[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:21:44.454044 24534 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.23.245.190:43513
I20260709 12:21:44.456423 24534 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:21:44.457602 24534 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:44.477663 24541 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:44.477654 24540 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:44.477654 24543 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:44.478181 24534 server_base.cc:1061] running on GCE node
I20260709 12:21:45.699638 24534 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:45.699889 24534 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:45.700136 24534 hybrid_clock.cc:648] HybridClock initialized: now 1783599705700112 us; error 0 us; skew 500 ppm
I20260709 12:21:45.700930 24534 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:45.707623 24534 webserver.cc:533] Webserver started at http://127.23.245.190:36823/ using document root <none> and password file <none>
I20260709 12:21:45.708534 24534 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:45.708734 24534 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:45.709127 24534 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:45.714978 24534 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599704270295-24534-0/minicluster-data/master-0-root/instance:
uuid: "a0be743c2e10439c947751bd17872f2c"
format_stamp: "Formatted at 2026-07-09 12:21:45 on dist-test-slave-mlt7"
I20260709 12:21:45.722817 24534 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.009s	sys 0.000s
I20260709 12:21:45.728142 24549 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:45.729357 24534 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:21:45.729692 24534 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599704270295-24534-0/minicluster-data/master-0-root
uuid: "a0be743c2e10439c947751bd17872f2c"
format_stamp: "Formatted at 2026-07-09 12:21:45 on dist-test-slave-mlt7"
I20260709 12:21:45.730062 24534 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599704270295-24534-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599704270295-24534-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599704270295-24534-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:45.790400 24534 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:45.792151 24534 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:21:45.792577 24534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:45.866155 24534 rpc_server.cc:307] RPC server started. Bound to: 127.23.245.190:43513
I20260709 12:21:45.866312 24600 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.245.190:43513 every 8 connection(s)
I20260709 12:21:45.874889 24601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:45.898499 24601 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0be743c2e10439c947751bd17872f2c: Bootstrap starting.
I20260709 12:21:45.904882 24601 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a0be743c2e10439c947751bd17872f2c: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:45.906962 24601 log.cc:826] T 00000000000000000000000000000000 P a0be743c2e10439c947751bd17872f2c: Log is configured to *not* fsync() on all Append() calls
I20260709 12:21:45.911716 24601 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0be743c2e10439c947751bd17872f2c: No bootstrap required, opened a new log
I20260709 12:21:45.934702 24601 raft_consensus.cc:359] T 00000000000000000000000000000000 P a0be743c2e10439c947751bd17872f2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0be743c2e10439c947751bd17872f2c" member_type: VOTER }
I20260709 12:21:45.935261 24601 raft_consensus.cc:385] T 00000000000000000000000000000000 P a0be743c2e10439c947751bd17872f2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:45.935470 24601 raft_consensus.cc:740] T 00000000000000000000000000000000 P a0be743c2e10439c947751bd17872f2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0be743c2e10439c947751bd17872f2c, State: Initialized, Role: FOLLOWER
I20260709 12:21:45.936291 24601 consensus_queue.cc:260] T 00000000000000000000000000000000 P a0be743c2e10439c947751bd17872f2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0be743c2e10439c947751bd17872f2c" member_type: VOTER }
I20260709 12:21:45.936762 24601 raft_consensus.cc:399] T 00000000000000000000000000000000 P a0be743c2e10439c947751bd17872f2c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:21:45.937008 24601 raft_consensus.cc:493] T 00000000000000000000000000000000 P a0be743c2e10439c947751bd17872f2c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:21:45.937289 24601 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a0be743c2e10439c947751bd17872f2c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:45.941535 24601 raft_consensus.cc:515] T 00000000000000000000000000000000 P a0be743c2e10439c947751bd17872f2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0be743c2e10439c947751bd17872f2c" member_type: VOTER }
I20260709 12:21:45.942260 24601 leader_election.cc:304] T 00000000000000000000000000000000 P a0be743c2e10439c947751bd17872f2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a0be743c2e10439c947751bd17872f2c; no voters: 
I20260709 12:21:45.943881 24601 leader_election.cc:290] T 00000000000000000000000000000000 P a0be743c2e10439c947751bd17872f2c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:21:45.944347 24604 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a0be743c2e10439c947751bd17872f2c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:45.946832 24604 raft_consensus.cc:697] T 00000000000000000000000000000000 P a0be743c2e10439c947751bd17872f2c [term 1 LEADER]: Becoming Leader. State: Replica: a0be743c2e10439c947751bd17872f2c, State: Running, Role: LEADER
I20260709 12:21:45.947662 24604 consensus_queue.cc:237] T 00000000000000000000000000000000 P a0be743c2e10439c947751bd17872f2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0be743c2e10439c947751bd17872f2c" member_type: VOTER }
I20260709 12:21:45.948285 24601 sys_catalog.cc:565] T 00000000000000000000000000000000 P a0be743c2e10439c947751bd17872f2c [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:21:45.959993 24605 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0be743c2e10439c947751bd17872f2c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a0be743c2e10439c947751bd17872f2c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0be743c2e10439c947751bd17872f2c" member_type: VOTER } }
I20260709 12:21:45.960958 24605 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0be743c2e10439c947751bd17872f2c [sys.catalog]: This master's current role is: LEADER
I20260709 12:21:45.961057 24606 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0be743c2e10439c947751bd17872f2c [sys.catalog]: SysCatalogTable state changed. Reason: New leader a0be743c2e10439c947751bd17872f2c. Latest consensus state: current_term: 1 leader_uuid: "a0be743c2e10439c947751bd17872f2c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0be743c2e10439c947751bd17872f2c" member_type: VOTER } }
I20260709 12:21:45.961726 24606 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0be743c2e10439c947751bd17872f2c [sys.catalog]: This master's current role is: LEADER
I20260709 12:21:45.963706 24614 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:21:45.978580 24614 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:21:45.981097 24534 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:21:45.996335 24614 catalog_manager.cc:1383] Generated new cluster ID: 5c71062f90fb496e9d0f4f3ec1d73e2e
I20260709 12:21:45.996675 24614 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:21:46.022962 24614 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:21:46.024636 24614 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:21:46.041934 24614 catalog_manager.cc:6070] T 00000000000000000000000000000000 P a0be743c2e10439c947751bd17872f2c: Generated new TSK 0
I20260709 12:21:46.042894 24614 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:21:46.048432 24534 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:46.059764 24623 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:46.063496 24624 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:46.067121 24626 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:46.068102 24534 server_base.cc:1061] running on GCE node
I20260709 12:21:46.068981 24534 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:46.069169 24534 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:46.069384 24534 hybrid_clock.cc:648] HybridClock initialized: now 1783599706069355 us; error 0 us; skew 500 ppm
I20260709 12:21:46.070158 24534 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:46.076092 24534 webserver.cc:533] Webserver started at http://127.23.245.129:46779/ using document root <none> and password file <none>
I20260709 12:21:46.076738 24534 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:46.076977 24534 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:46.077359 24534 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:46.078962 24534 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599704270295-24534-0/minicluster-data/ts-0-root/instance:
uuid: "36d4b1d255db4886a9bb549a0d4920fd"
format_stamp: "Formatted at 2026-07-09 12:21:46 on dist-test-slave-mlt7"
I20260709 12:21:46.085412 24534 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.004s	sys 0.004s
I20260709 12:21:46.090068 24631 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:46.090945 24534 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.002s
I20260709 12:21:46.091254 24534 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599704270295-24534-0/minicluster-data/ts-0-root
uuid: "36d4b1d255db4886a9bb549a0d4920fd"
format_stamp: "Formatted at 2026-07-09 12:21:46 on dist-test-slave-mlt7"
I20260709 12:21:46.091573 24534 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599704270295-24534-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599704270295-24534-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599704270295-24534-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:46.106880 24534 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:46.108359 24534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:46.111194 24534 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:21:46.115780 24534 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:21:46.116036 24534 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:21:46.116331 24534 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:21:46.116497 24534 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:46.224432 24534 rpc_server.cc:307] RPC server started. Bound to: 127.23.245.129:33613
I20260709 12:21:46.224504 24693 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.245.129:33613 every 8 connection(s)
I20260709 12:21:46.232237 24534 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:46.241530 24698 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:46.243561 24699 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:46.246583 24701 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:46.252171 24534 server_base.cc:1061] running on GCE node
I20260709 12:21:46.253244 24534 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:46.253572 24534 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:46.253788 24534 hybrid_clock.cc:648] HybridClock initialized: now 1783599706253770 us; error 0 us; skew 500 ppm
I20260709 12:21:46.254575 24534 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:46.257614 24534 webserver.cc:533] Webserver started at http://127.23.245.130:36959/ using document root <none> and password file <none>
I20260709 12:21:46.258023 24694 heartbeater.cc:344] Connected to a master server at 127.23.245.190:43513
I20260709 12:21:46.258275 24534 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:46.258525 24534 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:46.258533 24694 heartbeater.cc:461] Registering TS with master...
I20260709 12:21:46.258963 24534 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:46.259855 24694 heartbeater.cc:507] Master 127.23.245.190:43513 requested a full tablet report, sending...
I20260709 12:21:46.260253 24534 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599704270295-24534-0/minicluster-data/ts-1-root/instance:
uuid: "020e8ee127be4559a08dccacb1d2790b"
format_stamp: "Formatted at 2026-07-09 12:21:46 on dist-test-slave-mlt7"
I20260709 12:21:46.263520 24566 ts_manager.cc:194] Registered new tserver with Master: 36d4b1d255db4886a9bb549a0d4920fd (127.23.245.129:33613)
I20260709 12:21:46.266788 24566 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39242
I20260709 12:21:46.267886 24534 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:21:46.273681 24706 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:46.274672 24534 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.003s
I20260709 12:21:46.275038 24534 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599704270295-24534-0/minicluster-data/ts-1-root
uuid: "020e8ee127be4559a08dccacb1d2790b"
format_stamp: "Formatted at 2026-07-09 12:21:46 on dist-test-slave-mlt7"
I20260709 12:21:46.275411 24534 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599704270295-24534-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599704270295-24534-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599704270295-24534-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:46.301780 24534 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:46.303460 24534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:46.306043 24534 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:21:46.309870 24534 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:21:46.310144 24534 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:46.310444 24534 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:21:46.310649 24534 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:46.405786 24534 rpc_server.cc:307] RPC server started. Bound to: 127.23.245.130:44139
I20260709 12:21:46.405890 24769 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.245.130:44139 every 8 connection(s)
I20260709 12:21:46.413225 24534 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:46.423810 24774 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:46.423900 24773 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:46.428200 24770 heartbeater.cc:344] Connected to a master server at 127.23.245.190:43513
I20260709 12:21:46.428661 24770 heartbeater.cc:461] Registering TS with master...
I20260709 12:21:46.429687 24770 heartbeater.cc:507] Master 127.23.245.190:43513 requested a full tablet report, sending...
I20260709 12:21:46.430932 24534 server_base.cc:1061] running on GCE node
W20260709 12:21:46.431603 24776 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:46.432233 24566 ts_manager.cc:194] Registered new tserver with Master: 020e8ee127be4559a08dccacb1d2790b (127.23.245.130:44139)
I20260709 12:21:46.432552 24534 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:46.432755 24534 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:46.432889 24534 hybrid_clock.cc:648] HybridClock initialized: now 1783599706432878 us; error 0 us; skew 500 ppm
I20260709 12:21:46.433405 24534 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:46.434034 24566 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39246
I20260709 12:21:46.437510 24534 webserver.cc:533] Webserver started at http://127.23.245.131:43369/ using document root <none> and password file <none>
I20260709 12:21:46.438057 24534 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:46.438277 24534 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:46.438546 24534 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:46.439716 24534 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599704270295-24534-0/minicluster-data/ts-2-root/instance:
uuid: "08e1711cb2de485092226dd78ebcdb4c"
format_stamp: "Formatted at 2026-07-09 12:21:46 on dist-test-slave-mlt7"
I20260709 12:21:46.444773 24534 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:21:46.448505 24781 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:46.449476 24534 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.002s
I20260709 12:21:46.450004 24534 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599704270295-24534-0/minicluster-data/ts-2-root
uuid: "08e1711cb2de485092226dd78ebcdb4c"
format_stamp: "Formatted at 2026-07-09 12:21:46 on dist-test-slave-mlt7"
I20260709 12:21:46.450392 24534 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599704270295-24534-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599704270295-24534-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599704270295-24534-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:46.485878 24534 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:46.487445 24534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:46.488914 24534 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:21:46.491036 24534 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:21:46.491262 24534 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:46.491498 24534 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:21:46.491685 24534 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:46.585920 24534 rpc_server.cc:307] RPC server started. Bound to: 127.23.245.131:32793
I20260709 12:21:46.586016 24843 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.245.131:32793 every 8 connection(s)
I20260709 12:21:46.602306 24844 heartbeater.cc:344] Connected to a master server at 127.23.245.190:43513
I20260709 12:21:46.602694 24844 heartbeater.cc:461] Registering TS with master...
I20260709 12:21:46.603494 24844 heartbeater.cc:507] Master 127.23.245.190:43513 requested a full tablet report, sending...
I20260709 12:21:46.605536 24566 ts_manager.cc:194] Registered new tserver with Master: 08e1711cb2de485092226dd78ebcdb4c (127.23.245.131:32793)
I20260709 12:21:46.606159 24534 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016004385s
I20260709 12:21:46.607438 24566 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39248
I20260709 12:21:46.664175 24566 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39258:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:21:46.670120 24566 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:21:46.791409 24658 tablet_service.cc:1511] Processing CreateTablet for tablet 86d058965a9647e19043bf3db75c062f (DEFAULT_TABLE table=test-workload [id=bc797e93f1f54717b12489cbad5e0000]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:21:46.793273 24658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86d058965a9647e19043bf3db75c062f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:46.795050 24656 tablet_service.cc:1511] Processing CreateTablet for tablet 6345b2fc6a174d8299f0dd3307c8415a (DEFAULT_TABLE table=test-workload [id=bc797e93f1f54717b12489cbad5e0000]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:21:46.792629 24657 tablet_service.cc:1511] Processing CreateTablet for tablet 03bcafc1c9cc41c2b06d28c03004235e (DEFAULT_TABLE table=test-workload [id=bc797e93f1f54717b12489cbad5e0000]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:21:46.797972 24656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6345b2fc6a174d8299f0dd3307c8415a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:46.799068 24657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03bcafc1c9cc41c2b06d28c03004235e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:46.791433 24659 tablet_service.cc:1511] Processing CreateTablet for tablet 0f1b9086a754424297bb628279494e55 (DEFAULT_TABLE table=test-workload [id=bc797e93f1f54717b12489cbad5e0000]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:21:46.800170 24659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f1b9086a754424297bb628279494e55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:46.801403 24655 tablet_service.cc:1511] Processing CreateTablet for tablet cdc1bfaa521a420288862680a176a386 (DEFAULT_TABLE table=test-workload [id=bc797e93f1f54717b12489cbad5e0000]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:21:46.802685 24655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdc1bfaa521a420288862680a176a386. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:46.806402 24654 tablet_service.cc:1511] Processing CreateTablet for tablet 37a3d0199f90466490c70a3f3c466ca4 (DEFAULT_TABLE table=test-workload [id=bc797e93f1f54717b12489cbad5e0000]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:21:46.808461 24654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37a3d0199f90466490c70a3f3c466ca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:46.820689 24809 tablet_service.cc:1511] Processing CreateTablet for tablet 0f1b9086a754424297bb628279494e55 (DEFAULT_TABLE table=test-workload [id=bc797e93f1f54717b12489cbad5e0000]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:21:46.820915 24808 tablet_service.cc:1511] Processing CreateTablet for tablet 86d058965a9647e19043bf3db75c062f (DEFAULT_TABLE table=test-workload [id=bc797e93f1f54717b12489cbad5e0000]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:21:46.826728 24809 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f1b9086a754424297bb628279494e55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:46.830585 24806 tablet_service.cc:1511] Processing CreateTablet for tablet 6345b2fc6a174d8299f0dd3307c8415a (DEFAULT_TABLE table=test-workload [id=bc797e93f1f54717b12489cbad5e0000]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:21:46.832540 24804 tablet_service.cc:1511] Processing CreateTablet for tablet 37a3d0199f90466490c70a3f3c466ca4 (DEFAULT_TABLE table=test-workload [id=bc797e93f1f54717b12489cbad5e0000]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:21:46.833295 24807 tablet_service.cc:1511] Processing CreateTablet for tablet 03bcafc1c9cc41c2b06d28c03004235e (DEFAULT_TABLE table=test-workload [id=bc797e93f1f54717b12489cbad5e0000]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:21:46.832401 24805 tablet_service.cc:1511] Processing CreateTablet for tablet cdc1bfaa521a420288862680a176a386 (DEFAULT_TABLE table=test-workload [id=bc797e93f1f54717b12489cbad5e0000]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:21:46.837980 24808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86d058965a9647e19043bf3db75c062f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:46.840258 24804 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37a3d0199f90466490c70a3f3c466ca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:46.843251 24807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03bcafc1c9cc41c2b06d28c03004235e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:46.844194 24805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdc1bfaa521a420288862680a176a386. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:46.857151 24806 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6345b2fc6a174d8299f0dd3307c8415a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:46.857182 24653 tablet_service.cc:1511] Processing CreateTablet for tablet aa0b964a979d4687ba4fcf406e1b04a8 (DEFAULT_TABLE table=test-workload [id=bc797e93f1f54717b12489cbad5e0000]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:21:46.858862 24733 tablet_service.cc:1511] Processing CreateTablet for tablet 86d058965a9647e19043bf3db75c062f (DEFAULT_TABLE table=test-workload [id=bc797e93f1f54717b12489cbad5e0000]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:21:46.865963 24732 tablet_service.cc:1511] Processing CreateTablet for tablet 03bcafc1c9cc41c2b06d28c03004235e (DEFAULT_TABLE table=test-workload [id=bc797e93f1f54717b12489cbad5e0000]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:21:46.864420 24734 tablet_service.cc:1511] Processing CreateTablet for tablet 0f1b9086a754424297bb628279494e55 (DEFAULT_TABLE table=test-workload [id=bc797e93f1f54717b12489cbad5e0000]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:21:46.866410 24731 tablet_service.cc:1511] Processing CreateTablet for tablet 6345b2fc6a174d8299f0dd3307c8415a (DEFAULT_TABLE table=test-workload [id=bc797e93f1f54717b12489cbad5e0000]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:21:46.869966 24733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86d058965a9647e19043bf3db75c062f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:46.870409 24730 tablet_service.cc:1511] Processing CreateTablet for tablet cdc1bfaa521a420288862680a176a386 (DEFAULT_TABLE table=test-workload [id=bc797e93f1f54717b12489cbad5e0000]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:21:46.878762 24734 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f1b9086a754424297bb628279494e55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:46.878968 24653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa0b964a979d4687ba4fcf406e1b04a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:46.881961 24728 tablet_service.cc:1511] Processing CreateTablet for tablet aa0b964a979d4687ba4fcf406e1b04a8 (DEFAULT_TABLE table=test-workload [id=bc797e93f1f54717b12489cbad5e0000]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:21:46.885342 24729 tablet_service.cc:1511] Processing CreateTablet for tablet 37a3d0199f90466490c70a3f3c466ca4 (DEFAULT_TABLE table=test-workload [id=bc797e93f1f54717b12489cbad5e0000]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:21:46.885453 24803 tablet_service.cc:1511] Processing CreateTablet for tablet aa0b964a979d4687ba4fcf406e1b04a8 (DEFAULT_TABLE table=test-workload [id=bc797e93f1f54717b12489cbad5e0000]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:21:46.902278 24803 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa0b964a979d4687ba4fcf406e1b04a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:46.919744 24652 tablet_service.cc:1511] Processing CreateTablet for tablet 65345be99efc4ea7bf98c50f9f2678b8 (DEFAULT_TABLE table=test-workload [id=bc797e93f1f54717b12489cbad5e0000]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:21:46.921767 24652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65345be99efc4ea7bf98c50f9f2678b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:46.923442 24732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03bcafc1c9cc41c2b06d28c03004235e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:46.925004 24728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa0b964a979d4687ba4fcf406e1b04a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:46.932524 24729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37a3d0199f90466490c70a3f3c466ca4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:46.937211 24730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cdc1bfaa521a420288862680a176a386. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:46.942960 24731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6345b2fc6a174d8299f0dd3307c8415a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:46.954932 24727 tablet_service.cc:1511] Processing CreateTablet for tablet 65345be99efc4ea7bf98c50f9f2678b8 (DEFAULT_TABLE table=test-workload [id=bc797e93f1f54717b12489cbad5e0000]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:21:46.966717 24802 tablet_service.cc:1511] Processing CreateTablet for tablet 65345be99efc4ea7bf98c50f9f2678b8 (DEFAULT_TABLE table=test-workload [id=bc797e93f1f54717b12489cbad5e0000]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:21:46.970127 24802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65345be99efc4ea7bf98c50f9f2678b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:46.964141 24727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65345be99efc4ea7bf98c50f9f2678b8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:21:47.004597 24613 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:47.018788 24651 tablet_service.cc:1511] Processing CreateTablet for tablet d31655c39a4d409694a59895fb21c98f (DEFAULT_TABLE table=test-workload [id=bc797e93f1f54717b12489cbad5e0000]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:21:47.022060 24651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d31655c39a4d409694a59895fb21c98f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:47.051818 24726 tablet_service.cc:1511] Processing CreateTablet for tablet d31655c39a4d409694a59895fb21c98f (DEFAULT_TABLE table=test-workload [id=bc797e93f1f54717b12489cbad5e0000]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:21:47.054797 24726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d31655c39a4d409694a59895fb21c98f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:47.081337 24862 tablet_bootstrap.cc:492] T cdc1bfaa521a420288862680a176a386 P 36d4b1d255db4886a9bb549a0d4920fd: Bootstrap starting.
I20260709 12:21:47.103953 24801 tablet_service.cc:1511] Processing CreateTablet for tablet d31655c39a4d409694a59895fb21c98f (DEFAULT_TABLE table=test-workload [id=bc797e93f1f54717b12489cbad5e0000]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:21:47.118598 24801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d31655c39a4d409694a59895fb21c98f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:47.171940 24863 tablet_bootstrap.cc:492] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b: Bootstrap starting.
I20260709 12:21:47.198807 24864 tablet_bootstrap.cc:492] T aa0b964a979d4687ba4fcf406e1b04a8 P 08e1711cb2de485092226dd78ebcdb4c: Bootstrap starting.
I20260709 12:21:47.205071 24862 tablet_bootstrap.cc:654] T cdc1bfaa521a420288862680a176a386 P 36d4b1d255db4886a9bb549a0d4920fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:47.232746 24864 tablet_bootstrap.cc:654] T aa0b964a979d4687ba4fcf406e1b04a8 P 08e1711cb2de485092226dd78ebcdb4c: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:47.236675 24863 tablet_bootstrap.cc:654] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:47.247467 24862 tablet_bootstrap.cc:492] T cdc1bfaa521a420288862680a176a386 P 36d4b1d255db4886a9bb549a0d4920fd: No bootstrap required, opened a new log
I20260709 12:21:47.248205 24862 ts_tablet_manager.cc:1403] T cdc1bfaa521a420288862680a176a386 P 36d4b1d255db4886a9bb549a0d4920fd: Time spent bootstrapping tablet: real 0.172s	user 0.018s	sys 0.025s
I20260709 12:21:47.253665 24862 raft_consensus.cc:359] T cdc1bfaa521a420288862680a176a386 P 36d4b1d255db4886a9bb549a0d4920fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.254694 24862 raft_consensus.cc:385] T cdc1bfaa521a420288862680a176a386 P 36d4b1d255db4886a9bb549a0d4920fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:47.254953 24864 tablet_bootstrap.cc:492] T aa0b964a979d4687ba4fcf406e1b04a8 P 08e1711cb2de485092226dd78ebcdb4c: No bootstrap required, opened a new log
I20260709 12:21:47.255129 24862 raft_consensus.cc:740] T cdc1bfaa521a420288862680a176a386 P 36d4b1d255db4886a9bb549a0d4920fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36d4b1d255db4886a9bb549a0d4920fd, State: Initialized, Role: FOLLOWER
I20260709 12:21:47.255451 24864 ts_tablet_manager.cc:1403] T aa0b964a979d4687ba4fcf406e1b04a8 P 08e1711cb2de485092226dd78ebcdb4c: Time spent bootstrapping tablet: real 0.058s	user 0.004s	sys 0.016s
I20260709 12:21:47.257390 24862 consensus_queue.cc:260] T cdc1bfaa521a420288862680a176a386 P 36d4b1d255db4886a9bb549a0d4920fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.258780 24863 tablet_bootstrap.cc:492] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b: No bootstrap required, opened a new log
I20260709 12:21:47.258508 24864 raft_consensus.cc:359] T aa0b964a979d4687ba4fcf406e1b04a8 P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.259341 24864 raft_consensus.cc:385] T aa0b964a979d4687ba4fcf406e1b04a8 P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:47.259539 24863 ts_tablet_manager.cc:1403] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b: Time spent bootstrapping tablet: real 0.089s	user 0.014s	sys 0.017s
I20260709 12:21:47.259651 24864 raft_consensus.cc:740] T aa0b964a979d4687ba4fcf406e1b04a8 P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08e1711cb2de485092226dd78ebcdb4c, State: Initialized, Role: FOLLOWER
I20260709 12:21:47.261255 24864 consensus_queue.cc:260] T aa0b964a979d4687ba4fcf406e1b04a8 P 08e1711cb2de485092226dd78ebcdb4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.264750 24863 raft_consensus.cc:359] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.266871 24862 ts_tablet_manager.cc:1434] T cdc1bfaa521a420288862680a176a386 P 36d4b1d255db4886a9bb549a0d4920fd: Time spent starting tablet: real 0.018s	user 0.014s	sys 0.001s
I20260709 12:21:47.265633 24863 raft_consensus.cc:385] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:47.267395 24863 raft_consensus.cc:740] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 020e8ee127be4559a08dccacb1d2790b, State: Initialized, Role: FOLLOWER
I20260709 12:21:47.267764 24694 heartbeater.cc:499] Master 127.23.245.190:43513 was elected leader, sending a full tablet report...
I20260709 12:21:47.268316 24863 consensus_queue.cc:260] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.269404 24844 heartbeater.cc:499] Master 127.23.245.190:43513 was elected leader, sending a full tablet report...
I20260709 12:21:47.270437 24864 ts_tablet_manager.cc:1434] T aa0b964a979d4687ba4fcf406e1b04a8 P 08e1711cb2de485092226dd78ebcdb4c: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.007s
I20260709 12:21:47.271489 24864 tablet_bootstrap.cc:492] T 37a3d0199f90466490c70a3f3c466ca4 P 08e1711cb2de485092226dd78ebcdb4c: Bootstrap starting.
I20260709 12:21:47.274713 24862 tablet_bootstrap.cc:492] T 0f1b9086a754424297bb628279494e55 P 36d4b1d255db4886a9bb549a0d4920fd: Bootstrap starting.
I20260709 12:21:47.278431 24864 tablet_bootstrap.cc:654] T 37a3d0199f90466490c70a3f3c466ca4 P 08e1711cb2de485092226dd78ebcdb4c: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:47.285724 24862 tablet_bootstrap.cc:654] T 0f1b9086a754424297bb628279494e55 P 36d4b1d255db4886a9bb549a0d4920fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:47.287236 24770 heartbeater.cc:499] Master 127.23.245.190:43513 was elected leader, sending a full tablet report...
I20260709 12:21:47.287752 24863 ts_tablet_manager.cc:1434] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b: Time spent starting tablet: real 0.027s	user 0.017s	sys 0.007s
I20260709 12:21:47.289299 24863 tablet_bootstrap.cc:492] T 37a3d0199f90466490c70a3f3c466ca4 P 020e8ee127be4559a08dccacb1d2790b: Bootstrap starting.
I20260709 12:21:47.301653 24863 tablet_bootstrap.cc:654] T 37a3d0199f90466490c70a3f3c466ca4 P 020e8ee127be4559a08dccacb1d2790b: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:47.309270 24864 tablet_bootstrap.cc:492] T 37a3d0199f90466490c70a3f3c466ca4 P 08e1711cb2de485092226dd78ebcdb4c: No bootstrap required, opened a new log
I20260709 12:21:47.309754 24864 ts_tablet_manager.cc:1403] T 37a3d0199f90466490c70a3f3c466ca4 P 08e1711cb2de485092226dd78ebcdb4c: Time spent bootstrapping tablet: real 0.038s	user 0.016s	sys 0.007s
I20260709 12:21:47.319403 24863 tablet_bootstrap.cc:492] T 37a3d0199f90466490c70a3f3c466ca4 P 020e8ee127be4559a08dccacb1d2790b: No bootstrap required, opened a new log
I20260709 12:21:47.319941 24863 ts_tablet_manager.cc:1403] T 37a3d0199f90466490c70a3f3c466ca4 P 020e8ee127be4559a08dccacb1d2790b: Time spent bootstrapping tablet: real 0.031s	user 0.015s	sys 0.010s
I20260709 12:21:47.323833 24863 raft_consensus.cc:359] T 37a3d0199f90466490c70a3f3c466ca4 P 020e8ee127be4559a08dccacb1d2790b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.324548 24863 raft_consensus.cc:385] T 37a3d0199f90466490c70a3f3c466ca4 P 020e8ee127be4559a08dccacb1d2790b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:47.324832 24863 raft_consensus.cc:740] T 37a3d0199f90466490c70a3f3c466ca4 P 020e8ee127be4559a08dccacb1d2790b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 020e8ee127be4559a08dccacb1d2790b, State: Initialized, Role: FOLLOWER
I20260709 12:21:47.324726 24864 raft_consensus.cc:359] T 37a3d0199f90466490c70a3f3c466ca4 P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.325775 24864 raft_consensus.cc:385] T 37a3d0199f90466490c70a3f3c466ca4 P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:47.325673 24863 consensus_queue.cc:260] T 37a3d0199f90466490c70a3f3c466ca4 P 020e8ee127be4559a08dccacb1d2790b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.326220 24864 raft_consensus.cc:740] T 37a3d0199f90466490c70a3f3c466ca4 P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08e1711cb2de485092226dd78ebcdb4c, State: Initialized, Role: FOLLOWER
I20260709 12:21:47.327316 24864 consensus_queue.cc:260] T 37a3d0199f90466490c70a3f3c466ca4 P 08e1711cb2de485092226dd78ebcdb4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.328145 24863 ts_tablet_manager.cc:1434] T 37a3d0199f90466490c70a3f3c466ca4 P 020e8ee127be4559a08dccacb1d2790b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:21:47.329315 24863 tablet_bootstrap.cc:492] T 6345b2fc6a174d8299f0dd3307c8415a P 020e8ee127be4559a08dccacb1d2790b: Bootstrap starting.
I20260709 12:21:47.330116 24864 ts_tablet_manager.cc:1434] T 37a3d0199f90466490c70a3f3c466ca4 P 08e1711cb2de485092226dd78ebcdb4c: Time spent starting tablet: real 0.020s	user 0.002s	sys 0.006s
I20260709 12:21:47.331291 24864 tablet_bootstrap.cc:492] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c: Bootstrap starting.
I20260709 12:21:47.334318 24862 tablet_bootstrap.cc:492] T 0f1b9086a754424297bb628279494e55 P 36d4b1d255db4886a9bb549a0d4920fd: No bootstrap required, opened a new log
I20260709 12:21:47.334815 24862 ts_tablet_manager.cc:1403] T 0f1b9086a754424297bb628279494e55 P 36d4b1d255db4886a9bb549a0d4920fd: Time spent bootstrapping tablet: real 0.060s	user 0.012s	sys 0.020s
I20260709 12:21:47.335613 24863 tablet_bootstrap.cc:654] T 6345b2fc6a174d8299f0dd3307c8415a P 020e8ee127be4559a08dccacb1d2790b: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:47.337745 24862 raft_consensus.cc:359] T 0f1b9086a754424297bb628279494e55 P 36d4b1d255db4886a9bb549a0d4920fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } }
I20260709 12:21:47.338511 24862 raft_consensus.cc:385] T 0f1b9086a754424297bb628279494e55 P 36d4b1d255db4886a9bb549a0d4920fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:47.338703 24864 tablet_bootstrap.cc:654] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:47.338841 24862 raft_consensus.cc:740] T 0f1b9086a754424297bb628279494e55 P 36d4b1d255db4886a9bb549a0d4920fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36d4b1d255db4886a9bb549a0d4920fd, State: Initialized, Role: FOLLOWER
I20260709 12:21:47.339589 24862 consensus_queue.cc:260] T 0f1b9086a754424297bb628279494e55 P 36d4b1d255db4886a9bb549a0d4920fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } }
W20260709 12:21:47.342495 24845 tablet.cc:2406] T 37a3d0199f90466490c70a3f3c466ca4 P 08e1711cb2de485092226dd78ebcdb4c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:21:47.342114 24862 ts_tablet_manager.cc:1434] T 0f1b9086a754424297bb628279494e55 P 36d4b1d255db4886a9bb549a0d4920fd: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:21:47.345101 24862 tablet_bootstrap.cc:492] T 86d058965a9647e19043bf3db75c062f P 36d4b1d255db4886a9bb549a0d4920fd: Bootstrap starting.
I20260709 12:21:47.348057 24864 tablet_bootstrap.cc:492] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c: No bootstrap required, opened a new log
I20260709 12:21:47.348513 24864 ts_tablet_manager.cc:1403] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c: Time spent bootstrapping tablet: real 0.017s	user 0.003s	sys 0.009s
I20260709 12:21:47.351645 24862 tablet_bootstrap.cc:654] T 86d058965a9647e19043bf3db75c062f P 36d4b1d255db4886a9bb549a0d4920fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:47.351403 24864 raft_consensus.cc:359] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.352294 24864 raft_consensus.cc:385] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:47.352614 24864 raft_consensus.cc:740] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08e1711cb2de485092226dd78ebcdb4c, State: Initialized, Role: FOLLOWER
I20260709 12:21:47.353464 24864 consensus_queue.cc:260] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.355880 24864 ts_tablet_manager.cc:1434] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 12:21:47.357030 24864 tablet_bootstrap.cc:492] T 6345b2fc6a174d8299f0dd3307c8415a P 08e1711cb2de485092226dd78ebcdb4c: Bootstrap starting.
I20260709 12:21:47.362680 24862 tablet_bootstrap.cc:492] T 86d058965a9647e19043bf3db75c062f P 36d4b1d255db4886a9bb549a0d4920fd: No bootstrap required, opened a new log
I20260709 12:21:47.363166 24862 ts_tablet_manager.cc:1403] T 86d058965a9647e19043bf3db75c062f P 36d4b1d255db4886a9bb549a0d4920fd: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.007s
I20260709 12:21:47.365963 24862 raft_consensus.cc:359] T 86d058965a9647e19043bf3db75c062f P 36d4b1d255db4886a9bb549a0d4920fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.366832 24862 raft_consensus.cc:385] T 86d058965a9647e19043bf3db75c062f P 36d4b1d255db4886a9bb549a0d4920fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:47.367116 24862 raft_consensus.cc:740] T 86d058965a9647e19043bf3db75c062f P 36d4b1d255db4886a9bb549a0d4920fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36d4b1d255db4886a9bb549a0d4920fd, State: Initialized, Role: FOLLOWER
I20260709 12:21:47.367808 24862 consensus_queue.cc:260] T 86d058965a9647e19043bf3db75c062f P 36d4b1d255db4886a9bb549a0d4920fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.370126 24862 ts_tablet_manager.cc:1434] T 86d058965a9647e19043bf3db75c062f P 36d4b1d255db4886a9bb549a0d4920fd: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:21:47.371029 24862 tablet_bootstrap.cc:492] T 37a3d0199f90466490c70a3f3c466ca4 P 36d4b1d255db4886a9bb549a0d4920fd: Bootstrap starting.
I20260709 12:21:47.363776 24864 tablet_bootstrap.cc:654] T 6345b2fc6a174d8299f0dd3307c8415a P 08e1711cb2de485092226dd78ebcdb4c: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:47.378660 24862 tablet_bootstrap.cc:654] T 37a3d0199f90466490c70a3f3c466ca4 P 36d4b1d255db4886a9bb549a0d4920fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:47.386830 24869 raft_consensus.cc:493] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.387365 24869 raft_consensus.cc:515] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.392518 24869 leader_election.cc:290] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36d4b1d255db4886a9bb549a0d4920fd (127.23.245.129:33613), 020e8ee127be4559a08dccacb1d2790b (127.23.245.130:44139)
I20260709 12:21:47.399900 24863 tablet_bootstrap.cc:492] T 6345b2fc6a174d8299f0dd3307c8415a P 020e8ee127be4559a08dccacb1d2790b: No bootstrap required, opened a new log
I20260709 12:21:47.400517 24863 ts_tablet_manager.cc:1403] T 6345b2fc6a174d8299f0dd3307c8415a P 020e8ee127be4559a08dccacb1d2790b: Time spent bootstrapping tablet: real 0.071s	user 0.019s	sys 0.015s
I20260709 12:21:47.402109 24864 tablet_bootstrap.cc:492] T 6345b2fc6a174d8299f0dd3307c8415a P 08e1711cb2de485092226dd78ebcdb4c: No bootstrap required, opened a new log
I20260709 12:21:47.402581 24864 ts_tablet_manager.cc:1403] T 6345b2fc6a174d8299f0dd3307c8415a P 08e1711cb2de485092226dd78ebcdb4c: Time spent bootstrapping tablet: real 0.046s	user 0.012s	sys 0.002s
I20260709 12:21:47.403751 24863 raft_consensus.cc:359] T 6345b2fc6a174d8299f0dd3307c8415a P 020e8ee127be4559a08dccacb1d2790b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.404603 24863 raft_consensus.cc:385] T 6345b2fc6a174d8299f0dd3307c8415a P 020e8ee127be4559a08dccacb1d2790b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:47.404964 24863 raft_consensus.cc:740] T 6345b2fc6a174d8299f0dd3307c8415a P 020e8ee127be4559a08dccacb1d2790b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 020e8ee127be4559a08dccacb1d2790b, State: Initialized, Role: FOLLOWER
I20260709 12:21:47.406538 24862 tablet_bootstrap.cc:492] T 37a3d0199f90466490c70a3f3c466ca4 P 36d4b1d255db4886a9bb549a0d4920fd: No bootstrap required, opened a new log
I20260709 12:21:47.405896 24863 consensus_queue.cc:260] T 6345b2fc6a174d8299f0dd3307c8415a P 020e8ee127be4559a08dccacb1d2790b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.407052 24862 ts_tablet_manager.cc:1403] T 37a3d0199f90466490c70a3f3c466ca4 P 36d4b1d255db4886a9bb549a0d4920fd: Time spent bootstrapping tablet: real 0.036s	user 0.006s	sys 0.010s
I20260709 12:21:47.411080 24864 raft_consensus.cc:359] T 6345b2fc6a174d8299f0dd3307c8415a P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.411893 24864 raft_consensus.cc:385] T 6345b2fc6a174d8299f0dd3307c8415a P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:47.412212 24864 raft_consensus.cc:740] T 6345b2fc6a174d8299f0dd3307c8415a P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08e1711cb2de485092226dd78ebcdb4c, State: Initialized, Role: FOLLOWER
I20260709 12:21:47.414326 24862 raft_consensus.cc:359] T 37a3d0199f90466490c70a3f3c466ca4 P 36d4b1d255db4886a9bb549a0d4920fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.415069 24862 raft_consensus.cc:385] T 37a3d0199f90466490c70a3f3c466ca4 P 36d4b1d255db4886a9bb549a0d4920fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:47.414883 24864 consensus_queue.cc:260] T 6345b2fc6a174d8299f0dd3307c8415a P 08e1711cb2de485092226dd78ebcdb4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.418529 24864 ts_tablet_manager.cc:1434] T 6345b2fc6a174d8299f0dd3307c8415a P 08e1711cb2de485092226dd78ebcdb4c: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.004s
I20260709 12:21:47.419584 24864 tablet_bootstrap.cc:492] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c: Bootstrap starting.
I20260709 12:21:47.415372 24862 raft_consensus.cc:740] T 37a3d0199f90466490c70a3f3c466ca4 P 36d4b1d255db4886a9bb549a0d4920fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36d4b1d255db4886a9bb549a0d4920fd, State: Initialized, Role: FOLLOWER
I20260709 12:21:47.424959 24862 consensus_queue.cc:260] T 37a3d0199f90466490c70a3f3c466ca4 P 36d4b1d255db4886a9bb549a0d4920fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.426497 24864 tablet_bootstrap.cc:654] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:47.430915 24862 ts_tablet_manager.cc:1434] T 37a3d0199f90466490c70a3f3c466ca4 P 36d4b1d255db4886a9bb549a0d4920fd: Time spent starting tablet: real 0.023s	user 0.002s	sys 0.004s
I20260709 12:21:47.431905 24862 tablet_bootstrap.cc:492] T 65345be99efc4ea7bf98c50f9f2678b8 P 36d4b1d255db4886a9bb549a0d4920fd: Bootstrap starting.
I20260709 12:21:47.445900 24863 ts_tablet_manager.cc:1434] T 6345b2fc6a174d8299f0dd3307c8415a P 020e8ee127be4559a08dccacb1d2790b: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.001s
I20260709 12:21:47.455672 24863 tablet_bootstrap.cc:492] T d31655c39a4d409694a59895fb21c98f P 020e8ee127be4559a08dccacb1d2790b: Bootstrap starting.
I20260709 12:21:47.456310 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdc1bfaa521a420288862680a176a386" candidate_uuid: "08e1711cb2de485092226dd78ebcdb4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36d4b1d255db4886a9bb549a0d4920fd" is_pre_election: true
I20260709 12:21:47.457199 24669 raft_consensus.cc:2468] T cdc1bfaa521a420288862680a176a386 P 36d4b1d255db4886a9bb549a0d4920fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08e1711cb2de485092226dd78ebcdb4c in term 0.
I20260709 12:21:47.458830 24744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdc1bfaa521a420288862680a176a386" candidate_uuid: "08e1711cb2de485092226dd78ebcdb4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "020e8ee127be4559a08dccacb1d2790b" is_pre_election: true
W20260709 12:21:47.460745 24785 leader_election.cc:343] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 020e8ee127be4559a08dccacb1d2790b (127.23.245.130:44139): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:47.461532 24785 leader_election.cc:304] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08e1711cb2de485092226dd78ebcdb4c, 36d4b1d255db4886a9bb549a0d4920fd; no voters: 020e8ee127be4559a08dccacb1d2790b
I20260709 12:21:47.462333 24869 raft_consensus.cc:2804] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:47.462702 24869 raft_consensus.cc:493] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:47.462754 24868 raft_consensus.cc:493] T 37a3d0199f90466490c70a3f3c466ca4 P 36d4b1d255db4886a9bb549a0d4920fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.463090 24869 raft_consensus.cc:3060] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:47.463282 24868 raft_consensus.cc:515] T 37a3d0199f90466490c70a3f3c466ca4 P 36d4b1d255db4886a9bb549a0d4920fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.464103 24863 tablet_bootstrap.cc:654] T d31655c39a4d409694a59895fb21c98f P 020e8ee127be4559a08dccacb1d2790b: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:47.466109 24868 leader_election.cc:290] T 37a3d0199f90466490c70a3f3c466ca4 P 36d4b1d255db4886a9bb549a0d4920fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 020e8ee127be4559a08dccacb1d2790b (127.23.245.130:44139), 08e1711cb2de485092226dd78ebcdb4c (127.23.245.131:32793)
I20260709 12:21:47.466910 24862 tablet_bootstrap.cc:654] T 65345be99efc4ea7bf98c50f9f2678b8 P 36d4b1d255db4886a9bb549a0d4920fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:47.471835 24869 raft_consensus.cc:515] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.475872 24869 leader_election.cc:290] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c [CANDIDATE]: Term 1 election: Requested vote from peers 36d4b1d255db4886a9bb549a0d4920fd (127.23.245.129:33613), 020e8ee127be4559a08dccacb1d2790b (127.23.245.130:44139)
I20260709 12:21:47.476214 24744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdc1bfaa521a420288862680a176a386" candidate_uuid: "08e1711cb2de485092226dd78ebcdb4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "020e8ee127be4559a08dccacb1d2790b"
W20260709 12:21:47.478072 24785 leader_election.cc:343] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 020e8ee127be4559a08dccacb1d2790b (127.23.245.130:44139): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:47.479354 24864 tablet_bootstrap.cc:492] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c: No bootstrap required, opened a new log
I20260709 12:21:47.479746 24864 ts_tablet_manager.cc:1403] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c: Time spent bootstrapping tablet: real 0.060s	user 0.011s	sys 0.031s
I20260709 12:21:47.482573 24864 raft_consensus.cc:359] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.483121 24864 raft_consensus.cc:385] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:47.483361 24864 raft_consensus.cc:740] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08e1711cb2de485092226dd78ebcdb4c, State: Initialized, Role: FOLLOWER
I20260709 12:21:47.484270 24862 tablet_bootstrap.cc:492] T 65345be99efc4ea7bf98c50f9f2678b8 P 36d4b1d255db4886a9bb549a0d4920fd: No bootstrap required, opened a new log
I20260709 12:21:47.484074 24864 consensus_queue.cc:260] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.484841 24862 ts_tablet_manager.cc:1403] T 65345be99efc4ea7bf98c50f9f2678b8 P 36d4b1d255db4886a9bb549a0d4920fd: Time spent bootstrapping tablet: real 0.053s	user 0.013s	sys 0.000s
I20260709 12:21:47.486697 24863 tablet_bootstrap.cc:492] T d31655c39a4d409694a59895fb21c98f P 020e8ee127be4559a08dccacb1d2790b: No bootstrap required, opened a new log
I20260709 12:21:47.487141 24863 ts_tablet_manager.cc:1403] T d31655c39a4d409694a59895fb21c98f P 020e8ee127be4559a08dccacb1d2790b: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.005s
I20260709 12:21:47.488008 24862 raft_consensus.cc:359] T 65345be99efc4ea7bf98c50f9f2678b8 P 36d4b1d255db4886a9bb549a0d4920fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.488726 24862 raft_consensus.cc:385] T 65345be99efc4ea7bf98c50f9f2678b8 P 36d4b1d255db4886a9bb549a0d4920fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:47.489022 24862 raft_consensus.cc:740] T 65345be99efc4ea7bf98c50f9f2678b8 P 36d4b1d255db4886a9bb549a0d4920fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36d4b1d255db4886a9bb549a0d4920fd, State: Initialized, Role: FOLLOWER
I20260709 12:21:47.489995 24869 raft_consensus.cc:493] T aa0b964a979d4687ba4fcf406e1b04a8 P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.489802 24862 consensus_queue.cc:260] T 65345be99efc4ea7bf98c50f9f2678b8 P 36d4b1d255db4886a9bb549a0d4920fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.490445 24869 raft_consensus.cc:515] T aa0b964a979d4687ba4fcf406e1b04a8 P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.492525 24869 leader_election.cc:290] T aa0b964a979d4687ba4fcf406e1b04a8 P 08e1711cb2de485092226dd78ebcdb4c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36d4b1d255db4886a9bb549a0d4920fd (127.23.245.129:33613), 020e8ee127be4559a08dccacb1d2790b (127.23.245.130:44139)
I20260709 12:21:47.493429 24862 ts_tablet_manager.cc:1434] T 65345be99efc4ea7bf98c50f9f2678b8 P 36d4b1d255db4886a9bb549a0d4920fd: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:21:47.494573 24862 tablet_bootstrap.cc:492] T 03bcafc1c9cc41c2b06d28c03004235e P 36d4b1d255db4886a9bb549a0d4920fd: Bootstrap starting.
I20260709 12:21:47.494992 24864 ts_tablet_manager.cc:1434] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:21:47.495273 24744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0b964a979d4687ba4fcf406e1b04a8" candidate_uuid: "08e1711cb2de485092226dd78ebcdb4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "020e8ee127be4559a08dccacb1d2790b" is_pre_election: true
I20260709 12:21:47.495985 24864 tablet_bootstrap.cc:492] T 0f1b9086a754424297bb628279494e55 P 08e1711cb2de485092226dd78ebcdb4c: Bootstrap starting.
W20260709 12:21:47.502086 24785 leader_election.cc:343] T aa0b964a979d4687ba4fcf406e1b04a8 P 08e1711cb2de485092226dd78ebcdb4c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 020e8ee127be4559a08dccacb1d2790b (127.23.245.130:44139): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:47.503504 24862 tablet_bootstrap.cc:654] T 03bcafc1c9cc41c2b06d28c03004235e P 36d4b1d255db4886a9bb549a0d4920fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:47.509496 24744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a3d0199f90466490c70a3f3c466ca4" candidate_uuid: "36d4b1d255db4886a9bb549a0d4920fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "020e8ee127be4559a08dccacb1d2790b" is_pre_election: true
I20260709 12:21:47.510154 24744 raft_consensus.cc:2468] T 37a3d0199f90466490c70a3f3c466ca4 P 020e8ee127be4559a08dccacb1d2790b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36d4b1d255db4886a9bb549a0d4920fd in term 0.
I20260709 12:21:47.510938 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdc1bfaa521a420288862680a176a386" candidate_uuid: "08e1711cb2de485092226dd78ebcdb4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36d4b1d255db4886a9bb549a0d4920fd"
I20260709 12:21:47.511687 24669 raft_consensus.cc:3060] T cdc1bfaa521a420288862680a176a386 P 36d4b1d255db4886a9bb549a0d4920fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:47.513923 24864 tablet_bootstrap.cc:654] T 0f1b9086a754424297bb628279494e55 P 08e1711cb2de485092226dd78ebcdb4c: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:47.516484 24635 leader_election.cc:304] T 37a3d0199f90466490c70a3f3c466ca4 P 36d4b1d255db4886a9bb549a0d4920fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 020e8ee127be4559a08dccacb1d2790b, 36d4b1d255db4886a9bb549a0d4920fd; no voters: 
I20260709 12:21:47.517696 24868 raft_consensus.cc:2804] T 37a3d0199f90466490c70a3f3c466ca4 P 36d4b1d255db4886a9bb549a0d4920fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:47.518069 24868 raft_consensus.cc:493] T 37a3d0199f90466490c70a3f3c466ca4 P 36d4b1d255db4886a9bb549a0d4920fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:47.518431 24868 raft_consensus.cc:3060] T 37a3d0199f90466490c70a3f3c466ca4 P 36d4b1d255db4886a9bb549a0d4920fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:47.518538 24870 raft_consensus.cc:493] T 6345b2fc6a174d8299f0dd3307c8415a P 020e8ee127be4559a08dccacb1d2790b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.519081 24870 raft_consensus.cc:515] T 6345b2fc6a174d8299f0dd3307c8415a P 020e8ee127be4559a08dccacb1d2790b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.521974 24870 leader_election.cc:290] T 6345b2fc6a174d8299f0dd3307c8415a P 020e8ee127be4559a08dccacb1d2790b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36d4b1d255db4886a9bb549a0d4920fd (127.23.245.129:33613), 08e1711cb2de485092226dd78ebcdb4c (127.23.245.131:32793)
I20260709 12:21:47.521986 24669 raft_consensus.cc:2468] T cdc1bfaa521a420288862680a176a386 P 36d4b1d255db4886a9bb549a0d4920fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08e1711cb2de485092226dd78ebcdb4c in term 1.
I20260709 12:21:47.523624 24785 leader_election.cc:304] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08e1711cb2de485092226dd78ebcdb4c, 36d4b1d255db4886a9bb549a0d4920fd; no voters: 020e8ee127be4559a08dccacb1d2790b
I20260709 12:21:47.524444 24869 raft_consensus.cc:2804] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:47.525018 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0b964a979d4687ba4fcf406e1b04a8" candidate_uuid: "08e1711cb2de485092226dd78ebcdb4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36d4b1d255db4886a9bb549a0d4920fd" is_pre_election: true
I20260709 12:21:47.525956 24868 raft_consensus.cc:515] T 37a3d0199f90466490c70a3f3c466ca4 P 36d4b1d255db4886a9bb549a0d4920fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
W20260709 12:21:47.526366 24785 leader_election.cc:343] T aa0b964a979d4687ba4fcf406e1b04a8 P 08e1711cb2de485092226dd78ebcdb4c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 36d4b1d255db4886a9bb549a0d4920fd (127.23.245.129:33613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:47.526505 24863 raft_consensus.cc:359] T d31655c39a4d409694a59895fb21c98f P 020e8ee127be4559a08dccacb1d2790b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.526805 24785 leader_election.cc:304] T aa0b964a979d4687ba4fcf406e1b04a8 P 08e1711cb2de485092226dd78ebcdb4c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08e1711cb2de485092226dd78ebcdb4c; no voters: 020e8ee127be4559a08dccacb1d2790b, 36d4b1d255db4886a9bb549a0d4920fd
I20260709 12:21:47.527246 24863 raft_consensus.cc:385] T d31655c39a4d409694a59895fb21c98f P 020e8ee127be4559a08dccacb1d2790b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:47.527551 24863 raft_consensus.cc:740] T d31655c39a4d409694a59895fb21c98f P 020e8ee127be4559a08dccacb1d2790b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 020e8ee127be4559a08dccacb1d2790b, State: Initialized, Role: FOLLOWER
I20260709 12:21:47.528050 24868 leader_election.cc:290] T 37a3d0199f90466490c70a3f3c466ca4 P 36d4b1d255db4886a9bb549a0d4920fd [CANDIDATE]: Term 1 election: Requested vote from peers 020e8ee127be4559a08dccacb1d2790b (127.23.245.130:44139), 08e1711cb2de485092226dd78ebcdb4c (127.23.245.131:32793)
I20260709 12:21:47.528755 24863 consensus_queue.cc:260] T d31655c39a4d409694a59895fb21c98f P 020e8ee127be4559a08dccacb1d2790b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.531196 24819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a3d0199f90466490c70a3f3c466ca4" candidate_uuid: "36d4b1d255db4886a9bb549a0d4920fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08e1711cb2de485092226dd78ebcdb4c" is_pre_election: true
I20260709 12:21:47.532421 24818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a3d0199f90466490c70a3f3c466ca4" candidate_uuid: "36d4b1d255db4886a9bb549a0d4920fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08e1711cb2de485092226dd78ebcdb4c"
I20260709 12:21:47.533767 24819 raft_consensus.cc:2468] T 37a3d0199f90466490c70a3f3c466ca4 P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36d4b1d255db4886a9bb549a0d4920fd in term 0.
I20260709 12:21:47.537976 24869 raft_consensus.cc:697] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c [term 1 LEADER]: Becoming Leader. State: Replica: 08e1711cb2de485092226dd78ebcdb4c, State: Running, Role: LEADER
I20260709 12:21:47.538582 24893 raft_consensus.cc:2749] T aa0b964a979d4687ba4fcf406e1b04a8 P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:47.539008 24869 consensus_queue.cc:237] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.548677 24870 raft_consensus.cc:493] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.549301 24870 raft_consensus.cc:515] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.551060 24864 tablet_bootstrap.cc:492] T 0f1b9086a754424297bb628279494e55 P 08e1711cb2de485092226dd78ebcdb4c: No bootstrap required, opened a new log
I20260709 12:21:47.551519 24870 leader_election.cc:290] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36d4b1d255db4886a9bb549a0d4920fd (127.23.245.129:33613), 08e1711cb2de485092226dd78ebcdb4c (127.23.245.131:32793)
I20260709 12:21:47.551550 24864 ts_tablet_manager.cc:1403] T 0f1b9086a754424297bb628279494e55 P 08e1711cb2de485092226dd78ebcdb4c: Time spent bootstrapping tablet: real 0.056s	user 0.013s	sys 0.000s
I20260709 12:21:47.553675 24862 tablet_bootstrap.cc:492] T 03bcafc1c9cc41c2b06d28c03004235e P 36d4b1d255db4886a9bb549a0d4920fd: No bootstrap required, opened a new log
I20260709 12:21:47.554150 24862 ts_tablet_manager.cc:1403] T 03bcafc1c9cc41c2b06d28c03004235e P 36d4b1d255db4886a9bb549a0d4920fd: Time spent bootstrapping tablet: real 0.060s	user 0.017s	sys 0.005s
I20260709 12:21:47.550801 24566 catalog_manager.cc:5697] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c reported cstate change: term changed from 0 to 1, leader changed from <none> to 08e1711cb2de485092226dd78ebcdb4c (127.23.245.131). New cstate: current_term: 1 leader_uuid: "08e1711cb2de485092226dd78ebcdb4c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:47.559208 24864 raft_consensus.cc:359] T 0f1b9086a754424297bb628279494e55 P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } }
I20260709 12:21:47.559984 24864 raft_consensus.cc:385] T 0f1b9086a754424297bb628279494e55 P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:47.560278 24864 raft_consensus.cc:740] T 0f1b9086a754424297bb628279494e55 P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08e1711cb2de485092226dd78ebcdb4c, State: Initialized, Role: FOLLOWER
I20260709 12:21:47.561019 24864 consensus_queue.cc:260] T 0f1b9086a754424297bb628279494e55 P 08e1711cb2de485092226dd78ebcdb4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } }
I20260709 12:21:47.567508 24864 ts_tablet_manager.cc:1434] T 0f1b9086a754424297bb628279494e55 P 08e1711cb2de485092226dd78ebcdb4c: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:21:47.568679 24864 tablet_bootstrap.cc:492] T 86d058965a9647e19043bf3db75c062f P 08e1711cb2de485092226dd78ebcdb4c: Bootstrap starting.
I20260709 12:21:47.569104 24862 raft_consensus.cc:359] T 03bcafc1c9cc41c2b06d28c03004235e P 36d4b1d255db4886a9bb549a0d4920fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.569764 24863 ts_tablet_manager.cc:1434] T d31655c39a4d409694a59895fb21c98f P 020e8ee127be4559a08dccacb1d2790b: Time spent starting tablet: real 0.082s	user 0.006s	sys 0.000s
I20260709 12:21:47.569864 24862 raft_consensus.cc:385] T 03bcafc1c9cc41c2b06d28c03004235e P 36d4b1d255db4886a9bb549a0d4920fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:47.570350 24862 raft_consensus.cc:740] T 03bcafc1c9cc41c2b06d28c03004235e P 36d4b1d255db4886a9bb549a0d4920fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36d4b1d255db4886a9bb549a0d4920fd, State: Initialized, Role: FOLLOWER
I20260709 12:21:47.570758 24863 tablet_bootstrap.cc:492] T 0f1b9086a754424297bb628279494e55 P 020e8ee127be4559a08dccacb1d2790b: Bootstrap starting.
I20260709 12:21:47.571200 24862 consensus_queue.cc:260] T 03bcafc1c9cc41c2b06d28c03004235e P 36d4b1d255db4886a9bb549a0d4920fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.574144 24862 ts_tablet_manager.cc:1434] T 03bcafc1c9cc41c2b06d28c03004235e P 36d4b1d255db4886a9bb549a0d4920fd: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.002s
I20260709 12:21:47.576637 24862 tablet_bootstrap.cc:492] T 6345b2fc6a174d8299f0dd3307c8415a P 36d4b1d255db4886a9bb549a0d4920fd: Bootstrap starting.
I20260709 12:21:47.582623 24864 tablet_bootstrap.cc:654] T 86d058965a9647e19043bf3db75c062f P 08e1711cb2de485092226dd78ebcdb4c: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:47.589239 24862 tablet_bootstrap.cc:654] T 6345b2fc6a174d8299f0dd3307c8415a P 36d4b1d255db4886a9bb549a0d4920fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:47.596195 24869 raft_consensus.cc:493] T 0f1b9086a754424297bb628279494e55 P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.596836 24869 raft_consensus.cc:515] T 0f1b9086a754424297bb628279494e55 P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } }
I20260709 12:21:47.599418 24869 leader_election.cc:290] T 0f1b9086a754424297bb628279494e55 P 08e1711cb2de485092226dd78ebcdb4c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36d4b1d255db4886a9bb549a0d4920fd (127.23.245.129:33613), 020e8ee127be4559a08dccacb1d2790b (127.23.245.130:44139)
I20260709 12:21:47.600703 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1b9086a754424297bb628279494e55" candidate_uuid: "08e1711cb2de485092226dd78ebcdb4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36d4b1d255db4886a9bb549a0d4920fd" is_pre_election: true
I20260709 12:21:47.601511 24669 raft_consensus.cc:2468] T 0f1b9086a754424297bb628279494e55 P 36d4b1d255db4886a9bb549a0d4920fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08e1711cb2de485092226dd78ebcdb4c in term 0.
I20260709 12:21:47.602193 24864 tablet_bootstrap.cc:492] T 86d058965a9647e19043bf3db75c062f P 08e1711cb2de485092226dd78ebcdb4c: No bootstrap required, opened a new log
I20260709 12:21:47.602703 24864 ts_tablet_manager.cc:1403] T 86d058965a9647e19043bf3db75c062f P 08e1711cb2de485092226dd78ebcdb4c: Time spent bootstrapping tablet: real 0.034s	user 0.005s	sys 0.007s
I20260709 12:21:47.603204 24785 leader_election.cc:304] T 0f1b9086a754424297bb628279494e55 P 08e1711cb2de485092226dd78ebcdb4c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08e1711cb2de485092226dd78ebcdb4c, 36d4b1d255db4886a9bb549a0d4920fd; no voters: 
I20260709 12:21:47.604204 24869 raft_consensus.cc:2804] T 0f1b9086a754424297bb628279494e55 P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:47.604595 24869 raft_consensus.cc:493] T 0f1b9086a754424297bb628279494e55 P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:47.604938 24869 raft_consensus.cc:3060] T 0f1b9086a754424297bb628279494e55 P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:47.609532 24862 tablet_bootstrap.cc:492] T 6345b2fc6a174d8299f0dd3307c8415a P 36d4b1d255db4886a9bb549a0d4920fd: No bootstrap required, opened a new log
I20260709 12:21:47.610009 24862 ts_tablet_manager.cc:1403] T 6345b2fc6a174d8299f0dd3307c8415a P 36d4b1d255db4886a9bb549a0d4920fd: Time spent bootstrapping tablet: real 0.034s	user 0.006s	sys 0.007s
I20260709 12:21:47.611691 24869 raft_consensus.cc:515] T 0f1b9086a754424297bb628279494e55 P 08e1711cb2de485092226dd78ebcdb4c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } }
I20260709 12:21:47.627156 24742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a3d0199f90466490c70a3f3c466ca4" candidate_uuid: "36d4b1d255db4886a9bb549a0d4920fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "020e8ee127be4559a08dccacb1d2790b"
I20260709 12:21:47.613824 24869 leader_election.cc:290] T 0f1b9086a754424297bb628279494e55 P 08e1711cb2de485092226dd78ebcdb4c [CANDIDATE]: Term 1 election: Requested vote from peers 36d4b1d255db4886a9bb549a0d4920fd (127.23.245.129:33613), 020e8ee127be4559a08dccacb1d2790b (127.23.245.130:44139)
I20260709 12:21:47.632844 24864 raft_consensus.cc:359] T 86d058965a9647e19043bf3db75c062f P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.635227 24742 raft_consensus.cc:3060] T 37a3d0199f90466490c70a3f3c466ca4 P 020e8ee127be4559a08dccacb1d2790b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:47.635676 24864 raft_consensus.cc:385] T 86d058965a9647e19043bf3db75c062f P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:47.615188 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1b9086a754424297bb628279494e55" candidate_uuid: "08e1711cb2de485092226dd78ebcdb4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36d4b1d255db4886a9bb549a0d4920fd"
I20260709 12:21:47.636087 24864 raft_consensus.cc:740] T 86d058965a9647e19043bf3db75c062f P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08e1711cb2de485092226dd78ebcdb4c, State: Initialized, Role: FOLLOWER
I20260709 12:21:47.621848 24743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1b9086a754424297bb628279494e55" candidate_uuid: "08e1711cb2de485092226dd78ebcdb4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "020e8ee127be4559a08dccacb1d2790b"
I20260709 12:21:47.637735 24669 raft_consensus.cc:3060] T 0f1b9086a754424297bb628279494e55 P 36d4b1d255db4886a9bb549a0d4920fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:47.637470 24864 consensus_queue.cc:260] T 86d058965a9647e19043bf3db75c062f P 08e1711cb2de485092226dd78ebcdb4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.613677 24744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1b9086a754424297bb628279494e55" candidate_uuid: "08e1711cb2de485092226dd78ebcdb4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "020e8ee127be4559a08dccacb1d2790b" is_pre_election: true
I20260709 12:21:47.640245 24864 ts_tablet_manager.cc:1434] T 86d058965a9647e19043bf3db75c062f P 08e1711cb2de485092226dd78ebcdb4c: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.008s
I20260709 12:21:47.641281 24864 tablet_bootstrap.cc:492] T 65345be99efc4ea7bf98c50f9f2678b8 P 08e1711cb2de485092226dd78ebcdb4c: Bootstrap starting.
I20260709 12:21:47.642879 24742 raft_consensus.cc:2468] T 37a3d0199f90466490c70a3f3c466ca4 P 020e8ee127be4559a08dccacb1d2790b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36d4b1d255db4886a9bb549a0d4920fd in term 1.
I20260709 12:21:47.619835 24895 raft_consensus.cc:493] T 6345b2fc6a174d8299f0dd3307c8415a P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.646396 24895 raft_consensus.cc:515] T 6345b2fc6a174d8299f0dd3307c8415a P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.648039 24864 tablet_bootstrap.cc:654] T 65345be99efc4ea7bf98c50f9f2678b8 P 08e1711cb2de485092226dd78ebcdb4c: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:47.648797 24895 leader_election.cc:290] T 6345b2fc6a174d8299f0dd3307c8415a P 08e1711cb2de485092226dd78ebcdb4c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36d4b1d255db4886a9bb549a0d4920fd (127.23.245.129:33613), 020e8ee127be4559a08dccacb1d2790b (127.23.245.130:44139)
I20260709 12:21:47.650424 24635 leader_election.cc:304] T 37a3d0199f90466490c70a3f3c466ca4 P 36d4b1d255db4886a9bb549a0d4920fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 020e8ee127be4559a08dccacb1d2790b, 36d4b1d255db4886a9bb549a0d4920fd; no voters: 08e1711cb2de485092226dd78ebcdb4c
I20260709 12:21:47.651528 24868 raft_consensus.cc:2804] T 37a3d0199f90466490c70a3f3c466ca4 P 36d4b1d255db4886a9bb549a0d4920fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:47.644538 24669 raft_consensus.cc:2468] T 0f1b9086a754424297bb628279494e55 P 36d4b1d255db4886a9bb549a0d4920fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08e1711cb2de485092226dd78ebcdb4c in term 1.
W20260709 12:21:47.645305 24785 leader_election.cc:343] T 0f1b9086a754424297bb628279494e55 P 08e1711cb2de485092226dd78ebcdb4c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 020e8ee127be4559a08dccacb1d2790b (127.23.245.130:44139): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:47.645478 24862 raft_consensus.cc:359] T 6345b2fc6a174d8299f0dd3307c8415a P 36d4b1d255db4886a9bb549a0d4920fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.657325 24862 raft_consensus.cc:385] T 6345b2fc6a174d8299f0dd3307c8415a P 36d4b1d255db4886a9bb549a0d4920fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:21:47.657562 24785 leader_election.cc:343] T 0f1b9086a754424297bb628279494e55 P 08e1711cb2de485092226dd78ebcdb4c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 020e8ee127be4559a08dccacb1d2790b (127.23.245.130:44139): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:47.657678 24862 raft_consensus.cc:740] T 6345b2fc6a174d8299f0dd3307c8415a P 36d4b1d255db4886a9bb549a0d4920fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36d4b1d255db4886a9bb549a0d4920fd, State: Initialized, Role: FOLLOWER
I20260709 12:21:47.634147 24863 tablet_bootstrap.cc:654] T 0f1b9086a754424297bb628279494e55 P 020e8ee127be4559a08dccacb1d2790b: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:47.659480 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6345b2fc6a174d8299f0dd3307c8415a" candidate_uuid: "08e1711cb2de485092226dd78ebcdb4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36d4b1d255db4886a9bb549a0d4920fd" is_pre_election: true
I20260709 12:21:47.658469 24862 consensus_queue.cc:260] T 6345b2fc6a174d8299f0dd3307c8415a P 36d4b1d255db4886a9bb549a0d4920fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.661866 24668 raft_consensus.cc:2468] T 6345b2fc6a174d8299f0dd3307c8415a P 36d4b1d255db4886a9bb549a0d4920fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08e1711cb2de485092226dd78ebcdb4c in term 0.
I20260709 12:21:47.665011 24742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6345b2fc6a174d8299f0dd3307c8415a" candidate_uuid: "08e1711cb2de485092226dd78ebcdb4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "020e8ee127be4559a08dccacb1d2790b" is_pre_election: true
I20260709 12:21:47.665767 24742 raft_consensus.cc:2468] T 6345b2fc6a174d8299f0dd3307c8415a P 020e8ee127be4559a08dccacb1d2790b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08e1711cb2de485092226dd78ebcdb4c in term 0.
I20260709 12:21:47.666553 24785 leader_election.cc:304] T 6345b2fc6a174d8299f0dd3307c8415a P 08e1711cb2de485092226dd78ebcdb4c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08e1711cb2de485092226dd78ebcdb4c, 36d4b1d255db4886a9bb549a0d4920fd; no voters: 
I20260709 12:21:47.668678 24785 leader_election.cc:304] T 0f1b9086a754424297bb628279494e55 P 08e1711cb2de485092226dd78ebcdb4c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08e1711cb2de485092226dd78ebcdb4c, 36d4b1d255db4886a9bb549a0d4920fd; no voters: 020e8ee127be4559a08dccacb1d2790b
I20260709 12:21:47.669673 24869 raft_consensus.cc:2804] T 6345b2fc6a174d8299f0dd3307c8415a P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:47.670082 24869 raft_consensus.cc:493] T 6345b2fc6a174d8299f0dd3307c8415a P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:47.670096 24895 raft_consensus.cc:2804] T 0f1b9086a754424297bb628279494e55 P 08e1711cb2de485092226dd78ebcdb4c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:47.670729 24869 raft_consensus.cc:3060] T 6345b2fc6a174d8299f0dd3307c8415a P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:47.671147 24895 raft_consensus.cc:697] T 0f1b9086a754424297bb628279494e55 P 08e1711cb2de485092226dd78ebcdb4c [term 1 LEADER]: Becoming Leader. State: Replica: 08e1711cb2de485092226dd78ebcdb4c, State: Running, Role: LEADER
I20260709 12:21:47.672071 24895 consensus_queue.cc:237] T 0f1b9086a754424297bb628279494e55 P 08e1711cb2de485092226dd78ebcdb4c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } }
I20260709 12:21:47.677821 24902 raft_consensus.cc:493] T 65345be99efc4ea7bf98c50f9f2678b8 P 36d4b1d255db4886a9bb549a0d4920fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.682911 24818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d058965a9647e19043bf3db75c062f" candidate_uuid: "020e8ee127be4559a08dccacb1d2790b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08e1711cb2de485092226dd78ebcdb4c" is_pre_election: true
I20260709 12:21:47.683643 24818 raft_consensus.cc:2468] T 86d058965a9647e19043bf3db75c062f P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 020e8ee127be4559a08dccacb1d2790b in term 0.
I20260709 12:21:47.683437 24902 raft_consensus.cc:515] T 65345be99efc4ea7bf98c50f9f2678b8 P 36d4b1d255db4886a9bb549a0d4920fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.677646 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6345b2fc6a174d8299f0dd3307c8415a" candidate_uuid: "020e8ee127be4559a08dccacb1d2790b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36d4b1d255db4886a9bb549a0d4920fd" is_pre_election: true
I20260709 12:21:47.684665 24669 raft_consensus.cc:2468] T 6345b2fc6a174d8299f0dd3307c8415a P 36d4b1d255db4886a9bb549a0d4920fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 020e8ee127be4559a08dccacb1d2790b in term 0.
I20260709 12:21:47.677956 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d058965a9647e19043bf3db75c062f" candidate_uuid: "020e8ee127be4559a08dccacb1d2790b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36d4b1d255db4886a9bb549a0d4920fd" is_pre_election: true
I20260709 12:21:47.678324 24868 raft_consensus.cc:697] T 37a3d0199f90466490c70a3f3c466ca4 P 36d4b1d255db4886a9bb549a0d4920fd [term 1 LEADER]: Becoming Leader. State: Replica: 36d4b1d255db4886a9bb549a0d4920fd, State: Running, Role: LEADER
I20260709 12:21:47.685737 24668 raft_consensus.cc:2468] T 86d058965a9647e19043bf3db75c062f P 36d4b1d255db4886a9bb549a0d4920fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 020e8ee127be4559a08dccacb1d2790b in term 0.
I20260709 12:21:47.682157 24819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6345b2fc6a174d8299f0dd3307c8415a" candidate_uuid: "020e8ee127be4559a08dccacb1d2790b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08e1711cb2de485092226dd78ebcdb4c" is_pre_election: true
I20260709 12:21:47.686131 24868 consensus_queue.cc:237] T 37a3d0199f90466490c70a3f3c466ca4 P 36d4b1d255db4886a9bb549a0d4920fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.687024 24710 leader_election.cc:304] T 6345b2fc6a174d8299f0dd3307c8415a P 020e8ee127be4559a08dccacb1d2790b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 020e8ee127be4559a08dccacb1d2790b, 36d4b1d255db4886a9bb549a0d4920fd; no voters: 
I20260709 12:21:47.687644 24708 leader_election.cc:304] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 020e8ee127be4559a08dccacb1d2790b, 08e1711cb2de485092226dd78ebcdb4c; no voters: 
I20260709 12:21:47.688130 24896 raft_consensus.cc:2804] T 6345b2fc6a174d8299f0dd3307c8415a P 020e8ee127be4559a08dccacb1d2790b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:47.688571 24896 raft_consensus.cc:493] T 6345b2fc6a174d8299f0dd3307c8415a P 020e8ee127be4559a08dccacb1d2790b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:47.681783 24869 raft_consensus.cc:515] T 6345b2fc6a174d8299f0dd3307c8415a P 08e1711cb2de485092226dd78ebcdb4c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.691047 24864 tablet_bootstrap.cc:492] T 65345be99efc4ea7bf98c50f9f2678b8 P 08e1711cb2de485092226dd78ebcdb4c: No bootstrap required, opened a new log
I20260709 12:21:47.691201 24819 raft_consensus.cc:2393] T 6345b2fc6a174d8299f0dd3307c8415a P 08e1711cb2de485092226dd78ebcdb4c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 020e8ee127be4559a08dccacb1d2790b in current term 1: Already voted for candidate 08e1711cb2de485092226dd78ebcdb4c in this term.
I20260709 12:21:47.691519 24864 ts_tablet_manager.cc:1403] T 65345be99efc4ea7bf98c50f9f2678b8 P 08e1711cb2de485092226dd78ebcdb4c: Time spent bootstrapping tablet: real 0.050s	user 0.014s	sys 0.008s
I20260709 12:21:47.682883 24862 ts_tablet_manager.cc:1434] T 6345b2fc6a174d8299f0dd3307c8415a P 36d4b1d255db4886a9bb549a0d4920fd: Time spent starting tablet: real 0.071s	user 0.010s	sys 0.001s
I20260709 12:21:47.692297 24863 tablet_bootstrap.cc:492] T 0f1b9086a754424297bb628279494e55 P 020e8ee127be4559a08dccacb1d2790b: No bootstrap required, opened a new log
I20260709 12:21:47.692915 24863 ts_tablet_manager.cc:1403] T 0f1b9086a754424297bb628279494e55 P 020e8ee127be4559a08dccacb1d2790b: Time spent bootstrapping tablet: real 0.122s	user 0.017s	sys 0.000s
I20260709 12:21:47.693982 24862 tablet_bootstrap.cc:492] T aa0b964a979d4687ba4fcf406e1b04a8 P 36d4b1d255db4886a9bb549a0d4920fd: Bootstrap starting.
I20260709 12:21:47.694303 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6345b2fc6a174d8299f0dd3307c8415a" candidate_uuid: "08e1711cb2de485092226dd78ebcdb4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36d4b1d255db4886a9bb549a0d4920fd"
I20260709 12:21:47.694741 24869 leader_election.cc:290] T 6345b2fc6a174d8299f0dd3307c8415a P 08e1711cb2de485092226dd78ebcdb4c [CANDIDATE]: Term 1 election: Requested vote from peers 36d4b1d255db4886a9bb549a0d4920fd (127.23.245.129:33613), 020e8ee127be4559a08dccacb1d2790b (127.23.245.130:44139)
I20260709 12:21:47.696556 24744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6345b2fc6a174d8299f0dd3307c8415a" candidate_uuid: "08e1711cb2de485092226dd78ebcdb4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "020e8ee127be4559a08dccacb1d2790b"
I20260709 12:21:47.695623 24668 raft_consensus.cc:3060] T 6345b2fc6a174d8299f0dd3307c8415a P 36d4b1d255db4886a9bb549a0d4920fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:47.697240 24864 raft_consensus.cc:359] T 65345be99efc4ea7bf98c50f9f2678b8 P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.697916 24864 raft_consensus.cc:385] T 65345be99efc4ea7bf98c50f9f2678b8 P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:47.698210 24864 raft_consensus.cc:740] T 65345be99efc4ea7bf98c50f9f2678b8 P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08e1711cb2de485092226dd78ebcdb4c, State: Initialized, Role: FOLLOWER
I20260709 12:21:47.699030 24864 consensus_queue.cc:260] T 65345be99efc4ea7bf98c50f9f2678b8 P 08e1711cb2de485092226dd78ebcdb4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.701325 24864 ts_tablet_manager.cc:1434] T 65345be99efc4ea7bf98c50f9f2678b8 P 08e1711cb2de485092226dd78ebcdb4c: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:21:47.702288 24864 tablet_bootstrap.cc:492] T d31655c39a4d409694a59895fb21c98f P 08e1711cb2de485092226dd78ebcdb4c: Bootstrap starting.
I20260709 12:21:47.702520 24862 tablet_bootstrap.cc:654] T aa0b964a979d4687ba4fcf406e1b04a8 P 36d4b1d255db4886a9bb549a0d4920fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:47.704524 24668 raft_consensus.cc:2468] T 6345b2fc6a174d8299f0dd3307c8415a P 36d4b1d255db4886a9bb549a0d4920fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08e1711cb2de485092226dd78ebcdb4c in term 1.
I20260709 12:21:47.708211 24870 raft_consensus.cc:2804] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:47.708835 24742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65345be99efc4ea7bf98c50f9f2678b8" candidate_uuid: "36d4b1d255db4886a9bb549a0d4920fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "020e8ee127be4559a08dccacb1d2790b" is_pre_election: true
I20260709 12:21:47.709021 24870 raft_consensus.cc:493] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:47.709542 24870 raft_consensus.cc:3060] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:47.688910 24896 raft_consensus.cc:3060] T 6345b2fc6a174d8299f0dd3307c8415a P 020e8ee127be4559a08dccacb1d2790b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:47.711151 24902 leader_election.cc:290] T 65345be99efc4ea7bf98c50f9f2678b8 P 36d4b1d255db4886a9bb549a0d4920fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 020e8ee127be4559a08dccacb1d2790b (127.23.245.130:44139), 08e1711cb2de485092226dd78ebcdb4c (127.23.245.131:32793)
I20260709 12:21:47.713771 24819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65345be99efc4ea7bf98c50f9f2678b8" candidate_uuid: "36d4b1d255db4886a9bb549a0d4920fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08e1711cb2de485092226dd78ebcdb4c" is_pre_election: true
W20260709 12:21:47.713598 24635 leader_election.cc:343] T 65345be99efc4ea7bf98c50f9f2678b8 P 36d4b1d255db4886a9bb549a0d4920fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 020e8ee127be4559a08dccacb1d2790b (127.23.245.130:44139): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:47.715508 24819 raft_consensus.cc:2468] T 65345be99efc4ea7bf98c50f9f2678b8 P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36d4b1d255db4886a9bb549a0d4920fd in term 0.
I20260709 12:21:47.717772 24633 leader_election.cc:304] T 65345be99efc4ea7bf98c50f9f2678b8 P 36d4b1d255db4886a9bb549a0d4920fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08e1711cb2de485092226dd78ebcdb4c, 36d4b1d255db4886a9bb549a0d4920fd; no voters: 020e8ee127be4559a08dccacb1d2790b
I20260709 12:21:47.719048 24902 raft_consensus.cc:2804] T 65345be99efc4ea7bf98c50f9f2678b8 P 36d4b1d255db4886a9bb549a0d4920fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:47.718657 24863 raft_consensus.cc:359] T 0f1b9086a754424297bb628279494e55 P 020e8ee127be4559a08dccacb1d2790b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } }
I20260709 12:21:47.719424 24902 raft_consensus.cc:493] T 65345be99efc4ea7bf98c50f9f2678b8 P 36d4b1d255db4886a9bb549a0d4920fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:47.719760 24902 raft_consensus.cc:3060] T 65345be99efc4ea7bf98c50f9f2678b8 P 36d4b1d255db4886a9bb549a0d4920fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:47.717371 24785 leader_election.cc:304] T 6345b2fc6a174d8299f0dd3307c8415a P 08e1711cb2de485092226dd78ebcdb4c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08e1711cb2de485092226dd78ebcdb4c, 36d4b1d255db4886a9bb549a0d4920fd; no voters: 
I20260709 12:21:47.721531 24895 raft_consensus.cc:2804] T 6345b2fc6a174d8299f0dd3307c8415a P 08e1711cb2de485092226dd78ebcdb4c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:47.721990 24895 raft_consensus.cc:697] T 6345b2fc6a174d8299f0dd3307c8415a P 08e1711cb2de485092226dd78ebcdb4c [term 1 LEADER]: Becoming Leader. State: Replica: 08e1711cb2de485092226dd78ebcdb4c, State: Running, Role: LEADER
I20260709 12:21:47.719712 24863 raft_consensus.cc:385] T 0f1b9086a754424297bb628279494e55 P 020e8ee127be4559a08dccacb1d2790b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:47.724103 24895 consensus_queue.cc:237] T 6345b2fc6a174d8299f0dd3307c8415a P 08e1711cb2de485092226dd78ebcdb4c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.724764 24863 raft_consensus.cc:740] T 0f1b9086a754424297bb628279494e55 P 020e8ee127be4559a08dccacb1d2790b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 020e8ee127be4559a08dccacb1d2790b, State: Initialized, Role: FOLLOWER
I20260709 12:21:47.742581 24896 raft_consensus.cc:515] T 6345b2fc6a174d8299f0dd3307c8415a P 020e8ee127be4559a08dccacb1d2790b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.732712 24863 consensus_queue.cc:260] T 0f1b9086a754424297bb628279494e55 P 020e8ee127be4559a08dccacb1d2790b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } }
I20260709 12:21:47.748431 24744 raft_consensus.cc:2393] T 6345b2fc6a174d8299f0dd3307c8415a P 020e8ee127be4559a08dccacb1d2790b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 08e1711cb2de485092226dd78ebcdb4c in current term 1: Already voted for candidate 020e8ee127be4559a08dccacb1d2790b in this term.
I20260709 12:21:47.746851 24902 raft_consensus.cc:515] T 65345be99efc4ea7bf98c50f9f2678b8 P 36d4b1d255db4886a9bb549a0d4920fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.759824 24862 tablet_bootstrap.cc:492] T aa0b964a979d4687ba4fcf406e1b04a8 P 36d4b1d255db4886a9bb549a0d4920fd: No bootstrap required, opened a new log
I20260709 12:21:47.760391 24862 ts_tablet_manager.cc:1403] T aa0b964a979d4687ba4fcf406e1b04a8 P 36d4b1d255db4886a9bb549a0d4920fd: Time spent bootstrapping tablet: real 0.067s	user 0.015s	sys 0.007s
I20260709 12:21:47.763226 24862 raft_consensus.cc:359] T aa0b964a979d4687ba4fcf406e1b04a8 P 36d4b1d255db4886a9bb549a0d4920fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.763952 24862 raft_consensus.cc:385] T aa0b964a979d4687ba4fcf406e1b04a8 P 36d4b1d255db4886a9bb549a0d4920fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:47.764501 24895 raft_consensus.cc:493] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.764566 24863 ts_tablet_manager.cc:1434] T 0f1b9086a754424297bb628279494e55 P 020e8ee127be4559a08dccacb1d2790b: Time spent starting tablet: real 0.071s	user 0.014s	sys 0.000s
I20260709 12:21:47.765734 24895 raft_consensus.cc:515] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.769033 24864 tablet_bootstrap.cc:654] T d31655c39a4d409694a59895fb21c98f P 08e1711cb2de485092226dd78ebcdb4c: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:47.769218 24895 leader_election.cc:290] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36d4b1d255db4886a9bb549a0d4920fd (127.23.245.129:33613), 020e8ee127be4559a08dccacb1d2790b (127.23.245.130:44139)
I20260709 12:21:47.770913 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bcafc1c9cc41c2b06d28c03004235e" candidate_uuid: "08e1711cb2de485092226dd78ebcdb4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36d4b1d255db4886a9bb549a0d4920fd" is_pre_election: true
I20260709 12:21:47.766827 24862 raft_consensus.cc:740] T aa0b964a979d4687ba4fcf406e1b04a8 P 36d4b1d255db4886a9bb549a0d4920fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36d4b1d255db4886a9bb549a0d4920fd, State: Initialized, Role: FOLLOWER
I20260709 12:21:47.772552 24668 raft_consensus.cc:2468] T 03bcafc1c9cc41c2b06d28c03004235e P 36d4b1d255db4886a9bb549a0d4920fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08e1711cb2de485092226dd78ebcdb4c in term 0.
I20260709 12:21:47.773077 24862 consensus_queue.cc:260] T aa0b964a979d4687ba4fcf406e1b04a8 P 36d4b1d255db4886a9bb549a0d4920fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.774355 24785 leader_election.cc:304] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08e1711cb2de485092226dd78ebcdb4c, 36d4b1d255db4886a9bb549a0d4920fd; no voters: 
I20260709 12:21:47.775246 24895 raft_consensus.cc:2804] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:47.775666 24895 raft_consensus.cc:493] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:47.775817 24862 ts_tablet_manager.cc:1434] T aa0b964a979d4687ba4fcf406e1b04a8 P 36d4b1d255db4886a9bb549a0d4920fd: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 12:21:47.776160 24895 raft_consensus.cc:3060] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:47.776818 24862 tablet_bootstrap.cc:492] T d31655c39a4d409694a59895fb21c98f P 36d4b1d255db4886a9bb549a0d4920fd: Bootstrap starting.
I20260709 12:21:47.772465 24744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bcafc1c9cc41c2b06d28c03004235e" candidate_uuid: "08e1711cb2de485092226dd78ebcdb4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "020e8ee127be4559a08dccacb1d2790b" is_pre_election: true
W20260709 12:21:47.781106 24785 leader_election.cc:343] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 020e8ee127be4559a08dccacb1d2790b (127.23.245.130:44139): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:47.782328 24902 leader_election.cc:290] T 65345be99efc4ea7bf98c50f9f2678b8 P 36d4b1d255db4886a9bb549a0d4920fd [CANDIDATE]: Term 1 election: Requested vote from peers 020e8ee127be4559a08dccacb1d2790b (127.23.245.130:44139), 08e1711cb2de485092226dd78ebcdb4c (127.23.245.131:32793)
I20260709 12:21:47.783748 24819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65345be99efc4ea7bf98c50f9f2678b8" candidate_uuid: "36d4b1d255db4886a9bb549a0d4920fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08e1711cb2de485092226dd78ebcdb4c"
I20260709 12:21:47.784329 24819 raft_consensus.cc:3060] T 65345be99efc4ea7bf98c50f9f2678b8 P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:47.785264 24896 leader_election.cc:290] T 6345b2fc6a174d8299f0dd3307c8415a P 020e8ee127be4559a08dccacb1d2790b [CANDIDATE]: Term 1 election: Requested vote from peers 36d4b1d255db4886a9bb549a0d4920fd (127.23.245.129:33613), 08e1711cb2de485092226dd78ebcdb4c (127.23.245.131:32793)
I20260709 12:21:47.789642 24744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65345be99efc4ea7bf98c50f9f2678b8" candidate_uuid: "36d4b1d255db4886a9bb549a0d4920fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "020e8ee127be4559a08dccacb1d2790b"
I20260709 12:21:47.790531 24870 raft_consensus.cc:515] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
W20260709 12:21:47.791548 24635 leader_election.cc:343] T 65345be99efc4ea7bf98c50f9f2678b8 P 36d4b1d255db4886a9bb549a0d4920fd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 020e8ee127be4559a08dccacb1d2790b (127.23.245.130:44139): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:47.792470 24870 leader_election.cc:290] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b [CANDIDATE]: Term 1 election: Requested vote from peers 36d4b1d255db4886a9bb549a0d4920fd (127.23.245.129:33613), 08e1711cb2de485092226dd78ebcdb4c (127.23.245.131:32793)
I20260709 12:21:47.788296 24863 tablet_bootstrap.cc:492] T cdc1bfaa521a420288862680a176a386 P 020e8ee127be4559a08dccacb1d2790b: Bootstrap starting.
I20260709 12:21:47.795729 24862 tablet_bootstrap.cc:654] T d31655c39a4d409694a59895fb21c98f P 36d4b1d255db4886a9bb549a0d4920fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:47.789219 24818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6345b2fc6a174d8299f0dd3307c8415a" candidate_uuid: "020e8ee127be4559a08dccacb1d2790b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08e1711cb2de485092226dd78ebcdb4c"
I20260709 12:21:47.797124 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6345b2fc6a174d8299f0dd3307c8415a" candidate_uuid: "020e8ee127be4559a08dccacb1d2790b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36d4b1d255db4886a9bb549a0d4920fd"
I20260709 12:21:47.797238 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d058965a9647e19043bf3db75c062f" candidate_uuid: "020e8ee127be4559a08dccacb1d2790b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36d4b1d255db4886a9bb549a0d4920fd"
I20260709 12:21:47.795539 24817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d058965a9647e19043bf3db75c062f" candidate_uuid: "020e8ee127be4559a08dccacb1d2790b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08e1711cb2de485092226dd78ebcdb4c"
I20260709 12:21:47.803025 24668 raft_consensus.cc:2393] T 6345b2fc6a174d8299f0dd3307c8415a P 36d4b1d255db4886a9bb549a0d4920fd [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 020e8ee127be4559a08dccacb1d2790b in current term 1: Already voted for candidate 08e1711cb2de485092226dd78ebcdb4c in this term.
I20260709 12:21:47.803795 24817 raft_consensus.cc:3060] T 86d058965a9647e19043bf3db75c062f P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:47.802359 24669 raft_consensus.cc:3060] T 86d058965a9647e19043bf3db75c062f P 36d4b1d255db4886a9bb549a0d4920fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:47.804917 24710 leader_election.cc:304] T 6345b2fc6a174d8299f0dd3307c8415a P 020e8ee127be4559a08dccacb1d2790b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 020e8ee127be4559a08dccacb1d2790b; no voters: 08e1711cb2de485092226dd78ebcdb4c, 36d4b1d255db4886a9bb549a0d4920fd
I20260709 12:21:47.807225 24564 catalog_manager.cc:5697] T 37a3d0199f90466490c70a3f3c466ca4 P 36d4b1d255db4886a9bb549a0d4920fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 36d4b1d255db4886a9bb549a0d4920fd (127.23.245.129). New cstate: current_term: 1 leader_uuid: "36d4b1d255db4886a9bb549a0d4920fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:47.807794 24870 raft_consensus.cc:2749] T 6345b2fc6a174d8299f0dd3307c8415a P 020e8ee127be4559a08dccacb1d2790b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:21:47.812851 24895 raft_consensus.cc:515] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.815474 24895 leader_election.cc:290] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c [CANDIDATE]: Term 1 election: Requested vote from peers 36d4b1d255db4886a9bb549a0d4920fd (127.23.245.129:33613), 020e8ee127be4559a08dccacb1d2790b (127.23.245.130:44139)
I20260709 12:21:47.816598 24864 tablet_bootstrap.cc:492] T d31655c39a4d409694a59895fb21c98f P 08e1711cb2de485092226dd78ebcdb4c: No bootstrap required, opened a new log
I20260709 12:21:47.817041 24864 ts_tablet_manager.cc:1403] T d31655c39a4d409694a59895fb21c98f P 08e1711cb2de485092226dd78ebcdb4c: Time spent bootstrapping tablet: real 0.115s	user 0.015s	sys 0.000s
I20260709 12:21:47.818253 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bcafc1c9cc41c2b06d28c03004235e" candidate_uuid: "08e1711cb2de485092226dd78ebcdb4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36d4b1d255db4886a9bb549a0d4920fd"
I20260709 12:21:47.818948 24668 raft_consensus.cc:3060] T 03bcafc1c9cc41c2b06d28c03004235e P 36d4b1d255db4886a9bb549a0d4920fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:47.821038 24863 tablet_bootstrap.cc:654] T cdc1bfaa521a420288862680a176a386 P 020e8ee127be4559a08dccacb1d2790b: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:47.822283 24744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bcafc1c9cc41c2b06d28c03004235e" candidate_uuid: "08e1711cb2de485092226dd78ebcdb4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "020e8ee127be4559a08dccacb1d2790b"
I20260709 12:21:47.822599 24669 raft_consensus.cc:2468] T 86d058965a9647e19043bf3db75c062f P 36d4b1d255db4886a9bb549a0d4920fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 020e8ee127be4559a08dccacb1d2790b in term 1.
W20260709 12:21:47.824129 24785 leader_election.cc:343] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 020e8ee127be4559a08dccacb1d2790b (127.23.245.130:44139): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:47.826993 24864 raft_consensus.cc:359] T d31655c39a4d409694a59895fb21c98f P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.827574 24668 raft_consensus.cc:2468] T 03bcafc1c9cc41c2b06d28c03004235e P 36d4b1d255db4886a9bb549a0d4920fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08e1711cb2de485092226dd78ebcdb4c in term 1.
I20260709 12:21:47.841090 24864 raft_consensus.cc:385] T d31655c39a4d409694a59895fb21c98f P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:47.812027 24819 raft_consensus.cc:2468] T 65345be99efc4ea7bf98c50f9f2678b8 P 08e1711cb2de485092226dd78ebcdb4c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36d4b1d255db4886a9bb549a0d4920fd in term 1.
I20260709 12:21:47.841409 24864 raft_consensus.cc:740] T d31655c39a4d409694a59895fb21c98f P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08e1711cb2de485092226dd78ebcdb4c, State: Initialized, Role: FOLLOWER
I20260709 12:21:47.828593 24817 raft_consensus.cc:2468] T 86d058965a9647e19043bf3db75c062f P 08e1711cb2de485092226dd78ebcdb4c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 020e8ee127be4559a08dccacb1d2790b in term 1.
I20260709 12:21:47.842140 24864 consensus_queue.cc:260] T d31655c39a4d409694a59895fb21c98f P 08e1711cb2de485092226dd78ebcdb4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.843109 24785 leader_election.cc:304] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08e1711cb2de485092226dd78ebcdb4c, 36d4b1d255db4886a9bb549a0d4920fd; no voters: 020e8ee127be4559a08dccacb1d2790b
I20260709 12:21:47.844182 24864 ts_tablet_manager.cc:1434] T d31655c39a4d409694a59895fb21c98f P 08e1711cb2de485092226dd78ebcdb4c: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 12:21:47.844300 24633 leader_election.cc:304] T 65345be99efc4ea7bf98c50f9f2678b8 P 36d4b1d255db4886a9bb549a0d4920fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08e1711cb2de485092226dd78ebcdb4c, 36d4b1d255db4886a9bb549a0d4920fd; no voters: 020e8ee127be4559a08dccacb1d2790b
I20260709 12:21:47.829008 24710 leader_election.cc:304] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 020e8ee127be4559a08dccacb1d2790b, 36d4b1d255db4886a9bb549a0d4920fd; no voters: 
I20260709 12:21:47.845705 24895 raft_consensus.cc:2804] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:47.846171 24895 raft_consensus.cc:697] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c [term 1 LEADER]: Becoming Leader. State: Replica: 08e1711cb2de485092226dd78ebcdb4c, State: Running, Role: LEADER
I20260709 12:21:47.846995 24895 consensus_queue.cc:237] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.849086 24868 raft_consensus.cc:2804] T 65345be99efc4ea7bf98c50f9f2678b8 P 36d4b1d255db4886a9bb549a0d4920fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:47.849763 24868 raft_consensus.cc:697] T 65345be99efc4ea7bf98c50f9f2678b8 P 36d4b1d255db4886a9bb549a0d4920fd [term 1 LEADER]: Becoming Leader. State: Replica: 36d4b1d255db4886a9bb549a0d4920fd, State: Running, Role: LEADER
I20260709 12:21:47.850630 24868 consensus_queue.cc:237] T 65345be99efc4ea7bf98c50f9f2678b8 P 36d4b1d255db4886a9bb549a0d4920fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.847594 24870 raft_consensus.cc:2804] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:47.852237 24870 raft_consensus.cc:697] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b [term 1 LEADER]: Becoming Leader. State: Replica: 020e8ee127be4559a08dccacb1d2790b, State: Running, Role: LEADER
I20260709 12:21:47.852999 24870 consensus_queue.cc:237] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.853794 24566 catalog_manager.cc:5697] T 0f1b9086a754424297bb628279494e55 P 08e1711cb2de485092226dd78ebcdb4c reported cstate change: term changed from 0 to 1, leader changed from <none> to 08e1711cb2de485092226dd78ebcdb4c (127.23.245.131). New cstate: current_term: 1 leader_uuid: "08e1711cb2de485092226dd78ebcdb4c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:47.839344 24863 tablet_bootstrap.cc:492] T cdc1bfaa521a420288862680a176a386 P 020e8ee127be4559a08dccacb1d2790b: No bootstrap required, opened a new log
I20260709 12:21:47.856926 24863 ts_tablet_manager.cc:1403] T cdc1bfaa521a420288862680a176a386 P 020e8ee127be4559a08dccacb1d2790b: Time spent bootstrapping tablet: real 0.072s	user 0.012s	sys 0.007s
I20260709 12:21:47.857697 24566 catalog_manager.cc:5697] T 6345b2fc6a174d8299f0dd3307c8415a P 08e1711cb2de485092226dd78ebcdb4c reported cstate change: term changed from 0 to 1, leader changed from <none> to 08e1711cb2de485092226dd78ebcdb4c (127.23.245.131). New cstate: current_term: 1 leader_uuid: "08e1711cb2de485092226dd78ebcdb4c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:47.861418 24863 raft_consensus.cc:359] T cdc1bfaa521a420288862680a176a386 P 020e8ee127be4559a08dccacb1d2790b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.862159 24863 raft_consensus.cc:385] T cdc1bfaa521a420288862680a176a386 P 020e8ee127be4559a08dccacb1d2790b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:47.862466 24863 raft_consensus.cc:740] T cdc1bfaa521a420288862680a176a386 P 020e8ee127be4559a08dccacb1d2790b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 020e8ee127be4559a08dccacb1d2790b, State: Initialized, Role: FOLLOWER
I20260709 12:21:47.863214 24863 consensus_queue.cc:260] T cdc1bfaa521a420288862680a176a386 P 020e8ee127be4559a08dccacb1d2790b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.866496 24862 tablet_bootstrap.cc:492] T d31655c39a4d409694a59895fb21c98f P 36d4b1d255db4886a9bb549a0d4920fd: No bootstrap required, opened a new log
I20260709 12:21:47.870095 24862 ts_tablet_manager.cc:1403] T d31655c39a4d409694a59895fb21c98f P 36d4b1d255db4886a9bb549a0d4920fd: Time spent bootstrapping tablet: real 0.093s	user 0.020s	sys 0.014s
I20260709 12:21:47.870558 24863 ts_tablet_manager.cc:1434] T cdc1bfaa521a420288862680a176a386 P 020e8ee127be4559a08dccacb1d2790b: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 12:21:47.871546 24863 tablet_bootstrap.cc:492] T 03bcafc1c9cc41c2b06d28c03004235e P 020e8ee127be4559a08dccacb1d2790b: Bootstrap starting.
I20260709 12:21:47.872787 24862 raft_consensus.cc:359] T d31655c39a4d409694a59895fb21c98f P 36d4b1d255db4886a9bb549a0d4920fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.873482 24862 raft_consensus.cc:385] T d31655c39a4d409694a59895fb21c98f P 36d4b1d255db4886a9bb549a0d4920fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:47.873764 24862 raft_consensus.cc:740] T d31655c39a4d409694a59895fb21c98f P 36d4b1d255db4886a9bb549a0d4920fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 36d4b1d255db4886a9bb549a0d4920fd, State: Initialized, Role: FOLLOWER
I20260709 12:21:47.874495 24862 consensus_queue.cc:260] T d31655c39a4d409694a59895fb21c98f P 36d4b1d255db4886a9bb549a0d4920fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.883728 24862 ts_tablet_manager.cc:1434] T d31655c39a4d409694a59895fb21c98f P 36d4b1d255db4886a9bb549a0d4920fd: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 12:21:47.885182 24564 catalog_manager.cc:5697] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b reported cstate change: term changed from 0 to 1, leader changed from <none> to 020e8ee127be4559a08dccacb1d2790b (127.23.245.130). New cstate: current_term: 1 leader_uuid: "020e8ee127be4559a08dccacb1d2790b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:47.888919 24566 catalog_manager.cc:5697] T 65345be99efc4ea7bf98c50f9f2678b8 P 36d4b1d255db4886a9bb549a0d4920fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 36d4b1d255db4886a9bb549a0d4920fd (127.23.245.129). New cstate: current_term: 1 leader_uuid: "36d4b1d255db4886a9bb549a0d4920fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:47.890841 24562 catalog_manager.cc:5697] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c reported cstate change: term changed from 0 to 1, leader changed from <none> to 08e1711cb2de485092226dd78ebcdb4c (127.23.245.131). New cstate: current_term: 1 leader_uuid: "08e1711cb2de485092226dd78ebcdb4c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:47.900285 24863 tablet_bootstrap.cc:654] T 03bcafc1c9cc41c2b06d28c03004235e P 020e8ee127be4559a08dccacb1d2790b: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:47.914242 24863 tablet_bootstrap.cc:492] T 03bcafc1c9cc41c2b06d28c03004235e P 020e8ee127be4559a08dccacb1d2790b: No bootstrap required, opened a new log
I20260709 12:21:47.914722 24863 ts_tablet_manager.cc:1403] T 03bcafc1c9cc41c2b06d28c03004235e P 020e8ee127be4559a08dccacb1d2790b: Time spent bootstrapping tablet: real 0.043s	user 0.024s	sys 0.008s
I20260709 12:21:47.917558 24863 raft_consensus.cc:359] T 03bcafc1c9cc41c2b06d28c03004235e P 020e8ee127be4559a08dccacb1d2790b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.920739 24863 raft_consensus.cc:385] T 03bcafc1c9cc41c2b06d28c03004235e P 020e8ee127be4559a08dccacb1d2790b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:47.921134 24863 raft_consensus.cc:740] T 03bcafc1c9cc41c2b06d28c03004235e P 020e8ee127be4559a08dccacb1d2790b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 020e8ee127be4559a08dccacb1d2790b, State: Initialized, Role: FOLLOWER
I20260709 12:21:47.921852 24863 consensus_queue.cc:260] T 03bcafc1c9cc41c2b06d28c03004235e P 020e8ee127be4559a08dccacb1d2790b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.925699 24863 ts_tablet_manager.cc:1434] T 03bcafc1c9cc41c2b06d28c03004235e P 020e8ee127be4559a08dccacb1d2790b: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 12:21:47.927189 24863 tablet_bootstrap.cc:492] T 65345be99efc4ea7bf98c50f9f2678b8 P 020e8ee127be4559a08dccacb1d2790b: Bootstrap starting.
I20260709 12:21:47.935063 24863 tablet_bootstrap.cc:654] T 65345be99efc4ea7bf98c50f9f2678b8 P 020e8ee127be4559a08dccacb1d2790b: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:47.939857 24863 tablet_bootstrap.cc:492] T 65345be99efc4ea7bf98c50f9f2678b8 P 020e8ee127be4559a08dccacb1d2790b: No bootstrap required, opened a new log
I20260709 12:21:47.940376 24863 ts_tablet_manager.cc:1403] T 65345be99efc4ea7bf98c50f9f2678b8 P 020e8ee127be4559a08dccacb1d2790b: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.004s
I20260709 12:21:47.943114 24863 raft_consensus.cc:359] T 65345be99efc4ea7bf98c50f9f2678b8 P 020e8ee127be4559a08dccacb1d2790b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.943790 24863 raft_consensus.cc:385] T 65345be99efc4ea7bf98c50f9f2678b8 P 020e8ee127be4559a08dccacb1d2790b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:47.944096 24863 raft_consensus.cc:740] T 65345be99efc4ea7bf98c50f9f2678b8 P 020e8ee127be4559a08dccacb1d2790b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 020e8ee127be4559a08dccacb1d2790b, State: Initialized, Role: FOLLOWER
I20260709 12:21:47.944815 24863 consensus_queue.cc:260] T 65345be99efc4ea7bf98c50f9f2678b8 P 020e8ee127be4559a08dccacb1d2790b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.946924 24863 ts_tablet_manager.cc:1434] T 65345be99efc4ea7bf98c50f9f2678b8 P 020e8ee127be4559a08dccacb1d2790b: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:21:47.947793 24863 tablet_bootstrap.cc:492] T aa0b964a979d4687ba4fcf406e1b04a8 P 020e8ee127be4559a08dccacb1d2790b: Bootstrap starting.
I20260709 12:21:47.954245 24863 tablet_bootstrap.cc:654] T aa0b964a979d4687ba4fcf406e1b04a8 P 020e8ee127be4559a08dccacb1d2790b: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:47.959116 24863 tablet_bootstrap.cc:492] T aa0b964a979d4687ba4fcf406e1b04a8 P 020e8ee127be4559a08dccacb1d2790b: No bootstrap required, opened a new log
I20260709 12:21:47.959578 24863 ts_tablet_manager.cc:1403] T aa0b964a979d4687ba4fcf406e1b04a8 P 020e8ee127be4559a08dccacb1d2790b: Time spent bootstrapping tablet: real 0.012s	user 0.006s	sys 0.003s
I20260709 12:21:47.962450 24863 raft_consensus.cc:359] T aa0b964a979d4687ba4fcf406e1b04a8 P 020e8ee127be4559a08dccacb1d2790b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.963146 24863 raft_consensus.cc:385] T aa0b964a979d4687ba4fcf406e1b04a8 P 020e8ee127be4559a08dccacb1d2790b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:47.963409 24863 raft_consensus.cc:740] T aa0b964a979d4687ba4fcf406e1b04a8 P 020e8ee127be4559a08dccacb1d2790b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 020e8ee127be4559a08dccacb1d2790b, State: Initialized, Role: FOLLOWER
I20260709 12:21:47.964069 24863 consensus_queue.cc:260] T aa0b964a979d4687ba4fcf406e1b04a8 P 020e8ee127be4559a08dccacb1d2790b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.966001 24863 ts_tablet_manager.cc:1434] T aa0b964a979d4687ba4fcf406e1b04a8 P 020e8ee127be4559a08dccacb1d2790b: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:21:47.978741 24868 raft_consensus.cc:493] T aa0b964a979d4687ba4fcf406e1b04a8 P 36d4b1d255db4886a9bb549a0d4920fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:47.979260 24868 raft_consensus.cc:515] T aa0b964a979d4687ba4fcf406e1b04a8 P 36d4b1d255db4886a9bb549a0d4920fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.981339 24868 leader_election.cc:290] T aa0b964a979d4687ba4fcf406e1b04a8 P 36d4b1d255db4886a9bb549a0d4920fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 020e8ee127be4559a08dccacb1d2790b (127.23.245.130:44139), 08e1711cb2de485092226dd78ebcdb4c (127.23.245.131:32793)
I20260709 12:21:47.981901 24744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0b964a979d4687ba4fcf406e1b04a8" candidate_uuid: "36d4b1d255db4886a9bb549a0d4920fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "020e8ee127be4559a08dccacb1d2790b" is_pre_election: true
I20260709 12:21:47.982370 24817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0b964a979d4687ba4fcf406e1b04a8" candidate_uuid: "36d4b1d255db4886a9bb549a0d4920fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08e1711cb2de485092226dd78ebcdb4c" is_pre_election: true
I20260709 12:21:47.982424 24744 raft_consensus.cc:2468] T aa0b964a979d4687ba4fcf406e1b04a8 P 020e8ee127be4559a08dccacb1d2790b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36d4b1d255db4886a9bb549a0d4920fd in term 0.
I20260709 12:21:47.983062 24817 raft_consensus.cc:2468] T aa0b964a979d4687ba4fcf406e1b04a8 P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 36d4b1d255db4886a9bb549a0d4920fd in term 0.
I20260709 12:21:47.983609 24635 leader_election.cc:304] T aa0b964a979d4687ba4fcf406e1b04a8 P 36d4b1d255db4886a9bb549a0d4920fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 020e8ee127be4559a08dccacb1d2790b, 36d4b1d255db4886a9bb549a0d4920fd; no voters: 
I20260709 12:21:47.984393 24868 raft_consensus.cc:2804] T aa0b964a979d4687ba4fcf406e1b04a8 P 36d4b1d255db4886a9bb549a0d4920fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:47.984754 24868 raft_consensus.cc:493] T aa0b964a979d4687ba4fcf406e1b04a8 P 36d4b1d255db4886a9bb549a0d4920fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:47.985030 24868 raft_consensus.cc:3060] T aa0b964a979d4687ba4fcf406e1b04a8 P 36d4b1d255db4886a9bb549a0d4920fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:47.989135 24868 raft_consensus.cc:515] T aa0b964a979d4687ba4fcf406e1b04a8 P 36d4b1d255db4886a9bb549a0d4920fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:47.990926 24868 leader_election.cc:290] T aa0b964a979d4687ba4fcf406e1b04a8 P 36d4b1d255db4886a9bb549a0d4920fd [CANDIDATE]: Term 1 election: Requested vote from peers 020e8ee127be4559a08dccacb1d2790b (127.23.245.130:44139), 08e1711cb2de485092226dd78ebcdb4c (127.23.245.131:32793)
I20260709 12:21:47.991505 24744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0b964a979d4687ba4fcf406e1b04a8" candidate_uuid: "36d4b1d255db4886a9bb549a0d4920fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "020e8ee127be4559a08dccacb1d2790b"
I20260709 12:21:47.992058 24744 raft_consensus.cc:3060] T aa0b964a979d4687ba4fcf406e1b04a8 P 020e8ee127be4559a08dccacb1d2790b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:47.992089 24817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0b964a979d4687ba4fcf406e1b04a8" candidate_uuid: "36d4b1d255db4886a9bb549a0d4920fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08e1711cb2de485092226dd78ebcdb4c"
I20260709 12:21:47.992774 24817 raft_consensus.cc:3060] T aa0b964a979d4687ba4fcf406e1b04a8 P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:47.997596 24817 raft_consensus.cc:2468] T aa0b964a979d4687ba4fcf406e1b04a8 P 08e1711cb2de485092226dd78ebcdb4c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36d4b1d255db4886a9bb549a0d4920fd in term 1.
I20260709 12:21:47.998512 24744 raft_consensus.cc:2468] T aa0b964a979d4687ba4fcf406e1b04a8 P 020e8ee127be4559a08dccacb1d2790b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36d4b1d255db4886a9bb549a0d4920fd in term 1.
I20260709 12:21:47.998577 24633 leader_election.cc:304] T aa0b964a979d4687ba4fcf406e1b04a8 P 36d4b1d255db4886a9bb549a0d4920fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08e1711cb2de485092226dd78ebcdb4c, 36d4b1d255db4886a9bb549a0d4920fd; no voters: 
I20260709 12:21:47.999439 24868 raft_consensus.cc:2804] T aa0b964a979d4687ba4fcf406e1b04a8 P 36d4b1d255db4886a9bb549a0d4920fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:47.999872 24868 raft_consensus.cc:697] T aa0b964a979d4687ba4fcf406e1b04a8 P 36d4b1d255db4886a9bb549a0d4920fd [term 1 LEADER]: Becoming Leader. State: Replica: 36d4b1d255db4886a9bb549a0d4920fd, State: Running, Role: LEADER
I20260709 12:21:48.000648 24868 consensus_queue.cc:237] T aa0b964a979d4687ba4fcf406e1b04a8 P 36d4b1d255db4886a9bb549a0d4920fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:48.008909 24566 catalog_manager.cc:5697] T aa0b964a979d4687ba4fcf406e1b04a8 P 36d4b1d255db4886a9bb549a0d4920fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 36d4b1d255db4886a9bb549a0d4920fd (127.23.245.129). New cstate: current_term: 1 leader_uuid: "36d4b1d255db4886a9bb549a0d4920fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:48.013547 24613 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:48.016956 24870 raft_consensus.cc:493] T d31655c39a4d409694a59895fb21c98f P 020e8ee127be4559a08dccacb1d2790b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.017536 24870 raft_consensus.cc:515] T d31655c39a4d409694a59895fb21c98f P 020e8ee127be4559a08dccacb1d2790b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:48.019683 24870 leader_election.cc:290] T d31655c39a4d409694a59895fb21c98f P 020e8ee127be4559a08dccacb1d2790b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36d4b1d255db4886a9bb549a0d4920fd (127.23.245.129:33613), 08e1711cb2de485092226dd78ebcdb4c (127.23.245.131:32793)
I20260709 12:21:48.020546 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d31655c39a4d409694a59895fb21c98f" candidate_uuid: "020e8ee127be4559a08dccacb1d2790b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36d4b1d255db4886a9bb549a0d4920fd" is_pre_election: true
I20260709 12:21:48.020845 24817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d31655c39a4d409694a59895fb21c98f" candidate_uuid: "020e8ee127be4559a08dccacb1d2790b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08e1711cb2de485092226dd78ebcdb4c" is_pre_election: true
I20260709 12:21:48.021206 24668 raft_consensus.cc:2468] T d31655c39a4d409694a59895fb21c98f P 36d4b1d255db4886a9bb549a0d4920fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 020e8ee127be4559a08dccacb1d2790b in term 0.
I20260709 12:21:48.021482 24817 raft_consensus.cc:2468] T d31655c39a4d409694a59895fb21c98f P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 020e8ee127be4559a08dccacb1d2790b in term 0.
I20260709 12:21:48.022331 24710 leader_election.cc:304] T d31655c39a4d409694a59895fb21c98f P 020e8ee127be4559a08dccacb1d2790b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 020e8ee127be4559a08dccacb1d2790b, 36d4b1d255db4886a9bb549a0d4920fd; no voters: 
I20260709 12:21:48.023154 24870 raft_consensus.cc:2804] T d31655c39a4d409694a59895fb21c98f P 020e8ee127be4559a08dccacb1d2790b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:48.023561 24870 raft_consensus.cc:493] T d31655c39a4d409694a59895fb21c98f P 020e8ee127be4559a08dccacb1d2790b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:48.023862 24870 raft_consensus.cc:3060] T d31655c39a4d409694a59895fb21c98f P 020e8ee127be4559a08dccacb1d2790b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:48.028810 24870 raft_consensus.cc:515] T d31655c39a4d409694a59895fb21c98f P 020e8ee127be4559a08dccacb1d2790b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:48.030520 24870 leader_election.cc:290] T d31655c39a4d409694a59895fb21c98f P 020e8ee127be4559a08dccacb1d2790b [CANDIDATE]: Term 1 election: Requested vote from peers 36d4b1d255db4886a9bb549a0d4920fd (127.23.245.129:33613), 08e1711cb2de485092226dd78ebcdb4c (127.23.245.131:32793)
I20260709 12:21:48.031558 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d31655c39a4d409694a59895fb21c98f" candidate_uuid: "020e8ee127be4559a08dccacb1d2790b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36d4b1d255db4886a9bb549a0d4920fd"
I20260709 12:21:48.031713 24817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d31655c39a4d409694a59895fb21c98f" candidate_uuid: "020e8ee127be4559a08dccacb1d2790b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08e1711cb2de485092226dd78ebcdb4c"
I20260709 12:21:48.032112 24668 raft_consensus.cc:3060] T d31655c39a4d409694a59895fb21c98f P 36d4b1d255db4886a9bb549a0d4920fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:48.032335 24817 raft_consensus.cc:3060] T d31655c39a4d409694a59895fb21c98f P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:48.036904 24668 raft_consensus.cc:2468] T d31655c39a4d409694a59895fb21c98f P 36d4b1d255db4886a9bb549a0d4920fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 020e8ee127be4559a08dccacb1d2790b in term 1.
I20260709 12:21:48.038045 24710 leader_election.cc:304] T d31655c39a4d409694a59895fb21c98f P 020e8ee127be4559a08dccacb1d2790b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 020e8ee127be4559a08dccacb1d2790b, 36d4b1d255db4886a9bb549a0d4920fd; no voters: 
I20260709 12:21:48.038797 24870 raft_consensus.cc:2804] T d31655c39a4d409694a59895fb21c98f P 020e8ee127be4559a08dccacb1d2790b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:48.038808 24817 raft_consensus.cc:2468] T d31655c39a4d409694a59895fb21c98f P 08e1711cb2de485092226dd78ebcdb4c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 020e8ee127be4559a08dccacb1d2790b in term 1.
I20260709 12:21:48.039486 24870 raft_consensus.cc:697] T d31655c39a4d409694a59895fb21c98f P 020e8ee127be4559a08dccacb1d2790b [term 1 LEADER]: Becoming Leader. State: Replica: 020e8ee127be4559a08dccacb1d2790b, State: Running, Role: LEADER
I20260709 12:21:48.040442 24870 consensus_queue.cc:237] T d31655c39a4d409694a59895fb21c98f P 020e8ee127be4559a08dccacb1d2790b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:48.049057 24566 catalog_manager.cc:5697] T d31655c39a4d409694a59895fb21c98f P 020e8ee127be4559a08dccacb1d2790b reported cstate change: term changed from 0 to 1, leader changed from <none> to 020e8ee127be4559a08dccacb1d2790b (127.23.245.130). New cstate: current_term: 1 leader_uuid: "020e8ee127be4559a08dccacb1d2790b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:48.081846 24744 raft_consensus.cc:3060] T 0f1b9086a754424297bb628279494e55 P 020e8ee127be4559a08dccacb1d2790b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:48.090629 24895 consensus_queue.cc:1048] T 0f1b9086a754424297bb628279494e55 P 08e1711cb2de485092226dd78ebcdb4c [LEADER]: Connected to new peer: Peer: permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:48.092922 24744 raft_consensus.cc:3060] T cdc1bfaa521a420288862680a176a386 P 020e8ee127be4559a08dccacb1d2790b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:48.102566 24870 raft_consensus.cc:493] T 03bcafc1c9cc41c2b06d28c03004235e P 020e8ee127be4559a08dccacb1d2790b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.103106 24870 raft_consensus.cc:515] T 03bcafc1c9cc41c2b06d28c03004235e P 020e8ee127be4559a08dccacb1d2790b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:48.105437 24870 leader_election.cc:290] T 03bcafc1c9cc41c2b06d28c03004235e P 020e8ee127be4559a08dccacb1d2790b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36d4b1d255db4886a9bb549a0d4920fd (127.23.245.129:33613), 08e1711cb2de485092226dd78ebcdb4c (127.23.245.131:32793)
I20260709 12:21:48.107375 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bcafc1c9cc41c2b06d28c03004235e" candidate_uuid: "020e8ee127be4559a08dccacb1d2790b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36d4b1d255db4886a9bb549a0d4920fd" is_pre_election: true
I20260709 12:21:48.107766 24817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bcafc1c9cc41c2b06d28c03004235e" candidate_uuid: "020e8ee127be4559a08dccacb1d2790b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08e1711cb2de485092226dd78ebcdb4c" is_pre_election: true
I20260709 12:21:48.108311 24668 raft_consensus.cc:2393] T 03bcafc1c9cc41c2b06d28c03004235e P 36d4b1d255db4886a9bb549a0d4920fd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 020e8ee127be4559a08dccacb1d2790b in current term 1: Already voted for candidate 08e1711cb2de485092226dd78ebcdb4c in this term.
I20260709 12:21:48.109548 24710 leader_election.cc:304] T 03bcafc1c9cc41c2b06d28c03004235e P 020e8ee127be4559a08dccacb1d2790b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 020e8ee127be4559a08dccacb1d2790b; no voters: 08e1711cb2de485092226dd78ebcdb4c, 36d4b1d255db4886a9bb549a0d4920fd
I20260709 12:21:48.110705 24870 raft_consensus.cc:3060] T 03bcafc1c9cc41c2b06d28c03004235e P 020e8ee127be4559a08dccacb1d2790b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:48.113487 24869 consensus_queue.cc:1048] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c [LEADER]: Connected to new peer: Peer: permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:48.119234 24869 consensus_queue.cc:1048] T 0f1b9086a754424297bb628279494e55 P 08e1711cb2de485092226dd78ebcdb4c [LEADER]: Connected to new peer: Peer: permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:48.128399 24870 raft_consensus.cc:2749] T 03bcafc1c9cc41c2b06d28c03004235e P 020e8ee127be4559a08dccacb1d2790b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:48.150797 24895 consensus_queue.cc:1048] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c [LEADER]: Connected to new peer: Peer: permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:48.186086 24817 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f1b9086a754424297bb628279494e55"
dest_uuid: "08e1711cb2de485092226dd78ebcdb4c"
mode: GRACEFUL
new_leader_uuid: "36d4b1d255db4886a9bb549a0d4920fd"
 from {username='slave'} at 127.0.0.1:50136
I20260709 12:21:48.186913 24817 raft_consensus.cc:606] T 0f1b9086a754424297bb628279494e55 P 08e1711cb2de485092226dd78ebcdb4c [term 1 LEADER]: Received request to transfer leadership to TS 36d4b1d255db4886a9bb549a0d4920fd
I20260709 12:21:48.204181 24744 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86d058965a9647e19043bf3db75c062f"
dest_uuid: "020e8ee127be4559a08dccacb1d2790b"
mode: GRACEFUL
new_leader_uuid: "36d4b1d255db4886a9bb549a0d4920fd"
 from {username='slave'} at 127.0.0.1:59316
I20260709 12:21:48.204833 24744 raft_consensus.cc:606] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b [term 1 LEADER]: Received request to transfer leadership to TS 36d4b1d255db4886a9bb549a0d4920fd
I20260709 12:21:48.206315 24870 raft_consensus.cc:493] T 65345be99efc4ea7bf98c50f9f2678b8 P 020e8ee127be4559a08dccacb1d2790b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:48.206538 24868 consensus_queue.cc:1048] T 37a3d0199f90466490c70a3f3c466ca4 P 36d4b1d255db4886a9bb549a0d4920fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:48.206837 24870 raft_consensus.cc:515] T 65345be99efc4ea7bf98c50f9f2678b8 P 020e8ee127be4559a08dccacb1d2790b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:48.209107 24870 leader_election.cc:290] T 65345be99efc4ea7bf98c50f9f2678b8 P 020e8ee127be4559a08dccacb1d2790b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 36d4b1d255db4886a9bb549a0d4920fd (127.23.245.129:33613), 08e1711cb2de485092226dd78ebcdb4c (127.23.245.131:32793)
I20260709 12:21:48.210129 24817 raft_consensus.cc:3060] T 37a3d0199f90466490c70a3f3c466ca4 P 08e1711cb2de485092226dd78ebcdb4c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:48.210259 24819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65345be99efc4ea7bf98c50f9f2678b8" candidate_uuid: "020e8ee127be4559a08dccacb1d2790b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08e1711cb2de485092226dd78ebcdb4c" is_pre_election: true
I20260709 12:21:48.211099 24819 raft_consensus.cc:2393] T 65345be99efc4ea7bf98c50f9f2678b8 P 08e1711cb2de485092226dd78ebcdb4c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 020e8ee127be4559a08dccacb1d2790b in current term 1: Already voted for candidate 36d4b1d255db4886a9bb549a0d4920fd in this term.
I20260709 12:21:48.211772 24818 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03bcafc1c9cc41c2b06d28c03004235e"
dest_uuid: "08e1711cb2de485092226dd78ebcdb4c"
mode: GRACEFUL
new_leader_uuid: "36d4b1d255db4886a9bb549a0d4920fd"
 from {username='slave'} at 127.0.0.1:50136
I20260709 12:21:48.212487 24818 raft_consensus.cc:606] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c [term 1 LEADER]: Received request to transfer leadership to TS 36d4b1d255db4886a9bb549a0d4920fd
I20260709 12:21:48.213151 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65345be99efc4ea7bf98c50f9f2678b8" candidate_uuid: "020e8ee127be4559a08dccacb1d2790b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "36d4b1d255db4886a9bb549a0d4920fd" is_pre_election: true
I20260709 12:21:48.215169 24710 leader_election.cc:304] T 65345be99efc4ea7bf98c50f9f2678b8 P 020e8ee127be4559a08dccacb1d2790b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 020e8ee127be4559a08dccacb1d2790b; no voters: 08e1711cb2de485092226dd78ebcdb4c, 36d4b1d255db4886a9bb549a0d4920fd
I20260709 12:21:48.216904 24912 raft_consensus.cc:3060] T 65345be99efc4ea7bf98c50f9f2678b8 P 020e8ee127be4559a08dccacb1d2790b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:48.220753 24868 consensus_queue.cc:1048] T 37a3d0199f90466490c70a3f3c466ca4 P 36d4b1d255db4886a9bb549a0d4920fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:48.222396 24817 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6345b2fc6a174d8299f0dd3307c8415a"
dest_uuid: "08e1711cb2de485092226dd78ebcdb4c"
mode: GRACEFUL
new_leader_uuid: "36d4b1d255db4886a9bb549a0d4920fd"
 from {username='slave'} at 127.0.0.1:50136
I20260709 12:21:48.222970 24817 raft_consensus.cc:606] T 6345b2fc6a174d8299f0dd3307c8415a P 08e1711cb2de485092226dd78ebcdb4c [term 1 LEADER]: Received request to transfer leadership to TS 36d4b1d255db4886a9bb549a0d4920fd
I20260709 12:21:48.223676 24895 consensus_queue.cc:1048] T 6345b2fc6a174d8299f0dd3307c8415a P 08e1711cb2de485092226dd78ebcdb4c [LEADER]: Connected to new peer: Peer: permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:48.229568 24912 raft_consensus.cc:2749] T 65345be99efc4ea7bf98c50f9f2678b8 P 020e8ee127be4559a08dccacb1d2790b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:48.232223 24818 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cdc1bfaa521a420288862680a176a386"
dest_uuid: "08e1711cb2de485092226dd78ebcdb4c"
mode: GRACEFUL
new_leader_uuid: "020e8ee127be4559a08dccacb1d2790b"
 from {username='slave'} at 127.0.0.1:50136
I20260709 12:21:48.248756 24818 raft_consensus.cc:606] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c [term 1 LEADER]: Received request to transfer leadership to TS 020e8ee127be4559a08dccacb1d2790b
I20260709 12:21:48.266026 24895 raft_consensus.cc:993] T 6345b2fc6a174d8299f0dd3307c8415a P 08e1711cb2de485092226dd78ebcdb4c: : Instructing follower 36d4b1d255db4886a9bb549a0d4920fd to start an election
I20260709 12:21:48.266523 24895 raft_consensus.cc:1081] T 6345b2fc6a174d8299f0dd3307c8415a P 08e1711cb2de485092226dd78ebcdb4c [term 1 LEADER]: Signalling peer 36d4b1d255db4886a9bb549a0d4920fd to start an election
I20260709 12:21:48.269141 24669 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6345b2fc6a174d8299f0dd3307c8415a"
dest_uuid: "36d4b1d255db4886a9bb549a0d4920fd"
 from {username='slave'} at 127.0.0.1:57588
I20260709 12:21:48.269950 24669 raft_consensus.cc:493] T 6345b2fc6a174d8299f0dd3307c8415a P 36d4b1d255db4886a9bb549a0d4920fd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:48.270454 24669 raft_consensus.cc:3060] T 6345b2fc6a174d8299f0dd3307c8415a P 36d4b1d255db4886a9bb549a0d4920fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:48.279620 24895 consensus_queue.cc:1048] T 6345b2fc6a174d8299f0dd3307c8415a P 08e1711cb2de485092226dd78ebcdb4c [LEADER]: Connected to new peer: Peer: permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:48.282975 24669 raft_consensus.cc:515] T 6345b2fc6a174d8299f0dd3307c8415a P 36d4b1d255db4886a9bb549a0d4920fd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:48.287273 24668 raft_consensus.cc:1240] T 6345b2fc6a174d8299f0dd3307c8415a P 36d4b1d255db4886a9bb549a0d4920fd [term 2 FOLLOWER]: Rejecting Update request from peer 08e1711cb2de485092226dd78ebcdb4c for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:48.288081 24669 leader_election.cc:290] T 6345b2fc6a174d8299f0dd3307c8415a P 36d4b1d255db4886a9bb549a0d4920fd [CANDIDATE]: Term 2 election: Requested vote from peers 020e8ee127be4559a08dccacb1d2790b (127.23.245.130:44139), 08e1711cb2de485092226dd78ebcdb4c (127.23.245.131:32793)
I20260709 12:21:48.289888 24744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6345b2fc6a174d8299f0dd3307c8415a" candidate_uuid: "36d4b1d255db4886a9bb549a0d4920fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "020e8ee127be4559a08dccacb1d2790b"
I20260709 12:21:48.291375 24817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6345b2fc6a174d8299f0dd3307c8415a" candidate_uuid: "36d4b1d255db4886a9bb549a0d4920fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "08e1711cb2de485092226dd78ebcdb4c"
I20260709 12:21:48.292037 24817 raft_consensus.cc:3055] T 6345b2fc6a174d8299f0dd3307c8415a P 08e1711cb2de485092226dd78ebcdb4c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:48.292404 24817 raft_consensus.cc:740] T 6345b2fc6a174d8299f0dd3307c8415a P 08e1711cb2de485092226dd78ebcdb4c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 08e1711cb2de485092226dd78ebcdb4c, State: Running, Role: LEADER
I20260709 12:21:48.292454 24895 consensus_queue.cc:1059] T 6345b2fc6a174d8299f0dd3307c8415a P 08e1711cb2de485092226dd78ebcdb4c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:48.293500 24817 consensus_queue.cc:260] T 6345b2fc6a174d8299f0dd3307c8415a P 08e1711cb2de485092226dd78ebcdb4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:48.294827 24817 raft_consensus.cc:3060] T 6345b2fc6a174d8299f0dd3307c8415a P 08e1711cb2de485092226dd78ebcdb4c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:48.301489 24868 consensus_queue.cc:1048] T 65345be99efc4ea7bf98c50f9f2678b8 P 36d4b1d255db4886a9bb549a0d4920fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:48.302492 24817 raft_consensus.cc:2468] T 6345b2fc6a174d8299f0dd3307c8415a P 08e1711cb2de485092226dd78ebcdb4c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36d4b1d255db4886a9bb549a0d4920fd in term 2.
I20260709 12:21:48.303220 24668 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37a3d0199f90466490c70a3f3c466ca4"
dest_uuid: "36d4b1d255db4886a9bb549a0d4920fd"
mode: GRACEFUL
new_leader_uuid: "020e8ee127be4559a08dccacb1d2790b"
 from {username='slave'} at 127.0.0.1:57608
I20260709 12:21:48.303886 24668 raft_consensus.cc:606] T 37a3d0199f90466490c70a3f3c466ca4 P 36d4b1d255db4886a9bb549a0d4920fd [term 1 LEADER]: Received request to transfer leadership to TS 020e8ee127be4559a08dccacb1d2790b
I20260709 12:21:48.304245 24633 leader_election.cc:304] T 6345b2fc6a174d8299f0dd3307c8415a P 36d4b1d255db4886a9bb549a0d4920fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 08e1711cb2de485092226dd78ebcdb4c, 36d4b1d255db4886a9bb549a0d4920fd; no voters: 020e8ee127be4559a08dccacb1d2790b
I20260709 12:21:48.305128 24868 raft_consensus.cc:2804] T 6345b2fc6a174d8299f0dd3307c8415a P 36d4b1d255db4886a9bb549a0d4920fd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:48.305701 24868 raft_consensus.cc:697] T 6345b2fc6a174d8299f0dd3307c8415a P 36d4b1d255db4886a9bb549a0d4920fd [term 2 LEADER]: Becoming Leader. State: Replica: 36d4b1d255db4886a9bb549a0d4920fd, State: Running, Role: LEADER
I20260709 12:21:48.306519 24868 consensus_queue.cc:237] T 6345b2fc6a174d8299f0dd3307c8415a P 36d4b1d255db4886a9bb549a0d4920fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:48.316429 24668 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa0b964a979d4687ba4fcf406e1b04a8"
dest_uuid: "36d4b1d255db4886a9bb549a0d4920fd"
mode: GRACEFUL
new_leader_uuid: "020e8ee127be4559a08dccacb1d2790b"
 from {username='slave'} at 127.0.0.1:57608
I20260709 12:21:48.317444 24668 raft_consensus.cc:606] T aa0b964a979d4687ba4fcf406e1b04a8 P 36d4b1d255db4886a9bb549a0d4920fd [term 1 LEADER]: Received request to transfer leadership to TS 020e8ee127be4559a08dccacb1d2790b
I20260709 12:21:48.322006 24902 consensus_queue.cc:1048] T 65345be99efc4ea7bf98c50f9f2678b8 P 36d4b1d255db4886a9bb549a0d4920fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:48.321873 24565 catalog_manager.cc:5697] T 6345b2fc6a174d8299f0dd3307c8415a P 36d4b1d255db4886a9bb549a0d4920fd reported cstate change: term changed from 1 to 2, leader changed from 08e1711cb2de485092226dd78ebcdb4c (127.23.245.131) to 36d4b1d255db4886a9bb549a0d4920fd (127.23.245.129). New cstate: current_term: 2 leader_uuid: "36d4b1d255db4886a9bb549a0d4920fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:48.325768 24869 consensus_queue.cc:1048] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c [LEADER]: Connected to new peer: Peer: permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:48.338997 24668 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "65345be99efc4ea7bf98c50f9f2678b8"
dest_uuid: "36d4b1d255db4886a9bb549a0d4920fd"
mode: GRACEFUL
new_leader_uuid: "020e8ee127be4559a08dccacb1d2790b"
 from {username='slave'} at 127.0.0.1:57608
I20260709 12:21:48.339676 24668 raft_consensus.cc:606] T 65345be99efc4ea7bf98c50f9f2678b8 P 36d4b1d255db4886a9bb549a0d4920fd [term 1 LEADER]: Received request to transfer leadership to TS 020e8ee127be4559a08dccacb1d2790b
I20260709 12:21:48.347144 24902 raft_consensus.cc:993] T 65345be99efc4ea7bf98c50f9f2678b8 P 36d4b1d255db4886a9bb549a0d4920fd: : Instructing follower 020e8ee127be4559a08dccacb1d2790b to start an election
I20260709 12:21:48.347600 24902 raft_consensus.cc:1081] T 65345be99efc4ea7bf98c50f9f2678b8 P 36d4b1d255db4886a9bb549a0d4920fd [term 1 LEADER]: Signalling peer 020e8ee127be4559a08dccacb1d2790b to start an election
I20260709 12:21:48.349233 24744 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "65345be99efc4ea7bf98c50f9f2678b8"
dest_uuid: "020e8ee127be4559a08dccacb1d2790b"
 from {username='slave'} at 127.0.0.1:59302
I20260709 12:21:48.349834 24744 raft_consensus.cc:493] T 65345be99efc4ea7bf98c50f9f2678b8 P 020e8ee127be4559a08dccacb1d2790b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:48.351824 24744 raft_consensus.cc:3060] T 65345be99efc4ea7bf98c50f9f2678b8 P 020e8ee127be4559a08dccacb1d2790b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:48.352154 24869 consensus_queue.cc:1048] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c [LEADER]: Connected to new peer: Peer: permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:48.352572 24741 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d31655c39a4d409694a59895fb21c98f"
dest_uuid: "020e8ee127be4559a08dccacb1d2790b"
mode: GRACEFUL
new_leader_uuid: "08e1711cb2de485092226dd78ebcdb4c"
 from {username='slave'} at 127.0.0.1:59316
I20260709 12:21:48.353252 24741 raft_consensus.cc:606] T d31655c39a4d409694a59895fb21c98f P 020e8ee127be4559a08dccacb1d2790b [term 1 LEADER]: Received request to transfer leadership to TS 08e1711cb2de485092226dd78ebcdb4c
I20260709 12:21:48.362458 24893 raft_consensus.cc:993] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c: : Instructing follower 36d4b1d255db4886a9bb549a0d4920fd to start an election
I20260709 12:21:48.362916 24893 raft_consensus.cc:1081] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c [term 1 LEADER]: Signalling peer 36d4b1d255db4886a9bb549a0d4920fd to start an election
I20260709 12:21:48.364619 24744 raft_consensus.cc:515] T 65345be99efc4ea7bf98c50f9f2678b8 P 020e8ee127be4559a08dccacb1d2790b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:48.365826 24667 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03bcafc1c9cc41c2b06d28c03004235e"
dest_uuid: "36d4b1d255db4886a9bb549a0d4920fd"
 from {username='slave'} at 127.0.0.1:57588
I20260709 12:21:48.366698 24743 raft_consensus.cc:1240] T 65345be99efc4ea7bf98c50f9f2678b8 P 020e8ee127be4559a08dccacb1d2790b [term 2 FOLLOWER]: Rejecting Update request from peer 36d4b1d255db4886a9bb549a0d4920fd for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:48.368050 24817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65345be99efc4ea7bf98c50f9f2678b8" candidate_uuid: "020e8ee127be4559a08dccacb1d2790b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "08e1711cb2de485092226dd78ebcdb4c"
I20260709 12:21:48.368611 24817 raft_consensus.cc:3060] T 65345be99efc4ea7bf98c50f9f2678b8 P 08e1711cb2de485092226dd78ebcdb4c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:48.369589 24868 consensus_queue.cc:1059] T 65345be99efc4ea7bf98c50f9f2678b8 P 36d4b1d255db4886a9bb549a0d4920fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:48.370393 24868 raft_consensus.cc:3055] T 65345be99efc4ea7bf98c50f9f2678b8 P 36d4b1d255db4886a9bb549a0d4920fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:48.370719 24868 raft_consensus.cc:740] T 65345be99efc4ea7bf98c50f9f2678b8 P 36d4b1d255db4886a9bb549a0d4920fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36d4b1d255db4886a9bb549a0d4920fd, State: Running, Role: LEADER
I20260709 12:21:48.371495 24868 consensus_queue.cc:260] T 65345be99efc4ea7bf98c50f9f2678b8 P 36d4b1d255db4886a9bb549a0d4920fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:48.372557 24868 raft_consensus.cc:3060] T 65345be99efc4ea7bf98c50f9f2678b8 P 36d4b1d255db4886a9bb549a0d4920fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:48.375623 24817 raft_consensus.cc:2468] T 65345be99efc4ea7bf98c50f9f2678b8 P 08e1711cb2de485092226dd78ebcdb4c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 020e8ee127be4559a08dccacb1d2790b in term 2.
I20260709 12:21:48.376271 24667 raft_consensus.cc:493] T 03bcafc1c9cc41c2b06d28c03004235e P 36d4b1d255db4886a9bb549a0d4920fd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:48.376708 24667 raft_consensus.cc:3060] T 03bcafc1c9cc41c2b06d28c03004235e P 36d4b1d255db4886a9bb549a0d4920fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:48.376813 24708 leader_election.cc:304] T 65345be99efc4ea7bf98c50f9f2678b8 P 020e8ee127be4559a08dccacb1d2790b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 020e8ee127be4559a08dccacb1d2790b, 08e1711cb2de485092226dd78ebcdb4c; no voters: 
I20260709 12:21:48.377755 24912 raft_consensus.cc:2804] T 65345be99efc4ea7bf98c50f9f2678b8 P 020e8ee127be4559a08dccacb1d2790b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:48.378208 24912 raft_consensus.cc:697] T 65345be99efc4ea7bf98c50f9f2678b8 P 020e8ee127be4559a08dccacb1d2790b [term 2 LEADER]: Becoming Leader. State: Replica: 020e8ee127be4559a08dccacb1d2790b, State: Running, Role: LEADER
I20260709 12:21:48.378995 24912 consensus_queue.cc:237] T 65345be99efc4ea7bf98c50f9f2678b8 P 020e8ee127be4559a08dccacb1d2790b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:48.381151 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65345be99efc4ea7bf98c50f9f2678b8" candidate_uuid: "020e8ee127be4559a08dccacb1d2790b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "36d4b1d255db4886a9bb549a0d4920fd"
I20260709 12:21:48.383577 24744 leader_election.cc:290] T 65345be99efc4ea7bf98c50f9f2678b8 P 020e8ee127be4559a08dccacb1d2790b [CANDIDATE]: Term 2 election: Requested vote from peers 36d4b1d255db4886a9bb549a0d4920fd (127.23.245.129:33613), 08e1711cb2de485092226dd78ebcdb4c (127.23.245.131:32793)
I20260709 12:21:48.385665 24667 raft_consensus.cc:515] T 03bcafc1c9cc41c2b06d28c03004235e P 36d4b1d255db4886a9bb549a0d4920fd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:48.393299 24564 catalog_manager.cc:5697] T 65345be99efc4ea7bf98c50f9f2678b8 P 020e8ee127be4559a08dccacb1d2790b reported cstate change: term changed from 1 to 2, leader changed from 36d4b1d255db4886a9bb549a0d4920fd (127.23.245.129) to 020e8ee127be4559a08dccacb1d2790b (127.23.245.130). New cstate: current_term: 2 leader_uuid: "020e8ee127be4559a08dccacb1d2790b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:48.397477 24669 raft_consensus.cc:2468] T 65345be99efc4ea7bf98c50f9f2678b8 P 36d4b1d255db4886a9bb549a0d4920fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 020e8ee127be4559a08dccacb1d2790b in term 2.
I20260709 12:21:48.403872 24667 leader_election.cc:290] T 03bcafc1c9cc41c2b06d28c03004235e P 36d4b1d255db4886a9bb549a0d4920fd [CANDIDATE]: Term 2 election: Requested vote from peers 020e8ee127be4559a08dccacb1d2790b (127.23.245.130:44139), 08e1711cb2de485092226dd78ebcdb4c (127.23.245.131:32793)
I20260709 12:21:48.404742 24741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bcafc1c9cc41c2b06d28c03004235e" candidate_uuid: "36d4b1d255db4886a9bb549a0d4920fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "020e8ee127be4559a08dccacb1d2790b"
I20260709 12:21:48.405834 24741 raft_consensus.cc:3060] T 03bcafc1c9cc41c2b06d28c03004235e P 020e8ee127be4559a08dccacb1d2790b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:48.406208 24817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bcafc1c9cc41c2b06d28c03004235e" candidate_uuid: "36d4b1d255db4886a9bb549a0d4920fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "08e1711cb2de485092226dd78ebcdb4c"
I20260709 12:21:48.406813 24817 raft_consensus.cc:3055] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:48.407146 24817 raft_consensus.cc:740] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 08e1711cb2de485092226dd78ebcdb4c, State: Running, Role: LEADER
I20260709 12:21:48.407840 24817 consensus_queue.cc:260] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:48.409072 24817 raft_consensus.cc:3060] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:48.414361 24741 raft_consensus.cc:2468] T 03bcafc1c9cc41c2b06d28c03004235e P 020e8ee127be4559a08dccacb1d2790b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36d4b1d255db4886a9bb549a0d4920fd in term 2.
I20260709 12:21:48.416018 24635 leader_election.cc:304] T 03bcafc1c9cc41c2b06d28c03004235e P 36d4b1d255db4886a9bb549a0d4920fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 020e8ee127be4559a08dccacb1d2790b, 36d4b1d255db4886a9bb549a0d4920fd; no voters: 
I20260709 12:21:48.416836 24868 raft_consensus.cc:2804] T 03bcafc1c9cc41c2b06d28c03004235e P 36d4b1d255db4886a9bb549a0d4920fd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:48.417299 24868 raft_consensus.cc:697] T 03bcafc1c9cc41c2b06d28c03004235e P 36d4b1d255db4886a9bb549a0d4920fd [term 2 LEADER]: Becoming Leader. State: Replica: 36d4b1d255db4886a9bb549a0d4920fd, State: Running, Role: LEADER
I20260709 12:21:48.418172 24817 raft_consensus.cc:2468] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36d4b1d255db4886a9bb549a0d4920fd in term 2.
I20260709 12:21:48.418092 24868 consensus_queue.cc:237] T 03bcafc1c9cc41c2b06d28c03004235e P 36d4b1d255db4886a9bb549a0d4920fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:48.426196 24564 catalog_manager.cc:5697] T 03bcafc1c9cc41c2b06d28c03004235e P 36d4b1d255db4886a9bb549a0d4920fd reported cstate change: term changed from 1 to 2, leader changed from 08e1711cb2de485092226dd78ebcdb4c (127.23.245.131) to 36d4b1d255db4886a9bb549a0d4920fd (127.23.245.129). New cstate: current_term: 2 leader_uuid: "36d4b1d255db4886a9bb549a0d4920fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:48.474532 24870 consensus_queue.cc:1048] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b [LEADER]: Connected to new peer: Peer: permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:48.476460 24870 consensus_queue.cc:1048] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b [LEADER]: Connected to new peer: Peer: permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:48.485263 24912 raft_consensus.cc:993] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b: : Instructing follower 36d4b1d255db4886a9bb549a0d4920fd to start an election
I20260709 12:21:48.485690 24912 raft_consensus.cc:1081] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b [term 1 LEADER]: Signalling peer 36d4b1d255db4886a9bb549a0d4920fd to start an election
I20260709 12:21:48.490638 24669 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "86d058965a9647e19043bf3db75c062f"
dest_uuid: "36d4b1d255db4886a9bb549a0d4920fd"
 from {username='slave'} at 127.0.0.1:57596
I20260709 12:21:48.490538 24868 consensus_queue.cc:1048] T aa0b964a979d4687ba4fcf406e1b04a8 P 36d4b1d255db4886a9bb549a0d4920fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:48.491180 24669 raft_consensus.cc:493] T 86d058965a9647e19043bf3db75c062f P 36d4b1d255db4886a9bb549a0d4920fd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:48.491078 24912 consensus_queue.cc:1048] T d31655c39a4d409694a59895fb21c98f P 020e8ee127be4559a08dccacb1d2790b [LEADER]: Connected to new peer: Peer: permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:48.491638 24669 raft_consensus.cc:3060] T 86d058965a9647e19043bf3db75c062f P 36d4b1d255db4886a9bb549a0d4920fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:48.512989 24902 consensus_queue.cc:1048] T aa0b964a979d4687ba4fcf406e1b04a8 P 36d4b1d255db4886a9bb549a0d4920fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:48.517099 24669 raft_consensus.cc:515] T 86d058965a9647e19043bf3db75c062f P 36d4b1d255db4886a9bb549a0d4920fd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:48.519498 24667 raft_consensus.cc:1240] T 86d058965a9647e19043bf3db75c062f P 36d4b1d255db4886a9bb549a0d4920fd [term 2 FOLLOWER]: Rejecting Update request from peer 020e8ee127be4559a08dccacb1d2790b for earlier term 1. Current term is 2. Ops: []
I20260709 12:21:48.520504 24669 leader_election.cc:290] T 86d058965a9647e19043bf3db75c062f P 36d4b1d255db4886a9bb549a0d4920fd [CANDIDATE]: Term 2 election: Requested vote from peers 020e8ee127be4559a08dccacb1d2790b (127.23.245.130:44139), 08e1711cb2de485092226dd78ebcdb4c (127.23.245.131:32793)
I20260709 12:21:48.522377 24870 consensus_queue.cc:1059] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:48.522526 24818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d058965a9647e19043bf3db75c062f" candidate_uuid: "36d4b1d255db4886a9bb549a0d4920fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "08e1711cb2de485092226dd78ebcdb4c"
I20260709 12:21:48.523278 24818 raft_consensus.cc:3060] T 86d058965a9647e19043bf3db75c062f P 08e1711cb2de485092226dd78ebcdb4c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:48.523455 24870 raft_consensus.cc:3055] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:48.523857 24870 raft_consensus.cc:740] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 020e8ee127be4559a08dccacb1d2790b, State: Running, Role: LEADER
I20260709 12:21:48.524667 24870 consensus_queue.cc:260] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:48.525802 24870 raft_consensus.cc:3060] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:48.529345 24902 raft_consensus.cc:993] T aa0b964a979d4687ba4fcf406e1b04a8 P 36d4b1d255db4886a9bb549a0d4920fd: : Instructing follower 020e8ee127be4559a08dccacb1d2790b to start an election
I20260709 12:21:48.529860 24907 raft_consensus.cc:1081] T aa0b964a979d4687ba4fcf406e1b04a8 P 36d4b1d255db4886a9bb549a0d4920fd [term 1 LEADER]: Signalling peer 020e8ee127be4559a08dccacb1d2790b to start an election
I20260709 12:21:48.530345 24741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d058965a9647e19043bf3db75c062f" candidate_uuid: "36d4b1d255db4886a9bb549a0d4920fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "020e8ee127be4559a08dccacb1d2790b"
I20260709 12:21:48.532152 24744 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa0b964a979d4687ba4fcf406e1b04a8"
dest_uuid: "020e8ee127be4559a08dccacb1d2790b"
 from {username='slave'} at 127.0.0.1:59302
I20260709 12:21:48.532719 24744 raft_consensus.cc:493] T aa0b964a979d4687ba4fcf406e1b04a8 P 020e8ee127be4559a08dccacb1d2790b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:48.533077 24744 raft_consensus.cc:3060] T aa0b964a979d4687ba4fcf406e1b04a8 P 020e8ee127be4559a08dccacb1d2790b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:48.539731 24744 raft_consensus.cc:515] T aa0b964a979d4687ba4fcf406e1b04a8 P 020e8ee127be4559a08dccacb1d2790b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:48.549882 24818 raft_consensus.cc:2468] T 86d058965a9647e19043bf3db75c062f P 08e1711cb2de485092226dd78ebcdb4c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36d4b1d255db4886a9bb549a0d4920fd in term 2.
I20260709 12:21:48.553301 24744 leader_election.cc:290] T aa0b964a979d4687ba4fcf406e1b04a8 P 020e8ee127be4559a08dccacb1d2790b [CANDIDATE]: Term 2 election: Requested vote from peers 36d4b1d255db4886a9bb549a0d4920fd (127.23.245.129:33613), 08e1711cb2de485092226dd78ebcdb4c (127.23.245.131:32793)
I20260709 12:21:48.558800 24870 raft_consensus.cc:993] T d31655c39a4d409694a59895fb21c98f P 020e8ee127be4559a08dccacb1d2790b: : Instructing follower 08e1711cb2de485092226dd78ebcdb4c to start an election
I20260709 12:21:48.559559 24912 raft_consensus.cc:1081] T d31655c39a4d409694a59895fb21c98f P 020e8ee127be4559a08dccacb1d2790b [term 1 LEADER]: Signalling peer 08e1711cb2de485092226dd78ebcdb4c to start an election
I20260709 12:21:48.562652 24870 consensus_queue.cc:1048] T d31655c39a4d409694a59895fb21c98f P 020e8ee127be4559a08dccacb1d2790b [LEADER]: Connected to new peer: Peer: permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:48.555017 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0b964a979d4687ba4fcf406e1b04a8" candidate_uuid: "020e8ee127be4559a08dccacb1d2790b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "36d4b1d255db4886a9bb549a0d4920fd"
I20260709 12:21:48.570188 24669 raft_consensus.cc:3055] T aa0b964a979d4687ba4fcf406e1b04a8 P 36d4b1d255db4886a9bb549a0d4920fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:48.570583 24669 raft_consensus.cc:740] T aa0b964a979d4687ba4fcf406e1b04a8 P 36d4b1d255db4886a9bb549a0d4920fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36d4b1d255db4886a9bb549a0d4920fd, State: Running, Role: LEADER
I20260709 12:21:48.571478 24817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa0b964a979d4687ba4fcf406e1b04a8" candidate_uuid: "020e8ee127be4559a08dccacb1d2790b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "08e1711cb2de485092226dd78ebcdb4c"
I20260709 12:21:48.571391 24669 consensus_queue.cc:260] T aa0b964a979d4687ba4fcf406e1b04a8 P 36d4b1d255db4886a9bb549a0d4920fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:48.572108 24817 raft_consensus.cc:3060] T aa0b964a979d4687ba4fcf406e1b04a8 P 08e1711cb2de485092226dd78ebcdb4c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:48.572728 24669 raft_consensus.cc:3060] T aa0b964a979d4687ba4fcf406e1b04a8 P 36d4b1d255db4886a9bb549a0d4920fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:48.578920 24817 raft_consensus.cc:2468] T aa0b964a979d4687ba4fcf406e1b04a8 P 08e1711cb2de485092226dd78ebcdb4c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 020e8ee127be4559a08dccacb1d2790b in term 2.
I20260709 12:21:48.582552 24819 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d31655c39a4d409694a59895fb21c98f"
dest_uuid: "08e1711cb2de485092226dd78ebcdb4c"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:21:48.584679 24708 leader_election.cc:304] T aa0b964a979d4687ba4fcf406e1b04a8 P 020e8ee127be4559a08dccacb1d2790b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 020e8ee127be4559a08dccacb1d2790b, 08e1711cb2de485092226dd78ebcdb4c; no voters: 
I20260709 12:21:48.585813 24819 raft_consensus.cc:493] T d31655c39a4d409694a59895fb21c98f P 08e1711cb2de485092226dd78ebcdb4c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:48.586948 24819 raft_consensus.cc:3060] T d31655c39a4d409694a59895fb21c98f P 08e1711cb2de485092226dd78ebcdb4c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:48.556596 24741 raft_consensus.cc:2468] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36d4b1d255db4886a9bb549a0d4920fd in term 2.
I20260709 12:21:48.593528 24635 leader_election.cc:304] T 86d058965a9647e19043bf3db75c062f P 36d4b1d255db4886a9bb549a0d4920fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 020e8ee127be4559a08dccacb1d2790b, 36d4b1d255db4886a9bb549a0d4920fd; no voters: 
I20260709 12:21:48.594492 24907 raft_consensus.cc:2804] T 86d058965a9647e19043bf3db75c062f P 36d4b1d255db4886a9bb549a0d4920fd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:48.594980 24907 raft_consensus.cc:697] T 86d058965a9647e19043bf3db75c062f P 36d4b1d255db4886a9bb549a0d4920fd [term 2 LEADER]: Becoming Leader. State: Replica: 36d4b1d255db4886a9bb549a0d4920fd, State: Running, Role: LEADER
I20260709 12:21:48.595774 24907 consensus_queue.cc:237] T 86d058965a9647e19043bf3db75c062f P 36d4b1d255db4886a9bb549a0d4920fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:48.601284 24669 raft_consensus.cc:2468] T aa0b964a979d4687ba4fcf406e1b04a8 P 36d4b1d255db4886a9bb549a0d4920fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 020e8ee127be4559a08dccacb1d2790b in term 2.
I20260709 12:21:48.606348 24819 raft_consensus.cc:515] T d31655c39a4d409694a59895fb21c98f P 08e1711cb2de485092226dd78ebcdb4c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:48.608032 24948 raft_consensus.cc:2804] T aa0b964a979d4687ba4fcf406e1b04a8 P 020e8ee127be4559a08dccacb1d2790b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:48.608548 24948 raft_consensus.cc:697] T aa0b964a979d4687ba4fcf406e1b04a8 P 020e8ee127be4559a08dccacb1d2790b [term 2 LEADER]: Becoming Leader. State: Replica: 020e8ee127be4559a08dccacb1d2790b, State: Running, Role: LEADER
I20260709 12:21:48.609543 24948 consensus_queue.cc:237] T aa0b964a979d4687ba4fcf406e1b04a8 P 020e8ee127be4559a08dccacb1d2790b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:48.610247 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d31655c39a4d409694a59895fb21c98f" candidate_uuid: "08e1711cb2de485092226dd78ebcdb4c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "36d4b1d255db4886a9bb549a0d4920fd"
I20260709 12:21:48.612165 24667 raft_consensus.cc:3060] T d31655c39a4d409694a59895fb21c98f P 36d4b1d255db4886a9bb549a0d4920fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:48.611641 24819 leader_election.cc:290] T d31655c39a4d409694a59895fb21c98f P 08e1711cb2de485092226dd78ebcdb4c [CANDIDATE]: Term 2 election: Requested vote from peers 36d4b1d255db4886a9bb549a0d4920fd (127.23.245.129:33613), 020e8ee127be4559a08dccacb1d2790b (127.23.245.130:44139)
I20260709 12:21:48.615511 24741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d31655c39a4d409694a59895fb21c98f" candidate_uuid: "08e1711cb2de485092226dd78ebcdb4c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "020e8ee127be4559a08dccacb1d2790b"
I20260709 12:21:48.616151 24741 raft_consensus.cc:3055] T d31655c39a4d409694a59895fb21c98f P 020e8ee127be4559a08dccacb1d2790b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:48.616479 24741 raft_consensus.cc:740] T d31655c39a4d409694a59895fb21c98f P 020e8ee127be4559a08dccacb1d2790b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 020e8ee127be4559a08dccacb1d2790b, State: Running, Role: LEADER
I20260709 12:21:48.617244 24741 consensus_queue.cc:260] T d31655c39a4d409694a59895fb21c98f P 020e8ee127be4559a08dccacb1d2790b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:48.618486 24741 raft_consensus.cc:3060] T d31655c39a4d409694a59895fb21c98f P 020e8ee127be4559a08dccacb1d2790b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:48.618589 24564 catalog_manager.cc:5697] T aa0b964a979d4687ba4fcf406e1b04a8 P 020e8ee127be4559a08dccacb1d2790b reported cstate change: term changed from 1 to 2, leader changed from 36d4b1d255db4886a9bb549a0d4920fd (127.23.245.129) to 020e8ee127be4559a08dccacb1d2790b (127.23.245.130). New cstate: current_term: 2 leader_uuid: "020e8ee127be4559a08dccacb1d2790b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:48.621419 24667 raft_consensus.cc:2468] T d31655c39a4d409694a59895fb21c98f P 36d4b1d255db4886a9bb549a0d4920fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08e1711cb2de485092226dd78ebcdb4c in term 2.
I20260709 12:21:48.622677 24785 leader_election.cc:304] T d31655c39a4d409694a59895fb21c98f P 08e1711cb2de485092226dd78ebcdb4c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08e1711cb2de485092226dd78ebcdb4c, 36d4b1d255db4886a9bb549a0d4920fd; no voters: 
I20260709 12:21:48.623567 24893 raft_consensus.cc:2804] T d31655c39a4d409694a59895fb21c98f P 08e1711cb2de485092226dd78ebcdb4c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:48.624063 24893 raft_consensus.cc:697] T d31655c39a4d409694a59895fb21c98f P 08e1711cb2de485092226dd78ebcdb4c [term 2 LEADER]: Becoming Leader. State: Replica: 08e1711cb2de485092226dd78ebcdb4c, State: Running, Role: LEADER
I20260709 12:21:48.625069 24741 raft_consensus.cc:2468] T d31655c39a4d409694a59895fb21c98f P 020e8ee127be4559a08dccacb1d2790b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08e1711cb2de485092226dd78ebcdb4c in term 2.
I20260709 12:21:48.624941 24893 consensus_queue.cc:237] T d31655c39a4d409694a59895fb21c98f P 08e1711cb2de485092226dd78ebcdb4c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:48.633369 24564 catalog_manager.cc:5697] T 86d058965a9647e19043bf3db75c062f P 36d4b1d255db4886a9bb549a0d4920fd reported cstate change: term changed from 1 to 2, leader changed from 020e8ee127be4559a08dccacb1d2790b (127.23.245.130) to 36d4b1d255db4886a9bb549a0d4920fd (127.23.245.129). New cstate: current_term: 2 leader_uuid: "36d4b1d255db4886a9bb549a0d4920fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:48.641415 24566 catalog_manager.cc:5697] T d31655c39a4d409694a59895fb21c98f P 08e1711cb2de485092226dd78ebcdb4c reported cstate change: term changed from 1 to 2, leader changed from 020e8ee127be4559a08dccacb1d2790b (127.23.245.130) to 08e1711cb2de485092226dd78ebcdb4c (127.23.245.131). New cstate: current_term: 2 leader_uuid: "08e1711cb2de485092226dd78ebcdb4c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:48.689556 24869 raft_consensus.cc:993] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c: : Instructing follower 020e8ee127be4559a08dccacb1d2790b to start an election
I20260709 12:21:48.690088 24869 raft_consensus.cc:1081] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c [term 1 LEADER]: Signalling peer 020e8ee127be4559a08dccacb1d2790b to start an election
I20260709 12:21:48.692122 24744 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cdc1bfaa521a420288862680a176a386"
dest_uuid: "020e8ee127be4559a08dccacb1d2790b"
 from {username='slave'} at 127.0.0.1:59290
I20260709 12:21:48.692683 24744 raft_consensus.cc:493] T cdc1bfaa521a420288862680a176a386 P 020e8ee127be4559a08dccacb1d2790b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:48.693113 24744 raft_consensus.cc:3060] T cdc1bfaa521a420288862680a176a386 P 020e8ee127be4559a08dccacb1d2790b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:48.698028 24744 raft_consensus.cc:515] T cdc1bfaa521a420288862680a176a386 P 020e8ee127be4559a08dccacb1d2790b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:48.699783 24744 leader_election.cc:290] T cdc1bfaa521a420288862680a176a386 P 020e8ee127be4559a08dccacb1d2790b [CANDIDATE]: Term 2 election: Requested vote from peers 36d4b1d255db4886a9bb549a0d4920fd (127.23.245.129:33613), 08e1711cb2de485092226dd78ebcdb4c (127.23.245.131:32793)
I20260709 12:21:48.700769 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdc1bfaa521a420288862680a176a386" candidate_uuid: "020e8ee127be4559a08dccacb1d2790b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "36d4b1d255db4886a9bb549a0d4920fd"
I20260709 12:21:48.700985 24819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdc1bfaa521a420288862680a176a386" candidate_uuid: "020e8ee127be4559a08dccacb1d2790b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "08e1711cb2de485092226dd78ebcdb4c"
I20260709 12:21:48.701359 24667 raft_consensus.cc:3060] T cdc1bfaa521a420288862680a176a386 P 36d4b1d255db4886a9bb549a0d4920fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:48.701642 24819 raft_consensus.cc:3055] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:48.702081 24819 raft_consensus.cc:740] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 08e1711cb2de485092226dd78ebcdb4c, State: Running, Role: LEADER
I20260709 12:21:48.702976 24819 consensus_queue.cc:260] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:48.704248 24819 raft_consensus.cc:3060] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:48.708091 24667 raft_consensus.cc:2468] T cdc1bfaa521a420288862680a176a386 P 36d4b1d255db4886a9bb549a0d4920fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 020e8ee127be4559a08dccacb1d2790b in term 2.
I20260709 12:21:48.709438 24710 leader_election.cc:304] T cdc1bfaa521a420288862680a176a386 P 020e8ee127be4559a08dccacb1d2790b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 020e8ee127be4559a08dccacb1d2790b, 36d4b1d255db4886a9bb549a0d4920fd; no voters: 
I20260709 12:21:48.710317 24948 raft_consensus.cc:2804] T cdc1bfaa521a420288862680a176a386 P 020e8ee127be4559a08dccacb1d2790b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:48.710789 24948 raft_consensus.cc:697] T cdc1bfaa521a420288862680a176a386 P 020e8ee127be4559a08dccacb1d2790b [term 2 LEADER]: Becoming Leader. State: Replica: 020e8ee127be4559a08dccacb1d2790b, State: Running, Role: LEADER
I20260709 12:21:48.710937 24819 raft_consensus.cc:2468] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 020e8ee127be4559a08dccacb1d2790b in term 2.
I20260709 12:21:48.711689 24948 consensus_queue.cc:237] T cdc1bfaa521a420288862680a176a386 P 020e8ee127be4559a08dccacb1d2790b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:48.718465 24566 catalog_manager.cc:5697] T cdc1bfaa521a420288862680a176a386 P 020e8ee127be4559a08dccacb1d2790b reported cstate change: term changed from 1 to 2, leader changed from 08e1711cb2de485092226dd78ebcdb4c (127.23.245.131) to 020e8ee127be4559a08dccacb1d2790b (127.23.245.130). New cstate: current_term: 2 leader_uuid: "020e8ee127be4559a08dccacb1d2790b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:48.724496 24819 raft_consensus.cc:1275] T 6345b2fc6a174d8299f0dd3307c8415a P 08e1711cb2de485092226dd78ebcdb4c [term 2 FOLLOWER]: Refusing update from remote peer 36d4b1d255db4886a9bb549a0d4920fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:48.725935 24907 consensus_queue.cc:1048] T 6345b2fc6a174d8299f0dd3307c8415a P 36d4b1d255db4886a9bb549a0d4920fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:48.734884 24744 raft_consensus.cc:3060] T 6345b2fc6a174d8299f0dd3307c8415a P 020e8ee127be4559a08dccacb1d2790b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:48.741050 24869 raft_consensus.cc:993] T 0f1b9086a754424297bb628279494e55 P 08e1711cb2de485092226dd78ebcdb4c: : Instructing follower 36d4b1d255db4886a9bb549a0d4920fd to start an election
I20260709 12:21:48.741521 24869 raft_consensus.cc:1081] T 0f1b9086a754424297bb628279494e55 P 08e1711cb2de485092226dd78ebcdb4c [term 1 LEADER]: Signalling peer 36d4b1d255db4886a9bb549a0d4920fd to start an election
I20260709 12:21:48.743211 24667 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f1b9086a754424297bb628279494e55"
dest_uuid: "36d4b1d255db4886a9bb549a0d4920fd"
 from {username='slave'} at 127.0.0.1:57588
I20260709 12:21:48.743880 24667 raft_consensus.cc:493] T 0f1b9086a754424297bb628279494e55 P 36d4b1d255db4886a9bb549a0d4920fd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:48.744385 24667 raft_consensus.cc:3060] T 0f1b9086a754424297bb628279494e55 P 36d4b1d255db4886a9bb549a0d4920fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:48.749012 24744 raft_consensus.cc:1275] T 6345b2fc6a174d8299f0dd3307c8415a P 020e8ee127be4559a08dccacb1d2790b [term 2 FOLLOWER]: Refusing update from remote peer 36d4b1d255db4886a9bb549a0d4920fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:48.750677 24907 consensus_queue.cc:1048] T 6345b2fc6a174d8299f0dd3307c8415a P 36d4b1d255db4886a9bb549a0d4920fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:48.751402 24667 raft_consensus.cc:515] T 0f1b9086a754424297bb628279494e55 P 36d4b1d255db4886a9bb549a0d4920fd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } }
I20260709 12:21:48.754310 24819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1b9086a754424297bb628279494e55" candidate_uuid: "36d4b1d255db4886a9bb549a0d4920fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "08e1711cb2de485092226dd78ebcdb4c"
I20260709 12:21:48.754880 24819 raft_consensus.cc:3055] T 0f1b9086a754424297bb628279494e55 P 08e1711cb2de485092226dd78ebcdb4c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:48.755193 24819 raft_consensus.cc:740] T 0f1b9086a754424297bb628279494e55 P 08e1711cb2de485092226dd78ebcdb4c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 08e1711cb2de485092226dd78ebcdb4c, State: Running, Role: LEADER
I20260709 12:21:48.756001 24819 consensus_queue.cc:260] T 0f1b9086a754424297bb628279494e55 P 08e1711cb2de485092226dd78ebcdb4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } }
I20260709 12:21:48.757053 24819 raft_consensus.cc:3060] T 0f1b9086a754424297bb628279494e55 P 08e1711cb2de485092226dd78ebcdb4c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:48.759351 24667 leader_election.cc:290] T 0f1b9086a754424297bb628279494e55 P 36d4b1d255db4886a9bb549a0d4920fd [CANDIDATE]: Term 2 election: Requested vote from peers 08e1711cb2de485092226dd78ebcdb4c (127.23.245.131:32793), 020e8ee127be4559a08dccacb1d2790b (127.23.245.130:44139)
I20260709 12:21:48.760689 24741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1b9086a754424297bb628279494e55" candidate_uuid: "36d4b1d255db4886a9bb549a0d4920fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "020e8ee127be4559a08dccacb1d2790b"
I20260709 12:21:48.762262 24902 raft_consensus.cc:993] T 37a3d0199f90466490c70a3f3c466ca4 P 36d4b1d255db4886a9bb549a0d4920fd: : Instructing follower 020e8ee127be4559a08dccacb1d2790b to start an election
I20260709 12:21:48.762496 24741 raft_consensus.cc:3060] T 0f1b9086a754424297bb628279494e55 P 020e8ee127be4559a08dccacb1d2790b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:48.762745 24902 raft_consensus.cc:1081] T 37a3d0199f90466490c70a3f3c466ca4 P 36d4b1d255db4886a9bb549a0d4920fd [term 1 LEADER]: Signalling peer 020e8ee127be4559a08dccacb1d2790b to start an election
I20260709 12:21:48.766495 24744 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37a3d0199f90466490c70a3f3c466ca4"
dest_uuid: "020e8ee127be4559a08dccacb1d2790b"
 from {username='slave'} at 127.0.0.1:59302
I20260709 12:21:48.767107 24744 raft_consensus.cc:493] T 37a3d0199f90466490c70a3f3c466ca4 P 020e8ee127be4559a08dccacb1d2790b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:48.767539 24744 raft_consensus.cc:3060] T 37a3d0199f90466490c70a3f3c466ca4 P 020e8ee127be4559a08dccacb1d2790b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:48.765242 24819 raft_consensus.cc:2468] T 0f1b9086a754424297bb628279494e55 P 08e1711cb2de485092226dd78ebcdb4c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36d4b1d255db4886a9bb549a0d4920fd in term 2.
I20260709 12:21:48.773169 24633 leader_election.cc:304] T 0f1b9086a754424297bb628279494e55 P 36d4b1d255db4886a9bb549a0d4920fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08e1711cb2de485092226dd78ebcdb4c, 36d4b1d255db4886a9bb549a0d4920fd; no voters: 
I20260709 12:21:48.769747 24741 raft_consensus.cc:2468] T 0f1b9086a754424297bb628279494e55 P 020e8ee127be4559a08dccacb1d2790b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36d4b1d255db4886a9bb549a0d4920fd in term 2.
I20260709 12:21:48.774089 24902 raft_consensus.cc:2804] T 0f1b9086a754424297bb628279494e55 P 36d4b1d255db4886a9bb549a0d4920fd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:48.774137 24744 raft_consensus.cc:515] T 37a3d0199f90466490c70a3f3c466ca4 P 020e8ee127be4559a08dccacb1d2790b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:48.774839 24902 raft_consensus.cc:697] T 0f1b9086a754424297bb628279494e55 P 36d4b1d255db4886a9bb549a0d4920fd [term 2 LEADER]: Becoming Leader. State: Replica: 36d4b1d255db4886a9bb549a0d4920fd, State: Running, Role: LEADER
I20260709 12:21:48.775545 24902 consensus_queue.cc:237] T 0f1b9086a754424297bb628279494e55 P 36d4b1d255db4886a9bb549a0d4920fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } }
I20260709 12:21:48.776878 24744 leader_election.cc:290] T 37a3d0199f90466490c70a3f3c466ca4 P 020e8ee127be4559a08dccacb1d2790b [CANDIDATE]: Term 2 election: Requested vote from peers 36d4b1d255db4886a9bb549a0d4920fd (127.23.245.129:33613), 08e1711cb2de485092226dd78ebcdb4c (127.23.245.131:32793)
I20260709 12:21:48.778000 24819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a3d0199f90466490c70a3f3c466ca4" candidate_uuid: "020e8ee127be4559a08dccacb1d2790b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "08e1711cb2de485092226dd78ebcdb4c"
I20260709 12:21:48.778609 24819 raft_consensus.cc:3060] T 37a3d0199f90466490c70a3f3c466ca4 P 08e1711cb2de485092226dd78ebcdb4c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:48.779392 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a3d0199f90466490c70a3f3c466ca4" candidate_uuid: "020e8ee127be4559a08dccacb1d2790b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "36d4b1d255db4886a9bb549a0d4920fd"
I20260709 12:21:48.779968 24667 raft_consensus.cc:3055] T 37a3d0199f90466490c70a3f3c466ca4 P 36d4b1d255db4886a9bb549a0d4920fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:48.780278 24667 raft_consensus.cc:740] T 37a3d0199f90466490c70a3f3c466ca4 P 36d4b1d255db4886a9bb549a0d4920fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 36d4b1d255db4886a9bb549a0d4920fd, State: Running, Role: LEADER
I20260709 12:21:48.781140 24667 consensus_queue.cc:260] T 37a3d0199f90466490c70a3f3c466ca4 P 36d4b1d255db4886a9bb549a0d4920fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:48.782303 24667 raft_consensus.cc:3060] T 37a3d0199f90466490c70a3f3c466ca4 P 36d4b1d255db4886a9bb549a0d4920fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:48.783430 24818 raft_consensus.cc:1275] T 65345be99efc4ea7bf98c50f9f2678b8 P 08e1711cb2de485092226dd78ebcdb4c [term 2 FOLLOWER]: Refusing update from remote peer 020e8ee127be4559a08dccacb1d2790b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:48.784921 24948 consensus_queue.cc:1048] T 65345be99efc4ea7bf98c50f9f2678b8 P 020e8ee127be4559a08dccacb1d2790b [LEADER]: Connected to new peer: Peer: permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:48.786557 24566 catalog_manager.cc:5697] T 0f1b9086a754424297bb628279494e55 P 36d4b1d255db4886a9bb549a0d4920fd reported cstate change: term changed from 1 to 2, leader changed from 08e1711cb2de485092226dd78ebcdb4c (127.23.245.131) to 36d4b1d255db4886a9bb549a0d4920fd (127.23.245.129). New cstate: current_term: 2 leader_uuid: "36d4b1d255db4886a9bb549a0d4920fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:48.796087 24669 raft_consensus.cc:1275] T 65345be99efc4ea7bf98c50f9f2678b8 P 36d4b1d255db4886a9bb549a0d4920fd [term 2 FOLLOWER]: Refusing update from remote peer 020e8ee127be4559a08dccacb1d2790b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:48.800522 24947 consensus_queue.cc:1048] T 65345be99efc4ea7bf98c50f9f2678b8 P 020e8ee127be4559a08dccacb1d2790b [LEADER]: Connected to new peer: Peer: permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:48.803647 24667 raft_consensus.cc:2468] T 37a3d0199f90466490c70a3f3c466ca4 P 36d4b1d255db4886a9bb549a0d4920fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 020e8ee127be4559a08dccacb1d2790b in term 2.
I20260709 12:21:48.806150 24819 raft_consensus.cc:2468] T 37a3d0199f90466490c70a3f3c466ca4 P 08e1711cb2de485092226dd78ebcdb4c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 020e8ee127be4559a08dccacb1d2790b in term 2.
I20260709 12:21:48.811234 24708 leader_election.cc:304] T 37a3d0199f90466490c70a3f3c466ca4 P 020e8ee127be4559a08dccacb1d2790b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 020e8ee127be4559a08dccacb1d2790b, 08e1711cb2de485092226dd78ebcdb4c; no voters: 
I20260709 12:21:48.812143 24947 raft_consensus.cc:2804] T 37a3d0199f90466490c70a3f3c466ca4 P 020e8ee127be4559a08dccacb1d2790b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:48.812631 24947 raft_consensus.cc:697] T 37a3d0199f90466490c70a3f3c466ca4 P 020e8ee127be4559a08dccacb1d2790b [term 2 LEADER]: Becoming Leader. State: Replica: 020e8ee127be4559a08dccacb1d2790b, State: Running, Role: LEADER
I20260709 12:21:48.813431 24947 consensus_queue.cc:237] T 37a3d0199f90466490c70a3f3c466ca4 P 020e8ee127be4559a08dccacb1d2790b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:48.822927 24564 catalog_manager.cc:5697] T 37a3d0199f90466490c70a3f3c466ca4 P 020e8ee127be4559a08dccacb1d2790b reported cstate change: term changed from 1 to 2, leader changed from 36d4b1d255db4886a9bb549a0d4920fd (127.23.245.129) to 020e8ee127be4559a08dccacb1d2790b (127.23.245.130). New cstate: current_term: 2 leader_uuid: "020e8ee127be4559a08dccacb1d2790b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:48.857301 24819 raft_consensus.cc:1275] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c [term 2 FOLLOWER]: Refusing update from remote peer 36d4b1d255db4886a9bb549a0d4920fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:48.858668 24907 consensus_queue.cc:1048] T 03bcafc1c9cc41c2b06d28c03004235e P 36d4b1d255db4886a9bb549a0d4920fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:48.871099 24741 raft_consensus.cc:1275] T 03bcafc1c9cc41c2b06d28c03004235e P 020e8ee127be4559a08dccacb1d2790b [term 2 FOLLOWER]: Refusing update from remote peer 36d4b1d255db4886a9bb549a0d4920fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:48.872649 24902 consensus_queue.cc:1048] T 03bcafc1c9cc41c2b06d28c03004235e P 36d4b1d255db4886a9bb549a0d4920fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:48.994278 24669 raft_consensus.cc:1275] T aa0b964a979d4687ba4fcf406e1b04a8 P 36d4b1d255db4886a9bb549a0d4920fd [term 2 FOLLOWER]: Refusing update from remote peer 020e8ee127be4559a08dccacb1d2790b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:48.995539 24947 consensus_queue.cc:1048] T aa0b964a979d4687ba4fcf406e1b04a8 P 020e8ee127be4559a08dccacb1d2790b [LEADER]: Connected to new peer: Peer: permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:49.004570 24819 raft_consensus.cc:1275] T aa0b964a979d4687ba4fcf406e1b04a8 P 08e1711cb2de485092226dd78ebcdb4c [term 2 FOLLOWER]: Refusing update from remote peer 020e8ee127be4559a08dccacb1d2790b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:49.006090 24947 consensus_queue.cc:1048] T aa0b964a979d4687ba4fcf406e1b04a8 P 020e8ee127be4559a08dccacb1d2790b [LEADER]: Connected to new peer: Peer: permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:49.064463 24741 raft_consensus.cc:1275] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b [term 2 FOLLOWER]: Refusing update from remote peer 36d4b1d255db4886a9bb549a0d4920fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:49.066051 24902 consensus_queue.cc:1048] T 86d058965a9647e19043bf3db75c062f P 36d4b1d255db4886a9bb549a0d4920fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:49.075479 24819 raft_consensus.cc:1275] T 86d058965a9647e19043bf3db75c062f P 08e1711cb2de485092226dd78ebcdb4c [term 2 FOLLOWER]: Refusing update from remote peer 36d4b1d255db4886a9bb549a0d4920fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:49.076943 24902 consensus_queue.cc:1048] T 86d058965a9647e19043bf3db75c062f P 36d4b1d255db4886a9bb549a0d4920fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:49.089704 24741 raft_consensus.cc:1275] T d31655c39a4d409694a59895fb21c98f P 020e8ee127be4559a08dccacb1d2790b [term 2 FOLLOWER]: Refusing update from remote peer 08e1711cb2de485092226dd78ebcdb4c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:49.091025 24869 consensus_queue.cc:1048] T d31655c39a4d409694a59895fb21c98f P 08e1711cb2de485092226dd78ebcdb4c [LEADER]: Connected to new peer: Peer: permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:49.102108 24669 raft_consensus.cc:1275] T d31655c39a4d409694a59895fb21c98f P 36d4b1d255db4886a9bb549a0d4920fd [term 2 FOLLOWER]: Refusing update from remote peer 08e1711cb2de485092226dd78ebcdb4c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:49.105252 24895 consensus_queue.cc:1048] T d31655c39a4d409694a59895fb21c98f P 08e1711cb2de485092226dd78ebcdb4c [LEADER]: Connected to new peer: Peer: permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:49.107316 24819 raft_consensus.cc:1275] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c [term 2 FOLLOWER]: Refusing update from remote peer 020e8ee127be4559a08dccacb1d2790b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:49.108976 24948 consensus_queue.cc:1048] T cdc1bfaa521a420288862680a176a386 P 020e8ee127be4559a08dccacb1d2790b [LEADER]: Connected to new peer: Peer: permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:49.120368 24669 raft_consensus.cc:1275] T cdc1bfaa521a420288862680a176a386 P 36d4b1d255db4886a9bb549a0d4920fd [term 2 FOLLOWER]: Refusing update from remote peer 020e8ee127be4559a08dccacb1d2790b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:49.123708 24948 consensus_queue.cc:1048] T cdc1bfaa521a420288862680a176a386 P 020e8ee127be4559a08dccacb1d2790b [LEADER]: Connected to new peer: Peer: permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:49.260993 24741 raft_consensus.cc:1275] T 0f1b9086a754424297bb628279494e55 P 020e8ee127be4559a08dccacb1d2790b [term 2 FOLLOWER]: Refusing update from remote peer 36d4b1d255db4886a9bb549a0d4920fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:49.262435 24868 consensus_queue.cc:1048] T 0f1b9086a754424297bb628279494e55 P 36d4b1d255db4886a9bb549a0d4920fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:49.272665 24818 raft_consensus.cc:1275] T 0f1b9086a754424297bb628279494e55 P 08e1711cb2de485092226dd78ebcdb4c [term 2 FOLLOWER]: Refusing update from remote peer 36d4b1d255db4886a9bb549a0d4920fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:49.275218 24902 consensus_queue.cc:1048] T 0f1b9086a754424297bb628279494e55 P 36d4b1d255db4886a9bb549a0d4920fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:49.307386 24818 raft_consensus.cc:1275] T 37a3d0199f90466490c70a3f3c466ca4 P 08e1711cb2de485092226dd78ebcdb4c [term 2 FOLLOWER]: Refusing update from remote peer 020e8ee127be4559a08dccacb1d2790b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:49.310281 24948 consensus_queue.cc:1048] T 37a3d0199f90466490c70a3f3c466ca4 P 020e8ee127be4559a08dccacb1d2790b [LEADER]: Connected to new peer: Peer: permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:49.320267 24669 raft_consensus.cc:1275] T 37a3d0199f90466490c70a3f3c466ca4 P 36d4b1d255db4886a9bb549a0d4920fd [term 2 FOLLOWER]: Refusing update from remote peer 020e8ee127be4559a08dccacb1d2790b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:49.321938 24912 consensus_queue.cc:1048] T 37a3d0199f90466490c70a3f3c466ca4 P 020e8ee127be4559a08dccacb1d2790b [LEADER]: Connected to new peer: Peer: permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:51.386694 24534 auto_leader_rebalancer-test.cc:294] The leader distribution is 
I20260709 12:21:51.387493 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:51.409112 24667 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03bcafc1c9cc41c2b06d28c03004235e"
dest_uuid: "36d4b1d255db4886a9bb549a0d4920fd"
mode: GRACEFUL
new_leader_uuid: "08e1711cb2de485092226dd78ebcdb4c"
 from {username='slave'} at 127.0.0.1:55340
I20260709 12:21:51.409742 24667 raft_consensus.cc:606] T 03bcafc1c9cc41c2b06d28c03004235e P 36d4b1d255db4886a9bb549a0d4920fd [term 2 LEADER]: Received request to transfer leadership to TS 08e1711cb2de485092226dd78ebcdb4c
I20260709 12:21:51.423333 24741 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cdc1bfaa521a420288862680a176a386"
dest_uuid: "020e8ee127be4559a08dccacb1d2790b"
mode: GRACEFUL
new_leader_uuid: "08e1711cb2de485092226dd78ebcdb4c"
 from {username='slave'} at 127.0.0.1:53086
I20260709 12:21:51.423995 24741 raft_consensus.cc:606] T cdc1bfaa521a420288862680a176a386 P 020e8ee127be4559a08dccacb1d2790b [term 2 LEADER]: Received request to transfer leadership to TS 08e1711cb2de485092226dd78ebcdb4c
I20260709 12:21:51.425217 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:21:51.425734 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:51.534996 24947 raft_consensus.cc:993] T cdc1bfaa521a420288862680a176a386 P 020e8ee127be4559a08dccacb1d2790b: : Instructing follower 08e1711cb2de485092226dd78ebcdb4c to start an election
I20260709 12:21:51.535458 24960 raft_consensus.cc:1081] T cdc1bfaa521a420288862680a176a386 P 020e8ee127be4559a08dccacb1d2790b [term 2 LEADER]: Signalling peer 08e1711cb2de485092226dd78ebcdb4c to start an election
I20260709 12:21:51.536957 24818 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cdc1bfaa521a420288862680a176a386"
dest_uuid: "08e1711cb2de485092226dd78ebcdb4c"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:21:51.537446 24818 raft_consensus.cc:493] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:51.537748 24818 raft_consensus.cc:3060] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:51.542176 24818 raft_consensus.cc:515] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:51.543721 24818 leader_election.cc:290] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c [CANDIDATE]: Term 3 election: Requested vote from peers 36d4b1d255db4886a9bb549a0d4920fd (127.23.245.129:33613), 020e8ee127be4559a08dccacb1d2790b (127.23.245.130:44139)
I20260709 12:21:51.544585 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdc1bfaa521a420288862680a176a386" candidate_uuid: "08e1711cb2de485092226dd78ebcdb4c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "36d4b1d255db4886a9bb549a0d4920fd"
I20260709 12:21:51.545202 24667 raft_consensus.cc:3060] T cdc1bfaa521a420288862680a176a386 P 36d4b1d255db4886a9bb549a0d4920fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:51.545104 24741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdc1bfaa521a420288862680a176a386" candidate_uuid: "08e1711cb2de485092226dd78ebcdb4c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "020e8ee127be4559a08dccacb1d2790b"
I20260709 12:21:51.545778 24741 raft_consensus.cc:3055] T cdc1bfaa521a420288862680a176a386 P 020e8ee127be4559a08dccacb1d2790b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:51.546123 24741 raft_consensus.cc:740] T cdc1bfaa521a420288862680a176a386 P 020e8ee127be4559a08dccacb1d2790b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 020e8ee127be4559a08dccacb1d2790b, State: Running, Role: LEADER
I20260709 12:21:51.546933 24741 consensus_queue.cc:260] T cdc1bfaa521a420288862680a176a386 P 020e8ee127be4559a08dccacb1d2790b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:51.548173 24741 raft_consensus.cc:3060] T cdc1bfaa521a420288862680a176a386 P 020e8ee127be4559a08dccacb1d2790b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:51.551954 24667 raft_consensus.cc:2468] T cdc1bfaa521a420288862680a176a386 P 36d4b1d255db4886a9bb549a0d4920fd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08e1711cb2de485092226dd78ebcdb4c in term 3.
I20260709 12:21:51.553321 24785 leader_election.cc:304] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08e1711cb2de485092226dd78ebcdb4c, 36d4b1d255db4886a9bb549a0d4920fd; no voters: 
I20260709 12:21:51.554121 24955 raft_consensus.cc:2804] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:51.554662 24741 raft_consensus.cc:2468] T cdc1bfaa521a420288862680a176a386 P 020e8ee127be4559a08dccacb1d2790b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08e1711cb2de485092226dd78ebcdb4c in term 3.
I20260709 12:21:51.555249 24955 raft_consensus.cc:697] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c [term 3 LEADER]: Becoming Leader. State: Replica: 08e1711cb2de485092226dd78ebcdb4c, State: Running, Role: LEADER
I20260709 12:21:51.556094 24955 consensus_queue.cc:237] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:51.568512 24565 catalog_manager.cc:5697] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c reported cstate change: term changed from 2 to 3, leader changed from 020e8ee127be4559a08dccacb1d2790b (127.23.245.130) to 08e1711cb2de485092226dd78ebcdb4c (127.23.245.131). New cstate: current_term: 3 leader_uuid: "08e1711cb2de485092226dd78ebcdb4c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:51.698462 24868 raft_consensus.cc:993] T 03bcafc1c9cc41c2b06d28c03004235e P 36d4b1d255db4886a9bb549a0d4920fd: : Instructing follower 08e1711cb2de485092226dd78ebcdb4c to start an election
I20260709 12:21:51.698892 24868 raft_consensus.cc:1081] T 03bcafc1c9cc41c2b06d28c03004235e P 36d4b1d255db4886a9bb549a0d4920fd [term 2 LEADER]: Signalling peer 08e1711cb2de485092226dd78ebcdb4c to start an election
I20260709 12:21:51.700304 24819 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03bcafc1c9cc41c2b06d28c03004235e"
dest_uuid: "08e1711cb2de485092226dd78ebcdb4c"
 from {username='slave'} at 127.0.0.1:50106
I20260709 12:21:51.700730 24819 raft_consensus.cc:493] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:51.700986 24819 raft_consensus.cc:3060] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:51.706634 24819 raft_consensus.cc:515] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:51.708585 24819 leader_election.cc:290] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c [CANDIDATE]: Term 3 election: Requested vote from peers 36d4b1d255db4886a9bb549a0d4920fd (127.23.245.129:33613), 020e8ee127be4559a08dccacb1d2790b (127.23.245.130:44139)
I20260709 12:21:51.709232 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bcafc1c9cc41c2b06d28c03004235e" candidate_uuid: "08e1711cb2de485092226dd78ebcdb4c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "36d4b1d255db4886a9bb549a0d4920fd"
I20260709 12:21:51.709512 24741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bcafc1c9cc41c2b06d28c03004235e" candidate_uuid: "08e1711cb2de485092226dd78ebcdb4c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "020e8ee127be4559a08dccacb1d2790b"
I20260709 12:21:51.709833 24667 raft_consensus.cc:3055] T 03bcafc1c9cc41c2b06d28c03004235e P 36d4b1d255db4886a9bb549a0d4920fd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:51.710037 24741 raft_consensus.cc:3060] T 03bcafc1c9cc41c2b06d28c03004235e P 020e8ee127be4559a08dccacb1d2790b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:51.710202 24667 raft_consensus.cc:740] T 03bcafc1c9cc41c2b06d28c03004235e P 36d4b1d255db4886a9bb549a0d4920fd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 36d4b1d255db4886a9bb549a0d4920fd, State: Running, Role: LEADER
I20260709 12:21:51.711035 24667 consensus_queue.cc:260] T 03bcafc1c9cc41c2b06d28c03004235e P 36d4b1d255db4886a9bb549a0d4920fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:51.712281 24667 raft_consensus.cc:3060] T 03bcafc1c9cc41c2b06d28c03004235e P 36d4b1d255db4886a9bb549a0d4920fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:51.716943 24741 raft_consensus.cc:2468] T 03bcafc1c9cc41c2b06d28c03004235e P 020e8ee127be4559a08dccacb1d2790b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08e1711cb2de485092226dd78ebcdb4c in term 3.
I20260709 12:21:51.718297 24785 leader_election.cc:304] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 020e8ee127be4559a08dccacb1d2790b, 08e1711cb2de485092226dd78ebcdb4c; no voters: 
I20260709 12:21:51.718993 24667 raft_consensus.cc:2468] T 03bcafc1c9cc41c2b06d28c03004235e P 36d4b1d255db4886a9bb549a0d4920fd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08e1711cb2de485092226dd78ebcdb4c in term 3.
I20260709 12:21:51.719142 24955 raft_consensus.cc:2804] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:51.719619 24955 raft_consensus.cc:697] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c [term 3 LEADER]: Becoming Leader. State: Replica: 08e1711cb2de485092226dd78ebcdb4c, State: Running, Role: LEADER
I20260709 12:21:51.720422 24955 consensus_queue.cc:237] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:21:51.730906 24565 catalog_manager.cc:5697] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c reported cstate change: term changed from 2 to 3, leader changed from 36d4b1d255db4886a9bb549a0d4920fd (127.23.245.129) to 08e1711cb2de485092226dd78ebcdb4c (127.23.245.131). New cstate: current_term: 3 leader_uuid: "08e1711cb2de485092226dd78ebcdb4c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:51.965138 24744 raft_consensus.cc:1275] T cdc1bfaa521a420288862680a176a386 P 020e8ee127be4559a08dccacb1d2790b [term 3 FOLLOWER]: Refusing update from remote peer 08e1711cb2de485092226dd78ebcdb4c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:51.966567 24955 consensus_queue.cc:1048] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c [LEADER]: Connected to new peer: Peer: permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:51.977174 24667 raft_consensus.cc:1275] T cdc1bfaa521a420288862680a176a386 P 36d4b1d255db4886a9bb549a0d4920fd [term 3 FOLLOWER]: Refusing update from remote peer 08e1711cb2de485092226dd78ebcdb4c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:51.979004 24961 consensus_queue.cc:1048] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c [LEADER]: Connected to new peer: Peer: permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:52.128335 24744 raft_consensus.cc:1275] T 03bcafc1c9cc41c2b06d28c03004235e P 020e8ee127be4559a08dccacb1d2790b [term 3 FOLLOWER]: Refusing update from remote peer 08e1711cb2de485092226dd78ebcdb4c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:52.129552 24961 consensus_queue.cc:1048] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c [LEADER]: Connected to new peer: Peer: permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:52.138411 24667 raft_consensus.cc:1275] T 03bcafc1c9cc41c2b06d28c03004235e P 36d4b1d255db4886a9bb549a0d4920fd [term 3 FOLLOWER]: Refusing update from remote peer 08e1711cb2de485092226dd78ebcdb4c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:52.140256 24975 consensus_queue.cc:1048] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c [LEADER]: Connected to new peer: Peer: permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:52.426815 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:52.433027 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:52.433420 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:53.434396 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:53.439879 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:53.440560 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:54.441497 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:54.446345 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:54.446688 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:55.447649 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:55.452750 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:55.453147 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:56.454125 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:56.460053 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:56.460469 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:57.461505 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:57.466372 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:57.466755 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:58.467612 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:58.472236 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:58.472632 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:59.473557 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:59.479280 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:59.479733 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:00.480651 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:00.485838 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:00.486315 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:01.515177 24534 auto_leader_rebalancer-test.cc:313] The leader distribution is 
I20260709 12:22:01.520845 24667 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f1b9086a754424297bb628279494e55"
dest_uuid: "36d4b1d255db4886a9bb549a0d4920fd"
mode: GRACEFUL
new_leader_uuid: "020e8ee127be4559a08dccacb1d2790b"
 from {username='slave'} at 127.0.0.1:57608
I20260709 12:22:01.521848 24667 raft_consensus.cc:606] T 0f1b9086a754424297bb628279494e55 P 36d4b1d255db4886a9bb549a0d4920fd [term 2 LEADER]: Received request to transfer leadership to TS 020e8ee127be4559a08dccacb1d2790b
I20260709 12:22:01.526894 24667 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86d058965a9647e19043bf3db75c062f"
dest_uuid: "36d4b1d255db4886a9bb549a0d4920fd"
mode: GRACEFUL
new_leader_uuid: "020e8ee127be4559a08dccacb1d2790b"
 from {username='slave'} at 127.0.0.1:57608
I20260709 12:22:01.527357 24667 raft_consensus.cc:606] T 86d058965a9647e19043bf3db75c062f P 36d4b1d255db4886a9bb549a0d4920fd [term 2 LEADER]: Received request to transfer leadership to TS 020e8ee127be4559a08dccacb1d2790b
I20260709 12:22:01.532011 24819 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03bcafc1c9cc41c2b06d28c03004235e"
dest_uuid: "08e1711cb2de485092226dd78ebcdb4c"
mode: GRACEFUL
new_leader_uuid: "020e8ee127be4559a08dccacb1d2790b"
 from {username='slave'} at 127.0.0.1:50136
I20260709 12:22:01.532482 24819 raft_consensus.cc:606] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c [term 3 LEADER]: Received request to transfer leadership to TS 020e8ee127be4559a08dccacb1d2790b
I20260709 12:22:01.537292 24667 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6345b2fc6a174d8299f0dd3307c8415a"
dest_uuid: "36d4b1d255db4886a9bb549a0d4920fd"
mode: GRACEFUL
new_leader_uuid: "020e8ee127be4559a08dccacb1d2790b"
 from {username='slave'} at 127.0.0.1:57608
I20260709 12:22:01.537781 24667 raft_consensus.cc:606] T 6345b2fc6a174d8299f0dd3307c8415a P 36d4b1d255db4886a9bb549a0d4920fd [term 2 LEADER]: Received request to transfer leadership to TS 020e8ee127be4559a08dccacb1d2790b
I20260709 12:22:01.542443 24819 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cdc1bfaa521a420288862680a176a386"
dest_uuid: "08e1711cb2de485092226dd78ebcdb4c"
mode: GRACEFUL
new_leader_uuid: "020e8ee127be4559a08dccacb1d2790b"
 from {username='slave'} at 127.0.0.1:50136
I20260709 12:22:01.542902 24819 raft_consensus.cc:606] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c [term 3 LEADER]: Received request to transfer leadership to TS 020e8ee127be4559a08dccacb1d2790b
I20260709 12:22:01.623906 24955 raft_consensus.cc:993] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c: : Instructing follower 020e8ee127be4559a08dccacb1d2790b to start an election
I20260709 12:22:01.624596 24981 raft_consensus.cc:1081] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c [term 3 LEADER]: Signalling peer 020e8ee127be4559a08dccacb1d2790b to start an election
I20260709 12:22:01.626535 24741 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03bcafc1c9cc41c2b06d28c03004235e"
dest_uuid: "020e8ee127be4559a08dccacb1d2790b"
 from {username='slave'} at 127.0.0.1:59290
I20260709 12:22:01.627044 24741 raft_consensus.cc:493] T 03bcafc1c9cc41c2b06d28c03004235e P 020e8ee127be4559a08dccacb1d2790b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:01.627409 24741 raft_consensus.cc:3060] T 03bcafc1c9cc41c2b06d28c03004235e P 020e8ee127be4559a08dccacb1d2790b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:01.632633 24741 raft_consensus.cc:515] T 03bcafc1c9cc41c2b06d28c03004235e P 020e8ee127be4559a08dccacb1d2790b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:22:01.634568 24741 leader_election.cc:290] T 03bcafc1c9cc41c2b06d28c03004235e P 020e8ee127be4559a08dccacb1d2790b [CANDIDATE]: Term 4 election: Requested vote from peers 36d4b1d255db4886a9bb549a0d4920fd (127.23.245.129:33613), 08e1711cb2de485092226dd78ebcdb4c (127.23.245.131:32793)
I20260709 12:22:01.635648 24819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bcafc1c9cc41c2b06d28c03004235e" candidate_uuid: "020e8ee127be4559a08dccacb1d2790b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "08e1711cb2de485092226dd78ebcdb4c"
I20260709 12:22:01.635766 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03bcafc1c9cc41c2b06d28c03004235e" candidate_uuid: "020e8ee127be4559a08dccacb1d2790b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "36d4b1d255db4886a9bb549a0d4920fd"
I20260709 12:22:01.636380 24819 raft_consensus.cc:3055] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:01.636441 24667 raft_consensus.cc:3060] T 03bcafc1c9cc41c2b06d28c03004235e P 36d4b1d255db4886a9bb549a0d4920fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:01.636644 24819 raft_consensus.cc:740] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 08e1711cb2de485092226dd78ebcdb4c, State: Running, Role: LEADER
I20260709 12:22:01.637428 24819 consensus_queue.cc:260] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:22:01.638365 24819 raft_consensus.cc:3060] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:01.642252 24667 raft_consensus.cc:2468] T 03bcafc1c9cc41c2b06d28c03004235e P 36d4b1d255db4886a9bb549a0d4920fd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 020e8ee127be4559a08dccacb1d2790b in term 4.
I20260709 12:22:01.643546 24819 raft_consensus.cc:2468] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 020e8ee127be4559a08dccacb1d2790b in term 4.
I20260709 12:22:01.644230 24710 leader_election.cc:304] T 03bcafc1c9cc41c2b06d28c03004235e P 020e8ee127be4559a08dccacb1d2790b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 020e8ee127be4559a08dccacb1d2790b, 36d4b1d255db4886a9bb549a0d4920fd; no voters: 
I20260709 12:22:01.645234 24960 raft_consensus.cc:2804] T 03bcafc1c9cc41c2b06d28c03004235e P 020e8ee127be4559a08dccacb1d2790b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:01.646256 24960 raft_consensus.cc:697] T 03bcafc1c9cc41c2b06d28c03004235e P 020e8ee127be4559a08dccacb1d2790b [term 4 LEADER]: Becoming Leader. State: Replica: 020e8ee127be4559a08dccacb1d2790b, State: Running, Role: LEADER
I20260709 12:22:01.647073 24960 consensus_queue.cc:237] T 03bcafc1c9cc41c2b06d28c03004235e P 020e8ee127be4559a08dccacb1d2790b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:22:01.654476 24566 catalog_manager.cc:5697] T 03bcafc1c9cc41c2b06d28c03004235e P 020e8ee127be4559a08dccacb1d2790b reported cstate change: term changed from 3 to 4, leader changed from 08e1711cb2de485092226dd78ebcdb4c (127.23.245.131) to 020e8ee127be4559a08dccacb1d2790b (127.23.245.130). New cstate: current_term: 4 leader_uuid: "020e8ee127be4559a08dccacb1d2790b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:01.808203 24955 raft_consensus.cc:993] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c: : Instructing follower 020e8ee127be4559a08dccacb1d2790b to start an election
I20260709 12:22:01.808679 24955 raft_consensus.cc:1081] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c [term 3 LEADER]: Signalling peer 020e8ee127be4559a08dccacb1d2790b to start an election
I20260709 12:22:01.810019 24741 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cdc1bfaa521a420288862680a176a386"
dest_uuid: "020e8ee127be4559a08dccacb1d2790b"
 from {username='slave'} at 127.0.0.1:59290
I20260709 12:22:01.810500 24741 raft_consensus.cc:493] T cdc1bfaa521a420288862680a176a386 P 020e8ee127be4559a08dccacb1d2790b [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:01.810768 24741 raft_consensus.cc:3060] T cdc1bfaa521a420288862680a176a386 P 020e8ee127be4559a08dccacb1d2790b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:01.814874 24741 raft_consensus.cc:515] T cdc1bfaa521a420288862680a176a386 P 020e8ee127be4559a08dccacb1d2790b [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:22:01.816311 24741 leader_election.cc:290] T cdc1bfaa521a420288862680a176a386 P 020e8ee127be4559a08dccacb1d2790b [CANDIDATE]: Term 4 election: Requested vote from peers 36d4b1d255db4886a9bb549a0d4920fd (127.23.245.129:33613), 08e1711cb2de485092226dd78ebcdb4c (127.23.245.131:32793)
I20260709 12:22:01.817350 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdc1bfaa521a420288862680a176a386" candidate_uuid: "020e8ee127be4559a08dccacb1d2790b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "36d4b1d255db4886a9bb549a0d4920fd"
I20260709 12:22:01.817497 24818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdc1bfaa521a420288862680a176a386" candidate_uuid: "020e8ee127be4559a08dccacb1d2790b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "08e1711cb2de485092226dd78ebcdb4c"
I20260709 12:22:01.817836 24669 raft_consensus.cc:3060] T cdc1bfaa521a420288862680a176a386 P 36d4b1d255db4886a9bb549a0d4920fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:01.818099 24818 raft_consensus.cc:3055] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:01.818421 24818 raft_consensus.cc:740] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 08e1711cb2de485092226dd78ebcdb4c, State: Running, Role: LEADER
I20260709 12:22:01.819283 24818 consensus_queue.cc:260] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:22:01.820314 24818 raft_consensus.cc:3060] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:01.822297 24669 raft_consensus.cc:2468] T cdc1bfaa521a420288862680a176a386 P 36d4b1d255db4886a9bb549a0d4920fd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 020e8ee127be4559a08dccacb1d2790b in term 4.
I20260709 12:22:01.823268 24710 leader_election.cc:304] T cdc1bfaa521a420288862680a176a386 P 020e8ee127be4559a08dccacb1d2790b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 020e8ee127be4559a08dccacb1d2790b, 36d4b1d255db4886a9bb549a0d4920fd; no voters: 
I20260709 12:22:01.823935 24960 raft_consensus.cc:2804] T cdc1bfaa521a420288862680a176a386 P 020e8ee127be4559a08dccacb1d2790b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:01.824364 24960 raft_consensus.cc:697] T cdc1bfaa521a420288862680a176a386 P 020e8ee127be4559a08dccacb1d2790b [term 4 LEADER]: Becoming Leader. State: Replica: 020e8ee127be4559a08dccacb1d2790b, State: Running, Role: LEADER
I20260709 12:22:01.825098 24960 consensus_queue.cc:237] T cdc1bfaa521a420288862680a176a386 P 020e8ee127be4559a08dccacb1d2790b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:22:01.825634 24818 raft_consensus.cc:2468] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 020e8ee127be4559a08dccacb1d2790b in term 4.
I20260709 12:22:01.832399 24566 catalog_manager.cc:5697] T cdc1bfaa521a420288862680a176a386 P 020e8ee127be4559a08dccacb1d2790b reported cstate change: term changed from 3 to 4, leader changed from 08e1711cb2de485092226dd78ebcdb4c (127.23.245.131) to 020e8ee127be4559a08dccacb1d2790b (127.23.245.130). New cstate: current_term: 4 leader_uuid: "020e8ee127be4559a08dccacb1d2790b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:01.904526 24989 raft_consensus.cc:993] T 86d058965a9647e19043bf3db75c062f P 36d4b1d255db4886a9bb549a0d4920fd: : Instructing follower 020e8ee127be4559a08dccacb1d2790b to start an election
I20260709 12:22:01.905218 24989 raft_consensus.cc:1081] T 86d058965a9647e19043bf3db75c062f P 36d4b1d255db4886a9bb549a0d4920fd [term 2 LEADER]: Signalling peer 020e8ee127be4559a08dccacb1d2790b to start an election
I20260709 12:22:01.908784 24741 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "86d058965a9647e19043bf3db75c062f"
dest_uuid: "020e8ee127be4559a08dccacb1d2790b"
 from {username='slave'} at 127.0.0.1:59302
I20260709 12:22:02.050736 24989 raft_consensus.cc:993] T 0f1b9086a754424297bb628279494e55 P 36d4b1d255db4886a9bb549a0d4920fd: : Instructing follower 020e8ee127be4559a08dccacb1d2790b to start an election
I20260709 12:22:02.051044 24741 raft_consensus.cc:493] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:02.051301 24989 raft_consensus.cc:1081] T 0f1b9086a754424297bb628279494e55 P 36d4b1d255db4886a9bb549a0d4920fd [term 2 LEADER]: Signalling peer 020e8ee127be4559a08dccacb1d2790b to start an election
I20260709 12:22:02.051535 24741 raft_consensus.cc:3060] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:02.054749 24744 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f1b9086a754424297bb628279494e55"
dest_uuid: "020e8ee127be4559a08dccacb1d2790b"
 from {username='slave'} at 127.0.0.1:59302
I20260709 12:22:02.055269 24990 raft_consensus.cc:993] T 6345b2fc6a174d8299f0dd3307c8415a P 36d4b1d255db4886a9bb549a0d4920fd: : Instructing follower 020e8ee127be4559a08dccacb1d2790b to start an election
I20260709 12:22:02.055356 24744 raft_consensus.cc:493] T 0f1b9086a754424297bb628279494e55 P 020e8ee127be4559a08dccacb1d2790b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:02.055720 24990 raft_consensus.cc:1081] T 6345b2fc6a174d8299f0dd3307c8415a P 36d4b1d255db4886a9bb549a0d4920fd [term 2 LEADER]: Signalling peer 020e8ee127be4559a08dccacb1d2790b to start an election
I20260709 12:22:02.055773 24744 raft_consensus.cc:3060] T 0f1b9086a754424297bb628279494e55 P 020e8ee127be4559a08dccacb1d2790b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:02.058770 24741 raft_consensus.cc:515] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:22:02.060680 24741 leader_election.cc:290] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b [CANDIDATE]: Term 3 election: Requested vote from peers 36d4b1d255db4886a9bb549a0d4920fd (127.23.245.129:33613), 08e1711cb2de485092226dd78ebcdb4c (127.23.245.131:32793)
I20260709 12:22:02.063434 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d058965a9647e19043bf3db75c062f" candidate_uuid: "020e8ee127be4559a08dccacb1d2790b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "36d4b1d255db4886a9bb549a0d4920fd"
I20260709 12:22:02.063383 24744 raft_consensus.cc:515] T 0f1b9086a754424297bb628279494e55 P 020e8ee127be4559a08dccacb1d2790b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } }
I20260709 12:22:02.064110 24669 raft_consensus.cc:3055] T 86d058965a9647e19043bf3db75c062f P 36d4b1d255db4886a9bb549a0d4920fd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:02.064447 24669 raft_consensus.cc:740] T 86d058965a9647e19043bf3db75c062f P 36d4b1d255db4886a9bb549a0d4920fd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 36d4b1d255db4886a9bb549a0d4920fd, State: Running, Role: LEADER
I20260709 12:22:02.065201 24669 consensus_queue.cc:260] T 86d058965a9647e19043bf3db75c062f P 36d4b1d255db4886a9bb549a0d4920fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:22:02.066198 24669 raft_consensus.cc:3060] T 86d058965a9647e19043bf3db75c062f P 36d4b1d255db4886a9bb549a0d4920fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:02.066902 24744 leader_election.cc:290] T 0f1b9086a754424297bb628279494e55 P 020e8ee127be4559a08dccacb1d2790b [CANDIDATE]: Term 3 election: Requested vote from peers 36d4b1d255db4886a9bb549a0d4920fd (127.23.245.129:33613), 08e1711cb2de485092226dd78ebcdb4c (127.23.245.131:32793)
I20260709 12:22:02.072043 24669 raft_consensus.cc:2468] T 86d058965a9647e19043bf3db75c062f P 36d4b1d255db4886a9bb549a0d4920fd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 020e8ee127be4559a08dccacb1d2790b in term 3.
I20260709 12:22:02.074891 24744 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6345b2fc6a174d8299f0dd3307c8415a"
dest_uuid: "020e8ee127be4559a08dccacb1d2790b"
 from {username='slave'} at 127.0.0.1:59302
I20260709 12:22:02.075172 24667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1b9086a754424297bb628279494e55" candidate_uuid: "020e8ee127be4559a08dccacb1d2790b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "36d4b1d255db4886a9bb549a0d4920fd"
I20260709 12:22:02.075393 24710 leader_election.cc:304] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 020e8ee127be4559a08dccacb1d2790b, 36d4b1d255db4886a9bb549a0d4920fd; no voters: 
I20260709 12:22:02.075544 24744 raft_consensus.cc:493] T 6345b2fc6a174d8299f0dd3307c8415a P 020e8ee127be4559a08dccacb1d2790b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:02.075750 24667 raft_consensus.cc:3055] T 0f1b9086a754424297bb628279494e55 P 36d4b1d255db4886a9bb549a0d4920fd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:02.076010 24744 raft_consensus.cc:3060] T 6345b2fc6a174d8299f0dd3307c8415a P 020e8ee127be4559a08dccacb1d2790b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:02.076195 24667 raft_consensus.cc:740] T 0f1b9086a754424297bb628279494e55 P 36d4b1d255db4886a9bb549a0d4920fd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 36d4b1d255db4886a9bb549a0d4920fd, State: Running, Role: LEADER
I20260709 12:22:02.077165 24982 raft_consensus.cc:2804] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:02.077091 24667 consensus_queue.cc:260] T 0f1b9086a754424297bb628279494e55 P 36d4b1d255db4886a9bb549a0d4920fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } }
I20260709 12:22:02.077656 24982 raft_consensus.cc:697] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b [term 3 LEADER]: Becoming Leader. State: Replica: 020e8ee127be4559a08dccacb1d2790b, State: Running, Role: LEADER
I20260709 12:22:02.078398 24667 raft_consensus.cc:3060] T 0f1b9086a754424297bb628279494e55 P 36d4b1d255db4886a9bb549a0d4920fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:02.078514 24982 consensus_queue.cc:237] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:22:02.080798 24744 raft_consensus.cc:515] T 6345b2fc6a174d8299f0dd3307c8415a P 020e8ee127be4559a08dccacb1d2790b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:22:02.082631 24744 leader_election.cc:290] T 6345b2fc6a174d8299f0dd3307c8415a P 020e8ee127be4559a08dccacb1d2790b [CANDIDATE]: Term 3 election: Requested vote from peers 36d4b1d255db4886a9bb549a0d4920fd (127.23.245.129:33613), 08e1711cb2de485092226dd78ebcdb4c (127.23.245.131:32793)
I20260709 12:22:02.085062 24667 raft_consensus.cc:2468] T 0f1b9086a754424297bb628279494e55 P 36d4b1d255db4886a9bb549a0d4920fd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 020e8ee127be4559a08dccacb1d2790b in term 3.
I20260709 12:22:02.085378 24668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6345b2fc6a174d8299f0dd3307c8415a" candidate_uuid: "020e8ee127be4559a08dccacb1d2790b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "36d4b1d255db4886a9bb549a0d4920fd"
I20260709 12:22:02.086012 24668 raft_consensus.cc:3055] T 6345b2fc6a174d8299f0dd3307c8415a P 36d4b1d255db4886a9bb549a0d4920fd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:02.086346 24668 raft_consensus.cc:740] T 6345b2fc6a174d8299f0dd3307c8415a P 36d4b1d255db4886a9bb549a0d4920fd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 36d4b1d255db4886a9bb549a0d4920fd, State: Running, Role: LEADER
I20260709 12:22:02.087265 24668 consensus_queue.cc:260] T 6345b2fc6a174d8299f0dd3307c8415a P 36d4b1d255db4886a9bb549a0d4920fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:22:02.089030 24668 raft_consensus.cc:3060] T 6345b2fc6a174d8299f0dd3307c8415a P 36d4b1d255db4886a9bb549a0d4920fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:02.092449 24710 leader_election.cc:304] T 0f1b9086a754424297bb628279494e55 P 020e8ee127be4559a08dccacb1d2790b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 020e8ee127be4559a08dccacb1d2790b, 36d4b1d255db4886a9bb549a0d4920fd; no voters: 
I20260709 12:22:02.093668 24960 raft_consensus.cc:2804] T 0f1b9086a754424297bb628279494e55 P 020e8ee127be4559a08dccacb1d2790b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:02.094116 24960 raft_consensus.cc:697] T 0f1b9086a754424297bb628279494e55 P 020e8ee127be4559a08dccacb1d2790b [term 3 LEADER]: Becoming Leader. State: Replica: 020e8ee127be4559a08dccacb1d2790b, State: Running, Role: LEADER
I20260709 12:22:02.094759 24960 consensus_queue.cc:237] T 0f1b9086a754424297bb628279494e55 P 020e8ee127be4559a08dccacb1d2790b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } }
I20260709 12:22:02.102316 24819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1b9086a754424297bb628279494e55" candidate_uuid: "020e8ee127be4559a08dccacb1d2790b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "08e1711cb2de485092226dd78ebcdb4c"
I20260709 12:22:02.102895 24817 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6345b2fc6a174d8299f0dd3307c8415a" candidate_uuid: "020e8ee127be4559a08dccacb1d2790b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "08e1711cb2de485092226dd78ebcdb4c"
I20260709 12:22:02.103626 24817 raft_consensus.cc:3060] T 6345b2fc6a174d8299f0dd3307c8415a P 08e1711cb2de485092226dd78ebcdb4c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:02.103844 24816 raft_consensus.cc:1275] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c [term 4 FOLLOWER]: Refusing update from remote peer 020e8ee127be4559a08dccacb1d2790b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:02.102908 24819 raft_consensus.cc:3060] T 0f1b9086a754424297bb628279494e55 P 08e1711cb2de485092226dd78ebcdb4c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:02.104835 24668 raft_consensus.cc:2468] T 6345b2fc6a174d8299f0dd3307c8415a P 36d4b1d255db4886a9bb549a0d4920fd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 020e8ee127be4559a08dccacb1d2790b in term 3.
I20260709 12:22:02.105957 24991 consensus_queue.cc:1048] T 03bcafc1c9cc41c2b06d28c03004235e P 020e8ee127be4559a08dccacb1d2790b [LEADER]: Connected to new peer: Peer: permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:02.101979 24818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d058965a9647e19043bf3db75c062f" candidate_uuid: "020e8ee127be4559a08dccacb1d2790b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "08e1711cb2de485092226dd78ebcdb4c"
I20260709 12:22:02.109709 24818 raft_consensus.cc:3060] T 86d058965a9647e19043bf3db75c062f P 08e1711cb2de485092226dd78ebcdb4c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:02.111598 24819 raft_consensus.cc:2468] T 0f1b9086a754424297bb628279494e55 P 08e1711cb2de485092226dd78ebcdb4c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 020e8ee127be4559a08dccacb1d2790b in term 3.
I20260709 12:22:02.115186 24710 leader_election.cc:304] T 6345b2fc6a174d8299f0dd3307c8415a P 020e8ee127be4559a08dccacb1d2790b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 020e8ee127be4559a08dccacb1d2790b, 36d4b1d255db4886a9bb549a0d4920fd; no voters: 
I20260709 12:22:02.116159 24991 raft_consensus.cc:2804] T 6345b2fc6a174d8299f0dd3307c8415a P 020e8ee127be4559a08dccacb1d2790b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:02.117864 24991 raft_consensus.cc:697] T 6345b2fc6a174d8299f0dd3307c8415a P 020e8ee127be4559a08dccacb1d2790b [term 3 LEADER]: Becoming Leader. State: Replica: 020e8ee127be4559a08dccacb1d2790b, State: Running, Role: LEADER
I20260709 12:22:02.119728 24991 consensus_queue.cc:237] T 6345b2fc6a174d8299f0dd3307c8415a P 020e8ee127be4559a08dccacb1d2790b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:22:02.121639 24817 raft_consensus.cc:2468] T 6345b2fc6a174d8299f0dd3307c8415a P 08e1711cb2de485092226dd78ebcdb4c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 020e8ee127be4559a08dccacb1d2790b in term 3.
I20260709 12:22:02.125769 24818 raft_consensus.cc:2468] T 86d058965a9647e19043bf3db75c062f P 08e1711cb2de485092226dd78ebcdb4c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 020e8ee127be4559a08dccacb1d2790b in term 3.
I20260709 12:22:02.122869 24566 catalog_manager.cc:5697] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b reported cstate change: term changed from 2 to 3, leader changed from 36d4b1d255db4886a9bb549a0d4920fd (127.23.245.129) to 020e8ee127be4559a08dccacb1d2790b (127.23.245.130). New cstate: current_term: 3 leader_uuid: "020e8ee127be4559a08dccacb1d2790b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:02.134545 24668 raft_consensus.cc:1275] T 03bcafc1c9cc41c2b06d28c03004235e P 36d4b1d255db4886a9bb549a0d4920fd [term 4 FOLLOWER]: Refusing update from remote peer 020e8ee127be4559a08dccacb1d2790b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:02.136049 24982 consensus_queue.cc:1048] T 03bcafc1c9cc41c2b06d28c03004235e P 020e8ee127be4559a08dccacb1d2790b [LEADER]: Connected to new peer: Peer: permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:02.144052 24565 catalog_manager.cc:5697] T 0f1b9086a754424297bb628279494e55 P 020e8ee127be4559a08dccacb1d2790b reported cstate change: term changed from 2 to 3, leader changed from 36d4b1d255db4886a9bb549a0d4920fd (127.23.245.129) to 020e8ee127be4559a08dccacb1d2790b (127.23.245.130). New cstate: current_term: 3 leader_uuid: "020e8ee127be4559a08dccacb1d2790b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:02.145710 24565 catalog_manager.cc:5697] T 6345b2fc6a174d8299f0dd3307c8415a P 020e8ee127be4559a08dccacb1d2790b reported cstate change: term changed from 2 to 3, leader changed from 36d4b1d255db4886a9bb549a0d4920fd (127.23.245.129) to 020e8ee127be4559a08dccacb1d2790b (127.23.245.130). New cstate: current_term: 3 leader_uuid: "020e8ee127be4559a08dccacb1d2790b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:02.293629 24818 raft_consensus.cc:1275] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c [term 4 FOLLOWER]: Refusing update from remote peer 020e8ee127be4559a08dccacb1d2790b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:02.294951 24991 consensus_queue.cc:1048] T cdc1bfaa521a420288862680a176a386 P 020e8ee127be4559a08dccacb1d2790b [LEADER]: Connected to new peer: Peer: permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:02.304009 24668 raft_consensus.cc:1275] T cdc1bfaa521a420288862680a176a386 P 36d4b1d255db4886a9bb549a0d4920fd [term 4 FOLLOWER]: Refusing update from remote peer 020e8ee127be4559a08dccacb1d2790b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:02.305991 24991 consensus_queue.cc:1048] T cdc1bfaa521a420288862680a176a386 P 020e8ee127be4559a08dccacb1d2790b [LEADER]: Connected to new peer: Peer: permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:02.482719 24818 raft_consensus.cc:1275] T 0f1b9086a754424297bb628279494e55 P 08e1711cb2de485092226dd78ebcdb4c [term 3 FOLLOWER]: Refusing update from remote peer 020e8ee127be4559a08dccacb1d2790b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:02.484076 24991 consensus_queue.cc:1048] T 0f1b9086a754424297bb628279494e55 P 020e8ee127be4559a08dccacb1d2790b [LEADER]: Connected to new peer: Peer: permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:02.493012 24668 raft_consensus.cc:1275] T 0f1b9086a754424297bb628279494e55 P 36d4b1d255db4886a9bb549a0d4920fd [term 3 FOLLOWER]: Refusing update from remote peer 020e8ee127be4559a08dccacb1d2790b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:02.494628 24992 consensus_queue.cc:1048] T 0f1b9086a754424297bb628279494e55 P 020e8ee127be4559a08dccacb1d2790b [LEADER]: Connected to new peer: Peer: permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:02.540447 24668 raft_consensus.cc:1275] T 6345b2fc6a174d8299f0dd3307c8415a P 36d4b1d255db4886a9bb549a0d4920fd [term 3 FOLLOWER]: Refusing update from remote peer 020e8ee127be4559a08dccacb1d2790b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:02.541821 24991 consensus_queue.cc:1048] T 6345b2fc6a174d8299f0dd3307c8415a P 020e8ee127be4559a08dccacb1d2790b [LEADER]: Connected to new peer: Peer: permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:02.551213 24818 raft_consensus.cc:1275] T 6345b2fc6a174d8299f0dd3307c8415a P 08e1711cb2de485092226dd78ebcdb4c [term 3 FOLLOWER]: Refusing update from remote peer 020e8ee127be4559a08dccacb1d2790b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:02.553265 24960 consensus_queue.cc:1048] T 6345b2fc6a174d8299f0dd3307c8415a P 020e8ee127be4559a08dccacb1d2790b [LEADER]: Connected to new peer: Peer: permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:02.622680 24818 raft_consensus.cc:1275] T 86d058965a9647e19043bf3db75c062f P 08e1711cb2de485092226dd78ebcdb4c [term 3 FOLLOWER]: Refusing update from remote peer 020e8ee127be4559a08dccacb1d2790b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:02.624089 24960 consensus_queue.cc:1048] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b [LEADER]: Connected to new peer: Peer: permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:02.633925 24668 raft_consensus.cc:1275] T 86d058965a9647e19043bf3db75c062f P 36d4b1d255db4886a9bb549a0d4920fd [term 3 FOLLOWER]: Refusing update from remote peer 020e8ee127be4559a08dccacb1d2790b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:02.636166 24992 consensus_queue.cc:1048] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b [LEADER]: Connected to new peer: Peer: permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:22:03.023943 24766 debug-util.cc:398] Leaking SignalData structure 0x7b080012e060 after lost signal to thread 24537
W20260709 12:22:03.024981 24766 debug-util.cc:398] Leaking SignalData structure 0x7b080012e740 after lost signal to thread 24600
W20260709 12:22:03.025900 24766 debug-util.cc:398] Leaking SignalData structure 0x7b08001eec00 after lost signal to thread 24693
W20260709 12:22:03.026738 24766 debug-util.cc:398] Leaking SignalData structure 0x7b0800108820 after lost signal to thread 24769
W20260709 12:22:03.027536 24766 debug-util.cc:398] Leaking SignalData structure 0x7b0800151ba0 after lost signal to thread 24843
I20260709 12:22:04.689867 24534 auto_leader_rebalancer-test.cc:328] The leader distribution is 
I20260709 12:22:04.690739 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:04.697742 24744 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f1b9086a754424297bb628279494e55"
dest_uuid: "020e8ee127be4559a08dccacb1d2790b"
mode: GRACEFUL
new_leader_uuid: "36d4b1d255db4886a9bb549a0d4920fd"
 from {username='slave'} at 127.0.0.1:53086
I20260709 12:22:04.698662 24744 raft_consensus.cc:606] T 0f1b9086a754424297bb628279494e55 P 020e8ee127be4559a08dccacb1d2790b [term 3 LEADER]: Received request to transfer leadership to TS 36d4b1d255db4886a9bb549a0d4920fd
I20260709 12:22:04.701620 24744 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37a3d0199f90466490c70a3f3c466ca4"
dest_uuid: "020e8ee127be4559a08dccacb1d2790b"
mode: GRACEFUL
new_leader_uuid: "08e1711cb2de485092226dd78ebcdb4c"
 from {username='slave'} at 127.0.0.1:53086
I20260709 12:22:04.702214 24744 raft_consensus.cc:606] T 37a3d0199f90466490c70a3f3c466ca4 P 020e8ee127be4559a08dccacb1d2790b [term 2 LEADER]: Received request to transfer leadership to TS 08e1711cb2de485092226dd78ebcdb4c
I20260709 12:22:04.704878 24744 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6345b2fc6a174d8299f0dd3307c8415a"
dest_uuid: "020e8ee127be4559a08dccacb1d2790b"
mode: GRACEFUL
new_leader_uuid: "36d4b1d255db4886a9bb549a0d4920fd"
 from {username='slave'} at 127.0.0.1:53086
I20260709 12:22:04.705420 24744 raft_consensus.cc:606] T 6345b2fc6a174d8299f0dd3307c8415a P 020e8ee127be4559a08dccacb1d2790b [term 3 LEADER]: Received request to transfer leadership to TS 36d4b1d255db4886a9bb549a0d4920fd
I20260709 12:22:04.707989 24744 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86d058965a9647e19043bf3db75c062f"
dest_uuid: "020e8ee127be4559a08dccacb1d2790b"
mode: GRACEFUL
new_leader_uuid: "08e1711cb2de485092226dd78ebcdb4c"
 from {username='slave'} at 127.0.0.1:53086
I20260709 12:22:04.708573 24744 raft_consensus.cc:606] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b [term 3 LEADER]: Received request to transfer leadership to TS 08e1711cb2de485092226dd78ebcdb4c
I20260709 12:22:04.711251 24744 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cdc1bfaa521a420288862680a176a386"
dest_uuid: "020e8ee127be4559a08dccacb1d2790b"
mode: GRACEFUL
new_leader_uuid: "36d4b1d255db4886a9bb549a0d4920fd"
 from {username='slave'} at 127.0.0.1:53086
I20260709 12:22:04.711808 24744 raft_consensus.cc:606] T cdc1bfaa521a420288862680a176a386 P 020e8ee127be4559a08dccacb1d2790b [term 4 LEADER]: Received request to transfer leadership to TS 36d4b1d255db4886a9bb549a0d4920fd
I20260709 12:22:04.713092 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:22:04.713703 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:04.824620 25009 raft_consensus.cc:993] T 6345b2fc6a174d8299f0dd3307c8415a P 020e8ee127be4559a08dccacb1d2790b: : Instructing follower 36d4b1d255db4886a9bb549a0d4920fd to start an election
I20260709 12:22:04.825275 24992 raft_consensus.cc:1081] T 6345b2fc6a174d8299f0dd3307c8415a P 020e8ee127be4559a08dccacb1d2790b [term 3 LEADER]: Signalling peer 36d4b1d255db4886a9bb549a0d4920fd to start an election
I20260709 12:22:04.827126 24669 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6345b2fc6a174d8299f0dd3307c8415a"
dest_uuid: "36d4b1d255db4886a9bb549a0d4920fd"
 from {username='slave'} at 127.0.0.1:57596
I20260709 12:22:04.827613 24669 raft_consensus.cc:493] T 6345b2fc6a174d8299f0dd3307c8415a P 36d4b1d255db4886a9bb549a0d4920fd [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:04.828032 24669 raft_consensus.cc:3060] T 6345b2fc6a174d8299f0dd3307c8415a P 36d4b1d255db4886a9bb549a0d4920fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:04.833052 24669 raft_consensus.cc:515] T 6345b2fc6a174d8299f0dd3307c8415a P 36d4b1d255db4886a9bb549a0d4920fd [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:22:04.835489 24669 leader_election.cc:290] T 6345b2fc6a174d8299f0dd3307c8415a P 36d4b1d255db4886a9bb549a0d4920fd [CANDIDATE]: Term 4 election: Requested vote from peers 020e8ee127be4559a08dccacb1d2790b (127.23.245.130:44139), 08e1711cb2de485092226dd78ebcdb4c (127.23.245.131:32793)
I20260709 12:22:04.836529 24744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6345b2fc6a174d8299f0dd3307c8415a" candidate_uuid: "36d4b1d255db4886a9bb549a0d4920fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "020e8ee127be4559a08dccacb1d2790b"
I20260709 12:22:04.836979 24818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6345b2fc6a174d8299f0dd3307c8415a" candidate_uuid: "36d4b1d255db4886a9bb549a0d4920fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "08e1711cb2de485092226dd78ebcdb4c"
I20260709 12:22:04.837194 24744 raft_consensus.cc:3055] T 6345b2fc6a174d8299f0dd3307c8415a P 020e8ee127be4559a08dccacb1d2790b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:04.837594 24744 raft_consensus.cc:740] T 6345b2fc6a174d8299f0dd3307c8415a P 020e8ee127be4559a08dccacb1d2790b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 020e8ee127be4559a08dccacb1d2790b, State: Running, Role: LEADER
I20260709 12:22:04.837627 24818 raft_consensus.cc:3060] T 6345b2fc6a174d8299f0dd3307c8415a P 08e1711cb2de485092226dd78ebcdb4c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:04.838384 24744 consensus_queue.cc:260] T 6345b2fc6a174d8299f0dd3307c8415a P 020e8ee127be4559a08dccacb1d2790b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:22:04.839411 24744 raft_consensus.cc:3060] T 6345b2fc6a174d8299f0dd3307c8415a P 020e8ee127be4559a08dccacb1d2790b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:04.844040 24744 raft_consensus.cc:2468] T 6345b2fc6a174d8299f0dd3307c8415a P 020e8ee127be4559a08dccacb1d2790b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36d4b1d255db4886a9bb549a0d4920fd in term 4.
I20260709 12:22:04.845189 24818 raft_consensus.cc:2468] T 6345b2fc6a174d8299f0dd3307c8415a P 08e1711cb2de485092226dd78ebcdb4c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36d4b1d255db4886a9bb549a0d4920fd in term 4.
I20260709 12:22:04.845285 24635 leader_election.cc:304] T 6345b2fc6a174d8299f0dd3307c8415a P 36d4b1d255db4886a9bb549a0d4920fd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 020e8ee127be4559a08dccacb1d2790b, 36d4b1d255db4886a9bb549a0d4920fd; no voters: 
I20260709 12:22:04.850622 25011 raft_consensus.cc:2804] T 6345b2fc6a174d8299f0dd3307c8415a P 36d4b1d255db4886a9bb549a0d4920fd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:04.851750 25011 raft_consensus.cc:697] T 6345b2fc6a174d8299f0dd3307c8415a P 36d4b1d255db4886a9bb549a0d4920fd [term 4 LEADER]: Becoming Leader. State: Replica: 36d4b1d255db4886a9bb549a0d4920fd, State: Running, Role: LEADER
I20260709 12:22:04.852875 25011 consensus_queue.cc:237] T 6345b2fc6a174d8299f0dd3307c8415a P 36d4b1d255db4886a9bb549a0d4920fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:22:04.862064 24565 catalog_manager.cc:5697] T 6345b2fc6a174d8299f0dd3307c8415a P 36d4b1d255db4886a9bb549a0d4920fd reported cstate change: term changed from 3 to 4, leader changed from 020e8ee127be4559a08dccacb1d2790b (127.23.245.130) to 36d4b1d255db4886a9bb549a0d4920fd (127.23.245.129). New cstate: current_term: 4 leader_uuid: "36d4b1d255db4886a9bb549a0d4920fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:04.916741 25009 raft_consensus.cc:993] T 37a3d0199f90466490c70a3f3c466ca4 P 020e8ee127be4559a08dccacb1d2790b: : Instructing follower 08e1711cb2de485092226dd78ebcdb4c to start an election
I20260709 12:22:04.917215 24992 raft_consensus.cc:1081] T 37a3d0199f90466490c70a3f3c466ca4 P 020e8ee127be4559a08dccacb1d2790b [term 2 LEADER]: Signalling peer 08e1711cb2de485092226dd78ebcdb4c to start an election
I20260709 12:22:04.918969 24818 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37a3d0199f90466490c70a3f3c466ca4"
dest_uuid: "08e1711cb2de485092226dd78ebcdb4c"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:22:04.919529 24818 raft_consensus.cc:493] T 37a3d0199f90466490c70a3f3c466ca4 P 08e1711cb2de485092226dd78ebcdb4c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:04.919870 24818 raft_consensus.cc:3060] T 37a3d0199f90466490c70a3f3c466ca4 P 08e1711cb2de485092226dd78ebcdb4c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:04.926843 24818 raft_consensus.cc:515] T 37a3d0199f90466490c70a3f3c466ca4 P 08e1711cb2de485092226dd78ebcdb4c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:22:04.929447 24818 leader_election.cc:290] T 37a3d0199f90466490c70a3f3c466ca4 P 08e1711cb2de485092226dd78ebcdb4c [CANDIDATE]: Term 3 election: Requested vote from peers 36d4b1d255db4886a9bb549a0d4920fd (127.23.245.129:33613), 020e8ee127be4559a08dccacb1d2790b (127.23.245.130:44139)
I20260709 12:22:04.930584 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a3d0199f90466490c70a3f3c466ca4" candidate_uuid: "08e1711cb2de485092226dd78ebcdb4c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "36d4b1d255db4886a9bb549a0d4920fd"
I20260709 12:22:04.930925 24744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a3d0199f90466490c70a3f3c466ca4" candidate_uuid: "08e1711cb2de485092226dd78ebcdb4c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "020e8ee127be4559a08dccacb1d2790b"
I20260709 12:22:04.931164 24669 raft_consensus.cc:3060] T 37a3d0199f90466490c70a3f3c466ca4 P 36d4b1d255db4886a9bb549a0d4920fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:04.931495 24744 raft_consensus.cc:3055] T 37a3d0199f90466490c70a3f3c466ca4 P 020e8ee127be4559a08dccacb1d2790b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:04.931814 24744 raft_consensus.cc:740] T 37a3d0199f90466490c70a3f3c466ca4 P 020e8ee127be4559a08dccacb1d2790b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 020e8ee127be4559a08dccacb1d2790b, State: Running, Role: LEADER
I20260709 12:22:04.932585 24744 consensus_queue.cc:260] T 37a3d0199f90466490c70a3f3c466ca4 P 020e8ee127be4559a08dccacb1d2790b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:22:04.933825 24744 raft_consensus.cc:3060] T 37a3d0199f90466490c70a3f3c466ca4 P 020e8ee127be4559a08dccacb1d2790b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:04.935480 24669 raft_consensus.cc:2468] T 37a3d0199f90466490c70a3f3c466ca4 P 36d4b1d255db4886a9bb549a0d4920fd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08e1711cb2de485092226dd78ebcdb4c in term 3.
I20260709 12:22:04.936753 24785 leader_election.cc:304] T 37a3d0199f90466490c70a3f3c466ca4 P 08e1711cb2de485092226dd78ebcdb4c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08e1711cb2de485092226dd78ebcdb4c, 36d4b1d255db4886a9bb549a0d4920fd; no voters: 
I20260709 12:22:04.937517 24955 raft_consensus.cc:2804] T 37a3d0199f90466490c70a3f3c466ca4 P 08e1711cb2de485092226dd78ebcdb4c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:04.938699 24955 raft_consensus.cc:697] T 37a3d0199f90466490c70a3f3c466ca4 P 08e1711cb2de485092226dd78ebcdb4c [term 3 LEADER]: Becoming Leader. State: Replica: 08e1711cb2de485092226dd78ebcdb4c, State: Running, Role: LEADER
I20260709 12:22:04.939500 24955 consensus_queue.cc:237] T 37a3d0199f90466490c70a3f3c466ca4 P 08e1711cb2de485092226dd78ebcdb4c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:22:04.940641 24744 raft_consensus.cc:2468] T 37a3d0199f90466490c70a3f3c466ca4 P 020e8ee127be4559a08dccacb1d2790b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08e1711cb2de485092226dd78ebcdb4c in term 3.
I20260709 12:22:04.948264 24565 catalog_manager.cc:5697] T 37a3d0199f90466490c70a3f3c466ca4 P 08e1711cb2de485092226dd78ebcdb4c reported cstate change: term changed from 2 to 3, leader changed from 020e8ee127be4559a08dccacb1d2790b (127.23.245.130) to 08e1711cb2de485092226dd78ebcdb4c (127.23.245.131). New cstate: current_term: 3 leader_uuid: "08e1711cb2de485092226dd78ebcdb4c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:04.958642 25009 raft_consensus.cc:993] T cdc1bfaa521a420288862680a176a386 P 020e8ee127be4559a08dccacb1d2790b: : Instructing follower 36d4b1d255db4886a9bb549a0d4920fd to start an election
I20260709 12:22:04.959168 24992 raft_consensus.cc:1081] T cdc1bfaa521a420288862680a176a386 P 020e8ee127be4559a08dccacb1d2790b [term 4 LEADER]: Signalling peer 36d4b1d255db4886a9bb549a0d4920fd to start an election
I20260709 12:22:04.960613 24669 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cdc1bfaa521a420288862680a176a386"
dest_uuid: "36d4b1d255db4886a9bb549a0d4920fd"
 from {username='slave'} at 127.0.0.1:57596
I20260709 12:22:04.961123 24669 raft_consensus.cc:493] T cdc1bfaa521a420288862680a176a386 P 36d4b1d255db4886a9bb549a0d4920fd [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:04.961503 24669 raft_consensus.cc:3060] T cdc1bfaa521a420288862680a176a386 P 36d4b1d255db4886a9bb549a0d4920fd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:04.968515 24669 raft_consensus.cc:515] T cdc1bfaa521a420288862680a176a386 P 36d4b1d255db4886a9bb549a0d4920fd [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:22:04.970541 24669 leader_election.cc:290] T cdc1bfaa521a420288862680a176a386 P 36d4b1d255db4886a9bb549a0d4920fd [CANDIDATE]: Term 5 election: Requested vote from peers 020e8ee127be4559a08dccacb1d2790b (127.23.245.130:44139), 08e1711cb2de485092226dd78ebcdb4c (127.23.245.131:32793)
I20260709 12:22:04.971392 24744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdc1bfaa521a420288862680a176a386" candidate_uuid: "36d4b1d255db4886a9bb549a0d4920fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "020e8ee127be4559a08dccacb1d2790b"
I20260709 12:22:04.971484 24818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cdc1bfaa521a420288862680a176a386" candidate_uuid: "36d4b1d255db4886a9bb549a0d4920fd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "08e1711cb2de485092226dd78ebcdb4c"
I20260709 12:22:04.972081 24744 raft_consensus.cc:3055] T cdc1bfaa521a420288862680a176a386 P 020e8ee127be4559a08dccacb1d2790b [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:04.972374 24744 raft_consensus.cc:740] T cdc1bfaa521a420288862680a176a386 P 020e8ee127be4559a08dccacb1d2790b [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 020e8ee127be4559a08dccacb1d2790b, State: Running, Role: LEADER
I20260709 12:22:04.972424 24818 raft_consensus.cc:3060] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:04.973232 24744 consensus_queue.cc:260] T cdc1bfaa521a420288862680a176a386 P 020e8ee127be4559a08dccacb1d2790b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:22:04.974362 24744 raft_consensus.cc:3060] T cdc1bfaa521a420288862680a176a386 P 020e8ee127be4559a08dccacb1d2790b [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:04.978720 24818 raft_consensus.cc:2468] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36d4b1d255db4886a9bb549a0d4920fd in term 5.
I20260709 12:22:04.980003 24633 leader_election.cc:304] T cdc1bfaa521a420288862680a176a386 P 36d4b1d255db4886a9bb549a0d4920fd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08e1711cb2de485092226dd78ebcdb4c, 36d4b1d255db4886a9bb549a0d4920fd; no voters: 
I20260709 12:22:04.980537 24744 raft_consensus.cc:2468] T cdc1bfaa521a420288862680a176a386 P 020e8ee127be4559a08dccacb1d2790b [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36d4b1d255db4886a9bb549a0d4920fd in term 5.
I20260709 12:22:04.980846 25011 raft_consensus.cc:2804] T cdc1bfaa521a420288862680a176a386 P 36d4b1d255db4886a9bb549a0d4920fd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:04.981364 25011 raft_consensus.cc:697] T cdc1bfaa521a420288862680a176a386 P 36d4b1d255db4886a9bb549a0d4920fd [term 5 LEADER]: Becoming Leader. State: Replica: 36d4b1d255db4886a9bb549a0d4920fd, State: Running, Role: LEADER
I20260709 12:22:04.982344 25011 consensus_queue.cc:237] T cdc1bfaa521a420288862680a176a386 P 36d4b1d255db4886a9bb549a0d4920fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:22:04.990236 24565 catalog_manager.cc:5697] T cdc1bfaa521a420288862680a176a386 P 36d4b1d255db4886a9bb549a0d4920fd reported cstate change: term changed from 4 to 5, leader changed from 020e8ee127be4559a08dccacb1d2790b (127.23.245.130) to 36d4b1d255db4886a9bb549a0d4920fd (127.23.245.129). New cstate: current_term: 5 leader_uuid: "36d4b1d255db4886a9bb549a0d4920fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:05.036974 25009 raft_consensus.cc:993] T 0f1b9086a754424297bb628279494e55 P 020e8ee127be4559a08dccacb1d2790b: : Instructing follower 36d4b1d255db4886a9bb549a0d4920fd to start an election
I20260709 12:22:05.037500 24992 raft_consensus.cc:1081] T 0f1b9086a754424297bb628279494e55 P 020e8ee127be4559a08dccacb1d2790b [term 3 LEADER]: Signalling peer 36d4b1d255db4886a9bb549a0d4920fd to start an election
I20260709 12:22:05.038945 24669 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f1b9086a754424297bb628279494e55"
dest_uuid: "36d4b1d255db4886a9bb549a0d4920fd"
 from {username='slave'} at 127.0.0.1:57596
I20260709 12:22:05.039472 24669 raft_consensus.cc:493] T 0f1b9086a754424297bb628279494e55 P 36d4b1d255db4886a9bb549a0d4920fd [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:05.039815 24669 raft_consensus.cc:3060] T 0f1b9086a754424297bb628279494e55 P 36d4b1d255db4886a9bb549a0d4920fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:05.046698 24669 raft_consensus.cc:515] T 0f1b9086a754424297bb628279494e55 P 36d4b1d255db4886a9bb549a0d4920fd [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } }
I20260709 12:22:05.048074 25009 raft_consensus.cc:993] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b: : Instructing follower 08e1711cb2de485092226dd78ebcdb4c to start an election
I20260709 12:22:05.048558 25009 raft_consensus.cc:1081] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b [term 3 LEADER]: Signalling peer 08e1711cb2de485092226dd78ebcdb4c to start an election
I20260709 12:22:05.048835 24669 leader_election.cc:290] T 0f1b9086a754424297bb628279494e55 P 36d4b1d255db4886a9bb549a0d4920fd [CANDIDATE]: Term 4 election: Requested vote from peers 08e1711cb2de485092226dd78ebcdb4c (127.23.245.131:32793), 020e8ee127be4559a08dccacb1d2790b (127.23.245.130:44139)
I20260709 12:22:05.050359 24817 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "86d058965a9647e19043bf3db75c062f"
dest_uuid: "08e1711cb2de485092226dd78ebcdb4c"
 from {username='slave'} at 127.0.0.1:50120
I20260709 12:22:05.050360 24818 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1b9086a754424297bb628279494e55" candidate_uuid: "36d4b1d255db4886a9bb549a0d4920fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "08e1711cb2de485092226dd78ebcdb4c"
I20260709 12:22:05.050668 24744 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f1b9086a754424297bb628279494e55" candidate_uuid: "36d4b1d255db4886a9bb549a0d4920fd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "020e8ee127be4559a08dccacb1d2790b"
I20260709 12:22:05.051056 24817 raft_consensus.cc:493] T 86d058965a9647e19043bf3db75c062f P 08e1711cb2de485092226dd78ebcdb4c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:05.051092 24818 raft_consensus.cc:3060] T 0f1b9086a754424297bb628279494e55 P 08e1711cb2de485092226dd78ebcdb4c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:05.051144 24744 raft_consensus.cc:3055] T 0f1b9086a754424297bb628279494e55 P 020e8ee127be4559a08dccacb1d2790b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:05.051553 24817 raft_consensus.cc:3060] T 86d058965a9647e19043bf3db75c062f P 08e1711cb2de485092226dd78ebcdb4c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:05.051707 24744 raft_consensus.cc:740] T 0f1b9086a754424297bb628279494e55 P 020e8ee127be4559a08dccacb1d2790b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 020e8ee127be4559a08dccacb1d2790b, State: Running, Role: LEADER
I20260709 12:22:05.053038 24744 consensus_queue.cc:260] T 0f1b9086a754424297bb628279494e55 P 020e8ee127be4559a08dccacb1d2790b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } }
I20260709 12:22:05.054148 24744 raft_consensus.cc:3060] T 0f1b9086a754424297bb628279494e55 P 020e8ee127be4559a08dccacb1d2790b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:05.058158 24818 raft_consensus.cc:2468] T 0f1b9086a754424297bb628279494e55 P 08e1711cb2de485092226dd78ebcdb4c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36d4b1d255db4886a9bb549a0d4920fd in term 4.
I20260709 12:22:05.059799 24633 leader_election.cc:304] T 0f1b9086a754424297bb628279494e55 P 36d4b1d255db4886a9bb549a0d4920fd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08e1711cb2de485092226dd78ebcdb4c, 36d4b1d255db4886a9bb549a0d4920fd; no voters: 
I20260709 12:22:05.060690 25011 raft_consensus.cc:2804] T 0f1b9086a754424297bb628279494e55 P 36d4b1d255db4886a9bb549a0d4920fd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:05.061162 25011 raft_consensus.cc:697] T 0f1b9086a754424297bb628279494e55 P 36d4b1d255db4886a9bb549a0d4920fd [term 4 LEADER]: Becoming Leader. State: Replica: 36d4b1d255db4886a9bb549a0d4920fd, State: Running, Role: LEADER
I20260709 12:22:05.062036 25011 consensus_queue.cc:237] T 0f1b9086a754424297bb628279494e55 P 36d4b1d255db4886a9bb549a0d4920fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } }
I20260709 12:22:05.063292 24817 raft_consensus.cc:515] T 86d058965a9647e19043bf3db75c062f P 08e1711cb2de485092226dd78ebcdb4c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:22:05.066027 24669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d058965a9647e19043bf3db75c062f" candidate_uuid: "08e1711cb2de485092226dd78ebcdb4c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "36d4b1d255db4886a9bb549a0d4920fd"
I20260709 12:22:05.066663 24669 raft_consensus.cc:3060] T 86d058965a9647e19043bf3db75c062f P 36d4b1d255db4886a9bb549a0d4920fd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:05.066838 24741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d058965a9647e19043bf3db75c062f" candidate_uuid: "08e1711cb2de485092226dd78ebcdb4c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "020e8ee127be4559a08dccacb1d2790b"
I20260709 12:22:05.067502 24741 raft_consensus.cc:3055] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:05.067793 24741 raft_consensus.cc:740] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 020e8ee127be4559a08dccacb1d2790b, State: Running, Role: LEADER
I20260709 12:22:05.068485 24741 consensus_queue.cc:260] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:22:05.069449 24741 raft_consensus.cc:3060] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:05.070940 24744 raft_consensus.cc:2468] T 0f1b9086a754424297bb628279494e55 P 020e8ee127be4559a08dccacb1d2790b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 36d4b1d255db4886a9bb549a0d4920fd in term 4.
I20260709 12:22:05.073930 24669 raft_consensus.cc:2468] T 86d058965a9647e19043bf3db75c062f P 36d4b1d255db4886a9bb549a0d4920fd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08e1711cb2de485092226dd78ebcdb4c in term 4.
I20260709 12:22:05.075703 24785 leader_election.cc:304] T 86d058965a9647e19043bf3db75c062f P 08e1711cb2de485092226dd78ebcdb4c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08e1711cb2de485092226dd78ebcdb4c, 36d4b1d255db4886a9bb549a0d4920fd; no voters: 
I20260709 12:22:05.076524 24955 raft_consensus.cc:2804] T 86d058965a9647e19043bf3db75c062f P 08e1711cb2de485092226dd78ebcdb4c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:05.076977 24955 raft_consensus.cc:697] T 86d058965a9647e19043bf3db75c062f P 08e1711cb2de485092226dd78ebcdb4c [term 4 LEADER]: Becoming Leader. State: Replica: 08e1711cb2de485092226dd78ebcdb4c, State: Running, Role: LEADER
I20260709 12:22:05.078223 24741 raft_consensus.cc:2468] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08e1711cb2de485092226dd78ebcdb4c in term 4.
I20260709 12:22:05.078029 24955 consensus_queue.cc:237] T 86d058965a9647e19043bf3db75c062f P 08e1711cb2de485092226dd78ebcdb4c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } }
I20260709 12:22:05.078933 24817 leader_election.cc:290] T 86d058965a9647e19043bf3db75c062f P 08e1711cb2de485092226dd78ebcdb4c [CANDIDATE]: Term 4 election: Requested vote from peers 36d4b1d255db4886a9bb549a0d4920fd (127.23.245.129:33613), 020e8ee127be4559a08dccacb1d2790b (127.23.245.130:44139)
I20260709 12:22:05.083786 24565 catalog_manager.cc:5697] T 0f1b9086a754424297bb628279494e55 P 36d4b1d255db4886a9bb549a0d4920fd reported cstate change: term changed from 3 to 4, leader changed from 020e8ee127be4559a08dccacb1d2790b (127.23.245.130) to 36d4b1d255db4886a9bb549a0d4920fd (127.23.245.129). New cstate: current_term: 4 leader_uuid: "36d4b1d255db4886a9bb549a0d4920fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:05.094151 24566 catalog_manager.cc:5697] T 86d058965a9647e19043bf3db75c062f P 08e1711cb2de485092226dd78ebcdb4c reported cstate change: term changed from 3 to 4, leader changed from 020e8ee127be4559a08dccacb1d2790b (127.23.245.130) to 08e1711cb2de485092226dd78ebcdb4c (127.23.245.131). New cstate: current_term: 4 leader_uuid: "08e1711cb2de485092226dd78ebcdb4c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:05.348644 24741 raft_consensus.cc:1275] T 37a3d0199f90466490c70a3f3c466ca4 P 020e8ee127be4559a08dccacb1d2790b [term 3 FOLLOWER]: Refusing update from remote peer 08e1711cb2de485092226dd78ebcdb4c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:05.350044 24955 consensus_queue.cc:1048] T 37a3d0199f90466490c70a3f3c466ca4 P 08e1711cb2de485092226dd78ebcdb4c [LEADER]: Connected to new peer: Peer: permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:05.363799 24744 raft_consensus.cc:1275] T 6345b2fc6a174d8299f0dd3307c8415a P 020e8ee127be4559a08dccacb1d2790b [term 4 FOLLOWER]: Refusing update from remote peer 36d4b1d255db4886a9bb549a0d4920fd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:05.365855 25011 consensus_queue.cc:1048] T 6345b2fc6a174d8299f0dd3307c8415a P 36d4b1d255db4886a9bb549a0d4920fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:05.379856 24669 raft_consensus.cc:1275] T 37a3d0199f90466490c70a3f3c466ca4 P 36d4b1d255db4886a9bb549a0d4920fd [term 3 FOLLOWER]: Refusing update from remote peer 08e1711cb2de485092226dd78ebcdb4c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:05.384153 25018 consensus_queue.cc:1048] T 37a3d0199f90466490c70a3f3c466ca4 P 08e1711cb2de485092226dd78ebcdb4c [LEADER]: Connected to new peer: Peer: permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:05.392298 24817 raft_consensus.cc:1275] T 6345b2fc6a174d8299f0dd3307c8415a P 08e1711cb2de485092226dd78ebcdb4c [term 4 FOLLOWER]: Refusing update from remote peer 36d4b1d255db4886a9bb549a0d4920fd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:05.394259 25011 consensus_queue.cc:1048] T 6345b2fc6a174d8299f0dd3307c8415a P 36d4b1d255db4886a9bb549a0d4920fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:05.517431 24817 raft_consensus.cc:1275] T 0f1b9086a754424297bb628279494e55 P 08e1711cb2de485092226dd78ebcdb4c [term 4 FOLLOWER]: Refusing update from remote peer 36d4b1d255db4886a9bb549a0d4920fd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:05.519166 25029 consensus_queue.cc:1048] T 0f1b9086a754424297bb628279494e55 P 36d4b1d255db4886a9bb549a0d4920fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:05.530596 24744 raft_consensus.cc:1275] T 0f1b9086a754424297bb628279494e55 P 020e8ee127be4559a08dccacb1d2790b [term 4 FOLLOWER]: Refusing update from remote peer 36d4b1d255db4886a9bb549a0d4920fd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:05.532117 25011 consensus_queue.cc:1048] T 0f1b9086a754424297bb628279494e55 P 36d4b1d255db4886a9bb549a0d4920fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:05.559665 24744 raft_consensus.cc:1275] T cdc1bfaa521a420288862680a176a386 P 020e8ee127be4559a08dccacb1d2790b [term 5 FOLLOWER]: Refusing update from remote peer 36d4b1d255db4886a9bb549a0d4920fd: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:22:05.561483 25011 consensus_queue.cc:1048] T cdc1bfaa521a420288862680a176a386 P 36d4b1d255db4886a9bb549a0d4920fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:05.572201 24817 raft_consensus.cc:1275] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c [term 5 FOLLOWER]: Refusing update from remote peer 36d4b1d255db4886a9bb549a0d4920fd: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:22:05.573494 25011 consensus_queue.cc:1048] T cdc1bfaa521a420288862680a176a386 P 36d4b1d255db4886a9bb549a0d4920fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "08e1711cb2de485092226dd78ebcdb4c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 32793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:05.645587 24741 raft_consensus.cc:1275] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b [term 4 FOLLOWER]: Refusing update from remote peer 08e1711cb2de485092226dd78ebcdb4c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:05.647145 25018 consensus_queue.cc:1048] T 86d058965a9647e19043bf3db75c062f P 08e1711cb2de485092226dd78ebcdb4c [LEADER]: Connected to new peer: Peer: permanent_uuid: "020e8ee127be4559a08dccacb1d2790b" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:05.656539 24669 raft_consensus.cc:1275] T 86d058965a9647e19043bf3db75c062f P 36d4b1d255db4886a9bb549a0d4920fd [term 4 FOLLOWER]: Refusing update from remote peer 08e1711cb2de485092226dd78ebcdb4c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:05.657945 25018 consensus_queue.cc:1048] T 86d058965a9647e19043bf3db75c062f P 08e1711cb2de485092226dd78ebcdb4c [LEADER]: Connected to new peer: Peer: permanent_uuid: "36d4b1d255db4886a9bb549a0d4920fd" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 33613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:05.715231 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:05.724238 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:05.724872 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:06.726166 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:06.730922 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:06.731251 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:07.732250 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:07.738268 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:07.738704 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:08.739758 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:08.744704 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:08.745149 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:09.746426 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:09.751493 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:09.751987 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:10.753168 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:10.758216 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:10.758652 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:11.759783 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:11.766641 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:11.767127 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:12.768213 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:12.773213 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:12.773684 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:13.774816 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:13.780470 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:13.780943 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:14.814692 24534 auto_leader_rebalancer-test.cc:340] The leader distribution is 
I20260709 12:22:14.815433 24534 tablet_server.cc:179] TabletServer@127.23.245.129:0 shutting down...
W20260709 12:22:14.843979 24710 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:22:14.848227 24710 consensus_peers.cc:597] T 03bcafc1c9cc41c2b06d28c03004235e P 020e8ee127be4559a08dccacb1d2790b -> Peer 36d4b1d255db4886a9bb549a0d4920fd (127.23.245.129:33613): Couldn't send request to peer 36d4b1d255db4886a9bb549a0d4920fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:14.848724 24534 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:14.849572 24534 tablet_replica.cc:333] T d31655c39a4d409694a59895fb21c98f P 36d4b1d255db4886a9bb549a0d4920fd: stopping tablet replica
I20260709 12:22:14.850764 24534 raft_consensus.cc:2243] T d31655c39a4d409694a59895fb21c98f P 36d4b1d255db4886a9bb549a0d4920fd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:14.851841 24534 raft_consensus.cc:2272] T d31655c39a4d409694a59895fb21c98f P 36d4b1d255db4886a9bb549a0d4920fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:14.854739 24534 tablet_replica.cc:333] T aa0b964a979d4687ba4fcf406e1b04a8 P 36d4b1d255db4886a9bb549a0d4920fd: stopping tablet replica
I20260709 12:22:14.855312 24534 raft_consensus.cc:2243] T aa0b964a979d4687ba4fcf406e1b04a8 P 36d4b1d255db4886a9bb549a0d4920fd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:14.855866 24534 raft_consensus.cc:2272] T aa0b964a979d4687ba4fcf406e1b04a8 P 36d4b1d255db4886a9bb549a0d4920fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:14.857720 24534 tablet_replica.cc:333] T 03bcafc1c9cc41c2b06d28c03004235e P 36d4b1d255db4886a9bb549a0d4920fd: stopping tablet replica
I20260709 12:22:14.858242 24534 raft_consensus.cc:2243] T 03bcafc1c9cc41c2b06d28c03004235e P 36d4b1d255db4886a9bb549a0d4920fd [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:14.858733 24534 raft_consensus.cc:2272] T 03bcafc1c9cc41c2b06d28c03004235e P 36d4b1d255db4886a9bb549a0d4920fd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:14.860423 24534 tablet_replica.cc:333] T 65345be99efc4ea7bf98c50f9f2678b8 P 36d4b1d255db4886a9bb549a0d4920fd: stopping tablet replica
I20260709 12:22:14.860922 24534 raft_consensus.cc:2243] T 65345be99efc4ea7bf98c50f9f2678b8 P 36d4b1d255db4886a9bb549a0d4920fd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:14.861382 24534 raft_consensus.cc:2272] T 65345be99efc4ea7bf98c50f9f2678b8 P 36d4b1d255db4886a9bb549a0d4920fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:14.863072 24534 tablet_replica.cc:333] T 86d058965a9647e19043bf3db75c062f P 36d4b1d255db4886a9bb549a0d4920fd: stopping tablet replica
I20260709 12:22:14.863559 24534 raft_consensus.cc:2243] T 86d058965a9647e19043bf3db75c062f P 36d4b1d255db4886a9bb549a0d4920fd [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:14.864055 24534 raft_consensus.cc:2272] T 86d058965a9647e19043bf3db75c062f P 36d4b1d255db4886a9bb549a0d4920fd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:14.865694 24534 tablet_replica.cc:333] T 6345b2fc6a174d8299f0dd3307c8415a P 36d4b1d255db4886a9bb549a0d4920fd: stopping tablet replica
I20260709 12:22:14.866189 24534 raft_consensus.cc:2243] T 6345b2fc6a174d8299f0dd3307c8415a P 36d4b1d255db4886a9bb549a0d4920fd [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:22:14.867174 24534 raft_consensus.cc:2272] T 6345b2fc6a174d8299f0dd3307c8415a P 36d4b1d255db4886a9bb549a0d4920fd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:14.868976 24534 tablet_replica.cc:333] T 0f1b9086a754424297bb628279494e55 P 36d4b1d255db4886a9bb549a0d4920fd: stopping tablet replica
I20260709 12:22:14.869453 24534 raft_consensus.cc:2243] T 0f1b9086a754424297bb628279494e55 P 36d4b1d255db4886a9bb549a0d4920fd [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:22:14.870368 24534 raft_consensus.cc:2272] T 0f1b9086a754424297bb628279494e55 P 36d4b1d255db4886a9bb549a0d4920fd [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:14.872094 24534 tablet_replica.cc:333] T 37a3d0199f90466490c70a3f3c466ca4 P 36d4b1d255db4886a9bb549a0d4920fd: stopping tablet replica
I20260709 12:22:14.872553 24534 raft_consensus.cc:2243] T 37a3d0199f90466490c70a3f3c466ca4 P 36d4b1d255db4886a9bb549a0d4920fd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:14.872982 24534 raft_consensus.cc:2272] T 37a3d0199f90466490c70a3f3c466ca4 P 36d4b1d255db4886a9bb549a0d4920fd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:14.874536 24534 tablet_replica.cc:333] T cdc1bfaa521a420288862680a176a386 P 36d4b1d255db4886a9bb549a0d4920fd: stopping tablet replica
I20260709 12:22:14.874964 24534 raft_consensus.cc:2243] T cdc1bfaa521a420288862680a176a386 P 36d4b1d255db4886a9bb549a0d4920fd [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:22:14.875725 24534 raft_consensus.cc:2272] T cdc1bfaa521a420288862680a176a386 P 36d4b1d255db4886a9bb549a0d4920fd [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:14.885794 24710 consensus_peers.cc:597] T 65345be99efc4ea7bf98c50f9f2678b8 P 020e8ee127be4559a08dccacb1d2790b -> Peer 36d4b1d255db4886a9bb549a0d4920fd (127.23.245.129:33613): Couldn't send request to peer 36d4b1d255db4886a9bb549a0d4920fd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:14.965268 24710 consensus_peers.cc:597] T aa0b964a979d4687ba4fcf406e1b04a8 P 020e8ee127be4559a08dccacb1d2790b -> Peer 36d4b1d255db4886a9bb549a0d4920fd (127.23.245.129:33613): Couldn't send request to peer 36d4b1d255db4886a9bb549a0d4920fd. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:33613: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:14.978281 24534 tablet_server.cc:196] TabletServer@127.23.245.129:0 shutdown complete.
W20260709 12:22:14.983796 24785 consensus_peers.cc:597] T d31655c39a4d409694a59895fb21c98f P 08e1711cb2de485092226dd78ebcdb4c -> Peer 36d4b1d255db4886a9bb549a0d4920fd (127.23.245.129:33613): Couldn't send request to peer 36d4b1d255db4886a9bb549a0d4920fd. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:33613: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:14.999120 24534 tablet_server.cc:179] TabletServer@127.23.245.130:0 shutting down...
I20260709 12:22:15.029979 24534 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:15.030859 24534 tablet_replica.cc:333] T aa0b964a979d4687ba4fcf406e1b04a8 P 020e8ee127be4559a08dccacb1d2790b: stopping tablet replica
I20260709 12:22:15.031733 24534 raft_consensus.cc:2243] T aa0b964a979d4687ba4fcf406e1b04a8 P 020e8ee127be4559a08dccacb1d2790b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:15.032653 24534 raft_consensus.cc:2272] T aa0b964a979d4687ba4fcf406e1b04a8 P 020e8ee127be4559a08dccacb1d2790b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:15.034377 24534 tablet_replica.cc:333] T cdc1bfaa521a420288862680a176a386 P 020e8ee127be4559a08dccacb1d2790b: stopping tablet replica
I20260709 12:22:15.034824 24534 raft_consensus.cc:2243] T cdc1bfaa521a420288862680a176a386 P 020e8ee127be4559a08dccacb1d2790b [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:15.035209 24534 raft_consensus.cc:2272] T cdc1bfaa521a420288862680a176a386 P 020e8ee127be4559a08dccacb1d2790b [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:15.036887 24534 tablet_replica.cc:333] T d31655c39a4d409694a59895fb21c98f P 020e8ee127be4559a08dccacb1d2790b: stopping tablet replica
I20260709 12:22:15.037322 24534 raft_consensus.cc:2243] T d31655c39a4d409694a59895fb21c98f P 020e8ee127be4559a08dccacb1d2790b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:15.037724 24534 raft_consensus.cc:2272] T d31655c39a4d409694a59895fb21c98f P 020e8ee127be4559a08dccacb1d2790b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:15.039376 24534 tablet_replica.cc:333] T 0f1b9086a754424297bb628279494e55 P 020e8ee127be4559a08dccacb1d2790b: stopping tablet replica
I20260709 12:22:15.039841 24534 raft_consensus.cc:2243] T 0f1b9086a754424297bb628279494e55 P 020e8ee127be4559a08dccacb1d2790b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:15.040364 24534 raft_consensus.cc:2272] T 0f1b9086a754424297bb628279494e55 P 020e8ee127be4559a08dccacb1d2790b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:15.042070 24534 tablet_replica.cc:333] T 6345b2fc6a174d8299f0dd3307c8415a P 020e8ee127be4559a08dccacb1d2790b: stopping tablet replica
I20260709 12:22:15.042553 24534 raft_consensus.cc:2243] T 6345b2fc6a174d8299f0dd3307c8415a P 020e8ee127be4559a08dccacb1d2790b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:15.043038 24534 raft_consensus.cc:2272] T 6345b2fc6a174d8299f0dd3307c8415a P 020e8ee127be4559a08dccacb1d2790b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:15.044761 24534 tablet_replica.cc:333] T 37a3d0199f90466490c70a3f3c466ca4 P 020e8ee127be4559a08dccacb1d2790b: stopping tablet replica
I20260709 12:22:15.045245 24534 raft_consensus.cc:2243] T 37a3d0199f90466490c70a3f3c466ca4 P 020e8ee127be4559a08dccacb1d2790b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:15.045662 24534 raft_consensus.cc:2272] T 37a3d0199f90466490c70a3f3c466ca4 P 020e8ee127be4559a08dccacb1d2790b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:15.047278 24534 tablet_replica.cc:333] T 65345be99efc4ea7bf98c50f9f2678b8 P 020e8ee127be4559a08dccacb1d2790b: stopping tablet replica
I20260709 12:22:15.047787 24534 raft_consensus.cc:2243] T 65345be99efc4ea7bf98c50f9f2678b8 P 020e8ee127be4559a08dccacb1d2790b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:15.048616 24534 raft_consensus.cc:2272] T 65345be99efc4ea7bf98c50f9f2678b8 P 020e8ee127be4559a08dccacb1d2790b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:15.050287 24534 tablet_replica.cc:333] T 03bcafc1c9cc41c2b06d28c03004235e P 020e8ee127be4559a08dccacb1d2790b: stopping tablet replica
I20260709 12:22:15.050755 24534 raft_consensus.cc:2243] T 03bcafc1c9cc41c2b06d28c03004235e P 020e8ee127be4559a08dccacb1d2790b [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:22:15.051539 24534 raft_consensus.cc:2272] T 03bcafc1c9cc41c2b06d28c03004235e P 020e8ee127be4559a08dccacb1d2790b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:15.053220 24534 tablet_replica.cc:333] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b: stopping tablet replica
I20260709 12:22:15.053664 24534 raft_consensus.cc:2243] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:15.054087 24534 raft_consensus.cc:2272] T 86d058965a9647e19043bf3db75c062f P 020e8ee127be4559a08dccacb1d2790b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:15.102487 24534 tablet_server.cc:196] TabletServer@127.23.245.130:0 shutdown complete.
W20260709 12:22:15.107355 24785 consensus_peers.cc:597] T 37a3d0199f90466490c70a3f3c466ca4 P 08e1711cb2de485092226dd78ebcdb4c -> Peer 36d4b1d255db4886a9bb549a0d4920fd (127.23.245.129:33613): Couldn't send request to peer 36d4b1d255db4886a9bb549a0d4920fd. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:33613: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:15.123210 24534 tablet_server.cc:179] TabletServer@127.23.245.131:0 shutting down...
I20260709 12:22:15.150658 24534 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:15.151371 24534 tablet_replica.cc:333] T d31655c39a4d409694a59895fb21c98f P 08e1711cb2de485092226dd78ebcdb4c: stopping tablet replica
I20260709 12:22:15.152182 24534 raft_consensus.cc:2243] T d31655c39a4d409694a59895fb21c98f P 08e1711cb2de485092226dd78ebcdb4c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:15.153048 24534 raft_consensus.cc:2272] T d31655c39a4d409694a59895fb21c98f P 08e1711cb2de485092226dd78ebcdb4c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:15.154815 24534 tablet_replica.cc:333] T 65345be99efc4ea7bf98c50f9f2678b8 P 08e1711cb2de485092226dd78ebcdb4c: stopping tablet replica
I20260709 12:22:15.155323 24534 raft_consensus.cc:2243] T 65345be99efc4ea7bf98c50f9f2678b8 P 08e1711cb2de485092226dd78ebcdb4c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:15.155761 24534 raft_consensus.cc:2272] T 65345be99efc4ea7bf98c50f9f2678b8 P 08e1711cb2de485092226dd78ebcdb4c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:15.157388 24534 tablet_replica.cc:333] T 86d058965a9647e19043bf3db75c062f P 08e1711cb2de485092226dd78ebcdb4c: stopping tablet replica
I20260709 12:22:15.157878 24534 raft_consensus.cc:2243] T 86d058965a9647e19043bf3db75c062f P 08e1711cb2de485092226dd78ebcdb4c [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:22:15.158630 24534 raft_consensus.cc:2272] T 86d058965a9647e19043bf3db75c062f P 08e1711cb2de485092226dd78ebcdb4c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:15.160239 24534 tablet_replica.cc:333] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c: stopping tablet replica
I20260709 12:22:15.160746 24534 raft_consensus.cc:2243] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:15.161259 24534 raft_consensus.cc:2272] T 03bcafc1c9cc41c2b06d28c03004235e P 08e1711cb2de485092226dd78ebcdb4c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:15.162979 24534 tablet_replica.cc:333] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c: stopping tablet replica
I20260709 12:22:15.163445 24534 raft_consensus.cc:2243] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:15.163863 24534 raft_consensus.cc:2272] T cdc1bfaa521a420288862680a176a386 P 08e1711cb2de485092226dd78ebcdb4c [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:15.165438 24534 tablet_replica.cc:333] T 37a3d0199f90466490c70a3f3c466ca4 P 08e1711cb2de485092226dd78ebcdb4c: stopping tablet replica
I20260709 12:22:15.165879 24534 raft_consensus.cc:2243] T 37a3d0199f90466490c70a3f3c466ca4 P 08e1711cb2de485092226dd78ebcdb4c [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:15.166671 24534 raft_consensus.cc:2272] T 37a3d0199f90466490c70a3f3c466ca4 P 08e1711cb2de485092226dd78ebcdb4c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:15.168359 24534 tablet_replica.cc:333] T 0f1b9086a754424297bb628279494e55 P 08e1711cb2de485092226dd78ebcdb4c: stopping tablet replica
I20260709 12:22:15.168840 24534 raft_consensus.cc:2243] T 0f1b9086a754424297bb628279494e55 P 08e1711cb2de485092226dd78ebcdb4c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:15.169312 24534 raft_consensus.cc:2272] T 0f1b9086a754424297bb628279494e55 P 08e1711cb2de485092226dd78ebcdb4c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:15.170739 24534 tablet_replica.cc:333] T 6345b2fc6a174d8299f0dd3307c8415a P 08e1711cb2de485092226dd78ebcdb4c: stopping tablet replica
I20260709 12:22:15.171169 24534 raft_consensus.cc:2243] T 6345b2fc6a174d8299f0dd3307c8415a P 08e1711cb2de485092226dd78ebcdb4c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:15.171629 24534 raft_consensus.cc:2272] T 6345b2fc6a174d8299f0dd3307c8415a P 08e1711cb2de485092226dd78ebcdb4c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:15.173203 24534 tablet_replica.cc:333] T aa0b964a979d4687ba4fcf406e1b04a8 P 08e1711cb2de485092226dd78ebcdb4c: stopping tablet replica
I20260709 12:22:15.173647 24534 raft_consensus.cc:2243] T aa0b964a979d4687ba4fcf406e1b04a8 P 08e1711cb2de485092226dd78ebcdb4c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:15.174036 24534 raft_consensus.cc:2272] T aa0b964a979d4687ba4fcf406e1b04a8 P 08e1711cb2de485092226dd78ebcdb4c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:15.201438 24534 tablet_server.cc:196] TabletServer@127.23.245.131:0 shutdown complete.
I20260709 12:22:15.219216 24534 master.cc:562] Master@127.23.245.190:43513 shutting down...
I20260709 12:22:15.421418 24534 raft_consensus.cc:2243] T 00000000000000000000000000000000 P a0be743c2e10439c947751bd17872f2c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:15.422060 24534 raft_consensus.cc:2272] T 00000000000000000000000000000000 P a0be743c2e10439c947751bd17872f2c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:15.422389 24534 tablet_replica.cc:333] T 00000000000000000000000000000000 P a0be743c2e10439c947751bd17872f2c: stopping tablet replica
I20260709 12:22:15.441332 24534 master.cc:584] Master@127.23.245.190:43513 shutdown complete.
020e8ee127be4559a08dccacb1d2790b  4
08e1711cb2de485092226dd78ebcdb4c  1
36d4b1d255db4886a9bb549a0d4920fd  4
020e8ee127be4559a08dccacb1d2790b  3
08e1711cb2de485092226dd78ebcdb4c  3
36d4b1d255db4886a9bb549a0d4920fd  3
020e8ee127be4559a08dccacb1d2790b  8
08e1711cb2de485092226dd78ebcdb4c  1
36d4b1d255db4886a9bb549a0d4920fd  0
020e8ee127be4559a08dccacb1d2790b  3
08e1711cb2de485092226dd78ebcdb4c  3
36d4b1d255db4886a9bb549a0d4920fd  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (31031 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:22:15.481729 24534 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.23.245.190:43825
I20260709 12:22:15.482780 24534 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:15.489112 25050 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:15.489125 25049 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:15.490003 25052 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:15.490222 24534 server_base.cc:1061] running on GCE node
I20260709 12:22:15.491132 24534 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:15.491364 24534 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:15.491482 24534 hybrid_clock.cc:648] HybridClock initialized: now 1783599735491470 us; error 0 us; skew 500 ppm
I20260709 12:22:15.492075 24534 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:15.494484 24534 webserver.cc:533] Webserver started at http://127.23.245.190:40355/ using document root <none> and password file <none>
I20260709 12:22:15.494946 24534 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:15.495101 24534 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:15.495316 24534 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:15.496448 24534 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599704270295-24534-0/minicluster-data/master-0-root/instance:
uuid: "39a10666588745b1b7e6ed75f1979db9"
format_stamp: "Formatted at 2026-07-09 12:22:15 on dist-test-slave-mlt7"
I20260709 12:22:15.500788 24534 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:22:15.504199 25057 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:15.504928 24534 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:22:15.505174 24534 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599704270295-24534-0/minicluster-data/master-0-root
uuid: "39a10666588745b1b7e6ed75f1979db9"
format_stamp: "Formatted at 2026-07-09 12:22:15 on dist-test-slave-mlt7"
I20260709 12:22:15.505430 24534 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599704270295-24534-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599704270295-24534-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599704270295-24534-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:15.518810 24534 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:15.520051 24534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:15.556895 24534 rpc_server.cc:307] RPC server started. Bound to: 127.23.245.190:43825
I20260709 12:22:15.557142 25108 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.245.190:43825 every 8 connection(s)
I20260709 12:22:15.562884 25109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:15.573822 25109 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39a10666588745b1b7e6ed75f1979db9: Bootstrap starting.
I20260709 12:22:15.578415 25109 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 39a10666588745b1b7e6ed75f1979db9: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:15.582937 25109 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39a10666588745b1b7e6ed75f1979db9: No bootstrap required, opened a new log
I20260709 12:22:15.585210 25109 raft_consensus.cc:359] T 00000000000000000000000000000000 P 39a10666588745b1b7e6ed75f1979db9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39a10666588745b1b7e6ed75f1979db9" member_type: VOTER }
I20260709 12:22:15.585661 25109 raft_consensus.cc:385] T 00000000000000000000000000000000 P 39a10666588745b1b7e6ed75f1979db9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:15.585875 25109 raft_consensus.cc:740] T 00000000000000000000000000000000 P 39a10666588745b1b7e6ed75f1979db9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a10666588745b1b7e6ed75f1979db9, State: Initialized, Role: FOLLOWER
I20260709 12:22:15.586529 25109 consensus_queue.cc:260] T 00000000000000000000000000000000 P 39a10666588745b1b7e6ed75f1979db9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39a10666588745b1b7e6ed75f1979db9" member_type: VOTER }
I20260709 12:22:15.587020 25109 raft_consensus.cc:399] T 00000000000000000000000000000000 P 39a10666588745b1b7e6ed75f1979db9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:22:15.587222 25109 raft_consensus.cc:493] T 00000000000000000000000000000000 P 39a10666588745b1b7e6ed75f1979db9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:22:15.587522 25109 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 39a10666588745b1b7e6ed75f1979db9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:15.591398 25109 raft_consensus.cc:515] T 00000000000000000000000000000000 P 39a10666588745b1b7e6ed75f1979db9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39a10666588745b1b7e6ed75f1979db9" member_type: VOTER }
I20260709 12:22:15.591905 25109 leader_election.cc:304] T 00000000000000000000000000000000 P 39a10666588745b1b7e6ed75f1979db9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 39a10666588745b1b7e6ed75f1979db9; no voters: 
I20260709 12:22:15.593214 25109 leader_election.cc:290] T 00000000000000000000000000000000 P 39a10666588745b1b7e6ed75f1979db9 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:22:15.593623 25112 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 39a10666588745b1b7e6ed75f1979db9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:15.594956 25112 raft_consensus.cc:697] T 00000000000000000000000000000000 P 39a10666588745b1b7e6ed75f1979db9 [term 1 LEADER]: Becoming Leader. State: Replica: 39a10666588745b1b7e6ed75f1979db9, State: Running, Role: LEADER
I20260709 12:22:15.595644 25112 consensus_queue.cc:237] T 00000000000000000000000000000000 P 39a10666588745b1b7e6ed75f1979db9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39a10666588745b1b7e6ed75f1979db9" member_type: VOTER }
I20260709 12:22:15.596073 25109 sys_catalog.cc:565] T 00000000000000000000000000000000 P 39a10666588745b1b7e6ed75f1979db9 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:22:15.600860 25113 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39a10666588745b1b7e6ed75f1979db9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "39a10666588745b1b7e6ed75f1979db9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39a10666588745b1b7e6ed75f1979db9" member_type: VOTER } }
I20260709 12:22:15.600816 25114 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39a10666588745b1b7e6ed75f1979db9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 39a10666588745b1b7e6ed75f1979db9. Latest consensus state: current_term: 1 leader_uuid: "39a10666588745b1b7e6ed75f1979db9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "39a10666588745b1b7e6ed75f1979db9" member_type: VOTER } }
I20260709 12:22:15.601475 25113 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39a10666588745b1b7e6ed75f1979db9 [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:15.601631 25114 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39a10666588745b1b7e6ed75f1979db9 [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:15.604293 25119 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:22:15.609431 25119 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:22:15.616029 24534 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:22:15.618350 25119 catalog_manager.cc:1383] Generated new cluster ID: 1a3f16ec0e7b4a389394ccaf482ded28
I20260709 12:22:15.618638 25119 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:22:15.642037 25119 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:22:15.643301 25119 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:22:15.656092 25119 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 39a10666588745b1b7e6ed75f1979db9: Generated new TSK 0
I20260709 12:22:15.656659 25119 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:22:15.683018 24534 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:15.689067 25130 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:15.689826 25131 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:15.691481 25133 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:15.691725 24534 server_base.cc:1061] running on GCE node
I20260709 12:22:15.692628 24534 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:15.692800 24534 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:15.692916 24534 hybrid_clock.cc:648] HybridClock initialized: now 1783599735692906 us; error 0 us; skew 500 ppm
I20260709 12:22:15.693356 24534 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:15.695806 24534 webserver.cc:533] Webserver started at http://127.23.245.129:43273/ using document root <none> and password file <none>
I20260709 12:22:15.696357 24534 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:15.696550 24534 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:15.696776 24534 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:15.697927 24534 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599704270295-24534-0/minicluster-data/ts-0-root/instance:
uuid: "67f2d785daf545deba69f6d4d4ea8251"
format_stamp: "Formatted at 2026-07-09 12:22:15 on dist-test-slave-mlt7"
I20260709 12:22:15.702750 24534 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:22:15.706382 25138 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:15.707247 24534 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:22:15.707620 24534 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599704270295-24534-0/minicluster-data/ts-0-root
uuid: "67f2d785daf545deba69f6d4d4ea8251"
format_stamp: "Formatted at 2026-07-09 12:22:15 on dist-test-slave-mlt7"
I20260709 12:22:15.707924 24534 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599704270295-24534-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599704270295-24534-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599704270295-24534-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:15.717785 24534 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:15.719084 24534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:15.720741 24534 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:15.723145 24534 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:15.723398 24534 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:15.723678 24534 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:15.723887 24534 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:15.765245 24534 rpc_server.cc:307] RPC server started. Bound to: 127.23.245.129:41731
I20260709 12:22:15.765334 25200 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.245.129:41731 every 8 connection(s)
I20260709 12:22:15.770723 24534 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:15.778957 25205 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:15.779196 25206 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:15.782110 25208 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:15.782215 24534 server_base.cc:1061] running on GCE node
I20260709 12:22:15.783265 24534 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:15.783520 24534 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:15.783758 24534 hybrid_clock.cc:648] HybridClock initialized: now 1783599735783732 us; error 0 us; skew 500 ppm
I20260709 12:22:15.784502 24534 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:15.787388 24534 webserver.cc:533] Webserver started at http://127.23.245.130:39037/ using document root <none> and password file <none>
I20260709 12:22:15.787812 25201 heartbeater.cc:344] Connected to a master server at 127.23.245.190:43825
I20260709 12:22:15.787962 24534 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:15.788233 25201 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:15.788280 24534 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:15.788710 24534 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:15.789116 25201 heartbeater.cc:507] Master 127.23.245.190:43825 requested a full tablet report, sending...
I20260709 12:22:15.789883 24534 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599704270295-24534-0/minicluster-data/ts-1-root/instance:
uuid: "1f007450922d46c1aaae5cc6be7a9452"
format_stamp: "Formatted at 2026-07-09 12:22:15 on dist-test-slave-mlt7"
I20260709 12:22:15.791035 25074 ts_manager.cc:194] Registered new tserver with Master: 67f2d785daf545deba69f6d4d4ea8251 (127.23.245.129:41731)
I20260709 12:22:15.792754 25074 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54650
I20260709 12:22:15.794605 24534 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:22:15.798264 25213 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:15.799054 24534 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:22:15.799309 24534 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599704270295-24534-0/minicluster-data/ts-1-root
uuid: "1f007450922d46c1aaae5cc6be7a9452"
format_stamp: "Formatted at 2026-07-09 12:22:15 on dist-test-slave-mlt7"
I20260709 12:22:15.799546 24534 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599704270295-24534-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599704270295-24534-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599704270295-24534-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:15.809713 24534 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:15.810951 24534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:15.812359 24534 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:15.814458 24534 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:15.814690 24534 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:15.814926 24534 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:15.815102 24534 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:15.852865 24534 rpc_server.cc:307] RPC server started. Bound to: 127.23.245.130:41957
I20260709 12:22:15.852974 25275 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.245.130:41957 every 8 connection(s)
I20260709 12:22:15.857497 24534 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:15.864845 25279 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:15.865859 25280 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:15.868299 25282 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:15.869829 24534 server_base.cc:1061] running on GCE node
I20260709 12:22:15.870790 24534 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:22:15.870836 25276 heartbeater.cc:344] Connected to a master server at 127.23.245.190:43825
W20260709 12:22:15.871158 24534 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:15.871312 25276 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:15.871404 24534 hybrid_clock.cc:648] HybridClock initialized: now 1783599735871384 us; error 0 us; skew 500 ppm
I20260709 12:22:15.872184 25276 heartbeater.cc:507] Master 127.23.245.190:43825 requested a full tablet report, sending...
I20260709 12:22:15.872243 24534 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:15.874452 25074 ts_manager.cc:194] Registered new tserver with Master: 1f007450922d46c1aaae5cc6be7a9452 (127.23.245.130:41957)
I20260709 12:22:15.875056 24534 webserver.cc:533] Webserver started at http://127.23.245.131:42349/ using document root <none> and password file <none>
I20260709 12:22:15.875653 24534 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:15.875864 24534 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:15.875963 25074 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54666
I20260709 12:22:15.876287 24534 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:15.877703 24534 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599704270295-24534-0/minicluster-data/ts-2-root/instance:
uuid: "874f559253d64e01a7ce18b3b8f2164c"
format_stamp: "Formatted at 2026-07-09 12:22:15 on dist-test-slave-mlt7"
I20260709 12:22:15.882367 24534 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:22:15.885923 25287 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:15.886744 24534 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:22:15.887053 24534 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599704270295-24534-0/minicluster-data/ts-2-root
uuid: "874f559253d64e01a7ce18b3b8f2164c"
format_stamp: "Formatted at 2026-07-09 12:22:15 on dist-test-slave-mlt7"
I20260709 12:22:15.887356 24534 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599704270295-24534-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599704270295-24534-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599704270295-24534-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:15.907044 24534 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:15.908363 24534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:15.909785 24534 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:15.912034 24534 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:15.912206 24534 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:15.912499 24534 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:15.912657 24534 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:15.951368 24534 rpc_server.cc:307] RPC server started. Bound to: 127.23.245.131:46459
I20260709 12:22:15.951475 25349 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.245.131:46459 every 8 connection(s)
I20260709 12:22:15.965039 25350 heartbeater.cc:344] Connected to a master server at 127.23.245.190:43825
I20260709 12:22:15.965415 25350 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:15.966136 25350 heartbeater.cc:507] Master 127.23.245.190:43825 requested a full tablet report, sending...
I20260709 12:22:15.968245 25074 ts_manager.cc:194] Registered new tserver with Master: 874f559253d64e01a7ce18b3b8f2164c (127.23.245.131:46459)
I20260709 12:22:15.969077 24534 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014625381s
I20260709 12:22:15.970033 25074 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54678
I20260709 12:22:15.995978 25074 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54692:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:22:15.998869 25074 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:22:16.081542 25166 tablet_service.cc:1511] Processing CreateTablet for tablet 39cf9b9227204dd497e8ef50f1beb2bc (DEFAULT_TABLE table=test-workload [id=a88aa4aaaafc40ab831649bfe38d1e1a]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:22:16.083061 25166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39cf9b9227204dd497e8ef50f1beb2bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:16.085126 25165 tablet_service.cc:1511] Processing CreateTablet for tablet 8f462d4481754e45a6a38564f7ffacf7 (DEFAULT_TABLE table=test-workload [id=a88aa4aaaafc40ab831649bfe38d1e1a]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:22:16.086640 25165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f462d4481754e45a6a38564f7ffacf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:16.086886 25315 tablet_service.cc:1511] Processing CreateTablet for tablet 39cf9b9227204dd497e8ef50f1beb2bc (DEFAULT_TABLE table=test-workload [id=a88aa4aaaafc40ab831649bfe38d1e1a]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:22:16.087128 25240 tablet_service.cc:1511] Processing CreateTablet for tablet 8f462d4481754e45a6a38564f7ffacf7 (DEFAULT_TABLE table=test-workload [id=a88aa4aaaafc40ab831649bfe38d1e1a]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:22:16.088166 25315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39cf9b9227204dd497e8ef50f1beb2bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:16.088619 25240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f462d4481754e45a6a38564f7ffacf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:16.089159 25164 tablet_service.cc:1511] Processing CreateTablet for tablet 0c686b019831496188c502a729a4db8a (DEFAULT_TABLE table=test-workload [id=a88aa4aaaafc40ab831649bfe38d1e1a]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:22:16.090170 25236 tablet_service.cc:1511] Processing CreateTablet for tablet b7cc944e087640eab119454448129998 (DEFAULT_TABLE table=test-workload [id=a88aa4aaaafc40ab831649bfe38d1e1a]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:22:16.091181 25314 tablet_service.cc:1511] Processing CreateTablet for tablet 8f462d4481754e45a6a38564f7ffacf7 (DEFAULT_TABLE table=test-workload [id=a88aa4aaaafc40ab831649bfe38d1e1a]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:22:16.091686 25236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7cc944e087640eab119454448129998. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:16.091639 25163 tablet_service.cc:1511] Processing CreateTablet for tablet 0462f2e3489342489e622f469b237df2 (DEFAULT_TABLE table=test-workload [id=a88aa4aaaafc40ab831649bfe38d1e1a]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:22:16.092525 25314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f462d4481754e45a6a38564f7ffacf7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:16.094184 25162 tablet_service.cc:1511] Processing CreateTablet for tablet 7831b6a5a6f340948e8e0cbb3d36f7d8 (DEFAULT_TABLE table=test-workload [id=a88aa4aaaafc40ab831649bfe38d1e1a]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:22:16.096424 25237 tablet_service.cc:1511] Processing CreateTablet for tablet 7831b6a5a6f340948e8e0cbb3d36f7d8 (DEFAULT_TABLE table=test-workload [id=a88aa4aaaafc40ab831649bfe38d1e1a]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:22:16.097132 25313 tablet_service.cc:1511] Processing CreateTablet for tablet 0c686b019831496188c502a729a4db8a (DEFAULT_TABLE table=test-workload [id=a88aa4aaaafc40ab831649bfe38d1e1a]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:22:16.097555 25160 tablet_service.cc:1511] Processing CreateTablet for tablet a90bed0f71cb4741b9fa34669e5b7bc1 (DEFAULT_TABLE table=test-workload [id=a88aa4aaaafc40ab831649bfe38d1e1a]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:22:16.097966 25237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7831b6a5a6f340948e8e0cbb3d36f7d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:16.098462 25313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c686b019831496188c502a729a4db8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:16.096457 25161 tablet_service.cc:1511] Processing CreateTablet for tablet b7cc944e087640eab119454448129998 (DEFAULT_TABLE table=test-workload [id=a88aa4aaaafc40ab831649bfe38d1e1a]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:22:16.086215 25241 tablet_service.cc:1511] Processing CreateTablet for tablet 39cf9b9227204dd497e8ef50f1beb2bc (DEFAULT_TABLE table=test-workload [id=a88aa4aaaafc40ab831649bfe38d1e1a]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:22:16.100660 25241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39cf9b9227204dd497e8ef50f1beb2bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:16.101138 25312 tablet_service.cc:1511] Processing CreateTablet for tablet 0462f2e3489342489e622f469b237df2 (DEFAULT_TABLE table=test-workload [id=a88aa4aaaafc40ab831649bfe38d1e1a]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:22:16.101341 25238 tablet_service.cc:1511] Processing CreateTablet for tablet 0462f2e3489342489e622f469b237df2 (DEFAULT_TABLE table=test-workload [id=a88aa4aaaafc40ab831649bfe38d1e1a]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:22:16.102499 25312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0462f2e3489342489e622f469b237df2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:16.102841 25238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0462f2e3489342489e622f469b237df2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:16.107573 25160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a90bed0f71cb4741b9fa34669e5b7bc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:16.108449 25239 tablet_service.cc:1511] Processing CreateTablet for tablet 0c686b019831496188c502a729a4db8a (DEFAULT_TABLE table=test-workload [id=a88aa4aaaafc40ab831649bfe38d1e1a]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:22:16.109735 25162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7831b6a5a6f340948e8e0cbb3d36f7d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:16.110674 25161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7cc944e087640eab119454448129998. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:16.109884 25239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c686b019831496188c502a729a4db8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:16.111627 25311 tablet_service.cc:1511] Processing CreateTablet for tablet 7831b6a5a6f340948e8e0cbb3d36f7d8 (DEFAULT_TABLE table=test-workload [id=a88aa4aaaafc40ab831649bfe38d1e1a]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:22:16.113016 25311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7831b6a5a6f340948e8e0cbb3d36f7d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:16.116250 25163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0462f2e3489342489e622f469b237df2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:16.117700 25310 tablet_service.cc:1511] Processing CreateTablet for tablet b7cc944e087640eab119454448129998 (DEFAULT_TABLE table=test-workload [id=a88aa4aaaafc40ab831649bfe38d1e1a]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:22:16.124254 25164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c686b019831496188c502a729a4db8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:16.124773 25310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7cc944e087640eab119454448129998. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:16.142712 25235 tablet_service.cc:1511] Processing CreateTablet for tablet a90bed0f71cb4741b9fa34669e5b7bc1 (DEFAULT_TABLE table=test-workload [id=a88aa4aaaafc40ab831649bfe38d1e1a]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:22:16.144367 25235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a90bed0f71cb4741b9fa34669e5b7bc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:16.189414 25366 tablet_bootstrap.cc:492] T 0c686b019831496188c502a729a4db8a P 874f559253d64e01a7ce18b3b8f2164c: Bootstrap starting.
I20260709 12:22:16.193791 25365 tablet_bootstrap.cc:492] T 8f462d4481754e45a6a38564f7ffacf7 P 1f007450922d46c1aaae5cc6be7a9452: Bootstrap starting.
I20260709 12:22:16.200286 25314 tablet_service.cc:1511] Processing CreateTablet for tablet a90bed0f71cb4741b9fa34669e5b7bc1 (DEFAULT_TABLE table=test-workload [id=a88aa4aaaafc40ab831649bfe38d1e1a]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:22:16.201936 25314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a90bed0f71cb4741b9fa34669e5b7bc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:16.207731 25166 tablet_service.cc:1511] Processing CreateTablet for tablet ae5ec568a7c04c03ab6df14b7fc861e9 (DEFAULT_TABLE table=test-workload [id=a88aa4aaaafc40ab831649bfe38d1e1a]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:22:16.209167 25166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae5ec568a7c04c03ab6df14b7fc861e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:16.210470 25235 tablet_service.cc:1511] Processing CreateTablet for tablet ae5ec568a7c04c03ab6df14b7fc861e9 (DEFAULT_TABLE table=test-workload [id=a88aa4aaaafc40ab831649bfe38d1e1a]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:22:16.215939 25310 tablet_service.cc:1511] Processing CreateTablet for tablet ae5ec568a7c04c03ab6df14b7fc861e9 (DEFAULT_TABLE table=test-workload [id=a88aa4aaaafc40ab831649bfe38d1e1a]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:22:16.217236 25310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae5ec568a7c04c03ab6df14b7fc861e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:16.225013 25367 tablet_bootstrap.cc:492] T b7cc944e087640eab119454448129998 P 67f2d785daf545deba69f6d4d4ea8251: Bootstrap starting.
I20260709 12:22:16.213588 25366 tablet_bootstrap.cc:654] T 0c686b019831496188c502a729a4db8a P 874f559253d64e01a7ce18b3b8f2164c: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:16.233599 25165 tablet_service.cc:1511] Processing CreateTablet for tablet 09fa2961864c4c999f036a784f0da8cf (DEFAULT_TABLE table=test-workload [id=a88aa4aaaafc40ab831649bfe38d1e1a]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:22:16.234730 25165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09fa2961864c4c999f036a784f0da8cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:16.213681 25235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae5ec568a7c04c03ab6df14b7fc861e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:16.245643 25365 tablet_bootstrap.cc:654] T 8f462d4481754e45a6a38564f7ffacf7 P 1f007450922d46c1aaae5cc6be7a9452: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:16.254145 25366 tablet_bootstrap.cc:492] T 0c686b019831496188c502a729a4db8a P 874f559253d64e01a7ce18b3b8f2164c: No bootstrap required, opened a new log
I20260709 12:22:16.254648 25366 ts_tablet_manager.cc:1403] T 0c686b019831496188c502a729a4db8a P 874f559253d64e01a7ce18b3b8f2164c: Time spent bootstrapping tablet: real 0.065s	user 0.020s	sys 0.008s
I20260709 12:22:16.254694 25237 tablet_service.cc:1511] Processing CreateTablet for tablet 09fa2961864c4c999f036a784f0da8cf (DEFAULT_TABLE table=test-workload [id=a88aa4aaaafc40ab831649bfe38d1e1a]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:22:16.257293 25238 tablet_service.cc:1511] Processing CreateTablet for tablet 6afaae01b5b5406cac56ad99ce7f3482 (DEFAULT_TABLE table=test-workload [id=a88aa4aaaafc40ab831649bfe38d1e1a]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:22:16.257287 25314 tablet_service.cc:1511] Processing CreateTablet for tablet 09fa2961864c4c999f036a784f0da8cf (DEFAULT_TABLE table=test-workload [id=a88aa4aaaafc40ab831649bfe38d1e1a]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:22:16.261093 25314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09fa2961864c4c999f036a784f0da8cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:16.260772 25163 tablet_service.cc:1511] Processing CreateTablet for tablet 6afaae01b5b5406cac56ad99ce7f3482 (DEFAULT_TABLE table=test-workload [id=a88aa4aaaafc40ab831649bfe38d1e1a]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:22:16.261616 25311 tablet_service.cc:1511] Processing CreateTablet for tablet 6afaae01b5b5406cac56ad99ce7f3482 (DEFAULT_TABLE table=test-workload [id=a88aa4aaaafc40ab831649bfe38d1e1a]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:22:16.262028 25163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6afaae01b5b5406cac56ad99ce7f3482. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:16.262846 25311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6afaae01b5b5406cac56ad99ce7f3482. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:16.263934 25367 tablet_bootstrap.cc:654] T b7cc944e087640eab119454448129998 P 67f2d785daf545deba69f6d4d4ea8251: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:16.259876 25366 raft_consensus.cc:359] T 0c686b019831496188c502a729a4db8a P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.264972 25238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6afaae01b5b5406cac56ad99ce7f3482. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:16.275748 25237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09fa2961864c4c999f036a784f0da8cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:16.276108 25366 raft_consensus.cc:385] T 0c686b019831496188c502a729a4db8a P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:16.280122 25366 raft_consensus.cc:740] T 0c686b019831496188c502a729a4db8a P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 874f559253d64e01a7ce18b3b8f2164c, State: Initialized, Role: FOLLOWER
I20260709 12:22:16.280390 25367 tablet_bootstrap.cc:492] T b7cc944e087640eab119454448129998 P 67f2d785daf545deba69f6d4d4ea8251: No bootstrap required, opened a new log
I20260709 12:22:16.281957 25367 ts_tablet_manager.cc:1403] T b7cc944e087640eab119454448129998 P 67f2d785daf545deba69f6d4d4ea8251: Time spent bootstrapping tablet: real 0.057s	user 0.009s	sys 0.005s
I20260709 12:22:16.281599 25366 consensus_queue.cc:260] T 0c686b019831496188c502a729a4db8a P 874f559253d64e01a7ce18b3b8f2164c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.284926 25367 raft_consensus.cc:359] T b7cc944e087640eab119454448129998 P 67f2d785daf545deba69f6d4d4ea8251 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.285636 25367 raft_consensus.cc:385] T b7cc944e087640eab119454448129998 P 67f2d785daf545deba69f6d4d4ea8251 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:16.285940 25367 raft_consensus.cc:740] T b7cc944e087640eab119454448129998 P 67f2d785daf545deba69f6d4d4ea8251 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67f2d785daf545deba69f6d4d4ea8251, State: Initialized, Role: FOLLOWER
I20260709 12:22:16.288211 25365 tablet_bootstrap.cc:492] T 8f462d4481754e45a6a38564f7ffacf7 P 1f007450922d46c1aaae5cc6be7a9452: No bootstrap required, opened a new log
I20260709 12:22:16.289013 25367 consensus_queue.cc:260] T b7cc944e087640eab119454448129998 P 67f2d785daf545deba69f6d4d4ea8251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.291410 25350 heartbeater.cc:499] Master 127.23.245.190:43825 was elected leader, sending a full tablet report...
I20260709 12:22:16.293677 25366 ts_tablet_manager.cc:1434] T 0c686b019831496188c502a729a4db8a P 874f559253d64e01a7ce18b3b8f2164c: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.003s
I20260709 12:22:16.289129 25365 ts_tablet_manager.cc:1403] T 8f462d4481754e45a6a38564f7ffacf7 P 1f007450922d46c1aaae5cc6be7a9452: Time spent bootstrapping tablet: real 0.096s	user 0.008s	sys 0.015s
I20260709 12:22:16.296964 25201 heartbeater.cc:499] Master 127.23.245.190:43825 was elected leader, sending a full tablet report...
I20260709 12:22:16.297878 25367 ts_tablet_manager.cc:1434] T b7cc944e087640eab119454448129998 P 67f2d785daf545deba69f6d4d4ea8251: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:22:16.297717 25365 raft_consensus.cc:359] T 8f462d4481754e45a6a38564f7ffacf7 P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.298601 25365 raft_consensus.cc:385] T 8f462d4481754e45a6a38564f7ffacf7 P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:16.298990 25367 tablet_bootstrap.cc:492] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 67f2d785daf545deba69f6d4d4ea8251: Bootstrap starting.
I20260709 12:22:16.298986 25365 raft_consensus.cc:740] T 8f462d4481754e45a6a38564f7ffacf7 P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f007450922d46c1aaae5cc6be7a9452, State: Initialized, Role: FOLLOWER
I20260709 12:22:16.300302 25365 consensus_queue.cc:260] T 8f462d4481754e45a6a38564f7ffacf7 P 1f007450922d46c1aaae5cc6be7a9452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.302876 25276 heartbeater.cc:499] Master 127.23.245.190:43825 was elected leader, sending a full tablet report...
I20260709 12:22:16.306077 25367 tablet_bootstrap.cc:654] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 67f2d785daf545deba69f6d4d4ea8251: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:16.307763 25365 ts_tablet_manager.cc:1434] T 8f462d4481754e45a6a38564f7ffacf7 P 1f007450922d46c1aaae5cc6be7a9452: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.002s
I20260709 12:22:16.309434 25365 tablet_bootstrap.cc:492] T b7cc944e087640eab119454448129998 P 1f007450922d46c1aaae5cc6be7a9452: Bootstrap starting.
I20260709 12:22:16.294646 25366 tablet_bootstrap.cc:492] T 39cf9b9227204dd497e8ef50f1beb2bc P 874f559253d64e01a7ce18b3b8f2164c: Bootstrap starting.
I20260709 12:22:16.313927 25367 tablet_bootstrap.cc:492] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 67f2d785daf545deba69f6d4d4ea8251: No bootstrap required, opened a new log
I20260709 12:22:16.314724 25371 raft_consensus.cc:493] T 0c686b019831496188c502a729a4db8a P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.315287 25365 tablet_bootstrap.cc:654] T b7cc944e087640eab119454448129998 P 1f007450922d46c1aaae5cc6be7a9452: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:16.315223 25371 raft_consensus.cc:515] T 0c686b019831496188c502a729a4db8a P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.316809 25366 tablet_bootstrap.cc:654] T 39cf9b9227204dd497e8ef50f1beb2bc P 874f559253d64e01a7ce18b3b8f2164c: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:16.318742 25371 leader_election.cc:290] T 0c686b019831496188c502a729a4db8a P 874f559253d64e01a7ce18b3b8f2164c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67f2d785daf545deba69f6d4d4ea8251 (127.23.245.129:41731), 1f007450922d46c1aaae5cc6be7a9452 (127.23.245.130:41957)
I20260709 12:22:16.318055 25367 ts_tablet_manager.cc:1403] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 67f2d785daf545deba69f6d4d4ea8251: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.004s
I20260709 12:22:16.325942 25367 raft_consensus.cc:359] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 67f2d785daf545deba69f6d4d4ea8251 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.326930 25367 raft_consensus.cc:385] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 67f2d785daf545deba69f6d4d4ea8251 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:16.327316 25367 raft_consensus.cc:740] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 67f2d785daf545deba69f6d4d4ea8251 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67f2d785daf545deba69f6d4d4ea8251, State: Initialized, Role: FOLLOWER
I20260709 12:22:16.333364 25176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c686b019831496188c502a729a4db8a" candidate_uuid: "874f559253d64e01a7ce18b3b8f2164c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67f2d785daf545deba69f6d4d4ea8251" is_pre_election: true
W20260709 12:22:16.335507 25288 leader_election.cc:343] T 0c686b019831496188c502a729a4db8a P 874f559253d64e01a7ce18b3b8f2164c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67f2d785daf545deba69f6d4d4ea8251 (127.23.245.129:41731): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:16.340211 25367 consensus_queue.cc:260] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 67f2d785daf545deba69f6d4d4ea8251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.343797 25367 ts_tablet_manager.cc:1434] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 67f2d785daf545deba69f6d4d4ea8251: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:22:16.346657 25367 tablet_bootstrap.cc:492] T 0c686b019831496188c502a729a4db8a P 67f2d785daf545deba69f6d4d4ea8251: Bootstrap starting.
I20260709 12:22:16.347137 25365 tablet_bootstrap.cc:492] T b7cc944e087640eab119454448129998 P 1f007450922d46c1aaae5cc6be7a9452: No bootstrap required, opened a new log
I20260709 12:22:16.347632 25365 ts_tablet_manager.cc:1403] T b7cc944e087640eab119454448129998 P 1f007450922d46c1aaae5cc6be7a9452: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.006s
I20260709 12:22:16.348192 25366 tablet_bootstrap.cc:492] T 39cf9b9227204dd497e8ef50f1beb2bc P 874f559253d64e01a7ce18b3b8f2164c: No bootstrap required, opened a new log
I20260709 12:22:16.348714 25366 ts_tablet_manager.cc:1403] T 39cf9b9227204dd497e8ef50f1beb2bc P 874f559253d64e01a7ce18b3b8f2164c: Time spent bootstrapping tablet: real 0.054s	user 0.017s	sys 0.021s
I20260709 12:22:16.350517 25365 raft_consensus.cc:359] T b7cc944e087640eab119454448129998 P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.351248 25365 raft_consensus.cc:385] T b7cc944e087640eab119454448129998 P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:16.351574 25365 raft_consensus.cc:740] T b7cc944e087640eab119454448129998 P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f007450922d46c1aaae5cc6be7a9452, State: Initialized, Role: FOLLOWER
I20260709 12:22:16.351452 25366 raft_consensus.cc:359] T 39cf9b9227204dd497e8ef50f1beb2bc P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.352401 25366 raft_consensus.cc:385] T 39cf9b9227204dd497e8ef50f1beb2bc P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:16.352784 25366 raft_consensus.cc:740] T 39cf9b9227204dd497e8ef50f1beb2bc P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 874f559253d64e01a7ce18b3b8f2164c, State: Initialized, Role: FOLLOWER
I20260709 12:22:16.352558 25365 consensus_queue.cc:260] T b7cc944e087640eab119454448129998 P 1f007450922d46c1aaae5cc6be7a9452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.353075 25367 tablet_bootstrap.cc:654] T 0c686b019831496188c502a729a4db8a P 67f2d785daf545deba69f6d4d4ea8251: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:16.353708 25366 consensus_queue.cc:260] T 39cf9b9227204dd497e8ef50f1beb2bc P 874f559253d64e01a7ce18b3b8f2164c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.355263 25365 ts_tablet_manager.cc:1434] T b7cc944e087640eab119454448129998 P 1f007450922d46c1aaae5cc6be7a9452: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:22:16.356341 25365 tablet_bootstrap.cc:492] T a90bed0f71cb4741b9fa34669e5b7bc1 P 1f007450922d46c1aaae5cc6be7a9452: Bootstrap starting.
I20260709 12:22:16.356757 25366 ts_tablet_manager.cc:1434] T 39cf9b9227204dd497e8ef50f1beb2bc P 874f559253d64e01a7ce18b3b8f2164c: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.005s
I20260709 12:22:16.357792 25366 tablet_bootstrap.cc:492] T b7cc944e087640eab119454448129998 P 874f559253d64e01a7ce18b3b8f2164c: Bootstrap starting.
I20260709 12:22:16.363350 25365 tablet_bootstrap.cc:654] T a90bed0f71cb4741b9fa34669e5b7bc1 P 1f007450922d46c1aaae5cc6be7a9452: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:16.364787 25366 tablet_bootstrap.cc:654] T b7cc944e087640eab119454448129998 P 874f559253d64e01a7ce18b3b8f2164c: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:16.364846 25373 raft_consensus.cc:493] T b7cc944e087640eab119454448129998 P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.365449 25373 raft_consensus.cc:515] T b7cc944e087640eab119454448129998 P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.379119 25373 leader_election.cc:290] T b7cc944e087640eab119454448129998 P 1f007450922d46c1aaae5cc6be7a9452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67f2d785daf545deba69f6d4d4ea8251 (127.23.245.129:41731), 874f559253d64e01a7ce18b3b8f2164c (127.23.245.131:46459)
I20260709 12:22:16.392344 25176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7cc944e087640eab119454448129998" candidate_uuid: "1f007450922d46c1aaae5cc6be7a9452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67f2d785daf545deba69f6d4d4ea8251" is_pre_election: true
I20260709 12:22:16.393343 25176 raft_consensus.cc:2468] T b7cc944e087640eab119454448129998 P 67f2d785daf545deba69f6d4d4ea8251 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f007450922d46c1aaae5cc6be7a9452 in term 0.
I20260709 12:22:16.398241 25214 leader_election.cc:304] T b7cc944e087640eab119454448129998 P 1f007450922d46c1aaae5cc6be7a9452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f007450922d46c1aaae5cc6be7a9452, 67f2d785daf545deba69f6d4d4ea8251; no voters: 
I20260709 12:22:16.399185 25373 raft_consensus.cc:2804] T b7cc944e087640eab119454448129998 P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:16.399725 25373 raft_consensus.cc:493] T b7cc944e087640eab119454448129998 P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:16.400218 25373 raft_consensus.cc:3060] T b7cc944e087640eab119454448129998 P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:16.402448 25325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7cc944e087640eab119454448129998" candidate_uuid: "1f007450922d46c1aaae5cc6be7a9452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "874f559253d64e01a7ce18b3b8f2164c" is_pre_election: true
W20260709 12:22:16.404801 25214 leader_election.cc:343] T b7cc944e087640eab119454448129998 P 1f007450922d46c1aaae5cc6be7a9452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 874f559253d64e01a7ce18b3b8f2164c (127.23.245.131:46459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:16.415652 25373 raft_consensus.cc:515] T b7cc944e087640eab119454448129998 P 1f007450922d46c1aaae5cc6be7a9452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.419909 25176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7cc944e087640eab119454448129998" candidate_uuid: "1f007450922d46c1aaae5cc6be7a9452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67f2d785daf545deba69f6d4d4ea8251"
I20260709 12:22:16.420104 25251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c686b019831496188c502a729a4db8a" candidate_uuid: "874f559253d64e01a7ce18b3b8f2164c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f007450922d46c1aaae5cc6be7a9452" is_pre_election: true
I20260709 12:22:16.420840 25176 raft_consensus.cc:3060] T b7cc944e087640eab119454448129998 P 67f2d785daf545deba69f6d4d4ea8251 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:16.422308 25290 leader_election.cc:343] T 0c686b019831496188c502a729a4db8a P 874f559253d64e01a7ce18b3b8f2164c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f007450922d46c1aaae5cc6be7a9452 (127.23.245.130:41957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:16.422947 25290 leader_election.cc:304] T 0c686b019831496188c502a729a4db8a P 874f559253d64e01a7ce18b3b8f2164c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 874f559253d64e01a7ce18b3b8f2164c; no voters: 1f007450922d46c1aaae5cc6be7a9452, 67f2d785daf545deba69f6d4d4ea8251
I20260709 12:22:16.424101 25371 raft_consensus.cc:2749] T 0c686b019831496188c502a729a4db8a P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:16.427657 25373 leader_election.cc:290] T b7cc944e087640eab119454448129998 P 1f007450922d46c1aaae5cc6be7a9452 [CANDIDATE]: Term 1 election: Requested vote from peers 67f2d785daf545deba69f6d4d4ea8251 (127.23.245.129:41731), 874f559253d64e01a7ce18b3b8f2164c (127.23.245.131:46459)
I20260709 12:22:16.428900 25367 tablet_bootstrap.cc:492] T 0c686b019831496188c502a729a4db8a P 67f2d785daf545deba69f6d4d4ea8251: No bootstrap required, opened a new log
I20260709 12:22:16.428939 25325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7cc944e087640eab119454448129998" candidate_uuid: "1f007450922d46c1aaae5cc6be7a9452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "874f559253d64e01a7ce18b3b8f2164c"
I20260709 12:22:16.429538 25367 ts_tablet_manager.cc:1403] T 0c686b019831496188c502a729a4db8a P 67f2d785daf545deba69f6d4d4ea8251: Time spent bootstrapping tablet: real 0.083s	user 0.033s	sys 0.033s
W20260709 12:22:16.430552 25214 leader_election.cc:343] T b7cc944e087640eab119454448129998 P 1f007450922d46c1aaae5cc6be7a9452 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 874f559253d64e01a7ce18b3b8f2164c (127.23.245.131:46459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:16.431015 25366 tablet_bootstrap.cc:492] T b7cc944e087640eab119454448129998 P 874f559253d64e01a7ce18b3b8f2164c: No bootstrap required, opened a new log
I20260709 12:22:16.428893 25365 tablet_bootstrap.cc:492] T a90bed0f71cb4741b9fa34669e5b7bc1 P 1f007450922d46c1aaae5cc6be7a9452: No bootstrap required, opened a new log
I20260709 12:22:16.431479 25366 ts_tablet_manager.cc:1403] T b7cc944e087640eab119454448129998 P 874f559253d64e01a7ce18b3b8f2164c: Time spent bootstrapping tablet: real 0.074s	user 0.042s	sys 0.025s
I20260709 12:22:16.431349 25176 raft_consensus.cc:2468] T b7cc944e087640eab119454448129998 P 67f2d785daf545deba69f6d4d4ea8251 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f007450922d46c1aaae5cc6be7a9452 in term 1.
I20260709 12:22:16.431794 25365 ts_tablet_manager.cc:1403] T a90bed0f71cb4741b9fa34669e5b7bc1 P 1f007450922d46c1aaae5cc6be7a9452: Time spent bootstrapping tablet: real 0.076s	user 0.013s	sys 0.002s
I20260709 12:22:16.432592 25367 raft_consensus.cc:359] T 0c686b019831496188c502a729a4db8a P 67f2d785daf545deba69f6d4d4ea8251 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.433322 25367 raft_consensus.cc:385] T 0c686b019831496188c502a729a4db8a P 67f2d785daf545deba69f6d4d4ea8251 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:16.433106 25214 leader_election.cc:304] T b7cc944e087640eab119454448129998 P 1f007450922d46c1aaae5cc6be7a9452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f007450922d46c1aaae5cc6be7a9452, 67f2d785daf545deba69f6d4d4ea8251; no voters: 874f559253d64e01a7ce18b3b8f2164c
I20260709 12:22:16.433701 25367 raft_consensus.cc:740] T 0c686b019831496188c502a729a4db8a P 67f2d785daf545deba69f6d4d4ea8251 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67f2d785daf545deba69f6d4d4ea8251, State: Initialized, Role: FOLLOWER
I20260709 12:22:16.434613 25373 raft_consensus.cc:2804] T b7cc944e087640eab119454448129998 P 1f007450922d46c1aaae5cc6be7a9452 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:16.434482 25367 consensus_queue.cc:260] T 0c686b019831496188c502a729a4db8a P 67f2d785daf545deba69f6d4d4ea8251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.434616 25366 raft_consensus.cc:359] T b7cc944e087640eab119454448129998 P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.435467 25366 raft_consensus.cc:385] T b7cc944e087640eab119454448129998 P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:16.435060 25365 raft_consensus.cc:359] T a90bed0f71cb4741b9fa34669e5b7bc1 P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.435765 25366 raft_consensus.cc:740] T b7cc944e087640eab119454448129998 P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 874f559253d64e01a7ce18b3b8f2164c, State: Initialized, Role: FOLLOWER
I20260709 12:22:16.435891 25365 raft_consensus.cc:385] T a90bed0f71cb4741b9fa34669e5b7bc1 P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:16.436296 25365 raft_consensus.cc:740] T a90bed0f71cb4741b9fa34669e5b7bc1 P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f007450922d46c1aaae5cc6be7a9452, State: Initialized, Role: FOLLOWER
I20260709 12:22:16.436914 25367 ts_tablet_manager.cc:1434] T 0c686b019831496188c502a729a4db8a P 67f2d785daf545deba69f6d4d4ea8251: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:22:16.436746 25366 consensus_queue.cc:260] T b7cc944e087640eab119454448129998 P 874f559253d64e01a7ce18b3b8f2164c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.437234 25365 consensus_queue.cc:260] T a90bed0f71cb4741b9fa34669e5b7bc1 P 1f007450922d46c1aaae5cc6be7a9452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.437883 25367 tablet_bootstrap.cc:492] T 39cf9b9227204dd497e8ef50f1beb2bc P 67f2d785daf545deba69f6d4d4ea8251: Bootstrap starting.
I20260709 12:22:16.443442 25366 ts_tablet_manager.cc:1434] T b7cc944e087640eab119454448129998 P 874f559253d64e01a7ce18b3b8f2164c: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:22:16.444516 25366 tablet_bootstrap.cc:492] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c: Bootstrap starting.
I20260709 12:22:16.444748 25367 tablet_bootstrap.cc:654] T 39cf9b9227204dd497e8ef50f1beb2bc P 67f2d785daf545deba69f6d4d4ea8251: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:16.447141 25365 ts_tablet_manager.cc:1434] T a90bed0f71cb4741b9fa34669e5b7bc1 P 1f007450922d46c1aaae5cc6be7a9452: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.010s
I20260709 12:22:16.449034 25365 tablet_bootstrap.cc:492] T 0c686b019831496188c502a729a4db8a P 1f007450922d46c1aaae5cc6be7a9452: Bootstrap starting.
I20260709 12:22:16.452113 25366 tablet_bootstrap.cc:654] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:16.457832 25365 tablet_bootstrap.cc:654] T 0c686b019831496188c502a729a4db8a P 1f007450922d46c1aaae5cc6be7a9452: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:16.463773 25366 tablet_bootstrap.cc:492] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c: No bootstrap required, opened a new log
I20260709 12:22:16.464471 25366 ts_tablet_manager.cc:1403] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.008s
I20260709 12:22:16.468516 25366 raft_consensus.cc:359] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.469274 25365 tablet_bootstrap.cc:492] T 0c686b019831496188c502a729a4db8a P 1f007450922d46c1aaae5cc6be7a9452: No bootstrap required, opened a new log
I20260709 12:22:16.469581 25366 raft_consensus.cc:385] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:16.469946 25365 ts_tablet_manager.cc:1403] T 0c686b019831496188c502a729a4db8a P 1f007450922d46c1aaae5cc6be7a9452: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.002s
I20260709 12:22:16.469980 25366 raft_consensus.cc:740] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 874f559253d64e01a7ce18b3b8f2164c, State: Initialized, Role: FOLLOWER
I20260709 12:22:16.470639 25373 raft_consensus.cc:697] T b7cc944e087640eab119454448129998 P 1f007450922d46c1aaae5cc6be7a9452 [term 1 LEADER]: Becoming Leader. State: Replica: 1f007450922d46c1aaae5cc6be7a9452, State: Running, Role: LEADER
I20260709 12:22:16.471511 25366 consensus_queue.cc:260] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.471750 25373 consensus_queue.cc:237] T b7cc944e087640eab119454448129998 P 1f007450922d46c1aaae5cc6be7a9452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.474551 25366 ts_tablet_manager.cc:1434] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:22:16.475692 25366 tablet_bootstrap.cc:492] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 874f559253d64e01a7ce18b3b8f2164c: Bootstrap starting.
I20260709 12:22:16.477672 25365 raft_consensus.cc:359] T 0c686b019831496188c502a729a4db8a P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.478374 25365 raft_consensus.cc:385] T 0c686b019831496188c502a729a4db8a P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:16.478682 25365 raft_consensus.cc:740] T 0c686b019831496188c502a729a4db8a P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f007450922d46c1aaae5cc6be7a9452, State: Initialized, Role: FOLLOWER
I20260709 12:22:16.479223 25367 tablet_bootstrap.cc:492] T 39cf9b9227204dd497e8ef50f1beb2bc P 67f2d785daf545deba69f6d4d4ea8251: No bootstrap required, opened a new log
I20260709 12:22:16.479854 25367 ts_tablet_manager.cc:1403] T 39cf9b9227204dd497e8ef50f1beb2bc P 67f2d785daf545deba69f6d4d4ea8251: Time spent bootstrapping tablet: real 0.042s	user 0.012s	sys 0.028s
I20260709 12:22:16.479483 25365 consensus_queue.cc:260] T 0c686b019831496188c502a729a4db8a P 1f007450922d46c1aaae5cc6be7a9452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.484105 25366 tablet_bootstrap.cc:654] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 874f559253d64e01a7ce18b3b8f2164c: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:16.484161 25365 ts_tablet_manager.cc:1434] T 0c686b019831496188c502a729a4db8a P 1f007450922d46c1aaae5cc6be7a9452: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:22:16.483846 25367 raft_consensus.cc:359] T 39cf9b9227204dd497e8ef50f1beb2bc P 67f2d785daf545deba69f6d4d4ea8251 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.484860 25367 raft_consensus.cc:385] T 39cf9b9227204dd497e8ef50f1beb2bc P 67f2d785daf545deba69f6d4d4ea8251 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:16.485289 25367 raft_consensus.cc:740] T 39cf9b9227204dd497e8ef50f1beb2bc P 67f2d785daf545deba69f6d4d4ea8251 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67f2d785daf545deba69f6d4d4ea8251, State: Initialized, Role: FOLLOWER
I20260709 12:22:16.486168 25367 consensus_queue.cc:260] T 39cf9b9227204dd497e8ef50f1beb2bc P 67f2d785daf545deba69f6d4d4ea8251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.488139 25365 tablet_bootstrap.cc:492] T 0462f2e3489342489e622f469b237df2 P 1f007450922d46c1aaae5cc6be7a9452: Bootstrap starting.
I20260709 12:22:16.490525 25367 ts_tablet_manager.cc:1434] T 39cf9b9227204dd497e8ef50f1beb2bc P 67f2d785daf545deba69f6d4d4ea8251: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:22:16.490126 25073 catalog_manager.cc:5697] T b7cc944e087640eab119454448129998 P 1f007450922d46c1aaae5cc6be7a9452 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f007450922d46c1aaae5cc6be7a9452 (127.23.245.130). New cstate: current_term: 1 leader_uuid: "1f007450922d46c1aaae5cc6be7a9452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:16.491446 25367 tablet_bootstrap.cc:492] T a90bed0f71cb4741b9fa34669e5b7bc1 P 67f2d785daf545deba69f6d4d4ea8251: Bootstrap starting.
I20260709 12:22:16.495990 25372 raft_consensus.cc:493] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 67f2d785daf545deba69f6d4d4ea8251 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.496943 25366 tablet_bootstrap.cc:492] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 874f559253d64e01a7ce18b3b8f2164c: No bootstrap required, opened a new log
I20260709 12:22:16.496482 25372 raft_consensus.cc:515] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 67f2d785daf545deba69f6d4d4ea8251 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.501724 25372 leader_election.cc:290] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 67f2d785daf545deba69f6d4d4ea8251 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f007450922d46c1aaae5cc6be7a9452 (127.23.245.130:41957), 874f559253d64e01a7ce18b3b8f2164c (127.23.245.131:46459)
I20260709 12:22:16.503638 25367 tablet_bootstrap.cc:654] T a90bed0f71cb4741b9fa34669e5b7bc1 P 67f2d785daf545deba69f6d4d4ea8251: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:16.505476 25366 ts_tablet_manager.cc:1403] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 874f559253d64e01a7ce18b3b8f2164c: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.008s
I20260709 12:22:16.497327 25365 tablet_bootstrap.cc:654] T 0462f2e3489342489e622f469b237df2 P 1f007450922d46c1aaae5cc6be7a9452: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:16.510677 25366 raft_consensus.cc:359] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.515766 25366 raft_consensus.cc:385] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:16.516227 25366 raft_consensus.cc:740] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 874f559253d64e01a7ce18b3b8f2164c, State: Initialized, Role: FOLLOWER
I20260709 12:22:16.519136 25366 consensus_queue.cc:260] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 874f559253d64e01a7ce18b3b8f2164c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.526644 25366 ts_tablet_manager.cc:1434] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 874f559253d64e01a7ce18b3b8f2164c: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:22:16.527674 25366 tablet_bootstrap.cc:492] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c: Bootstrap starting.
I20260709 12:22:16.541759 25366 tablet_bootstrap.cc:654] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:16.554319 25366 tablet_bootstrap.cc:492] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c: No bootstrap required, opened a new log
I20260709 12:22:16.554877 25366 ts_tablet_manager.cc:1403] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c: Time spent bootstrapping tablet: real 0.027s	user 0.017s	sys 0.000s
I20260709 12:22:16.558220 25366 raft_consensus.cc:359] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.559028 25366 raft_consensus.cc:385] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:16.559341 25366 raft_consensus.cc:740] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 874f559253d64e01a7ce18b3b8f2164c, State: Initialized, Role: FOLLOWER
I20260709 12:22:16.560305 25366 consensus_queue.cc:260] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.564846 25251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7831b6a5a6f340948e8e0cbb3d36f7d8" candidate_uuid: "67f2d785daf545deba69f6d4d4ea8251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f007450922d46c1aaae5cc6be7a9452" is_pre_election: true
I20260709 12:22:16.565201 25365 tablet_bootstrap.cc:492] T 0462f2e3489342489e622f469b237df2 P 1f007450922d46c1aaae5cc6be7a9452: No bootstrap required, opened a new log
I20260709 12:22:16.565833 25365 ts_tablet_manager.cc:1403] T 0462f2e3489342489e622f469b237df2 P 1f007450922d46c1aaae5cc6be7a9452: Time spent bootstrapping tablet: real 0.078s	user 0.040s	sys 0.021s
W20260709 12:22:16.566653 25141 leader_election.cc:343] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 67f2d785daf545deba69f6d4d4ea8251 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1f007450922d46c1aaae5cc6be7a9452 (127.23.245.130:41957): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:16.567559 25325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7831b6a5a6f340948e8e0cbb3d36f7d8" candidate_uuid: "67f2d785daf545deba69f6d4d4ea8251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "874f559253d64e01a7ce18b3b8f2164c" is_pre_election: true
I20260709 12:22:16.568024 25367 tablet_bootstrap.cc:492] T a90bed0f71cb4741b9fa34669e5b7bc1 P 67f2d785daf545deba69f6d4d4ea8251: No bootstrap required, opened a new log
I20260709 12:22:16.568239 25325 raft_consensus.cc:2468] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67f2d785daf545deba69f6d4d4ea8251 in term 0.
I20260709 12:22:16.568470 25367 ts_tablet_manager.cc:1403] T a90bed0f71cb4741b9fa34669e5b7bc1 P 67f2d785daf545deba69f6d4d4ea8251: Time spent bootstrapping tablet: real 0.077s	user 0.037s	sys 0.028s
I20260709 12:22:16.569701 25139 leader_election.cc:304] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 67f2d785daf545deba69f6d4d4ea8251 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67f2d785daf545deba69f6d4d4ea8251, 874f559253d64e01a7ce18b3b8f2164c; no voters: 1f007450922d46c1aaae5cc6be7a9452
I20260709 12:22:16.569413 25365 raft_consensus.cc:359] T 0462f2e3489342489e622f469b237df2 P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.570319 25365 raft_consensus.cc:385] T 0462f2e3489342489e622f469b237df2 P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:16.570593 25366 ts_tablet_manager.cc:1434] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.003s
I20260709 12:22:16.570667 25365 raft_consensus.cc:740] T 0462f2e3489342489e622f469b237df2 P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f007450922d46c1aaae5cc6be7a9452, State: Initialized, Role: FOLLOWER
I20260709 12:22:16.571177 25372 raft_consensus.cc:2804] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 67f2d785daf545deba69f6d4d4ea8251 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:16.571570 25372 raft_consensus.cc:493] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 67f2d785daf545deba69f6d4d4ea8251 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:16.571458 25367 raft_consensus.cc:359] T a90bed0f71cb4741b9fa34669e5b7bc1 P 67f2d785daf545deba69f6d4d4ea8251 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.572098 25372 raft_consensus.cc:3060] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 67f2d785daf545deba69f6d4d4ea8251 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:16.572249 25367 raft_consensus.cc:385] T a90bed0f71cb4741b9fa34669e5b7bc1 P 67f2d785daf545deba69f6d4d4ea8251 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:16.571653 25365 consensus_queue.cc:260] T 0462f2e3489342489e622f469b237df2 P 1f007450922d46c1aaae5cc6be7a9452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.572576 25367 raft_consensus.cc:740] T a90bed0f71cb4741b9fa34669e5b7bc1 P 67f2d785daf545deba69f6d4d4ea8251 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67f2d785daf545deba69f6d4d4ea8251, State: Initialized, Role: FOLLOWER
I20260709 12:22:16.573725 25366 tablet_bootstrap.cc:492] T ae5ec568a7c04c03ab6df14b7fc861e9 P 874f559253d64e01a7ce18b3b8f2164c: Bootstrap starting.
I20260709 12:22:16.573364 25367 consensus_queue.cc:260] T a90bed0f71cb4741b9fa34669e5b7bc1 P 67f2d785daf545deba69f6d4d4ea8251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.576830 25365 ts_tablet_manager.cc:1434] T 0462f2e3489342489e622f469b237df2 P 1f007450922d46c1aaae5cc6be7a9452: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:22:16.577914 25365 tablet_bootstrap.cc:492] T 39cf9b9227204dd497e8ef50f1beb2bc P 1f007450922d46c1aaae5cc6be7a9452: Bootstrap starting.
I20260709 12:22:16.582823 25371 raft_consensus.cc:493] T b7cc944e087640eab119454448129998 P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.583329 25371 raft_consensus.cc:515] T b7cc944e087640eab119454448129998 P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.584419 25365 tablet_bootstrap.cc:654] T 39cf9b9227204dd497e8ef50f1beb2bc P 1f007450922d46c1aaae5cc6be7a9452: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:16.585536 25371 leader_election.cc:290] T b7cc944e087640eab119454448129998 P 874f559253d64e01a7ce18b3b8f2164c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67f2d785daf545deba69f6d4d4ea8251 (127.23.245.129:41731), 1f007450922d46c1aaae5cc6be7a9452 (127.23.245.130:41957)
I20260709 12:22:16.587958 25366 tablet_bootstrap.cc:654] T ae5ec568a7c04c03ab6df14b7fc861e9 P 874f559253d64e01a7ce18b3b8f2164c: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:16.588280 25251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7cc944e087640eab119454448129998" candidate_uuid: "874f559253d64e01a7ce18b3b8f2164c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f007450922d46c1aaae5cc6be7a9452" is_pre_election: true
I20260709 12:22:16.590034 25176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7cc944e087640eab119454448129998" candidate_uuid: "874f559253d64e01a7ce18b3b8f2164c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67f2d785daf545deba69f6d4d4ea8251" is_pre_election: true
I20260709 12:22:16.591100 25176 raft_consensus.cc:2393] T b7cc944e087640eab119454448129998 P 67f2d785daf545deba69f6d4d4ea8251 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 874f559253d64e01a7ce18b3b8f2164c in current term 1: Already voted for candidate 1f007450922d46c1aaae5cc6be7a9452 in this term.
I20260709 12:22:16.593716 25290 leader_election.cc:304] T b7cc944e087640eab119454448129998 P 874f559253d64e01a7ce18b3b8f2164c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 874f559253d64e01a7ce18b3b8f2164c; no voters: 1f007450922d46c1aaae5cc6be7a9452, 67f2d785daf545deba69f6d4d4ea8251
I20260709 12:22:16.594856 25371 raft_consensus.cc:3060] T b7cc944e087640eab119454448129998 P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:16.598311 25366 tablet_bootstrap.cc:492] T ae5ec568a7c04c03ab6df14b7fc861e9 P 874f559253d64e01a7ce18b3b8f2164c: No bootstrap required, opened a new log
I20260709 12:22:16.598821 25366 ts_tablet_manager.cc:1403] T ae5ec568a7c04c03ab6df14b7fc861e9 P 874f559253d64e01a7ce18b3b8f2164c: Time spent bootstrapping tablet: real 0.025s	user 0.006s	sys 0.009s
I20260709 12:22:16.602025 25366 raft_consensus.cc:359] T ae5ec568a7c04c03ab6df14b7fc861e9 P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.602514 25371 raft_consensus.cc:2749] T b7cc944e087640eab119454448129998 P 874f559253d64e01a7ce18b3b8f2164c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:16.602766 25366 raft_consensus.cc:385] T ae5ec568a7c04c03ab6df14b7fc861e9 P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:16.603070 25366 raft_consensus.cc:740] T ae5ec568a7c04c03ab6df14b7fc861e9 P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 874f559253d64e01a7ce18b3b8f2164c, State: Initialized, Role: FOLLOWER
I20260709 12:22:16.603945 25366 consensus_queue.cc:260] T ae5ec568a7c04c03ab6df14b7fc861e9 P 874f559253d64e01a7ce18b3b8f2164c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.604821 25365 tablet_bootstrap.cc:492] T 39cf9b9227204dd497e8ef50f1beb2bc P 1f007450922d46c1aaae5cc6be7a9452: No bootstrap required, opened a new log
I20260709 12:22:16.605298 25365 ts_tablet_manager.cc:1403] T 39cf9b9227204dd497e8ef50f1beb2bc P 1f007450922d46c1aaae5cc6be7a9452: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.008s
I20260709 12:22:16.606314 25366 ts_tablet_manager.cc:1434] T ae5ec568a7c04c03ab6df14b7fc861e9 P 874f559253d64e01a7ce18b3b8f2164c: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:22:16.608649 25365 raft_consensus.cc:359] T 39cf9b9227204dd497e8ef50f1beb2bc P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.609452 25365 raft_consensus.cc:385] T 39cf9b9227204dd497e8ef50f1beb2bc P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:16.609730 25365 raft_consensus.cc:740] T 39cf9b9227204dd497e8ef50f1beb2bc P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f007450922d46c1aaae5cc6be7a9452, State: Initialized, Role: FOLLOWER
I20260709 12:22:16.609890 25366 tablet_bootstrap.cc:492] T a90bed0f71cb4741b9fa34669e5b7bc1 P 874f559253d64e01a7ce18b3b8f2164c: Bootstrap starting.
I20260709 12:22:16.610738 25365 consensus_queue.cc:260] T 39cf9b9227204dd497e8ef50f1beb2bc P 1f007450922d46c1aaae5cc6be7a9452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.612705 25365 ts_tablet_manager.cc:1434] T 39cf9b9227204dd497e8ef50f1beb2bc P 1f007450922d46c1aaae5cc6be7a9452: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 12:22:16.613737 25365 tablet_bootstrap.cc:492] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 1f007450922d46c1aaae5cc6be7a9452: Bootstrap starting.
I20260709 12:22:16.616659 25366 tablet_bootstrap.cc:654] T a90bed0f71cb4741b9fa34669e5b7bc1 P 874f559253d64e01a7ce18b3b8f2164c: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:16.620771 25365 tablet_bootstrap.cc:654] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 1f007450922d46c1aaae5cc6be7a9452: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:16.624436 25371 raft_consensus.cc:493] T 39cf9b9227204dd497e8ef50f1beb2bc P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.625195 25371 raft_consensus.cc:515] T 39cf9b9227204dd497e8ef50f1beb2bc P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.628687 25371 leader_election.cc:290] T 39cf9b9227204dd497e8ef50f1beb2bc P 874f559253d64e01a7ce18b3b8f2164c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67f2d785daf545deba69f6d4d4ea8251 (127.23.245.129:41731), 1f007450922d46c1aaae5cc6be7a9452 (127.23.245.130:41957)
I20260709 12:22:16.629256 25176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cf9b9227204dd497e8ef50f1beb2bc" candidate_uuid: "874f559253d64e01a7ce18b3b8f2164c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67f2d785daf545deba69f6d4d4ea8251" is_pre_election: true
W20260709 12:22:16.619598 25122 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:16.629742 25251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cf9b9227204dd497e8ef50f1beb2bc" candidate_uuid: "874f559253d64e01a7ce18b3b8f2164c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f007450922d46c1aaae5cc6be7a9452" is_pre_election: true
I20260709 12:22:16.629968 25176 raft_consensus.cc:2468] T 39cf9b9227204dd497e8ef50f1beb2bc P 67f2d785daf545deba69f6d4d4ea8251 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 874f559253d64e01a7ce18b3b8f2164c in term 0.
I20260709 12:22:16.630378 25251 raft_consensus.cc:2468] T 39cf9b9227204dd497e8ef50f1beb2bc P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 874f559253d64e01a7ce18b3b8f2164c in term 0.
I20260709 12:22:16.631297 25288 leader_election.cc:304] T 39cf9b9227204dd497e8ef50f1beb2bc P 874f559253d64e01a7ce18b3b8f2164c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67f2d785daf545deba69f6d4d4ea8251, 874f559253d64e01a7ce18b3b8f2164c; no voters: 
I20260709 12:22:16.632840 25371 raft_consensus.cc:2804] T 39cf9b9227204dd497e8ef50f1beb2bc P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:16.633246 25371 raft_consensus.cc:493] T 39cf9b9227204dd497e8ef50f1beb2bc P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:16.633608 25371 raft_consensus.cc:3060] T 39cf9b9227204dd497e8ef50f1beb2bc P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:16.635069 25365 tablet_bootstrap.cc:492] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 1f007450922d46c1aaae5cc6be7a9452: No bootstrap required, opened a new log
I20260709 12:22:16.635561 25365 ts_tablet_manager.cc:1403] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 1f007450922d46c1aaae5cc6be7a9452: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.008s
I20260709 12:22:16.638409 25365 raft_consensus.cc:359] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.639113 25365 raft_consensus.cc:385] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:16.639384 25365 raft_consensus.cc:740] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f007450922d46c1aaae5cc6be7a9452, State: Initialized, Role: FOLLOWER
I20260709 12:22:16.640318 25365 consensus_queue.cc:260] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 1f007450922d46c1aaae5cc6be7a9452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.640630 25371 raft_consensus.cc:515] T 39cf9b9227204dd497e8ef50f1beb2bc P 874f559253d64e01a7ce18b3b8f2164c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.643103 25365 ts_tablet_manager.cc:1434] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 1f007450922d46c1aaae5cc6be7a9452: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 12:22:16.643332 25176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cf9b9227204dd497e8ef50f1beb2bc" candidate_uuid: "874f559253d64e01a7ce18b3b8f2164c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67f2d785daf545deba69f6d4d4ea8251"
I20260709 12:22:16.643867 25176 raft_consensus.cc:3060] T 39cf9b9227204dd497e8ef50f1beb2bc P 67f2d785daf545deba69f6d4d4ea8251 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:16.644117 25365 tablet_bootstrap.cc:492] T ae5ec568a7c04c03ab6df14b7fc861e9 P 1f007450922d46c1aaae5cc6be7a9452: Bootstrap starting.
I20260709 12:22:16.647068 25372 raft_consensus.cc:515] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 67f2d785daf545deba69f6d4d4ea8251 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.650584 25365 tablet_bootstrap.cc:654] T ae5ec568a7c04c03ab6df14b7fc861e9 P 1f007450922d46c1aaae5cc6be7a9452: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:16.650625 25176 raft_consensus.cc:2468] T 39cf9b9227204dd497e8ef50f1beb2bc P 67f2d785daf545deba69f6d4d4ea8251 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 874f559253d64e01a7ce18b3b8f2164c in term 1.
I20260709 12:22:16.655905 25288 leader_election.cc:304] T 39cf9b9227204dd497e8ef50f1beb2bc P 874f559253d64e01a7ce18b3b8f2164c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67f2d785daf545deba69f6d4d4ea8251, 874f559253d64e01a7ce18b3b8f2164c; no voters: 
I20260709 12:22:16.651342 25366 tablet_bootstrap.cc:492] T a90bed0f71cb4741b9fa34669e5b7bc1 P 874f559253d64e01a7ce18b3b8f2164c: No bootstrap required, opened a new log
I20260709 12:22:16.657389 25366 ts_tablet_manager.cc:1403] T a90bed0f71cb4741b9fa34669e5b7bc1 P 874f559253d64e01a7ce18b3b8f2164c: Time spent bootstrapping tablet: real 0.048s	user 0.013s	sys 0.005s
I20260709 12:22:16.662415 25366 raft_consensus.cc:359] T a90bed0f71cb4741b9fa34669e5b7bc1 P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.663365 25366 raft_consensus.cc:385] T a90bed0f71cb4741b9fa34669e5b7bc1 P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:16.665050 25250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7831b6a5a6f340948e8e0cbb3d36f7d8" candidate_uuid: "67f2d785daf545deba69f6d4d4ea8251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f007450922d46c1aaae5cc6be7a9452"
I20260709 12:22:16.665738 25250 raft_consensus.cc:3060] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:16.666383 25372 leader_election.cc:290] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 67f2d785daf545deba69f6d4d4ea8251 [CANDIDATE]: Term 1 election: Requested vote from peers 1f007450922d46c1aaae5cc6be7a9452 (127.23.245.130:41957), 874f559253d64e01a7ce18b3b8f2164c (127.23.245.131:46459)
I20260709 12:22:16.666666 25325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7831b6a5a6f340948e8e0cbb3d36f7d8" candidate_uuid: "67f2d785daf545deba69f6d4d4ea8251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "874f559253d64e01a7ce18b3b8f2164c"
I20260709 12:22:16.667449 25325 raft_consensus.cc:3060] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:16.669148 25399 raft_consensus.cc:2804] T 39cf9b9227204dd497e8ef50f1beb2bc P 874f559253d64e01a7ce18b3b8f2164c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:16.672992 25386 raft_consensus.cc:493] T 0c686b019831496188c502a729a4db8a P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.673501 25386 raft_consensus.cc:515] T 0c686b019831496188c502a729a4db8a P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.674448 25250 raft_consensus.cc:2468] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 1f007450922d46c1aaae5cc6be7a9452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67f2d785daf545deba69f6d4d4ea8251 in term 1.
I20260709 12:22:16.675676 25141 leader_election.cc:304] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 67f2d785daf545deba69f6d4d4ea8251 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f007450922d46c1aaae5cc6be7a9452, 67f2d785daf545deba69f6d4d4ea8251; no voters: 
I20260709 12:22:16.675637 25386 leader_election.cc:290] T 0c686b019831496188c502a729a4db8a P 1f007450922d46c1aaae5cc6be7a9452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67f2d785daf545deba69f6d4d4ea8251 (127.23.245.129:41731), 874f559253d64e01a7ce18b3b8f2164c (127.23.245.131:46459)
I20260709 12:22:16.677013 25394 raft_consensus.cc:2804] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 67f2d785daf545deba69f6d4d4ea8251 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:16.677381 25367 ts_tablet_manager.cc:1434] T a90bed0f71cb4741b9fa34669e5b7bc1 P 67f2d785daf545deba69f6d4d4ea8251: Time spent starting tablet: real 0.108s	user 0.053s	sys 0.043s
I20260709 12:22:16.677300 25176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c686b019831496188c502a729a4db8a" candidate_uuid: "1f007450922d46c1aaae5cc6be7a9452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67f2d785daf545deba69f6d4d4ea8251" is_pre_election: true
I20260709 12:22:16.677908 25394 raft_consensus.cc:697] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 67f2d785daf545deba69f6d4d4ea8251 [term 1 LEADER]: Becoming Leader. State: Replica: 67f2d785daf545deba69f6d4d4ea8251, State: Running, Role: LEADER
I20260709 12:22:16.678609 25367 tablet_bootstrap.cc:492] T 8f462d4481754e45a6a38564f7ffacf7 P 67f2d785daf545deba69f6d4d4ea8251: Bootstrap starting.
I20260709 12:22:16.652989 25251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cf9b9227204dd497e8ef50f1beb2bc" candidate_uuid: "874f559253d64e01a7ce18b3b8f2164c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f007450922d46c1aaae5cc6be7a9452"
I20260709 12:22:16.679145 25251 raft_consensus.cc:3060] T 39cf9b9227204dd497e8ef50f1beb2bc P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:16.679193 25394 consensus_queue.cc:237] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 67f2d785daf545deba69f6d4d4ea8251 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.681620 25324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c686b019831496188c502a729a4db8a" candidate_uuid: "1f007450922d46c1aaae5cc6be7a9452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "874f559253d64e01a7ce18b3b8f2164c" is_pre_election: true
I20260709 12:22:16.682518 25324 raft_consensus.cc:2468] T 0c686b019831496188c502a729a4db8a P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f007450922d46c1aaae5cc6be7a9452 in term 0.
I20260709 12:22:16.683962 25214 leader_election.cc:304] T 0c686b019831496188c502a729a4db8a P 1f007450922d46c1aaae5cc6be7a9452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f007450922d46c1aaae5cc6be7a9452, 874f559253d64e01a7ce18b3b8f2164c; no voters: 
I20260709 12:22:16.685150 25386 raft_consensus.cc:2804] T 0c686b019831496188c502a729a4db8a P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:16.685662 25386 raft_consensus.cc:493] T 0c686b019831496188c502a729a4db8a P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:16.686070 25386 raft_consensus.cc:3060] T 0c686b019831496188c502a729a4db8a P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:16.687044 25251 raft_consensus.cc:2468] T 39cf9b9227204dd497e8ef50f1beb2bc P 1f007450922d46c1aaae5cc6be7a9452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 874f559253d64e01a7ce18b3b8f2164c in term 1.
I20260709 12:22:16.678362 25176 raft_consensus.cc:2468] T 0c686b019831496188c502a729a4db8a P 67f2d785daf545deba69f6d4d4ea8251 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f007450922d46c1aaae5cc6be7a9452 in term 0.
I20260709 12:22:16.663705 25366 raft_consensus.cc:740] T a90bed0f71cb4741b9fa34669e5b7bc1 P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 874f559253d64e01a7ce18b3b8f2164c, State: Initialized, Role: FOLLOWER
I20260709 12:22:16.651939 25371 leader_election.cc:290] T 39cf9b9227204dd497e8ef50f1beb2bc P 874f559253d64e01a7ce18b3b8f2164c [CANDIDATE]: Term 1 election: Requested vote from peers 67f2d785daf545deba69f6d4d4ea8251 (127.23.245.129:41731), 1f007450922d46c1aaae5cc6be7a9452 (127.23.245.130:41957)
I20260709 12:22:16.695860 25325 raft_consensus.cc:2468] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 874f559253d64e01a7ce18b3b8f2164c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67f2d785daf545deba69f6d4d4ea8251 in term 1.
I20260709 12:22:16.697458 25399 raft_consensus.cc:697] T 39cf9b9227204dd497e8ef50f1beb2bc P 874f559253d64e01a7ce18b3b8f2164c [term 1 LEADER]: Becoming Leader. State: Replica: 874f559253d64e01a7ce18b3b8f2164c, State: Running, Role: LEADER
I20260709 12:22:16.704124 25399 consensus_queue.cc:237] T 39cf9b9227204dd497e8ef50f1beb2bc P 874f559253d64e01a7ce18b3b8f2164c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.710367 25373 raft_consensus.cc:493] T 8f462d4481754e45a6a38564f7ffacf7 P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.700613 25366 consensus_queue.cc:260] T a90bed0f71cb4741b9fa34669e5b7bc1 P 874f559253d64e01a7ce18b3b8f2164c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.710952 25373 raft_consensus.cc:515] T 8f462d4481754e45a6a38564f7ffacf7 P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.712988 25366 ts_tablet_manager.cc:1434] T a90bed0f71cb4741b9fa34669e5b7bc1 P 874f559253d64e01a7ce18b3b8f2164c: Time spent starting tablet: real 0.055s	user 0.006s	sys 0.002s
I20260709 12:22:16.713812 25373 leader_election.cc:290] T 8f462d4481754e45a6a38564f7ffacf7 P 1f007450922d46c1aaae5cc6be7a9452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67f2d785daf545deba69f6d4d4ea8251 (127.23.245.129:41731), 874f559253d64e01a7ce18b3b8f2164c (127.23.245.131:46459)
I20260709 12:22:16.714268 25366 tablet_bootstrap.cc:492] T 6afaae01b5b5406cac56ad99ce7f3482 P 874f559253d64e01a7ce18b3b8f2164c: Bootstrap starting.
I20260709 12:22:16.716256 25176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f462d4481754e45a6a38564f7ffacf7" candidate_uuid: "1f007450922d46c1aaae5cc6be7a9452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67f2d785daf545deba69f6d4d4ea8251" is_pre_election: true
I20260709 12:22:16.700289 25386 raft_consensus.cc:515] T 0c686b019831496188c502a729a4db8a P 1f007450922d46c1aaae5cc6be7a9452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.698100 25401 raft_consensus.cc:493] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.719842 25401 raft_consensus.cc:515] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
W20260709 12:22:16.721274 25214 leader_election.cc:343] T 8f462d4481754e45a6a38564f7ffacf7 P 1f007450922d46c1aaae5cc6be7a9452 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67f2d785daf545deba69f6d4d4ea8251 (127.23.245.129:41731): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:16.722961 25176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c686b019831496188c502a729a4db8a" candidate_uuid: "1f007450922d46c1aaae5cc6be7a9452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67f2d785daf545deba69f6d4d4ea8251"
I20260709 12:22:16.723692 25176 raft_consensus.cc:3060] T 0c686b019831496188c502a729a4db8a P 67f2d785daf545deba69f6d4d4ea8251 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:16.696871 25367 tablet_bootstrap.cc:654] T 8f462d4481754e45a6a38564f7ffacf7 P 67f2d785daf545deba69f6d4d4ea8251: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:16.730274 25386 leader_election.cc:290] T 0c686b019831496188c502a729a4db8a P 1f007450922d46c1aaae5cc6be7a9452 [CANDIDATE]: Term 1 election: Requested vote from peers 67f2d785daf545deba69f6d4d4ea8251 (127.23.245.129:41731), 874f559253d64e01a7ce18b3b8f2164c (127.23.245.131:46459)
I20260709 12:22:16.731366 25366 tablet_bootstrap.cc:654] T 6afaae01b5b5406cac56ad99ce7f3482 P 874f559253d64e01a7ce18b3b8f2164c: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:16.732627 25251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f462d4481754e45a6a38564f7ffacf7" candidate_uuid: "874f559253d64e01a7ce18b3b8f2164c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f007450922d46c1aaae5cc6be7a9452" is_pre_election: true
I20260709 12:22:16.733160 25175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f462d4481754e45a6a38564f7ffacf7" candidate_uuid: "874f559253d64e01a7ce18b3b8f2164c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67f2d785daf545deba69f6d4d4ea8251" is_pre_election: true
I20260709 12:22:16.733384 25251 raft_consensus.cc:2468] T 8f462d4481754e45a6a38564f7ffacf7 P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 874f559253d64e01a7ce18b3b8f2164c in term 0.
I20260709 12:22:16.735018 25290 leader_election.cc:304] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f007450922d46c1aaae5cc6be7a9452, 874f559253d64e01a7ce18b3b8f2164c; no voters: 
I20260709 12:22:16.735901 25325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f462d4481754e45a6a38564f7ffacf7" candidate_uuid: "1f007450922d46c1aaae5cc6be7a9452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "874f559253d64e01a7ce18b3b8f2164c" is_pre_election: true
I20260709 12:22:16.736214 25402 raft_consensus.cc:2804] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:16.736819 25325 raft_consensus.cc:2468] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f007450922d46c1aaae5cc6be7a9452 in term 0.
I20260709 12:22:16.737684 25401 leader_election.cc:290] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67f2d785daf545deba69f6d4d4ea8251 (127.23.245.129:41731), 1f007450922d46c1aaae5cc6be7a9452 (127.23.245.130:41957)
I20260709 12:22:16.738281 25402 raft_consensus.cc:493] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:16.738431 25324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c686b019831496188c502a729a4db8a" candidate_uuid: "1f007450922d46c1aaae5cc6be7a9452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "874f559253d64e01a7ce18b3b8f2164c"
I20260709 12:22:16.738866 25402 raft_consensus.cc:3060] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:16.739009 25324 raft_consensus.cc:3060] T 0c686b019831496188c502a729a4db8a P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:16.741436 25072 catalog_manager.cc:5697] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 67f2d785daf545deba69f6d4d4ea8251 reported cstate change: term changed from 0 to 1, leader changed from <none> to 67f2d785daf545deba69f6d4d4ea8251 (127.23.245.129). New cstate: current_term: 1 leader_uuid: "67f2d785daf545deba69f6d4d4ea8251" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:16.744506 25214 leader_election.cc:304] T 8f462d4481754e45a6a38564f7ffacf7 P 1f007450922d46c1aaae5cc6be7a9452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f007450922d46c1aaae5cc6be7a9452, 874f559253d64e01a7ce18b3b8f2164c; no voters: 67f2d785daf545deba69f6d4d4ea8251
I20260709 12:22:16.745932 25386 raft_consensus.cc:2804] T 8f462d4481754e45a6a38564f7ffacf7 P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:16.746348 25386 raft_consensus.cc:493] T 8f462d4481754e45a6a38564f7ffacf7 P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:16.746707 25386 raft_consensus.cc:3060] T 8f462d4481754e45a6a38564f7ffacf7 P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:16.750043 25402 raft_consensus.cc:515] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.753942 25324 raft_consensus.cc:2468] T 0c686b019831496188c502a729a4db8a P 874f559253d64e01a7ce18b3b8f2164c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f007450922d46c1aaae5cc6be7a9452 in term 1.
I20260709 12:22:16.757107 25365 tablet_bootstrap.cc:492] T ae5ec568a7c04c03ab6df14b7fc861e9 P 1f007450922d46c1aaae5cc6be7a9452: No bootstrap required, opened a new log
I20260709 12:22:16.764042 25367 tablet_bootstrap.cc:492] T 8f462d4481754e45a6a38564f7ffacf7 P 67f2d785daf545deba69f6d4d4ea8251: No bootstrap required, opened a new log
I20260709 12:22:16.757421 25402 leader_election.cc:290] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c [CANDIDATE]: Term 1 election: Requested vote from peers 67f2d785daf545deba69f6d4d4ea8251 (127.23.245.129:41731), 1f007450922d46c1aaae5cc6be7a9452 (127.23.245.130:41957)
I20260709 12:22:16.764420 25365 ts_tablet_manager.cc:1403] T ae5ec568a7c04c03ab6df14b7fc861e9 P 1f007450922d46c1aaae5cc6be7a9452: Time spent bootstrapping tablet: real 0.121s	user 0.038s	sys 0.037s
I20260709 12:22:16.758828 25251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f462d4481754e45a6a38564f7ffacf7" candidate_uuid: "874f559253d64e01a7ce18b3b8f2164c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f007450922d46c1aaae5cc6be7a9452"
I20260709 12:22:16.764587 25367 ts_tablet_manager.cc:1403] T 8f462d4481754e45a6a38564f7ffacf7 P 67f2d785daf545deba69f6d4d4ea8251: Time spent bootstrapping tablet: real 0.086s	user 0.015s	sys 0.000s
I20260709 12:22:16.760313 25366 tablet_bootstrap.cc:492] T 6afaae01b5b5406cac56ad99ce7f3482 P 874f559253d64e01a7ce18b3b8f2164c: No bootstrap required, opened a new log
I20260709 12:22:16.764957 25402 raft_consensus.cc:493] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.765271 25366 ts_tablet_manager.cc:1403] T 6afaae01b5b5406cac56ad99ce7f3482 P 874f559253d64e01a7ce18b3b8f2164c: Time spent bootstrapping tablet: real 0.051s	user 0.014s	sys 0.014s
I20260709 12:22:16.765574 25402 raft_consensus.cc:515] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.767069 25365 raft_consensus.cc:359] T ae5ec568a7c04c03ab6df14b7fc861e9 P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.767714 25365 raft_consensus.cc:385] T ae5ec568a7c04c03ab6df14b7fc861e9 P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:16.768126 25365 raft_consensus.cc:740] T ae5ec568a7c04c03ab6df14b7fc861e9 P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f007450922d46c1aaae5cc6be7a9452, State: Initialized, Role: FOLLOWER
I20260709 12:22:16.767983 25366 raft_consensus.cc:359] T 6afaae01b5b5406cac56ad99ce7f3482 P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.761188 25072 catalog_manager.cc:5697] T 39cf9b9227204dd497e8ef50f1beb2bc P 874f559253d64e01a7ce18b3b8f2164c reported cstate change: term changed from 0 to 1, leader changed from <none> to 874f559253d64e01a7ce18b3b8f2164c (127.23.245.131). New cstate: current_term: 1 leader_uuid: "874f559253d64e01a7ce18b3b8f2164c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:16.768664 25366 raft_consensus.cc:385] T 6afaae01b5b5406cac56ad99ce7f3482 P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:16.768970 25366 raft_consensus.cc:740] T 6afaae01b5b5406cac56ad99ce7f3482 P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 874f559253d64e01a7ce18b3b8f2164c, State: Initialized, Role: FOLLOWER
I20260709 12:22:16.768852 25365 consensus_queue.cc:260] T ae5ec568a7c04c03ab6df14b7fc861e9 P 1f007450922d46c1aaae5cc6be7a9452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.769554 25366 consensus_queue.cc:260] T 6afaae01b5b5406cac56ad99ce7f3482 P 874f559253d64e01a7ce18b3b8f2164c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
W20260709 12:22:16.754844 25288 leader_election.cc:343] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67f2d785daf545deba69f6d4d4ea8251 (127.23.245.129:41731): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:16.770268 25402 leader_election.cc:290] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67f2d785daf545deba69f6d4d4ea8251 (127.23.245.129:41731), 1f007450922d46c1aaae5cc6be7a9452 (127.23.245.130:41957)
I20260709 12:22:16.771481 25214 leader_election.cc:304] T 0c686b019831496188c502a729a4db8a P 1f007450922d46c1aaae5cc6be7a9452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f007450922d46c1aaae5cc6be7a9452, 874f559253d64e01a7ce18b3b8f2164c; no voters: 
I20260709 12:22:16.772644 25175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f462d4481754e45a6a38564f7ffacf7" candidate_uuid: "874f559253d64e01a7ce18b3b8f2164c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67f2d785daf545deba69f6d4d4ea8251"
I20260709 12:22:16.772842 25174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0462f2e3489342489e622f469b237df2" candidate_uuid: "874f559253d64e01a7ce18b3b8f2164c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67f2d785daf545deba69f6d4d4ea8251" is_pre_election: true
I20260709 12:22:16.773785 25366 ts_tablet_manager.cc:1434] T 6afaae01b5b5406cac56ad99ce7f3482 P 874f559253d64e01a7ce18b3b8f2164c: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
W20260709 12:22:16.774513 25288 leader_election.cc:343] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 67f2d785daf545deba69f6d4d4ea8251 (127.23.245.129:41731): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:16.774755 25366 tablet_bootstrap.cc:492] T 09fa2961864c4c999f036a784f0da8cf P 874f559253d64e01a7ce18b3b8f2164c: Bootstrap starting.
I20260709 12:22:16.767756 25367 raft_consensus.cc:359] T 8f462d4481754e45a6a38564f7ffacf7 P 67f2d785daf545deba69f6d4d4ea8251 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.769766 25250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0462f2e3489342489e622f469b237df2" candidate_uuid: "874f559253d64e01a7ce18b3b8f2164c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f007450922d46c1aaae5cc6be7a9452" is_pre_election: true
I20260709 12:22:16.776162 25373 raft_consensus.cc:2804] T 0c686b019831496188c502a729a4db8a P 1f007450922d46c1aaae5cc6be7a9452 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:16.776547 25250 raft_consensus.cc:2468] T 0462f2e3489342489e622f469b237df2 P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 874f559253d64e01a7ce18b3b8f2164c in term 0.
I20260709 12:22:16.778041 25290 leader_election.cc:304] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f007450922d46c1aaae5cc6be7a9452, 874f559253d64e01a7ce18b3b8f2164c; no voters: 67f2d785daf545deba69f6d4d4ea8251
I20260709 12:22:16.763118 25386 raft_consensus.cc:515] T 8f462d4481754e45a6a38564f7ffacf7 P 1f007450922d46c1aaae5cc6be7a9452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.776655 25373 raft_consensus.cc:697] T 0c686b019831496188c502a729a4db8a P 1f007450922d46c1aaae5cc6be7a9452 [term 1 LEADER]: Becoming Leader. State: Replica: 1f007450922d46c1aaae5cc6be7a9452, State: Running, Role: LEADER
I20260709 12:22:16.780356 25373 consensus_queue.cc:237] T 0c686b019831496188c502a729a4db8a P 1f007450922d46c1aaae5cc6be7a9452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.782281 25366 tablet_bootstrap.cc:654] T 09fa2961864c4c999f036a784f0da8cf P 874f559253d64e01a7ce18b3b8f2164c: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:16.782372 25174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f462d4481754e45a6a38564f7ffacf7" candidate_uuid: "1f007450922d46c1aaae5cc6be7a9452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67f2d785daf545deba69f6d4d4ea8251"
I20260709 12:22:16.780356 25251 raft_consensus.cc:2393] T 8f462d4481754e45a6a38564f7ffacf7 P 1f007450922d46c1aaae5cc6be7a9452 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 874f559253d64e01a7ce18b3b8f2164c in current term 1: Already voted for candidate 1f007450922d46c1aaae5cc6be7a9452 in this term.
I20260709 12:22:16.784564 25386 leader_election.cc:290] T 8f462d4481754e45a6a38564f7ffacf7 P 1f007450922d46c1aaae5cc6be7a9452 [CANDIDATE]: Term 1 election: Requested vote from peers 67f2d785daf545deba69f6d4d4ea8251 (127.23.245.129:41731), 874f559253d64e01a7ce18b3b8f2164c (127.23.245.131:46459)
I20260709 12:22:16.785322 25402 raft_consensus.cc:2804] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:16.786198 25402 raft_consensus.cc:493] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:16.787457 25402 raft_consensus.cc:3060] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:16.788583 25324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f462d4481754e45a6a38564f7ffacf7" candidate_uuid: "1f007450922d46c1aaae5cc6be7a9452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "874f559253d64e01a7ce18b3b8f2164c"
I20260709 12:22:16.785810 25367 raft_consensus.cc:385] T 8f462d4481754e45a6a38564f7ffacf7 P 67f2d785daf545deba69f6d4d4ea8251 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:16.789371 25324 raft_consensus.cc:2393] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1f007450922d46c1aaae5cc6be7a9452 in current term 1: Already voted for candidate 874f559253d64e01a7ce18b3b8f2164c in this term.
I20260709 12:22:16.789541 25365 ts_tablet_manager.cc:1434] T ae5ec568a7c04c03ab6df14b7fc861e9 P 1f007450922d46c1aaae5cc6be7a9452: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 12:22:16.790479 25365 tablet_bootstrap.cc:492] T 6afaae01b5b5406cac56ad99ce7f3482 P 1f007450922d46c1aaae5cc6be7a9452: Bootstrap starting.
I20260709 12:22:16.790620 25214 leader_election.cc:304] T 8f462d4481754e45a6a38564f7ffacf7 P 1f007450922d46c1aaae5cc6be7a9452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1f007450922d46c1aaae5cc6be7a9452; no voters: 67f2d785daf545deba69f6d4d4ea8251, 874f559253d64e01a7ce18b3b8f2164c
I20260709 12:22:16.789222 25367 raft_consensus.cc:740] T 8f462d4481754e45a6a38564f7ffacf7 P 67f2d785daf545deba69f6d4d4ea8251 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67f2d785daf545deba69f6d4d4ea8251, State: Initialized, Role: FOLLOWER
I20260709 12:22:16.791679 25386 raft_consensus.cc:2749] T 8f462d4481754e45a6a38564f7ffacf7 P 1f007450922d46c1aaae5cc6be7a9452 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:22:16.791802 25367 consensus_queue.cc:260] T 8f462d4481754e45a6a38564f7ffacf7 P 67f2d785daf545deba69f6d4d4ea8251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.793123 25175 raft_consensus.cc:3060] T 8f462d4481754e45a6a38564f7ffacf7 P 67f2d785daf545deba69f6d4d4ea8251 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:16.795473 25402 raft_consensus.cc:515] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.761691 25176 raft_consensus.cc:2468] T 0c686b019831496188c502a729a4db8a P 67f2d785daf545deba69f6d4d4ea8251 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f007450922d46c1aaae5cc6be7a9452 in term 1.
I20260709 12:22:16.802919 25175 raft_consensus.cc:2468] T 8f462d4481754e45a6a38564f7ffacf7 P 67f2d785daf545deba69f6d4d4ea8251 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 874f559253d64e01a7ce18b3b8f2164c in term 1.
I20260709 12:22:16.805369 25402 leader_election.cc:290] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c [CANDIDATE]: Term 1 election: Requested vote from peers 67f2d785daf545deba69f6d4d4ea8251 (127.23.245.129:41731), 1f007450922d46c1aaae5cc6be7a9452 (127.23.245.130:41957)
I20260709 12:22:16.803501 25176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0462f2e3489342489e622f469b237df2" candidate_uuid: "874f559253d64e01a7ce18b3b8f2164c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67f2d785daf545deba69f6d4d4ea8251"
W20260709 12:22:16.806955 25288 leader_election.cc:343] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 67f2d785daf545deba69f6d4d4ea8251 (127.23.245.129:41731): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:16.808342 25365 tablet_bootstrap.cc:654] T 6afaae01b5b5406cac56ad99ce7f3482 P 1f007450922d46c1aaae5cc6be7a9452: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:16.808403 25251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0462f2e3489342489e622f469b237df2" candidate_uuid: "874f559253d64e01a7ce18b3b8f2164c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f007450922d46c1aaae5cc6be7a9452"
I20260709 12:22:16.809284 25251 raft_consensus.cc:3060] T 0462f2e3489342489e622f469b237df2 P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:16.811884 25402 raft_consensus.cc:493] T a90bed0f71cb4741b9fa34669e5b7bc1 P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.812923 25402 raft_consensus.cc:515] T a90bed0f71cb4741b9fa34669e5b7bc1 P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.815450 25402 leader_election.cc:290] T a90bed0f71cb4741b9fa34669e5b7bc1 P 874f559253d64e01a7ce18b3b8f2164c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67f2d785daf545deba69f6d4d4ea8251 (127.23.245.129:41731), 1f007450922d46c1aaae5cc6be7a9452 (127.23.245.130:41957)
I20260709 12:22:16.816340 25176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a90bed0f71cb4741b9fa34669e5b7bc1" candidate_uuid: "874f559253d64e01a7ce18b3b8f2164c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67f2d785daf545deba69f6d4d4ea8251" is_pre_election: true
I20260709 12:22:16.817013 25250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a90bed0f71cb4741b9fa34669e5b7bc1" candidate_uuid: "874f559253d64e01a7ce18b3b8f2164c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f007450922d46c1aaae5cc6be7a9452" is_pre_election: true
I20260709 12:22:16.817785 25288 leader_election.cc:304] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 67f2d785daf545deba69f6d4d4ea8251, 874f559253d64e01a7ce18b3b8f2164c; no voters: 1f007450922d46c1aaae5cc6be7a9452
I20260709 12:22:16.811018 25070 catalog_manager.cc:5697] T 0c686b019831496188c502a729a4db8a P 1f007450922d46c1aaae5cc6be7a9452 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f007450922d46c1aaae5cc6be7a9452 (127.23.245.130). New cstate: current_term: 1 leader_uuid: "1f007450922d46c1aaae5cc6be7a9452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:16.820190 25176 raft_consensus.cc:2468] T a90bed0f71cb4741b9fa34669e5b7bc1 P 67f2d785daf545deba69f6d4d4ea8251 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 874f559253d64e01a7ce18b3b8f2164c in term 0.
I20260709 12:22:16.822772 25366 tablet_bootstrap.cc:492] T 09fa2961864c4c999f036a784f0da8cf P 874f559253d64e01a7ce18b3b8f2164c: No bootstrap required, opened a new log
I20260709 12:22:16.820190 25250 raft_consensus.cc:2468] T a90bed0f71cb4741b9fa34669e5b7bc1 P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 874f559253d64e01a7ce18b3b8f2164c in term 0.
I20260709 12:22:16.823247 25366 ts_tablet_manager.cc:1403] T 09fa2961864c4c999f036a784f0da8cf P 874f559253d64e01a7ce18b3b8f2164c: Time spent bootstrapping tablet: real 0.049s	user 0.016s	sys 0.016s
I20260709 12:22:16.822597 25288 leader_election.cc:304] T a90bed0f71cb4741b9fa34669e5b7bc1 P 874f559253d64e01a7ce18b3b8f2164c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67f2d785daf545deba69f6d4d4ea8251, 874f559253d64e01a7ce18b3b8f2164c; no voters: 
I20260709 12:22:16.827042 25367 ts_tablet_manager.cc:1434] T 8f462d4481754e45a6a38564f7ffacf7 P 67f2d785daf545deba69f6d4d4ea8251: Time spent starting tablet: real 0.062s	user 0.011s	sys 0.000s
I20260709 12:22:16.819510 25251 raft_consensus.cc:2468] T 0462f2e3489342489e622f469b237df2 P 1f007450922d46c1aaae5cc6be7a9452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 874f559253d64e01a7ce18b3b8f2164c in term 1.
I20260709 12:22:16.828823 25367 tablet_bootstrap.cc:492] T 0462f2e3489342489e622f469b237df2 P 67f2d785daf545deba69f6d4d4ea8251: Bootstrap starting.
I20260709 12:22:16.828819 25290 leader_election.cc:304] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f007450922d46c1aaae5cc6be7a9452, 874f559253d64e01a7ce18b3b8f2164c; no voters: 67f2d785daf545deba69f6d4d4ea8251
I20260709 12:22:16.831039 25366 raft_consensus.cc:359] T 09fa2961864c4c999f036a784f0da8cf P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.832639 25399 raft_consensus.cc:2804] T a90bed0f71cb4741b9fa34669e5b7bc1 P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:16.833058 25399 raft_consensus.cc:493] T a90bed0f71cb4741b9fa34669e5b7bc1 P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:16.833470 25399 raft_consensus.cc:3060] T a90bed0f71cb4741b9fa34669e5b7bc1 P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:16.834033 25365 tablet_bootstrap.cc:492] T 6afaae01b5b5406cac56ad99ce7f3482 P 1f007450922d46c1aaae5cc6be7a9452: No bootstrap required, opened a new log
I20260709 12:22:16.834501 25365 ts_tablet_manager.cc:1403] T 6afaae01b5b5406cac56ad99ce7f3482 P 1f007450922d46c1aaae5cc6be7a9452: Time spent bootstrapping tablet: real 0.044s	user 0.012s	sys 0.008s
I20260709 12:22:16.836647 25367 tablet_bootstrap.cc:654] T 0462f2e3489342489e622f469b237df2 P 67f2d785daf545deba69f6d4d4ea8251: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:16.837080 25365 raft_consensus.cc:359] T 6afaae01b5b5406cac56ad99ce7f3482 P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.837761 25365 raft_consensus.cc:385] T 6afaae01b5b5406cac56ad99ce7f3482 P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:16.838042 25365 raft_consensus.cc:740] T 6afaae01b5b5406cac56ad99ce7f3482 P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f007450922d46c1aaae5cc6be7a9452, State: Initialized, Role: FOLLOWER
I20260709 12:22:16.839495 25401 raft_consensus.cc:2804] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:16.840085 25401 raft_consensus.cc:697] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c [term 1 LEADER]: Becoming Leader. State: Replica: 874f559253d64e01a7ce18b3b8f2164c, State: Running, Role: LEADER
I20260709 12:22:16.838953 25365 consensus_queue.cc:260] T 6afaae01b5b5406cac56ad99ce7f3482 P 1f007450922d46c1aaae5cc6be7a9452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.841034 25401 consensus_queue.cc:237] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.831787 25366 raft_consensus.cc:385] T 09fa2961864c4c999f036a784f0da8cf P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:16.844135 25366 raft_consensus.cc:740] T 09fa2961864c4c999f036a784f0da8cf P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 874f559253d64e01a7ce18b3b8f2164c, State: Initialized, Role: FOLLOWER
I20260709 12:22:16.845006 25366 consensus_queue.cc:260] T 09fa2961864c4c999f036a784f0da8cf P 874f559253d64e01a7ce18b3b8f2164c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.845678 25365 ts_tablet_manager.cc:1434] T 6afaae01b5b5406cac56ad99ce7f3482 P 1f007450922d46c1aaae5cc6be7a9452: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:22:16.846719 25365 tablet_bootstrap.cc:492] T 09fa2961864c4c999f036a784f0da8cf P 1f007450922d46c1aaae5cc6be7a9452: Bootstrap starting.
I20260709 12:22:16.847692 25366 ts_tablet_manager.cc:1434] T 09fa2961864c4c999f036a784f0da8cf P 874f559253d64e01a7ce18b3b8f2164c: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.002s
I20260709 12:22:16.848623 25402 raft_consensus.cc:2804] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:16.849296 25402 raft_consensus.cc:697] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c [term 1 LEADER]: Becoming Leader. State: Replica: 874f559253d64e01a7ce18b3b8f2164c, State: Running, Role: LEADER
I20260709 12:22:16.850391 25402 consensus_queue.cc:237] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.841282 25399 raft_consensus.cc:515] T a90bed0f71cb4741b9fa34669e5b7bc1 P 874f559253d64e01a7ce18b3b8f2164c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.857339 25365 tablet_bootstrap.cc:654] T 09fa2961864c4c999f036a784f0da8cf P 1f007450922d46c1aaae5cc6be7a9452: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:16.858029 25176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a90bed0f71cb4741b9fa34669e5b7bc1" candidate_uuid: "874f559253d64e01a7ce18b3b8f2164c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67f2d785daf545deba69f6d4d4ea8251"
I20260709 12:22:16.858695 25176 raft_consensus.cc:3060] T a90bed0f71cb4741b9fa34669e5b7bc1 P 67f2d785daf545deba69f6d4d4ea8251 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:16.863772 25367 tablet_bootstrap.cc:492] T 0462f2e3489342489e622f469b237df2 P 67f2d785daf545deba69f6d4d4ea8251: No bootstrap required, opened a new log
I20260709 12:22:16.867007 25367 ts_tablet_manager.cc:1403] T 0462f2e3489342489e622f469b237df2 P 67f2d785daf545deba69f6d4d4ea8251: Time spent bootstrapping tablet: real 0.038s	user 0.016s	sys 0.002s
I20260709 12:22:16.867862 25365 tablet_bootstrap.cc:492] T 09fa2961864c4c999f036a784f0da8cf P 1f007450922d46c1aaae5cc6be7a9452: No bootstrap required, opened a new log
I20260709 12:22:16.868453 25365 ts_tablet_manager.cc:1403] T 09fa2961864c4c999f036a784f0da8cf P 1f007450922d46c1aaae5cc6be7a9452: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.002s
I20260709 12:22:16.870368 25367 raft_consensus.cc:359] T 0462f2e3489342489e622f469b237df2 P 67f2d785daf545deba69f6d4d4ea8251 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.871362 25367 raft_consensus.cc:385] T 0462f2e3489342489e622f469b237df2 P 67f2d785daf545deba69f6d4d4ea8251 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:16.871711 25367 raft_consensus.cc:740] T 0462f2e3489342489e622f469b237df2 P 67f2d785daf545deba69f6d4d4ea8251 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67f2d785daf545deba69f6d4d4ea8251, State: Initialized, Role: FOLLOWER
I20260709 12:22:16.871193 25070 catalog_manager.cc:5697] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c reported cstate change: term changed from 0 to 1, leader changed from <none> to 874f559253d64e01a7ce18b3b8f2164c (127.23.245.131). New cstate: current_term: 1 leader_uuid: "874f559253d64e01a7ce18b3b8f2164c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:16.872107 25365 raft_consensus.cc:359] T 09fa2961864c4c999f036a784f0da8cf P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.872854 25365 raft_consensus.cc:385] T 09fa2961864c4c999f036a784f0da8cf P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:16.872646 25367 consensus_queue.cc:260] T 0462f2e3489342489e622f469b237df2 P 67f2d785daf545deba69f6d4d4ea8251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.873214 25365 raft_consensus.cc:740] T 09fa2961864c4c999f036a784f0da8cf P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f007450922d46c1aaae5cc6be7a9452, State: Initialized, Role: FOLLOWER
I20260709 12:22:16.874145 25365 consensus_queue.cc:260] T 09fa2961864c4c999f036a784f0da8cf P 1f007450922d46c1aaae5cc6be7a9452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.875208 25367 ts_tablet_manager.cc:1434] T 0462f2e3489342489e622f469b237df2 P 67f2d785daf545deba69f6d4d4ea8251: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:22:16.876189 25399 leader_election.cc:290] T a90bed0f71cb4741b9fa34669e5b7bc1 P 874f559253d64e01a7ce18b3b8f2164c [CANDIDATE]: Term 1 election: Requested vote from peers 67f2d785daf545deba69f6d4d4ea8251 (127.23.245.129:41731), 1f007450922d46c1aaae5cc6be7a9452 (127.23.245.130:41957)
I20260709 12:22:16.876400 25365 ts_tablet_manager.cc:1434] T 09fa2961864c4c999f036a784f0da8cf P 1f007450922d46c1aaae5cc6be7a9452: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:22:16.862746 25251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a90bed0f71cb4741b9fa34669e5b7bc1" candidate_uuid: "874f559253d64e01a7ce18b3b8f2164c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f007450922d46c1aaae5cc6be7a9452"
I20260709 12:22:16.877300 25251 raft_consensus.cc:3060] T a90bed0f71cb4741b9fa34669e5b7bc1 P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:16.880590 25367 tablet_bootstrap.cc:492] T 09fa2961864c4c999f036a784f0da8cf P 67f2d785daf545deba69f6d4d4ea8251: Bootstrap starting.
I20260709 12:22:16.884853 25251 raft_consensus.cc:2468] T a90bed0f71cb4741b9fa34669e5b7bc1 P 1f007450922d46c1aaae5cc6be7a9452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 874f559253d64e01a7ce18b3b8f2164c in term 1.
I20260709 12:22:16.886358 25290 leader_election.cc:304] T a90bed0f71cb4741b9fa34669e5b7bc1 P 874f559253d64e01a7ce18b3b8f2164c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f007450922d46c1aaae5cc6be7a9452, 874f559253d64e01a7ce18b3b8f2164c; no voters: 
I20260709 12:22:16.887365 25367 tablet_bootstrap.cc:654] T 09fa2961864c4c999f036a784f0da8cf P 67f2d785daf545deba69f6d4d4ea8251: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:16.887542 25399 raft_consensus.cc:2804] T a90bed0f71cb4741b9fa34669e5b7bc1 P 874f559253d64e01a7ce18b3b8f2164c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:16.888196 25399 raft_consensus.cc:697] T a90bed0f71cb4741b9fa34669e5b7bc1 P 874f559253d64e01a7ce18b3b8f2164c [term 1 LEADER]: Becoming Leader. State: Replica: 874f559253d64e01a7ce18b3b8f2164c, State: Running, Role: LEADER
I20260709 12:22:16.890913 25176 raft_consensus.cc:2468] T a90bed0f71cb4741b9fa34669e5b7bc1 P 67f2d785daf545deba69f6d4d4ea8251 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 874f559253d64e01a7ce18b3b8f2164c in term 1.
I20260709 12:22:16.890189 25399 consensus_queue.cc:237] T a90bed0f71cb4741b9fa34669e5b7bc1 P 874f559253d64e01a7ce18b3b8f2164c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.900054 25367 tablet_bootstrap.cc:492] T 09fa2961864c4c999f036a784f0da8cf P 67f2d785daf545deba69f6d4d4ea8251: No bootstrap required, opened a new log
I20260709 12:22:16.900635 25367 ts_tablet_manager.cc:1403] T 09fa2961864c4c999f036a784f0da8cf P 67f2d785daf545deba69f6d4d4ea8251: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 12:22:16.903345 25367 raft_consensus.cc:359] T 09fa2961864c4c999f036a784f0da8cf P 67f2d785daf545deba69f6d4d4ea8251 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.904156 25367 raft_consensus.cc:385] T 09fa2961864c4c999f036a784f0da8cf P 67f2d785daf545deba69f6d4d4ea8251 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:16.904516 25367 raft_consensus.cc:740] T 09fa2961864c4c999f036a784f0da8cf P 67f2d785daf545deba69f6d4d4ea8251 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67f2d785daf545deba69f6d4d4ea8251, State: Initialized, Role: FOLLOWER
I20260709 12:22:16.905251 25367 consensus_queue.cc:260] T 09fa2961864c4c999f036a784f0da8cf P 67f2d785daf545deba69f6d4d4ea8251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.907501 25367 ts_tablet_manager.cc:1434] T 09fa2961864c4c999f036a784f0da8cf P 67f2d785daf545deba69f6d4d4ea8251: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 12:22:16.906486 25070 catalog_manager.cc:5697] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c reported cstate change: term changed from 0 to 1, leader changed from <none> to 874f559253d64e01a7ce18b3b8f2164c (127.23.245.131). New cstate: current_term: 1 leader_uuid: "874f559253d64e01a7ce18b3b8f2164c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:16.908478 25367 tablet_bootstrap.cc:492] T ae5ec568a7c04c03ab6df14b7fc861e9 P 67f2d785daf545deba69f6d4d4ea8251: Bootstrap starting.
I20260709 12:22:16.908748 25070 catalog_manager.cc:5697] T a90bed0f71cb4741b9fa34669e5b7bc1 P 874f559253d64e01a7ce18b3b8f2164c reported cstate change: term changed from 0 to 1, leader changed from <none> to 874f559253d64e01a7ce18b3b8f2164c (127.23.245.131). New cstate: current_term: 1 leader_uuid: "874f559253d64e01a7ce18b3b8f2164c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:16.914634 25367 tablet_bootstrap.cc:654] T ae5ec568a7c04c03ab6df14b7fc861e9 P 67f2d785daf545deba69f6d4d4ea8251: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:16.914660 25373 consensus_queue.cc:1048] T b7cc944e087640eab119454448129998 P 1f007450922d46c1aaae5cc6be7a9452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:16.920321 25367 tablet_bootstrap.cc:492] T ae5ec568a7c04c03ab6df14b7fc861e9 P 67f2d785daf545deba69f6d4d4ea8251: No bootstrap required, opened a new log
I20260709 12:22:16.920842 25367 ts_tablet_manager.cc:1403] T ae5ec568a7c04c03ab6df14b7fc861e9 P 67f2d785daf545deba69f6d4d4ea8251: Time spent bootstrapping tablet: real 0.013s	user 0.003s	sys 0.008s
I20260709 12:22:16.923875 25367 raft_consensus.cc:359] T ae5ec568a7c04c03ab6df14b7fc861e9 P 67f2d785daf545deba69f6d4d4ea8251 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.924691 25367 raft_consensus.cc:385] T ae5ec568a7c04c03ab6df14b7fc861e9 P 67f2d785daf545deba69f6d4d4ea8251 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:16.924968 25367 raft_consensus.cc:740] T ae5ec568a7c04c03ab6df14b7fc861e9 P 67f2d785daf545deba69f6d4d4ea8251 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67f2d785daf545deba69f6d4d4ea8251, State: Initialized, Role: FOLLOWER
I20260709 12:22:16.925850 25367 consensus_queue.cc:260] T ae5ec568a7c04c03ab6df14b7fc861e9 P 67f2d785daf545deba69f6d4d4ea8251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.928347 25367 ts_tablet_manager.cc:1434] T ae5ec568a7c04c03ab6df14b7fc861e9 P 67f2d785daf545deba69f6d4d4ea8251: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:22:16.929291 25367 tablet_bootstrap.cc:492] T 6afaae01b5b5406cac56ad99ce7f3482 P 67f2d785daf545deba69f6d4d4ea8251: Bootstrap starting.
I20260709 12:22:16.935097 25367 tablet_bootstrap.cc:654] T 6afaae01b5b5406cac56ad99ce7f3482 P 67f2d785daf545deba69f6d4d4ea8251: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:16.939559 25386 consensus_queue.cc:1048] T b7cc944e087640eab119454448129998 P 1f007450922d46c1aaae5cc6be7a9452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:16.941304 25394 raft_consensus.cc:493] T 09fa2961864c4c999f036a784f0da8cf P 67f2d785daf545deba69f6d4d4ea8251 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:16.941810 25394 raft_consensus.cc:515] T 09fa2961864c4c999f036a784f0da8cf P 67f2d785daf545deba69f6d4d4ea8251 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.944077 25394 leader_election.cc:290] T 09fa2961864c4c999f036a784f0da8cf P 67f2d785daf545deba69f6d4d4ea8251 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f007450922d46c1aaae5cc6be7a9452 (127.23.245.130:41957), 874f559253d64e01a7ce18b3b8f2164c (127.23.245.131:46459)
I20260709 12:22:16.945683 25325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09fa2961864c4c999f036a784f0da8cf" candidate_uuid: "67f2d785daf545deba69f6d4d4ea8251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "874f559253d64e01a7ce18b3b8f2164c" is_pre_election: true
I20260709 12:22:16.946339 25325 raft_consensus.cc:2468] T 09fa2961864c4c999f036a784f0da8cf P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67f2d785daf545deba69f6d4d4ea8251 in term 0.
I20260709 12:22:16.947382 25251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09fa2961864c4c999f036a784f0da8cf" candidate_uuid: "67f2d785daf545deba69f6d4d4ea8251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f007450922d46c1aaae5cc6be7a9452" is_pre_election: true
I20260709 12:22:16.948120 25251 raft_consensus.cc:2468] T 09fa2961864c4c999f036a784f0da8cf P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 67f2d785daf545deba69f6d4d4ea8251 in term 0.
I20260709 12:22:16.948993 25139 leader_election.cc:304] T 09fa2961864c4c999f036a784f0da8cf P 67f2d785daf545deba69f6d4d4ea8251 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67f2d785daf545deba69f6d4d4ea8251, 874f559253d64e01a7ce18b3b8f2164c; no voters: 
I20260709 12:22:16.950106 25394 raft_consensus.cc:2804] T 09fa2961864c4c999f036a784f0da8cf P 67f2d785daf545deba69f6d4d4ea8251 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:16.950479 25394 raft_consensus.cc:493] T 09fa2961864c4c999f036a784f0da8cf P 67f2d785daf545deba69f6d4d4ea8251 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:16.950834 25394 raft_consensus.cc:3060] T 09fa2961864c4c999f036a784f0da8cf P 67f2d785daf545deba69f6d4d4ea8251 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:16.958804 25394 raft_consensus.cc:515] T 09fa2961864c4c999f036a784f0da8cf P 67f2d785daf545deba69f6d4d4ea8251 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.961513 25394 leader_election.cc:290] T 09fa2961864c4c999f036a784f0da8cf P 67f2d785daf545deba69f6d4d4ea8251 [CANDIDATE]: Term 1 election: Requested vote from peers 1f007450922d46c1aaae5cc6be7a9452 (127.23.245.130:41957), 874f559253d64e01a7ce18b3b8f2164c (127.23.245.131:46459)
I20260709 12:22:16.962455 25324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09fa2961864c4c999f036a784f0da8cf" candidate_uuid: "67f2d785daf545deba69f6d4d4ea8251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "874f559253d64e01a7ce18b3b8f2164c"
I20260709 12:22:16.963057 25324 raft_consensus.cc:3060] T 09fa2961864c4c999f036a784f0da8cf P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:16.964395 25251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09fa2961864c4c999f036a784f0da8cf" candidate_uuid: "67f2d785daf545deba69f6d4d4ea8251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f007450922d46c1aaae5cc6be7a9452"
I20260709 12:22:16.965073 25251 raft_consensus.cc:3060] T 09fa2961864c4c999f036a784f0da8cf P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:16.959841 25367 tablet_bootstrap.cc:492] T 6afaae01b5b5406cac56ad99ce7f3482 P 67f2d785daf545deba69f6d4d4ea8251: No bootstrap required, opened a new log
I20260709 12:22:16.970551 25324 raft_consensus.cc:2468] T 09fa2961864c4c999f036a784f0da8cf P 874f559253d64e01a7ce18b3b8f2164c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67f2d785daf545deba69f6d4d4ea8251 in term 1.
I20260709 12:22:16.971843 25367 ts_tablet_manager.cc:1403] T 6afaae01b5b5406cac56ad99ce7f3482 P 67f2d785daf545deba69f6d4d4ea8251: Time spent bootstrapping tablet: real 0.043s	user 0.025s	sys 0.004s
I20260709 12:22:16.972729 25251 raft_consensus.cc:2468] T 09fa2961864c4c999f036a784f0da8cf P 1f007450922d46c1aaae5cc6be7a9452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67f2d785daf545deba69f6d4d4ea8251 in term 1.
I20260709 12:22:16.972677 25139 leader_election.cc:304] T 09fa2961864c4c999f036a784f0da8cf P 67f2d785daf545deba69f6d4d4ea8251 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67f2d785daf545deba69f6d4d4ea8251, 874f559253d64e01a7ce18b3b8f2164c; no voters: 
I20260709 12:22:16.973846 25394 raft_consensus.cc:2804] T 09fa2961864c4c999f036a784f0da8cf P 67f2d785daf545deba69f6d4d4ea8251 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:16.974359 25394 raft_consensus.cc:697] T 09fa2961864c4c999f036a784f0da8cf P 67f2d785daf545deba69f6d4d4ea8251 [term 1 LEADER]: Becoming Leader. State: Replica: 67f2d785daf545deba69f6d4d4ea8251, State: Running, Role: LEADER
I20260709 12:22:16.975129 25394 consensus_queue.cc:237] T 09fa2961864c4c999f036a784f0da8cf P 67f2d785daf545deba69f6d4d4ea8251 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.976254 25367 raft_consensus.cc:359] T 6afaae01b5b5406cac56ad99ce7f3482 P 67f2d785daf545deba69f6d4d4ea8251 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.977598 25367 raft_consensus.cc:385] T 6afaae01b5b5406cac56ad99ce7f3482 P 67f2d785daf545deba69f6d4d4ea8251 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:16.977875 25367 raft_consensus.cc:740] T 6afaae01b5b5406cac56ad99ce7f3482 P 67f2d785daf545deba69f6d4d4ea8251 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67f2d785daf545deba69f6d4d4ea8251, State: Initialized, Role: FOLLOWER
I20260709 12:22:16.978631 25367 consensus_queue.cc:260] T 6afaae01b5b5406cac56ad99ce7f3482 P 67f2d785daf545deba69f6d4d4ea8251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:16.980831 25367 ts_tablet_manager.cc:1434] T 6afaae01b5b5406cac56ad99ce7f3482 P 67f2d785daf545deba69f6d4d4ea8251: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:22:16.989663 25070 catalog_manager.cc:5697] T 09fa2961864c4c999f036a784f0da8cf P 67f2d785daf545deba69f6d4d4ea8251 reported cstate change: term changed from 0 to 1, leader changed from <none> to 67f2d785daf545deba69f6d4d4ea8251 (127.23.245.129). New cstate: current_term: 1 leader_uuid: "67f2d785daf545deba69f6d4d4ea8251" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:17.033209 25399 raft_consensus.cc:493] T ae5ec568a7c04c03ab6df14b7fc861e9 P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.033743 25399 raft_consensus.cc:515] T ae5ec568a7c04c03ab6df14b7fc861e9 P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:17.035506 25399 leader_election.cc:290] T ae5ec568a7c04c03ab6df14b7fc861e9 P 874f559253d64e01a7ce18b3b8f2164c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67f2d785daf545deba69f6d4d4ea8251 (127.23.245.129:41731), 1f007450922d46c1aaae5cc6be7a9452 (127.23.245.130:41957)
I20260709 12:22:17.036309 25176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae5ec568a7c04c03ab6df14b7fc861e9" candidate_uuid: "874f559253d64e01a7ce18b3b8f2164c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67f2d785daf545deba69f6d4d4ea8251" is_pre_election: true
I20260709 12:22:17.036471 25251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae5ec568a7c04c03ab6df14b7fc861e9" candidate_uuid: "874f559253d64e01a7ce18b3b8f2164c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f007450922d46c1aaae5cc6be7a9452" is_pre_election: true
I20260709 12:22:17.036847 25176 raft_consensus.cc:2468] T ae5ec568a7c04c03ab6df14b7fc861e9 P 67f2d785daf545deba69f6d4d4ea8251 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 874f559253d64e01a7ce18b3b8f2164c in term 0.
I20260709 12:22:17.037041 25251 raft_consensus.cc:2468] T ae5ec568a7c04c03ab6df14b7fc861e9 P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 874f559253d64e01a7ce18b3b8f2164c in term 0.
I20260709 12:22:17.037819 25288 leader_election.cc:304] T ae5ec568a7c04c03ab6df14b7fc861e9 P 874f559253d64e01a7ce18b3b8f2164c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67f2d785daf545deba69f6d4d4ea8251, 874f559253d64e01a7ce18b3b8f2164c; no voters: 
I20260709 12:22:17.038579 25399 raft_consensus.cc:2804] T ae5ec568a7c04c03ab6df14b7fc861e9 P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:17.038832 25399 raft_consensus.cc:493] T ae5ec568a7c04c03ab6df14b7fc861e9 P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:17.039052 25399 raft_consensus.cc:3060] T ae5ec568a7c04c03ab6df14b7fc861e9 P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:17.043843 25399 raft_consensus.cc:515] T ae5ec568a7c04c03ab6df14b7fc861e9 P 874f559253d64e01a7ce18b3b8f2164c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:17.045303 25399 leader_election.cc:290] T ae5ec568a7c04c03ab6df14b7fc861e9 P 874f559253d64e01a7ce18b3b8f2164c [CANDIDATE]: Term 1 election: Requested vote from peers 67f2d785daf545deba69f6d4d4ea8251 (127.23.245.129:41731), 1f007450922d46c1aaae5cc6be7a9452 (127.23.245.130:41957)
I20260709 12:22:17.046149 25176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae5ec568a7c04c03ab6df14b7fc861e9" candidate_uuid: "874f559253d64e01a7ce18b3b8f2164c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67f2d785daf545deba69f6d4d4ea8251"
I20260709 12:22:17.046345 25251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae5ec568a7c04c03ab6df14b7fc861e9" candidate_uuid: "874f559253d64e01a7ce18b3b8f2164c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f007450922d46c1aaae5cc6be7a9452"
I20260709 12:22:17.046670 25176 raft_consensus.cc:3060] T ae5ec568a7c04c03ab6df14b7fc861e9 P 67f2d785daf545deba69f6d4d4ea8251 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:17.046926 25251 raft_consensus.cc:3060] T ae5ec568a7c04c03ab6df14b7fc861e9 P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:17.051126 25251 raft_consensus.cc:2468] T ae5ec568a7c04c03ab6df14b7fc861e9 P 1f007450922d46c1aaae5cc6be7a9452 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 874f559253d64e01a7ce18b3b8f2164c in term 1.
I20260709 12:22:17.051137 25176 raft_consensus.cc:2468] T ae5ec568a7c04c03ab6df14b7fc861e9 P 67f2d785daf545deba69f6d4d4ea8251 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 874f559253d64e01a7ce18b3b8f2164c in term 1.
I20260709 12:22:17.052246 25290 leader_election.cc:304] T ae5ec568a7c04c03ab6df14b7fc861e9 P 874f559253d64e01a7ce18b3b8f2164c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f007450922d46c1aaae5cc6be7a9452, 874f559253d64e01a7ce18b3b8f2164c; no voters: 
I20260709 12:22:17.052906 25399 raft_consensus.cc:2804] T ae5ec568a7c04c03ab6df14b7fc861e9 P 874f559253d64e01a7ce18b3b8f2164c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:17.053429 25399 raft_consensus.cc:697] T ae5ec568a7c04c03ab6df14b7fc861e9 P 874f559253d64e01a7ce18b3b8f2164c [term 1 LEADER]: Becoming Leader. State: Replica: 874f559253d64e01a7ce18b3b8f2164c, State: Running, Role: LEADER
I20260709 12:22:17.054152 25399 consensus_queue.cc:237] T ae5ec568a7c04c03ab6df14b7fc861e9 P 874f559253d64e01a7ce18b3b8f2164c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:17.062027 25070 catalog_manager.cc:5697] T ae5ec568a7c04c03ab6df14b7fc861e9 P 874f559253d64e01a7ce18b3b8f2164c reported cstate change: term changed from 0 to 1, leader changed from <none> to 874f559253d64e01a7ce18b3b8f2164c (127.23.245.131). New cstate: current_term: 1 leader_uuid: "874f559253d64e01a7ce18b3b8f2164c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:17.123023 25386 raft_consensus.cc:493] T 6afaae01b5b5406cac56ad99ce7f3482 P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.123588 25386 raft_consensus.cc:515] T 6afaae01b5b5406cac56ad99ce7f3482 P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:17.125379 25386 leader_election.cc:290] T 6afaae01b5b5406cac56ad99ce7f3482 P 1f007450922d46c1aaae5cc6be7a9452 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67f2d785daf545deba69f6d4d4ea8251 (127.23.245.129:41731), 874f559253d64e01a7ce18b3b8f2164c (127.23.245.131:46459)
I20260709 12:22:17.126343 25176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afaae01b5b5406cac56ad99ce7f3482" candidate_uuid: "1f007450922d46c1aaae5cc6be7a9452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67f2d785daf545deba69f6d4d4ea8251" is_pre_election: true
I20260709 12:22:17.126624 25324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afaae01b5b5406cac56ad99ce7f3482" candidate_uuid: "1f007450922d46c1aaae5cc6be7a9452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "874f559253d64e01a7ce18b3b8f2164c" is_pre_election: true
I20260709 12:22:17.127256 25176 raft_consensus.cc:2468] T 6afaae01b5b5406cac56ad99ce7f3482 P 67f2d785daf545deba69f6d4d4ea8251 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f007450922d46c1aaae5cc6be7a9452 in term 0.
I20260709 12:22:17.127301 25324 raft_consensus.cc:2468] T 6afaae01b5b5406cac56ad99ce7f3482 P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f007450922d46c1aaae5cc6be7a9452 in term 0.
I20260709 12:22:17.128517 25214 leader_election.cc:304] T 6afaae01b5b5406cac56ad99ce7f3482 P 1f007450922d46c1aaae5cc6be7a9452 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f007450922d46c1aaae5cc6be7a9452, 67f2d785daf545deba69f6d4d4ea8251; no voters: 
I20260709 12:22:17.129221 25386 raft_consensus.cc:2804] T 6afaae01b5b5406cac56ad99ce7f3482 P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:17.129566 25386 raft_consensus.cc:493] T 6afaae01b5b5406cac56ad99ce7f3482 P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:17.129865 25386 raft_consensus.cc:3060] T 6afaae01b5b5406cac56ad99ce7f3482 P 1f007450922d46c1aaae5cc6be7a9452 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:17.134593 25386 raft_consensus.cc:515] T 6afaae01b5b5406cac56ad99ce7f3482 P 1f007450922d46c1aaae5cc6be7a9452 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:17.136281 25386 leader_election.cc:290] T 6afaae01b5b5406cac56ad99ce7f3482 P 1f007450922d46c1aaae5cc6be7a9452 [CANDIDATE]: Term 1 election: Requested vote from peers 67f2d785daf545deba69f6d4d4ea8251 (127.23.245.129:41731), 874f559253d64e01a7ce18b3b8f2164c (127.23.245.131:46459)
I20260709 12:22:17.137147 25176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afaae01b5b5406cac56ad99ce7f3482" candidate_uuid: "1f007450922d46c1aaae5cc6be7a9452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67f2d785daf545deba69f6d4d4ea8251"
I20260709 12:22:17.137363 25324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afaae01b5b5406cac56ad99ce7f3482" candidate_uuid: "1f007450922d46c1aaae5cc6be7a9452" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "874f559253d64e01a7ce18b3b8f2164c"
I20260709 12:22:17.137686 25176 raft_consensus.cc:3060] T 6afaae01b5b5406cac56ad99ce7f3482 P 67f2d785daf545deba69f6d4d4ea8251 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:17.138041 25324 raft_consensus.cc:3060] T 6afaae01b5b5406cac56ad99ce7f3482 P 874f559253d64e01a7ce18b3b8f2164c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:17.142540 25324 raft_consensus.cc:2468] T 6afaae01b5b5406cac56ad99ce7f3482 P 874f559253d64e01a7ce18b3b8f2164c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f007450922d46c1aaae5cc6be7a9452 in term 1.
I20260709 12:22:17.142620 25176 raft_consensus.cc:2468] T 6afaae01b5b5406cac56ad99ce7f3482 P 67f2d785daf545deba69f6d4d4ea8251 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f007450922d46c1aaae5cc6be7a9452 in term 1.
I20260709 12:22:17.143544 25214 leader_election.cc:304] T 6afaae01b5b5406cac56ad99ce7f3482 P 1f007450922d46c1aaae5cc6be7a9452 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f007450922d46c1aaae5cc6be7a9452, 874f559253d64e01a7ce18b3b8f2164c; no voters: 
I20260709 12:22:17.144268 25386 raft_consensus.cc:2804] T 6afaae01b5b5406cac56ad99ce7f3482 P 1f007450922d46c1aaae5cc6be7a9452 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:17.144721 25386 raft_consensus.cc:697] T 6afaae01b5b5406cac56ad99ce7f3482 P 1f007450922d46c1aaae5cc6be7a9452 [term 1 LEADER]: Becoming Leader. State: Replica: 1f007450922d46c1aaae5cc6be7a9452, State: Running, Role: LEADER
I20260709 12:22:17.145581 25386 consensus_queue.cc:237] T 6afaae01b5b5406cac56ad99ce7f3482 P 1f007450922d46c1aaae5cc6be7a9452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:17.152340 25070 catalog_manager.cc:5697] T 6afaae01b5b5406cac56ad99ce7f3482 P 1f007450922d46c1aaae5cc6be7a9452 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f007450922d46c1aaae5cc6be7a9452 (127.23.245.130). New cstate: current_term: 1 leader_uuid: "1f007450922d46c1aaae5cc6be7a9452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:17.163345 25399 consensus_queue.cc:1048] T 39cf9b9227204dd497e8ef50f1beb2bc P 874f559253d64e01a7ce18b3b8f2164c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:17.169174 25394 consensus_queue.cc:1048] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 67f2d785daf545deba69f6d4d4ea8251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:17.176218 25401 consensus_queue.cc:1048] T 39cf9b9227204dd497e8ef50f1beb2bc P 874f559253d64e01a7ce18b3b8f2164c [LEADER]: Connected to new peer: Peer: permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:17.188125 25372 consensus_queue.cc:1048] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 67f2d785daf545deba69f6d4d4ea8251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:17.238116 25372 raft_consensus.cc:493] T 0462f2e3489342489e622f469b237df2 P 67f2d785daf545deba69f6d4d4ea8251 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:17.238631 25372 raft_consensus.cc:515] T 0462f2e3489342489e622f469b237df2 P 67f2d785daf545deba69f6d4d4ea8251 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:17.240656 25401 consensus_queue.cc:1048] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:17.240911 25372 leader_election.cc:290] T 0462f2e3489342489e622f469b237df2 P 67f2d785daf545deba69f6d4d4ea8251 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f007450922d46c1aaae5cc6be7a9452 (127.23.245.130:41957), 874f559253d64e01a7ce18b3b8f2164c (127.23.245.131:46459)
I20260709 12:22:17.241592 25251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0462f2e3489342489e622f469b237df2" candidate_uuid: "67f2d785daf545deba69f6d4d4ea8251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f007450922d46c1aaae5cc6be7a9452" is_pre_election: true
I20260709 12:22:17.241997 25324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0462f2e3489342489e622f469b237df2" candidate_uuid: "67f2d785daf545deba69f6d4d4ea8251" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "874f559253d64e01a7ce18b3b8f2164c" is_pre_election: true
I20260709 12:22:17.242304 25251 raft_consensus.cc:2393] T 0462f2e3489342489e622f469b237df2 P 1f007450922d46c1aaae5cc6be7a9452 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 67f2d785daf545deba69f6d4d4ea8251 in current term 1: Already voted for candidate 874f559253d64e01a7ce18b3b8f2164c in this term.
I20260709 12:22:17.243507 25141 leader_election.cc:304] T 0462f2e3489342489e622f469b237df2 P 67f2d785daf545deba69f6d4d4ea8251 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 67f2d785daf545deba69f6d4d4ea8251; no voters: 1f007450922d46c1aaae5cc6be7a9452, 874f559253d64e01a7ce18b3b8f2164c
I20260709 12:22:17.244295 25372 raft_consensus.cc:3060] T 0462f2e3489342489e622f469b237df2 P 67f2d785daf545deba69f6d4d4ea8251 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:17.254964 25372 raft_consensus.cc:2749] T 0462f2e3489342489e622f469b237df2 P 67f2d785daf545deba69f6d4d4ea8251 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:17.256235 25371 consensus_queue.cc:1048] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c [LEADER]: Connected to new peer: Peer: permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:17.264782 25386 consensus_queue.cc:1048] T 0c686b019831496188c502a729a4db8a P 1f007450922d46c1aaae5cc6be7a9452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:17.282308 25382 consensus_queue.cc:1048] T 0c686b019831496188c502a729a4db8a P 1f007450922d46c1aaae5cc6be7a9452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:17.343595 25399 consensus_queue.cc:1048] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c [LEADER]: Connected to new peer: Peer: permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:17.352263 25371 consensus_queue.cc:1048] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:17.362670 25324 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "39cf9b9227204dd497e8ef50f1beb2bc"
dest_uuid: "874f559253d64e01a7ce18b3b8f2164c"
mode: GRACEFUL
new_leader_uuid: "67f2d785daf545deba69f6d4d4ea8251"
 from {username='slave'} at 127.0.0.1:57894
I20260709 12:22:17.363423 25324 raft_consensus.cc:606] T 39cf9b9227204dd497e8ef50f1beb2bc P 874f559253d64e01a7ce18b3b8f2164c [term 1 LEADER]: Received request to transfer leadership to TS 67f2d785daf545deba69f6d4d4ea8251
I20260709 12:22:17.369128 25324 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f462d4481754e45a6a38564f7ffacf7"
dest_uuid: "874f559253d64e01a7ce18b3b8f2164c"
mode: GRACEFUL
new_leader_uuid: "67f2d785daf545deba69f6d4d4ea8251"
 from {username='slave'} at 127.0.0.1:57894
I20260709 12:22:17.369632 25324 raft_consensus.cc:606] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c [term 1 LEADER]: Received request to transfer leadership to TS 67f2d785daf545deba69f6d4d4ea8251
I20260709 12:22:17.376600 25401 consensus_queue.cc:1048] T a90bed0f71cb4741b9fa34669e5b7bc1 P 874f559253d64e01a7ce18b3b8f2164c [LEADER]: Connected to new peer: Peer: permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:17.389215 25251 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0c686b019831496188c502a729a4db8a"
dest_uuid: "1f007450922d46c1aaae5cc6be7a9452"
mode: GRACEFUL
new_leader_uuid: "67f2d785daf545deba69f6d4d4ea8251"
 from {username='slave'} at 127.0.0.1:41630
I20260709 12:22:17.389724 25251 raft_consensus.cc:606] T 0c686b019831496188c502a729a4db8a P 1f007450922d46c1aaae5cc6be7a9452 [term 1 LEADER]: Received request to transfer leadership to TS 67f2d785daf545deba69f6d4d4ea8251
I20260709 12:22:17.391851 25401 consensus_queue.cc:1048] T a90bed0f71cb4741b9fa34669e5b7bc1 P 874f559253d64e01a7ce18b3b8f2164c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:17.395336 25324 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0462f2e3489342489e622f469b237df2"
dest_uuid: "874f559253d64e01a7ce18b3b8f2164c"
mode: GRACEFUL
new_leader_uuid: "67f2d785daf545deba69f6d4d4ea8251"
 from {username='slave'} at 127.0.0.1:57894
I20260709 12:22:17.395934 25324 raft_consensus.cc:606] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c [term 1 LEADER]: Received request to transfer leadership to TS 67f2d785daf545deba69f6d4d4ea8251
I20260709 12:22:17.408273 25324 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a90bed0f71cb4741b9fa34669e5b7bc1"
dest_uuid: "874f559253d64e01a7ce18b3b8f2164c"
mode: GRACEFUL
new_leader_uuid: "1f007450922d46c1aaae5cc6be7a9452"
 from {username='slave'} at 127.0.0.1:57894
I20260709 12:22:17.408820 25324 raft_consensus.cc:606] T a90bed0f71cb4741b9fa34669e5b7bc1 P 874f559253d64e01a7ce18b3b8f2164c [term 1 LEADER]: Received request to transfer leadership to TS 1f007450922d46c1aaae5cc6be7a9452
I20260709 12:22:17.413856 25324 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae5ec568a7c04c03ab6df14b7fc861e9"
dest_uuid: "874f559253d64e01a7ce18b3b8f2164c"
mode: GRACEFUL
new_leader_uuid: "1f007450922d46c1aaae5cc6be7a9452"
 from {username='slave'} at 127.0.0.1:57894
I20260709 12:22:17.414337 25324 raft_consensus.cc:606] T ae5ec568a7c04c03ab6df14b7fc861e9 P 874f559253d64e01a7ce18b3b8f2164c [term 1 LEADER]: Received request to transfer leadership to TS 1f007450922d46c1aaae5cc6be7a9452
I20260709 12:22:17.422880 25372 consensus_queue.cc:1048] T 09fa2961864c4c999f036a784f0da8cf P 67f2d785daf545deba69f6d4d4ea8251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:17.428586 25176 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09fa2961864c4c999f036a784f0da8cf"
dest_uuid: "67f2d785daf545deba69f6d4d4ea8251"
mode: GRACEFUL
new_leader_uuid: "1f007450922d46c1aaae5cc6be7a9452"
 from {username='slave'} at 127.0.0.1:41488
I20260709 12:22:17.429222 25176 raft_consensus.cc:606] T 09fa2961864c4c999f036a784f0da8cf P 67f2d785daf545deba69f6d4d4ea8251 [term 1 LEADER]: Received request to transfer leadership to TS 1f007450922d46c1aaae5cc6be7a9452
I20260709 12:22:17.430153 25394 raft_consensus.cc:993] T 09fa2961864c4c999f036a784f0da8cf P 67f2d785daf545deba69f6d4d4ea8251: : Instructing follower 1f007450922d46c1aaae5cc6be7a9452 to start an election
I20260709 12:22:17.430552 25394 raft_consensus.cc:1081] T 09fa2961864c4c999f036a784f0da8cf P 67f2d785daf545deba69f6d4d4ea8251 [term 1 LEADER]: Signalling peer 1f007450922d46c1aaae5cc6be7a9452 to start an election
I20260709 12:22:17.433773 25251 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "09fa2961864c4c999f036a784f0da8cf"
dest_uuid: "1f007450922d46c1aaae5cc6be7a9452"
 from {username='slave'} at 127.0.0.1:41620
I20260709 12:22:17.434384 25251 raft_consensus.cc:493] T 09fa2961864c4c999f036a784f0da8cf P 1f007450922d46c1aaae5cc6be7a9452 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:17.434744 25251 raft_consensus.cc:3060] T 09fa2961864c4c999f036a784f0da8cf P 1f007450922d46c1aaae5cc6be7a9452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:17.434744 25372 consensus_queue.cc:1048] T 09fa2961864c4c999f036a784f0da8cf P 67f2d785daf545deba69f6d4d4ea8251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:17.437305 25249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6afaae01b5b5406cac56ad99ce7f3482"
dest_uuid: "1f007450922d46c1aaae5cc6be7a9452"
mode: GRACEFUL
new_leader_uuid: "874f559253d64e01a7ce18b3b8f2164c"
 from {username='slave'} at 127.0.0.1:41630
I20260709 12:22:17.437829 25249 raft_consensus.cc:606] T 6afaae01b5b5406cac56ad99ce7f3482 P 1f007450922d46c1aaae5cc6be7a9452 [term 1 LEADER]: Received request to transfer leadership to TS 874f559253d64e01a7ce18b3b8f2164c
I20260709 12:22:17.442250 25251 raft_consensus.cc:515] T 09fa2961864c4c999f036a784f0da8cf P 1f007450922d46c1aaae5cc6be7a9452 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:17.443318 25250 raft_consensus.cc:1240] T 09fa2961864c4c999f036a784f0da8cf P 1f007450922d46c1aaae5cc6be7a9452 [term 2 FOLLOWER]: Rejecting Update request from peer 67f2d785daf545deba69f6d4d4ea8251 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:17.445151 25251 leader_election.cc:290] T 09fa2961864c4c999f036a784f0da8cf P 1f007450922d46c1aaae5cc6be7a9452 [CANDIDATE]: Term 2 election: Requested vote from peers 67f2d785daf545deba69f6d4d4ea8251 (127.23.245.129:41731), 874f559253d64e01a7ce18b3b8f2164c (127.23.245.131:46459)
I20260709 12:22:17.445047 25176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09fa2961864c4c999f036a784f0da8cf" candidate_uuid: "1f007450922d46c1aaae5cc6be7a9452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "67f2d785daf545deba69f6d4d4ea8251"
I20260709 12:22:17.445775 25176 raft_consensus.cc:3055] T 09fa2961864c4c999f036a784f0da8cf P 67f2d785daf545deba69f6d4d4ea8251 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:17.446142 25176 raft_consensus.cc:740] T 09fa2961864c4c999f036a784f0da8cf P 67f2d785daf545deba69f6d4d4ea8251 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 67f2d785daf545deba69f6d4d4ea8251, State: Running, Role: LEADER
I20260709 12:22:17.446261 25324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09fa2961864c4c999f036a784f0da8cf" candidate_uuid: "1f007450922d46c1aaae5cc6be7a9452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "874f559253d64e01a7ce18b3b8f2164c"
I20260709 12:22:17.446796 25324 raft_consensus.cc:3060] T 09fa2961864c4c999f036a784f0da8cf P 874f559253d64e01a7ce18b3b8f2164c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:17.446960 25176 consensus_queue.cc:260] T 09fa2961864c4c999f036a784f0da8cf P 67f2d785daf545deba69f6d4d4ea8251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:17.448174 25176 raft_consensus.cc:3060] T 09fa2961864c4c999f036a784f0da8cf P 67f2d785daf545deba69f6d4d4ea8251 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:17.453487 25324 raft_consensus.cc:2468] T 09fa2961864c4c999f036a784f0da8cf P 874f559253d64e01a7ce18b3b8f2164c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f007450922d46c1aaae5cc6be7a9452 in term 2.
I20260709 12:22:17.454568 25176 raft_consensus.cc:2468] T 09fa2961864c4c999f036a784f0da8cf P 67f2d785daf545deba69f6d4d4ea8251 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f007450922d46c1aaae5cc6be7a9452 in term 2.
I20260709 12:22:17.454802 25214 leader_election.cc:304] T 09fa2961864c4c999f036a784f0da8cf P 1f007450922d46c1aaae5cc6be7a9452 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f007450922d46c1aaae5cc6be7a9452, 874f559253d64e01a7ce18b3b8f2164c; no voters: 
I20260709 12:22:17.455699 25382 raft_consensus.cc:2804] T 09fa2961864c4c999f036a784f0da8cf P 1f007450922d46c1aaae5cc6be7a9452 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:17.456276 25382 raft_consensus.cc:697] T 09fa2961864c4c999f036a784f0da8cf P 1f007450922d46c1aaae5cc6be7a9452 [term 2 LEADER]: Becoming Leader. State: Replica: 1f007450922d46c1aaae5cc6be7a9452, State: Running, Role: LEADER
I20260709 12:22:17.457075 25382 consensus_queue.cc:237] T 09fa2961864c4c999f036a784f0da8cf P 1f007450922d46c1aaae5cc6be7a9452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:17.463783 25071 catalog_manager.cc:5697] T 09fa2961864c4c999f036a784f0da8cf P 1f007450922d46c1aaae5cc6be7a9452 reported cstate change: term changed from 1 to 2, leader changed from 67f2d785daf545deba69f6d4d4ea8251 (127.23.245.129) to 1f007450922d46c1aaae5cc6be7a9452 (127.23.245.130). New cstate: current_term: 2 leader_uuid: "1f007450922d46c1aaae5cc6be7a9452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:17.567207 25401 consensus_queue.cc:1048] T ae5ec568a7c04c03ab6df14b7fc861e9 P 874f559253d64e01a7ce18b3b8f2164c [LEADER]: Connected to new peer: Peer: permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:17.579133 25433 consensus_queue.cc:1048] T ae5ec568a7c04c03ab6df14b7fc861e9 P 874f559253d64e01a7ce18b3b8f2164c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:17.587179 25433 raft_consensus.cc:993] T ae5ec568a7c04c03ab6df14b7fc861e9 P 874f559253d64e01a7ce18b3b8f2164c: : Instructing follower 1f007450922d46c1aaae5cc6be7a9452 to start an election
I20260709 12:22:17.587659 25399 raft_consensus.cc:1081] T ae5ec568a7c04c03ab6df14b7fc861e9 P 874f559253d64e01a7ce18b3b8f2164c [term 1 LEADER]: Signalling peer 1f007450922d46c1aaae5cc6be7a9452 to start an election
I20260709 12:22:17.589356 25251 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ae5ec568a7c04c03ab6df14b7fc861e9"
dest_uuid: "1f007450922d46c1aaae5cc6be7a9452"
 from {username='slave'} at 127.0.0.1:41618
I20260709 12:22:17.589862 25251 raft_consensus.cc:493] T ae5ec568a7c04c03ab6df14b7fc861e9 P 1f007450922d46c1aaae5cc6be7a9452 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:17.590183 25251 raft_consensus.cc:3060] T ae5ec568a7c04c03ab6df14b7fc861e9 P 1f007450922d46c1aaae5cc6be7a9452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:17.595180 25251 raft_consensus.cc:515] T ae5ec568a7c04c03ab6df14b7fc861e9 P 1f007450922d46c1aaae5cc6be7a9452 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:17.597865 25176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae5ec568a7c04c03ab6df14b7fc861e9" candidate_uuid: "1f007450922d46c1aaae5cc6be7a9452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "67f2d785daf545deba69f6d4d4ea8251"
I20260709 12:22:17.597110 25251 leader_election.cc:290] T ae5ec568a7c04c03ab6df14b7fc861e9 P 1f007450922d46c1aaae5cc6be7a9452 [CANDIDATE]: Term 2 election: Requested vote from peers 67f2d785daf545deba69f6d4d4ea8251 (127.23.245.129:41731), 874f559253d64e01a7ce18b3b8f2164c (127.23.245.131:46459)
I20260709 12:22:17.598117 25324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae5ec568a7c04c03ab6df14b7fc861e9" candidate_uuid: "1f007450922d46c1aaae5cc6be7a9452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "874f559253d64e01a7ce18b3b8f2164c"
I20260709 12:22:17.598613 25176 raft_consensus.cc:3060] T ae5ec568a7c04c03ab6df14b7fc861e9 P 67f2d785daf545deba69f6d4d4ea8251 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:17.598706 25324 raft_consensus.cc:3055] T ae5ec568a7c04c03ab6df14b7fc861e9 P 874f559253d64e01a7ce18b3b8f2164c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:17.599128 25324 raft_consensus.cc:740] T ae5ec568a7c04c03ab6df14b7fc861e9 P 874f559253d64e01a7ce18b3b8f2164c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 874f559253d64e01a7ce18b3b8f2164c, State: Running, Role: LEADER
I20260709 12:22:17.600062 25324 consensus_queue.cc:260] T ae5ec568a7c04c03ab6df14b7fc861e9 P 874f559253d64e01a7ce18b3b8f2164c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:17.601375 25324 raft_consensus.cc:3060] T ae5ec568a7c04c03ab6df14b7fc861e9 P 874f559253d64e01a7ce18b3b8f2164c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:17.606276 25176 raft_consensus.cc:2468] T ae5ec568a7c04c03ab6df14b7fc861e9 P 67f2d785daf545deba69f6d4d4ea8251 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f007450922d46c1aaae5cc6be7a9452 in term 2.
I20260709 12:22:17.607602 25214 leader_election.cc:304] T ae5ec568a7c04c03ab6df14b7fc861e9 P 1f007450922d46c1aaae5cc6be7a9452 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f007450922d46c1aaae5cc6be7a9452, 67f2d785daf545deba69f6d4d4ea8251; no voters: 
I20260709 12:22:17.608330 25382 raft_consensus.cc:2804] T ae5ec568a7c04c03ab6df14b7fc861e9 P 1f007450922d46c1aaae5cc6be7a9452 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:17.608511 25324 raft_consensus.cc:2468] T ae5ec568a7c04c03ab6df14b7fc861e9 P 874f559253d64e01a7ce18b3b8f2164c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f007450922d46c1aaae5cc6be7a9452 in term 2.
I20260709 12:22:17.608748 25382 raft_consensus.cc:697] T ae5ec568a7c04c03ab6df14b7fc861e9 P 1f007450922d46c1aaae5cc6be7a9452 [term 2 LEADER]: Becoming Leader. State: Replica: 1f007450922d46c1aaae5cc6be7a9452, State: Running, Role: LEADER
I20260709 12:22:17.609714 25382 consensus_queue.cc:237] T ae5ec568a7c04c03ab6df14b7fc861e9 P 1f007450922d46c1aaae5cc6be7a9452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:17.615370 25070 catalog_manager.cc:5697] T ae5ec568a7c04c03ab6df14b7fc861e9 P 1f007450922d46c1aaae5cc6be7a9452 reported cstate change: term changed from 1 to 2, leader changed from 874f559253d64e01a7ce18b3b8f2164c (127.23.245.131) to 1f007450922d46c1aaae5cc6be7a9452 (127.23.245.130). New cstate: current_term: 2 leader_uuid: "1f007450922d46c1aaae5cc6be7a9452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:17.627789 25382 consensus_queue.cc:1048] T 6afaae01b5b5406cac56ad99ce7f3482 P 1f007450922d46c1aaae5cc6be7a9452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:17.635560 25386 raft_consensus.cc:993] T 6afaae01b5b5406cac56ad99ce7f3482 P 1f007450922d46c1aaae5cc6be7a9452: : Instructing follower 874f559253d64e01a7ce18b3b8f2164c to start an election
I20260709 12:22:17.636027 25386 raft_consensus.cc:1081] T 6afaae01b5b5406cac56ad99ce7f3482 P 1f007450922d46c1aaae5cc6be7a9452 [term 1 LEADER]: Signalling peer 874f559253d64e01a7ce18b3b8f2164c to start an election
I20260709 12:22:17.639446 25325 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6afaae01b5b5406cac56ad99ce7f3482"
dest_uuid: "874f559253d64e01a7ce18b3b8f2164c"
 from {username='slave'} at 127.0.0.1:57872
I20260709 12:22:17.640825 25325 raft_consensus.cc:493] T 6afaae01b5b5406cac56ad99ce7f3482 P 874f559253d64e01a7ce18b3b8f2164c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:17.641215 25325 raft_consensus.cc:3060] T 6afaae01b5b5406cac56ad99ce7f3482 P 874f559253d64e01a7ce18b3b8f2164c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:17.646238 25325 raft_consensus.cc:515] T 6afaae01b5b5406cac56ad99ce7f3482 P 874f559253d64e01a7ce18b3b8f2164c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:17.646512 25373 consensus_queue.cc:1048] T 6afaae01b5b5406cac56ad99ce7f3482 P 1f007450922d46c1aaae5cc6be7a9452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:17.650272 25175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afaae01b5b5406cac56ad99ce7f3482" candidate_uuid: "874f559253d64e01a7ce18b3b8f2164c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "67f2d785daf545deba69f6d4d4ea8251"
I20260709 12:22:17.650609 25251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6afaae01b5b5406cac56ad99ce7f3482" candidate_uuid: "874f559253d64e01a7ce18b3b8f2164c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f007450922d46c1aaae5cc6be7a9452"
I20260709 12:22:17.651284 25251 raft_consensus.cc:3055] T 6afaae01b5b5406cac56ad99ce7f3482 P 1f007450922d46c1aaae5cc6be7a9452 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:17.651655 25251 raft_consensus.cc:740] T 6afaae01b5b5406cac56ad99ce7f3482 P 1f007450922d46c1aaae5cc6be7a9452 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f007450922d46c1aaae5cc6be7a9452, State: Running, Role: LEADER
I20260709 12:22:17.652606 25251 consensus_queue.cc:260] T 6afaae01b5b5406cac56ad99ce7f3482 P 1f007450922d46c1aaae5cc6be7a9452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:17.653848 25251 raft_consensus.cc:3060] T 6afaae01b5b5406cac56ad99ce7f3482 P 1f007450922d46c1aaae5cc6be7a9452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:17.656095 25325 leader_election.cc:290] T 6afaae01b5b5406cac56ad99ce7f3482 P 874f559253d64e01a7ce18b3b8f2164c [CANDIDATE]: Term 2 election: Requested vote from peers 67f2d785daf545deba69f6d4d4ea8251 (127.23.245.129:41731), 1f007450922d46c1aaae5cc6be7a9452 (127.23.245.130:41957)
I20260709 12:22:17.662603 25251 raft_consensus.cc:2468] T 6afaae01b5b5406cac56ad99ce7f3482 P 1f007450922d46c1aaae5cc6be7a9452 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 874f559253d64e01a7ce18b3b8f2164c in term 2.
I20260709 12:22:17.663774 25290 leader_election.cc:304] T 6afaae01b5b5406cac56ad99ce7f3482 P 874f559253d64e01a7ce18b3b8f2164c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1f007450922d46c1aaae5cc6be7a9452, 874f559253d64e01a7ce18b3b8f2164c; no voters: 67f2d785daf545deba69f6d4d4ea8251
I20260709 12:22:17.664552 25399 raft_consensus.cc:2804] T 6afaae01b5b5406cac56ad99ce7f3482 P 874f559253d64e01a7ce18b3b8f2164c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:17.665006 25399 raft_consensus.cc:697] T 6afaae01b5b5406cac56ad99ce7f3482 P 874f559253d64e01a7ce18b3b8f2164c [term 2 LEADER]: Becoming Leader. State: Replica: 874f559253d64e01a7ce18b3b8f2164c, State: Running, Role: LEADER
I20260709 12:22:17.665809 25399 consensus_queue.cc:237] T 6afaae01b5b5406cac56ad99ce7f3482 P 874f559253d64e01a7ce18b3b8f2164c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:17.668520 25399 raft_consensus.cc:993] T 39cf9b9227204dd497e8ef50f1beb2bc P 874f559253d64e01a7ce18b3b8f2164c: : Instructing follower 67f2d785daf545deba69f6d4d4ea8251 to start an election
I20260709 12:22:17.668923 25371 raft_consensus.cc:1081] T 39cf9b9227204dd497e8ef50f1beb2bc P 874f559253d64e01a7ce18b3b8f2164c [term 1 LEADER]: Signalling peer 67f2d785daf545deba69f6d4d4ea8251 to start an election
I20260709 12:22:17.670970 25176 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "39cf9b9227204dd497e8ef50f1beb2bc"
dest_uuid: "67f2d785daf545deba69f6d4d4ea8251"
 from {username='slave'} at 127.0.0.1:41470
I20260709 12:22:17.671579 25176 raft_consensus.cc:493] T 39cf9b9227204dd497e8ef50f1beb2bc P 67f2d785daf545deba69f6d4d4ea8251 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:17.671923 25176 raft_consensus.cc:3060] T 39cf9b9227204dd497e8ef50f1beb2bc P 67f2d785daf545deba69f6d4d4ea8251 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:17.672917 25071 catalog_manager.cc:5697] T 6afaae01b5b5406cac56ad99ce7f3482 P 874f559253d64e01a7ce18b3b8f2164c reported cstate change: term changed from 1 to 2, leader changed from 1f007450922d46c1aaae5cc6be7a9452 (127.23.245.130) to 874f559253d64e01a7ce18b3b8f2164c (127.23.245.131). New cstate: current_term: 2 leader_uuid: "874f559253d64e01a7ce18b3b8f2164c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:17.677954 25176 raft_consensus.cc:515] T 39cf9b9227204dd497e8ef50f1beb2bc P 67f2d785daf545deba69f6d4d4ea8251 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:17.680321 25176 leader_election.cc:290] T 39cf9b9227204dd497e8ef50f1beb2bc P 67f2d785daf545deba69f6d4d4ea8251 [CANDIDATE]: Term 2 election: Requested vote from peers 1f007450922d46c1aaae5cc6be7a9452 (127.23.245.130:41957), 874f559253d64e01a7ce18b3b8f2164c (127.23.245.131:46459)
I20260709 12:22:17.680605 25251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cf9b9227204dd497e8ef50f1beb2bc" candidate_uuid: "67f2d785daf545deba69f6d4d4ea8251" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f007450922d46c1aaae5cc6be7a9452"
I20260709 12:22:17.681047 25325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cf9b9227204dd497e8ef50f1beb2bc" candidate_uuid: "67f2d785daf545deba69f6d4d4ea8251" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "874f559253d64e01a7ce18b3b8f2164c"
I20260709 12:22:17.681514 25251 raft_consensus.cc:3060] T 39cf9b9227204dd497e8ef50f1beb2bc P 1f007450922d46c1aaae5cc6be7a9452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:17.681753 25325 raft_consensus.cc:3055] T 39cf9b9227204dd497e8ef50f1beb2bc P 874f559253d64e01a7ce18b3b8f2164c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:17.682181 25325 raft_consensus.cc:740] T 39cf9b9227204dd497e8ef50f1beb2bc P 874f559253d64e01a7ce18b3b8f2164c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 874f559253d64e01a7ce18b3b8f2164c, State: Running, Role: LEADER
I20260709 12:22:17.683226 25325 consensus_queue.cc:260] T 39cf9b9227204dd497e8ef50f1beb2bc P 874f559253d64e01a7ce18b3b8f2164c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:17.684425 25325 raft_consensus.cc:3060] T 39cf9b9227204dd497e8ef50f1beb2bc P 874f559253d64e01a7ce18b3b8f2164c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:17.687073 25251 raft_consensus.cc:2468] T 39cf9b9227204dd497e8ef50f1beb2bc P 1f007450922d46c1aaae5cc6be7a9452 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67f2d785daf545deba69f6d4d4ea8251 in term 2.
I20260709 12:22:17.688297 25141 leader_election.cc:304] T 39cf9b9227204dd497e8ef50f1beb2bc P 67f2d785daf545deba69f6d4d4ea8251 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f007450922d46c1aaae5cc6be7a9452, 67f2d785daf545deba69f6d4d4ea8251; no voters: 
I20260709 12:22:17.688983 25372 raft_consensus.cc:2804] T 39cf9b9227204dd497e8ef50f1beb2bc P 67f2d785daf545deba69f6d4d4ea8251 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:17.689473 25372 raft_consensus.cc:697] T 39cf9b9227204dd497e8ef50f1beb2bc P 67f2d785daf545deba69f6d4d4ea8251 [term 2 LEADER]: Becoming Leader. State: Replica: 67f2d785daf545deba69f6d4d4ea8251, State: Running, Role: LEADER
I20260709 12:22:17.689607 25325 raft_consensus.cc:2468] T 39cf9b9227204dd497e8ef50f1beb2bc P 874f559253d64e01a7ce18b3b8f2164c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67f2d785daf545deba69f6d4d4ea8251 in term 2.
I20260709 12:22:17.690250 25372 consensus_queue.cc:237] T 39cf9b9227204dd497e8ef50f1beb2bc P 67f2d785daf545deba69f6d4d4ea8251 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:17.696966 25070 catalog_manager.cc:5697] T 39cf9b9227204dd497e8ef50f1beb2bc P 67f2d785daf545deba69f6d4d4ea8251 reported cstate change: term changed from 1 to 2, leader changed from 874f559253d64e01a7ce18b3b8f2164c (127.23.245.131) to 67f2d785daf545deba69f6d4d4ea8251 (127.23.245.129). New cstate: current_term: 2 leader_uuid: "67f2d785daf545deba69f6d4d4ea8251" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:17.763649 25373 raft_consensus.cc:993] T 0c686b019831496188c502a729a4db8a P 1f007450922d46c1aaae5cc6be7a9452: : Instructing follower 67f2d785daf545deba69f6d4d4ea8251 to start an election
I20260709 12:22:17.764142 25386 raft_consensus.cc:1081] T 0c686b019831496188c502a729a4db8a P 1f007450922d46c1aaae5cc6be7a9452 [term 1 LEADER]: Signalling peer 67f2d785daf545deba69f6d4d4ea8251 to start an election
I20260709 12:22:17.766178 25176 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0c686b019831496188c502a729a4db8a"
dest_uuid: "67f2d785daf545deba69f6d4d4ea8251"
 from {username='slave'} at 127.0.0.1:41480
I20260709 12:22:17.766731 25176 raft_consensus.cc:493] T 0c686b019831496188c502a729a4db8a P 67f2d785daf545deba69f6d4d4ea8251 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:17.767096 25176 raft_consensus.cc:3060] T 0c686b019831496188c502a729a4db8a P 67f2d785daf545deba69f6d4d4ea8251 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:17.772265 25176 raft_consensus.cc:515] T 0c686b019831496188c502a729a4db8a P 67f2d785daf545deba69f6d4d4ea8251 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:17.774251 25176 leader_election.cc:290] T 0c686b019831496188c502a729a4db8a P 67f2d785daf545deba69f6d4d4ea8251 [CANDIDATE]: Term 2 election: Requested vote from peers 1f007450922d46c1aaae5cc6be7a9452 (127.23.245.130:41957), 874f559253d64e01a7ce18b3b8f2164c (127.23.245.131:46459)
I20260709 12:22:17.775331 25251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c686b019831496188c502a729a4db8a" candidate_uuid: "67f2d785daf545deba69f6d4d4ea8251" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f007450922d46c1aaae5cc6be7a9452"
I20260709 12:22:17.775307 25325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c686b019831496188c502a729a4db8a" candidate_uuid: "67f2d785daf545deba69f6d4d4ea8251" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "874f559253d64e01a7ce18b3b8f2164c"
I20260709 12:22:17.776050 25251 raft_consensus.cc:3055] T 0c686b019831496188c502a729a4db8a P 1f007450922d46c1aaae5cc6be7a9452 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:17.776115 25325 raft_consensus.cc:3060] T 0c686b019831496188c502a729a4db8a P 874f559253d64e01a7ce18b3b8f2164c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:17.776342 25251 raft_consensus.cc:740] T 0c686b019831496188c502a729a4db8a P 1f007450922d46c1aaae5cc6be7a9452 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f007450922d46c1aaae5cc6be7a9452, State: Running, Role: LEADER
I20260709 12:22:17.777084 25251 consensus_queue.cc:260] T 0c686b019831496188c502a729a4db8a P 1f007450922d46c1aaae5cc6be7a9452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:17.778002 25251 raft_consensus.cc:3060] T 0c686b019831496188c502a729a4db8a P 1f007450922d46c1aaae5cc6be7a9452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:17.781533 25325 raft_consensus.cc:2468] T 0c686b019831496188c502a729a4db8a P 874f559253d64e01a7ce18b3b8f2164c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67f2d785daf545deba69f6d4d4ea8251 in term 2.
I20260709 12:22:17.782570 25139 leader_election.cc:304] T 0c686b019831496188c502a729a4db8a P 67f2d785daf545deba69f6d4d4ea8251 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67f2d785daf545deba69f6d4d4ea8251, 874f559253d64e01a7ce18b3b8f2164c; no voters: 
I20260709 12:22:17.782979 25251 raft_consensus.cc:2468] T 0c686b019831496188c502a729a4db8a P 1f007450922d46c1aaae5cc6be7a9452 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67f2d785daf545deba69f6d4d4ea8251 in term 2.
I20260709 12:22:17.783305 25372 raft_consensus.cc:2804] T 0c686b019831496188c502a729a4db8a P 67f2d785daf545deba69f6d4d4ea8251 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:17.783797 25372 raft_consensus.cc:697] T 0c686b019831496188c502a729a4db8a P 67f2d785daf545deba69f6d4d4ea8251 [term 2 LEADER]: Becoming Leader. State: Replica: 67f2d785daf545deba69f6d4d4ea8251, State: Running, Role: LEADER
I20260709 12:22:17.784586 25372 consensus_queue.cc:237] T 0c686b019831496188c502a729a4db8a P 67f2d785daf545deba69f6d4d4ea8251 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:17.791299 25070 catalog_manager.cc:5697] T 0c686b019831496188c502a729a4db8a P 67f2d785daf545deba69f6d4d4ea8251 reported cstate change: term changed from 1 to 2, leader changed from 1f007450922d46c1aaae5cc6be7a9452 (127.23.245.130) to 67f2d785daf545deba69f6d4d4ea8251 (127.23.245.129). New cstate: current_term: 2 leader_uuid: "67f2d785daf545deba69f6d4d4ea8251" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:17.819424 25451 raft_consensus.cc:993] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c: : Instructing follower 67f2d785daf545deba69f6d4d4ea8251 to start an election
I20260709 12:22:17.819928 25401 raft_consensus.cc:1081] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c [term 1 LEADER]: Signalling peer 67f2d785daf545deba69f6d4d4ea8251 to start an election
I20260709 12:22:17.821343 25176 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8f462d4481754e45a6a38564f7ffacf7"
dest_uuid: "67f2d785daf545deba69f6d4d4ea8251"
 from {username='slave'} at 127.0.0.1:41470
I20260709 12:22:17.821897 25176 raft_consensus.cc:493] T 8f462d4481754e45a6a38564f7ffacf7 P 67f2d785daf545deba69f6d4d4ea8251 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:17.822278 25176 raft_consensus.cc:3060] T 8f462d4481754e45a6a38564f7ffacf7 P 67f2d785daf545deba69f6d4d4ea8251 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:17.827762 25176 raft_consensus.cc:515] T 8f462d4481754e45a6a38564f7ffacf7 P 67f2d785daf545deba69f6d4d4ea8251 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:17.829700 25176 leader_election.cc:290] T 8f462d4481754e45a6a38564f7ffacf7 P 67f2d785daf545deba69f6d4d4ea8251 [CANDIDATE]: Term 2 election: Requested vote from peers 1f007450922d46c1aaae5cc6be7a9452 (127.23.245.130:41957), 874f559253d64e01a7ce18b3b8f2164c (127.23.245.131:46459)
I20260709 12:22:17.830294 25251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f462d4481754e45a6a38564f7ffacf7" candidate_uuid: "67f2d785daf545deba69f6d4d4ea8251" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f007450922d46c1aaae5cc6be7a9452"
I20260709 12:22:17.830864 25251 raft_consensus.cc:3060] T 8f462d4481754e45a6a38564f7ffacf7 P 1f007450922d46c1aaae5cc6be7a9452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:17.830904 25325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f462d4481754e45a6a38564f7ffacf7" candidate_uuid: "67f2d785daf545deba69f6d4d4ea8251" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "874f559253d64e01a7ce18b3b8f2164c"
I20260709 12:22:17.831532 25325 raft_consensus.cc:3055] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:17.831861 25451 raft_consensus.cc:993] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c: : Instructing follower 67f2d785daf545deba69f6d4d4ea8251 to start an election
I20260709 12:22:17.831833 25325 raft_consensus.cc:740] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 874f559253d64e01a7ce18b3b8f2164c, State: Running, Role: LEADER
I20260709 12:22:17.832365 25401 raft_consensus.cc:1081] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c [term 1 LEADER]: Signalling peer 67f2d785daf545deba69f6d4d4ea8251 to start an election
I20260709 12:22:17.832791 25325 consensus_queue.cc:260] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:17.833948 25325 raft_consensus.cc:3060] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:17.833940 25175 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0462f2e3489342489e622f469b237df2"
dest_uuid: "67f2d785daf545deba69f6d4d4ea8251"
 from {username='slave'} at 127.0.0.1:41470
I20260709 12:22:17.834616 25175 raft_consensus.cc:493] T 0462f2e3489342489e622f469b237df2 P 67f2d785daf545deba69f6d4d4ea8251 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:17.834997 25175 raft_consensus.cc:3060] T 0462f2e3489342489e622f469b237df2 P 67f2d785daf545deba69f6d4d4ea8251 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:17.837759 25251 raft_consensus.cc:2468] T 8f462d4481754e45a6a38564f7ffacf7 P 1f007450922d46c1aaae5cc6be7a9452 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67f2d785daf545deba69f6d4d4ea8251 in term 2.
I20260709 12:22:17.838968 25325 raft_consensus.cc:2468] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67f2d785daf545deba69f6d4d4ea8251 in term 2.
I20260709 12:22:17.838883 25141 leader_election.cc:304] T 8f462d4481754e45a6a38564f7ffacf7 P 67f2d785daf545deba69f6d4d4ea8251 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f007450922d46c1aaae5cc6be7a9452, 67f2d785daf545deba69f6d4d4ea8251; no voters: 
I20260709 12:22:17.839778 25372 raft_consensus.cc:2804] T 8f462d4481754e45a6a38564f7ffacf7 P 67f2d785daf545deba69f6d4d4ea8251 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:17.840279 25372 raft_consensus.cc:697] T 8f462d4481754e45a6a38564f7ffacf7 P 67f2d785daf545deba69f6d4d4ea8251 [term 2 LEADER]: Becoming Leader. State: Replica: 67f2d785daf545deba69f6d4d4ea8251, State: Running, Role: LEADER
I20260709 12:22:17.841027 25372 consensus_queue.cc:237] T 8f462d4481754e45a6a38564f7ffacf7 P 67f2d785daf545deba69f6d4d4ea8251 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:17.841138 25175 raft_consensus.cc:515] T 0462f2e3489342489e622f469b237df2 P 67f2d785daf545deba69f6d4d4ea8251 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:17.843786 25325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0462f2e3489342489e622f469b237df2" candidate_uuid: "67f2d785daf545deba69f6d4d4ea8251" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "874f559253d64e01a7ce18b3b8f2164c"
I20260709 12:22:17.843676 25251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0462f2e3489342489e622f469b237df2" candidate_uuid: "67f2d785daf545deba69f6d4d4ea8251" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f007450922d46c1aaae5cc6be7a9452"
I20260709 12:22:17.844156 25175 leader_election.cc:290] T 0462f2e3489342489e622f469b237df2 P 67f2d785daf545deba69f6d4d4ea8251 [CANDIDATE]: Term 2 election: Requested vote from peers 1f007450922d46c1aaae5cc6be7a9452 (127.23.245.130:41957), 874f559253d64e01a7ce18b3b8f2164c (127.23.245.131:46459)
I20260709 12:22:17.844519 25251 raft_consensus.cc:3060] T 0462f2e3489342489e622f469b237df2 P 1f007450922d46c1aaae5cc6be7a9452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:17.844550 25325 raft_consensus.cc:3055] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:17.845124 25325 raft_consensus.cc:740] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 874f559253d64e01a7ce18b3b8f2164c, State: Running, Role: LEADER
I20260709 12:22:17.846019 25325 consensus_queue.cc:260] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:17.847020 25325 raft_consensus.cc:3060] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:17.848115 25070 catalog_manager.cc:5697] T 8f462d4481754e45a6a38564f7ffacf7 P 67f2d785daf545deba69f6d4d4ea8251 reported cstate change: term changed from 1 to 2, leader changed from 874f559253d64e01a7ce18b3b8f2164c (127.23.245.131) to 67f2d785daf545deba69f6d4d4ea8251 (127.23.245.129). New cstate: current_term: 2 leader_uuid: "67f2d785daf545deba69f6d4d4ea8251" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:17.850859 25251 raft_consensus.cc:2468] T 0462f2e3489342489e622f469b237df2 P 1f007450922d46c1aaae5cc6be7a9452 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67f2d785daf545deba69f6d4d4ea8251 in term 2.
I20260709 12:22:17.851694 25325 raft_consensus.cc:2468] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67f2d785daf545deba69f6d4d4ea8251 in term 2.
I20260709 12:22:17.851882 25141 leader_election.cc:304] T 0462f2e3489342489e622f469b237df2 P 67f2d785daf545deba69f6d4d4ea8251 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f007450922d46c1aaae5cc6be7a9452, 67f2d785daf545deba69f6d4d4ea8251; no voters: 
I20260709 12:22:17.852759 25372 raft_consensus.cc:2804] T 0462f2e3489342489e622f469b237df2 P 67f2d785daf545deba69f6d4d4ea8251 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:17.853197 25372 raft_consensus.cc:697] T 0462f2e3489342489e622f469b237df2 P 67f2d785daf545deba69f6d4d4ea8251 [term 2 LEADER]: Becoming Leader. State: Replica: 67f2d785daf545deba69f6d4d4ea8251, State: Running, Role: LEADER
I20260709 12:22:17.853987 25372 consensus_queue.cc:237] T 0462f2e3489342489e622f469b237df2 P 67f2d785daf545deba69f6d4d4ea8251 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:17.860662 25070 catalog_manager.cc:5697] T 0462f2e3489342489e622f469b237df2 P 67f2d785daf545deba69f6d4d4ea8251 reported cstate change: term changed from 1 to 2, leader changed from 874f559253d64e01a7ce18b3b8f2164c (127.23.245.131) to 67f2d785daf545deba69f6d4d4ea8251 (127.23.245.129). New cstate: current_term: 2 leader_uuid: "67f2d785daf545deba69f6d4d4ea8251" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:17.936838 25325 raft_consensus.cc:1275] T 09fa2961864c4c999f036a784f0da8cf P 874f559253d64e01a7ce18b3b8f2164c [term 2 FOLLOWER]: Refusing update from remote peer 1f007450922d46c1aaae5cc6be7a9452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:17.938297 25386 consensus_queue.cc:1048] T 09fa2961864c4c999f036a784f0da8cf P 1f007450922d46c1aaae5cc6be7a9452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:17.949856 25175 raft_consensus.cc:1275] T 09fa2961864c4c999f036a784f0da8cf P 67f2d785daf545deba69f6d4d4ea8251 [term 2 FOLLOWER]: Refusing update from remote peer 1f007450922d46c1aaae5cc6be7a9452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:17.951421 25382 consensus_queue.cc:1048] T 09fa2961864c4c999f036a784f0da8cf P 1f007450922d46c1aaae5cc6be7a9452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:17.968652 25451 raft_consensus.cc:993] T a90bed0f71cb4741b9fa34669e5b7bc1 P 874f559253d64e01a7ce18b3b8f2164c: : Instructing follower 1f007450922d46c1aaae5cc6be7a9452 to start an election
I20260709 12:22:17.969081 25401 raft_consensus.cc:1081] T a90bed0f71cb4741b9fa34669e5b7bc1 P 874f559253d64e01a7ce18b3b8f2164c [term 1 LEADER]: Signalling peer 1f007450922d46c1aaae5cc6be7a9452 to start an election
I20260709 12:22:17.970420 25251 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a90bed0f71cb4741b9fa34669e5b7bc1"
dest_uuid: "1f007450922d46c1aaae5cc6be7a9452"
 from {username='slave'} at 127.0.0.1:41618
I20260709 12:22:17.970898 25251 raft_consensus.cc:493] T a90bed0f71cb4741b9fa34669e5b7bc1 P 1f007450922d46c1aaae5cc6be7a9452 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:17.971217 25251 raft_consensus.cc:3060] T a90bed0f71cb4741b9fa34669e5b7bc1 P 1f007450922d46c1aaae5cc6be7a9452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:17.977033 25251 raft_consensus.cc:515] T a90bed0f71cb4741b9fa34669e5b7bc1 P 1f007450922d46c1aaae5cc6be7a9452 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:17.978761 25251 leader_election.cc:290] T a90bed0f71cb4741b9fa34669e5b7bc1 P 1f007450922d46c1aaae5cc6be7a9452 [CANDIDATE]: Term 2 election: Requested vote from peers 67f2d785daf545deba69f6d4d4ea8251 (127.23.245.129:41731), 874f559253d64e01a7ce18b3b8f2164c (127.23.245.131:46459)
I20260709 12:22:17.980084 25176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a90bed0f71cb4741b9fa34669e5b7bc1" candidate_uuid: "1f007450922d46c1aaae5cc6be7a9452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "67f2d785daf545deba69f6d4d4ea8251"
I20260709 12:22:17.980513 25176 raft_consensus.cc:3060] T a90bed0f71cb4741b9fa34669e5b7bc1 P 67f2d785daf545deba69f6d4d4ea8251 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:17.980347 25325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a90bed0f71cb4741b9fa34669e5b7bc1" candidate_uuid: "1f007450922d46c1aaae5cc6be7a9452" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "874f559253d64e01a7ce18b3b8f2164c"
I20260709 12:22:17.980939 25325 raft_consensus.cc:3055] T a90bed0f71cb4741b9fa34669e5b7bc1 P 874f559253d64e01a7ce18b3b8f2164c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:17.981213 25325 raft_consensus.cc:740] T a90bed0f71cb4741b9fa34669e5b7bc1 P 874f559253d64e01a7ce18b3b8f2164c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 874f559253d64e01a7ce18b3b8f2164c, State: Running, Role: LEADER
I20260709 12:22:17.981890 25325 consensus_queue.cc:260] T a90bed0f71cb4741b9fa34669e5b7bc1 P 874f559253d64e01a7ce18b3b8f2164c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:17.982738 25325 raft_consensus.cc:3060] T a90bed0f71cb4741b9fa34669e5b7bc1 P 874f559253d64e01a7ce18b3b8f2164c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:17.984618 25176 raft_consensus.cc:2468] T a90bed0f71cb4741b9fa34669e5b7bc1 P 67f2d785daf545deba69f6d4d4ea8251 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f007450922d46c1aaae5cc6be7a9452 in term 2.
I20260709 12:22:17.985468 25214 leader_election.cc:304] T a90bed0f71cb4741b9fa34669e5b7bc1 P 1f007450922d46c1aaae5cc6be7a9452 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f007450922d46c1aaae5cc6be7a9452, 67f2d785daf545deba69f6d4d4ea8251; no voters: 
I20260709 12:22:17.986439 25382 raft_consensus.cc:2804] T a90bed0f71cb4741b9fa34669e5b7bc1 P 1f007450922d46c1aaae5cc6be7a9452 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:17.986946 25382 raft_consensus.cc:697] T a90bed0f71cb4741b9fa34669e5b7bc1 P 1f007450922d46c1aaae5cc6be7a9452 [term 2 LEADER]: Becoming Leader. State: Replica: 1f007450922d46c1aaae5cc6be7a9452, State: Running, Role: LEADER
I20260709 12:22:17.987711 25382 consensus_queue.cc:237] T a90bed0f71cb4741b9fa34669e5b7bc1 P 1f007450922d46c1aaae5cc6be7a9452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:17.988035 25325 raft_consensus.cc:2468] T a90bed0f71cb4741b9fa34669e5b7bc1 P 874f559253d64e01a7ce18b3b8f2164c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f007450922d46c1aaae5cc6be7a9452 in term 2.
I20260709 12:22:17.993568 25070 catalog_manager.cc:5697] T a90bed0f71cb4741b9fa34669e5b7bc1 P 1f007450922d46c1aaae5cc6be7a9452 reported cstate change: term changed from 1 to 2, leader changed from 874f559253d64e01a7ce18b3b8f2164c (127.23.245.131) to 1f007450922d46c1aaae5cc6be7a9452 (127.23.245.130). New cstate: current_term: 2 leader_uuid: "1f007450922d46c1aaae5cc6be7a9452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:18.009229 25176 raft_consensus.cc:1275] T ae5ec568a7c04c03ab6df14b7fc861e9 P 67f2d785daf545deba69f6d4d4ea8251 [term 2 FOLLOWER]: Refusing update from remote peer 1f007450922d46c1aaae5cc6be7a9452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:18.010658 25382 consensus_queue.cc:1048] T ae5ec568a7c04c03ab6df14b7fc861e9 P 1f007450922d46c1aaae5cc6be7a9452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:18.018326 25325 raft_consensus.cc:1275] T ae5ec568a7c04c03ab6df14b7fc861e9 P 874f559253d64e01a7ce18b3b8f2164c [term 2 FOLLOWER]: Refusing update from remote peer 1f007450922d46c1aaae5cc6be7a9452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:18.019778 25373 consensus_queue.cc:1048] T ae5ec568a7c04c03ab6df14b7fc861e9 P 1f007450922d46c1aaae5cc6be7a9452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:18.099433 25176 raft_consensus.cc:3060] T 6afaae01b5b5406cac56ad99ce7f3482 P 67f2d785daf545deba69f6d4d4ea8251 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:18.103870 25176 raft_consensus.cc:1275] T 6afaae01b5b5406cac56ad99ce7f3482 P 67f2d785daf545deba69f6d4d4ea8251 [term 2 FOLLOWER]: Refusing update from remote peer 874f559253d64e01a7ce18b3b8f2164c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:18.105141 25401 consensus_queue.cc:1048] T 6afaae01b5b5406cac56ad99ce7f3482 P 874f559253d64e01a7ce18b3b8f2164c [LEADER]: Connected to new peer: Peer: permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:18.112977 25251 raft_consensus.cc:1275] T 6afaae01b5b5406cac56ad99ce7f3482 P 1f007450922d46c1aaae5cc6be7a9452 [term 2 FOLLOWER]: Refusing update from remote peer 874f559253d64e01a7ce18b3b8f2164c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:18.114382 25452 consensus_queue.cc:1048] T 6afaae01b5b5406cac56ad99ce7f3482 P 874f559253d64e01a7ce18b3b8f2164c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:18.184552 25325 raft_consensus.cc:1275] T 39cf9b9227204dd497e8ef50f1beb2bc P 874f559253d64e01a7ce18b3b8f2164c [term 2 FOLLOWER]: Refusing update from remote peer 67f2d785daf545deba69f6d4d4ea8251: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:18.185973 25372 consensus_queue.cc:1048] T 39cf9b9227204dd497e8ef50f1beb2bc P 67f2d785daf545deba69f6d4d4ea8251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:18.194537 25251 raft_consensus.cc:1275] T 39cf9b9227204dd497e8ef50f1beb2bc P 1f007450922d46c1aaae5cc6be7a9452 [term 2 FOLLOWER]: Refusing update from remote peer 67f2d785daf545deba69f6d4d4ea8251: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:18.196405 25455 consensus_queue.cc:1048] T 39cf9b9227204dd497e8ef50f1beb2bc P 67f2d785daf545deba69f6d4d4ea8251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:18.198284 25324 raft_consensus.cc:1275] T 0c686b019831496188c502a729a4db8a P 874f559253d64e01a7ce18b3b8f2164c [term 2 FOLLOWER]: Refusing update from remote peer 67f2d785daf545deba69f6d4d4ea8251: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:18.201016 25429 consensus_queue.cc:1048] T 0c686b019831496188c502a729a4db8a P 67f2d785daf545deba69f6d4d4ea8251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:18.209479 25251 raft_consensus.cc:1275] T 0c686b019831496188c502a729a4db8a P 1f007450922d46c1aaae5cc6be7a9452 [term 2 FOLLOWER]: Refusing update from remote peer 67f2d785daf545deba69f6d4d4ea8251: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:18.211162 25372 consensus_queue.cc:1048] T 0c686b019831496188c502a729a4db8a P 67f2d785daf545deba69f6d4d4ea8251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:18.271112 25325 raft_consensus.cc:1275] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c [term 2 FOLLOWER]: Refusing update from remote peer 67f2d785daf545deba69f6d4d4ea8251: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:18.272580 25429 consensus_queue.cc:1048] T 8f462d4481754e45a6a38564f7ffacf7 P 67f2d785daf545deba69f6d4d4ea8251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:18.281704 25251 raft_consensus.cc:1275] T 8f462d4481754e45a6a38564f7ffacf7 P 1f007450922d46c1aaae5cc6be7a9452 [term 2 FOLLOWER]: Refusing update from remote peer 67f2d785daf545deba69f6d4d4ea8251: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:18.283185 25372 consensus_queue.cc:1048] T 8f462d4481754e45a6a38564f7ffacf7 P 67f2d785daf545deba69f6d4d4ea8251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:18.288678 25325 raft_consensus.cc:1275] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c [term 2 FOLLOWER]: Refusing update from remote peer 67f2d785daf545deba69f6d4d4ea8251: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:18.289953 25372 consensus_queue.cc:1048] T 0462f2e3489342489e622f469b237df2 P 67f2d785daf545deba69f6d4d4ea8251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:18.299280 25251 raft_consensus.cc:1275] T 0462f2e3489342489e622f469b237df2 P 1f007450922d46c1aaae5cc6be7a9452 [term 2 FOLLOWER]: Refusing update from remote peer 67f2d785daf545deba69f6d4d4ea8251: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:18.300678 25372 consensus_queue.cc:1048] T 0462f2e3489342489e622f469b237df2 P 67f2d785daf545deba69f6d4d4ea8251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:18.443670 25325 raft_consensus.cc:1275] T a90bed0f71cb4741b9fa34669e5b7bc1 P 874f559253d64e01a7ce18b3b8f2164c [term 2 FOLLOWER]: Refusing update from remote peer 1f007450922d46c1aaae5cc6be7a9452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:18.445035 25382 consensus_queue.cc:1048] T a90bed0f71cb4741b9fa34669e5b7bc1 P 1f007450922d46c1aaae5cc6be7a9452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:18.453023 25176 raft_consensus.cc:1275] T a90bed0f71cb4741b9fa34669e5b7bc1 P 67f2d785daf545deba69f6d4d4ea8251 [term 2 FOLLOWER]: Refusing update from remote peer 1f007450922d46c1aaae5cc6be7a9452: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:18.454481 25382 consensus_queue.cc:1048] T a90bed0f71cb4741b9fa34669e5b7bc1 P 1f007450922d46c1aaae5cc6be7a9452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:20.470186 24534 auto_leader_rebalancer-test.cc:365] The leader distribution is 
I20260709 12:22:20.470942 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:20.486663 25176 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0462f2e3489342489e622f469b237df2"
dest_uuid: "67f2d785daf545deba69f6d4d4ea8251"
mode: GRACEFUL
new_leader_uuid: "874f559253d64e01a7ce18b3b8f2164c"
 from {username='slave'} at 127.0.0.1:41500
I20260709 12:22:20.487146 25176 raft_consensus.cc:606] T 0462f2e3489342489e622f469b237df2 P 67f2d785daf545deba69f6d4d4ea8251 [term 2 LEADER]: Received request to transfer leadership to TS 874f559253d64e01a7ce18b3b8f2164c
I20260709 12:22:20.489567 25176 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f462d4481754e45a6a38564f7ffacf7"
dest_uuid: "67f2d785daf545deba69f6d4d4ea8251"
mode: GRACEFUL
new_leader_uuid: "874f559253d64e01a7ce18b3b8f2164c"
 from {username='slave'} at 127.0.0.1:41500
I20260709 12:22:20.489993 25176 raft_consensus.cc:606] T 8f462d4481754e45a6a38564f7ffacf7 P 67f2d785daf545deba69f6d4d4ea8251 [term 2 LEADER]: Received request to transfer leadership to TS 874f559253d64e01a7ce18b3b8f2164c
I20260709 12:22:20.490993 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:22:20.491415 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:20.762362 25455 raft_consensus.cc:993] T 0462f2e3489342489e622f469b237df2 P 67f2d785daf545deba69f6d4d4ea8251: : Instructing follower 874f559253d64e01a7ce18b3b8f2164c to start an election
I20260709 12:22:20.762887 25469 raft_consensus.cc:1081] T 0462f2e3489342489e622f469b237df2 P 67f2d785daf545deba69f6d4d4ea8251 [term 2 LEADER]: Signalling peer 874f559253d64e01a7ce18b3b8f2164c to start an election
I20260709 12:22:20.764344 25325 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0462f2e3489342489e622f469b237df2"
dest_uuid: "874f559253d64e01a7ce18b3b8f2164c"
 from {username='slave'} at 127.0.0.1:57880
I20260709 12:22:20.764853 25325 raft_consensus.cc:493] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:20.765139 25325 raft_consensus.cc:3060] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:20.769054 25325 raft_consensus.cc:515] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:20.770526 25325 leader_election.cc:290] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c [CANDIDATE]: Term 3 election: Requested vote from peers 67f2d785daf545deba69f6d4d4ea8251 (127.23.245.129:41731), 1f007450922d46c1aaae5cc6be7a9452 (127.23.245.130:41957)
I20260709 12:22:20.771394 25176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0462f2e3489342489e622f469b237df2" candidate_uuid: "874f559253d64e01a7ce18b3b8f2164c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "67f2d785daf545deba69f6d4d4ea8251"
I20260709 12:22:20.771692 25250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0462f2e3489342489e622f469b237df2" candidate_uuid: "874f559253d64e01a7ce18b3b8f2164c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1f007450922d46c1aaae5cc6be7a9452"
I20260709 12:22:20.771891 25176 raft_consensus.cc:3055] T 0462f2e3489342489e622f469b237df2 P 67f2d785daf545deba69f6d4d4ea8251 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:20.772235 25176 raft_consensus.cc:740] T 0462f2e3489342489e622f469b237df2 P 67f2d785daf545deba69f6d4d4ea8251 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 67f2d785daf545deba69f6d4d4ea8251, State: Running, Role: LEADER
I20260709 12:22:20.772264 25250 raft_consensus.cc:3060] T 0462f2e3489342489e622f469b237df2 P 1f007450922d46c1aaae5cc6be7a9452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:20.772943 25176 consensus_queue.cc:260] T 0462f2e3489342489e622f469b237df2 P 67f2d785daf545deba69f6d4d4ea8251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:20.773743 25176 raft_consensus.cc:3060] T 0462f2e3489342489e622f469b237df2 P 67f2d785daf545deba69f6d4d4ea8251 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:20.776968 25250 raft_consensus.cc:2468] T 0462f2e3489342489e622f469b237df2 P 1f007450922d46c1aaae5cc6be7a9452 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 874f559253d64e01a7ce18b3b8f2164c in term 3.
I20260709 12:22:20.777719 25176 raft_consensus.cc:2468] T 0462f2e3489342489e622f469b237df2 P 67f2d785daf545deba69f6d4d4ea8251 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 874f559253d64e01a7ce18b3b8f2164c in term 3.
I20260709 12:22:20.778079 25290 leader_election.cc:304] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f007450922d46c1aaae5cc6be7a9452, 874f559253d64e01a7ce18b3b8f2164c; no voters: 
I20260709 12:22:20.779137 25466 raft_consensus.cc:2804] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:20.780342 25466 raft_consensus.cc:697] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c [term 3 LEADER]: Becoming Leader. State: Replica: 874f559253d64e01a7ce18b3b8f2164c, State: Running, Role: LEADER
I20260709 12:22:20.781126 25466 consensus_queue.cc:237] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:20.787150 25070 catalog_manager.cc:5697] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c reported cstate change: term changed from 2 to 3, leader changed from 67f2d785daf545deba69f6d4d4ea8251 (127.23.245.129) to 874f559253d64e01a7ce18b3b8f2164c (127.23.245.131). New cstate: current_term: 3 leader_uuid: "874f559253d64e01a7ce18b3b8f2164c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:20.974650 25455 raft_consensus.cc:993] T 8f462d4481754e45a6a38564f7ffacf7 P 67f2d785daf545deba69f6d4d4ea8251: : Instructing follower 874f559253d64e01a7ce18b3b8f2164c to start an election
I20260709 12:22:20.975095 25469 raft_consensus.cc:1081] T 8f462d4481754e45a6a38564f7ffacf7 P 67f2d785daf545deba69f6d4d4ea8251 [term 2 LEADER]: Signalling peer 874f559253d64e01a7ce18b3b8f2164c to start an election
I20260709 12:22:20.976637 25325 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8f462d4481754e45a6a38564f7ffacf7"
dest_uuid: "874f559253d64e01a7ce18b3b8f2164c"
 from {username='slave'} at 127.0.0.1:57880
I20260709 12:22:20.977144 25325 raft_consensus.cc:493] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:20.977465 25325 raft_consensus.cc:3060] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:20.982182 25325 raft_consensus.cc:515] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:20.983892 25325 leader_election.cc:290] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c [CANDIDATE]: Term 3 election: Requested vote from peers 67f2d785daf545deba69f6d4d4ea8251 (127.23.245.129:41731), 1f007450922d46c1aaae5cc6be7a9452 (127.23.245.130:41957)
I20260709 12:22:20.984969 25176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f462d4481754e45a6a38564f7ffacf7" candidate_uuid: "874f559253d64e01a7ce18b3b8f2164c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "67f2d785daf545deba69f6d4d4ea8251"
I20260709 12:22:20.985077 25250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f462d4481754e45a6a38564f7ffacf7" candidate_uuid: "874f559253d64e01a7ce18b3b8f2164c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1f007450922d46c1aaae5cc6be7a9452"
I20260709 12:22:20.985706 25176 raft_consensus.cc:3055] T 8f462d4481754e45a6a38564f7ffacf7 P 67f2d785daf545deba69f6d4d4ea8251 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:20.985733 25250 raft_consensus.cc:3060] T 8f462d4481754e45a6a38564f7ffacf7 P 1f007450922d46c1aaae5cc6be7a9452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:20.986172 25176 raft_consensus.cc:740] T 8f462d4481754e45a6a38564f7ffacf7 P 67f2d785daf545deba69f6d4d4ea8251 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 67f2d785daf545deba69f6d4d4ea8251, State: Running, Role: LEADER
I20260709 12:22:20.987170 25176 consensus_queue.cc:260] T 8f462d4481754e45a6a38564f7ffacf7 P 67f2d785daf545deba69f6d4d4ea8251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:20.988832 25176 raft_consensus.cc:3060] T 8f462d4481754e45a6a38564f7ffacf7 P 67f2d785daf545deba69f6d4d4ea8251 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:20.994719 25176 raft_consensus.cc:2468] T 8f462d4481754e45a6a38564f7ffacf7 P 67f2d785daf545deba69f6d4d4ea8251 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 874f559253d64e01a7ce18b3b8f2164c in term 3.
I20260709 12:22:20.994817 25250 raft_consensus.cc:2468] T 8f462d4481754e45a6a38564f7ffacf7 P 1f007450922d46c1aaae5cc6be7a9452 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 874f559253d64e01a7ce18b3b8f2164c in term 3.
I20260709 12:22:20.995994 25288 leader_election.cc:304] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67f2d785daf545deba69f6d4d4ea8251, 874f559253d64e01a7ce18b3b8f2164c; no voters: 
I20260709 12:22:20.996788 25466 raft_consensus.cc:2804] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:20.997215 25466 raft_consensus.cc:697] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c [term 3 LEADER]: Becoming Leader. State: Replica: 874f559253d64e01a7ce18b3b8f2164c, State: Running, Role: LEADER
I20260709 12:22:20.997974 25466 consensus_queue.cc:237] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:21.008153 25070 catalog_manager.cc:5697] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c reported cstate change: term changed from 2 to 3, leader changed from 67f2d785daf545deba69f6d4d4ea8251 (127.23.245.129) to 874f559253d64e01a7ce18b3b8f2164c (127.23.245.131). New cstate: current_term: 3 leader_uuid: "874f559253d64e01a7ce18b3b8f2164c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:21.245836 25250 raft_consensus.cc:1275] T 0462f2e3489342489e622f469b237df2 P 1f007450922d46c1aaae5cc6be7a9452 [term 3 FOLLOWER]: Refusing update from remote peer 874f559253d64e01a7ce18b3b8f2164c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:21.247455 25466 consensus_queue.cc:1048] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:21.260777 25175 raft_consensus.cc:1275] T 0462f2e3489342489e622f469b237df2 P 67f2d785daf545deba69f6d4d4ea8251 [term 3 FOLLOWER]: Refusing update from remote peer 874f559253d64e01a7ce18b3b8f2164c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:21.267570 25466 consensus_queue.cc:1048] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c [LEADER]: Connected to new peer: Peer: permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:21.395781 25250 raft_consensus.cc:1275] T 8f462d4481754e45a6a38564f7ffacf7 P 1f007450922d46c1aaae5cc6be7a9452 [term 3 FOLLOWER]: Refusing update from remote peer 874f559253d64e01a7ce18b3b8f2164c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:21.397058 25470 consensus_queue.cc:1048] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:21.408382 25175 raft_consensus.cc:1275] T 8f462d4481754e45a6a38564f7ffacf7 P 67f2d785daf545deba69f6d4d4ea8251 [term 3 FOLLOWER]: Refusing update from remote peer 874f559253d64e01a7ce18b3b8f2164c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:21.410282 25470 consensus_queue.cc:1048] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c [LEADER]: Connected to new peer: Peer: permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:21.492648 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:21.499032 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:21.499841 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:22.501276 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:22.507073 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:22.507563 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:23.508535 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:23.514497 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:23.514942 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:24.516134 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:24.521991 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:24.522491 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:25.523861 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:25.530455 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:25.530983 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:26.532182 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:26.538657 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:26.539232 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:27.540236 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:27.545435 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:27.545887 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:28.546850 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:28.552016 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:28.552459 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:29.553544 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:29.562188 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:29.562891 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:30.600541 24534 auto_leader_rebalancer-test.cc:384] The leader distribution is 
I20260709 12:22:30.609247 25324 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f462d4481754e45a6a38564f7ffacf7"
dest_uuid: "874f559253d64e01a7ce18b3b8f2164c"
mode: GRACEFUL
new_leader_uuid: "67f2d785daf545deba69f6d4d4ea8251"
 from {username='slave'} at 127.0.0.1:57894
I20260709 12:22:30.610157 25324 raft_consensus.cc:606] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c [term 3 LEADER]: Received request to transfer leadership to TS 67f2d785daf545deba69f6d4d4ea8251
I20260709 12:22:30.618572 25324 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0462f2e3489342489e622f469b237df2"
dest_uuid: "874f559253d64e01a7ce18b3b8f2164c"
mode: GRACEFUL
new_leader_uuid: "67f2d785daf545deba69f6d4d4ea8251"
 from {username='slave'} at 127.0.0.1:57894
I20260709 12:22:30.619242 25324 raft_consensus.cc:606] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c [term 3 LEADER]: Received request to transfer leadership to TS 67f2d785daf545deba69f6d4d4ea8251
I20260709 12:22:30.627246 25250 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b7cc944e087640eab119454448129998"
dest_uuid: "1f007450922d46c1aaae5cc6be7a9452"
mode: GRACEFUL
new_leader_uuid: "67f2d785daf545deba69f6d4d4ea8251"
 from {username='slave'} at 127.0.0.1:41630
I20260709 12:22:30.627935 25250 raft_consensus.cc:606] T b7cc944e087640eab119454448129998 P 1f007450922d46c1aaae5cc6be7a9452 [term 1 LEADER]: Received request to transfer leadership to TS 67f2d785daf545deba69f6d4d4ea8251
I20260709 12:22:30.634864 25250 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a90bed0f71cb4741b9fa34669e5b7bc1"
dest_uuid: "1f007450922d46c1aaae5cc6be7a9452"
mode: GRACEFUL
new_leader_uuid: "67f2d785daf545deba69f6d4d4ea8251"
 from {username='slave'} at 127.0.0.1:41630
I20260709 12:22:30.635641 25250 raft_consensus.cc:606] T a90bed0f71cb4741b9fa34669e5b7bc1 P 1f007450922d46c1aaae5cc6be7a9452 [term 2 LEADER]: Received request to transfer leadership to TS 67f2d785daf545deba69f6d4d4ea8251
I20260709 12:22:30.640740 25250 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae5ec568a7c04c03ab6df14b7fc861e9"
dest_uuid: "1f007450922d46c1aaae5cc6be7a9452"
mode: GRACEFUL
new_leader_uuid: "67f2d785daf545deba69f6d4d4ea8251"
 from {username='slave'} at 127.0.0.1:41630
I20260709 12:22:30.641261 25250 raft_consensus.cc:606] T ae5ec568a7c04c03ab6df14b7fc861e9 P 1f007450922d46c1aaae5cc6be7a9452 [term 2 LEADER]: Received request to transfer leadership to TS 67f2d785daf545deba69f6d4d4ea8251
I20260709 12:22:30.698985 25492 raft_consensus.cc:993] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c: : Instructing follower 67f2d785daf545deba69f6d4d4ea8251 to start an election
I20260709 12:22:30.699570 25494 raft_consensus.cc:1081] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c [term 3 LEADER]: Signalling peer 67f2d785daf545deba69f6d4d4ea8251 to start an election
I20260709 12:22:30.701413 25176 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8f462d4481754e45a6a38564f7ffacf7"
dest_uuid: "67f2d785daf545deba69f6d4d4ea8251"
 from {username='slave'} at 127.0.0.1:41470
I20260709 12:22:30.701912 25176 raft_consensus.cc:493] T 8f462d4481754e45a6a38564f7ffacf7 P 67f2d785daf545deba69f6d4d4ea8251 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:30.702246 25176 raft_consensus.cc:3060] T 8f462d4481754e45a6a38564f7ffacf7 P 67f2d785daf545deba69f6d4d4ea8251 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:30.708990 25176 raft_consensus.cc:515] T 8f462d4481754e45a6a38564f7ffacf7 P 67f2d785daf545deba69f6d4d4ea8251 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:30.711812 25176 leader_election.cc:290] T 8f462d4481754e45a6a38564f7ffacf7 P 67f2d785daf545deba69f6d4d4ea8251 [CANDIDATE]: Term 4 election: Requested vote from peers 1f007450922d46c1aaae5cc6be7a9452 (127.23.245.130:41957), 874f559253d64e01a7ce18b3b8f2164c (127.23.245.131:46459)
I20260709 12:22:30.712646 25250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f462d4481754e45a6a38564f7ffacf7" candidate_uuid: "67f2d785daf545deba69f6d4d4ea8251" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1f007450922d46c1aaae5cc6be7a9452"
I20260709 12:22:30.713016 25324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f462d4481754e45a6a38564f7ffacf7" candidate_uuid: "67f2d785daf545deba69f6d4d4ea8251" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "874f559253d64e01a7ce18b3b8f2164c"
I20260709 12:22:30.713474 25250 raft_consensus.cc:3060] T 8f462d4481754e45a6a38564f7ffacf7 P 1f007450922d46c1aaae5cc6be7a9452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:30.713583 25324 raft_consensus.cc:3055] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:30.713943 25324 raft_consensus.cc:740] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 874f559253d64e01a7ce18b3b8f2164c, State: Running, Role: LEADER
I20260709 12:22:30.714919 25324 consensus_queue.cc:260] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:30.716454 25324 raft_consensus.cc:3060] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:30.719802 25495 raft_consensus.cc:993] T a90bed0f71cb4741b9fa34669e5b7bc1 P 1f007450922d46c1aaae5cc6be7a9452: : Instructing follower 67f2d785daf545deba69f6d4d4ea8251 to start an election
I20260709 12:22:30.720485 25493 raft_consensus.cc:1081] T a90bed0f71cb4741b9fa34669e5b7bc1 P 1f007450922d46c1aaae5cc6be7a9452 [term 2 LEADER]: Signalling peer 67f2d785daf545deba69f6d4d4ea8251 to start an election
I20260709 12:22:30.721835 25250 raft_consensus.cc:2468] T 8f462d4481754e45a6a38564f7ffacf7 P 1f007450922d46c1aaae5cc6be7a9452 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67f2d785daf545deba69f6d4d4ea8251 in term 4.
I20260709 12:22:30.721873 25176 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a90bed0f71cb4741b9fa34669e5b7bc1"
dest_uuid: "67f2d785daf545deba69f6d4d4ea8251"
 from {username='slave'} at 127.0.0.1:41480
I20260709 12:22:30.722719 25176 raft_consensus.cc:493] T a90bed0f71cb4741b9fa34669e5b7bc1 P 67f2d785daf545deba69f6d4d4ea8251 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:30.723291 25176 raft_consensus.cc:3060] T a90bed0f71cb4741b9fa34669e5b7bc1 P 67f2d785daf545deba69f6d4d4ea8251 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:30.723409 25141 leader_election.cc:304] T 8f462d4481754e45a6a38564f7ffacf7 P 67f2d785daf545deba69f6d4d4ea8251 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f007450922d46c1aaae5cc6be7a9452, 67f2d785daf545deba69f6d4d4ea8251; no voters: 
I20260709 12:22:30.724561 25469 raft_consensus.cc:2804] T 8f462d4481754e45a6a38564f7ffacf7 P 67f2d785daf545deba69f6d4d4ea8251 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:30.725066 25324 raft_consensus.cc:2468] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67f2d785daf545deba69f6d4d4ea8251 in term 4.
I20260709 12:22:30.725670 25469 raft_consensus.cc:697] T 8f462d4481754e45a6a38564f7ffacf7 P 67f2d785daf545deba69f6d4d4ea8251 [term 4 LEADER]: Becoming Leader. State: Replica: 67f2d785daf545deba69f6d4d4ea8251, State: Running, Role: LEADER
I20260709 12:22:30.726776 25469 consensus_queue.cc:237] T 8f462d4481754e45a6a38564f7ffacf7 P 67f2d785daf545deba69f6d4d4ea8251 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:30.731604 25176 raft_consensus.cc:515] T a90bed0f71cb4741b9fa34669e5b7bc1 P 67f2d785daf545deba69f6d4d4ea8251 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:30.733201 25176 leader_election.cc:290] T a90bed0f71cb4741b9fa34669e5b7bc1 P 67f2d785daf545deba69f6d4d4ea8251 [CANDIDATE]: Term 3 election: Requested vote from peers 1f007450922d46c1aaae5cc6be7a9452 (127.23.245.130:41957), 874f559253d64e01a7ce18b3b8f2164c (127.23.245.131:46459)
I20260709 12:22:30.733975 25250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a90bed0f71cb4741b9fa34669e5b7bc1" candidate_uuid: "67f2d785daf545deba69f6d4d4ea8251" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1f007450922d46c1aaae5cc6be7a9452"
I20260709 12:22:30.734388 25324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a90bed0f71cb4741b9fa34669e5b7bc1" candidate_uuid: "67f2d785daf545deba69f6d4d4ea8251" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "874f559253d64e01a7ce18b3b8f2164c"
I20260709 12:22:30.734524 25250 raft_consensus.cc:3055] T a90bed0f71cb4741b9fa34669e5b7bc1 P 1f007450922d46c1aaae5cc6be7a9452 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:30.734804 25324 raft_consensus.cc:3060] T a90bed0f71cb4741b9fa34669e5b7bc1 P 874f559253d64e01a7ce18b3b8f2164c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:30.734838 25250 raft_consensus.cc:740] T a90bed0f71cb4741b9fa34669e5b7bc1 P 1f007450922d46c1aaae5cc6be7a9452 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1f007450922d46c1aaae5cc6be7a9452, State: Running, Role: LEADER
I20260709 12:22:30.735843 25250 consensus_queue.cc:260] T a90bed0f71cb4741b9fa34669e5b7bc1 P 1f007450922d46c1aaae5cc6be7a9452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:30.735847 25070 catalog_manager.cc:5697] T 8f462d4481754e45a6a38564f7ffacf7 P 67f2d785daf545deba69f6d4d4ea8251 reported cstate change: term changed from 3 to 4, leader changed from 874f559253d64e01a7ce18b3b8f2164c (127.23.245.131) to 67f2d785daf545deba69f6d4d4ea8251 (127.23.245.129). New cstate: current_term: 4 leader_uuid: "67f2d785daf545deba69f6d4d4ea8251" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:30.737389 25250 raft_consensus.cc:3060] T a90bed0f71cb4741b9fa34669e5b7bc1 P 1f007450922d46c1aaae5cc6be7a9452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:30.743865 25324 raft_consensus.cc:2468] T a90bed0f71cb4741b9fa34669e5b7bc1 P 874f559253d64e01a7ce18b3b8f2164c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67f2d785daf545deba69f6d4d4ea8251 in term 3.
I20260709 12:22:30.744808 25250 raft_consensus.cc:2468] T a90bed0f71cb4741b9fa34669e5b7bc1 P 1f007450922d46c1aaae5cc6be7a9452 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67f2d785daf545deba69f6d4d4ea8251 in term 3.
I20260709 12:22:30.745281 25139 leader_election.cc:304] T a90bed0f71cb4741b9fa34669e5b7bc1 P 67f2d785daf545deba69f6d4d4ea8251 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67f2d785daf545deba69f6d4d4ea8251, 874f559253d64e01a7ce18b3b8f2164c; no voters: 
I20260709 12:22:30.746243 25469 raft_consensus.cc:2804] T a90bed0f71cb4741b9fa34669e5b7bc1 P 67f2d785daf545deba69f6d4d4ea8251 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:30.746789 25469 raft_consensus.cc:697] T a90bed0f71cb4741b9fa34669e5b7bc1 P 67f2d785daf545deba69f6d4d4ea8251 [term 3 LEADER]: Becoming Leader. State: Replica: 67f2d785daf545deba69f6d4d4ea8251, State: Running, Role: LEADER
I20260709 12:22:30.747463 25469 consensus_queue.cc:237] T a90bed0f71cb4741b9fa34669e5b7bc1 P 67f2d785daf545deba69f6d4d4ea8251 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:30.758308 25070 catalog_manager.cc:5697] T a90bed0f71cb4741b9fa34669e5b7bc1 P 67f2d785daf545deba69f6d4d4ea8251 reported cstate change: term changed from 2 to 3, leader changed from 1f007450922d46c1aaae5cc6be7a9452 (127.23.245.130) to 67f2d785daf545deba69f6d4d4ea8251 (127.23.245.129). New cstate: current_term: 3 leader_uuid: "67f2d785daf545deba69f6d4d4ea8251" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:30.860746 25495 raft_consensus.cc:993] T ae5ec568a7c04c03ab6df14b7fc861e9 P 1f007450922d46c1aaae5cc6be7a9452: : Instructing follower 67f2d785daf545deba69f6d4d4ea8251 to start an election
I20260709 12:22:30.861543 25493 raft_consensus.cc:1081] T ae5ec568a7c04c03ab6df14b7fc861e9 P 1f007450922d46c1aaae5cc6be7a9452 [term 2 LEADER]: Signalling peer 67f2d785daf545deba69f6d4d4ea8251 to start an election
I20260709 12:22:30.862304 25492 raft_consensus.cc:993] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c: : Instructing follower 67f2d785daf545deba69f6d4d4ea8251 to start an election
I20260709 12:22:30.862823 25494 raft_consensus.cc:1081] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c [term 3 LEADER]: Signalling peer 67f2d785daf545deba69f6d4d4ea8251 to start an election
I20260709 12:22:30.863300 25175 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ae5ec568a7c04c03ab6df14b7fc861e9"
dest_uuid: "67f2d785daf545deba69f6d4d4ea8251"
 from {username='slave'} at 127.0.0.1:41480
I20260709 12:22:30.863823 25175 raft_consensus.cc:493] T ae5ec568a7c04c03ab6df14b7fc861e9 P 67f2d785daf545deba69f6d4d4ea8251 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:30.864197 25175 raft_consensus.cc:3060] T ae5ec568a7c04c03ab6df14b7fc861e9 P 67f2d785daf545deba69f6d4d4ea8251 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:30.864195 25176 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0462f2e3489342489e622f469b237df2"
dest_uuid: "67f2d785daf545deba69f6d4d4ea8251"
 from {username='slave'} at 127.0.0.1:41470
I20260709 12:22:30.864848 25176 raft_consensus.cc:493] T 0462f2e3489342489e622f469b237df2 P 67f2d785daf545deba69f6d4d4ea8251 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:30.865132 25176 raft_consensus.cc:3060] T 0462f2e3489342489e622f469b237df2 P 67f2d785daf545deba69f6d4d4ea8251 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:30.870966 25176 raft_consensus.cc:515] T 0462f2e3489342489e622f469b237df2 P 67f2d785daf545deba69f6d4d4ea8251 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:30.871502 25175 raft_consensus.cc:515] T ae5ec568a7c04c03ab6df14b7fc861e9 P 67f2d785daf545deba69f6d4d4ea8251 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:30.873004 25176 leader_election.cc:290] T 0462f2e3489342489e622f469b237df2 P 67f2d785daf545deba69f6d4d4ea8251 [CANDIDATE]: Term 4 election: Requested vote from peers 1f007450922d46c1aaae5cc6be7a9452 (127.23.245.130:41957), 874f559253d64e01a7ce18b3b8f2164c (127.23.245.131:46459)
I20260709 12:22:30.874081 25175 leader_election.cc:290] T ae5ec568a7c04c03ab6df14b7fc861e9 P 67f2d785daf545deba69f6d4d4ea8251 [CANDIDATE]: Term 3 election: Requested vote from peers 1f007450922d46c1aaae5cc6be7a9452 (127.23.245.130:41957), 874f559253d64e01a7ce18b3b8f2164c (127.23.245.131:46459)
I20260709 12:22:30.873978 25251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0462f2e3489342489e622f469b237df2" candidate_uuid: "67f2d785daf545deba69f6d4d4ea8251" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1f007450922d46c1aaae5cc6be7a9452"
I20260709 12:22:30.874616 25251 raft_consensus.cc:3060] T 0462f2e3489342489e622f469b237df2 P 1f007450922d46c1aaae5cc6be7a9452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:30.875756 25250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae5ec568a7c04c03ab6df14b7fc861e9" candidate_uuid: "67f2d785daf545deba69f6d4d4ea8251" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1f007450922d46c1aaae5cc6be7a9452"
I20260709 12:22:30.876394 25250 raft_consensus.cc:3055] T ae5ec568a7c04c03ab6df14b7fc861e9 P 1f007450922d46c1aaae5cc6be7a9452 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:30.876437 25324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0462f2e3489342489e622f469b237df2" candidate_uuid: "67f2d785daf545deba69f6d4d4ea8251" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "874f559253d64e01a7ce18b3b8f2164c"
I20260709 12:22:30.876787 25250 raft_consensus.cc:740] T ae5ec568a7c04c03ab6df14b7fc861e9 P 1f007450922d46c1aaae5cc6be7a9452 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1f007450922d46c1aaae5cc6be7a9452, State: Running, Role: LEADER
I20260709 12:22:30.877059 25324 raft_consensus.cc:3055] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:30.877388 25324 raft_consensus.cc:740] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 874f559253d64e01a7ce18b3b8f2164c, State: Running, Role: LEADER
I20260709 12:22:30.877562 25250 consensus_queue.cc:260] T ae5ec568a7c04c03ab6df14b7fc861e9 P 1f007450922d46c1aaae5cc6be7a9452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:30.878146 25324 consensus_queue.cc:260] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:30.878762 25250 raft_consensus.cc:3060] T ae5ec568a7c04c03ab6df14b7fc861e9 P 1f007450922d46c1aaae5cc6be7a9452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:30.879465 25324 raft_consensus.cc:3060] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:30.880205 25325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae5ec568a7c04c03ab6df14b7fc861e9" candidate_uuid: "67f2d785daf545deba69f6d4d4ea8251" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "874f559253d64e01a7ce18b3b8f2164c"
I20260709 12:22:30.881145 25325 raft_consensus.cc:3060] T ae5ec568a7c04c03ab6df14b7fc861e9 P 874f559253d64e01a7ce18b3b8f2164c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:30.881865 25251 raft_consensus.cc:2468] T 0462f2e3489342489e622f469b237df2 P 1f007450922d46c1aaae5cc6be7a9452 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67f2d785daf545deba69f6d4d4ea8251 in term 4.
I20260709 12:22:30.883149 25141 leader_election.cc:304] T 0462f2e3489342489e622f469b237df2 P 67f2d785daf545deba69f6d4d4ea8251 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f007450922d46c1aaae5cc6be7a9452, 67f2d785daf545deba69f6d4d4ea8251; no voters: 
I20260709 12:22:30.885381 25250 raft_consensus.cc:2468] T ae5ec568a7c04c03ab6df14b7fc861e9 P 1f007450922d46c1aaae5cc6be7a9452 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67f2d785daf545deba69f6d4d4ea8251 in term 3.
I20260709 12:22:30.885958 25469 raft_consensus.cc:2804] T 0462f2e3489342489e622f469b237df2 P 67f2d785daf545deba69f6d4d4ea8251 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:30.886169 25325 raft_consensus.cc:2468] T ae5ec568a7c04c03ab6df14b7fc861e9 P 874f559253d64e01a7ce18b3b8f2164c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67f2d785daf545deba69f6d4d4ea8251 in term 3.
I20260709 12:22:30.886432 25141 leader_election.cc:304] T ae5ec568a7c04c03ab6df14b7fc861e9 P 67f2d785daf545deba69f6d4d4ea8251 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f007450922d46c1aaae5cc6be7a9452, 67f2d785daf545deba69f6d4d4ea8251; no voters: 
I20260709 12:22:30.887444 25496 raft_consensus.cc:2804] T ae5ec568a7c04c03ab6df14b7fc861e9 P 67f2d785daf545deba69f6d4d4ea8251 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:30.888005 25469 raft_consensus.cc:697] T 0462f2e3489342489e622f469b237df2 P 67f2d785daf545deba69f6d4d4ea8251 [term 4 LEADER]: Becoming Leader. State: Replica: 67f2d785daf545deba69f6d4d4ea8251, State: Running, Role: LEADER
I20260709 12:22:30.888695 25324 raft_consensus.cc:2468] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67f2d785daf545deba69f6d4d4ea8251 in term 4.
I20260709 12:22:30.889000 25469 consensus_queue.cc:237] T 0462f2e3489342489e622f469b237df2 P 67f2d785daf545deba69f6d4d4ea8251 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:30.889714 25496 raft_consensus.cc:697] T ae5ec568a7c04c03ab6df14b7fc861e9 P 67f2d785daf545deba69f6d4d4ea8251 [term 3 LEADER]: Becoming Leader. State: Replica: 67f2d785daf545deba69f6d4d4ea8251, State: Running, Role: LEADER
I20260709 12:22:30.890676 25496 consensus_queue.cc:237] T ae5ec568a7c04c03ab6df14b7fc861e9 P 67f2d785daf545deba69f6d4d4ea8251 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:30.897378 25070 catalog_manager.cc:5697] T 0462f2e3489342489e622f469b237df2 P 67f2d785daf545deba69f6d4d4ea8251 reported cstate change: term changed from 3 to 4, leader changed from 874f559253d64e01a7ce18b3b8f2164c (127.23.245.131) to 67f2d785daf545deba69f6d4d4ea8251 (127.23.245.129). New cstate: current_term: 4 leader_uuid: "67f2d785daf545deba69f6d4d4ea8251" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:30.910164 25070 catalog_manager.cc:5697] T ae5ec568a7c04c03ab6df14b7fc861e9 P 67f2d785daf545deba69f6d4d4ea8251 reported cstate change: term changed from 2 to 3, leader changed from 1f007450922d46c1aaae5cc6be7a9452 (127.23.245.130) to 67f2d785daf545deba69f6d4d4ea8251 (127.23.245.129). New cstate: current_term: 3 leader_uuid: "67f2d785daf545deba69f6d4d4ea8251" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:30.988950 25495 raft_consensus.cc:993] T b7cc944e087640eab119454448129998 P 1f007450922d46c1aaae5cc6be7a9452: : Instructing follower 67f2d785daf545deba69f6d4d4ea8251 to start an election
I20260709 12:22:30.989573 25493 raft_consensus.cc:1081] T b7cc944e087640eab119454448129998 P 1f007450922d46c1aaae5cc6be7a9452 [term 1 LEADER]: Signalling peer 67f2d785daf545deba69f6d4d4ea8251 to start an election
I20260709 12:22:30.991376 25175 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b7cc944e087640eab119454448129998"
dest_uuid: "67f2d785daf545deba69f6d4d4ea8251"
 from {username='slave'} at 127.0.0.1:41480
I20260709 12:22:30.992000 25175 raft_consensus.cc:493] T b7cc944e087640eab119454448129998 P 67f2d785daf545deba69f6d4d4ea8251 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:30.992388 25175 raft_consensus.cc:3060] T b7cc944e087640eab119454448129998 P 67f2d785daf545deba69f6d4d4ea8251 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:30.997812 25175 raft_consensus.cc:515] T b7cc944e087640eab119454448129998 P 67f2d785daf545deba69f6d4d4ea8251 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:30.999476 25175 leader_election.cc:290] T b7cc944e087640eab119454448129998 P 67f2d785daf545deba69f6d4d4ea8251 [CANDIDATE]: Term 2 election: Requested vote from peers 1f007450922d46c1aaae5cc6be7a9452 (127.23.245.130:41957), 874f559253d64e01a7ce18b3b8f2164c (127.23.245.131:46459)
I20260709 12:22:31.000499 25250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7cc944e087640eab119454448129998" candidate_uuid: "67f2d785daf545deba69f6d4d4ea8251" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1f007450922d46c1aaae5cc6be7a9452"
I20260709 12:22:31.000615 25324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7cc944e087640eab119454448129998" candidate_uuid: "67f2d785daf545deba69f6d4d4ea8251" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "874f559253d64e01a7ce18b3b8f2164c"
I20260709 12:22:31.001071 25250 raft_consensus.cc:3055] T b7cc944e087640eab119454448129998 P 1f007450922d46c1aaae5cc6be7a9452 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:31.001159 25324 raft_consensus.cc:3060] T b7cc944e087640eab119454448129998 P 874f559253d64e01a7ce18b3b8f2164c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:31.001420 25250 raft_consensus.cc:740] T b7cc944e087640eab119454448129998 P 1f007450922d46c1aaae5cc6be7a9452 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1f007450922d46c1aaae5cc6be7a9452, State: Running, Role: LEADER
I20260709 12:22:31.002120 25250 consensus_queue.cc:260] T b7cc944e087640eab119454448129998 P 1f007450922d46c1aaae5cc6be7a9452 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:31.003080 25250 raft_consensus.cc:3060] T b7cc944e087640eab119454448129998 P 1f007450922d46c1aaae5cc6be7a9452 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:31.006407 25324 raft_consensus.cc:2468] T b7cc944e087640eab119454448129998 P 874f559253d64e01a7ce18b3b8f2164c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67f2d785daf545deba69f6d4d4ea8251 in term 2.
I20260709 12:22:31.007872 25139 leader_election.cc:304] T b7cc944e087640eab119454448129998 P 67f2d785daf545deba69f6d4d4ea8251 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 67f2d785daf545deba69f6d4d4ea8251, 874f559253d64e01a7ce18b3b8f2164c; no voters: 
I20260709 12:22:31.008092 25250 raft_consensus.cc:2468] T b7cc944e087640eab119454448129998 P 1f007450922d46c1aaae5cc6be7a9452 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 67f2d785daf545deba69f6d4d4ea8251 in term 2.
I20260709 12:22:31.008960 25496 raft_consensus.cc:2804] T b7cc944e087640eab119454448129998 P 67f2d785daf545deba69f6d4d4ea8251 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:31.009471 25496 raft_consensus.cc:697] T b7cc944e087640eab119454448129998 P 67f2d785daf545deba69f6d4d4ea8251 [term 2 LEADER]: Becoming Leader. State: Replica: 67f2d785daf545deba69f6d4d4ea8251, State: Running, Role: LEADER
I20260709 12:22:31.010363 25496 consensus_queue.cc:237] T b7cc944e087640eab119454448129998 P 67f2d785daf545deba69f6d4d4ea8251 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:31.018046 25070 catalog_manager.cc:5697] T b7cc944e087640eab119454448129998 P 67f2d785daf545deba69f6d4d4ea8251 reported cstate change: term changed from 1 to 2, leader changed from 1f007450922d46c1aaae5cc6be7a9452 (127.23.245.130) to 67f2d785daf545deba69f6d4d4ea8251 (127.23.245.129). New cstate: current_term: 2 leader_uuid: "67f2d785daf545deba69f6d4d4ea8251" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:31.175462 25250 raft_consensus.cc:1275] T 8f462d4481754e45a6a38564f7ffacf7 P 1f007450922d46c1aaae5cc6be7a9452 [term 4 FOLLOWER]: Refusing update from remote peer 67f2d785daf545deba69f6d4d4ea8251: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:31.176776 25496 consensus_queue.cc:1048] T 8f462d4481754e45a6a38564f7ffacf7 P 67f2d785daf545deba69f6d4d4ea8251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:31.188778 25324 raft_consensus.cc:1275] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c [term 4 FOLLOWER]: Refusing update from remote peer 67f2d785daf545deba69f6d4d4ea8251: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:31.190464 25496 consensus_queue.cc:1048] T 8f462d4481754e45a6a38564f7ffacf7 P 67f2d785daf545deba69f6d4d4ea8251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:31.222538 25250 raft_consensus.cc:1275] T a90bed0f71cb4741b9fa34669e5b7bc1 P 1f007450922d46c1aaae5cc6be7a9452 [term 3 FOLLOWER]: Refusing update from remote peer 67f2d785daf545deba69f6d4d4ea8251: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:31.223974 25469 consensus_queue.cc:1048] T a90bed0f71cb4741b9fa34669e5b7bc1 P 67f2d785daf545deba69f6d4d4ea8251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:31.225761 25324 raft_consensus.cc:1275] T a90bed0f71cb4741b9fa34669e5b7bc1 P 874f559253d64e01a7ce18b3b8f2164c [term 3 FOLLOWER]: Refusing update from remote peer 67f2d785daf545deba69f6d4d4ea8251: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:31.227131 25469 consensus_queue.cc:1048] T a90bed0f71cb4741b9fa34669e5b7bc1 P 67f2d785daf545deba69f6d4d4ea8251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:31.414932 25250 raft_consensus.cc:1275] T b7cc944e087640eab119454448129998 P 1f007450922d46c1aaae5cc6be7a9452 [term 2 FOLLOWER]: Refusing update from remote peer 67f2d785daf545deba69f6d4d4ea8251: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:31.416160 25469 consensus_queue.cc:1048] T b7cc944e087640eab119454448129998 P 67f2d785daf545deba69f6d4d4ea8251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:31.424782 25324 raft_consensus.cc:1275] T b7cc944e087640eab119454448129998 P 874f559253d64e01a7ce18b3b8f2164c [term 2 FOLLOWER]: Refusing update from remote peer 67f2d785daf545deba69f6d4d4ea8251: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:31.426157 25514 consensus_queue.cc:1048] T b7cc944e087640eab119454448129998 P 67f2d785daf545deba69f6d4d4ea8251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:31.452101 25250 raft_consensus.cc:1275] T ae5ec568a7c04c03ab6df14b7fc861e9 P 1f007450922d46c1aaae5cc6be7a9452 [term 3 FOLLOWER]: Refusing update from remote peer 67f2d785daf545deba69f6d4d4ea8251: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:31.453444 25514 consensus_queue.cc:1048] T ae5ec568a7c04c03ab6df14b7fc861e9 P 67f2d785daf545deba69f6d4d4ea8251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:31.463310 25324 raft_consensus.cc:1275] T ae5ec568a7c04c03ab6df14b7fc861e9 P 874f559253d64e01a7ce18b3b8f2164c [term 3 FOLLOWER]: Refusing update from remote peer 67f2d785daf545deba69f6d4d4ea8251: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:31.463471 25251 raft_consensus.cc:1275] T 0462f2e3489342489e622f469b237df2 P 1f007450922d46c1aaae5cc6be7a9452 [term 4 FOLLOWER]: Refusing update from remote peer 67f2d785daf545deba69f6d4d4ea8251: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:31.464262 25325 raft_consensus.cc:1275] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c [term 4 FOLLOWER]: Refusing update from remote peer 67f2d785daf545deba69f6d4d4ea8251: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:31.464860 25469 consensus_queue.cc:1048] T ae5ec568a7c04c03ab6df14b7fc861e9 P 67f2d785daf545deba69f6d4d4ea8251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:31.466109 25503 consensus_queue.cc:1048] T 0462f2e3489342489e622f469b237df2 P 67f2d785daf545deba69f6d4d4ea8251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:31.466784 25469 consensus_queue.cc:1048] T 0462f2e3489342489e622f469b237df2 P 67f2d785daf545deba69f6d4d4ea8251 [LEADER]: Connected to new peer: Peer: permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:33.678328 24534 auto_leader_rebalancer-test.cc:399] The leader distribution is 
I20260709 12:22:33.679076 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:33.686879 25175 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0c686b019831496188c502a729a4db8a"
dest_uuid: "67f2d785daf545deba69f6d4d4ea8251"
mode: GRACEFUL
new_leader_uuid: "874f559253d64e01a7ce18b3b8f2164c"
 from {username='slave'} at 127.0.0.1:41500
I20260709 12:22:33.687436 25175 raft_consensus.cc:606] T 0c686b019831496188c502a729a4db8a P 67f2d785daf545deba69f6d4d4ea8251 [term 2 LEADER]: Received request to transfer leadership to TS 874f559253d64e01a7ce18b3b8f2164c
I20260709 12:22:33.690028 25175 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "39cf9b9227204dd497e8ef50f1beb2bc"
dest_uuid: "67f2d785daf545deba69f6d4d4ea8251"
mode: GRACEFUL
new_leader_uuid: "874f559253d64e01a7ce18b3b8f2164c"
 from {username='slave'} at 127.0.0.1:41500
I20260709 12:22:33.690500 25175 raft_consensus.cc:606] T 39cf9b9227204dd497e8ef50f1beb2bc P 67f2d785daf545deba69f6d4d4ea8251 [term 2 LEADER]: Received request to transfer leadership to TS 874f559253d64e01a7ce18b3b8f2164c
I20260709 12:22:33.692665 25175 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a90bed0f71cb4741b9fa34669e5b7bc1"
dest_uuid: "67f2d785daf545deba69f6d4d4ea8251"
mode: GRACEFUL
new_leader_uuid: "1f007450922d46c1aaae5cc6be7a9452"
 from {username='slave'} at 127.0.0.1:41500
I20260709 12:22:33.693169 25175 raft_consensus.cc:606] T a90bed0f71cb4741b9fa34669e5b7bc1 P 67f2d785daf545deba69f6d4d4ea8251 [term 3 LEADER]: Received request to transfer leadership to TS 1f007450922d46c1aaae5cc6be7a9452
I20260709 12:22:33.695261 25175 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b7cc944e087640eab119454448129998"
dest_uuid: "67f2d785daf545deba69f6d4d4ea8251"
mode: GRACEFUL
new_leader_uuid: "1f007450922d46c1aaae5cc6be7a9452"
 from {username='slave'} at 127.0.0.1:41500
I20260709 12:22:33.695701 25175 raft_consensus.cc:606] T b7cc944e087640eab119454448129998 P 67f2d785daf545deba69f6d4d4ea8251 [term 2 LEADER]: Received request to transfer leadership to TS 1f007450922d46c1aaae5cc6be7a9452
I20260709 12:22:33.696702 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:22:33.697288 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:33.736235 25503 raft_consensus.cc:993] T 39cf9b9227204dd497e8ef50f1beb2bc P 67f2d785daf545deba69f6d4d4ea8251: : Instructing follower 874f559253d64e01a7ce18b3b8f2164c to start an election
I20260709 12:22:33.736707 25503 raft_consensus.cc:1081] T 39cf9b9227204dd497e8ef50f1beb2bc P 67f2d785daf545deba69f6d4d4ea8251 [term 2 LEADER]: Signalling peer 874f559253d64e01a7ce18b3b8f2164c to start an election
I20260709 12:22:33.737986 25324 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "39cf9b9227204dd497e8ef50f1beb2bc"
dest_uuid: "874f559253d64e01a7ce18b3b8f2164c"
 from {username='slave'} at 127.0.0.1:57880
I20260709 12:22:33.738427 25324 raft_consensus.cc:493] T 39cf9b9227204dd497e8ef50f1beb2bc P 874f559253d64e01a7ce18b3b8f2164c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:33.738711 25324 raft_consensus.cc:3060] T 39cf9b9227204dd497e8ef50f1beb2bc P 874f559253d64e01a7ce18b3b8f2164c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:33.743018 25324 raft_consensus.cc:515] T 39cf9b9227204dd497e8ef50f1beb2bc P 874f559253d64e01a7ce18b3b8f2164c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:33.744814 25324 leader_election.cc:290] T 39cf9b9227204dd497e8ef50f1beb2bc P 874f559253d64e01a7ce18b3b8f2164c [CANDIDATE]: Term 3 election: Requested vote from peers 67f2d785daf545deba69f6d4d4ea8251 (127.23.245.129:41731), 1f007450922d46c1aaae5cc6be7a9452 (127.23.245.130:41957)
I20260709 12:22:33.745805 25251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cf9b9227204dd497e8ef50f1beb2bc" candidate_uuid: "874f559253d64e01a7ce18b3b8f2164c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1f007450922d46c1aaae5cc6be7a9452"
I20260709 12:22:33.745657 25175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cf9b9227204dd497e8ef50f1beb2bc" candidate_uuid: "874f559253d64e01a7ce18b3b8f2164c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "67f2d785daf545deba69f6d4d4ea8251"
I20260709 12:22:33.746275 25251 raft_consensus.cc:3060] T 39cf9b9227204dd497e8ef50f1beb2bc P 1f007450922d46c1aaae5cc6be7a9452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:33.746390 25175 raft_consensus.cc:3055] T 39cf9b9227204dd497e8ef50f1beb2bc P 67f2d785daf545deba69f6d4d4ea8251 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:33.746747 25175 raft_consensus.cc:740] T 39cf9b9227204dd497e8ef50f1beb2bc P 67f2d785daf545deba69f6d4d4ea8251 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 67f2d785daf545deba69f6d4d4ea8251, State: Running, Role: LEADER
I20260709 12:22:33.747457 25175 consensus_queue.cc:260] T 39cf9b9227204dd497e8ef50f1beb2bc P 67f2d785daf545deba69f6d4d4ea8251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:33.748407 25175 raft_consensus.cc:3060] T 39cf9b9227204dd497e8ef50f1beb2bc P 67f2d785daf545deba69f6d4d4ea8251 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:33.750435 25251 raft_consensus.cc:2468] T 39cf9b9227204dd497e8ef50f1beb2bc P 1f007450922d46c1aaae5cc6be7a9452 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 874f559253d64e01a7ce18b3b8f2164c in term 3.
I20260709 12:22:33.751519 25290 leader_election.cc:304] T 39cf9b9227204dd497e8ef50f1beb2bc P 874f559253d64e01a7ce18b3b8f2164c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f007450922d46c1aaae5cc6be7a9452, 874f559253d64e01a7ce18b3b8f2164c; no voters: 
I20260709 12:22:33.752278 25494 raft_consensus.cc:2804] T 39cf9b9227204dd497e8ef50f1beb2bc P 874f559253d64e01a7ce18b3b8f2164c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:33.753238 25494 raft_consensus.cc:697] T 39cf9b9227204dd497e8ef50f1beb2bc P 874f559253d64e01a7ce18b3b8f2164c [term 3 LEADER]: Becoming Leader. State: Replica: 874f559253d64e01a7ce18b3b8f2164c, State: Running, Role: LEADER
I20260709 12:22:33.753479 25175 raft_consensus.cc:2468] T 39cf9b9227204dd497e8ef50f1beb2bc P 67f2d785daf545deba69f6d4d4ea8251 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 874f559253d64e01a7ce18b3b8f2164c in term 3.
I20260709 12:22:33.754163 25494 consensus_queue.cc:237] T 39cf9b9227204dd497e8ef50f1beb2bc P 874f559253d64e01a7ce18b3b8f2164c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:33.760766 25071 catalog_manager.cc:5697] T 39cf9b9227204dd497e8ef50f1beb2bc P 874f559253d64e01a7ce18b3b8f2164c reported cstate change: term changed from 2 to 3, leader changed from 67f2d785daf545deba69f6d4d4ea8251 (127.23.245.129) to 874f559253d64e01a7ce18b3b8f2164c (127.23.245.131). New cstate: current_term: 3 leader_uuid: "874f559253d64e01a7ce18b3b8f2164c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:33.812071 25523 raft_consensus.cc:993] T 0c686b019831496188c502a729a4db8a P 67f2d785daf545deba69f6d4d4ea8251: : Instructing follower 874f559253d64e01a7ce18b3b8f2164c to start an election
I20260709 12:22:33.812541 25503 raft_consensus.cc:1081] T 0c686b019831496188c502a729a4db8a P 67f2d785daf545deba69f6d4d4ea8251 [term 2 LEADER]: Signalling peer 874f559253d64e01a7ce18b3b8f2164c to start an election
I20260709 12:22:33.813866 25324 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0c686b019831496188c502a729a4db8a"
dest_uuid: "874f559253d64e01a7ce18b3b8f2164c"
 from {username='slave'} at 127.0.0.1:57880
I20260709 12:22:33.814311 25324 raft_consensus.cc:493] T 0c686b019831496188c502a729a4db8a P 874f559253d64e01a7ce18b3b8f2164c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:33.814690 25324 raft_consensus.cc:3060] T 0c686b019831496188c502a729a4db8a P 874f559253d64e01a7ce18b3b8f2164c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:33.819092 25324 raft_consensus.cc:515] T 0c686b019831496188c502a729a4db8a P 874f559253d64e01a7ce18b3b8f2164c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:33.820670 25324 leader_election.cc:290] T 0c686b019831496188c502a729a4db8a P 874f559253d64e01a7ce18b3b8f2164c [CANDIDATE]: Term 3 election: Requested vote from peers 67f2d785daf545deba69f6d4d4ea8251 (127.23.245.129:41731), 1f007450922d46c1aaae5cc6be7a9452 (127.23.245.130:41957)
I20260709 12:22:33.821496 25175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c686b019831496188c502a729a4db8a" candidate_uuid: "874f559253d64e01a7ce18b3b8f2164c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "67f2d785daf545deba69f6d4d4ea8251"
I20260709 12:22:33.821682 25251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c686b019831496188c502a729a4db8a" candidate_uuid: "874f559253d64e01a7ce18b3b8f2164c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1f007450922d46c1aaae5cc6be7a9452"
I20260709 12:22:33.822049 25175 raft_consensus.cc:3055] T 0c686b019831496188c502a729a4db8a P 67f2d785daf545deba69f6d4d4ea8251 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:33.822209 25251 raft_consensus.cc:3060] T 0c686b019831496188c502a729a4db8a P 1f007450922d46c1aaae5cc6be7a9452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:33.822407 25175 raft_consensus.cc:740] T 0c686b019831496188c502a729a4db8a P 67f2d785daf545deba69f6d4d4ea8251 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 67f2d785daf545deba69f6d4d4ea8251, State: Running, Role: LEADER
I20260709 12:22:33.823199 25175 consensus_queue.cc:260] T 0c686b019831496188c502a729a4db8a P 67f2d785daf545deba69f6d4d4ea8251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:33.824301 25175 raft_consensus.cc:3060] T 0c686b019831496188c502a729a4db8a P 67f2d785daf545deba69f6d4d4ea8251 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:33.826653 25251 raft_consensus.cc:2468] T 0c686b019831496188c502a729a4db8a P 1f007450922d46c1aaae5cc6be7a9452 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 874f559253d64e01a7ce18b3b8f2164c in term 3.
I20260709 12:22:33.827596 25290 leader_election.cc:304] T 0c686b019831496188c502a729a4db8a P 874f559253d64e01a7ce18b3b8f2164c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f007450922d46c1aaae5cc6be7a9452, 874f559253d64e01a7ce18b3b8f2164c; no voters: 
I20260709 12:22:33.828451 25494 raft_consensus.cc:2804] T 0c686b019831496188c502a729a4db8a P 874f559253d64e01a7ce18b3b8f2164c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:33.828898 25494 raft_consensus.cc:697] T 0c686b019831496188c502a729a4db8a P 874f559253d64e01a7ce18b3b8f2164c [term 3 LEADER]: Becoming Leader. State: Replica: 874f559253d64e01a7ce18b3b8f2164c, State: Running, Role: LEADER
I20260709 12:22:33.829706 25494 consensus_queue.cc:237] T 0c686b019831496188c502a729a4db8a P 874f559253d64e01a7ce18b3b8f2164c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:33.830073 25175 raft_consensus.cc:2468] T 0c686b019831496188c502a729a4db8a P 67f2d785daf545deba69f6d4d4ea8251 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 874f559253d64e01a7ce18b3b8f2164c in term 3.
I20260709 12:22:33.837283 25071 catalog_manager.cc:5697] T 0c686b019831496188c502a729a4db8a P 874f559253d64e01a7ce18b3b8f2164c reported cstate change: term changed from 2 to 3, leader changed from 67f2d785daf545deba69f6d4d4ea8251 (127.23.245.129) to 874f559253d64e01a7ce18b3b8f2164c (127.23.245.131). New cstate: current_term: 3 leader_uuid: "874f559253d64e01a7ce18b3b8f2164c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:33.862561 25503 raft_consensus.cc:993] T b7cc944e087640eab119454448129998 P 67f2d785daf545deba69f6d4d4ea8251: : Instructing follower 1f007450922d46c1aaae5cc6be7a9452 to start an election
I20260709 12:22:33.863161 25503 raft_consensus.cc:1081] T b7cc944e087640eab119454448129998 P 67f2d785daf545deba69f6d4d4ea8251 [term 2 LEADER]: Signalling peer 1f007450922d46c1aaae5cc6be7a9452 to start an election
I20260709 12:22:33.864821 25251 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b7cc944e087640eab119454448129998"
dest_uuid: "1f007450922d46c1aaae5cc6be7a9452"
 from {username='slave'} at 127.0.0.1:41620
I20260709 12:22:33.865377 25251 raft_consensus.cc:493] T b7cc944e087640eab119454448129998 P 1f007450922d46c1aaae5cc6be7a9452 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:33.865669 25251 raft_consensus.cc:3060] T b7cc944e087640eab119454448129998 P 1f007450922d46c1aaae5cc6be7a9452 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:33.870602 25251 raft_consensus.cc:515] T b7cc944e087640eab119454448129998 P 1f007450922d46c1aaae5cc6be7a9452 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:33.872454 25251 leader_election.cc:290] T b7cc944e087640eab119454448129998 P 1f007450922d46c1aaae5cc6be7a9452 [CANDIDATE]: Term 3 election: Requested vote from peers 67f2d785daf545deba69f6d4d4ea8251 (127.23.245.129:41731), 874f559253d64e01a7ce18b3b8f2164c (127.23.245.131:46459)
I20260709 12:22:33.873361 25175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7cc944e087640eab119454448129998" candidate_uuid: "1f007450922d46c1aaae5cc6be7a9452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "67f2d785daf545deba69f6d4d4ea8251"
I20260709 12:22:33.873588 25324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7cc944e087640eab119454448129998" candidate_uuid: "1f007450922d46c1aaae5cc6be7a9452" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "874f559253d64e01a7ce18b3b8f2164c"
I20260709 12:22:33.873844 25175 raft_consensus.cc:3055] T b7cc944e087640eab119454448129998 P 67f2d785daf545deba69f6d4d4ea8251 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:33.874136 25175 raft_consensus.cc:740] T b7cc944e087640eab119454448129998 P 67f2d785daf545deba69f6d4d4ea8251 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 67f2d785daf545deba69f6d4d4ea8251, State: Running, Role: LEADER
I20260709 12:22:33.874804 25324 raft_consensus.cc:3060] T b7cc944e087640eab119454448129998 P 874f559253d64e01a7ce18b3b8f2164c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:33.874773 25175 consensus_queue.cc:260] T b7cc944e087640eab119454448129998 P 67f2d785daf545deba69f6d4d4ea8251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:33.875706 25175 raft_consensus.cc:3060] T b7cc944e087640eab119454448129998 P 67f2d785daf545deba69f6d4d4ea8251 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:33.879142 25324 raft_consensus.cc:2468] T b7cc944e087640eab119454448129998 P 874f559253d64e01a7ce18b3b8f2164c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f007450922d46c1aaae5cc6be7a9452 in term 3.
I20260709 12:22:33.879568 25175 raft_consensus.cc:2468] T b7cc944e087640eab119454448129998 P 67f2d785daf545deba69f6d4d4ea8251 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f007450922d46c1aaae5cc6be7a9452 in term 3.
I20260709 12:22:33.880398 25214 leader_election.cc:304] T b7cc944e087640eab119454448129998 P 1f007450922d46c1aaae5cc6be7a9452 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f007450922d46c1aaae5cc6be7a9452, 874f559253d64e01a7ce18b3b8f2164c; no voters: 
I20260709 12:22:33.881039 25493 raft_consensus.cc:2804] T b7cc944e087640eab119454448129998 P 1f007450922d46c1aaae5cc6be7a9452 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:33.882126 25493 raft_consensus.cc:697] T b7cc944e087640eab119454448129998 P 1f007450922d46c1aaae5cc6be7a9452 [term 3 LEADER]: Becoming Leader. State: Replica: 1f007450922d46c1aaae5cc6be7a9452, State: Running, Role: LEADER
I20260709 12:22:33.882813 25493 consensus_queue.cc:237] T b7cc944e087640eab119454448129998 P 1f007450922d46c1aaae5cc6be7a9452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:33.889657 25071 catalog_manager.cc:5697] T b7cc944e087640eab119454448129998 P 1f007450922d46c1aaae5cc6be7a9452 reported cstate change: term changed from 2 to 3, leader changed from 67f2d785daf545deba69f6d4d4ea8251 (127.23.245.129) to 1f007450922d46c1aaae5cc6be7a9452 (127.23.245.130). New cstate: current_term: 3 leader_uuid: "1f007450922d46c1aaae5cc6be7a9452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:34.033493 25523 raft_consensus.cc:993] T a90bed0f71cb4741b9fa34669e5b7bc1 P 67f2d785daf545deba69f6d4d4ea8251: : Instructing follower 1f007450922d46c1aaae5cc6be7a9452 to start an election
I20260709 12:22:34.033988 25503 raft_consensus.cc:1081] T a90bed0f71cb4741b9fa34669e5b7bc1 P 67f2d785daf545deba69f6d4d4ea8251 [term 3 LEADER]: Signalling peer 1f007450922d46c1aaae5cc6be7a9452 to start an election
I20260709 12:22:34.035754 25251 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a90bed0f71cb4741b9fa34669e5b7bc1"
dest_uuid: "1f007450922d46c1aaae5cc6be7a9452"
 from {username='slave'} at 127.0.0.1:41620
I20260709 12:22:34.036346 25251 raft_consensus.cc:493] T a90bed0f71cb4741b9fa34669e5b7bc1 P 1f007450922d46c1aaae5cc6be7a9452 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:34.036612 25251 raft_consensus.cc:3060] T a90bed0f71cb4741b9fa34669e5b7bc1 P 1f007450922d46c1aaae5cc6be7a9452 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:34.041445 25251 raft_consensus.cc:515] T a90bed0f71cb4741b9fa34669e5b7bc1 P 1f007450922d46c1aaae5cc6be7a9452 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:34.043282 25251 leader_election.cc:290] T a90bed0f71cb4741b9fa34669e5b7bc1 P 1f007450922d46c1aaae5cc6be7a9452 [CANDIDATE]: Term 4 election: Requested vote from peers 67f2d785daf545deba69f6d4d4ea8251 (127.23.245.129:41731), 874f559253d64e01a7ce18b3b8f2164c (127.23.245.131:46459)
I20260709 12:22:34.044181 25175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a90bed0f71cb4741b9fa34669e5b7bc1" candidate_uuid: "1f007450922d46c1aaae5cc6be7a9452" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "67f2d785daf545deba69f6d4d4ea8251"
I20260709 12:22:34.044484 25324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a90bed0f71cb4741b9fa34669e5b7bc1" candidate_uuid: "1f007450922d46c1aaae5cc6be7a9452" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "874f559253d64e01a7ce18b3b8f2164c"
I20260709 12:22:34.044791 25175 raft_consensus.cc:3055] T a90bed0f71cb4741b9fa34669e5b7bc1 P 67f2d785daf545deba69f6d4d4ea8251 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:34.044970 25324 raft_consensus.cc:3060] T a90bed0f71cb4741b9fa34669e5b7bc1 P 874f559253d64e01a7ce18b3b8f2164c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:34.045137 25175 raft_consensus.cc:740] T a90bed0f71cb4741b9fa34669e5b7bc1 P 67f2d785daf545deba69f6d4d4ea8251 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 67f2d785daf545deba69f6d4d4ea8251, State: Running, Role: LEADER
I20260709 12:22:34.045887 25175 consensus_queue.cc:260] T a90bed0f71cb4741b9fa34669e5b7bc1 P 67f2d785daf545deba69f6d4d4ea8251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:34.046977 25175 raft_consensus.cc:3060] T a90bed0f71cb4741b9fa34669e5b7bc1 P 67f2d785daf545deba69f6d4d4ea8251 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:34.052413 25324 raft_consensus.cc:2468] T a90bed0f71cb4741b9fa34669e5b7bc1 P 874f559253d64e01a7ce18b3b8f2164c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f007450922d46c1aaae5cc6be7a9452 in term 4.
I20260709 12:22:34.053494 25175 raft_consensus.cc:2468] T a90bed0f71cb4741b9fa34669e5b7bc1 P 67f2d785daf545deba69f6d4d4ea8251 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f007450922d46c1aaae5cc6be7a9452 in term 4.
I20260709 12:22:34.053682 25214 leader_election.cc:304] T a90bed0f71cb4741b9fa34669e5b7bc1 P 1f007450922d46c1aaae5cc6be7a9452 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f007450922d46c1aaae5cc6be7a9452, 874f559253d64e01a7ce18b3b8f2164c; no voters: 
I20260709 12:22:34.055070 25493 raft_consensus.cc:2804] T a90bed0f71cb4741b9fa34669e5b7bc1 P 1f007450922d46c1aaae5cc6be7a9452 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:34.055537 25493 raft_consensus.cc:697] T a90bed0f71cb4741b9fa34669e5b7bc1 P 1f007450922d46c1aaae5cc6be7a9452 [term 4 LEADER]: Becoming Leader. State: Replica: 1f007450922d46c1aaae5cc6be7a9452, State: Running, Role: LEADER
I20260709 12:22:34.056358 25493 consensus_queue.cc:237] T a90bed0f71cb4741b9fa34669e5b7bc1 P 1f007450922d46c1aaae5cc6be7a9452 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } }
I20260709 12:22:34.063336 25071 catalog_manager.cc:5697] T a90bed0f71cb4741b9fa34669e5b7bc1 P 1f007450922d46c1aaae5cc6be7a9452 reported cstate change: term changed from 3 to 4, leader changed from 67f2d785daf545deba69f6d4d4ea8251 (127.23.245.129) to 1f007450922d46c1aaae5cc6be7a9452 (127.23.245.130). New cstate: current_term: 4 leader_uuid: "1f007450922d46c1aaae5cc6be7a9452" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:34.190958 25175 raft_consensus.cc:1275] T 39cf9b9227204dd497e8ef50f1beb2bc P 67f2d785daf545deba69f6d4d4ea8251 [term 3 FOLLOWER]: Refusing update from remote peer 874f559253d64e01a7ce18b3b8f2164c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:34.192282 25494 consensus_queue.cc:1048] T 39cf9b9227204dd497e8ef50f1beb2bc P 874f559253d64e01a7ce18b3b8f2164c [LEADER]: Connected to new peer: Peer: permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:34.202597 25251 raft_consensus.cc:1275] T 39cf9b9227204dd497e8ef50f1beb2bc P 1f007450922d46c1aaae5cc6be7a9452 [term 3 FOLLOWER]: Refusing update from remote peer 874f559253d64e01a7ce18b3b8f2164c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:34.204277 25536 consensus_queue.cc:1048] T 39cf9b9227204dd497e8ef50f1beb2bc P 874f559253d64e01a7ce18b3b8f2164c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:34.277557 25250 raft_consensus.cc:1275] T 0c686b019831496188c502a729a4db8a P 1f007450922d46c1aaae5cc6be7a9452 [term 3 FOLLOWER]: Refusing update from remote peer 874f559253d64e01a7ce18b3b8f2164c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:34.278746 25536 consensus_queue.cc:1048] T 0c686b019831496188c502a729a4db8a P 874f559253d64e01a7ce18b3b8f2164c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f007450922d46c1aaae5cc6be7a9452" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 41957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:34.288576 25175 raft_consensus.cc:1275] T 0c686b019831496188c502a729a4db8a P 67f2d785daf545deba69f6d4d4ea8251 [term 3 FOLLOWER]: Refusing update from remote peer 874f559253d64e01a7ce18b3b8f2164c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:34.290046 25536 consensus_queue.cc:1048] T 0c686b019831496188c502a729a4db8a P 874f559253d64e01a7ce18b3b8f2164c [LEADER]: Connected to new peer: Peer: permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:34.390935 25324 raft_consensus.cc:1275] T b7cc944e087640eab119454448129998 P 874f559253d64e01a7ce18b3b8f2164c [term 3 FOLLOWER]: Refusing update from remote peer 1f007450922d46c1aaae5cc6be7a9452: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:34.392140 25493 consensus_queue.cc:1048] T b7cc944e087640eab119454448129998 P 1f007450922d46c1aaae5cc6be7a9452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:34.400228 25175 raft_consensus.cc:1275] T b7cc944e087640eab119454448129998 P 67f2d785daf545deba69f6d4d4ea8251 [term 3 FOLLOWER]: Refusing update from remote peer 1f007450922d46c1aaae5cc6be7a9452: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:34.403105 25531 consensus_queue.cc:1048] T b7cc944e087640eab119454448129998 P 1f007450922d46c1aaae5cc6be7a9452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:34.545527 25175 raft_consensus.cc:1275] T a90bed0f71cb4741b9fa34669e5b7bc1 P 67f2d785daf545deba69f6d4d4ea8251 [term 4 FOLLOWER]: Refusing update from remote peer 1f007450922d46c1aaae5cc6be7a9452: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:34.546730 25531 consensus_queue.cc:1048] T a90bed0f71cb4741b9fa34669e5b7bc1 P 1f007450922d46c1aaae5cc6be7a9452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67f2d785daf545deba69f6d4d4ea8251" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 41731 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:34.554858 25324 raft_consensus.cc:1275] T a90bed0f71cb4741b9fa34669e5b7bc1 P 874f559253d64e01a7ce18b3b8f2164c [term 4 FOLLOWER]: Refusing update from remote peer 1f007450922d46c1aaae5cc6be7a9452: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:34.556324 25493 consensus_queue.cc:1048] T a90bed0f71cb4741b9fa34669e5b7bc1 P 1f007450922d46c1aaae5cc6be7a9452 [LEADER]: Connected to new peer: Peer: permanent_uuid: "874f559253d64e01a7ce18b3b8f2164c" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 46459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:34.728632 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:34.745664 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:34.746292 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:35.747959 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:35.753278 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:35.753712 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:22:36.105569 25346 debug-util.cc:398] Leaking SignalData structure 0x7b080010afa0 after lost signal to thread 24537
W20260709 12:22:36.106387 25346 debug-util.cc:398] Leaking SignalData structure 0x7b08000a5760 after lost signal to thread 25108
W20260709 12:22:36.107333 25346 debug-util.cc:398] Leaking SignalData structure 0x7b08000d9e40 after lost signal to thread 25200
W20260709 12:22:36.108094 25346 debug-util.cc:398] Leaking SignalData structure 0x7b0800149640 after lost signal to thread 25275
W20260709 12:22:36.108798 25346 debug-util.cc:398] Leaking SignalData structure 0x7b08000a16c0 after lost signal to thread 25349
I20260709 12:22:36.754752 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:36.760412 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:36.760856 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:37.761771 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:37.767437 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:37.767978 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:38.768959 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:38.774487 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:38.774963 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:39.776001 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:39.781461 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:39.781966 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:40.864708 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:40.869935 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:40.870395 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:22:41.691583 25272 debug-util.cc:398] Leaking SignalData structure 0x7b0800104b00 after lost signal to thread 24537
W20260709 12:22:41.692584 25272 debug-util.cc:398] Leaking SignalData structure 0x7b08001011e0 after lost signal to thread 25108
W20260709 12:22:41.693588 25272 debug-util.cc:398] Leaking SignalData structure 0x7b08000cbee0 after lost signal to thread 25200
W20260709 12:22:41.694515 25272 debug-util.cc:398] Leaking SignalData structure 0x7b08000a68e0 after lost signal to thread 25275
W20260709 12:22:41.695319 25272 debug-util.cc:398] Leaking SignalData structure 0x7b080010eb60 after lost signal to thread 25349
I20260709 12:22:41.871474 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:41.879110 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:41.879627 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:42.880589 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:42.886868 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:42.887329 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:43.921414 24534 auto_leader_rebalancer-test.cc:410] The leader distribution is 
I20260709 12:22:43.922024 24534 tablet_server.cc:179] TabletServer@127.23.245.129:0 shutting down...
W20260709 12:22:43.934510 25214 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 4 similar messages]
W20260709 12:22:43.942021 25214 consensus_peers.cc:597] T b7cc944e087640eab119454448129998 P 1f007450922d46c1aaae5cc6be7a9452 -> Peer 67f2d785daf545deba69f6d4d4ea8251 (127.23.245.129:41731): Couldn't send request to peer 67f2d785daf545deba69f6d4d4ea8251. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:43.957221 24534 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:43.958074 24534 tablet_replica.cc:333] T 09fa2961864c4c999f036a784f0da8cf P 67f2d785daf545deba69f6d4d4ea8251: stopping tablet replica
I20260709 12:22:43.958721 24534 raft_consensus.cc:2243] T 09fa2961864c4c999f036a784f0da8cf P 67f2d785daf545deba69f6d4d4ea8251 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:43.959479 24534 raft_consensus.cc:2272] T 09fa2961864c4c999f036a784f0da8cf P 67f2d785daf545deba69f6d4d4ea8251 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:43.961668 24534 tablet_replica.cc:333] T ae5ec568a7c04c03ab6df14b7fc861e9 P 67f2d785daf545deba69f6d4d4ea8251: stopping tablet replica
I20260709 12:22:43.962258 24534 raft_consensus.cc:2243] T ae5ec568a7c04c03ab6df14b7fc861e9 P 67f2d785daf545deba69f6d4d4ea8251 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:43.963114 24534 raft_consensus.cc:2272] T ae5ec568a7c04c03ab6df14b7fc861e9 P 67f2d785daf545deba69f6d4d4ea8251 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:43.965094 24534 tablet_replica.cc:333] T 8f462d4481754e45a6a38564f7ffacf7 P 67f2d785daf545deba69f6d4d4ea8251: stopping tablet replica
I20260709 12:22:43.965646 24534 raft_consensus.cc:2243] T 8f462d4481754e45a6a38564f7ffacf7 P 67f2d785daf545deba69f6d4d4ea8251 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:22:43.966473 24534 raft_consensus.cc:2272] T 8f462d4481754e45a6a38564f7ffacf7 P 67f2d785daf545deba69f6d4d4ea8251 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:43.968350 24534 tablet_replica.cc:333] T a90bed0f71cb4741b9fa34669e5b7bc1 P 67f2d785daf545deba69f6d4d4ea8251: stopping tablet replica
I20260709 12:22:43.968844 24534 raft_consensus.cc:2243] T a90bed0f71cb4741b9fa34669e5b7bc1 P 67f2d785daf545deba69f6d4d4ea8251 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:43.969242 24534 raft_consensus.cc:2272] T a90bed0f71cb4741b9fa34669e5b7bc1 P 67f2d785daf545deba69f6d4d4ea8251 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:43.971218 24534 tablet_replica.cc:333] T 39cf9b9227204dd497e8ef50f1beb2bc P 67f2d785daf545deba69f6d4d4ea8251: stopping tablet replica
I20260709 12:22:43.971771 24534 raft_consensus.cc:2243] T 39cf9b9227204dd497e8ef50f1beb2bc P 67f2d785daf545deba69f6d4d4ea8251 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:43.972312 24534 raft_consensus.cc:2272] T 39cf9b9227204dd497e8ef50f1beb2bc P 67f2d785daf545deba69f6d4d4ea8251 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:43.974603 24534 tablet_replica.cc:333] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 67f2d785daf545deba69f6d4d4ea8251: stopping tablet replica
I20260709 12:22:43.975227 24534 raft_consensus.cc:2243] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 67f2d785daf545deba69f6d4d4ea8251 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:43.976135 24534 raft_consensus.cc:2272] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 67f2d785daf545deba69f6d4d4ea8251 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:43.978477 24534 tablet_replica.cc:333] T 0462f2e3489342489e622f469b237df2 P 67f2d785daf545deba69f6d4d4ea8251: stopping tablet replica
I20260709 12:22:43.978988 24534 raft_consensus.cc:2243] T 0462f2e3489342489e622f469b237df2 P 67f2d785daf545deba69f6d4d4ea8251 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:22:43.979809 24534 raft_consensus.cc:2272] T 0462f2e3489342489e622f469b237df2 P 67f2d785daf545deba69f6d4d4ea8251 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:43.981673 24534 tablet_replica.cc:333] T 0c686b019831496188c502a729a4db8a P 67f2d785daf545deba69f6d4d4ea8251: stopping tablet replica
I20260709 12:22:43.982210 24534 raft_consensus.cc:2243] T 0c686b019831496188c502a729a4db8a P 67f2d785daf545deba69f6d4d4ea8251 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:43.982637 24534 raft_consensus.cc:2272] T 0c686b019831496188c502a729a4db8a P 67f2d785daf545deba69f6d4d4ea8251 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:43.984459 24534 tablet_replica.cc:333] T 6afaae01b5b5406cac56ad99ce7f3482 P 67f2d785daf545deba69f6d4d4ea8251: stopping tablet replica
I20260709 12:22:43.984937 24534 raft_consensus.cc:2243] T 6afaae01b5b5406cac56ad99ce7f3482 P 67f2d785daf545deba69f6d4d4ea8251 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:43.985431 24534 raft_consensus.cc:2272] T 6afaae01b5b5406cac56ad99ce7f3482 P 67f2d785daf545deba69f6d4d4ea8251 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:43.987283 24534 tablet_replica.cc:333] T b7cc944e087640eab119454448129998 P 67f2d785daf545deba69f6d4d4ea8251: stopping tablet replica
I20260709 12:22:43.987712 24534 raft_consensus.cc:2243] T b7cc944e087640eab119454448129998 P 67f2d785daf545deba69f6d4d4ea8251 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:43.988188 24534 raft_consensus.cc:2272] T b7cc944e087640eab119454448129998 P 67f2d785daf545deba69f6d4d4ea8251 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:44.020918 24534 tablet_server.cc:196] TabletServer@127.23.245.129:0 shutdown complete.
I20260709 12:22:44.048301 24534 tablet_server.cc:179] TabletServer@127.23.245.130:0 shutting down...
I20260709 12:22:44.081059 24534 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:44.081900 24534 tablet_replica.cc:333] T 09fa2961864c4c999f036a784f0da8cf P 1f007450922d46c1aaae5cc6be7a9452: stopping tablet replica
I20260709 12:22:44.082608 24534 raft_consensus.cc:2243] T 09fa2961864c4c999f036a784f0da8cf P 1f007450922d46c1aaae5cc6be7a9452 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:44.083395 24534 raft_consensus.cc:2272] T 09fa2961864c4c999f036a784f0da8cf P 1f007450922d46c1aaae5cc6be7a9452 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:44.085575 24534 tablet_replica.cc:333] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 1f007450922d46c1aaae5cc6be7a9452: stopping tablet replica
I20260709 12:22:44.086194 24534 raft_consensus.cc:2243] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 1f007450922d46c1aaae5cc6be7a9452 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:44.086623 24534 raft_consensus.cc:2272] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 1f007450922d46c1aaae5cc6be7a9452 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:44.088428 24534 tablet_replica.cc:333] T 39cf9b9227204dd497e8ef50f1beb2bc P 1f007450922d46c1aaae5cc6be7a9452: stopping tablet replica
I20260709 12:22:44.088933 24534 raft_consensus.cc:2243] T 39cf9b9227204dd497e8ef50f1beb2bc P 1f007450922d46c1aaae5cc6be7a9452 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:44.089362 24534 raft_consensus.cc:2272] T 39cf9b9227204dd497e8ef50f1beb2bc P 1f007450922d46c1aaae5cc6be7a9452 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:44.091048 24534 tablet_replica.cc:333] T a90bed0f71cb4741b9fa34669e5b7bc1 P 1f007450922d46c1aaae5cc6be7a9452: stopping tablet replica
I20260709 12:22:44.091603 24534 raft_consensus.cc:2243] T a90bed0f71cb4741b9fa34669e5b7bc1 P 1f007450922d46c1aaae5cc6be7a9452 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:22:44.092387 24534 raft_consensus.cc:2272] T a90bed0f71cb4741b9fa34669e5b7bc1 P 1f007450922d46c1aaae5cc6be7a9452 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:44.094089 24534 tablet_replica.cc:333] T 0462f2e3489342489e622f469b237df2 P 1f007450922d46c1aaae5cc6be7a9452: stopping tablet replica
I20260709 12:22:44.094589 24534 raft_consensus.cc:2243] T 0462f2e3489342489e622f469b237df2 P 1f007450922d46c1aaae5cc6be7a9452 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:44.094926 24534 raft_consensus.cc:2272] T 0462f2e3489342489e622f469b237df2 P 1f007450922d46c1aaae5cc6be7a9452 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:44.096506 24534 tablet_replica.cc:333] T 0c686b019831496188c502a729a4db8a P 1f007450922d46c1aaae5cc6be7a9452: stopping tablet replica
I20260709 12:22:44.096921 24534 raft_consensus.cc:2243] T 0c686b019831496188c502a729a4db8a P 1f007450922d46c1aaae5cc6be7a9452 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:44.097368 24534 raft_consensus.cc:2272] T 0c686b019831496188c502a729a4db8a P 1f007450922d46c1aaae5cc6be7a9452 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:44.098845 24534 tablet_replica.cc:333] T 6afaae01b5b5406cac56ad99ce7f3482 P 1f007450922d46c1aaae5cc6be7a9452: stopping tablet replica
I20260709 12:22:44.099320 24534 raft_consensus.cc:2243] T 6afaae01b5b5406cac56ad99ce7f3482 P 1f007450922d46c1aaae5cc6be7a9452 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:44.099748 24534 raft_consensus.cc:2272] T 6afaae01b5b5406cac56ad99ce7f3482 P 1f007450922d46c1aaae5cc6be7a9452 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:44.101421 24534 tablet_replica.cc:333] T b7cc944e087640eab119454448129998 P 1f007450922d46c1aaae5cc6be7a9452: stopping tablet replica
I20260709 12:22:44.101889 24534 raft_consensus.cc:2243] T b7cc944e087640eab119454448129998 P 1f007450922d46c1aaae5cc6be7a9452 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:44.102640 24534 raft_consensus.cc:2272] T b7cc944e087640eab119454448129998 P 1f007450922d46c1aaae5cc6be7a9452 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:44.104292 24534 tablet_replica.cc:333] T ae5ec568a7c04c03ab6df14b7fc861e9 P 1f007450922d46c1aaae5cc6be7a9452: stopping tablet replica
I20260709 12:22:44.104771 24534 raft_consensus.cc:2243] T ae5ec568a7c04c03ab6df14b7fc861e9 P 1f007450922d46c1aaae5cc6be7a9452 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:44.105180 24534 raft_consensus.cc:2272] T ae5ec568a7c04c03ab6df14b7fc861e9 P 1f007450922d46c1aaae5cc6be7a9452 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:44.106693 24534 tablet_replica.cc:333] T 8f462d4481754e45a6a38564f7ffacf7 P 1f007450922d46c1aaae5cc6be7a9452: stopping tablet replica
I20260709 12:22:44.107127 24534 raft_consensus.cc:2243] T 8f462d4481754e45a6a38564f7ffacf7 P 1f007450922d46c1aaae5cc6be7a9452 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:44.107548 24534 raft_consensus.cc:2272] T 8f462d4481754e45a6a38564f7ffacf7 P 1f007450922d46c1aaae5cc6be7a9452 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:44.155498 24534 tablet_server.cc:196] TabletServer@127.23.245.130:0 shutdown complete.
I20260709 12:22:44.176312 24534 tablet_server.cc:179] TabletServer@127.23.245.131:0 shutting down...
I20260709 12:22:44.205219 24534 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:44.205986 24534 tablet_replica.cc:333] T 09fa2961864c4c999f036a784f0da8cf P 874f559253d64e01a7ce18b3b8f2164c: stopping tablet replica
I20260709 12:22:44.206652 24534 raft_consensus.cc:2243] T 09fa2961864c4c999f036a784f0da8cf P 874f559253d64e01a7ce18b3b8f2164c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:44.207181 24534 raft_consensus.cc:2272] T 09fa2961864c4c999f036a784f0da8cf P 874f559253d64e01a7ce18b3b8f2164c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:44.209285 24534 tablet_replica.cc:333] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 874f559253d64e01a7ce18b3b8f2164c: stopping tablet replica
I20260709 12:22:44.209875 24534 raft_consensus.cc:2243] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 874f559253d64e01a7ce18b3b8f2164c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:44.210294 24534 raft_consensus.cc:2272] T 7831b6a5a6f340948e8e0cbb3d36f7d8 P 874f559253d64e01a7ce18b3b8f2164c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:44.212062 24534 tablet_replica.cc:333] T ae5ec568a7c04c03ab6df14b7fc861e9 P 874f559253d64e01a7ce18b3b8f2164c: stopping tablet replica
I20260709 12:22:44.212577 24534 raft_consensus.cc:2243] T ae5ec568a7c04c03ab6df14b7fc861e9 P 874f559253d64e01a7ce18b3b8f2164c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:44.213014 24534 raft_consensus.cc:2272] T ae5ec568a7c04c03ab6df14b7fc861e9 P 874f559253d64e01a7ce18b3b8f2164c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:44.214680 24534 tablet_replica.cc:333] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c: stopping tablet replica
I20260709 12:22:44.215164 24534 raft_consensus.cc:2243] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:44.215595 24534 raft_consensus.cc:2272] T 8f462d4481754e45a6a38564f7ffacf7 P 874f559253d64e01a7ce18b3b8f2164c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:44.217384 24534 tablet_replica.cc:333] T a90bed0f71cb4741b9fa34669e5b7bc1 P 874f559253d64e01a7ce18b3b8f2164c: stopping tablet replica
I20260709 12:22:44.217904 24534 raft_consensus.cc:2243] T a90bed0f71cb4741b9fa34669e5b7bc1 P 874f559253d64e01a7ce18b3b8f2164c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:44.218364 24534 raft_consensus.cc:2272] T a90bed0f71cb4741b9fa34669e5b7bc1 P 874f559253d64e01a7ce18b3b8f2164c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:44.220191 24534 tablet_replica.cc:333] T 39cf9b9227204dd497e8ef50f1beb2bc P 874f559253d64e01a7ce18b3b8f2164c: stopping tablet replica
I20260709 12:22:44.220696 24534 raft_consensus.cc:2243] T 39cf9b9227204dd497e8ef50f1beb2bc P 874f559253d64e01a7ce18b3b8f2164c [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:44.221519 24534 raft_consensus.cc:2272] T 39cf9b9227204dd497e8ef50f1beb2bc P 874f559253d64e01a7ce18b3b8f2164c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:44.223582 24534 tablet_replica.cc:333] T 6afaae01b5b5406cac56ad99ce7f3482 P 874f559253d64e01a7ce18b3b8f2164c: stopping tablet replica
I20260709 12:22:44.224156 24534 raft_consensus.cc:2243] T 6afaae01b5b5406cac56ad99ce7f3482 P 874f559253d64e01a7ce18b3b8f2164c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:44.224903 24534 raft_consensus.cc:2272] T 6afaae01b5b5406cac56ad99ce7f3482 P 874f559253d64e01a7ce18b3b8f2164c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:44.226500 24534 tablet_replica.cc:333] T b7cc944e087640eab119454448129998 P 874f559253d64e01a7ce18b3b8f2164c: stopping tablet replica
I20260709 12:22:44.226961 24534 raft_consensus.cc:2243] T b7cc944e087640eab119454448129998 P 874f559253d64e01a7ce18b3b8f2164c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:44.227360 24534 raft_consensus.cc:2272] T b7cc944e087640eab119454448129998 P 874f559253d64e01a7ce18b3b8f2164c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:44.228973 24534 tablet_replica.cc:333] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c: stopping tablet replica
I20260709 12:22:44.229440 24534 raft_consensus.cc:2243] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:44.229825 24534 raft_consensus.cc:2272] T 0462f2e3489342489e622f469b237df2 P 874f559253d64e01a7ce18b3b8f2164c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:44.231387 24534 tablet_replica.cc:333] T 0c686b019831496188c502a729a4db8a P 874f559253d64e01a7ce18b3b8f2164c: stopping tablet replica
I20260709 12:22:44.231838 24534 raft_consensus.cc:2243] T 0c686b019831496188c502a729a4db8a P 874f559253d64e01a7ce18b3b8f2164c [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:44.232547 24534 raft_consensus.cc:2272] T 0c686b019831496188c502a729a4db8a P 874f559253d64e01a7ce18b3b8f2164c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:44.278831 24534 tablet_server.cc:196] TabletServer@127.23.245.131:0 shutdown complete.
I20260709 12:22:44.298977 24534 master.cc:562] Master@127.23.245.190:43825 shutting down...
I20260709 12:22:44.326107 24534 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 39a10666588745b1b7e6ed75f1979db9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:44.326712 24534 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 39a10666588745b1b7e6ed75f1979db9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:44.327041 24534 tablet_replica.cc:333] T 00000000000000000000000000000000 P 39a10666588745b1b7e6ed75f1979db9: stopping tablet replica
I20260709 12:22:44.346819 24534 master.cc:584] Master@127.23.245.190:43825 shutdown complete.
1f007450922d46c1aaae5cc6be7a9452  4
67f2d785daf545deba69f6d4d4ea8251  5
874f559253d64e01a7ce18b3b8f2164c  1
1f007450922d46c1aaae5cc6be7a9452  4
67f2d785daf545deba69f6d4d4ea8251  3
874f559253d64e01a7ce18b3b8f2164c  3
1f007450922d46c1aaae5cc6be7a9452  1
67f2d785daf545deba69f6d4d4ea8251  8
874f559253d64e01a7ce18b3b8f2164c  1
1f007450922d46c1aaae5cc6be7a9452  3
67f2d785daf545deba69f6d4d4ea8251  4
874f559253d64e01a7ce18b3b8f2164c  3
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (28910 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:22:44.392088 24534 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.23.245.190:45099
I20260709 12:22:44.393285 24534 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:44.399015 25559 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:44.400537 25560 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:44.400645 25562 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:44.400789 24534 server_base.cc:1061] running on GCE node
I20260709 12:22:44.402201 24534 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:44.402431 24534 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:44.402606 24534 hybrid_clock.cc:648] HybridClock initialized: now 1783599764402589 us; error 0 us; skew 500 ppm
I20260709 12:22:44.403154 24534 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:44.405558 24534 webserver.cc:533] Webserver started at http://127.23.245.190:35817/ using document root <none> and password file <none>
I20260709 12:22:44.406046 24534 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:44.406263 24534 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:44.406563 24534 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:44.407713 24534 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/master-0-root/instance:
uuid: "496fd6924b624e77b03ccfd15653d47b"
format_stamp: "Formatted at 2026-07-09 12:22:44 on dist-test-slave-mlt7"
I20260709 12:22:44.412181 24534 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:22:44.415431 25567 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:44.416265 24534 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:22:44.416567 24534 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/master-0-root
uuid: "496fd6924b624e77b03ccfd15653d47b"
format_stamp: "Formatted at 2026-07-09 12:22:44 on dist-test-slave-mlt7"
I20260709 12:22:44.416865 24534 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:44.428401 24534 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:44.429585 24534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:44.466984 24534 rpc_server.cc:307] RPC server started. Bound to: 127.23.245.190:45099
I20260709 12:22:44.467105 25618 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.245.190:45099 every 8 connection(s)
I20260709 12:22:44.470947 25619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:44.480371 25619 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 496fd6924b624e77b03ccfd15653d47b: Bootstrap starting.
I20260709 12:22:44.485013 25619 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 496fd6924b624e77b03ccfd15653d47b: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:44.489138 25619 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 496fd6924b624e77b03ccfd15653d47b: No bootstrap required, opened a new log
I20260709 12:22:44.491504 25619 raft_consensus.cc:359] T 00000000000000000000000000000000 P 496fd6924b624e77b03ccfd15653d47b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "496fd6924b624e77b03ccfd15653d47b" member_type: VOTER }
I20260709 12:22:44.492027 25619 raft_consensus.cc:385] T 00000000000000000000000000000000 P 496fd6924b624e77b03ccfd15653d47b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:44.492287 25619 raft_consensus.cc:740] T 00000000000000000000000000000000 P 496fd6924b624e77b03ccfd15653d47b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 496fd6924b624e77b03ccfd15653d47b, State: Initialized, Role: FOLLOWER
I20260709 12:22:44.492890 25619 consensus_queue.cc:260] T 00000000000000000000000000000000 P 496fd6924b624e77b03ccfd15653d47b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "496fd6924b624e77b03ccfd15653d47b" member_type: VOTER }
I20260709 12:22:44.493412 25619 raft_consensus.cc:399] T 00000000000000000000000000000000 P 496fd6924b624e77b03ccfd15653d47b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:22:44.493667 25619 raft_consensus.cc:493] T 00000000000000000000000000000000 P 496fd6924b624e77b03ccfd15653d47b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:22:44.493970 25619 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 496fd6924b624e77b03ccfd15653d47b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:44.498399 25619 raft_consensus.cc:515] T 00000000000000000000000000000000 P 496fd6924b624e77b03ccfd15653d47b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "496fd6924b624e77b03ccfd15653d47b" member_type: VOTER }
I20260709 12:22:44.498971 25619 leader_election.cc:304] T 00000000000000000000000000000000 P 496fd6924b624e77b03ccfd15653d47b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 496fd6924b624e77b03ccfd15653d47b; no voters: 
I20260709 12:22:44.500278 25619 leader_election.cc:290] T 00000000000000000000000000000000 P 496fd6924b624e77b03ccfd15653d47b [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:22:44.500682 25622 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 496fd6924b624e77b03ccfd15653d47b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:44.501991 25622 raft_consensus.cc:697] T 00000000000000000000000000000000 P 496fd6924b624e77b03ccfd15653d47b [term 1 LEADER]: Becoming Leader. State: Replica: 496fd6924b624e77b03ccfd15653d47b, State: Running, Role: LEADER
I20260709 12:22:44.502633 25622 consensus_queue.cc:237] T 00000000000000000000000000000000 P 496fd6924b624e77b03ccfd15653d47b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "496fd6924b624e77b03ccfd15653d47b" member_type: VOTER }
I20260709 12:22:44.503525 25619 sys_catalog.cc:565] T 00000000000000000000000000000000 P 496fd6924b624e77b03ccfd15653d47b [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:22:44.508105 25624 sys_catalog.cc:455] T 00000000000000000000000000000000 P 496fd6924b624e77b03ccfd15653d47b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 496fd6924b624e77b03ccfd15653d47b. Latest consensus state: current_term: 1 leader_uuid: "496fd6924b624e77b03ccfd15653d47b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "496fd6924b624e77b03ccfd15653d47b" member_type: VOTER } }
I20260709 12:22:44.508284 25623 sys_catalog.cc:455] T 00000000000000000000000000000000 P 496fd6924b624e77b03ccfd15653d47b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "496fd6924b624e77b03ccfd15653d47b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "496fd6924b624e77b03ccfd15653d47b" member_type: VOTER } }
I20260709 12:22:44.508822 25624 sys_catalog.cc:458] T 00000000000000000000000000000000 P 496fd6924b624e77b03ccfd15653d47b [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:44.509044 25623 sys_catalog.cc:458] T 00000000000000000000000000000000 P 496fd6924b624e77b03ccfd15653d47b [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:44.511562 25629 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:22:44.517467 25629 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:22:44.520252 24534 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:22:44.526799 25629 catalog_manager.cc:1383] Generated new cluster ID: 22bc87a08cc3455792acb9105d58f46e
I20260709 12:22:44.527096 25629 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:22:44.541843 25629 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:22:44.543157 25629 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:22:44.565313 25629 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 496fd6924b624e77b03ccfd15653d47b: Generated new TSK 0
I20260709 12:22:44.565958 25629 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:22:44.586582 24534 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:44.592566 25640 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:44.593513 25641 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:44.596011 24534 server_base.cc:1061] running on GCE node
W20260709 12:22:44.596148 25643 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:44.597234 24534 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:44.597412 24534 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:44.597602 24534 hybrid_clock.cc:648] HybridClock initialized: now 1783599764597588 us; error 0 us; skew 500 ppm
I20260709 12:22:44.598142 24534 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:44.600553 24534 webserver.cc:533] Webserver started at http://127.23.245.129:43793/ using document root <none> and password file <none>
I20260709 12:22:44.601037 24534 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:44.601230 24534 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:44.601513 24534 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:44.602614 24534 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-0-root/instance:
uuid: "f82778701b464892aab92a752ed7ffdc"
format_stamp: "Formatted at 2026-07-09 12:22:44 on dist-test-slave-mlt7"
I20260709 12:22:44.607028 24534 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.003s
I20260709 12:22:44.610337 25648 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:44.611263 24534 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:22:44.611589 24534 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-0-root
uuid: "f82778701b464892aab92a752ed7ffdc"
format_stamp: "Formatted at 2026-07-09 12:22:44 on dist-test-slave-mlt7"
I20260709 12:22:44.611965 24534 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:44.625228 24534 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:44.626958 24534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:44.628984 24534 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:44.631286 24534 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:44.631510 24534 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:44.631765 24534 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:44.631989 24534 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:22:44.672339 24534 rpc_server.cc:307] RPC server started. Bound to: 127.23.245.129:37349
I20260709 12:22:44.672439 25711 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.245.129:37349 every 8 connection(s)
I20260709 12:22:44.677187 24534 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:44.684391 25716 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:44.686302 25717 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:44.688931 25719 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:44.689715 24534 server_base.cc:1061] running on GCE node
I20260709 12:22:44.690829 24534 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:44.691147 24534 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:44.691371 24534 hybrid_clock.cc:648] HybridClock initialized: now 1783599764691343 us; error 0 us; skew 500 ppm
I20260709 12:22:44.692050 24534 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:44.694000 25712 heartbeater.cc:344] Connected to a master server at 127.23.245.190:45099
I20260709 12:22:44.694455 25712 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:44.694681 24534 webserver.cc:533] Webserver started at http://127.23.245.130:33059/ using document root <none> and password file <none>
I20260709 12:22:44.695320 24534 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:44.695322 25712 heartbeater.cc:507] Master 127.23.245.190:45099 requested a full tablet report, sending...
I20260709 12:22:44.695705 24534 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:44.696058 24534 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:44.697389 24534 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-1-root/instance:
uuid: "6e673265293d4e9a937dc45150aeb1b8"
format_stamp: "Formatted at 2026-07-09 12:22:44 on dist-test-slave-mlt7"
I20260709 12:22:44.697791 25584 ts_manager.cc:194] Registered new tserver with Master: f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349)
I20260709 12:22:44.699545 25584 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41224
I20260709 12:22:44.702710 24534 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:22:44.706228 25724 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:44.707048 24534 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:22:44.707415 24534 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-1-root
uuid: "6e673265293d4e9a937dc45150aeb1b8"
format_stamp: "Formatted at 2026-07-09 12:22:44 on dist-test-slave-mlt7"
I20260709 12:22:44.707710 24534 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:44.731137 24534 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:44.732481 24534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:44.734108 24534 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:44.736548 24534 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:44.736806 24534 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:44.737071 24534 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:44.737293 24534 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:44.803841 24534 rpc_server.cc:307] RPC server started. Bound to: 127.23.245.130:37267
I20260709 12:22:44.804023 25787 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.245.130:37267 every 8 connection(s)
I20260709 12:22:44.810722 24534 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:44.819617 25791 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:44.820689 25792 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:44.822480 25794 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:44.824010 24534 server_base.cc:1061] running on GCE node
I20260709 12:22:44.825220 24534 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:22:44.825299 25788 heartbeater.cc:344] Connected to a master server at 127.23.245.190:45099
W20260709 12:22:44.825451 24534 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:44.825852 24534 hybrid_clock.cc:648] HybridClock initialized: now 1783599764825825 us; error 0 us; skew 500 ppm
I20260709 12:22:44.825861 25788 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:44.826481 24534 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:44.826735 25788 heartbeater.cc:507] Master 127.23.245.190:45099 requested a full tablet report, sending...
I20260709 12:22:44.829329 25584 ts_manager.cc:194] Registered new tserver with Master: 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:44.829835 24534 webserver.cc:533] Webserver started at http://127.23.245.131:40583/ using document root <none> and password file <none>
I20260709 12:22:44.830590 24534 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:44.830852 24534 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:44.831235 24534 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:44.831622 25584 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41232
I20260709 12:22:44.833156 24534 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-2-root/instance:
uuid: "5cccf20a8bff46dba6601f241d172b8a"
format_stamp: "Formatted at 2026-07-09 12:22:44 on dist-test-slave-mlt7"
I20260709 12:22:44.837991 24534 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:22:44.841836 25799 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:44.842773 24534 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 12:22:44.843158 24534 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-2-root
uuid: "5cccf20a8bff46dba6601f241d172b8a"
format_stamp: "Formatted at 2026-07-09 12:22:44 on dist-test-slave-mlt7"
I20260709 12:22:44.843598 24534 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:44.861238 24534 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:44.862484 24534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:44.864135 24534 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:44.866586 24534 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:44.866771 24534 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:44.867091 24534 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:44.867244 24534 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:44.908972 24534 rpc_server.cc:307] RPC server started. Bound to: 127.23.245.131:36237
I20260709 12:22:44.909107 25861 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.245.131:36237 every 8 connection(s)
I20260709 12:22:44.924208 25862 heartbeater.cc:344] Connected to a master server at 127.23.245.190:45099
I20260709 12:22:44.924604 25862 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:44.925537 25862 heartbeater.cc:507] Master 127.23.245.190:45099 requested a full tablet report, sending...
I20260709 12:22:44.927630 25584 ts_manager.cc:194] Registered new tserver with Master: 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:44.928488 24534 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016262928s
I20260709 12:22:44.929060 25584 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41240
I20260709 12:22:44.956116 25584 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41242:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:22:44.962436 25584 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:22:45.166131 25676 tablet_service.cc:1511] Processing CreateTablet for tablet ca1c66d4736542ecb25b33fab43ae780 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:22:45.166445 25675 tablet_service.cc:1511] Processing CreateTablet for tablet d32f766d8f384968a837db40f23c072c (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:22:45.167881 25676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca1c66d4736542ecb25b33fab43ae780. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.168634 25675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d32f766d8f384968a837db40f23c072c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.168787 25826 tablet_service.cc:1511] Processing CreateTablet for tablet d32f766d8f384968a837db40f23c072c (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:22:45.170743 25826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d32f766d8f384968a837db40f23c072c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.166226 25827 tablet_service.cc:1511] Processing CreateTablet for tablet ca1c66d4736542ecb25b33fab43ae780 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:22:45.179585 25827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca1c66d4736542ecb25b33fab43ae780. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.186153 25674 tablet_service.cc:1511] Processing CreateTablet for tablet 6182e86ac1764086b37738a0f1b04cd4 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:22:45.187714 25674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6182e86ac1764086b37738a0f1b04cd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.190951 25825 tablet_service.cc:1511] Processing CreateTablet for tablet 6182e86ac1764086b37738a0f1b04cd4 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:22:45.192407 25825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6182e86ac1764086b37738a0f1b04cd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.200258 25673 tablet_service.cc:1511] Processing CreateTablet for tablet 237622cb71464b3ca091560bd9d8c06b (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:22:45.204929 25672 tablet_service.cc:1511] Processing CreateTablet for tablet 4734c282e09b4bbbb96de8eee61c160a (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:22:45.205233 25824 tablet_service.cc:1511] Processing CreateTablet for tablet 237622cb71464b3ca091560bd9d8c06b (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:22:45.206349 25672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4734c282e09b4bbbb96de8eee61c160a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.207036 25824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 237622cb71464b3ca091560bd9d8c06b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.211730 25673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 237622cb71464b3ca091560bd9d8c06b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.213424 25823 tablet_service.cc:1511] Processing CreateTablet for tablet 4734c282e09b4bbbb96de8eee61c160a (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:22:45.214869 25823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4734c282e09b4bbbb96de8eee61c160a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.221791 25753 tablet_service.cc:1511] Processing CreateTablet for tablet ca1c66d4736542ecb25b33fab43ae780 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:22:45.223295 25753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca1c66d4736542ecb25b33fab43ae780. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.225389 25751 tablet_service.cc:1511] Processing CreateTablet for tablet 6182e86ac1764086b37738a0f1b04cd4 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:22:45.225765 25749 tablet_service.cc:1511] Processing CreateTablet for tablet 4734c282e09b4bbbb96de8eee61c160a (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:22:45.225386 25752 tablet_service.cc:1511] Processing CreateTablet for tablet d32f766d8f384968a837db40f23c072c (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:22:45.228849 25750 tablet_service.cc:1511] Processing CreateTablet for tablet 237622cb71464b3ca091560bd9d8c06b (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:22:45.230742 25752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d32f766d8f384968a837db40f23c072c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.231587 25750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 237622cb71464b3ca091560bd9d8c06b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.232509 25749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4734c282e09b4bbbb96de8eee61c160a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.236583 25751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6182e86ac1764086b37738a0f1b04cd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.247799 25675 tablet_service.cc:1511] Processing CreateTablet for tablet b679f7cf7f1e468582715c3427ced820 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:22:45.249858 25675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b679f7cf7f1e468582715c3427ced820. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.263893 25748 tablet_service.cc:1511] Processing CreateTablet for tablet b679f7cf7f1e468582715c3427ced820 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:22:45.265389 25748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b679f7cf7f1e468582715c3427ced820. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.270663 25877 tablet_bootstrap.cc:492] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
I20260709 12:22:45.278514 25825 tablet_service.cc:1511] Processing CreateTablet for tablet b679f7cf7f1e468582715c3427ced820 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:22:45.279976 25825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b679f7cf7f1e468582715c3427ced820. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.283017 25878 tablet_bootstrap.cc:492] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:45.290145 25674 tablet_service.cc:1511] Processing CreateTablet for tablet 522704a36135481fa4fc221fa9a0801e (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:22:45.292275 25674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 522704a36135481fa4fc221fa9a0801e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.295676 25747 tablet_service.cc:1511] Processing CreateTablet for tablet 522704a36135481fa4fc221fa9a0801e (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:22:45.297180 25747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 522704a36135481fa4fc221fa9a0801e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.302217 25878 tablet_bootstrap.cc:654] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:45.314872 25675 tablet_service.cc:1511] Processing CreateTablet for tablet 47453d79f4484e7ea165be91f0269a2b (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:22:45.316183 25675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47453d79f4484e7ea165be91f0269a2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.326397 25879 tablet_bootstrap.cc:492] T 4734c282e09b4bbbb96de8eee61c160a P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
I20260709 12:22:45.328749 25827 tablet_service.cc:1511] Processing CreateTablet for tablet 522704a36135481fa4fc221fa9a0801e (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:22:45.330039 25827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 522704a36135481fa4fc221fa9a0801e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.331028 25877 tablet_bootstrap.cc:654] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:45.333276 25879 tablet_bootstrap.cc:654] T 4734c282e09b4bbbb96de8eee61c160a P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:45.351256 25750 tablet_service.cc:1511] Processing CreateTablet for tablet 47453d79f4484e7ea165be91f0269a2b (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:22:45.352607 25750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47453d79f4484e7ea165be91f0269a2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.354017 25674 tablet_service.cc:1511] Processing CreateTablet for tablet f9ea7c5f4a6a4724bfcb0c6d88c32b1c (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:22:45.355320 25674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9ea7c5f4a6a4724bfcb0c6d88c32b1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.357102 25825 tablet_service.cc:1511] Processing CreateTablet for tablet 47453d79f4484e7ea165be91f0269a2b (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:22:45.357488 25747 tablet_service.cc:1511] Processing CreateTablet for tablet f9ea7c5f4a6a4724bfcb0c6d88c32b1c (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:22:45.358354 25825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47453d79f4484e7ea165be91f0269a2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.358738 25747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9ea7c5f4a6a4724bfcb0c6d88c32b1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.364069 25672 tablet_service.cc:1511] Processing CreateTablet for tablet f979ddeb5c014d329931d4e2e035af60 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:22:45.365316 25672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f979ddeb5c014d329931d4e2e035af60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.365027 25824 tablet_service.cc:1511] Processing CreateTablet for tablet f9ea7c5f4a6a4724bfcb0c6d88c32b1c (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:22:45.367964 25824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9ea7c5f4a6a4724bfcb0c6d88c32b1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.369596 25878 tablet_bootstrap.cc:492] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:45.370069 25878 ts_tablet_manager.cc:1403] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.087s	user 0.013s	sys 0.005s
I20260709 12:22:45.369599 25879 tablet_bootstrap.cc:492] T 4734c282e09b4bbbb96de8eee61c160a P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
I20260709 12:22:45.372308 25879 ts_tablet_manager.cc:1403] T 4734c282e09b4bbbb96de8eee61c160a P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.046s	user 0.016s	sys 0.008s
I20260709 12:22:45.372819 25752 tablet_service.cc:1511] Processing CreateTablet for tablet f979ddeb5c014d329931d4e2e035af60 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:22:45.374111 25752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f979ddeb5c014d329931d4e2e035af60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.375345 25879 raft_consensus.cc:359] T 4734c282e09b4bbbb96de8eee61c160a P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:45.376362 25879 raft_consensus.cc:385] T 4734c282e09b4bbbb96de8eee61c160a P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:45.376688 25879 raft_consensus.cc:740] T 4734c282e09b4bbbb96de8eee61c160a P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
I20260709 12:22:45.380445 25825 tablet_service.cc:1511] Processing CreateTablet for tablet f979ddeb5c014d329931d4e2e035af60 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:22:45.381762 25825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f979ddeb5c014d329931d4e2e035af60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.382872 25673 tablet_service.cc:1511] Processing CreateTablet for tablet e535a01d34654e31ac7826205390f938 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:22:45.384598 25673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e535a01d34654e31ac7826205390f938. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.386222 25878 raft_consensus.cc:359] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } }
I20260709 12:22:45.386965 25878 raft_consensus.cc:385] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:45.387174 25877 tablet_bootstrap.cc:492] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:45.387295 25878 raft_consensus.cc:740] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
I20260709 12:22:45.387722 25877 ts_tablet_manager.cc:1403] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.118s	user 0.009s	sys 0.004s
I20260709 12:22:45.390630 25877 raft_consensus.cc:359] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } }
I20260709 12:22:45.391357 25877 raft_consensus.cc:385] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:45.391659 25877 raft_consensus.cc:740] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
I20260709 12:22:45.392663 25877 consensus_queue.cc:260] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } }
I20260709 12:22:45.401321 25878 consensus_queue.cc:260] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } }
I20260709 12:22:45.407384 25748 tablet_service.cc:1511] Processing CreateTablet for tablet e535a01d34654e31ac7826205390f938 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:22:45.408811 25748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e535a01d34654e31ac7826205390f938. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.412213 25879 consensus_queue.cc:260] T 4734c282e09b4bbbb96de8eee61c160a P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:45.412613 25825 tablet_service.cc:1511] Processing CreateTablet for tablet e535a01d34654e31ac7826205390f938 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:22:45.414104 25825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e535a01d34654e31ac7826205390f938. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.414610 25885 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.415163 25885 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } }
I20260709 12:22:45.420158 25788 heartbeater.cc:499] Master 127.23.245.190:45099 was elected leader, sending a full tablet report...
I20260709 12:22:45.421711 25878 ts_tablet_manager.cc:1434] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.002s
I20260709 12:22:45.423873 25674 tablet_service.cc:1511] Processing CreateTablet for tablet 58ab3e51ccf14577a94774f25ade6cd8 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:22:45.425232 25674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58ab3e51ccf14577a94774f25ade6cd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.426905 25751 tablet_service.cc:1511] Processing CreateTablet for tablet 58ab3e51ccf14577a94774f25ade6cd8 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:22:45.428005 25877 ts_tablet_manager.cc:1434] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.014s
I20260709 12:22:45.428020 25712 heartbeater.cc:499] Master 127.23.245.190:45099 was elected leader, sending a full tablet report...
I20260709 12:22:45.429068 25877 tablet_bootstrap.cc:492] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
I20260709 12:22:45.433650 25879 ts_tablet_manager.cc:1434] T 4734c282e09b4bbbb96de8eee61c160a P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.061s	user 0.003s	sys 0.004s
I20260709 12:22:45.434700 25879 tablet_bootstrap.cc:492] T ca1c66d4736542ecb25b33fab43ae780 P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
I20260709 12:22:45.435557 25877 tablet_bootstrap.cc:654] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:45.445231 25862 heartbeater.cc:499] Master 127.23.245.190:45099 was elected leader, sending a full tablet report...
I20260709 12:22:45.428254 25751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58ab3e51ccf14577a94774f25ade6cd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.450403 25883 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.450896 25883 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } }
I20260709 12:22:45.451736 25878 tablet_bootstrap.cc:492] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:45.457690 25675 tablet_service.cc:1511] Processing CreateTablet for tablet a8fa32386b77471b923cc6c4241570d5 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:22:45.446338 25825 tablet_service.cc:1511] Processing CreateTablet for tablet 58ab3e51ccf14577a94774f25ade6cd8 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:22:45.459426 25827 tablet_service.cc:1511] Processing CreateTablet for tablet a8fa32386b77471b923cc6c4241570d5 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:22:45.470185 25885 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:45.471124 25883 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:45.473173 25747 tablet_service.cc:1511] Processing CreateTablet for tablet a8fa32386b77471b923cc6c4241570d5 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:22:45.474452 25747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8fa32386b77471b923cc6c4241570d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.475953 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:45.476588 25675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8fa32386b77471b923cc6c4241570d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.475983 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:45.478580 25686 raft_consensus.cc:2468] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 0.
W20260709 12:22:45.480101 25800 leader_election.cc:343] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:45.486894 25878 tablet_bootstrap.cc:654] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:45.459436 25825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58ab3e51ccf14577a94774f25ade6cd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.496470 25827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8fa32386b77471b923cc6c4241570d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.493541 25673 tablet_service.cc:1511] Processing CreateTablet for tablet f1625669bcc54589846d8a3d94c097d4 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:22:45.520893 25673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1625669bcc54589846d8a3d94c097d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.523461 25877 tablet_bootstrap.cc:492] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:45.524978 25801 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:22:45.526222 25885 raft_consensus.cc:2804] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:45.526576 25885 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:45.526908 25885 raft_consensus.cc:3060] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:45.524010 25877 ts_tablet_manager.cc:1403] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.095s	user 0.016s	sys 0.007s
I20260709 12:22:45.534689 25885 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } }
I20260709 12:22:45.535969 25877 raft_consensus.cc:359] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:45.536985 25877 raft_consensus.cc:385] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:45.537381 25877 raft_consensus.cc:740] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
I20260709 12:22:45.537978 25885 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:45.540032 25879 tablet_bootstrap.cc:654] T ca1c66d4736542ecb25b33fab43ae780 P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:45.543857 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
W20260709 12:22:45.545753 25800 leader_election.cc:343] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:45.546528 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:22:45.547086 25686 raft_consensus.cc:3060] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:45.545800 25877 consensus_queue.cc:260] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:22:45.549010 25632 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:45.550124 25877 ts_tablet_manager.cc:1434] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:22:45.555893 25877 tablet_bootstrap.cc:492] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
I20260709 12:22:45.559885 25751 tablet_service.cc:1511] Processing CreateTablet for tablet f1625669bcc54589846d8a3d94c097d4 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
W20260709 12:22:45.561679 25789 tablet.cc:2406] T 4734c282e09b4bbbb96de8eee61c160a P 6e673265293d4e9a937dc45150aeb1b8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:22:45.564175 25877 tablet_bootstrap.cc:654] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:45.565573 25751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1625669bcc54589846d8a3d94c097d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.571724 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:22:45.573237 25649 leader_election.cc:343] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:45.574970 25748 tablet_service.cc:1511] Processing CreateTablet for tablet 25bd5658646b41608d707d196c6e0585 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:22:45.565894 25878 tablet_bootstrap.cc:492] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:45.576243 25748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25bd5658646b41608d707d196c6e0585. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.576340 25878 ts_tablet_manager.cc:1403] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.125s	user 0.013s	sys 0.024s
I20260709 12:22:45.577476 25686 raft_consensus.cc:2468] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 1.
I20260709 12:22:45.579349 25878 raft_consensus.cc:359] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:45.585273 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:45.586935 25878 raft_consensus.cc:385] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:45.587256 25878 raft_consensus.cc:740] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
I20260709 12:22:45.587550 25837 raft_consensus.cc:2393] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 1: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:22:45.588069 25878 consensus_queue.cc:260] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:45.588967 25650 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:22:45.590101 25883 raft_consensus.cc:2749] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:45.590276 25878 ts_tablet_manager.cc:1434] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:22:45.585314 25824 tablet_service.cc:1511] Processing CreateTablet for tablet f1625669bcc54589846d8a3d94c097d4 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:22:45.591203 25878 tablet_bootstrap.cc:492] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:45.591495 25824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1625669bcc54589846d8a3d94c097d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.593155 25879 tablet_bootstrap.cc:492] T ca1c66d4736542ecb25b33fab43ae780 P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
I20260709 12:22:45.593637 25879 ts_tablet_manager.cc:1403] T ca1c66d4736542ecb25b33fab43ae780 P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.159s	user 0.000s	sys 0.013s
I20260709 12:22:45.596485 25879 raft_consensus.cc:359] T ca1c66d4736542ecb25b33fab43ae780 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } }
I20260709 12:22:45.597205 25879 raft_consensus.cc:385] T ca1c66d4736542ecb25b33fab43ae780 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:45.597494 25879 raft_consensus.cc:740] T ca1c66d4736542ecb25b33fab43ae780 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
I20260709 12:22:45.598227 25879 consensus_queue.cc:260] T ca1c66d4736542ecb25b33fab43ae780 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } }
I20260709 12:22:45.600085 25801 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:22:45.600551 25672 tablet_service.cc:1511] Processing CreateTablet for tablet 25bd5658646b41608d707d196c6e0585 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:22:45.601183 25885 raft_consensus.cc:2804] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:45.601686 25885 raft_consensus.cc:697] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:22:45.602283 25672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25bd5658646b41608d707d196c6e0585. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.602537 25885 consensus_queue.cc:237] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } }
I20260709 12:22:45.605412 25879 ts_tablet_manager.cc:1434] T ca1c66d4736542ecb25b33fab43ae780 P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.006s
I20260709 12:22:45.606437 25879 tablet_bootstrap.cc:492] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
I20260709 12:22:45.616125 25878 tablet_bootstrap.cc:654] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:45.630291 25879 tablet_bootstrap.cc:654] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:45.638761 25826 tablet_service.cc:1511] Processing CreateTablet for tablet 25bd5658646b41608d707d196c6e0585 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:22:45.640740 25826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25bd5658646b41608d707d196c6e0585. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.641283 25582 catalog_manager.cc:5697] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 1 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:45.649664 25675 tablet_service.cc:1511] Processing CreateTablet for tablet d2487f95c174426ebe2cdfc51537aea3 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:22:45.650988 25675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2487f95c174426ebe2cdfc51537aea3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.651877 25748 tablet_service.cc:1511] Processing CreateTablet for tablet d2487f95c174426ebe2cdfc51537aea3 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:22:45.653646 25748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2487f95c174426ebe2cdfc51537aea3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.663151 25673 tablet_service.cc:1511] Processing CreateTablet for tablet 97d7984a0036411695d6b3427bff9d69 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:22:45.664475 25673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97d7984a0036411695d6b3427bff9d69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.664469 25747 tablet_service.cc:1511] Processing CreateTablet for tablet 97d7984a0036411695d6b3427bff9d69 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:22:45.665940 25747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97d7984a0036411695d6b3427bff9d69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.669492 25825 tablet_service.cc:1511] Processing CreateTablet for tablet d2487f95c174426ebe2cdfc51537aea3 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:22:45.670781 25825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2487f95c174426ebe2cdfc51537aea3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.681659 25752 tablet_service.cc:1511] Processing CreateTablet for tablet 3324229ffe6d4ca282dc77ffa254a5b2 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:22:45.682962 25752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3324229ffe6d4ca282dc77ffa254a5b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.682833 25826 tablet_service.cc:1511] Processing CreateTablet for tablet 97d7984a0036411695d6b3427bff9d69 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:22:45.684229 25826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97d7984a0036411695d6b3427bff9d69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.693496 25877 tablet_bootstrap.cc:492] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:45.685593 25672 tablet_service.cc:1511] Processing CreateTablet for tablet 3324229ffe6d4ca282dc77ffa254a5b2 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:22:45.694005 25877 ts_tablet_manager.cc:1403] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.143s	user 0.034s	sys 0.034s
I20260709 12:22:45.693111 25824 tablet_service.cc:1511] Processing CreateTablet for tablet 3324229ffe6d4ca282dc77ffa254a5b2 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:22:45.694736 25672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3324229ffe6d4ca282dc77ffa254a5b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.695138 25824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3324229ffe6d4ca282dc77ffa254a5b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.695393 25750 tablet_service.cc:1511] Processing CreateTablet for tablet f5c104146a1c4ce1b19e2c6b5a1bf37a (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:22:45.696645 25750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5c104146a1c4ce1b19e2c6b5a1bf37a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.697487 25878 tablet_bootstrap.cc:492] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:45.697948 25878 ts_tablet_manager.cc:1403] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.107s	user 0.009s	sys 0.037s
I20260709 12:22:45.698964 25674 tablet_service.cc:1511] Processing CreateTablet for tablet f5c104146a1c4ce1b19e2c6b5a1bf37a (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:22:45.700273 25674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5c104146a1c4ce1b19e2c6b5a1bf37a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.700920 25878 raft_consensus.cc:359] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:45.701669 25878 raft_consensus.cc:385] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:45.701964 25878 raft_consensus.cc:740] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
I20260709 12:22:45.702708 25878 consensus_queue.cc:260] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:45.711087 25878 ts_tablet_manager.cc:1434] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:22:45.712150 25878 tablet_bootstrap.cc:492] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:45.715344 25749 tablet_service.cc:1511] Processing CreateTablet for tablet 0a6b77683d6547db82cd02da9d9c938a (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:22:45.716837 25749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a6b77683d6547db82cd02da9d9c938a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.717926 25877 raft_consensus.cc:359] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:45.718664 25877 raft_consensus.cc:385] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:45.718957 25877 raft_consensus.cc:740] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
I20260709 12:22:45.725731 25826 tablet_service.cc:1511] Processing CreateTablet for tablet f5c104146a1c4ce1b19e2c6b5a1bf37a (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:22:45.719720 25877 consensus_queue.cc:260] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:45.727031 25826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5c104146a1c4ce1b19e2c6b5a1bf37a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.729489 25877 ts_tablet_manager.cc:1434] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 12:22:45.729972 25879 tablet_bootstrap.cc:492] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
I20260709 12:22:45.729911 25885 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.729784 25672 tablet_service.cc:1511] Processing CreateTablet for tablet 0a6b77683d6547db82cd02da9d9c938a (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:22:45.730484 25885 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:45.732512 25885 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:45.734366 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:45.735002 25763 raft_consensus.cc:2468] T 4734c282e09b4bbbb96de8eee61c160a P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 0.
I20260709 12:22:45.736883 25800 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:22:45.737726 25885 raft_consensus.cc:2804] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:45.738098 25885 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:45.738435 25885 raft_consensus.cc:3060] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:45.730479 25879 ts_tablet_manager.cc:1403] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.124s	user 0.008s	sys 0.004s
I20260709 12:22:45.743455 25827 tablet_service.cc:1511] Processing CreateTablet for tablet 0a6b77683d6547db82cd02da9d9c938a (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:22:45.744779 25827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a6b77683d6547db82cd02da9d9c938a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.750378 25885 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:45.750828 25748 tablet_service.cc:1511] Processing CreateTablet for tablet 5f0353e850934c9db0a248807127ca4c (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:22:45.744927 25879 raft_consensus.cc:359] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:45.752209 25748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f0353e850934c9db0a248807127ca4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.752321 25879 raft_consensus.cc:385] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:45.752725 25879 raft_consensus.cc:740] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
I20260709 12:22:45.734561 25878 tablet_bootstrap.cc:654] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:45.756945 25750 tablet_service.cc:1511] Processing CreateTablet for tablet c38d3f292da44b3dbb2e512cd53e21da (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:22:45.758358 25750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c38d3f292da44b3dbb2e512cd53e21da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.760216 25879 consensus_queue.cc:260] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:45.762624 25676 tablet_service.cc:1511] Processing CreateTablet for tablet c38d3f292da44b3dbb2e512cd53e21da (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:22:45.766062 25823 tablet_service.cc:1511] Processing CreateTablet for tablet c38d3f292da44b3dbb2e512cd53e21da (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:22:45.769397 25823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c38d3f292da44b3dbb2e512cd53e21da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.771515 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:22:45.772140 25885 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:45.772222 25763 raft_consensus.cc:3060] T 4734c282e09b4bbbb96de8eee61c160a P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:45.776767 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:22:45.777796 25676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c38d3f292da44b3dbb2e512cd53e21da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.772771 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:22:45.780228 25801 leader_election.cc:343] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:45.773329 25886 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.780825 25886 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } }
I20260709 12:22:45.773532 25877 tablet_bootstrap.cc:492] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
I20260709 12:22:45.775597 25671 tablet_service.cc:1511] Processing CreateTablet for tablet 5f0353e850934c9db0a248807127ca4c (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
W20260709 12:22:45.782368 25801 leader_election.cc:343] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:45.783771 25886 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349)
I20260709 12:22:45.786477 25763 raft_consensus.cc:2468] T 4734c282e09b4bbbb96de8eee61c160a P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 1.
I20260709 12:22:45.787742 25800 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:22:45.788609 25672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a6b77683d6547db82cd02da9d9c938a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.788759 25884 raft_consensus.cc:2804] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:45.794265 25671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f0353e850934c9db0a248807127ca4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.794438 25825 tablet_service.cc:1511] Processing CreateTablet for tablet 5f0353e850934c9db0a248807127ca4c (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:22:45.795661 25825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f0353e850934c9db0a248807127ca4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.799191 25877 tablet_bootstrap.cc:654] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:45.803135 25883 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.803617 25883 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:45.805699 25883 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:45.807382 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:45.788759 25879 ts_tablet_manager.cc:1434] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.001s
I20260709 12:22:45.801016 25749 tablet_service.cc:1511] Processing CreateTablet for tablet 90d850895b8a4a40a4fba5caf2048ca2 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:22:45.810783 25879 tablet_bootstrap.cc:492] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
W20260709 12:22:45.811203 25650 leader_election.cc:343] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:45.812454 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:22:45.813977 25649 leader_election.cc:343] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:45.814437 25649 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:22:45.817394 25883 raft_consensus.cc:2749] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:45.823076 25752 tablet_service.cc:1511] Processing CreateTablet for tablet 819272169f6f4293b6e279793be58b49 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:22:45.823694 25884 raft_consensus.cc:697] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:22:45.825774 25878 tablet_bootstrap.cc:492] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:45.825330 25884 consensus_queue.cc:237] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:45.826241 25878 ts_tablet_manager.cc:1403] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.114s	user 0.010s	sys 0.000s
I20260709 12:22:45.830098 25752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 819272169f6f4293b6e279793be58b49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.832739 25673 tablet_service.cc:1511] Processing CreateTablet for tablet 90d850895b8a4a40a4fba5caf2048ca2 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:22:45.834141 25673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90d850895b8a4a40a4fba5caf2048ca2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.837030 25674 tablet_service.cc:1511] Processing CreateTablet for tablet 819272169f6f4293b6e279793be58b49 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:22:45.837827 25824 tablet_service.cc:1511] Processing CreateTablet for tablet 819272169f6f4293b6e279793be58b49 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:22:45.838564 25674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 819272169f6f4293b6e279793be58b49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.839115 25824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 819272169f6f4293b6e279793be58b49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.844197 25675 tablet_service.cc:1511] Processing CreateTablet for tablet ca85fa90ddc84c0680729add054d3003 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:22:45.845469 25675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca85fa90ddc84c0680729add054d3003. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.864056 25748 tablet_service.cc:1511] Processing CreateTablet for tablet ca85fa90ddc84c0680729add054d3003 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:22:45.860105 25749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90d850895b8a4a40a4fba5caf2048ca2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.873131 25879 tablet_bootstrap.cc:654] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:45.880784 25676 tablet_service.cc:1511] Processing CreateTablet for tablet 01372ae5f161477dab1b4c89fd847b3c (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:22:45.882030 25676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01372ae5f161477dab1b4c89fd847b3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.883213 25750 tablet_service.cc:1511] Processing CreateTablet for tablet 01372ae5f161477dab1b4c89fd847b3c (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:22:45.884231 25878 raft_consensus.cc:359] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:45.884943 25878 raft_consensus.cc:385] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:45.884740 25825 tablet_service.cc:1511] Processing CreateTablet for tablet ca85fa90ddc84c0680729add054d3003 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:22:45.885241 25878 raft_consensus.cc:740] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
I20260709 12:22:45.885799 25825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca85fa90ddc84c0680729add054d3003. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.886072 25878 consensus_queue.cc:260] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:45.889436 25750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01372ae5f161477dab1b4c89fd847b3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.892531 25823 tablet_service.cc:1511] Processing CreateTablet for tablet 01372ae5f161477dab1b4c89fd847b3c (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:22:45.893182 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:45.893603 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:45.893814 25823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01372ae5f161477dab1b4c89fd847b3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.894356 25686 raft_consensus.cc:2393] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 1: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:22:45.895073 25827 tablet_service.cc:1511] Processing CreateTablet for tablet 90d850895b8a4a40a4fba5caf2048ca2 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:22:45.896529 25726 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:22:45.897058 25673 tablet_service.cc:1511] Processing CreateTablet for tablet d7bb9a8676e14626b11877dab828ea68 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:22:45.898569 25886 raft_consensus.cc:3060] T ca1c66d4736542ecb25b33fab43ae780 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:45.905478 25885 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:45.907511 25885 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:45.909799 25885 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:45.911273 25878 ts_tablet_manager.cc:1434] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.085s	user 0.008s	sys 0.002s
I20260709 12:22:45.911815 25748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca85fa90ddc84c0680729add054d3003. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.912303 25826 tablet_service.cc:1511] Processing CreateTablet for tablet d7bb9a8676e14626b11877dab828ea68 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:22:45.912881 25751 tablet_service.cc:1511] Processing CreateTablet for tablet 03fbd3823c734a7d92ea482cf0d206b9 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:22:45.913086 25672 tablet_service.cc:1511] Processing CreateTablet for tablet 03fbd3823c734a7d92ea482cf0d206b9 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:22:45.914186 25751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03fbd3823c734a7d92ea482cf0d206b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.915051 25827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90d850895b8a4a40a4fba5caf2048ca2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.916332 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:45.917033 25826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7bb9a8676e14626b11877dab828ea68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.905458 25747 tablet_service.cc:1511] Processing CreateTablet for tablet d7bb9a8676e14626b11877dab828ea68 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:22:45.917055 25763 raft_consensus.cc:2468] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 0.
I20260709 12:22:45.919216 25747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7bb9a8676e14626b11877dab828ea68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.924605 25800 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:22:45.925354 25877 tablet_bootstrap.cc:492] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:45.925804 25877 ts_tablet_manager.cc:1403] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.153s	user 0.010s	sys 0.009s
I20260709 12:22:45.928761 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:22:45.930248 25801 leader_election.cc:343] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:45.930444 25753 tablet_service.cc:1511] Processing CreateTablet for tablet 14252b42f20346a5b1ae15409e129b12 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:22:45.931697 25753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14252b42f20346a5b1ae15409e129b12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.932945 25670 tablet_service.cc:1511] Processing CreateTablet for tablet 14252b42f20346a5b1ae15409e129b12 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:22:45.914192 25673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7bb9a8676e14626b11877dab828ea68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.937265 25822 tablet_service.cc:1511] Processing CreateTablet for tablet 03fbd3823c734a7d92ea482cf0d206b9 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:22:45.938019 25672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03fbd3823c734a7d92ea482cf0d206b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.938959 25670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14252b42f20346a5b1ae15409e129b12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.939230 25821 tablet_service.cc:1511] Processing CreateTablet for tablet 14252b42f20346a5b1ae15409e129b12 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:22:45.940665 25821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14252b42f20346a5b1ae15409e129b12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.927183 25583 catalog_manager.cc:5697] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 1 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:45.947571 25822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03fbd3823c734a7d92ea482cf0d206b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.952208 25669 tablet_service.cc:1511] Processing CreateTablet for tablet 8d74d1c9c8a84919a6f57b0b6721de51 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:22:45.953629 25669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d74d1c9c8a84919a6f57b0b6721de51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.952216 25902 raft_consensus.cc:2804] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:45.956946 25902 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:45.957314 25902 raft_consensus.cc:3060] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:45.958597 25746 tablet_service.cc:1511] Processing CreateTablet for tablet 8d74d1c9c8a84919a6f57b0b6721de51 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:22:45.960122 25746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d74d1c9c8a84919a6f57b0b6721de51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.961498 25886 raft_consensus.cc:2749] T ca1c66d4736542ecb25b33fab43ae780 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:45.962957 25877 raft_consensus.cc:359] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:45.963770 25877 raft_consensus.cc:385] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:45.964156 25877 raft_consensus.cc:740] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
I20260709 12:22:45.964725 25825 tablet_service.cc:1511] Processing CreateTablet for tablet 8d74d1c9c8a84919a6f57b0b6721de51 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:22:45.964958 25877 consensus_queue.cc:260] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:45.969226 25668 tablet_service.cc:1511] Processing CreateTablet for tablet 0c043718ee3a40fea4b2b1453fcb259b (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:22:45.972453 25825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d74d1c9c8a84919a6f57b0b6721de51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.978315 25745 tablet_service.cc:1511] Processing CreateTablet for tablet 0c043718ee3a40fea4b2b1453fcb259b (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:22:45.979624 25745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c043718ee3a40fea4b2b1453fcb259b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.980715 25668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c043718ee3a40fea4b2b1453fcb259b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:45.989717 25885 consensus_queue.cc:1048] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:45.993417 25878 tablet_bootstrap.cc:492] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:46.011670 25877 ts_tablet_manager.cc:1434] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.086s	user 0.007s	sys 0.000s
I20260709 12:22:46.015615 25879 tablet_bootstrap.cc:492] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
I20260709 12:22:46.016309 25879 ts_tablet_manager.cc:1403] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.207s	user 0.021s	sys 0.006s
I20260709 12:22:46.028606 25877 tablet_bootstrap.cc:492] T b679f7cf7f1e468582715c3427ced820 P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
I20260709 12:22:46.035037 25883 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:46.035606 25883 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:46.039171 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:46.039386 25883 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:46.039783 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:22:46.040697 25650 leader_election.cc:343] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:46.041244 25649 leader_election.cc:343] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:46.041724 25649 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:22:46.044997 25883 raft_consensus.cc:2749] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:46.047629 25879 raft_consensus.cc:359] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:46.064631 25879 raft_consensus.cc:385] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:46.064967 25879 raft_consensus.cc:740] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
I20260709 12:22:46.068619 25672 tablet_service.cc:1511] Processing CreateTablet for tablet 5204a6a2db104ffa90f8679086d4e6f8 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:22:46.069994 25672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5204a6a2db104ffa90f8679086d4e6f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.060233 25823 tablet_service.cc:1511] Processing CreateTablet for tablet 0c043718ee3a40fea4b2b1453fcb259b (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:22:46.061829 25877 tablet_bootstrap.cc:654] T b679f7cf7f1e468582715c3427ced820 P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:46.062132 25878 tablet_bootstrap.cc:654] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:46.065703 25879 consensus_queue.cc:260] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:46.099483 25902 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:46.103494 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:22:46.104206 25686 raft_consensus.cc:3060] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:46.107198 25822 tablet_service.cc:1511] Processing CreateTablet for tablet 5204a6a2db104ffa90f8679086d4e6f8 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:22:46.109763 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:22:46.110394 25763 raft_consensus.cc:3060] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:46.104910 25749 tablet_service.cc:1511] Processing CreateTablet for tablet 5204a6a2db104ffa90f8679086d4e6f8 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:22:46.121156 25749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5204a6a2db104ffa90f8679086d4e6f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.121048 25671 tablet_service.cc:1511] Processing CreateTablet for tablet 2bb433064bfd49359e66128eb1c5edb3 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:22:46.122295 25671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bb433064bfd49359e66128eb1c5edb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.114779 25902 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:46.119817 25823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c043718ee3a40fea4b2b1453fcb259b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.131369 25902 consensus_queue.cc:1048] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:22:46.133746 25877 tablet_bootstrap.cc:492] T b679f7cf7f1e468582715c3427ced820 P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:46.134280 25877 ts_tablet_manager.cc:1403] T b679f7cf7f1e468582715c3427ced820 P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.106s	user 0.015s	sys 0.012s
I20260709 12:22:46.137151 25879 ts_tablet_manager.cc:1434] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.120s	user 0.003s	sys 0.005s
I20260709 12:22:46.137355 25822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5204a6a2db104ffa90f8679086d4e6f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.137380 25877 raft_consensus.cc:359] T b679f7cf7f1e468582715c3427ced820 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:46.138360 25879 tablet_bootstrap.cc:492] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
I20260709 12:22:46.138391 25877 raft_consensus.cc:385] T b679f7cf7f1e468582715c3427ced820 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:46.139163 25877 raft_consensus.cc:740] T b679f7cf7f1e468582715c3427ced820 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
I20260709 12:22:46.140075 25877 consensus_queue.cc:260] T b679f7cf7f1e468582715c3427ced820 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:46.142144 25748 tablet_service.cc:1511] Processing CreateTablet for tablet 2bb433064bfd49359e66128eb1c5edb3 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:22:46.143348 25877 ts_tablet_manager.cc:1434] T b679f7cf7f1e468582715c3427ced820 P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 12:22:46.143579 25748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bb433064bfd49359e66128eb1c5edb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.144619 25877 tablet_bootstrap.cc:492] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
I20260709 12:22:46.150359 25883 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:46.150861 25883 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:46.151962 25877 tablet_bootstrap.cc:654] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:46.149729 25902 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:46.156008 25902 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:46.156287 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:46.157131 25837 raft_consensus.cc:2468] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 0.
I20260709 12:22:46.158630 25650 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:46.165138 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:46.165316 25827 tablet_service.cc:1511] Processing CreateTablet for tablet 2bb433064bfd49359e66128eb1c5edb3 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:22:46.166556 25827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bb433064bfd49359e66128eb1c5edb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.170351 25751 tablet_service.cc:1511] Processing CreateTablet for tablet 7939d783f9eb4a738d840145c79cf380 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:22:46.172263 25902 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:46.172477 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:46.173122 25684 raft_consensus.cc:2468] T b679f7cf7f1e468582715c3427ced820 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 0.
I20260709 12:22:46.173077 25669 tablet_service.cc:1511] Processing CreateTablet for tablet 7939d783f9eb4a738d840145c79cf380 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:22:46.173717 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:46.174582 25669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7939d783f9eb4a738d840145c79cf380. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:22:46.174866 25649 leader_election.cc:343] T b679f7cf7f1e468582715c3427ced820 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:46.175107 25800 leader_election.cc:343] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:46.175714 25801 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:22:46.177207 25686 raft_consensus.cc:2468] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 1.
I20260709 12:22:46.177848 25902 raft_consensus.cc:2804] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:46.178300 25902 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:46.178699 25902 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:46.155305 25883 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:46.180799 25883 raft_consensus.cc:2804] T b679f7cf7f1e468582715c3427ced820 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:46.181422 25883 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:46.182015 25883 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:46.186306 25826 tablet_service.cc:1511] Processing CreateTablet for tablet 7939d783f9eb4a738d840145c79cf380 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:22:46.187624 25826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7939d783f9eb4a738d840145c79cf380. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.188277 25801 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:46.171746 25751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7939d783f9eb4a738d840145c79cf380. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.192260 25884 raft_consensus.cc:2804] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:46.192764 25884 raft_consensus.cc:697] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:22:46.193001 25763 raft_consensus.cc:2468] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 1.
I20260709 12:22:46.193599 25884 consensus_queue.cc:237] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:46.203048 25746 tablet_service.cc:1511] Processing CreateTablet for tablet 7954a5254e674b77843c0d32002d2e90 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:22:46.209637 25746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7954a5254e674b77843c0d32002d2e90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.210852 25825 tablet_service.cc:1511] Processing CreateTablet for tablet 7954a5254e674b77843c0d32002d2e90 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
W20260709 12:22:46.210949 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 52380.2us
I20260709 12:22:46.212038 25825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7954a5254e674b77843c0d32002d2e90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.225533 25877 tablet_bootstrap.cc:492] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:46.226032 25877 ts_tablet_manager.cc:1403] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.082s	user 0.009s	sys 0.007s
I20260709 12:22:46.228822 25672 tablet_service.cc:1511] Processing CreateTablet for tablet 7954a5254e674b77843c0d32002d2e90 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:22:46.230721 25672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7954a5254e674b77843c0d32002d2e90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.230903 25676 tablet_service.cc:1511] Processing CreateTablet for tablet c87d777e7d64471f988b07272bf2441c (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:22:46.232231 25676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c87d777e7d64471f988b07272bf2441c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.237226 25878 tablet_bootstrap.cc:492] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:46.237404 25883 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:46.240396 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
W20260709 12:22:46.241837 25649 leader_election.cc:343] T b679f7cf7f1e468582715c3427ced820 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:46.242794 25883 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:46.237789 25878 ts_tablet_manager.cc:1403] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.245s	user 0.014s	sys 0.004s
I20260709 12:22:46.249506 25750 tablet_service.cc:1511] Processing CreateTablet for tablet c87d777e7d64471f988b07272bf2441c (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:22:46.204908 25902 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:46.260066 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:22:46.260960 25750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c87d777e7d64471f988b07272bf2441c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.264392 25837 raft_consensus.cc:2393] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 1: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:22:46.268085 25583 catalog_manager.cc:5697] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 1 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:46.257627 25879 tablet_bootstrap.cc:654] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:46.273087 25826 tablet_service.cc:1511] Processing CreateTablet for tablet c87d777e7d64471f988b07272bf2441c (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:22:46.277667 25902 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:46.278960 25670 tablet_service.cc:1511] Processing CreateTablet for tablet a22f8565191e471dbe96772477b84e36 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:22:46.280289 25670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a22f8565191e471dbe96772477b84e36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.283427 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
W20260709 12:22:46.284886 25800 leader_election.cc:343] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:46.284978 25650 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:22:46.286438 25883 raft_consensus.cc:2749] T b679f7cf7f1e468582715c3427ced820 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:22:46.289026 25826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c87d777e7d64471f988b07272bf2441c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.290747 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:22:46.291543 25686 raft_consensus.cc:2393] T b679f7cf7f1e468582715c3427ced820 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 1: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:22:46.294764 25877 raft_consensus.cc:359] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:46.295629 25877 raft_consensus.cc:385] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:46.293121 25801 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:22:46.302294 25877 raft_consensus.cc:740] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
I20260709 12:22:46.304208 25877 consensus_queue.cc:260] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:46.312814 25877 ts_tablet_manager.cc:1434] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.086s	user 0.009s	sys 0.001s
I20260709 12:22:46.313872 25877 tablet_bootstrap.cc:492] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
I20260709 12:22:46.318251 25746 tablet_service.cc:1511] Processing CreateTablet for tablet a22f8565191e471dbe96772477b84e36 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:22:46.319571 25746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a22f8565191e471dbe96772477b84e36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.322849 25749 tablet_service.cc:1511] Processing CreateTablet for tablet 04fe73edd8db49c08ea7a6adb6e443e6 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:22:46.323642 25877 tablet_bootstrap.cc:654] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:46.324098 25749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04fe73edd8db49c08ea7a6adb6e443e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.330840 25902 raft_consensus.cc:2749] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:22:46.333196 25825 tablet_service.cc:1511] Processing CreateTablet for tablet a22f8565191e471dbe96772477b84e36 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:22:46.334321 25825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a22f8565191e471dbe96772477b84e36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.336000 25827 tablet_service.cc:1511] Processing CreateTablet for tablet 04fe73edd8db49c08ea7a6adb6e443e6 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:22:46.337208 25827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04fe73edd8db49c08ea7a6adb6e443e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.349866 25879 tablet_bootstrap.cc:492] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
I20260709 12:22:46.350368 25879 ts_tablet_manager.cc:1403] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.212s	user 0.016s	sys 0.031s
I20260709 12:22:46.350032 25671 tablet_service.cc:1511] Processing CreateTablet for tablet de96c5816bc14e3cb8f32ff10dc52a61 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:22:46.351316 25671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de96c5816bc14e3cb8f32ff10dc52a61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.351861 25878 raft_consensus.cc:359] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:46.352599 25878 raft_consensus.cc:385] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:46.352877 25878 raft_consensus.cc:740] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
I20260709 12:22:46.353441 25879 raft_consensus.cc:359] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:46.354945 25879 raft_consensus.cc:385] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:46.354542 25878 consensus_queue.cc:260] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:46.355374 25879 raft_consensus.cc:740] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
I20260709 12:22:46.356195 25879 consensus_queue.cc:260] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:46.358436 25879 ts_tablet_manager.cc:1434] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:22:46.359476 25879 tablet_bootstrap.cc:492] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
I20260709 12:22:46.359529 25878 ts_tablet_manager.cc:1434] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.111s	user 0.003s	sys 0.003s
I20260709 12:22:46.360585 25878 tablet_bootstrap.cc:492] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:46.350032 25670 tablet_service.cc:1511] Processing CreateTablet for tablet 04fe73edd8db49c08ea7a6adb6e443e6 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:22:46.363749 25670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04fe73edd8db49c08ea7a6adb6e443e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.366084 25879 tablet_bootstrap.cc:654] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:46.366972 25878 tablet_bootstrap.cc:654] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:46.374891 25751 tablet_service.cc:1511] Processing CreateTablet for tablet de96c5816bc14e3cb8f32ff10dc52a61 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:22:46.376204 25751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de96c5816bc14e3cb8f32ff10dc52a61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.377105 25877 tablet_bootstrap.cc:492] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:46.377575 25877 ts_tablet_manager.cc:1403] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.064s	user 0.017s	sys 0.000s
I20260709 12:22:46.382651 25877 raft_consensus.cc:359] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:46.383353 25877 raft_consensus.cc:385] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:46.383646 25877 raft_consensus.cc:740] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
I20260709 12:22:46.389506 25877 consensus_queue.cc:260] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:46.391763 25877 ts_tablet_manager.cc:1434] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 12:22:46.402285 25877 tablet_bootstrap.cc:492] T 47453d79f4484e7ea165be91f0269a2b P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
I20260709 12:22:46.402112 25827 tablet_service.cc:1511] Processing CreateTablet for tablet de96c5816bc14e3cb8f32ff10dc52a61 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:22:46.405193 25827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de96c5816bc14e3cb8f32ff10dc52a61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.405463 25671 tablet_service.cc:1511] Processing CreateTablet for tablet 870002623db3456699b2b970d066f356 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:22:46.410303 25671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 870002623db3456699b2b970d066f356. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.411079 25877 tablet_bootstrap.cc:654] T 47453d79f4484e7ea165be91f0269a2b P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:46.415725 25879 tablet_bootstrap.cc:492] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
I20260709 12:22:46.416226 25879 ts_tablet_manager.cc:1403] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.057s	user 0.018s	sys 0.004s
I20260709 12:22:46.418226 25878 tablet_bootstrap.cc:492] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:46.419126 25878 ts_tablet_manager.cc:1403] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.059s	user 0.011s	sys 0.018s
I20260709 12:22:46.418944 25879 raft_consensus.cc:359] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:46.419734 25879 raft_consensus.cc:385] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:46.419365 25751 tablet_service.cc:1511] Processing CreateTablet for tablet 870002623db3456699b2b970d066f356 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:22:46.420083 25879 raft_consensus.cc:740] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
I20260709 12:22:46.420825 25751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 870002623db3456699b2b970d066f356. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.420836 25879 consensus_queue.cc:260] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:46.423188 25879 ts_tablet_manager.cc:1434] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 12:22:46.424360 25879 tablet_bootstrap.cc:492] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
I20260709 12:22:46.426967 25912 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:46.427551 25912 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:46.430809 25902 consensus_queue.cc:1048] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:46.434474 25749 tablet_service.cc:1511] Processing CreateTablet for tablet f50d78c25fc8461f8670d3708bbce774 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:22:46.441005 25826 tablet_service.cc:1511] Processing CreateTablet for tablet 870002623db3456699b2b970d066f356 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:22:46.442479 25826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 870002623db3456699b2b970d066f356. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.442296 25822 tablet_service.cc:1511] Processing CreateTablet for tablet f50d78c25fc8461f8670d3708bbce774 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:22:46.443557 25822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f50d78c25fc8461f8670d3708bbce774. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.445716 25670 tablet_service.cc:1511] Processing CreateTablet for tablet f50d78c25fc8461f8670d3708bbce774 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:22:46.447427 25670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f50d78c25fc8461f8670d3708bbce774. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.449380 25686 raft_consensus.cc:3060] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:46.446269 25749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f50d78c25fc8461f8670d3708bbce774. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.424996 25878 raft_consensus.cc:359] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:46.457248 25878 raft_consensus.cc:385] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:46.458016 25878 raft_consensus.cc:740] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
I20260709 12:22:46.459232 25878 consensus_queue.cc:260] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:46.461406 25879 tablet_bootstrap.cc:654] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:46.463315 25878 ts_tablet_manager.cc:1434] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.013s
I20260709 12:22:46.465757 25878 tablet_bootstrap.cc:492] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:46.473546 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:46.474210 25685 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 0.
I20260709 12:22:46.475184 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:46.475788 25837 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 0.
I20260709 12:22:46.476528 25726 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:46.475798 25669 tablet_service.cc:1511] Processing CreateTablet for tablet ea014f5d4c6744b9b7032f2fa25b4165 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:22:46.477999 25669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea014f5d4c6744b9b7032f2fa25b4165. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.480099 25886 raft_consensus.cc:2804] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:46.480504 25886 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:46.480927 25886 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:46.486405 25878 tablet_bootstrap.cc:654] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:46.494282 25750 tablet_service.cc:1511] Processing CreateTablet for tablet ea014f5d4c6744b9b7032f2fa25b4165 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:22:46.495563 25750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea014f5d4c6744b9b7032f2fa25b4165. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.500032 25912 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:46.501016 25912 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:46.501564 25912 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:46.504693 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:46.505308 25685 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 0.
I20260709 12:22:46.505872 25886 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:46.506700 25726 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:46.508993 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:22:46.509533 25685 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:46.510277 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:22:46.510819 25837 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:46.521821 25685 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 1.
I20260709 12:22:46.522006 25837 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 1.
I20260709 12:22:46.523483 25902 consensus_queue.cc:1048] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:46.523952 25726 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:22:46.541563 25928 raft_consensus.cc:2804] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:46.542188 25928 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:46.542620 25928 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:46.557287 25670 tablet_service.cc:1511] Processing CreateTablet for tablet 43b78aa0054b4da398a8fc04d12454a7 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:22:46.559211 25670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43b78aa0054b4da398a8fc04d12454a7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:22:46.559628 25632 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:46.515023 25886 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:46.577358 25750 tablet_service.cc:1511] Processing CreateTablet for tablet 43b78aa0054b4da398a8fc04d12454a7 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:22:46.579385 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:46.580513 25750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43b78aa0054b4da398a8fc04d12454a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.570787 25912 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:22:46.584486 25726 leader_election.cc:343] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:46.572039 25826 tablet_service.cc:1511] Processing CreateTablet for tablet ea014f5d4c6744b9b7032f2fa25b4165 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:22:46.584432 25912 raft_consensus.cc:2804] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:46.593142 25826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea014f5d4c6744b9b7032f2fa25b4165. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.596767 25878 tablet_bootstrap.cc:492] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:46.597435 25878 ts_tablet_manager.cc:1403] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.132s	user 0.015s	sys 0.026s
I20260709 12:22:46.593633 25912 raft_consensus.cc:697] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 1 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:22:46.600901 25912 consensus_queue.cc:237] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:46.602887 25879 tablet_bootstrap.cc:492] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
I20260709 12:22:46.602721 25878 raft_consensus.cc:359] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:46.603538 25879 ts_tablet_manager.cc:1403] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.179s	user 0.030s	sys 0.060s
I20260709 12:22:46.605427 25878 raft_consensus.cc:385] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:46.606510 25878 raft_consensus.cc:740] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
I20260709 12:22:46.607368 25878 consensus_queue.cc:260] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:46.621392 25879 raft_consensus.cc:359] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:46.622282 25879 raft_consensus.cc:385] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:46.621990 25822 tablet_service.cc:1511] Processing CreateTablet for tablet 43b78aa0054b4da398a8fc04d12454a7 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:22:46.622663 25879 raft_consensus.cc:740] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
I20260709 12:22:46.623495 25822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43b78aa0054b4da398a8fc04d12454a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.624516 25676 tablet_service.cc:1511] Processing CreateTablet for tablet 3767151a5d4345659810a40ea7f44873 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:22:46.625841 25676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3767151a5d4345659810a40ea7f44873. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.629235 25877 tablet_bootstrap.cc:492] T 47453d79f4484e7ea165be91f0269a2b P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:46.630182 25877 ts_tablet_manager.cc:1403] T 47453d79f4484e7ea165be91f0269a2b P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.228s	user 0.044s	sys 0.052s
I20260709 12:22:46.631268 25886 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:46.631810 25886 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:46.634850 25928 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:46.636291 25886 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:46.636919 25928 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:46.636966 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:46.637647 25686 raft_consensus.cc:2468] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 0.
I20260709 12:22:46.638854 25878 ts_tablet_manager.cc:1434] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.041s	user 0.009s	sys 0.000s
I20260709 12:22:46.640002 25878 tablet_bootstrap.cc:492] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:46.642611 25726 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:46.643972 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:22:46.644577 25686 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:46.645392 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:46.646322 25837 raft_consensus.cc:2468] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 0.
I20260709 12:22:46.647143 25878 tablet_bootstrap.cc:654] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:46.644438 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:22:46.644565 25928 raft_consensus.cc:2804] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:46.650863 25928 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:46.623699 25879 consensus_queue.cc:260] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:22:46.663050 25726 leader_election.cc:343] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:46.665854 25877 raft_consensus.cc:359] T 47453d79f4484e7ea165be91f0269a2b P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:46.666520 25877 raft_consensus.cc:385] T 47453d79f4484e7ea165be91f0269a2b P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:46.666790 25877 raft_consensus.cc:740] T 47453d79f4484e7ea165be91f0269a2b P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
I20260709 12:22:46.667933 25877 consensus_queue.cc:260] T 47453d79f4484e7ea165be91f0269a2b P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:46.669842 25877 ts_tablet_manager.cc:1434] T 47453d79f4484e7ea165be91f0269a2b P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.039s	user 0.004s	sys 0.000s
I20260709 12:22:46.670698 25877 tablet_bootstrap.cc:492] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
I20260709 12:22:46.660501 25928 raft_consensus.cc:3060] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:46.674562 25583 catalog_manager.cc:5697] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 1 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:46.690765 25928 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:46.683389 25686 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 1.
I20260709 12:22:46.683866 25826 tablet_service.cc:1511] Processing CreateTablet for tablet 3767151a5d4345659810a40ea7f44873 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:22:46.696542 25826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3767151a5d4345659810a40ea7f44873. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.683687 25670 tablet_service.cc:1511] Processing CreateTablet for tablet 63f47864b8d248a792567d96c5e453b8 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:22:46.685397 25751 tablet_service.cc:1511] Processing CreateTablet for tablet 63f47864b8d248a792567d96c5e453b8 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:22:46.676043 25877 tablet_bootstrap.cc:654] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:46.700675 25670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63f47864b8d248a792567d96c5e453b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.701931 25827 tablet_service.cc:1511] Processing CreateTablet for tablet 63f47864b8d248a792567d96c5e453b8 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:22:46.702888 25750 tablet_service.cc:1511] Processing CreateTablet for tablet 3767151a5d4345659810a40ea7f44873 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:22:46.703465 25827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63f47864b8d248a792567d96c5e453b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.700719 25751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63f47864b8d248a792567d96c5e453b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.708106 25749 tablet_service.cc:1511] Processing CreateTablet for tablet 8dcbaf690aa54e4887d08b85cec29701 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:22:46.709468 25749 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dcbaf690aa54e4887d08b85cec29701. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.712263 25746 tablet_service.cc:1511] Processing CreateTablet for tablet b12e2b074f1b4518bcfc6728abeca136 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:22:46.713584 25746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b12e2b074f1b4518bcfc6728abeca136. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.719100 25672 tablet_service.cc:1511] Processing CreateTablet for tablet b12e2b074f1b4518bcfc6728abeca136 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:22:46.720288 25672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b12e2b074f1b4518bcfc6728abeca136. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.723189 25825 tablet_service.cc:1511] Processing CreateTablet for tablet 8dcbaf690aa54e4887d08b85cec29701 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:22:46.719123 25750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3767151a5d4345659810a40ea7f44873. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.724548 25825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dcbaf690aa54e4887d08b85cec29701. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.723690 25823 tablet_service.cc:1511] Processing CreateTablet for tablet b12e2b074f1b4518bcfc6728abeca136 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:22:46.730276 25726 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:22:46.730829 25823 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b12e2b074f1b4518bcfc6728abeca136. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.735675 25886 raft_consensus.cc:2804] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:46.736274 25886 raft_consensus.cc:697] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8 [term 1 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:22:46.737140 25886 consensus_queue.cc:237] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:46.714893 25669 tablet_service.cc:1511] Processing CreateTablet for tablet 8dcbaf690aa54e4887d08b85cec29701 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:22:46.744086 25669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dcbaf690aa54e4887d08b85cec29701. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.751456 25748 tablet_service.cc:1511] Processing CreateTablet for tablet 05232536e53b419682a5f24515843652 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:22:46.752998 25748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05232536e53b419682a5f24515843652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.755776 25745 tablet_service.cc:1511] Processing CreateTablet for tablet 06c3ab7c0c7a496390151c476ec675a0 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:22:46.757527 25745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06c3ab7c0c7a496390151c476ec675a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.761967 25670 tablet_service.cc:1511] Processing CreateTablet for tablet 05232536e53b419682a5f24515843652 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:22:46.763286 25670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05232536e53b419682a5f24515843652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.765787 25751 tablet_service.cc:1511] Processing CreateTablet for tablet afda1f2e78cc4f799b9bad380ffd3d44 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:22:46.767355 25751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afda1f2e78cc4f799b9bad380ffd3d44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.823472 25878 tablet_bootstrap.cc:492] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:46.823992 25878 ts_tablet_manager.cc:1403] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.184s	user 0.016s	sys 0.027s
I20260709 12:22:46.827159 25913 consensus_queue.cc:1048] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:22:46.828878 25928 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:46.830726 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:22:46.831426 25836 raft_consensus.cc:3060] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:46.837359 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:22:46.837700 25885 consensus_queue.cc:1048] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:46.838025 25686 raft_consensus.cc:3060] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:46.840276 25836 raft_consensus.cc:2468] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 1.
I20260709 12:22:46.841849 25726 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:22:46.842772 25928 raft_consensus.cc:2804] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:46.843278 25928 raft_consensus.cc:697] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 1 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:22:46.844185 25928 consensus_queue.cc:237] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:46.846637 25686 raft_consensus.cc:2468] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 1.
I20260709 12:22:46.847278 25672 tablet_service.cc:1511] Processing CreateTablet for tablet 06c3ab7c0c7a496390151c476ec675a0 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:22:46.849812 25672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06c3ab7c0c7a496390151c476ec675a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.862180 25825 tablet_service.cc:1511] Processing CreateTablet for tablet 05232536e53b419682a5f24515843652 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:22:46.864025 25825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05232536e53b419682a5f24515843652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.888641 25673 tablet_service.cc:1511] Processing CreateTablet for tablet 74bf68992e4a43c78d2ef30e6c477746 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:22:46.890152 25673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74bf68992e4a43c78d2ef30e6c477746. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.890509 25877 tablet_bootstrap.cc:492] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:46.890995 25877 ts_tablet_manager.cc:1403] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.220s	user 0.030s	sys 0.026s
I20260709 12:22:46.909750 25885 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:46.910522 25885 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:46.914335 25668 tablet_service.cc:1511] Processing CreateTablet for tablet afda1f2e78cc4f799b9bad380ffd3d44 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:22:46.952004 25825 tablet_service.cc:1511] Processing CreateTablet for tablet 06c3ab7c0c7a496390151c476ec675a0 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:22:46.953209 25825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06c3ab7c0c7a496390151c476ec675a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.953542 25750 tablet_service.cc:1511] Processing CreateTablet for tablet 74bf68992e4a43c78d2ef30e6c477746 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:22:46.954384 25750 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74bf68992e4a43c78d2ef30e6c477746. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.967087 25668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afda1f2e78cc4f799b9bad380ffd3d44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.968989 25877 raft_consensus.cc:359] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:46.969872 25877 raft_consensus.cc:385] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:46.969782 25675 tablet_service.cc:1511] Processing CreateTablet for tablet 2d9ca842256c405c98d29454943e5d01 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:22:46.970216 25877 raft_consensus.cc:740] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
I20260709 12:22:46.968992 25674 tablet_service.cc:1511] Processing CreateTablet for tablet 3d79b16002fc460a9e70bd0a5bcec639 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:22:46.972755 25675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d9ca842256c405c98d29454943e5d01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.973937 25667 tablet_service.cc:1511] Processing CreateTablet for tablet 5aae9f34f7154346afd482b3183ee180 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:22:46.975158 25674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d79b16002fc460a9e70bd0a5bcec639. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.974997 25671 tablet_service.cc:1511] Processing CreateTablet for tablet 022a05e9e59f4ddf8f793ff24696476d (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:22:46.975842 25667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5aae9f34f7154346afd482b3183ee180. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.976661 25879 ts_tablet_manager.cc:1434] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.371s	user 0.011s	sys 0.003s
I20260709 12:22:46.977807 25879 tablet_bootstrap.cc:492] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
I20260709 12:22:46.980016 25928 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:46.980584 25928 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:46.983229 25827 tablet_service.cc:1511] Processing CreateTablet for tablet afda1f2e78cc4f799b9bad380ffd3d44 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:22:46.984639 25827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afda1f2e78cc4f799b9bad380ffd3d44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.985131 25826 tablet_service.cc:1511] Processing CreateTablet for tablet 74bf68992e4a43c78d2ef30e6c477746 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:22:46.986316 25826 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74bf68992e4a43c78d2ef30e6c477746. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.985998 25822 tablet_service.cc:1511] Processing CreateTablet for tablet 3d79b16002fc460a9e70bd0a5bcec639 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:22:46.987517 25822 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d79b16002fc460a9e70bd0a5bcec639. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.990726 25821 tablet_service.cc:1511] Processing CreateTablet for tablet 2d9ca842256c405c98d29454943e5d01 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:22:46.992285 25821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d9ca842256c405c98d29454943e5d01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:46.959805 25878 raft_consensus.cc:359] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:46.998999 25878 raft_consensus.cc:385] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:46.999414 25878 raft_consensus.cc:740] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
I20260709 12:22:47.000264 25878 consensus_queue.cc:260] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.003754 25883 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.003504 25824 tablet_service.cc:1511] Processing CreateTablet for tablet 5aae9f34f7154346afd482b3183ee180 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:22:47.004272 25883 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.005007 25824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5aae9f34f7154346afd482b3183ee180. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:47.006175 25883 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:47.008183 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:22:47.010562 25649 leader_election.cc:343] T 47453d79f4484e7ea165be91f0269a2b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:47.011724 25877 consensus_queue.cc:260] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.013073 25676 tablet_service.cc:1511] Processing CreateTablet for tablet 51d1a71a6e1f4e20842a35cdeb808ac0 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:22:47.013701 25877 ts_tablet_manager.cc:1434] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.122s	user 0.016s	sys 0.008s
I20260709 12:22:47.015383 25877 tablet_bootstrap.cc:492] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
I20260709 12:22:47.017230 25820 tablet_service.cc:1511] Processing CreateTablet for tablet 022a05e9e59f4ddf8f793ff24696476d (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:22:47.017764 25928 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:47.018357 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:47.019163 25836 raft_consensus.cc:2393] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 1: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:22:47.019671 25819 tablet_service.cc:1511] Processing CreateTablet for tablet 51d1a71a6e1f4e20842a35cdeb808ac0 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:22:47.022047 25818 tablet_service.cc:1511] Processing CreateTablet for tablet 2a278e46eb5d49edab4ba69303448a66 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:22:47.022531 25820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 022a05e9e59f4ddf8f793ff24696476d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:47.023376 25818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a278e46eb5d49edab4ba69303448a66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:47.028611 25672 tablet_service.cc:1511] Processing CreateTablet for tablet 2a278e46eb5d49edab4ba69303448a66 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:22:47.037859 25819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51d1a71a6e1f4e20842a35cdeb808ac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:47.046815 25878 ts_tablet_manager.cc:1434] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.222s	user 0.010s	sys 0.000s
I20260709 12:22:47.047870 25878 tablet_bootstrap.cc:492] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:47.053166 25751 tablet_service.cc:1511] Processing CreateTablet for tablet 2d9ca842256c405c98d29454943e5d01 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:22:47.054319 25751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d9ca842256c405c98d29454943e5d01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:47.057114 25753 tablet_service.cc:1511] Processing CreateTablet for tablet 5aae9f34f7154346afd482b3183ee180 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:22:47.058427 25753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5aae9f34f7154346afd482b3183ee180. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:47.058797 25879 tablet_bootstrap.cc:654] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:47.062845 25748 tablet_service.cc:1511] Processing CreateTablet for tablet 3d79b16002fc460a9e70bd0a5bcec639 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:22:47.065322 25748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d79b16002fc460a9e70bd0a5bcec639. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:47.066732 25928 consensus_queue.cc:1048] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:47.067600 25747 tablet_service.cc:1511] Processing CreateTablet for tablet 022a05e9e59f4ddf8f793ff24696476d (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:22:47.069353 25747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 022a05e9e59f4ddf8f793ff24696476d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:47.076542 25671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 022a05e9e59f4ddf8f793ff24696476d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:47.080528 25885 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:47.083931 25672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a278e46eb5d49edab4ba69303448a66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:47.084893 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:47.159155 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:47.159556 25752 tablet_service.cc:1511] Processing CreateTablet for tablet 2a278e46eb5d49edab4ba69303448a66 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:22:47.160909 25752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a278e46eb5d49edab4ba69303448a66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:47.159869 25684 raft_consensus.cc:2468] T 47453d79f4484e7ea165be91f0269a2b P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 0.
I20260709 12:22:47.123664 25676 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51d1a71a6e1f4e20842a35cdeb808ac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:47.165449 25748 tablet_service.cc:1511] Processing CreateTablet for tablet 06bd2840931844279521c7e8eb8750bf (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:22:47.166389 25748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06bd2840931844279521c7e8eb8750bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:47.176136 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:47.176820 25837 raft_consensus.cc:2468] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 0.
I20260709 12:22:47.180142 25928 consensus_queue.cc:1048] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:22:47.178519 25685 raft_consensus.cc:2393] T b679f7cf7f1e468582715c3427ced820 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 1: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:22:47.125200 25746 tablet_service.cc:1511] Processing CreateTablet for tablet 51d1a71a6e1f4e20842a35cdeb808ac0 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:22:47.211261 25825 tablet_service.cc:1511] Processing CreateTablet for tablet 06bd2840931844279521c7e8eb8750bf (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:22:47.212662 25825 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06bd2840931844279521c7e8eb8750bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:47.214023 25675 tablet_service.cc:1511] Processing CreateTablet for tablet 06bd2840931844279521c7e8eb8750bf (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:22:47.216742 25801 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:47.217742 25726 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:22:47.214263 25650 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:22:47.220615 25883 raft_consensus.cc:2804] T 47453d79f4484e7ea165be91f0269a2b P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:47.220988 25883 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:47.221329 25883 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:47.224090 25886 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:47.231545 25886 raft_consensus.cc:2749] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:47.239974 25913 raft_consensus.cc:2804] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:47.246716 25913 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:47.247074 25913 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:47.247130 25886 consensus_queue.cc:1048] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:47.246337 25883 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.254016 25746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51d1a71a6e1f4e20842a35cdeb808ac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:47.269169 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:47.271464 25877 tablet_bootstrap.cc:654] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:47.273080 25670 tablet_service.cc:1511] Processing CreateTablet for tablet 4e8d1d3d43ad47308fae5ed98608feb8 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:22:47.273751 25879 tablet_bootstrap.cc:492] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
I20260709 12:22:47.274385 25879 ts_tablet_manager.cc:1403] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.297s	user 0.012s	sys 0.022s
I20260709 12:22:47.307351 25670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e8d1d3d43ad47308fae5ed98608feb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:47.331259 25878 tablet_bootstrap.cc:654] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:47.325109 25943 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.336377 25675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06bd2840931844279521c7e8eb8750bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:47.358582 25883 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:22:47.333029 25800 leader_election.cc:343] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:47.333757 25836 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:47.320892 25913 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.368842 25824 tablet_service.cc:1511] Processing CreateTablet for tablet 4e8d1d3d43ad47308fae5ed98608feb8 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:22:47.364652 25879 raft_consensus.cc:359] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.375146 25879 raft_consensus.cc:385] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:47.375512 25879 raft_consensus.cc:740] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
I20260709 12:22:47.377823 25879 consensus_queue.cc:260] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.373421 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:22:47.379478 25837 raft_consensus.cc:2393] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 1: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:22:47.380355 25913 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:47.380421 25753 tablet_service.cc:1511] Processing CreateTablet for tablet 4e8d1d3d43ad47308fae5ed98608feb8 (DEFAULT_TABLE table=test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:22:47.383055 25753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e8d1d3d43ad47308fae5ed98608feb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:47.388576 25824 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e8d1d3d43ad47308fae5ed98608feb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:47.395473 25879 ts_tablet_manager.cc:1434] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.121s	user 0.008s	sys 0.000s
I20260709 12:22:47.360561 25943 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.396534 25879 tablet_bootstrap.cc:492] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
I20260709 12:22:47.401485 25943 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:47.397013 25877 tablet_bootstrap.cc:492] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
W20260709 12:22:47.382030 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 49070us
I20260709 12:22:47.402879 25877 ts_tablet_manager.cc:1403] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.388s	user 0.025s	sys 0.027s
I20260709 12:22:47.403836 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:22:47.405242 25650 leader_election.cc:343] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:47.406805 25886 consensus_queue.cc:1048] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:47.407047 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:22:47.407632 25761 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:47.417495 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:22:47.421352 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:47.426304 25584 catalog_manager.cc:5697] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 1 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } }
I20260709 12:22:47.429868 25902 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.432463 25902 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.435056 25761 raft_consensus.cc:2468] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 1.
I20260709 12:22:47.436728 25800 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:22:47.437619 25913 raft_consensus.cc:2804] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:47.438239 25913 raft_consensus.cc:697] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:22:47.439342 25913 consensus_queue.cc:237] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.441319 25886 consensus_queue.cc:1048] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:47.445520 25902 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:47.446784 25877 raft_consensus.cc:359] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.447432 25877 raft_consensus.cc:385] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:47.447530 25878 tablet_bootstrap.cc:492] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:47.447702 25877 raft_consensus.cc:740] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
I20260709 12:22:47.448087 25878 ts_tablet_manager.cc:1403] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.400s	user 0.016s	sys 0.019s
I20260709 12:22:47.448390 25877 consensus_queue.cc:260] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.450392 25877 ts_tablet_manager.cc:1434] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.012s
I20260709 12:22:47.450713 25878 raft_consensus.cc:359] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.451267 25877 tablet_bootstrap.cc:492] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
I20260709 12:22:47.451375 25878 raft_consensus.cc:385] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:47.451728 25878 raft_consensus.cc:740] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
I20260709 12:22:47.453084 25878 consensus_queue.cc:260] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.453233 25583 catalog_manager.cc:5697] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 1 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:47.458146 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:47.467628 25879 tablet_bootstrap.cc:654] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:47.475078 25877 tablet_bootstrap.cc:654] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:47.476841 25878 ts_tablet_manager.cc:1434] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 12:22:47.479252 25878 tablet_bootstrap.cc:492] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:47.493301 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:22:47.493968 25685 raft_consensus.cc:2393] T 47453d79f4484e7ea165be91f0269a2b P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 1: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:22:47.500275 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:47.502110 25649 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:22:47.502447 25946 consensus_queue.cc:1048] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:47.503019 25943 raft_consensus.cc:2749] T 47453d79f4484e7ea165be91f0269a2b P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:22:47.503400 25649 leader_election.cc:343] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:47.505143 25649 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:22:47.505924 25943 raft_consensus.cc:2749] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:47.508210 25801 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:22:47.509298 25913 raft_consensus.cc:2749] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:47.535307 25878 tablet_bootstrap.cc:654] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:47.538659 25583 catalog_manager.cc:5697] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 1 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:47.540901 25879 tablet_bootstrap.cc:492] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
I20260709 12:22:47.544482 25879 ts_tablet_manager.cc:1403] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.148s	user 0.023s	sys 0.017s
I20260709 12:22:47.541566 25877 tablet_bootstrap.cc:492] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:47.546554 25877 ts_tablet_manager.cc:1403] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.095s	user 0.010s	sys 0.010s
I20260709 12:22:47.547143 25879 raft_consensus.cc:359] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.543313 25878 tablet_bootstrap.cc:492] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:47.547874 25879 raft_consensus.cc:385] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:47.548203 25879 raft_consensus.cc:740] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
I20260709 12:22:47.548712 25943 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.548730 25877 raft_consensus.cc:359] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.548911 25879 consensus_queue.cc:260] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.549211 25943 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.549614 25877 raft_consensus.cc:385] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:47.549893 25877 raft_consensus.cc:740] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
I20260709 12:22:47.550554 25877 consensus_queue.cc:260] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.551008 25879 ts_tablet_manager.cc:1434] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:22:47.551163 25943 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:47.551873 25879 tablet_bootstrap.cc:492] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
I20260709 12:22:47.552825 25877 ts_tablet_manager.cc:1434] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:22:47.552867 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:47.553839 25877 tablet_bootstrap.cc:492] T a8fa32386b77471b923cc6c4241570d5 P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
I20260709 12:22:47.554137 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:22:47.555475 25649 leader_election.cc:343] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:47.548344 25878 ts_tablet_manager.cc:1403] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.069s	user 0.010s	sys 0.000s
W20260709 12:22:47.556030 25650 leader_election.cc:343] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:47.557467 25879 tablet_bootstrap.cc:654] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:47.558379 25878 raft_consensus.cc:359] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.559034 25878 raft_consensus.cc:385] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:47.559327 25878 raft_consensus.cc:740] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
I20260709 12:22:47.559975 25878 consensus_queue.cc:260] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.561769 25877 tablet_bootstrap.cc:654] T a8fa32386b77471b923cc6c4241570d5 P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:47.561969 25878 ts_tablet_manager.cc:1434] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:22:47.556469 25650 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:22:47.562839 25878 tablet_bootstrap.cc:492] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:47.564018 25951 raft_consensus.cc:2749] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:47.568894 25878 tablet_bootstrap.cc:654] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:47.577065 25877 tablet_bootstrap.cc:492] T a8fa32386b77471b923cc6c4241570d5 P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:47.577664 25877 ts_tablet_manager.cc:1403] T a8fa32386b77471b923cc6c4241570d5 P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.006s
I20260709 12:22:47.581224 25877 raft_consensus.cc:359] T a8fa32386b77471b923cc6c4241570d5 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.581889 25877 raft_consensus.cc:385] T a8fa32386b77471b923cc6c4241570d5 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:47.582151 25877 raft_consensus.cc:740] T a8fa32386b77471b923cc6c4241570d5 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
I20260709 12:22:47.582772 25877 consensus_queue.cc:260] T a8fa32386b77471b923cc6c4241570d5 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.585098 25877 ts_tablet_manager.cc:1434] T a8fa32386b77471b923cc6c4241570d5 P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:22:47.585875 25877 tablet_bootstrap.cc:492] T f979ddeb5c014d329931d4e2e035af60 P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
I20260709 12:22:47.593367 25879 tablet_bootstrap.cc:492] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
I20260709 12:22:47.593928 25879 ts_tablet_manager.cc:1403] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.042s	user 0.007s	sys 0.015s
W20260709 12:22:47.594725 25632 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:47.597465 25878 tablet_bootstrap.cc:492] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:47.597900 25878 ts_tablet_manager.cc:1403] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.035s	user 0.006s	sys 0.010s
I20260709 12:22:47.597806 25879 raft_consensus.cc:359] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.598431 25879 raft_consensus.cc:385] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:47.598672 25879 raft_consensus.cc:740] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
I20260709 12:22:47.598819 25877 tablet_bootstrap.cc:654] T f979ddeb5c014d329931d4e2e035af60 P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:47.599298 25879 consensus_queue.cc:260] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.600502 25878 raft_consensus.cc:359] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.601135 25879 ts_tablet_manager.cc:1434] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:22:47.601120 25878 raft_consensus.cc:385] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:47.601630 25878 raft_consensus.cc:740] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
I20260709 12:22:47.602478 25878 consensus_queue.cc:260] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.602449 25879 tablet_bootstrap.cc:492] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
I20260709 12:22:47.604490 25878 ts_tablet_manager.cc:1434] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 12:22:47.605604 25878 tablet_bootstrap.cc:492] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:47.608777 25877 tablet_bootstrap.cc:492] T f979ddeb5c014d329931d4e2e035af60 P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:47.609220 25877 ts_tablet_manager.cc:1403] T f979ddeb5c014d329931d4e2e035af60 P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.024s	user 0.002s	sys 0.009s
I20260709 12:22:47.610659 25879 tablet_bootstrap.cc:654] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:47.611346 25878 tablet_bootstrap.cc:654] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:47.612372 25877 raft_consensus.cc:359] T f979ddeb5c014d329931d4e2e035af60 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.613039 25877 raft_consensus.cc:385] T f979ddeb5c014d329931d4e2e035af60 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:47.613291 25877 raft_consensus.cc:740] T f979ddeb5c014d329931d4e2e035af60 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
I20260709 12:22:47.613900 25877 consensus_queue.cc:260] T f979ddeb5c014d329931d4e2e035af60 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.616858 25877 ts_tablet_manager.cc:1434] T f979ddeb5c014d329931d4e2e035af60 P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:22:47.620101 25877 tablet_bootstrap.cc:492] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
I20260709 12:22:47.621191 25878 tablet_bootstrap.cc:492] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:47.621665 25878 ts_tablet_manager.cc:1403] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.003s
I20260709 12:22:47.624504 25878 raft_consensus.cc:359] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.625234 25878 raft_consensus.cc:385] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:47.625591 25878 raft_consensus.cc:740] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
I20260709 12:22:47.626417 25878 consensus_queue.cc:260] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.628226 25877 tablet_bootstrap.cc:654] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:47.628774 25878 ts_tablet_manager.cc:1434] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:22:47.629720 25878 tablet_bootstrap.cc:492] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:47.635511 25878 tablet_bootstrap.cc:654] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:47.638041 25879 tablet_bootstrap.cc:492] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
I20260709 12:22:47.638581 25879 ts_tablet_manager.cc:1403] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.036s	user 0.016s	sys 0.016s
I20260709 12:22:47.641804 25879 raft_consensus.cc:359] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.642536 25879 raft_consensus.cc:385] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:47.642855 25879 raft_consensus.cc:740] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
I20260709 12:22:47.643438 25877 tablet_bootstrap.cc:492] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:47.643541 25879 consensus_queue.cc:260] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.644713 25878 tablet_bootstrap.cc:492] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:47.645182 25878 ts_tablet_manager.cc:1403] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.004s
I20260709 12:22:47.645538 25879 ts_tablet_manager.cc:1434] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:22:47.646684 25879 tablet_bootstrap.cc:492] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
I20260709 12:22:47.647855 25878 raft_consensus.cc:359] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.648562 25878 raft_consensus.cc:385] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:47.648886 25878 raft_consensus.cc:740] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
I20260709 12:22:47.649652 25878 consensus_queue.cc:260] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.651636 25878 ts_tablet_manager.cc:1434] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:22:47.644371 25877 ts_tablet_manager.cc:1403] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.007s
I20260709 12:22:47.652838 25879 tablet_bootstrap.cc:654] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:47.654662 25877 raft_consensus.cc:359] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.655339 25877 raft_consensus.cc:385] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:47.655711 25877 raft_consensus.cc:740] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
I20260709 12:22:47.656026 25878 tablet_bootstrap.cc:492] T f1625669bcc54589846d8a3d94c097d4 P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:47.656533 25877 consensus_queue.cc:260] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.660346 25879 tablet_bootstrap.cc:492] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
I20260709 12:22:47.660907 25879 ts_tablet_manager.cc:1403] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.004s
I20260709 12:22:47.664045 25878 tablet_bootstrap.cc:654] T f1625669bcc54589846d8a3d94c097d4 P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:47.663614 25879 raft_consensus.cc:359] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.666234 25879 raft_consensus.cc:385] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:47.666522 25879 raft_consensus.cc:740] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
I20260709 12:22:47.660425 25877 ts_tablet_manager.cc:1434] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:22:47.667333 25879 consensus_queue.cc:260] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.668649 25877 tablet_bootstrap.cc:492] T 25bd5658646b41608d707d196c6e0585 P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
I20260709 12:22:47.669385 25879 ts_tablet_manager.cc:1434] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:22:47.672312 25878 tablet_bootstrap.cc:492] T f1625669bcc54589846d8a3d94c097d4 P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:47.673207 25878 ts_tablet_manager.cc:1403] T f1625669bcc54589846d8a3d94c097d4 P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.002s
I20260709 12:22:47.675722 25878 raft_consensus.cc:359] T f1625669bcc54589846d8a3d94c097d4 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.676257 25877 tablet_bootstrap.cc:654] T 25bd5658646b41608d707d196c6e0585 P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:47.676409 25878 raft_consensus.cc:385] T f1625669bcc54589846d8a3d94c097d4 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:47.676739 25878 raft_consensus.cc:740] T f1625669bcc54589846d8a3d94c097d4 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
I20260709 12:22:47.677517 25878 consensus_queue.cc:260] T f1625669bcc54589846d8a3d94c097d4 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.679644 25878 ts_tablet_manager.cc:1434] T f1625669bcc54589846d8a3d94c097d4 P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:22:47.680548 25879 tablet_bootstrap.cc:492] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
I20260709 12:22:47.684813 25878 tablet_bootstrap.cc:492] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:47.686726 25879 tablet_bootstrap.cc:654] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:47.693992 25951 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.694665 25877 tablet_bootstrap.cc:492] T 25bd5658646b41608d707d196c6e0585 P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:47.694818 25878 tablet_bootstrap.cc:654] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:47.694504 25951 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.695119 25877 ts_tablet_manager.cc:1403] T 25bd5658646b41608d707d196c6e0585 P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.027s	user 0.021s	sys 0.001s
I20260709 12:22:47.697852 25951 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:47.697825 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:47.698184 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:47.698674 25761 raft_consensus.cc:2468] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 0.
I20260709 12:22:47.700189 25649 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:47.700461 25879 tablet_bootstrap.cc:492] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
I20260709 12:22:47.698719 25836 raft_consensus.cc:2468] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 0.
I20260709 12:22:47.701043 25879 ts_tablet_manager.cc:1403] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.002s
I20260709 12:22:47.702435 25951 raft_consensus.cc:2804] T f979ddeb5c014d329931d4e2e035af60 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:47.702862 25951 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:47.703269 25951 raft_consensus.cc:3060] T f979ddeb5c014d329931d4e2e035af60 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:47.697829 25877 raft_consensus.cc:359] T 25bd5658646b41608d707d196c6e0585 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.704727 25879 raft_consensus.cc:359] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.705220 25886 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.705256 25877 raft_consensus.cc:385] T 25bd5658646b41608d707d196c6e0585 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:47.705873 25877 raft_consensus.cc:740] T 25bd5658646b41608d707d196c6e0585 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
I20260709 12:22:47.705776 25886 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.706873 25878 tablet_bootstrap.cc:492] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:47.706682 25877 consensus_queue.cc:260] T 25bd5658646b41608d707d196c6e0585 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.707324 25878 ts_tablet_manager.cc:1403] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.008s
I20260709 12:22:47.708925 25877 ts_tablet_manager.cc:1434] T 25bd5658646b41608d707d196c6e0585 P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 12:22:47.710340 25878 raft_consensus.cc:359] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.707839 25886 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:47.710556 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:47.711452 25836 raft_consensus.cc:2468] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 0.
I20260709 12:22:47.711819 25951 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.712144 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:47.712669 25726 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:22:47.712785 25684 raft_consensus.cc:2468] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 0.
I20260709 12:22:47.713840 25951 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:47.712004 25877 tablet_bootstrap.cc:492] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
I20260709 12:22:47.714995 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:22:47.705446 25879 raft_consensus.cc:385] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:47.715560 25835 raft_consensus.cc:3060] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:47.715667 25879 raft_consensus.cc:740] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
I20260709 12:22:47.716419 25879 consensus_queue.cc:260] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.711527 25878 raft_consensus.cc:385] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:47.717288 25946 raft_consensus.cc:2804] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:47.717340 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:22:47.717770 25946 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:47.717970 25761 raft_consensus.cc:3060] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:47.718139 25946 raft_consensus.cc:3060] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:47.718309 25879 ts_tablet_manager.cc:1434] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:22:47.719246 25879 tablet_bootstrap.cc:492] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
I20260709 12:22:47.722007 25878 raft_consensus.cc:740] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
I20260709 12:22:47.724581 25878 consensus_queue.cc:260] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.726321 25951 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.727957 25946 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.728816 25943 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.729262 25943 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.731251 25943 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:47.727257 25951 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.733501 25878 ts_tablet_manager.cc:1434] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.001s
I20260709 12:22:47.733749 25951 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:47.736105 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:22:47.736788 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:47.740175 25684 raft_consensus.cc:3060] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:47.737445 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:47.741470 25837 raft_consensus.cc:2468] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 0.
I20260709 12:22:47.743654 25878 tablet_bootstrap.cc:492] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:47.738509 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:47.739297 25835 raft_consensus.cc:2468] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 1.
I20260709 12:22:47.737831 25761 raft_consensus.cc:2468] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 1.
I20260709 12:22:47.745227 25650 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:47.746511 25760 raft_consensus.cc:2468] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 0.
I20260709 12:22:47.746733 25951 raft_consensus.cc:2804] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:47.747077 25951 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:47.747759 25951 raft_consensus.cc:3060] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:47.749122 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:22:47.748479 25649 leader_election.cc:343] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:47.751056 25649 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:47.749888 25836 raft_consensus.cc:2468] T f1625669bcc54589846d8a3d94c097d4 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 0.
I20260709 12:22:47.754114 25879 tablet_bootstrap.cc:654] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:47.754855 25943 raft_consensus.cc:2804] T f979ddeb5c014d329931d4e2e035af60 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:47.755347 25943 raft_consensus.cc:697] T f979ddeb5c014d329931d4e2e035af60 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:22:47.756192 25943 consensus_queue.cc:237] T f979ddeb5c014d329931d4e2e035af60 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.756896 25650 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:22:47.757198 25684 raft_consensus.cc:2468] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 1.
I20260709 12:22:47.759473 25883 raft_consensus.cc:2804] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:47.759835 25883 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:47.760182 25883 raft_consensus.cc:3060] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:47.771713 25877 tablet_bootstrap.cc:654] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:47.774715 25726 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:47.776093 25886 raft_consensus.cc:2804] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:47.776569 25886 raft_consensus.cc:697] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 1 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:22:47.777428 25886 consensus_queue.cc:237] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.779862 25951 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.782337 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:22:47.782960 25836 raft_consensus.cc:3060] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:47.786562 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:22:47.787173 25760 raft_consensus.cc:3060] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:47.773667 25946 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:47.780104 25883 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.790547 25951 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:47.792714 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:22:47.793603 25835 raft_consensus.cc:3060] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:47.794334 25836 raft_consensus.cc:2468] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 1.
I20260709 12:22:47.799095 25760 raft_consensus.cc:2468] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 1.
I20260709 12:22:47.799544 25583 catalog_manager.cc:5697] T f979ddeb5c014d329931d4e2e035af60 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 0 to 1, leader changed from <none> to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 1 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:47.806444 25878 tablet_bootstrap.cc:654] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:47.809196 25581 catalog_manager.cc:5697] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 1 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:47.811051 25883 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:47.812090 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:22:47.804404 25835 raft_consensus.cc:2468] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 1.
I20260709 12:22:47.814476 25836 raft_consensus.cc:3060] T f1625669bcc54589846d8a3d94c097d4 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:47.809568 25649 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:47.822184 25883 raft_consensus.cc:2804] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:47.823001 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:22:47.824746 25877 tablet_bootstrap.cc:492] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:47.825187 25883 raft_consensus.cc:697] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:22:47.825431 25877 ts_tablet_manager.cc:1403] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.114s	user 0.021s	sys 0.021s
I20260709 12:22:47.826231 25883 consensus_queue.cc:237] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.826998 25879 tablet_bootstrap.cc:492] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
I20260709 12:22:47.827670 25879 ts_tablet_manager.cc:1403] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.109s	user 0.007s	sys 0.013s
I20260709 12:22:47.830013 25877 raft_consensus.cc:359] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.830818 25877 raft_consensus.cc:385] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:47.831158 25877 raft_consensus.cc:740] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
W20260709 12:22:47.831845 25649 leader_election.cc:343] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:47.832042 25877 consensus_queue.cc:260] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.835433 25877 ts_tablet_manager.cc:1434] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:22:47.836845 25877 tablet_bootstrap.cc:492] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
I20260709 12:22:47.838184 25836 raft_consensus.cc:2468] T f1625669bcc54589846d8a3d94c097d4 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 1.
I20260709 12:22:47.839749 25650 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:22:47.840551 25879 raft_consensus.cc:359] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.841431 25879 raft_consensus.cc:385] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:47.841665 25879 raft_consensus.cc:740] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
I20260709 12:22:47.842373 25975 raft_consensus.cc:2804] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:47.842880 25975 raft_consensus.cc:697] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:22:47.842919 25879 consensus_queue.cc:260] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.843532 25878 tablet_bootstrap.cc:492] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:47.844105 25878 ts_tablet_manager.cc:1403] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.101s	user 0.017s	sys 0.007s
I20260709 12:22:47.844173 25975 consensus_queue.cc:237] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.846799 25877 tablet_bootstrap.cc:654] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:47.849189 25879 ts_tablet_manager.cc:1434] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260709 12:22:47.850270 25879 tablet_bootstrap.cc:492] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
I20260709 12:22:47.850986 25878 raft_consensus.cc:359] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.851714 25878 raft_consensus.cc:385] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:47.854928 25878 raft_consensus.cc:740] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
I20260709 12:22:47.855726 25878 consensus_queue.cc:260] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.857672 25879 tablet_bootstrap.cc:654] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:47.858062 25878 ts_tablet_manager.cc:1434] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:22:47.860390 25878 tablet_bootstrap.cc:492] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:47.873214 25879 tablet_bootstrap.cc:492] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
I20260709 12:22:47.872802 25581 catalog_manager.cc:5697] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 0 to 1, leader changed from <none> to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 1 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:47.873709 25879 ts_tablet_manager.cc:1403] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.009s
I20260709 12:22:47.874019 25878 tablet_bootstrap.cc:654] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:47.875108 25913 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.875555 25913 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.876725 25879 raft_consensus.cc:359] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.877588 25879 raft_consensus.cc:385] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:47.877987 25879 raft_consensus.cc:740] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
I20260709 12:22:47.878964 25879 consensus_queue.cc:260] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.879484 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:47.881420 25684 raft_consensus.cc:2468] T a8fa32386b77471b923cc6c4241570d5 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 0.
I20260709 12:22:47.882002 25879 ts_tablet_manager.cc:1434] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:22:47.882642 25801 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:47.883297 25879 tablet_bootstrap.cc:492] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
I20260709 12:22:47.883471 25884 raft_consensus.cc:2804] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:47.883891 25884 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:47.884248 25884 raft_consensus.cc:3060] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:47.887511 25877 tablet_bootstrap.cc:492] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:47.888406 25877 ts_tablet_manager.cc:1403] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.052s	user 0.013s	sys 0.009s
I20260709 12:22:47.891047 25877 raft_consensus.cc:359] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.880808 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:47.891798 25877 raft_consensus.cc:385] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:47.892208 25877 raft_consensus.cc:740] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
I20260709 12:22:47.892940 25877 consensus_queue.cc:260] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.894673 25879 tablet_bootstrap.cc:654] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:47.895501 25877 ts_tablet_manager.cc:1434] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:22:47.892208 25760 raft_consensus.cc:2468] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 0.
I20260709 12:22:47.877599 25913 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:47.901746 25584 catalog_manager.cc:5697] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 0 to 1, leader changed from <none> to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 1 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:47.907801 25879 tablet_bootstrap.cc:492] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
I20260709 12:22:47.908529 25879 ts_tablet_manager.cc:1403] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.008s
I20260709 12:22:47.909427 25884 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.913161 25884 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:47.913717 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:22:47.914348 25760 raft_consensus.cc:3060] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:47.896499 25877 tablet_bootstrap.cc:492] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
I20260709 12:22:47.917106 25878 tablet_bootstrap.cc:492] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:47.917624 25878 ts_tablet_manager.cc:1403] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.058s	user 0.020s	sys 0.026s
I20260709 12:22:47.917747 25946 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.918216 25946 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.918671 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:22:47.919211 25684 raft_consensus.cc:3060] T a8fa32386b77471b923cc6c4241570d5 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:47.920338 25946 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:47.923251 25760 raft_consensus.cc:2468] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 1.
I20260709 12:22:47.923403 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:47.924165 25836 raft_consensus.cc:2468] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 0.
I20260709 12:22:47.925540 25800 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:22:47.926071 25913 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.926450 25884 raft_consensus.cc:2804] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:47.926762 25879 raft_consensus.cc:359] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.926988 25884 raft_consensus.cc:697] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:22:47.927409 25879 raft_consensus.cc:385] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:47.927702 25879 raft_consensus.cc:740] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
I20260709 12:22:47.927963 25884 consensus_queue.cc:237] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.929688 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:47.930524 25685 raft_consensus.cc:2468] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 0.
I20260709 12:22:47.930433 25878 raft_consensus.cc:359] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.931205 25878 raft_consensus.cc:385] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:47.931535 25878 raft_consensus.cc:740] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
I20260709 12:22:47.932243 25726 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:22:47.932281 25878 consensus_queue.cc:260] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.933182 25684 raft_consensus.cc:2468] T a8fa32386b77471b923cc6c4241570d5 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 1.
I20260709 12:22:47.934015 25946 raft_consensus.cc:2804] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:47.926582 25913 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.934583 25946 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:47.935128 25946 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:47.936833 25913 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:47.937834 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:47.938840 25685 raft_consensus.cc:2468] T 25bd5658646b41608d707d196c6e0585 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 0.
I20260709 12:22:47.937994 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:47.940243 25760 raft_consensus.cc:2468] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 0.
I20260709 12:22:47.928267 25879 consensus_queue.cc:260] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.941886 25800 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:22:47.942873 25879 ts_tablet_manager.cc:1434] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 12:22:47.943131 25913 raft_consensus.cc:2804] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:47.943974 25879 tablet_bootstrap.cc:492] T 97d7984a0036411695d6b3427bff9d69 P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
I20260709 12:22:47.934592 25878 ts_tablet_manager.cc:1434] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.002s
I20260709 12:22:47.945159 25877 tablet_bootstrap.cc:654] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:47.945188 25878 tablet_bootstrap.cc:492] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:47.943674 25913 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:47.947352 25913 raft_consensus.cc:3060] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:47.955183 25946 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.957942 25946 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:47.955834 25581 catalog_manager.cc:5697] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 1 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:47.959201 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:22:47.962160 25684 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:47.959981 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:22:47.964210 25836 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:47.965169 25879 tablet_bootstrap.cc:654] T 97d7984a0036411695d6b3427bff9d69 P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:47.972350 25946 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:47.975018 25884 consensus_queue.cc:1048] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:47.975605 25946 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.976171 25878 tablet_bootstrap.cc:654] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:47.979962 25946 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:47.981215 25684 raft_consensus.cc:2468] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 1.
I20260709 12:22:47.981483 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:47.982322 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:47.982333 25835 raft_consensus.cc:2393] T f1625669bcc54589846d8a3d94c097d4 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 1: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:22:47.984460 25726 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:47.985455 25948 raft_consensus.cc:2804] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:47.985982 25948 raft_consensus.cc:697] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:22:47.986919 25948 consensus_queue.cc:237] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:47.987308 25726 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:22:47.988343 25928 raft_consensus.cc:3060] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:47.999293 25928 raft_consensus.cc:2749] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:47.998979 25884 consensus_queue.cc:1048] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:47.987284 25836 raft_consensus.cc:2468] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 1.
I20260709 12:22:48.006776 25975 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.011629 25975 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.012773 25913 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.014874 25975 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:48.016620 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:22:48.031879 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:48.026162 25761 raft_consensus.cc:3060] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:48.020218 25913 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:48.037827 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:22:48.042263 25684 raft_consensus.cc:3060] T 25bd5658646b41608d707d196c6e0585 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:48.036597 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:48.055383 25761 raft_consensus.cc:2468] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 1.
W20260709 12:22:48.040469 25649 leader_election.cc:343] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:48.059347 25800 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:22:48.060364 25913 raft_consensus.cc:2804] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:48.060858 25913 raft_consensus.cc:697] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:22:48.061340 25878 tablet_bootstrap.cc:492] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:48.061872 25878 ts_tablet_manager.cc:1403] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.117s	user 0.021s	sys 0.027s
I20260709 12:22:48.061712 25913 consensus_queue.cc:237] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:22:48.064378 25650 leader_election.cc:343] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:48.066989 25650 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:22:48.069325 25975 raft_consensus.cc:2749] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:48.073046 25878 raft_consensus.cc:359] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.073817 25878 raft_consensus.cc:385] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:48.074085 25878 raft_consensus.cc:740] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
I20260709 12:22:48.073081 25684 raft_consensus.cc:2468] T 25bd5658646b41608d707d196c6e0585 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 1.
I20260709 12:22:48.074819 25878 consensus_queue.cc:260] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.077693 25878 ts_tablet_manager.cc:1434] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 12:22:48.078418 25877 tablet_bootstrap.cc:492] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:48.078572 25878 tablet_bootstrap.cc:492] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:48.078895 25877 ts_tablet_manager.cc:1403] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.183s	user 0.034s	sys 0.048s
I20260709 12:22:48.081405 25902 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.081918 25902 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.085170 25902 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:48.086179 25878 tablet_bootstrap.cc:654] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:48.086272 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:48.088316 25762 raft_consensus.cc:2468] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 1.
I20260709 12:22:48.081936 25877 raft_consensus.cc:359] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.089808 25877 raft_consensus.cc:385] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:48.089901 25800 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:22:48.090704 25877 raft_consensus.cc:740] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
I20260709 12:22:48.095597 25879 tablet_bootstrap.cc:492] T 97d7984a0036411695d6b3427bff9d69 P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
I20260709 12:22:48.101467 25879 ts_tablet_manager.cc:1403] T 97d7984a0036411695d6b3427bff9d69 P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.158s	user 0.020s	sys 0.034s
I20260709 12:22:48.102819 25913 raft_consensus.cc:2804] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:48.103873 25913 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:48.105211 25913 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:48.108026 25584 catalog_manager.cc:5697] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 1 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:48.110143 25878 tablet_bootstrap.cc:492] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:48.110541 25878 ts_tablet_manager.cc:1403] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.032s	user 0.007s	sys 0.012s
I20260709 12:22:48.113027 25878 raft_consensus.cc:359] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.113723 25878 raft_consensus.cc:385] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:48.113993 25878 raft_consensus.cc:740] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
I20260709 12:22:48.114640 25878 consensus_queue.cc:260] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.116626 25878 ts_tablet_manager.cc:1434] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:22:48.116099 25913 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.117573 25878 tablet_bootstrap.cc:492] T 0a6b77683d6547db82cd02da9d9c938a P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:48.118399 25913 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:48.119534 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:22:48.120754 25761 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:48.123250 25878 tablet_bootstrap.cc:654] T 0a6b77683d6547db82cd02da9d9c938a P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:48.124639 25879 raft_consensus.cc:359] T 97d7984a0036411695d6b3427bff9d69 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.125290 25879 raft_consensus.cc:385] T 97d7984a0036411695d6b3427bff9d69 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:48.125535 25879 raft_consensus.cc:740] T 97d7984a0036411695d6b3427bff9d69 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
I20260709 12:22:48.126127 25879 consensus_queue.cc:260] T 97d7984a0036411695d6b3427bff9d69 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.106276 25998 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.105945 25877 consensus_queue.cc:260] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.129125 25998 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.130378 25877 ts_tablet_manager.cc:1434] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.002s
W20260709 12:22:48.132632 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 49473.8us
I20260709 12:22:48.132881 25761 raft_consensus.cc:2468] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 2.
I20260709 12:22:48.134181 25877 tablet_bootstrap.cc:492] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
I20260709 12:22:48.135289 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:48.135942 25685 raft_consensus.cc:2468] T b679f7cf7f1e468582715c3427ced820 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 1.
I20260709 12:22:48.137313 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:22:48.137912 25685 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:48.140530 25877 tablet_bootstrap.cc:654] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:48.144361 25800 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:22:48.145430 25913 raft_consensus.cc:2804] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:48.146203 25913 raft_consensus.cc:697] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 2 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:22:48.147078 25913 consensus_queue.cc:237] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.149129 25878 tablet_bootstrap.cc:492] T 0a6b77683d6547db82cd02da9d9c938a P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:48.149565 25878 ts_tablet_manager.cc:1403] T 0a6b77683d6547db82cd02da9d9c938a P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.032s	user 0.018s	sys 0.005s
I20260709 12:22:48.150023 25583 catalog_manager.cc:5697] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 1 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:48.152097 25878 raft_consensus.cc:359] T 0a6b77683d6547db82cd02da9d9c938a P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.152858 25878 raft_consensus.cc:385] T 0a6b77683d6547db82cd02da9d9c938a P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:48.153208 25878 raft_consensus.cc:740] T 0a6b77683d6547db82cd02da9d9c938a P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
I20260709 12:22:48.154059 25878 consensus_queue.cc:260] T 0a6b77683d6547db82cd02da9d9c938a P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.156749 25878 ts_tablet_manager.cc:1434] T 0a6b77683d6547db82cd02da9d9c938a P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:22:48.157945 25878 tablet_bootstrap.cc:492] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:48.165845 25878 tablet_bootstrap.cc:654] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:48.172369 25913 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.173043 25913 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.175757 25913 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:48.176874 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:48.177534 25761 raft_consensus.cc:2468] T 97d7984a0036411695d6b3427bff9d69 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 0.
I20260709 12:22:48.178772 25800 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:22:48.179670 25913 raft_consensus.cc:2804] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:48.179702 25975 consensus_queue.cc:1048] T f979ddeb5c014d329931d4e2e035af60 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:48.180146 25913 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:48.180501 25913 raft_consensus.cc:3060] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:48.186843 25878 tablet_bootstrap.cc:492] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:48.187469 25878 ts_tablet_manager.cc:1403] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.011s
I20260709 12:22:48.191063 25878 raft_consensus.cc:359] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.192021 25878 raft_consensus.cc:385] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:48.192370 25878 raft_consensus.cc:740] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
I20260709 12:22:48.192220 25913 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.194080 25878 consensus_queue.cc:260] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.195623 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:22:48.196487 25760 raft_consensus.cc:3060] T 97d7984a0036411695d6b3427bff9d69 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:48.203114 25913 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:48.203241 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:48.205349 25998 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:48.205651 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:22:48.206458 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:48.207105 25762 raft_consensus.cc:2468] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 0.
I20260709 12:22:48.208698 25800 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:22:48.209612 25685 raft_consensus.cc:2468] T b679f7cf7f1e468582715c3427ced820 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 2.
I20260709 12:22:48.212474 25997 raft_consensus.cc:2804] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:48.213896 25997 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:48.214283 25997 raft_consensus.cc:3060] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:48.214788 25879 ts_tablet_manager.cc:1434] T 97d7984a0036411695d6b3427bff9d69 P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.113s	user 0.006s	sys 0.000s
I20260709 12:22:48.216406 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:48.217095 25879 tablet_bootstrap.cc:492] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
I20260709 12:22:48.217319 25686 raft_consensus.cc:2468] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 0.
W20260709 12:22:48.213280 25801 leader_election.cc:343] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:48.215620 25878 ts_tablet_manager.cc:1434] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.005s
I20260709 12:22:48.220146 25760 raft_consensus.cc:2468] T 97d7984a0036411695d6b3427bff9d69 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 1.
W20260709 12:22:48.220665 25801 leader_election.cc:343] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:48.221498 25878 tablet_bootstrap.cc:492] T c38d3f292da44b3dbb2e512cd53e21da P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:48.212942 25581 catalog_manager.cc:5697] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 0 to 2, leader changed from <none> to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 2 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:48.221762 25800 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:22:48.225458 25902 raft_consensus.cc:2804] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:48.225934 25902 raft_consensus.cc:697] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:22:48.226748 25902 consensus_queue.cc:237] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.233371 25878 tablet_bootstrap.cc:654] T c38d3f292da44b3dbb2e512cd53e21da P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:48.236083 25879 tablet_bootstrap.cc:654] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:48.256102 25997 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.260310 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:22:48.261114 25684 raft_consensus.cc:3060] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:48.267757 25883 consensus_queue.cc:1048] T f979ddeb5c014d329931d4e2e035af60 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:48.271783 25684 raft_consensus.cc:2468] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 1.
I20260709 12:22:48.273449 25997 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:48.274206 25877 tablet_bootstrap.cc:492] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:48.274679 25877 ts_tablet_manager.cc:1403] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.141s	user 0.025s	sys 0.013s
I20260709 12:22:48.274516 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:22:48.275292 25760 raft_consensus.cc:3060] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:48.277446 25801 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:48.277976 25877 raft_consensus.cc:359] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.278658 25877 raft_consensus.cc:385] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:48.278980 25877 raft_consensus.cc:740] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
I20260709 12:22:48.279376 25975 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.279855 25975 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.280939 25877 consensus_queue.cc:260] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.282182 25975 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:48.282785 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:48.282963 25760 raft_consensus.cc:2468] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 1.
I20260709 12:22:48.283103 25998 raft_consensus.cc:2804] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:48.283234 25877 ts_tablet_manager.cc:1434] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:22:48.283625 25998 raft_consensus.cc:697] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
W20260709 12:22:48.284492 25649 leader_election.cc:343] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:48.285349 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:48.285213 25998 consensus_queue.cc:237] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.286190 25835 raft_consensus.cc:2468] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 0.
I20260709 12:22:48.287412 25650 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:22:48.288640 25883 raft_consensus.cc:2804] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:48.289052 25883 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:48.289390 25883 raft_consensus.cc:3060] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:48.289656 25877 tablet_bootstrap.cc:492] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
I20260709 12:22:48.307260 25877 tablet_bootstrap.cc:654] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:48.320881 25879 tablet_bootstrap.cc:492] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
I20260709 12:22:48.321365 25879 ts_tablet_manager.cc:1403] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.105s	user 0.022s	sys 0.035s
I20260709 12:22:48.321771 25878 tablet_bootstrap.cc:492] T c38d3f292da44b3dbb2e512cd53e21da P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:48.322368 25878 ts_tablet_manager.cc:1403] T c38d3f292da44b3dbb2e512cd53e21da P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.102s	user 0.027s	sys 0.032s
I20260709 12:22:48.323908 25879 raft_consensus.cc:359] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.329264 25879 raft_consensus.cc:385] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:48.329535 25879 raft_consensus.cc:740] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
I20260709 12:22:48.330291 25879 consensus_queue.cc:260] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.325183 25878 raft_consensus.cc:359] T c38d3f292da44b3dbb2e512cd53e21da P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.332223 25879 ts_tablet_manager.cc:1434] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:22:48.332376 25878 raft_consensus.cc:385] T c38d3f292da44b3dbb2e512cd53e21da P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:48.332582 25878 raft_consensus.cc:740] T c38d3f292da44b3dbb2e512cd53e21da P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
I20260709 12:22:48.333228 25879 tablet_bootstrap.cc:492] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
I20260709 12:22:48.333158 25878 consensus_queue.cc:260] T c38d3f292da44b3dbb2e512cd53e21da P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.334568 25878 ts_tablet_manager.cc:1434] T c38d3f292da44b3dbb2e512cd53e21da P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:22:48.335386 25878 tablet_bootstrap.cc:492] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:48.338804 25584 catalog_manager.cc:5697] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 1 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:48.327956 25877 tablet_bootstrap.cc:492] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:48.340219 25879 tablet_bootstrap.cc:654] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:48.340374 25877 ts_tablet_manager.cc:1403] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.051s	user 0.015s	sys 0.000s
I20260709 12:22:48.340540 25584 catalog_manager.cc:5697] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 1 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:48.342963 25877 raft_consensus.cc:359] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.343577 25877 raft_consensus.cc:385] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:48.343873 25877 raft_consensus.cc:740] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
I20260709 12:22:48.344642 25877 consensus_queue.cc:260] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.345180 25878 tablet_bootstrap.cc:654] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:48.347785 25951 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.348345 25951 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.353354 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:48.354193 25836 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 0.
I20260709 12:22:48.354557 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:48.356269 25650 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:22:48.358630 25649 leader_election.cc:343] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:48.360558 25879 tablet_bootstrap.cc:492] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
I20260709 12:22:48.361011 25879 ts_tablet_manager.cc:1403] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.006s
I20260709 12:22:48.362730 25975 raft_consensus.cc:2804] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:48.363224 25975 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:48.363680 25975 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:48.363608 25879 raft_consensus.cc:359] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.364434 25879 raft_consensus.cc:385] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:48.364718 25879 raft_consensus.cc:740] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
I20260709 12:22:48.365625 25883 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.366604 25879 consensus_queue.cc:260] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.368368 25878 tablet_bootstrap.cc:492] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:48.368860 25878 ts_tablet_manager.cc:1403] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.034s	user 0.019s	sys 0.009s
I20260709 12:22:48.371491 25878 raft_consensus.cc:359] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.371989 25948 consensus_queue.cc:1048] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:48.372256 25878 raft_consensus.cc:385] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:48.372679 25878 raft_consensus.cc:740] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
I20260709 12:22:48.376375 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:22:48.376646 25883 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:48.376962 25761 raft_consensus.cc:3060] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:48.377704 25883 consensus_queue.cc:1048] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:48.378681 25879 ts_tablet_manager.cc:1434] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:22:48.379802 25879 tablet_bootstrap.cc:492] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
I20260709 12:22:48.376966 25951 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:48.386911 25879 tablet_bootstrap.cc:654] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:48.385099 25761 raft_consensus.cc:2468] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 1.
I20260709 12:22:48.388470 25649 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:48.389287 25883 raft_consensus.cc:2804] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:48.389730 25877 ts_tablet_manager.cc:1434] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.049s	user 0.005s	sys 0.000s
I20260709 12:22:48.373521 25878 consensus_queue.cc:260] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.392701 25877 tablet_bootstrap.cc:492] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
I20260709 12:22:48.392721 25878 ts_tablet_manager.cc:1434] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.001s
I20260709 12:22:48.391530 25883 raft_consensus.cc:697] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:22:48.395792 25883 consensus_queue.cc:237] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.463192 25878 tablet_bootstrap.cc:492] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:48.463855 25998 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.465464 25998 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:22:48.400002 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 43857.8us
I20260709 12:22:48.468325 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:22:48.468492 25998 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:48.468930 25835 raft_consensus.cc:3060] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:48.469976 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:48.470579 25761 raft_consensus.cc:2468] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 0.
I20260709 12:22:48.470961 25928 consensus_queue.cc:1048] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:48.472488 25800 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:22:48.473039 25878 tablet_bootstrap.cc:654] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:48.477018 25835 raft_consensus.cc:2468] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 1.
I20260709 12:22:48.481252 25997 consensus_queue.cc:1048] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:48.481896 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:48.482511 25684 raft_consensus.cc:2468] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 0.
I20260709 12:22:48.482790 25877 tablet_bootstrap.cc:654] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:48.484934 25997 raft_consensus.cc:2804] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:48.485332 25997 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:48.485688 25997 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:48.491405 25877 tablet_bootstrap.cc:492] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:48.491979 25877 ts_tablet_manager.cc:1403] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.100s	user 0.010s	sys 0.018s
I20260709 12:22:48.458935 25975 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.493454 25975 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:48.494230 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
W20260709 12:22:48.495482 25649 leader_election.cc:343] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:48.496572 25877 raft_consensus.cc:359] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.497239 25877 raft_consensus.cc:385] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:48.497522 25877 raft_consensus.cc:740] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
I20260709 12:22:48.498242 25877 consensus_queue.cc:260] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.500330 25877 ts_tablet_manager.cc:1434] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:22:48.501664 25877 tablet_bootstrap.cc:492] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
I20260709 12:22:48.505479 25998 consensus_queue.cc:1048] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:48.509591 25879 tablet_bootstrap.cc:492] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
I20260709 12:22:48.510018 25879 ts_tablet_manager.cc:1403] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.130s	user 0.017s	sys 0.000s
I20260709 12:22:48.510793 25878 tablet_bootstrap.cc:492] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:48.511188 25878 ts_tablet_manager.cc:1403] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.048s	user 0.011s	sys 0.007s
I20260709 12:22:48.508344 25913 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.512665 25928 consensus_queue.cc:1048] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:22:48.516289 25581 catalog_manager.cc:5697] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 0 to 1, leader changed from <none> to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 1 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:48.514844 25913 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.526335 25913 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:48.527453 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:48.527453 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:22:48.528568 25835 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:48.530356 25800 leader_election.cc:343] T c38d3f292da44b3dbb2e512cd53e21da P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:48.531772 25878 raft_consensus.cc:359] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.533401 25878 raft_consensus.cc:385] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:48.533748 25878 raft_consensus.cc:740] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
I20260709 12:22:48.534631 25878 consensus_queue.cc:260] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.538268 25878 ts_tablet_manager.cc:1434] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.001s
I20260709 12:22:48.538209 25998 consensus_queue.cc:1048] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:48.511512 25997 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.540768 25997 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:48.541800 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:22:48.542747 25761 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:48.546864 25879 raft_consensus.cc:359] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.547583 25879 raft_consensus.cc:385] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:48.547875 25879 raft_consensus.cc:740] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
I20260709 12:22:48.548499 25878 tablet_bootstrap.cc:492] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:48.554168 25877 tablet_bootstrap.cc:654] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:48.560819 26019 consensus_queue.cc:1048] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:22:48.593451 26021 consensus_queue.cc:1048] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:48.603307 26021 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.603798 26021 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.606046 26021 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:48.606617 25879 consensus_queue.cc:260] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.607410 25928 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.607847 25928 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.621773 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:48.622473 25833 raft_consensus.cc:2468] T c38d3f292da44b3dbb2e512cd53e21da P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 0.
I20260709 12:22:48.623176 25928 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:48.607898 25761 raft_consensus.cc:2468] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 1.
I20260709 12:22:48.631417 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:22:48.632248 25683 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:48.641175 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:48.642017 25684 raft_consensus.cc:2468] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 0.
I20260709 12:22:48.644352 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:48.646045 25801 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:22:48.655117 25998 raft_consensus.cc:2804] T c38d3f292da44b3dbb2e512cd53e21da P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:48.655661 25998 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:48.656174 25998 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:48.625515 26019 consensus_queue.cc:1048] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.032s
I20260709 12:22:48.649046 25682 raft_consensus.cc:1275] T b679f7cf7f1e468582715c3427ced820 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:22:48.626632 25835 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 1.
I20260709 12:22:48.652884 25650 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:48.690716 25879 ts_tablet_manager.cc:1434] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.180s	user 0.011s	sys 0.023s
W20260709 12:22:48.683045 25632 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:48.690227 25884 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.698573 26014 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:48.690016 25649 leader_election.cc:343] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:48.710060 25884 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.713313 25878 tablet_bootstrap.cc:654] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:48.713423 25884 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:48.693647 25951 raft_consensus.cc:2804] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:48.716265 25951 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:48.716774 25951 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:48.692857 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 61886.2us
I20260709 12:22:48.720804 25650 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:22:48.721823 25883 raft_consensus.cc:2804] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:48.722282 25883 raft_consensus.cc:697] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:22:48.722922 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:48.723706 25836 raft_consensus.cc:2393] T 0a6b77683d6547db82cd02da9d9c938a P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 1: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:22:48.723166 25883 consensus_queue.cc:237] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.725157 26014 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.728956 25877 tablet_bootstrap.cc:492] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:48.729390 25877 ts_tablet_manager.cc:1403] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.228s	user 0.018s	sys 0.008s
I20260709 12:22:48.735769 26026 consensus_queue.cc:1048] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:22:48.738827 25800 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:22:48.739128 26014 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:48.738867 25877 raft_consensus.cc:359] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.739862 25877 raft_consensus.cc:385] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:48.740221 25877 raft_consensus.cc:740] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
I20260709 12:22:48.740880 25877 consensus_queue.cc:260] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.742189 25998 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.742995 25877 ts_tablet_manager.cc:1434] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.001s
I20260709 12:22:48.744092 25902 raft_consensus.cc:2804] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:48.744452 25877 tablet_bootstrap.cc:492] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
I20260709 12:22:48.744625 25902 raft_consensus.cc:697] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:22:48.745858 25879 tablet_bootstrap.cc:492] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
I20260709 12:22:48.745523 25902 consensus_queue.cc:237] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.746419 25763 raft_consensus.cc:1275] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20260709 12:22:48.754711 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 92150.8us
I20260709 12:22:48.757254 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:48.762945 25878 tablet_bootstrap.cc:492] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:48.763415 25878 ts_tablet_manager.cc:1403] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.215s	user 0.016s	sys 0.013s
I20260709 12:22:48.761234 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:48.772930 25997 consensus_queue.cc:1048] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:48.773203 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:48.779023 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:22:48.766227 25998 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:48.792681 25581 catalog_manager.cc:5697] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 0 to 1, leader changed from <none> to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 1 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:48.793648 25902 consensus_queue.cc:1048] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:22:48.799100 26025 log.cc:927] Time spent T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:22:48.775485 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:48.801442 25998 consensus_queue.cc:1048] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:48.805531 25762 raft_consensus.cc:2393] T 97d7984a0036411695d6b3427bff9d69 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 1: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:22:48.806811 25879 tablet_bootstrap.cc:654] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:48.802528 25726 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:22:48.819351 25878 raft_consensus.cc:359] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.821064 25878 raft_consensus.cc:385] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:48.821416 25878 raft_consensus.cc:740] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
I20260709 12:22:48.822201 25878 consensus_queue.cc:260] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:22:48.815506 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 53228.1us
I20260709 12:22:48.825028 25928 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:48.835183 25878 ts_tablet_manager.cc:1434] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.071s	user 0.005s	sys 0.003s
I20260709 12:22:48.836092 25878 tablet_bootstrap.cc:492] T 8d74d1c9c8a84919a6f57b0b6721de51 P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:48.825690 25683 raft_consensus.cc:2468] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 1.
W20260709 12:22:48.844571 25801 leader_election.cc:343] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:48.846671 25877 tablet_bootstrap.cc:654] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:48.857510 26039 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.858050 26039 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:22:48.849784 25800 leader_election.cc:343] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:48.863054 26039 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:48.870644 25951 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.877506 25928 raft_consensus.cc:2749] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:48.851240 25902 consensus_queue.cc:1048] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:22:48.911846 25686 raft_consensus.cc:2393] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 1: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:22:48.948769 25951 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:48.949509 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
W20260709 12:22:48.952535 25649 leader_election.cc:343] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:48.956583 25684 raft_consensus.cc:3060] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:48.959192 25878 tablet_bootstrap.cc:654] T 8d74d1c9c8a84919a6f57b0b6721de51 P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:48.960295 25877 tablet_bootstrap.cc:492] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:48.960201 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:22:48.960821 25877 ts_tablet_manager.cc:1403] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.217s	user 0.030s	sys 0.059s
I20260709 12:22:48.963366 25877 raft_consensus.cc:359] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.964044 25877 raft_consensus.cc:385] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:48.964284 25877 raft_consensus.cc:740] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
I20260709 12:22:48.966952 25877 consensus_queue.cc:260] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.968963 25902 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:48.969435 25902 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.971359 25902 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:48.971714 25800 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:22:48.972514 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:48.968712 25877 ts_tablet_manager.cc:1434] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:22:48.977356 25877 tablet_bootstrap.cc:492] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
I20260709 12:22:48.978709 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:22:48.979693 25837 raft_consensus.cc:2393] T c38d3f292da44b3dbb2e512cd53e21da P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 1: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:22:48.982405 25650 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:22:48.982925 25877 tablet_bootstrap.cc:654] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:48.985455 26038 raft_consensus.cc:2749] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:22:48.986544 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 141962us
I20260709 12:22:48.987154 25879 tablet_bootstrap.cc:492] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
I20260709 12:22:48.987641 25879 ts_tablet_manager.cc:1403] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.242s	user 0.014s	sys 0.004s
I20260709 12:22:48.988247 25650 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:22:48.989283 25951 raft_consensus.cc:2749] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:22:48.994797 25879 raft_consensus.cc:359] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:48.996944 25879 raft_consensus.cc:385] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:48.997387 25879 raft_consensus.cc:740] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
I20260709 12:22:49.003680 26037 consensus_queue.cc:1048] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 12:22:49.018226 25879 consensus_queue.cc:260] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.024089 25879 ts_tablet_manager.cc:1434] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.001s
I20260709 12:22:49.025583 25879 tablet_bootstrap.cc:492] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
I20260709 12:22:49.027019 25951 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.014402 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:49.027537 25951 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.027704 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:49.032232 25883 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.032828 25877 tablet_bootstrap.cc:492] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:49.032711 25883 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.033265 25877 ts_tablet_manager.cc:1403] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.056s	user 0.008s	sys 0.038s
I20260709 12:22:49.036021 25877 raft_consensus.cc:359] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.036736 25877 raft_consensus.cc:385] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:49.037045 25877 raft_consensus.cc:740] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
I20260709 12:22:49.037837 25877 consensus_queue.cc:260] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.038911 26037 consensus_queue.cc:1048] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:49.041538 25951 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:22:49.042281 25800 leader_election.cc:343] T c38d3f292da44b3dbb2e512cd53e21da P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:49.046531 25800 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:22:49.048379 26037 raft_consensus.cc:2749] T c38d3f292da44b3dbb2e512cd53e21da P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:22:49.048424 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:49.049568 25837 raft_consensus.cc:2468] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 0.
I20260709 12:22:49.050017 25877 ts_tablet_manager.cc:1434] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:22:49.051752 25877 tablet_bootstrap.cc:492] T 5f0353e850934c9db0a248807127ca4c P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
I20260709 12:22:49.052372 25883 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:22:49.055871 25801 leader_election.cc:343] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:49.057073 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:22:49.057493 25801 leader_election.cc:343] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:49.050915 25650 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:49.057927 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:49.059306 26014 raft_consensus.cc:2749] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:49.064399 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:49.064848 25879 tablet_bootstrap.cc:654] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:49.065835 25650 leader_election.cc:343] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:49.070181 25951 raft_consensus.cc:2804] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:49.070647 25951 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:49.070993 25951 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:49.075335 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:49.080374 26041 consensus_queue.cc:1048] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:49.082317 25951 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.085538 25878 tablet_bootstrap.cc:492] T 8d74d1c9c8a84919a6f57b0b6721de51 P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:49.086030 25878 ts_tablet_manager.cc:1403] T 8d74d1c9c8a84919a6f57b0b6721de51 P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.250s	user 0.025s	sys 0.009s
I20260709 12:22:49.086980 25877 tablet_bootstrap.cc:654] T 5f0353e850934c9db0a248807127ca4c P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:49.088269 25951 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:22:49.089161 25649 leader_election.cc:343] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:49.090190 25649 leader_election.cc:343] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:49.090644 25649 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:22:49.090788 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:22:49.091454 25878 raft_consensus.cc:359] T 8d74d1c9c8a84919a6f57b0b6721de51 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.092144 25836 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:49.092240 25878 raft_consensus.cc:385] T 8d74d1c9c8a84919a6f57b0b6721de51 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:49.092615 25878 raft_consensus.cc:740] T 8d74d1c9c8a84919a6f57b0b6721de51 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
I20260709 12:22:49.098989 25883 consensus_queue.cc:1048] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:49.101434 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:49.101783 25583 catalog_manager.cc:5697] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 1 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:49.097882 25951 raft_consensus.cc:2749] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:49.110800 25878 consensus_queue.cc:260] T 8d74d1c9c8a84919a6f57b0b6721de51 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.109097 25836 raft_consensus.cc:2468] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 1.
I20260709 12:22:49.113365 25650 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:49.113682 25951 consensus_queue.cc:1048] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:49.115091 25883 raft_consensus.cc:2804] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:49.115793 25883 raft_consensus.cc:697] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:22:49.118993 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:22:49.128543 25878 ts_tablet_manager.cc:1434] T 8d74d1c9c8a84919a6f57b0b6721de51 P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.042s	user 0.009s	sys 0.000s
I20260709 12:22:49.118988 25883 consensus_queue.cc:237] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.130137 25878 tablet_bootstrap.cc:492] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
W20260709 12:22:49.131273 25649 leader_election.cc:343] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:49.163300 25878 tablet_bootstrap.cc:654] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:49.178814 25800 leader_election.cc:343] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:49.184377 25800 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:22:49.186352 26021 consensus_queue.cc:1048] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:49.197134 25951 consensus_queue.cc:1048] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:49.204561 26041 raft_consensus.cc:2749] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:22:49.206213 25800 leader_election.cc:343] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:49.207676 25800 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:22:49.211944 25879 tablet_bootstrap.cc:492] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
I20260709 12:22:49.215694 25879 ts_tablet_manager.cc:1403] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.190s	user 0.028s	sys 0.039s
I20260709 12:22:49.215978 26041 raft_consensus.cc:2749] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:49.217679 25948 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.219339 25948 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.222615 25948 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:49.222945 25879 raft_consensus.cc:359] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.223665 25879 raft_consensus.cc:385] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:49.224370 25879 raft_consensus.cc:740] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
I20260709 12:22:49.225487 25879 consensus_queue.cc:260] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.223594 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:22:49.236761 25726 leader_election.cc:343] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:49.234318 25879 ts_tablet_manager.cc:1434] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:22:49.243870 25879 tablet_bootstrap.cc:492] T 819272169f6f4293b6e279793be58b49 P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
I20260709 12:22:49.250185 26038 consensus_queue.cc:1048] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:49.258225 25877 tablet_bootstrap.cc:492] T 5f0353e850934c9db0a248807127ca4c P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:49.258773 25877 ts_tablet_manager.cc:1403] T 5f0353e850934c9db0a248807127ca4c P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.207s	user 0.026s	sys 0.033s
I20260709 12:22:49.261709 25878 tablet_bootstrap.cc:492] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:49.261469 25877 raft_consensus.cc:359] T 5f0353e850934c9db0a248807127ca4c P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.262158 25878 ts_tablet_manager.cc:1403] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.132s	user 0.013s	sys 0.006s
I20260709 12:22:49.263046 25879 tablet_bootstrap.cc:654] T 819272169f6f4293b6e279793be58b49 P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:49.264700 25878 raft_consensus.cc:359] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.265367 25878 raft_consensus.cc:385] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:49.265656 25878 raft_consensus.cc:740] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
I20260709 12:22:49.268180 25878 consensus_queue.cc:260] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.269943 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:49.270572 25834 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 0.
I20260709 12:22:49.271302 25878 ts_tablet_manager.cc:1434] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:22:49.272397 25878 tablet_bootstrap.cc:492] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:49.272475 26014 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.273121 26014 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.278625 26014 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:49.280857 25878 tablet_bootstrap.cc:654] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:49.284205 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:49.284878 25834 raft_consensus.cc:2468] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 0.
I20260709 12:22:49.283744 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:49.286715 25726 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:22:49.287883 25650 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:49.289197 26041 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:49.289480 25649 leader_election.cc:343] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:49.289813 26041 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.288233 26042 raft_consensus.cc:2804] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:49.292227 26041 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:49.292378 26042 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:49.292932 26042 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:49.293977 26021 raft_consensus.cc:2804] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:49.294337 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:49.294572 26021 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:49.295024 26021 raft_consensus.cc:3060] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:49.296028 25801 leader_election.cc:343] T 8d74d1c9c8a84919a6f57b0b6721de51 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:49.302646 26021 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.307539 26042 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.312183 26041 consensus_queue.cc:1048] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:49.312245 25581 catalog_manager.cc:5697] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 0 to 1, leader changed from <none> to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 1 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:49.317221 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:49.262126 25877 raft_consensus.cc:385] T 5f0353e850934c9db0a248807127ca4c P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:49.318735 25877 raft_consensus.cc:740] T 5f0353e850934c9db0a248807127ca4c P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
W20260709 12:22:49.318823 25800 leader_election.cc:343] T 8d74d1c9c8a84919a6f57b0b6721de51 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:49.319504 25800 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:22:49.320364 26041 raft_consensus.cc:2749] T 8d74d1c9c8a84919a6f57b0b6721de51 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:49.325155 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:22:49.325088 25877 consensus_queue.cc:260] T 5f0353e850934c9db0a248807127ca4c P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.325659 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:22:49.326473 25836 raft_consensus.cc:3060] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:49.326615 25649 leader_election.cc:343] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:49.329110 26021 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:49.328982 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:22:49.330886 25685 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:49.342705 25877 ts_tablet_manager.cc:1434] T 5f0353e850934c9db0a248807127ca4c P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.084s	user 0.007s	sys 0.000s
I20260709 12:22:49.345176 25877 tablet_bootstrap.cc:492] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
I20260709 12:22:49.333133 26042 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:49.365082 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:22:49.365855 25834 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:49.379496 25836 raft_consensus.cc:2468] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 1.
I20260709 12:22:49.383651 25650 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:22:49.384831 25883 raft_consensus.cc:2804] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:49.385326 25883 raft_consensus.cc:697] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:22:49.386569 25878 tablet_bootstrap.cc:492] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:49.386353 25883 consensus_queue.cc:237] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.387024 25878 ts_tablet_manager.cc:1403] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.115s	user 0.039s	sys 0.059s
I20260709 12:22:49.389670 25878 raft_consensus.cc:359] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.390329 25878 raft_consensus.cc:385] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:49.390620 25878 raft_consensus.cc:740] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
I20260709 12:22:49.391274 25878 consensus_queue.cc:260] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.394836 25877 tablet_bootstrap.cc:654] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:49.396039 25878 ts_tablet_manager.cc:1434] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:22:49.396777 25878 tablet_bootstrap.cc:492] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:49.400516 25879 tablet_bootstrap.cc:492] T 819272169f6f4293b6e279793be58b49 P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
I20260709 12:22:49.400990 25879 ts_tablet_manager.cc:1403] T 819272169f6f4293b6e279793be58b49 P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.157s	user 0.003s	sys 0.034s
I20260709 12:22:49.399794 25685 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 1.
I20260709 12:22:49.404019 25726 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:49.405035 26042 raft_consensus.cc:2804] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:49.405488 26042 raft_consensus.cc:697] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 1 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:22:49.406697 25878 tablet_bootstrap.cc:654] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:49.406253 26042 consensus_queue.cc:237] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.413864 25879 raft_consensus.cc:359] T 819272169f6f4293b6e279793be58b49 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.416451 25879 raft_consensus.cc:385] T 819272169f6f4293b6e279793be58b49 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:49.416724 25879 raft_consensus.cc:740] T 819272169f6f4293b6e279793be58b49 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
I20260709 12:22:49.418829 25879 consensus_queue.cc:260] T 819272169f6f4293b6e279793be58b49 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.418363 25834 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 1.
I20260709 12:22:49.424537 25879 ts_tablet_manager.cc:1434] T 819272169f6f4293b6e279793be58b49 P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.023s	user 0.002s	sys 0.004s
I20260709 12:22:49.425683 25879 tablet_bootstrap.cc:492] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
I20260709 12:22:49.431886 25878 tablet_bootstrap.cc:492] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:49.432374 25878 ts_tablet_manager.cc:1403] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.036s	user 0.019s	sys 0.001s
I20260709 12:22:49.432830 25879 tablet_bootstrap.cc:654] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:49.435139 25878 raft_consensus.cc:359] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.435859 25878 raft_consensus.cc:385] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:49.436266 25878 raft_consensus.cc:740] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
I20260709 12:22:49.436334 25584 catalog_manager.cc:5697] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 0 to 1, leader changed from <none> to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 1 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:49.437747 25878 consensus_queue.cc:260] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.448526 25581 catalog_manager.cc:5697] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 1 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:49.451308 25878 ts_tablet_manager.cc:1434] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:22:49.452943 25878 tablet_bootstrap.cc:492] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:49.451251 25879 tablet_bootstrap.cc:492] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
I20260709 12:22:49.453908 25879 ts_tablet_manager.cc:1403] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.008s
I20260709 12:22:49.456107 25877 tablet_bootstrap.cc:492] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:49.456599 25879 raft_consensus.cc:359] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.457257 25879 raft_consensus.cc:385] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:49.457485 25879 raft_consensus.cc:740] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
I20260709 12:22:49.458035 25879 consensus_queue.cc:260] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.458709 25878 tablet_bootstrap.cc:654] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:49.458860 25877 ts_tablet_manager.cc:1403] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.113s	user 0.033s	sys 0.012s
I20260709 12:22:49.459767 25879 ts_tablet_manager.cc:1434] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 12:22:49.460500 25879 tablet_bootstrap.cc:492] T 90d850895b8a4a40a4fba5caf2048ca2 P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
I20260709 12:22:49.461499 25877 raft_consensus.cc:359] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.462591 25877 raft_consensus.cc:385] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:49.462862 25877 raft_consensus.cc:740] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
I20260709 12:22:49.463485 25877 consensus_queue.cc:260] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.465358 25877 ts_tablet_manager.cc:1434] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:22:49.466174 25877 tablet_bootstrap.cc:492] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
I20260709 12:22:49.467595 25878 tablet_bootstrap.cc:492] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:49.468698 25878 ts_tablet_manager.cc:1403] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.016s	user 0.003s	sys 0.008s
I20260709 12:22:49.470999 25928 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.471402 25878 raft_consensus.cc:359] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.472179 25878 raft_consensus.cc:385] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:49.472303 25877 tablet_bootstrap.cc:654] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:49.472517 25878 raft_consensus.cc:740] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
I20260709 12:22:49.471547 25928 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.473320 25878 consensus_queue.cc:260] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.474524 25928 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:49.475503 25878 ts_tablet_manager.cc:1434] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:22:49.476397 25878 tablet_bootstrap.cc:492] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:49.476661 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:49.477406 25834 raft_consensus.cc:2393] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 1: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:22:49.481323 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:49.485023 25726 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:22:49.485788 25928 raft_consensus.cc:3060] T 819272169f6f4293b6e279793be58b49 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:49.488097 25878 tablet_bootstrap.cc:654] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:49.489668 25879 tablet_bootstrap.cc:654] T 90d850895b8a4a40a4fba5caf2048ca2 P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:49.502588 25928 raft_consensus.cc:2749] T 819272169f6f4293b6e279793be58b49 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:49.506349 25878 tablet_bootstrap.cc:492] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:49.507462 25878 ts_tablet_manager.cc:1403] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.014s
I20260709 12:22:49.510455 25878 raft_consensus.cc:359] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.511196 25878 raft_consensus.cc:385] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:49.511436 25878 raft_consensus.cc:740] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
I20260709 12:22:49.511530 25879 tablet_bootstrap.cc:492] T 90d850895b8a4a40a4fba5caf2048ca2 P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
I20260709 12:22:49.512041 25879 ts_tablet_manager.cc:1403] T 90d850895b8a4a40a4fba5caf2048ca2 P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.052s	user 0.003s	sys 0.007s
I20260709 12:22:49.512130 25878 consensus_queue.cc:260] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.514029 25878 ts_tablet_manager.cc:1434] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 12:22:49.515329 25878 tablet_bootstrap.cc:492] T 0c043718ee3a40fea4b2b1453fcb259b P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:49.516225 25879 raft_consensus.cc:359] T 90d850895b8a4a40a4fba5caf2048ca2 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.516897 25879 raft_consensus.cc:385] T 90d850895b8a4a40a4fba5caf2048ca2 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:49.517140 25879 raft_consensus.cc:740] T 90d850895b8a4a40a4fba5caf2048ca2 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
I20260709 12:22:49.518100 25877 tablet_bootstrap.cc:492] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:49.518513 25877 ts_tablet_manager.cc:1403] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.053s	user 0.018s	sys 0.014s
I20260709 12:22:49.518265 25879 consensus_queue.cc:260] T 90d850895b8a4a40a4fba5caf2048ca2 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.520256 25879 ts_tablet_manager.cc:1434] T 90d850895b8a4a40a4fba5caf2048ca2 P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:22:49.521097 25879 tablet_bootstrap.cc:492] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
I20260709 12:22:49.521085 25877 raft_consensus.cc:359] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.521829 25877 raft_consensus.cc:385] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:49.522073 25877 raft_consensus.cc:740] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
I20260709 12:22:49.522414 25878 tablet_bootstrap.cc:654] T 0c043718ee3a40fea4b2b1453fcb259b P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:49.522651 25877 consensus_queue.cc:260] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.527143 25879 tablet_bootstrap.cc:654] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:49.528474 25877 ts_tablet_manager.cc:1434] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:22:49.529711 25877 tablet_bootstrap.cc:492] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
I20260709 12:22:49.535308 26039 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.535780 26039 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.537863 26039 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:49.539448 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:22:49.540874 25801 leader_election.cc:343] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:49.544246 25879 tablet_bootstrap.cc:492] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
I20260709 12:22:49.544476 25877 tablet_bootstrap.cc:654] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:49.544691 25879 ts_tablet_manager.cc:1403] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.024s	user 0.004s	sys 0.012s
I20260709 12:22:49.544902 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:49.545822 25760 raft_consensus.cc:2468] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 0.
I20260709 12:22:49.546859 25800 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:22:49.547426 25879 raft_consensus.cc:359] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.548075 25878 tablet_bootstrap.cc:492] T 0c043718ee3a40fea4b2b1453fcb259b P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:49.547957 26039 raft_consensus.cc:2804] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:49.548137 25879 raft_consensus.cc:385] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:49.548583 25878 ts_tablet_manager.cc:1403] T 0c043718ee3a40fea4b2b1453fcb259b P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.012s
I20260709 12:22:49.548538 26039 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:49.548645 25879 raft_consensus.cc:740] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
I20260709 12:22:49.549223 26039 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:49.549970 25879 consensus_queue.cc:260] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.551705 25878 raft_consensus.cc:359] T 0c043718ee3a40fea4b2b1453fcb259b P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.553036 25878 raft_consensus.cc:385] T 0c043718ee3a40fea4b2b1453fcb259b P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:49.553378 25878 raft_consensus.cc:740] T 0c043718ee3a40fea4b2b1453fcb259b P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
I20260709 12:22:49.554042 25878 consensus_queue.cc:260] T 0c043718ee3a40fea4b2b1453fcb259b P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.555991 25879 ts_tablet_manager.cc:1434] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:22:49.556332 25878 ts_tablet_manager.cc:1434] T 0c043718ee3a40fea4b2b1453fcb259b P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:22:49.559377 25877 tablet_bootstrap.cc:492] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:49.559909 25877 ts_tablet_manager.cc:1403] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.004s
I20260709 12:22:49.562693 25879 tablet_bootstrap.cc:492] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
I20260709 12:22:49.563362 25877 raft_consensus.cc:359] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.564046 25877 raft_consensus.cc:385] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:49.564324 25877 raft_consensus.cc:740] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
I20260709 12:22:49.565068 25877 consensus_queue.cc:260] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.566923 25877 ts_tablet_manager.cc:1434] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 12:22:49.568080 25877 tablet_bootstrap.cc:492] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
I20260709 12:22:49.568706 25879 tablet_bootstrap.cc:654] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:49.577217 25877 tablet_bootstrap.cc:654] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:49.578827 26039 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.580926 25878 tablet_bootstrap.cc:492] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:49.589171 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:22:49.589527 25878 tablet_bootstrap.cc:654] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:49.589838 25684 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:49.591022 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:22:49.591710 25760 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:49.583389 25879 tablet_bootstrap.cc:492] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
I20260709 12:22:49.583509 25877 tablet_bootstrap.cc:492] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:49.592985 25879 ts_tablet_manager.cc:1403] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.030s	user 0.008s	sys 0.011s
I20260709 12:22:49.593143 25877 ts_tablet_manager.cc:1403] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.001s
I20260709 12:22:49.595620 25879 raft_consensus.cc:359] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.596325 25879 raft_consensus.cc:385] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:49.596591 25879 raft_consensus.cc:740] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
I20260709 12:22:49.596880 25877 raft_consensus.cc:359] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.597673 25877 raft_consensus.cc:385] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:49.598037 25877 raft_consensus.cc:740] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
I20260709 12:22:49.599030 25760 raft_consensus.cc:2468] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 1.
I20260709 12:22:49.598945 25877 consensus_queue.cc:260] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.599332 25879 consensus_queue.cc:260] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.601516 25879 ts_tablet_manager.cc:1434] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:22:49.601833 25877 ts_tablet_manager.cc:1434] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:22:49.602406 25879 tablet_bootstrap.cc:492] T 01372ae5f161477dab1b4c89fd847b3c P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
I20260709 12:22:49.602965 25684 raft_consensus.cc:2468] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 1.
I20260709 12:22:49.603420 25877 tablet_bootstrap.cc:492] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
I20260709 12:22:49.604067 25800 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:22:49.605142 26041 raft_consensus.cc:2804] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:49.605779 26041 raft_consensus.cc:697] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:22:49.606602 26039 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:49.606868 26041 consensus_queue.cc:237] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.614607 25883 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.615202 25877 tablet_bootstrap.cc:654] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:49.618075 25879 tablet_bootstrap.cc:654] T 01372ae5f161477dab1b4c89fd847b3c P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:49.615280 25883 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.626166 25877 tablet_bootstrap.cc:492] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:49.626657 25877 ts_tablet_manager.cc:1403] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.005s
I20260709 12:22:49.626857 25883 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:49.627473 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:49.628142 25834 raft_consensus.cc:2468] T 0c043718ee3a40fea4b2b1453fcb259b P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 0.
I20260709 12:22:49.628262 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:49.628952 25760 raft_consensus.cc:2468] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 0.
I20260709 12:22:49.629451 25650 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:49.629174 25877 raft_consensus.cc:359] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.630425 25877 raft_consensus.cc:385] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:49.630712 25877 raft_consensus.cc:740] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
I20260709 12:22:49.630759 26021 raft_consensus.cc:2804] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:49.631210 26021 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:49.631639 26021 raft_consensus.cc:3060] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:49.631455 25877 consensus_queue.cc:260] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.633684 25877 ts_tablet_manager.cc:1434] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:22:49.634929 25877 tablet_bootstrap.cc:492] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
I20260709 12:22:49.639079 26021 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.640369 25877 tablet_bootstrap.cc:654] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:49.641372 26021 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:49.626616 25879 tablet_bootstrap.cc:492] T 01372ae5f161477dab1b4c89fd847b3c P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
I20260709 12:22:49.642516 25879 ts_tablet_manager.cc:1403] T 01372ae5f161477dab1b4c89fd847b3c P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.040s	user 0.008s	sys 0.003s
I20260709 12:22:49.642832 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:22:49.643482 25834 raft_consensus.cc:3060] T 0c043718ee3a40fea4b2b1453fcb259b P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:49.647406 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:22:49.648005 25760 raft_consensus.cc:3060] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:49.648824 25879 raft_consensus.cc:359] T 01372ae5f161477dab1b4c89fd847b3c P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.649513 25879 raft_consensus.cc:385] T 01372ae5f161477dab1b4c89fd847b3c P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:49.649829 25879 raft_consensus.cc:740] T 01372ae5f161477dab1b4c89fd847b3c P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
I20260709 12:22:49.650506 25879 consensus_queue.cc:260] T 01372ae5f161477dab1b4c89fd847b3c P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.651244 25877 tablet_bootstrap.cc:492] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:49.651670 25877 ts_tablet_manager.cc:1403] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.000s
I20260709 12:22:49.653127 25879 ts_tablet_manager.cc:1434] T 01372ae5f161477dab1b4c89fd847b3c P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:22:49.655345 25878 tablet_bootstrap.cc:492] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:49.655836 25878 ts_tablet_manager.cc:1403] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.075s	user 0.011s	sys 0.013s
I20260709 12:22:49.658098 25879 tablet_bootstrap.cc:492] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
I20260709 12:22:49.660718 26019 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.661201 26019 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.661535 25878 raft_consensus.cc:359] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.662204 25878 raft_consensus.cc:385] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:49.662632 25878 raft_consensus.cc:740] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
I20260709 12:22:49.665270 26019 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:49.666868 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:49.666420 25877 raft_consensus.cc:359] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.667516 25877 raft_consensus.cc:385] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:49.668121 25877 raft_consensus.cc:740] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
I20260709 12:22:49.667991 25760 raft_consensus.cc:2468] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 1.
I20260709 12:22:49.669152 26037 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.668962 25877 consensus_queue.cc:260] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.670956 25649 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:49.669641 26037 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.667559 25836 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 0.
I20260709 12:22:49.672833 25878 consensus_queue.cc:260] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.674464 25650 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:49.675007 26014 raft_consensus.cc:2804] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:49.675242 26019 raft_consensus.cc:2804] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:49.675631 26014 raft_consensus.cc:697] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:22:49.675783 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:49.675954 26019 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:49.676496 26019 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:49.676528 25759 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 0.
I20260709 12:22:49.676946 25928 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.676630 26014 consensus_queue.cc:237] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.677510 25928 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.679986 26037 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:49.681646 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:49.675139 25878 ts_tablet_manager.cc:1434] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.001s
I20260709 12:22:49.682269 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:49.682482 25684 raft_consensus.cc:2393] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 1: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:22:49.686691 25878 tablet_bootstrap.cc:492] T 7954a5254e674b77843c0d32002d2e90 P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:49.684173 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:49.688236 25877 ts_tablet_manager.cc:1434] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.036s	user 0.009s	sys 0.000s
I20260709 12:22:49.657409 25834 raft_consensus.cc:2468] T 0c043718ee3a40fea4b2b1453fcb259b P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 1.
I20260709 12:22:49.689298 25877 tablet_bootstrap.cc:492] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
I20260709 12:22:49.688503 25685 raft_consensus.cc:2468] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 0.
I20260709 12:22:49.684209 25761 raft_consensus.cc:2468] T 90d850895b8a4a40a4fba5caf2048ca2 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 0.
I20260709 12:22:49.692425 25928 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:49.693370 25801 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:49.694271 26037 raft_consensus.cc:2804] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:49.694639 26037 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:49.697562 26019 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.696363 26037 raft_consensus.cc:3060] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:49.704924 26019 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:49.705281 26039 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.705809 26039 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.663715 26021 consensus_queue.cc:1048] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.028s
I20260709 12:22:49.713186 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:22:49.715562 25801 leader_election.cc:343] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:49.716925 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:22:49.717582 25836 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:49.703346 25581 catalog_manager.cc:5697] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 1 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
W20260709 12:22:49.725620 25649 consensus_peers.cc:597] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:49.720427 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:49.720454 26039 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:49.721202 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:22:49.723378 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:49.730779 25902 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.728164 26037 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.731287 25902 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.732601 25759 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:49.739342 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:22:49.738363 25834 raft_consensus.cc:2393] T c38d3f292da44b3dbb2e512cd53e21da P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 1: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
W20260709 12:22:49.742061 25800 leader_election.cc:343] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:49.742498 25800 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:22:49.743121 26039 raft_consensus.cc:2749] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:49.749750 25879 tablet_bootstrap.cc:654] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:49.745827 25685 raft_consensus.cc:3060] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:49.751574 25726 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:22:49.753618 25928 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:49.749948 25836 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 1.
I20260709 12:22:49.758257 25650 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:49.759374 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:49.760025 25684 raft_consensus.cc:2468] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 0.
I20260709 12:22:49.762889 25801 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:49.763765 26039 raft_consensus.cc:2804] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:49.764154 26039 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:49.764271 26021 raft_consensus.cc:2804] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:49.764534 26039 raft_consensus.cc:3060] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:49.764778 25902 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:49.764878 26021 raft_consensus.cc:697] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:22:49.766023 25928 raft_consensus.cc:2749] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:49.768857 26021 consensus_queue.cc:237] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.777706 25584 catalog_manager.cc:5697] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 0 to 1, leader changed from <none> to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 1 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
W20260709 12:22:49.784301 25632 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:49.789580 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:49.789991 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:22:49.790321 25760 raft_consensus.cc:2468] T 01372ae5f161477dab1b4c89fd847b3c P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 0.
I20260709 12:22:49.790601 25761 raft_consensus.cc:3060] T 90d850895b8a4a40a4fba5caf2048ca2 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:49.793707 25877 tablet_bootstrap.cc:654] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:49.796607 25878 tablet_bootstrap.cc:654] T 7954a5254e674b77843c0d32002d2e90 P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:49.808037 25928 consensus_queue.cc:1048] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:49.809520 26037 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:49.799777 25685 raft_consensus.cc:2468] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 1.
I20260709 12:22:49.814343 25759 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 1.
I20260709 12:22:49.815389 25761 raft_consensus.cc:2468] T 90d850895b8a4a40a4fba5caf2048ca2 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 1.
I20260709 12:22:49.816007 25801 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:49.820245 26041 raft_consensus.cc:2804] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:49.820748 26041 raft_consensus.cc:697] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:22:49.820828 25902 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.822446 25902 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.822645 26039 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.824822 26039 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:49.825145 25902 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:49.853601 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:22:49.861186 26041 consensus_queue.cc:237] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.863781 25878 tablet_bootstrap.cc:492] T 7954a5254e674b77843c0d32002d2e90 P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:49.864431 25878 ts_tablet_manager.cc:1403] T 7954a5254e674b77843c0d32002d2e90 P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.180s	user 0.015s	sys 0.008s
I20260709 12:22:49.869624 25877 tablet_bootstrap.cc:492] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:49.870097 25877 ts_tablet_manager.cc:1403] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.181s	user 0.009s	sys 0.011s
I20260709 12:22:49.871389 25879 tablet_bootstrap.cc:492] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
I20260709 12:22:49.875600 25879 ts_tablet_manager.cc:1403] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.218s	user 0.017s	sys 0.009s
I20260709 12:22:49.874172 25584 catalog_manager.cc:5697] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 0 to 1, leader changed from <none> to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 1 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:49.880296 26014 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:49.880765 26014 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.881176 25878 raft_consensus.cc:359] T 7954a5254e674b77843c0d32002d2e90 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.881816 25878 raft_consensus.cc:385] T 7954a5254e674b77843c0d32002d2e90 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:49.882062 25878 raft_consensus.cc:740] T 7954a5254e674b77843c0d32002d2e90 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
I20260709 12:22:49.882764 26014 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:49.882689 25878 consensus_queue.cc:260] T 7954a5254e674b77843c0d32002d2e90 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.870151 25685 raft_consensus.cc:3060] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:49.885749 25878 ts_tablet_manager.cc:1434] T 7954a5254e674b77843c0d32002d2e90 P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:22:49.886933 25878 tablet_bootstrap.cc:492] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:49.885097 25877 raft_consensus.cc:359] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.888412 25877 raft_consensus.cc:385] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:49.888706 25877 raft_consensus.cc:740] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
I20260709 12:22:49.889472 25877 consensus_queue.cc:260] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.892275 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:49.897730 25877 ts_tablet_manager.cc:1434] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.001s
I20260709 12:22:49.897665 25835 raft_consensus.cc:2468] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 0.
I20260709 12:22:49.898092 25879 raft_consensus.cc:359] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.898891 25879 raft_consensus.cc:385] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:49.899231 25879 raft_consensus.cc:740] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
I20260709 12:22:49.900061 25879 consensus_queue.cc:260] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.896621 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:49.909616 25879 ts_tablet_manager.cc:1434] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 12:22:49.905967 25650 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:49.907037 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:22:49.917140 25877 tablet_bootstrap.cc:492] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
I20260709 12:22:49.913014 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:49.919379 25879 tablet_bootstrap.cc:492] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
I20260709 12:22:49.925704 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:49.927219 25878 tablet_bootstrap.cc:654] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:49.915077 26021 raft_consensus.cc:2804] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:49.918697 25759 raft_consensus.cc:3060] T 01372ae5f161477dab1b4c89fd847b3c P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:49.936239 25883 consensus_queue.cc:1048] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:49.929864 26021 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:49.938235 26021 raft_consensus.cc:3060] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:49.938243 25801 leader_election.cc:343] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:49.936720 25685 raft_consensus.cc:2468] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 1.
I20260709 12:22:49.943104 25883 consensus_queue.cc:1048] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:22:49.943109 25649 leader_election.cc:343] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:49.946036 25801 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:49.947001 26041 raft_consensus.cc:2804] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:49.947444 26041 raft_consensus.cc:697] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:22:49.948307 26041 consensus_queue.cc:237] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:49.953004 26042 consensus_queue.cc:1048] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:22:49.963626 25877 tablet_bootstrap.cc:654] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:49.967417 25800 leader_election.cc:343] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:49.976627 25800 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:22:49.982909 26092 raft_consensus.cc:2749] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:49.983307 25879 tablet_bootstrap.cc:654] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:49.987811 25581 catalog_manager.cc:5697] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 1 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:50.075950 26019 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.076560 26019 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:50.079137 26021 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:50.098796 25759 raft_consensus.cc:2468] T 01372ae5f161477dab1b4c89fd847b3c P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 1.
I20260709 12:22:50.099473 26021 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:50.051007 26014 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.109419 26014 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:50.118530 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:22:50.127555 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:22:50.129139 25837 raft_consensus.cc:3060] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:50.129467 25649 leader_election.cc:343] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:50.137235 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:50.152390 25878 tablet_bootstrap.cc:492] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:50.152890 25878 ts_tablet_manager.cc:1403] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.266s	user 0.022s	sys 0.009s
W20260709 12:22:50.155009 25649 leader_election.cc:343] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:50.137856 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:50.191906 25879 tablet_bootstrap.cc:492] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
I20260709 12:22:50.192435 25879 ts_tablet_manager.cc:1403] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.273s	user 0.017s	sys 0.022s
I20260709 12:22:50.194949 25879 raft_consensus.cc:359] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:50.195393 25837 raft_consensus.cc:2468] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 1.
I20260709 12:22:50.195609 25879 raft_consensus.cc:385] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:50.195889 25879 raft_consensus.cc:740] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
I20260709 12:22:50.196730 25879 consensus_queue.cc:260] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:50.203150 25879 ts_tablet_manager.cc:1434] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:22:50.204002 25879 tablet_bootstrap.cc:492] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
W20260709 12:22:50.205396 25649 leader_election.cc:343] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:50.165833 25902 consensus_queue.cc:1048] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.037s
I20260709 12:22:50.209337 25877 tablet_bootstrap.cc:492] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:50.210561 25877 ts_tablet_manager.cc:1403] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.294s	user 0.012s	sys 0.011s
I20260709 12:22:50.216432 25878 raft_consensus.cc:359] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:50.217463 25878 raft_consensus.cc:385] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:50.217916 25878 raft_consensus.cc:740] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
I20260709 12:22:50.213733 25877 raft_consensus.cc:359] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:50.219236 25877 raft_consensus.cc:385] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:50.219534 25877 raft_consensus.cc:740] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
I20260709 12:22:50.219607 25878 consensus_queue.cc:260] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:50.228649 25878 ts_tablet_manager.cc:1434] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.075s	user 0.009s	sys 0.000s
I20260709 12:22:50.232497 25877 consensus_queue.cc:260] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:50.235374 25878 tablet_bootstrap.cc:492] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:50.231247 25951 consensus_queue.cc:1048] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:50.241596 25877 ts_tablet_manager.cc:1434] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.031s	user 0.003s	sys 0.003s
I20260709 12:22:50.269692 25879 tablet_bootstrap.cc:654] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:50.277880 26014 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:50.297245 26019 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:50.299495 25877 tablet_bootstrap.cc:492] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
I20260709 12:22:50.316895 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:50.317840 25836 raft_consensus.cc:2468] T 8d74d1c9c8a84919a6f57b0b6721de51 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 0.
I20260709 12:22:50.328599 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:22:50.330889 26100 log.cc:927] Time spent T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.205s	user 0.005s	sys 0.006s
I20260709 12:22:50.332736 25650 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:22:50.334868 26021 raft_consensus.cc:2804] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:50.335450 26021 raft_consensus.cc:697] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:22:50.336969 25650 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:22:50.337977 26019 raft_consensus.cc:2804] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:50.339133 26021 consensus_queue.cc:237] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:50.492769 25878 tablet_bootstrap.cc:654] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:50.336983 26106 log.cc:927] Time spent T 5f0353e850934c9db0a248807127ca4c P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:22:50.403445 26092 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:50.415666 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 164707us
W20260709 12:22:50.488109 25866 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.IsCreateTableDone -> {remote=127.23.245.190:45099, user_credentials={real_user=slave}} blocked reactor thread for 77610.7us
I20260709 12:22:50.498193 26092 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:50.496693 26110 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.496845 26098 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.507969 25878 tablet_bootstrap.cc:492] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:50.508749 25878 ts_tablet_manager.cc:1403] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.276s	user 0.037s	sys 0.050s
I20260709 12:22:50.509714 26110 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:50.338434 26019 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:50.516688 25878 raft_consensus.cc:359] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:50.519043 25878 raft_consensus.cc:385] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:50.519313 25878 raft_consensus.cc:740] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
I20260709 12:22:50.510701 26098 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:50.519770 25878 consensus_queue.cc:260] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:50.526609 26098 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:50.524626 26099 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.528167 26039 consensus_queue.cc:1048] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:50.528434 26099 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:50.529292 25760 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:50.530335 26099 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:50.531227 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:22:50.338385 25650 leader_election.cc:343] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:50.533027 25650 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:22:50.535383 25951 raft_consensus.cc:2749] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:22:50.536203 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 197848us
I20260709 12:22:50.540392 26110 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:50.540944 26037 consensus_queue.cc:1048] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:50.547330 25883 consensus_queue.cc:1048] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:50.547427 25902 consensus_queue.cc:1048] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:50.524046 26019 raft_consensus.cc:3060] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:50.552860 26014 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.556457 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:50.563325 25879 tablet_bootstrap.cc:492] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
I20260709 12:22:50.563839 25879 ts_tablet_manager.cc:1403] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.360s	user 0.013s	sys 0.001s
I20260709 12:22:50.567377 25878 ts_tablet_manager.cc:1434] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.058s	user 0.005s	sys 0.000s
W20260709 12:22:50.567751 25800 leader_election.cc:343] T 7954a5254e674b77843c0d32002d2e90 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:50.570811 26014 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:50.573102 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:50.575145 25832 raft_consensus.cc:2393] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 1: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:22:50.578506 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:50.597054 26112 consensus_queue.cc:1048] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 12:22:50.598800 25879 raft_consensus.cc:359] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:50.599650 25879 raft_consensus.cc:385] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:50.605865 25879 raft_consensus.cc:740] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
I20260709 12:22:50.609311 25878 tablet_bootstrap.cc:492] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:50.551162 26092 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:50.636579 25902 consensus_queue.cc:1048] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 12:22:50.692826 25877 tablet_bootstrap.cc:654] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:50.693320 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:50.692322 25879 consensus_queue.cc:260] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:50.698438 25879 ts_tablet_manager.cc:1434] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.134s	user 0.011s	sys 0.005s
I20260709 12:22:50.703811 26019 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:50.705938 25878 tablet_bootstrap.cc:654] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:50.706290 26019 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:22:50.707564 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 70841.8us
I20260709 12:22:50.715153 26041 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:50.707123 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:50.739742 25763 raft_consensus.cc:2468] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 1.
I20260709 12:22:50.741184 25877 tablet_bootstrap.cc:492] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:50.715679 26041 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:50.997224 25877 ts_tablet_manager.cc:1403] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.698s	user 0.040s	sys 0.065s
W20260709 12:22:50.799206 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 61273.3us
W20260709 12:22:51.007364 25649 leader_election.cc:343] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:50.700527 26014 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:51.028128 25879 tablet_bootstrap.cc:492] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
I20260709 12:22:50.742851 26042 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:50.794724 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 142715us
I20260709 12:22:51.012647 26112 consensus_queue.cc:1048] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.032s
I20260709 12:22:51.050527 25649 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:51.061473 25877 raft_consensus.cc:359] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:51.062333 25877 raft_consensus.cc:385] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:51.062636 25877 raft_consensus.cc:740] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
I20260709 12:22:51.063294 25877 consensus_queue.cc:260] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:51.054068 25951 raft_consensus.cc:2804] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:51.068856 25951 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:51.069283 25951 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:51.069850 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:51.070552 25830 raft_consensus.cc:2468] T c38d3f292da44b3dbb2e512cd53e21da P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 1.
I20260709 12:22:51.040267 26042 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:51.074671 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:51.089974 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:22:51.090596 25757 raft_consensus.cc:3060] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:51.100598 25877 ts_tablet_manager.cc:1434] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.101s	user 0.006s	sys 0.000s
W20260709 12:22:51.094628 25801 leader_election.cc:343] T 7954a5254e674b77843c0d32002d2e90 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:51.130069 25877 tablet_bootstrap.cc:492] T a22f8565191e471dbe96772477b84e36 P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
I20260709 12:22:51.129755 25801 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:22:51.100564 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:22:51.137867 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 88623.5us
W20260709 12:22:51.142925 25632 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:51.100835 26126 consensus_queue.cc:1048] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.039s
I20260709 12:22:51.132619 26042 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:51.165850 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:51.170739 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:51.178493 25951 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:51.188611 26132 raft_consensus.cc:2749] T 7954a5254e674b77843c0d32002d2e90 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:22:51.198448 25800 leader_election.cc:343] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:51.200922 25878 tablet_bootstrap.cc:492] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:51.201579 25878 ts_tablet_manager.cc:1403] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.593s	user 0.057s	sys 0.090s
I20260709 12:22:51.205369 25951 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:51.205276 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:22:51.183979 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 95422us
I20260709 12:22:51.197666 25683 raft_consensus.cc:2393] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 1: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:22:51.210263 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:51.211050 25828 raft_consensus.cc:2468] T 8d74d1c9c8a84919a6f57b0b6721de51 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 0.
I20260709 12:22:51.218410 25879 tablet_bootstrap.cc:654] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:51.206188 25833 raft_consensus.cc:2468] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 0.
I20260709 12:22:51.230628 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:22:51.231258 25831 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:51.240796 25878 raft_consensus.cc:359] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:51.307507 25878 raft_consensus.cc:385] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:51.307885 25878 raft_consensus.cc:740] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
I20260709 12:22:51.296416 26092 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:51.332459 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 110408us
W20260709 12:22:51.315078 26118 log.cc:927] Time spent T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260709 12:22:51.311060 26112 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:22:51.315024 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:22:51.352725 25878 consensus_queue.cc:260] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:51.355608 25878 ts_tablet_manager.cc:1434] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.154s	user 0.016s	sys 0.004s
I20260709 12:22:51.362550 25878 tablet_bootstrap.cc:492] T 04fe73edd8db49c08ea7a6adb6e443e6 P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:51.341418 26092 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:51.221444 25726 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:22:51.379204 25754 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:51.354370 26112 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:51.395169 26140 raft_consensus.cc:3060] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:51.413266 26014 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:51.416347 26014 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:51.427063 25878 tablet_bootstrap.cc:654] T 04fe73edd8db49c08ea7a6adb6e443e6 P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:51.431583 25877 tablet_bootstrap.cc:654] T a22f8565191e471dbe96772477b84e36 P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:51.402323 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 194754us
I20260709 12:22:51.434358 25726 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:22:51.435753 26140 raft_consensus.cc:2749] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:51.437132 26092 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:51.437244 26140 raft_consensus.cc:2749] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:51.412923 25831 raft_consensus.cc:2468] T c38d3f292da44b3dbb2e512cd53e21da P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 2.
I20260709 12:22:51.460932 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:51.461789 25680 raft_consensus.cc:2468] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 0.
I20260709 12:22:51.464393 25757 raft_consensus.cc:2468] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 1.
I20260709 12:22:51.466120 25879 tablet_bootstrap.cc:492] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
I20260709 12:22:51.466632 25879 ts_tablet_manager.cc:1403] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.439s	user 0.031s	sys 0.013s
I20260709 12:22:51.467397 26041 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:51.470355 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:22:51.471119 25835 raft_consensus.cc:3060] T 8d74d1c9c8a84919a6f57b0b6721de51 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:51.473062 25754 raft_consensus.cc:2468] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 2.
I20260709 12:22:51.489912 25650 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:22:51.490756 26110 raft_consensus.cc:2804] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:51.491130 26110 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:51.491474 26110 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:51.491726 25650 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:51.495389 26135 raft_consensus.cc:2804] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:51.497408 26135 raft_consensus.cc:697] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 2 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:22:51.498407 26112 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:51.503087 26135 consensus_queue.cc:237] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:51.515417 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:51.515836 25883 consensus_queue.cc:1048] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:51.536489 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:51.537181 25835 raft_consensus.cc:2468] T 8d74d1c9c8a84919a6f57b0b6721de51 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 1.
I20260709 12:22:51.538554 26041 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:51.539129 26041 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:51.539148 25726 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:22:51.541174 26041 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:51.541268 26099 raft_consensus.cc:2764] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
W20260709 12:22:51.542351 25800 leader_election.cc:343] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:51.542798 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:22:51.544130 25800 leader_election.cc:343] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:51.544934 25650 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:51.545832 25883 raft_consensus.cc:2804] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:51.546356 25883 raft_consensus.cc:697] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:22:51.547168 25883 consensus_queue.cc:237] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:51.548247 25760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 68) took 1036 ms. Trace:
I20260709 12:22:51.548732 25760 rpcz_store.cc:276] 0709 12:22:50.524247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:22:50.527344 (+  3097us) service_pool.cc:224] Handling call
0709 12:22:50.527720 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:22:50.749103 (+221383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:22:50.749135 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:22:50.749703 (+   568us) log.cc:844] Serialized 26 byte log entry
0709 12:22:51.066783 (+317080us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:22:51.222597 (+155814us) log.cc:844] Serialized 14 byte log entry
0709 12:22:51.224625 (+  2028us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:22:51.525961 (+301336us) spinlock_profiling.cc:243] Waited 1.4 ms on lock 0x7b540005fad4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:22:51.527339 (+  1378us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:22:51.527716 (+   377us) raft_consensus.cc:1685] finished
0709 12:22:51.528781 (+  1065us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:22:51.548188 (+ 19407us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":83367,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":3531,"raft.queue_time_us":175,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":162,"spinlock_wait_cycles":3218816,"thread_start_us":179145,"threads_started":2,"wal-append.queue_time_us":390619}
I20260709 12:22:51.554612 26014 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:51.555188 25877 tablet_bootstrap.cc:492] T a22f8565191e471dbe96772477b84e36 P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:51.555642 25877 ts_tablet_manager.cc:1403] T a22f8565191e471dbe96772477b84e36 P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.426s	user 0.012s	sys 0.018s
I20260709 12:22:51.567729 25581 catalog_manager.cc:5697] T 01372ae5f161477dab1b4c89fd847b3c P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 1 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } }
I20260709 12:22:51.566526 25584 catalog_manager.cc:5697] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 0 to 1, leader changed from <none> to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 1 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:51.572506 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:51.544679 26110 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:51.576296 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:51.576988 25829 raft_consensus.cc:2468] T 7954a5254e674b77843c0d32002d2e90 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 0.
I20260709 12:22:51.577595 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:51.579056 25879 raft_consensus.cc:359] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:51.579949 25879 raft_consensus.cc:385] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:51.580230 25879 raft_consensus.cc:740] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
I20260709 12:22:51.580771 25879 consensus_queue.cc:260] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:51.588034 25877 raft_consensus.cc:359] T a22f8565191e471dbe96772477b84e36 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:51.591234 25801 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:22:51.596814 26092 raft_consensus.cc:2804] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:51.597234 26092 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:51.597065 25650 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:51.597671 26092 raft_consensus.cc:3060] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:51.594215 26110 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:51.595460 25879 ts_tablet_manager.cc:1434] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.129s	user 0.007s	sys 0.000s
I20260709 12:22:51.596217 25877 raft_consensus.cc:385] T a22f8565191e471dbe96772477b84e36 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:51.608984 25877 raft_consensus.cc:740] T a22f8565191e471dbe96772477b84e36 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
I20260709 12:22:51.609439 25879 tablet_bootstrap.cc:492] T 5204a6a2db104ffa90f8679086d4e6f8 P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
I20260709 12:22:51.609658 25877 consensus_queue.cc:260] T a22f8565191e471dbe96772477b84e36 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:51.602085 25951 raft_consensus.cc:2804] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:51.604331 25649 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:22:51.605561 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:51.613353 25877 ts_tablet_manager.cc:1434] T a22f8565191e471dbe96772477b84e36 P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.000s
I20260709 12:22:51.614200 25877 tablet_bootstrap.cc:492] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
I20260709 12:22:51.611570 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:22:51.616809 25836 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:51.608150 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:22:51.598316 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:22:51.623467 25801 leader_election.cc:343] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:51.622176 26019 consensus_queue.cc:1048] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:22:51.624745 25801 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:22:51.625031 25878 tablet_bootstrap.cc:492] T 04fe73edd8db49c08ea7a6adb6e443e6 P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:51.625470 25878 ts_tablet_manager.cc:1403] T 04fe73edd8db49c08ea7a6adb6e443e6 P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.263s	user 0.025s	sys 0.017s
I20260709 12:22:51.613216 25951 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:51.627096 26120 raft_consensus.cc:2749] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:51.619060 26135 raft_consensus.cc:2749] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:51.628191 25951 raft_consensus.cc:3060] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:51.621615 25755 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:51.618902 25685 raft_consensus.cc:2468] T a22f8565191e471dbe96772477b84e36 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 0.
W20260709 12:22:51.642428 25649 leader_election.cc:343] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:51.646687 25879 tablet_bootstrap.cc:654] T 5204a6a2db104ffa90f8679086d4e6f8 P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:51.656024 25878 raft_consensus.cc:359] T 04fe73edd8db49c08ea7a6adb6e443e6 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:51.657148 25878 raft_consensus.cc:385] T 04fe73edd8db49c08ea7a6adb6e443e6 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:51.657545 25878 raft_consensus.cc:740] T 04fe73edd8db49c08ea7a6adb6e443e6 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
I20260709 12:22:51.660255 25801 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:22:51.662578 26120 raft_consensus.cc:2804] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:51.663357 26120 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:51.664716 26120 raft_consensus.cc:3060] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:51.668392 25878 consensus_queue.cc:260] T 04fe73edd8db49c08ea7a6adb6e443e6 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:51.672169 25836 raft_consensus.cc:2468] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 1.
W20260709 12:22:51.673120 26155 log.cc:927] Time spent T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.103s	user 0.003s	sys 0.000s
I20260709 12:22:51.676756 25650 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:51.677528 26135 raft_consensus.cc:2804] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:51.677767 25878 ts_tablet_manager.cc:1434] T 04fe73edd8db49c08ea7a6adb6e443e6 P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.003s
I20260709 12:22:51.679004 25878 tablet_bootstrap.cc:492] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:51.678741 26135 raft_consensus.cc:697] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:22:51.682631 26092 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:51.667829 25951 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:51.688843 26135 consensus_queue.cc:237] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:51.689636 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
W20260709 12:22:51.696323 25649 leader_election.cc:343] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:51.701130 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:22:51.701892 25837 raft_consensus.cc:3060] T 7954a5254e674b77843c0d32002d2e90 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:51.709784 25837 raft_consensus.cc:2468] T 7954a5254e674b77843c0d32002d2e90 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 1.
I20260709 12:22:51.711230 25650 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:22:51.712317 26110 raft_consensus.cc:2804] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:51.700433 25951 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:51.712849 26110 raft_consensus.cc:697] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:22:51.721757 25877 tablet_bootstrap.cc:654] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:51.723409 26092 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:51.724061 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:22:51.724457 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:22:51.724663 25685 raft_consensus.cc:3060] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:51.724349 26110 consensus_queue.cc:237] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:51.725735 26120 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:22:51.726135 25800 leader_election.cc:343] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:51.728456 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:22:51.729736 25681 raft_consensus.cc:3060] T a22f8565191e471dbe96772477b84e36 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:51.729959 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
W20260709 12:22:51.731827 25800 leader_election.cc:343] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:51.729485 26120 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:51.746260 25755 raft_consensus.cc:2468] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 1.
I20260709 12:22:51.748373 25685 raft_consensus.cc:2468] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 1.
I20260709 12:22:51.752712 25801 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:22:51.753868 26092 raft_consensus.cc:2804] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:51.754571 26092 raft_consensus.cc:697] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:22:51.755472 26092 consensus_queue.cc:237] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:51.759534 25879 tablet_bootstrap.cc:492] T 5204a6a2db104ffa90f8679086d4e6f8 P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
I20260709 12:22:51.760026 25879 ts_tablet_manager.cc:1403] T 5204a6a2db104ffa90f8679086d4e6f8 P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.151s	user 0.013s	sys 0.010s
I20260709 12:22:51.762212 25878 tablet_bootstrap.cc:654] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:51.762498 25879 raft_consensus.cc:359] T 5204a6a2db104ffa90f8679086d4e6f8 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:51.763190 25879 raft_consensus.cc:385] T 5204a6a2db104ffa90f8679086d4e6f8 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:51.763625 25879 raft_consensus.cc:740] T 5204a6a2db104ffa90f8679086d4e6f8 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
I20260709 12:22:51.764443 25879 consensus_queue.cc:260] T 5204a6a2db104ffa90f8679086d4e6f8 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:51.767048 25879 ts_tablet_manager.cc:1434] T 5204a6a2db104ffa90f8679086d4e6f8 P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:22:51.768235 25879 tablet_bootstrap.cc:492] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
I20260709 12:22:51.773478 25681 raft_consensus.cc:2468] T a22f8565191e471dbe96772477b84e36 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 1.
I20260709 12:22:51.775439 25801 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:22:51.777443 26120 raft_consensus.cc:2804] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:51.778338 26120 raft_consensus.cc:697] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:22:51.780198 26120 consensus_queue.cc:237] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:51.793901 25877 tablet_bootstrap.cc:492] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:51.794551 25877 ts_tablet_manager.cc:1403] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.181s	user 0.014s	sys 0.016s
I20260709 12:22:51.795886 25879 tablet_bootstrap.cc:654] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:51.797252 25877 raft_consensus.cc:359] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:51.797801 25877 raft_consensus.cc:385] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:51.798183 25877 raft_consensus.cc:740] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
I20260709 12:22:51.811043 25877 consensus_queue.cc:260] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:51.820995 25877 ts_tablet_manager.cc:1434] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.026s	user 0.015s	sys 0.000s
I20260709 12:22:51.821455 26120 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:51.821946 26120 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:51.830482 26120 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:51.832224 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:22:51.837275 25800 leader_election.cc:343] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:51.839560 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:51.840394 25685 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 0.
I20260709 12:22:51.843514 25801 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:22:51.846568 26041 raft_consensus.cc:2804] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:51.846999 26041 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:51.847404 26041 raft_consensus.cc:3060] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:51.857978 25879 tablet_bootstrap.cc:492] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
I20260709 12:22:51.858664 25879 ts_tablet_manager.cc:1403] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.091s	user 0.022s	sys 0.005s
I20260709 12:22:51.858943 25877 tablet_bootstrap.cc:492] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
I20260709 12:22:51.864976 25879 raft_consensus.cc:359] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:51.866793 25879 raft_consensus.cc:385] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:51.867501 25879 raft_consensus.cc:740] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
I20260709 12:22:51.868600 25879 consensus_queue.cc:260] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:51.873685 25878 tablet_bootstrap.cc:492] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:51.874154 25878 ts_tablet_manager.cc:1403] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.195s	user 0.013s	sys 0.007s
I20260709 12:22:51.871744 25879 ts_tablet_manager.cc:1434] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.012s	user 0.001s	sys 0.004s
I20260709 12:22:51.876398 26137 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:51.880241 26137 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:51.881645 25879 tablet_bootstrap.cc:492] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
I20260709 12:22:51.882638 26137 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:51.884567 25762 raft_consensus.cc:1275] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:22:51.884948 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:51.886224 26135 consensus_queue.cc:1048] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:22:51.886629 25800 leader_election.cc:343] T 04fe73edd8db49c08ea7a6adb6e443e6 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:51.888622 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:22:51.891384 25801 leader_election.cc:343] T 04fe73edd8db49c08ea7a6adb6e443e6 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:51.877213 25877 tablet_bootstrap.cc:654] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:51.876739 25878 raft_consensus.cc:359] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:51.891847 25801 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:22:51.892158 25878 raft_consensus.cc:385] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:51.892555 25878 raft_consensus.cc:740] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
I20260709 12:22:51.893075 26140 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:51.893303 25878 consensus_queue.cc:260] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:51.893563 26140 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:51.895110 25878 ts_tablet_manager.cc:1434] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 12:22:51.896169 26140 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:51.897096 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:51.896201 25878 tablet_bootstrap.cc:492] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:51.897362 25879 tablet_bootstrap.cc:654] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:51.892917 26137 raft_consensus.cc:2749] T 04fe73edd8db49c08ea7a6adb6e443e6 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:51.900256 26041 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:51.902499 26041 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:51.905035 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:51.907099 25836 raft_consensus.cc:2393] T 7954a5254e674b77843c0d32002d2e90 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 1: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:22:51.909003 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:22:51.909770 25726 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
W20260709 12:22:51.910846 25800 leader_election.cc:343] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:51.911039 26139 raft_consensus.cc:3060] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:51.917361 25878 tablet_bootstrap.cc:654] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:51.932431 25584 catalog_manager.cc:5697] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 0 to 1, leader changed from <none> to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 1 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:51.924819 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:22:51.935400 25584 catalog_manager.cc:5697] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 0 to 1, leader changed from <none> to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 1 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:51.937299 25584 catalog_manager.cc:5697] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 0 to 2, leader changed from <none> to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 2 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:51.939440 25584 catalog_manager.cc:5697] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 0 to 1, leader changed from <none> to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 1 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:51.944690 25877 tablet_bootstrap.cc:492] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:51.945170 25877 ts_tablet_manager.cc:1403] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.086s	user 0.010s	sys 0.005s
I20260709 12:22:51.942327 26139 raft_consensus.cc:2749] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:51.947507 25879 tablet_bootstrap.cc:492] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
I20260709 12:22:51.948017 25879 ts_tablet_manager.cc:1403] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.067s	user 0.014s	sys 0.002s
I20260709 12:22:51.940793 25681 raft_consensus.cc:3060] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:51.956092 25836 raft_consensus.cc:1275] T c38d3f292da44b3dbb2e512cd53e21da P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:22:51.956727 25877 raft_consensus.cc:359] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:51.957477 25877 raft_consensus.cc:385] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:51.957777 25877 raft_consensus.cc:740] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
I20260709 12:22:51.957854 25951 consensus_queue.cc:1048] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:51.958498 25877 consensus_queue.cc:260] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:51.959226 25681 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 1.
I20260709 12:22:51.960678 25801 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:22:51.963647 25879 raft_consensus.cc:359] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:51.964455 25879 raft_consensus.cc:385] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:51.964764 25879 raft_consensus.cc:740] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
I20260709 12:22:51.965574 25879 consensus_queue.cc:260] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:51.966074 26137 raft_consensus.cc:2804] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:51.966601 26137 raft_consensus.cc:697] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:22:51.967861 25879 ts_tablet_manager.cc:1434] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.000s
I20260709 12:22:51.967471 26137 consensus_queue.cc:237] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:51.968623 25877 ts_tablet_manager.cc:1434] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 12:22:51.968796 25879 tablet_bootstrap.cc:492] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
I20260709 12:22:51.969689 25877 tablet_bootstrap.cc:492] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
I20260709 12:22:51.974174 26041 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:51.974710 26041 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:51.975504 25879 tablet_bootstrap.cc:654] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:51.976446 26135 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:51.976935 26135 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:51.978008 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:51.978969 26135 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:51.979106 26041 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:22:51.980276 25800 leader_election.cc:343] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:51.982010 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:51.982658 25837 raft_consensus.cc:2468] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 0.
I20260709 12:22:51.983975 25650 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:51.985072 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:22:51.986568 25649 leader_election.cc:343] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:51.987511 26135 raft_consensus.cc:2804] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:51.987680 25879 tablet_bootstrap.cc:492] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
I20260709 12:22:51.988067 26135 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:51.988322 25879 ts_tablet_manager.cc:1403] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.003s
I20260709 12:22:51.988631 26135 raft_consensus.cc:3060] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:51.990283 25878 tablet_bootstrap.cc:492] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:51.990736 25878 ts_tablet_manager.cc:1403] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.095s	user 0.015s	sys 0.023s
I20260709 12:22:51.991354 25879 raft_consensus.cc:359] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:51.992030 25879 raft_consensus.cc:385] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:51.992285 25879 raft_consensus.cc:740] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
I20260709 12:22:51.992902 25879 consensus_queue.cc:260] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:51.993290 25878 raft_consensus.cc:359] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:51.993945 25878 raft_consensus.cc:385] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:51.994215 25878 raft_consensus.cc:740] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
I20260709 12:22:51.994928 25879 ts_tablet_manager.cc:1434] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 12:22:51.995863 25879 tablet_bootstrap.cc:492] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
I20260709 12:22:51.997611 25878 consensus_queue.cc:260] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:51.999837 25878 ts_tablet_manager.cc:1434] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:22:52.000717 25878 tablet_bootstrap.cc:492] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:51.995764 25877 tablet_bootstrap.cc:654] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.003427 26135 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.016743 25879 tablet_bootstrap.cc:654] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.018023 25878 tablet_bootstrap.cc:654] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.021811 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:52.023892 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:22:52.024484 25760 raft_consensus.cc:3060] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:52.024492 25801 leader_election.cc:343] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:52.025869 25801 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:22:52.028381 26135 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:52.027051 25582 catalog_manager.cc:5697] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 1 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:52.030360 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:22:52.030910 25837 raft_consensus.cc:3060] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.029932 25582 catalog_manager.cc:5697] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 1 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:52.038255 25760 raft_consensus.cc:2468] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 1.
I20260709 12:22:52.040773 25649 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:52.042083 26112 raft_consensus.cc:2804] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:52.044523 26112 raft_consensus.cc:697] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:22:52.045305 26112 consensus_queue.cc:237] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.046010 25877 tablet_bootstrap.cc:492] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:52.046479 25877 ts_tablet_manager.cc:1403] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.077s	user 0.017s	sys 0.001s
I20260709 12:22:52.046494 25837 raft_consensus.cc:2468] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 1.
I20260709 12:22:52.034080 26137 raft_consensus.cc:2749] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:52.052518 25877 raft_consensus.cc:359] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.053642 25877 raft_consensus.cc:385] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.054177 25877 raft_consensus.cc:740] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.056574 25877 consensus_queue.cc:260] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.058995 25877 ts_tablet_manager.cc:1434] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:22:52.060004 25877 tablet_bootstrap.cc:492] T de96c5816bc14e3cb8f32ff10dc52a61 P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
I20260709 12:22:52.060639 25879 tablet_bootstrap.cc:492] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
I20260709 12:22:52.061040 25879 ts_tablet_manager.cc:1403] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.065s	user 0.010s	sys 0.003s
I20260709 12:22:52.074431 25877 tablet_bootstrap.cc:654] T de96c5816bc14e3cb8f32ff10dc52a61 P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.074129 26019 consensus_queue.cc:1048] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:52.088850 25879 raft_consensus.cc:359] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.089563 25879 raft_consensus.cc:385] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.089828 25879 raft_consensus.cc:740] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.090468 25879 consensus_queue.cc:260] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.091967 25879 ts_tablet_manager.cc:1434] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 12:22:52.092814 25879 tablet_bootstrap.cc:492] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
I20260709 12:22:52.098318 25951 consensus_queue.cc:1048] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:52.099658 25951 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.100143 25951 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.100623 25879 tablet_bootstrap.cc:654] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.108325 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:52.108989 26137 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:52.109337 25649 leader_election.cc:343] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:52.109515 26137 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.110939 25951 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:52.112810 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:52.116405 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:22:52.117436 25801 leader_election.cc:343] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:52.118010 25800 leader_election.cc:343] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:52.118500 25800 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:22:52.119506 26041 raft_consensus.cc:2749] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:52.111714 26137 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:52.132014 25951 consensus_queue.cc:1048] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:52.111598 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:52.140745 25581 catalog_manager.cc:5697] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 0 to 1, leader changed from <none> to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 1 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:52.138216 25584 catalog_manager.cc:5697] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 1 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:52.142558 25878 tablet_bootstrap.cc:492] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:52.147976 25759 raft_consensus.cc:3060] T 5204a6a2db104ffa90f8679086d4e6f8 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.148365 26112 consensus_queue.cc:1048] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 12:22:52.161345 25878 ts_tablet_manager.cc:1403] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.161s	user 0.016s	sys 0.006s
I20260709 12:22:52.142779 25837 raft_consensus.cc:2468] T 04fe73edd8db49c08ea7a6adb6e443e6 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 0.
I20260709 12:22:52.168936 26139 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.169478 26139 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.170010 25878 raft_consensus.cc:359] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.170670 25878 raft_consensus.cc:385] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.170948 25878 raft_consensus.cc:740] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.172271 25650 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:22:52.173065 26112 raft_consensus.cc:2804] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:52.173460 26112 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:52.173799 26112 raft_consensus.cc:3060] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.175021 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:52.175544 26139 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:52.176671 25878 consensus_queue.cc:260] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.178268 25878 ts_tablet_manager.cc:1434] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 12:22:52.178187 26135 consensus_queue.cc:1048] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:52.179270 25878 tablet_bootstrap.cc:492] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:52.180488 26041 consensus_queue.cc:1048] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:52.189333 26112 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.191332 26137 consensus_queue.cc:1048] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:52.159909 25877 tablet_bootstrap.cc:492] T de96c5816bc14e3cb8f32ff10dc52a61 P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:52.193198 25877 ts_tablet_manager.cc:1403] T de96c5816bc14e3cb8f32ff10dc52a61 P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.133s	user 0.016s	sys 0.007s
I20260709 12:22:52.195007 26137 consensus_queue.cc:1048] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:52.199688 25879 tablet_bootstrap.cc:492] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
I20260709 12:22:52.199527 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:52.209595 25879 ts_tablet_manager.cc:1403] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.117s	user 0.010s	sys 0.010s
I20260709 12:22:52.204252 25759 raft_consensus.cc:3060] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.208017 26112 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:52.209664 25677 raft_consensus.cc:2393] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 1: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:22:52.203284 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:22:52.215044 25836 raft_consensus.cc:3060] T 04fe73edd8db49c08ea7a6adb6e443e6 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.201666 25877 raft_consensus.cc:359] T de96c5816bc14e3cb8f32ff10dc52a61 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.222213 25877 raft_consensus.cc:385] T de96c5816bc14e3cb8f32ff10dc52a61 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.224265 25877 raft_consensus.cc:740] T de96c5816bc14e3cb8f32ff10dc52a61 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.227294 25726 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:22:52.232846 26139 raft_consensus.cc:3060] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.239142 25836 raft_consensus.cc:2468] T 04fe73edd8db49c08ea7a6adb6e443e6 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 1.
I20260709 12:22:52.245875 25877 consensus_queue.cc:260] T de96c5816bc14e3cb8f32ff10dc52a61 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.257275 25879 raft_consensus.cc:359] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.229894 26019 consensus_queue.cc:1048] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:52.230491 25878 tablet_bootstrap.cc:654] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.228416 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:22:52.272850 25877 ts_tablet_manager.cc:1434] T de96c5816bc14e3cb8f32ff10dc52a61 P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.078s	user 0.005s	sys 0.002s
I20260709 12:22:52.269333 25879 raft_consensus.cc:385] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.278649 25879 raft_consensus.cc:740] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.279517 25879 consensus_queue.cc:260] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.281355 25762 raft_consensus.cc:3060] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.284842 25877 tablet_bootstrap.cc:492] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
I20260709 12:22:52.290226 25878 tablet_bootstrap.cc:492] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:52.290727 25878 ts_tablet_manager.cc:1403] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.112s	user 0.011s	sys 0.003s
I20260709 12:22:52.292455 26140 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.293053 26140 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.295218 26041 consensus_queue.cc:1048] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:52.295981 25879 ts_tablet_manager.cc:1434] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.085s	user 0.006s	sys 0.001s
I20260709 12:22:52.276304 26139 raft_consensus.cc:2749] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:52.296993 25878 raft_consensus.cc:359] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.297706 25878 raft_consensus.cc:385] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.297999 25878 raft_consensus.cc:740] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.298692 25878 consensus_queue.cc:260] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.301048 25878 ts_tablet_manager.cc:1434] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 12:22:52.296983 25879 tablet_bootstrap.cc:492] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
I20260709 12:22:52.301896 25878 tablet_bootstrap.cc:492] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:52.291553 25762 raft_consensus.cc:2468] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 1.
I20260709 12:22:52.308118 25877 tablet_bootstrap.cc:654] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.309409 25878 tablet_bootstrap.cc:654] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.315536 26140 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:52.317242 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:52.325443 25879 tablet_bootstrap.cc:654] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.330457 26120 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.331038 26120 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.338501 26120 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:52.340257 25878 tablet_bootstrap.cc:492] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:52.342450 25878 ts_tablet_manager.cc:1403] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.041s	user 0.018s	sys 0.004s
I20260709 12:22:52.345738 25878 raft_consensus.cc:359] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.346670 25878 raft_consensus.cc:385] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.347061 25878 raft_consensus.cc:740] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.346175 25650 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:52.347816 25878 consensus_queue.cc:260] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.349712 26135 raft_consensus.cc:2804] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:52.350191 26135 raft_consensus.cc:697] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:22:52.350332 25878 ts_tablet_manager.cc:1434] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:22:52.351358 25878 tablet_bootstrap.cc:492] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:52.351055 26135 consensus_queue.cc:237] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.357728 25878 tablet_bootstrap.cc:654] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:52.408798 25632 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:52.425029 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:52.428304 25726 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:22:52.433820 26099 raft_consensus.cc:2749] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:52.448311 26112 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.448835 26112 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.451015 26112 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:52.452913 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:22:52.454042 25649 leader_election.cc:343] T de96c5816bc14e3cb8f32ff10dc52a61 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:52.454813 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:52.455590 25835 raft_consensus.cc:2468] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 0.
I20260709 12:22:52.457479 25650 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:22:52.458312 26110 raft_consensus.cc:2804] T de96c5816bc14e3cb8f32ff10dc52a61 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:52.459017 26110 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:52.459460 26110 raft_consensus.cc:3060] T de96c5816bc14e3cb8f32ff10dc52a61 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.468176 26110 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.470316 26110 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:52.471071 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:22:52.471573 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:22:52.472162 25837 raft_consensus.cc:3060] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:52.472255 25649 leader_election.cc:343] T de96c5816bc14e3cb8f32ff10dc52a61 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:52.479897 25877 tablet_bootstrap.cc:492] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:52.481912 25877 ts_tablet_manager.cc:1403] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.204s	user 0.014s	sys 0.011s
I20260709 12:22:52.484550 25877 raft_consensus.cc:359] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.487586 26110 consensus_queue.cc:1048] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:52.487629 25877 raft_consensus.cc:385] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.489548 25877 raft_consensus.cc:740] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.490164 25877 consensus_queue.cc:260] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.492828 25877 ts_tablet_manager.cc:1434] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:22:52.493986 25877 tablet_bootstrap.cc:492] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
I20260709 12:22:52.501114 25878 tablet_bootstrap.cc:492] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:52.501637 25878 ts_tablet_manager.cc:1403] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.150s	user 0.010s	sys 0.008s
I20260709 12:22:52.488642 25837 raft_consensus.cc:2468] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 1.
I20260709 12:22:52.504093 25877 tablet_bootstrap.cc:654] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.505336 25650 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:22:52.513406 26112 raft_consensus.cc:2804] T de96c5816bc14e3cb8f32ff10dc52a61 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:52.514115 26112 raft_consensus.cc:697] T de96c5816bc14e3cb8f32ff10dc52a61 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:22:52.516566 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:52.517518 26019 consensus_queue.cc:1048] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:52.519556 26137 consensus_queue.cc:1048] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:22:52.520776 25800 leader_election.cc:343] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:52.521831 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:22:52.523185 25801 leader_election.cc:343] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:52.523633 25801 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:22:52.515098 26112 consensus_queue.cc:237] T de96c5816bc14e3cb8f32ff10dc52a61 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.528118 26137 raft_consensus.cc:2749] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:52.532420 25878 raft_consensus.cc:359] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.533241 25878 raft_consensus.cc:385] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.533545 25878 raft_consensus.cc:740] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.534242 25878 consensus_queue.cc:260] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.535712 25878 ts_tablet_manager.cc:1434] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.000s
I20260709 12:22:52.536626 25878 tablet_bootstrap.cc:492] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:52.544234 25879 tablet_bootstrap.cc:492] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
I20260709 12:22:52.544713 25879 ts_tablet_manager.cc:1403] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.248s	user 0.013s	sys 0.000s
I20260709 12:22:52.546104 25878 tablet_bootstrap.cc:654] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.547602 25879 raft_consensus.cc:359] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.550163 25879 raft_consensus.cc:385] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.550510 25879 raft_consensus.cc:740] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.593327 25879 consensus_queue.cc:260] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.605036 26135 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.619167 25879 ts_tablet_manager.cc:1434] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.074s	user 0.008s	sys 0.000s
I20260709 12:22:52.620018 25879 tablet_bootstrap.cc:492] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
I20260709 12:22:52.624644 25877 tablet_bootstrap.cc:492] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:52.625203 25877 ts_tablet_manager.cc:1403] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.131s	user 0.037s	sys 0.040s
I20260709 12:22:52.630699 25877 raft_consensus.cc:359] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.631381 25877 raft_consensus.cc:385] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.631629 25877 raft_consensus.cc:740] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.636337 26041 consensus_queue.cc:1048] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:52.632265 25877 consensus_queue.cc:260] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.640519 25877 ts_tablet_manager.cc:1434] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:22:52.641683 25877 tablet_bootstrap.cc:492] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
I20260709 12:22:52.618230 26135 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.669454 26135 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:52.667007 26041 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.697758 26209 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.698292 26209 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.700311 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:52.688428 26041 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:22:52.701728 25649 leader_election.cc:343] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:52.703212 26041 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:52.712188 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:52.714197 25879 tablet_bootstrap.cc:654] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.715198 25878 tablet_bootstrap.cc:492] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:52.717289 26209 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:52.718181 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:52.728675 25878 ts_tablet_manager.cc:1403] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.192s	user 0.016s	sys 0.038s
I20260709 12:22:52.719517 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:52.729215 25829 raft_consensus.cc:2468] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 0.
I20260709 12:22:52.730623 25650 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:22:52.731334 25878 raft_consensus.cc:359] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.731781 26135 raft_consensus.cc:2804] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:52.732054 25878 raft_consensus.cc:385] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.732271 26135 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:52.732745 26135 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.732398 25878 raft_consensus.cc:740] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.742569 25878 consensus_queue.cc:260] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.720636 25584 catalog_manager.cc:5697] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 0 to 1, leader changed from <none> to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 1 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:52.749660 25879 tablet_bootstrap.cc:492] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
I20260709 12:22:52.724962 25877 tablet_bootstrap.cc:654] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.749215 25584 catalog_manager.cc:5697] T de96c5816bc14e3cb8f32ff10dc52a61 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 0 to 1, leader changed from <none> to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 1 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:52.750204 25879 ts_tablet_manager.cc:1403] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.130s	user 0.004s	sys 0.006s
W20260709 12:22:52.725827 25801 leader_election.cc:343] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:52.752655 25879 raft_consensus.cc:359] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.753296 25879 raft_consensus.cc:385] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.753556 25879 raft_consensus.cc:740] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.754289 25879 consensus_queue.cc:260] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.754832 25878 ts_tablet_manager.cc:1434] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.026s	user 0.001s	sys 0.005s
W20260709 12:22:52.758461 25801 leader_election.cc:343] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:52.763861 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:52.765008 25879 ts_tablet_manager.cc:1434] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 12:22:52.769987 25879 tablet_bootstrap.cc:492] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
I20260709 12:22:52.772320 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:52.777343 25878 tablet_bootstrap.cc:492] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:52.777448 26135 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.779649 26135 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:52.781140 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:22:52.781854 25829 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.785121 25879 tablet_bootstrap.cc:654] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.787190 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
W20260709 12:22:52.788615 25649 leader_election.cc:343] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:52.789382 25877 tablet_bootstrap.cc:492] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:52.790009 25829 raft_consensus.cc:2468] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 1.
W20260709 12:22:52.791097 25800 leader_election.cc:343] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:52.791553 25800 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:22:52.791097 25877 ts_tablet_manager.cc:1403] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.150s	user 0.012s	sys 0.000s
I20260709 12:22:52.793390 26211 raft_consensus.cc:2749] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:52.795034 25878 tablet_bootstrap.cc:654] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:52.796301 25800 leader_election.cc:343] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:52.796702 25800 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:22:52.797544 26135 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.798019 26135 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.798491 26215 raft_consensus.cc:2749] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:52.791311 25650 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:22:52.801569 26135 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:52.802058 26135 raft_consensus.cc:2804] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:52.802523 26135 raft_consensus.cc:697] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:22:52.803962 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:52.804507 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:52.804579 25831 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 0.
I20260709 12:22:52.806600 25877 raft_consensus.cc:359] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.805199 25763 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 0.
I20260709 12:22:52.808389 25649 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:52.803423 26135 consensus_queue.cc:237] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.807384 25877 raft_consensus.cc:385] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.809125 26019 raft_consensus.cc:2804] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:52.809224 25877 raft_consensus.cc:740] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.809736 26019 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:52.810202 26019 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.810245 25877 consensus_queue.cc:260] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.817962 25877 ts_tablet_manager.cc:1434] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.002s
I20260709 12:22:52.819181 25877 tablet_bootstrap.cc:492] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
I20260709 12:22:52.826098 25879 tablet_bootstrap.cc:492] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
I20260709 12:22:52.826589 25879 ts_tablet_manager.cc:1403] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.057s	user 0.017s	sys 0.000s
I20260709 12:22:52.831601 25877 tablet_bootstrap.cc:654] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.829275 25879 raft_consensus.cc:359] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.832568 25879 raft_consensus.cc:385] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.835219 25879 raft_consensus.cc:740] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.835881 25879 consensus_queue.cc:260] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.837975 25879 ts_tablet_manager.cc:1434] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:22:52.819032 26019 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.838871 25879 tablet_bootstrap.cc:492] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
I20260709 12:22:52.841617 25883 consensus_queue.cc:1048] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:52.845475 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:22:52.846092 25763 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.848196 25877 tablet_bootstrap.cc:492] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:52.848659 25877 ts_tablet_manager.cc:1403] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.030s	user 0.007s	sys 0.006s
I20260709 12:22:52.851995 25879 tablet_bootstrap.cc:654] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.860838 25877 raft_consensus.cc:359] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.861590 25877 raft_consensus.cc:385] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.861889 25877 raft_consensus.cc:740] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.862515 25877 consensus_queue.cc:260] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.864091 25877 ts_tablet_manager.cc:1434] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.002s
I20260709 12:22:52.865713 25877 tablet_bootstrap.cc:492] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
I20260709 12:22:52.868201 25763 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 1.
I20260709 12:22:52.876539 26202 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:52.883178 26019 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:52.887671 26202 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.889222 25879 tablet_bootstrap.cc:492] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
I20260709 12:22:52.889691 25879 ts_tablet_manager.cc:1403] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.051s	user 0.012s	sys 0.004s
I20260709 12:22:52.886662 25877 tablet_bootstrap.cc:654] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:52.886883 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:22:52.892022 25878 tablet_bootstrap.cc:492] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:52.892664 25878 ts_tablet_manager.cc:1403] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.137s	user 0.017s	sys 0.018s
I20260709 12:22:52.899643 25649 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:52.902387 26202 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:52.903954 26019 raft_consensus.cc:2804] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:52.904485 26019 raft_consensus.cc:697] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:22:52.904544 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:52.905483 25837 raft_consensus.cc:2393] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 1: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:22:52.905421 26019 consensus_queue.cc:237] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.906075 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:52.891881 25829 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.909564 25726 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:22:52.909806 25879 raft_consensus.cc:359] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.910823 26202 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.911685 25879 raft_consensus.cc:385] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.912189 25879 raft_consensus.cc:740] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.922361 26110 consensus_queue.cc:1048] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:52.927142 25759 raft_consensus.cc:3060] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:52.928495 25829 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 1.
I20260709 12:22:52.936259 25879 consensus_queue.cc:260] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.940261 25879 ts_tablet_manager.cc:1434] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.050s	user 0.009s	sys 0.000s
I20260709 12:22:52.941493 25879 tablet_bootstrap.cc:492] T 43b78aa0054b4da398a8fc04d12454a7 P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
I20260709 12:22:52.948905 25581 catalog_manager.cc:5697] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 0 to 1, leader changed from <none> to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 1 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:52.956965 25877 tablet_bootstrap.cc:492] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:52.957683 25877 ts_tablet_manager.cc:1403] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.092s	user 0.016s	sys 0.015s
I20260709 12:22:52.959043 25878 raft_consensus.cc:359] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.959815 25878 raft_consensus.cc:385] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.960150 25878 raft_consensus.cc:740] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.961048 25883 consensus_queue.cc:1048] T de96c5816bc14e3cb8f32ff10dc52a61 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:52.962014 25878 consensus_queue.cc:260] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.964169 25878 ts_tablet_manager.cc:1434] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.071s	user 0.007s	sys 0.001s
I20260709 12:22:52.965018 25878 tablet_bootstrap.cc:492] T 05232536e53b419682a5f24515843652 P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:52.977133 26202 raft_consensus.cc:2749] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:52.976918 25877 raft_consensus.cc:359] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.977613 25877 raft_consensus.cc:385] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:52.977896 25877 raft_consensus.cc:740] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
I20260709 12:22:52.978860 25877 consensus_queue.cc:260] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:52.983978 26135 consensus_queue.cc:1048] T de96c5816bc14e3cb8f32ff10dc52a61 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:52.988476 25877 ts_tablet_manager.cc:1434] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.002s
I20260709 12:22:52.989800 25877 tablet_bootstrap.cc:492] T 870002623db3456699b2b970d066f356 P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
I20260709 12:22:52.991655 25878 tablet_bootstrap.cc:654] T 05232536e53b419682a5f24515843652 P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:53.000975 25877 tablet_bootstrap.cc:654] T 870002623db3456699b2b970d066f356 P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:53.001827 25879 tablet_bootstrap.cc:654] T 43b78aa0054b4da398a8fc04d12454a7 P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:53.002633 25581 catalog_manager.cc:5697] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 0 to 1, leader changed from <none> to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 1 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:53.029727 25877 tablet_bootstrap.cc:492] T 870002623db3456699b2b970d066f356 P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:53.030055 26135 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.030282 25877 ts_tablet_manager.cc:1403] T 870002623db3456699b2b970d066f356 P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.009s
I20260709 12:22:53.030546 26135 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.033181 26135 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:53.033105 25877 raft_consensus.cc:359] T 870002623db3456699b2b970d066f356 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.033951 25877 raft_consensus.cc:385] T 870002623db3456699b2b970d066f356 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:53.034294 25877 raft_consensus.cc:740] T 870002623db3456699b2b970d066f356 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
I20260709 12:22:53.034519 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:53.035401 25837 raft_consensus.cc:2468] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 0.
I20260709 12:22:53.035236 25877 consensus_queue.cc:260] T 870002623db3456699b2b970d066f356 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.037395 25650 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:53.038131 26135 raft_consensus.cc:2804] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:53.038511 26135 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:53.039004 26215 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.039351 26019 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.038820 26135 raft_consensus.cc:3060] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:53.040277 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:53.039842 26019 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:22:53.041587 25649 leader_election.cc:343] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:53.042553 26218 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.043035 26218 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.043530 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:53.037704 25877 ts_tablet_manager.cc:1434] T 870002623db3456699b2b970d066f356 P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:22:53.045765 25877 tablet_bootstrap.cc:492] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
I20260709 12:22:53.044370 26019 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:22:53.048637 25649 leader_election.cc:343] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:53.052922 26218 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:53.053378 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:53.054008 25837 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 0.
I20260709 12:22:53.057188 25650 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:22:53.060245 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:53.061298 26110 raft_consensus.cc:2804] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:53.061683 26110 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:53.062002 26110 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:53.065074 25800 leader_election.cc:343] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:53.039848 26215 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.079885 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:53.082149 26215 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:53.086582 25877 tablet_bootstrap.cc:654] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:53.087832 26135 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.086582 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:53.092152 25879 tablet_bootstrap.cc:492] T 43b78aa0054b4da398a8fc04d12454a7 P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
W20260709 12:22:53.093798 25800 leader_election.cc:343] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:53.094213 25879 ts_tablet_manager.cc:1403] T 43b78aa0054b4da398a8fc04d12454a7 P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.153s	user 0.013s	sys 0.003s
I20260709 12:22:53.097034 26135 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:53.097337 25879 raft_consensus.cc:359] T 43b78aa0054b4da398a8fc04d12454a7 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.098582 25879 raft_consensus.cc:385] T 43b78aa0054b4da398a8fc04d12454a7 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:53.098851 25879 raft_consensus.cc:740] T 43b78aa0054b4da398a8fc04d12454a7 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
I20260709 12:22:53.100230 25879 consensus_queue.cc:260] T 43b78aa0054b4da398a8fc04d12454a7 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.097704 26110 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.101012 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:22:53.102530 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:53.102917 25681 raft_consensus.cc:2393] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 1: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:22:53.102957 25837 raft_consensus.cc:3060] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:53.103889 26110 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:53.105593 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:22:53.106170 25878 tablet_bootstrap.cc:492] T 05232536e53b419682a5f24515843652 P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:53.106187 25831 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:53.106459 26202 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.106735 25878 ts_tablet_manager.cc:1403] T 05232536e53b419682a5f24515843652 P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.142s	user 0.031s	sys 0.033s
I20260709 12:22:53.106956 26202 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.109200 26202 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:53.110632 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:53.111308 25835 raft_consensus.cc:2468] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 0.
I20260709 12:22:53.112362 25878 raft_consensus.cc:359] T 05232536e53b419682a5f24515843652 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.112382 25726 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:22:53.113034 25878 raft_consensus.cc:385] T 05232536e53b419682a5f24515843652 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:53.113336 25878 raft_consensus.cc:740] T 05232536e53b419682a5f24515843652 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
I20260709 12:22:53.113982 25878 consensus_queue.cc:260] T 05232536e53b419682a5f24515843652 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.114523 26202 raft_consensus.cc:2804] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:53.115047 26202 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:53.115384 26202 raft_consensus.cc:3060] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:53.115814 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:22:53.116147 25878 ts_tablet_manager.cc:1434] T 05232536e53b419682a5f24515843652 P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.004s
I20260709 12:22:53.116398 25759 raft_consensus.cc:3060] T 43b78aa0054b4da398a8fc04d12454a7 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:53.120385 25801 leader_election.cc:343] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:53.120959 25878 tablet_bootstrap.cc:492] T b12e2b074f1b4518bcfc6728abeca136 P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:53.120841 25801 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:22:53.122474 26218 raft_consensus.cc:2749] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:53.122238 26202 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.126009 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:53.126642 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:22:53.126858 26202 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:53.127244 25835 raft_consensus.cc:3060] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:53.129056 25759 raft_consensus.cc:2468] T 43b78aa0054b4da398a8fc04d12454a7 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 1.
I20260709 12:22:53.130067 25878 tablet_bootstrap.cc:654] T b12e2b074f1b4518bcfc6728abeca136 P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:53.126691 25681 raft_consensus.cc:2468] T 870002623db3456699b2b970d066f356 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 0.
I20260709 12:22:53.130441 25801 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:22:53.134302 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:22:53.136111 25878 tablet_bootstrap.cc:492] T b12e2b074f1b4518bcfc6728abeca136 P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:53.136863 25878 ts_tablet_manager.cc:1403] T b12e2b074f1b4518bcfc6728abeca136 P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.004s
I20260709 12:22:53.139693 25878 raft_consensus.cc:359] T b12e2b074f1b4518bcfc6728abeca136 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.140445 25878 raft_consensus.cc:385] T b12e2b074f1b4518bcfc6728abeca136 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:53.140727 25878 raft_consensus.cc:740] T b12e2b074f1b4518bcfc6728abeca136 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
I20260709 12:22:53.141875 25878 consensus_queue.cc:260] T b12e2b074f1b4518bcfc6728abeca136 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.142657 25835 raft_consensus.cc:2468] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 1.
I20260709 12:22:53.142218 25831 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 1.
I20260709 12:22:53.143836 26215 raft_consensus.cc:2749] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:53.144012 25726 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:22:53.145450 25878 ts_tablet_manager.cc:1434] T b12e2b074f1b4518bcfc6728abeca136 P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:22:53.145967 26202 raft_consensus.cc:2804] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:53.148110 26202 raft_consensus.cc:697] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:22:53.149343 26202 consensus_queue.cc:237] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.152194 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:22:53.151430 25650 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:53.152817 25680 raft_consensus.cc:3060] T 870002623db3456699b2b970d066f356 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:53.153282 26019 raft_consensus.cc:2804] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:53.154206 26019 raft_consensus.cc:697] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:22:53.147346 25878 tablet_bootstrap.cc:492] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:53.162276 25878 tablet_bootstrap.cc:654] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:53.162760 26019 consensus_queue.cc:237] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.175052 25680 raft_consensus.cc:2468] T 870002623db3456699b2b970d066f356 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 1.
I20260709 12:22:53.175536 25649 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:53.191841 26019 raft_consensus.cc:2804] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:53.192811 26019 raft_consensus.cc:697] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:22:53.193634 26019 consensus_queue.cc:237] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:22:53.196265 25649 leader_election.cc:343] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:53.198143 25877 tablet_bootstrap.cc:492] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:53.198652 25877 ts_tablet_manager.cc:1403] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.153s	user 0.005s	sys 0.007s
I20260709 12:22:53.109634 25879 ts_tablet_manager.cc:1434] T 43b78aa0054b4da398a8fc04d12454a7 P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 12:22:53.200908 25879 tablet_bootstrap.cc:492] T 63f47864b8d248a792567d96c5e453b8 P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
I20260709 12:22:53.207039 25877 raft_consensus.cc:359] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.207985 25877 raft_consensus.cc:385] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:53.208307 25877 raft_consensus.cc:740] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
I20260709 12:22:53.210170 26135 consensus_queue.cc:1048] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:53.190337 25837 raft_consensus.cc:2468] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 1.
I20260709 12:22:53.235105 25877 consensus_queue.cc:260] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.237488 25877 ts_tablet_manager.cc:1434] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.000s
I20260709 12:22:53.246431 26110 consensus_queue.cc:1048] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:53.223083 25581 catalog_manager.cc:5697] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 1 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:53.252403 25879 tablet_bootstrap.cc:654] T 63f47864b8d248a792567d96c5e453b8 P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:53.255775 25877 tablet_bootstrap.cc:492] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
I20260709 12:22:53.264351 25883 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.264896 25883 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.266832 25883 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:53.268724 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:53.269629 25878 tablet_bootstrap.cc:492] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:53.269451 25829 raft_consensus.cc:2468] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 0.
I20260709 12:22:53.270206 25878 ts_tablet_manager.cc:1403] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.123s	user 0.041s	sys 0.052s
I20260709 12:22:53.271522 25650 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:53.272378 25883 raft_consensus.cc:2804] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:53.272745 25883 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:53.273109 25883 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:53.273460 25877 tablet_bootstrap.cc:654] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:53.272811 25583 catalog_manager.cc:5697] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 0 to 1, leader changed from <none> to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 1 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:53.274829 25583 catalog_manager.cc:5697] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 0 to 1, leader changed from <none> to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 1 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:53.269423 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:53.275557 25878 raft_consensus.cc:359] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.280076 25878 raft_consensus.cc:385] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:53.281983 25878 raft_consensus.cc:740] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
I20260709 12:22:53.282266 25883 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.283152 25878 consensus_queue.cc:260] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:22:53.284090 25649 leader_election.cc:343] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:53.286412 25878 ts_tablet_manager.cc:1434] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 12:22:53.287513 25878 tablet_bootstrap.cc:492] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:53.288638 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:22:53.289278 25829 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:53.291328 26218 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.291847 26218 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.294278 25877 tablet_bootstrap.cc:492] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:53.295652 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:53.298245 25878 tablet_bootstrap.cc:654] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:53.299543 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
W20260709 12:22:53.300396 25800 leader_election.cc:343] T 05232536e53b419682a5f24515843652 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:53.301570 25883 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:53.297914 25829 raft_consensus.cc:2468] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 1.
I20260709 12:22:53.299582 25877 ts_tablet_manager.cc:1403] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.044s	user 0.015s	sys 0.011s
I20260709 12:22:53.305130 25879 tablet_bootstrap.cc:492] T 63f47864b8d248a792567d96c5e453b8 P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
I20260709 12:22:53.305260 25650 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:53.305612 25879 ts_tablet_manager.cc:1403] T 63f47864b8d248a792567d96c5e453b8 P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.105s	user 0.010s	sys 0.004s
I20260709 12:22:53.306082 25883 raft_consensus.cc:2804] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:53.306612 25877 raft_consensus.cc:359] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.307006 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:53.307315 25877 raft_consensus.cc:385] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:53.307590 25877 raft_consensus.cc:740] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
I20260709 12:22:53.306661 25883 raft_consensus.cc:697] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:22:53.308358 25877 consensus_queue.cc:260] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.296185 26218 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:53.308763 25879 raft_consensus.cc:359] T 63f47864b8d248a792567d96c5e453b8 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.309434 25879 raft_consensus.cc:385] T 63f47864b8d248a792567d96c5e453b8 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:53.309751 25879 raft_consensus.cc:740] T 63f47864b8d248a792567d96c5e453b8 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
I20260709 12:22:53.310400 25879 consensus_queue.cc:260] T 63f47864b8d248a792567d96c5e453b8 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.310854 25877 ts_tablet_manager.cc:1434] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
W20260709 12:22:53.311554 25801 leader_election.cc:343] T 05232536e53b419682a5f24515843652 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:53.312191 25877 tablet_bootstrap.cc:492] T 2d9ca842256c405c98d29454943e5d01 P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
I20260709 12:22:53.312057 25801 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:22:53.313344 26215 raft_consensus.cc:2749] T 05232536e53b419682a5f24515843652 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:53.309165 25883 consensus_queue.cc:237] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.315340 25879 ts_tablet_manager.cc:1434] T 63f47864b8d248a792567d96c5e453b8 P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
W20260709 12:22:53.315692 25649 leader_election.cc:343] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:53.316303 25879 tablet_bootstrap.cc:492] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
I20260709 12:22:53.322572 25877 tablet_bootstrap.cc:654] T 2d9ca842256c405c98d29454943e5d01 P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:53.323170 25879 tablet_bootstrap.cc:654] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:53.340287 25879 tablet_bootstrap.cc:492] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
I20260709 12:22:53.340776 25879 ts_tablet_manager.cc:1403] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.025s	user 0.004s	sys 0.012s
I20260709 12:22:53.343297 25879 raft_consensus.cc:359] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.344003 25879 raft_consensus.cc:385] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:53.344312 25879 raft_consensus.cc:740] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
I20260709 12:22:53.344949 25879 consensus_queue.cc:260] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.347213 25879 ts_tablet_manager.cc:1434] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:22:53.348877 25879 tablet_bootstrap.cc:492] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
I20260709 12:22:53.355381 25878 tablet_bootstrap.cc:492] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:53.355957 25878 ts_tablet_manager.cc:1403] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.069s	user 0.020s	sys 0.012s
I20260709 12:22:53.356411 26019 consensus_queue.cc:1048] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:53.358685 25878 raft_consensus.cc:359] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.359443 25878 raft_consensus.cc:385] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:53.359753 25878 raft_consensus.cc:740] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
I20260709 12:22:53.360576 25878 consensus_queue.cc:260] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.361449 25879 tablet_bootstrap.cc:654] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:53.372476 25708 debug-util.cc:398] Leaking SignalData structure 0x7b080005f0c0 after lost signal to thread 24537
I20260709 12:22:53.373374 25879 tablet_bootstrap.cc:492] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
W20260709 12:22:53.373481 25708 debug-util.cc:398] Leaking SignalData structure 0x7b08001c0b80 after lost signal to thread 25618
I20260709 12:22:53.373854 25879 ts_tablet_manager.cc:1403] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.025s	user 0.003s	sys 0.006s
I20260709 12:22:53.373154 25582 catalog_manager.cc:5697] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 0 to 1, leader changed from <none> to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 1 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
W20260709 12:22:53.374588 25708 debug-util.cc:398] Leaking SignalData structure 0x7b0800099b80 after lost signal to thread 25711
W20260709 12:22:53.375586 25708 debug-util.cc:398] Leaking SignalData structure 0x7b080020d340 after lost signal to thread 25787
W20260709 12:22:53.376546 25708 debug-util.cc:398] Leaking SignalData structure 0x7b08001ee9e0 after lost signal to thread 25861
I20260709 12:22:53.377107 25879 raft_consensus.cc:359] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.363408 25878 ts_tablet_manager.cc:1434] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:22:53.365438 25877 tablet_bootstrap.cc:492] T 2d9ca842256c405c98d29454943e5d01 P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:53.377903 26218 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.378515 26218 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.380630 26218 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:53.381649 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:53.382256 25756 raft_consensus.cc:2468] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 0.
I20260709 12:22:53.382759 25877 ts_tablet_manager.cc:1403] T 2d9ca842256c405c98d29454943e5d01 P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.071s	user 0.017s	sys 0.007s
I20260709 12:22:53.378973 25878 tablet_bootstrap.cc:492] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:53.384086 25800 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:22:53.387001 26209 raft_consensus.cc:2804] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:53.387352 26209 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:53.387699 26209 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:53.388288 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:53.390240 25877 raft_consensus.cc:359] T 2d9ca842256c405c98d29454943e5d01 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:22:53.390764 25801 leader_election.cc:343] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:53.390956 25877 raft_consensus.cc:385] T 2d9ca842256c405c98d29454943e5d01 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:53.391261 25877 raft_consensus.cc:740] T 2d9ca842256c405c98d29454943e5d01 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
I20260709 12:22:53.391494 25878 tablet_bootstrap.cc:654] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:53.391985 25877 consensus_queue.cc:260] T 2d9ca842256c405c98d29454943e5d01 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.377902 25879 raft_consensus.cc:385] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:53.395862 25877 ts_tablet_manager.cc:1434] T 2d9ca842256c405c98d29454943e5d01 P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:22:53.390251 26135 consensus_queue.cc:1048] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:22:53.396811 25877 tablet_bootstrap.cc:492] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
I20260709 12:22:53.393126 25879 raft_consensus.cc:740] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
I20260709 12:22:53.399498 25879 consensus_queue.cc:260] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.403515 26209 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.406361 26209 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:53.407562 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:22:53.408186 25763 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:53.408701 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
W20260709 12:22:53.410957 25801 leader_election.cc:343] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:53.411360 25879 ts_tablet_manager.cc:1434] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.000s
I20260709 12:22:53.413812 25877 tablet_bootstrap.cc:654] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:53.414742 25879 tablet_bootstrap.cc:492] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
I20260709 12:22:53.418319 25763 raft_consensus.cc:2468] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 1.
I20260709 12:22:53.426219 25800 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:22:53.429452 26209 raft_consensus.cc:2804] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:53.429939 26209 raft_consensus.cc:697] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:22:53.439057 26135 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.439625 26135 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.442932 25878 tablet_bootstrap.cc:492] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:53.443421 25878 ts_tablet_manager.cc:1403] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.065s	user 0.004s	sys 0.020s
I20260709 12:22:53.444548 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:53.445031 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:53.445971 25878 raft_consensus.cc:359] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.446626 25878 raft_consensus.cc:385] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:22:53.446859 25650 leader_election.cc:343] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:53.447896 26135 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:22:53.452207 25649 leader_election.cc:343] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:53.452692 25649 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:22:53.453310 26135 raft_consensus.cc:2749] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:53.454486 25877 tablet_bootstrap.cc:492] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:53.454972 25877 ts_tablet_manager.cc:1403] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.058s	user 0.010s	sys 0.017s
I20260709 12:22:53.430751 26209 consensus_queue.cc:237] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.457639 25877 raft_consensus.cc:359] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.458400 25877 raft_consensus.cc:385] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:53.458707 25877 raft_consensus.cc:740] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
I20260709 12:22:53.459414 25877 consensus_queue.cc:260] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.460927 25877 ts_tablet_manager.cc:1434] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:22:53.446899 25878 raft_consensus.cc:740] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
I20260709 12:22:53.467736 26135 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.468770 25877 tablet_bootstrap.cc:492] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
I20260709 12:22:53.468798 26135 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.468452 25878 consensus_queue.cc:260] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.473227 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:53.473768 25878 ts_tablet_manager.cc:1434] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.030s	user 0.003s	sys 0.003s
I20260709 12:22:53.473846 25837 raft_consensus.cc:2468] T b12e2b074f1b4518bcfc6728abeca136 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 0.
I20260709 12:22:53.474844 25878 tablet_bootstrap.cc:492] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:53.475112 25650 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:53.475620 25877 tablet_bootstrap.cc:654] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:53.475944 25951 raft_consensus.cc:2804] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:53.476307 25951 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:53.476681 25951 raft_consensus.cc:3060] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:53.477533 25879 tablet_bootstrap.cc:654] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:53.484061 26135 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:53.486271 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:53.490559 25879 tablet_bootstrap.cc:492] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
I20260709 12:22:53.491052 25879 ts_tablet_manager.cc:1403] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.077s	user 0.008s	sys 0.002s
I20260709 12:22:53.493837 25879 raft_consensus.cc:359] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.494556 25879 raft_consensus.cc:385] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:53.494830 25879 raft_consensus.cc:740] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
W20260709 12:22:53.502005 25649 leader_election.cc:343] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:53.508989 25951 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.513684 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:22:53.514374 25837 raft_consensus.cc:3060] T b12e2b074f1b4518bcfc6728abeca136 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:53.536785 25878 tablet_bootstrap.cc:654] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:53.538734 25837 raft_consensus.cc:2468] T b12e2b074f1b4518bcfc6728abeca136 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 1.
I20260709 12:22:53.539882 25650 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:53.540736 26110 raft_consensus.cc:2804] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:53.541234 26110 raft_consensus.cc:697] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:22:53.540423 25879 consensus_queue.cc:260] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.542167 26110 consensus_queue.cc:237] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.542826 25879 ts_tablet_manager.cc:1434] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.051s	user 0.004s	sys 0.002s
I20260709 12:22:53.546809 25878 tablet_bootstrap.cc:492] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:53.547312 25878 ts_tablet_manager.cc:1403] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.073s	user 0.010s	sys 0.001s
I20260709 12:22:53.552847 25879 tablet_bootstrap.cc:492] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
I20260709 12:22:53.553429 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:22:53.565806 26202 consensus_queue.cc:1048] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:53.570930 25878 raft_consensus.cc:359] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.571646 25878 raft_consensus.cc:385] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:22:53.574647 25649 leader_election.cc:343] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:53.576416 25878 raft_consensus.cc:740] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
I20260709 12:22:53.577855 25878 consensus_queue.cc:260] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.581632 25878 ts_tablet_manager.cc:1434] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.034s	user 0.002s	sys 0.005s
I20260709 12:22:53.582609 25878 tablet_bootstrap.cc:492] T 06c3ab7c0c7a496390151c476ec675a0 P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:53.584323 26218 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.584786 26218 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.586786 26218 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:53.587659 25951 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:53.591053 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:53.591929 25879 tablet_bootstrap.cc:654] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:53.592916 25800 leader_election.cc:343] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:53.596071 25582 catalog_manager.cc:5697] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 1 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:53.598899 26135 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.599400 26135 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.601660 26209 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.602144 26209 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.605624 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:22:53.607108 25800 leader_election.cc:343] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:53.607781 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:53.608458 25837 raft_consensus.cc:2468] T 05232536e53b419682a5f24515843652 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 0.
I20260709 12:22:53.609457 25650 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:53.609622 26209 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:53.610512 26110 raft_consensus.cc:2804] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:53.611261 26110 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:53.611611 26110 raft_consensus.cc:3060] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:53.612599 26209 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.613116 26209 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.616299 26209 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:53.617811 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:53.618836 26110 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.602065 26135 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:53.618304 25878 tablet_bootstrap.cc:654] T 06c3ab7c0c7a496390151c476ec675a0 P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:53.622105 25800 leader_election.cc:343] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:53.625479 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:53.626915 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:53.629045 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:53.629287 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:53.629906 25756 raft_consensus.cc:2468] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 0.
W20260709 12:22:53.636425 25801 leader_election.cc:343] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:53.636977 25801 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:22:53.638412 26218 raft_consensus.cc:2749] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:22:53.645645 25801 leader_election.cc:343] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:53.646059 25801 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:22:53.647032 26209 raft_consensus.cc:2749] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:53.647675 25879 tablet_bootstrap.cc:492] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
I20260709 12:22:53.648211 25879 ts_tablet_manager.cc:1403] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.096s	user 0.010s	sys 0.004s
I20260709 12:22:53.651469 25879 raft_consensus.cc:359] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.652184 25879 raft_consensus.cc:385] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:53.652458 25879 raft_consensus.cc:740] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
I20260709 12:22:53.653105 25879 consensus_queue.cc:260] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.654304 25877 tablet_bootstrap.cc:492] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:53.655773 25877 ts_tablet_manager.cc:1403] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.186s	user 0.034s	sys 0.015s
I20260709 12:22:53.658855 25877 raft_consensus.cc:359] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.660516 25877 raft_consensus.cc:385] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:53.662132 26110 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:53.668838 25877 raft_consensus.cc:740] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
I20260709 12:22:53.687214 26019 consensus_queue.cc:1048] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:22:53.663699 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:22:53.691330 25829 raft_consensus.cc:3060] T 05232536e53b419682a5f24515843652 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:53.676918 26140 consensus_queue.cc:1048] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 12:22:53.689250 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:22:53.693909 25756 raft_consensus.cc:3060] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:53.669890 25879 ts_tablet_manager.cc:1434] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:22:53.695542 25877 consensus_queue.cc:260] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.696838 25879 tablet_bootstrap.cc:492] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
I20260709 12:22:53.697710 25877 ts_tablet_manager.cc:1434] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.003s
I20260709 12:22:53.711941 25829 raft_consensus.cc:2468] T 05232536e53b419682a5f24515843652 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 1.
I20260709 12:22:53.712756 25877 tablet_bootstrap.cc:492] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
W20260709 12:22:53.664670 25801 leader_election.cc:343] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:53.699779 25763 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:53.685909 25584 catalog_manager.cc:5697] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 0 to 1, leader changed from <none> to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 1 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:53.720777 25801 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
W20260709 12:22:53.721673 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 57047.5us
I20260709 12:22:53.725214 26019 consensus_queue.cc:1048] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:53.730173 26209 raft_consensus.cc:2749] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:53.707806 25756 raft_consensus.cc:2468] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 1.
I20260709 12:22:53.732719 25878 tablet_bootstrap.cc:492] T 06c3ab7c0c7a496390151c476ec675a0 P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:53.709966 25879 tablet_bootstrap.cc:654] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:53.733229 25878 ts_tablet_manager.cc:1403] T 06c3ab7c0c7a496390151c476ec675a0 P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.151s	user 0.008s	sys 0.003s
I20260709 12:22:53.713582 25650 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:53.737176 25883 raft_consensus.cc:2804] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:53.735774 25878 raft_consensus.cc:359] T 06c3ab7c0c7a496390151c476ec675a0 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.738060 25878 raft_consensus.cc:385] T 06c3ab7c0c7a496390151c476ec675a0 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:53.740012 25878 raft_consensus.cc:740] T 06c3ab7c0c7a496390151c476ec675a0 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
I20260709 12:22:53.740849 25878 consensus_queue.cc:260] T 06c3ab7c0c7a496390151c476ec675a0 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.737609 25883 raft_consensus.cc:697] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:22:53.742338 25883 consensus_queue.cc:237] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.744771 25878 ts_tablet_manager.cc:1434] T 06c3ab7c0c7a496390151c476ec675a0 P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:22:53.747176 25878 tablet_bootstrap.cc:492] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:53.747223 26202 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.747187 25879 tablet_bootstrap.cc:492] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
I20260709 12:22:53.748116 25879 ts_tablet_manager.cc:1403] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.051s	user 0.003s	sys 0.010s
I20260709 12:22:53.747891 26202 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.749850 26202 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:53.750753 25879 raft_consensus.cc:359] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.751406 25879 raft_consensus.cc:385] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:53.751685 25879 raft_consensus.cc:740] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
I20260709 12:22:53.751796 25877 tablet_bootstrap.cc:654] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:53.751977 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:53.752592 25828 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 1.
I20260709 12:22:53.753780 25726 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:22:53.754576 26140 raft_consensus.cc:2804] T 63f47864b8d248a792567d96c5e453b8 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:53.754992 26140 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:53.755357 26140 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:53.756855 26135 consensus_queue.cc:1048] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:53.762284 26140 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.782846 25763 raft_consensus.cc:1240] T 63f47864b8d248a792567d96c5e453b8 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:22:53.762982 25877 tablet_bootstrap.cc:492] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:53.764174 25879 consensus_queue.cc:260] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.785405 25877 ts_tablet_manager.cc:1403] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.073s	user 0.017s	sys 0.000s
I20260709 12:22:53.786645 25879 ts_tablet_manager.cc:1434] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.000s
I20260709 12:22:53.787532 25879 tablet_bootstrap.cc:492] T 3d79b16002fc460a9e70bd0a5bcec639 P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
I20260709 12:22:53.788954 26140 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:53.774914 26110 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.779138 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:53.789868 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:22:53.790799 26110 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:22:53.767315 25632 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:53.790310 25878 tablet_bootstrap.cc:654] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:53.792980 26110 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:53.795841 25879 tablet_bootstrap.cc:654] T 3d79b16002fc460a9e70bd0a5bcec639 P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:53.796484 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:22:53.797883 25650 leader_election.cc:343] T 2d9ca842256c405c98d29454943e5d01 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:53.803179 25877 raft_consensus.cc:359] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.804167 25877 raft_consensus.cc:385] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:53.804507 25877 raft_consensus.cc:740] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
I20260709 12:22:53.805338 25877 consensus_queue.cc:260] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.807915 25877 ts_tablet_manager.cc:1434] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.000s
I20260709 12:22:53.820016 25877 tablet_bootstrap.cc:492] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
I20260709 12:22:53.823014 26202 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.823546 26202 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.825623 25877 tablet_bootstrap.cc:654] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:53.825562 26202 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:53.827392 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:53.828199 25829 raft_consensus.cc:2393] T b12e2b074f1b4518bcfc6728abeca136 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 1: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:22:53.833827 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:53.835541 25763 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:53.837811 25583 catalog_manager.cc:5697] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 0 to 1, leader changed from <none> to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 1 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:53.849429 25877 tablet_bootstrap.cc:492] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:53.850037 25877 ts_tablet_manager.cc:1403] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.030s	user 0.007s	sys 0.003s
I20260709 12:22:53.852658 25877 raft_consensus.cc:359] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.853370 25877 raft_consensus.cc:385] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:53.853705 25877 raft_consensus.cc:740] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
I20260709 12:22:53.856767 25877 consensus_queue.cc:260] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.855264 26202 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.858448 26202 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.859848 25877 ts_tablet_manager.cc:1434] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:22:53.860625 25879 tablet_bootstrap.cc:492] T 3d79b16002fc460a9e70bd0a5bcec639 P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
I20260709 12:22:53.863698 25951 consensus_queue.cc:1048] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:53.864135 25879 ts_tablet_manager.cc:1403] T 3d79b16002fc460a9e70bd0a5bcec639 P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.077s	user 0.016s	sys 0.011s
I20260709 12:22:53.864506 26140 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.864748 25877 tablet_bootstrap.cc:492] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
I20260709 12:22:53.864960 26140 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.866707 26140 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:53.866667 25879 raft_consensus.cc:359] T 3d79b16002fc460a9e70bd0a5bcec639 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.867552 25879 raft_consensus.cc:385] T 3d79b16002fc460a9e70bd0a5bcec639 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:53.867635 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:53.861208 26202 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:53.867851 25879 raft_consensus.cc:740] T 3d79b16002fc460a9e70bd0a5bcec639 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
I20260709 12:22:53.868851 25828 raft_consensus.cc:2468] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 1.
I20260709 12:22:53.869474 25879 consensus_queue.cc:260] T 3d79b16002fc460a9e70bd0a5bcec639 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.870252 25726 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:22:53.870992 25879 ts_tablet_manager.cc:1434] T 3d79b16002fc460a9e70bd0a5bcec639 P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:22:53.871308 25877 tablet_bootstrap.cc:654] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:53.871562 26140 raft_consensus.cc:2804] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:53.871969 25879 tablet_bootstrap.cc:492] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
I20260709 12:22:53.862913 25878 tablet_bootstrap.cc:492] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:53.862849 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:53.872004 26140 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:53.876420 25829 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 0.
I20260709 12:22:53.878153 25878 ts_tablet_manager.cc:1403] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.131s	user 0.011s	sys 0.000s
I20260709 12:22:53.876448 26140 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:53.881678 25878 raft_consensus.cc:359] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.882620 25878 raft_consensus.cc:385] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:53.882961 25878 raft_consensus.cc:740] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
I20260709 12:22:53.884423 25878 consensus_queue.cc:260] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.890223 25951 consensus_queue.cc:1059] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:53.890965 26110 raft_consensus.cc:3055] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:22:53.891252 25649 leader_election.cc:343] T 2d9ca842256c405c98d29454943e5d01 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:53.891777 25649 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:22:53.892829 25883 raft_consensus.cc:2749] T 2d9ca842256c405c98d29454943e5d01 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:53.891314 26110 raft_consensus.cc:740] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:22:53.893582 25726 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:22:53.895195 26202 raft_consensus.cc:2804] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:53.895695 26202 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:53.896200 26202 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:53.900282 25878 ts_tablet_manager.cc:1434] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 12:22:53.900182 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:53.900760 26140 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.901650 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:22:53.903959 25878 tablet_bootstrap.cc:492] T 06bd2840931844279521c7e8eb8750bf P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:53.904021 26019 consensus_queue.cc:1048] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:53.905117 25879 tablet_bootstrap.cc:654] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:53.905891 25883 consensus_queue.cc:1048] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:22:53.908429 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:53.909116 25685 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 0.
I20260709 12:22:53.895792 26110 consensus_queue.cc:260] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.910983 26110 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:53.923631 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:53.946695 25883 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.947238 25883 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.958317 25883 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:53.960937 25883 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.962096 25883 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.965030 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:22:53.965632 25883 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:53.966171 25877 tablet_bootstrap.cc:492] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:53.966693 25877 ts_tablet_manager.cc:1403] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.102s	user 0.020s	sys 0.052s
I20260709 12:22:53.962839 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:22:53.967039 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:53.967665 25828 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 0.
I20260709 12:22:53.968987 25650 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:53.969792 25883 raft_consensus.cc:2804] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:53.970160 25883 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:53.969909 25877 raft_consensus.cc:359] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.970517 25883 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:53.970669 25877 raft_consensus.cc:385] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:53.970999 25877 raft_consensus.cc:740] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
I20260709 12:22:53.971616 25877 consensus_queue.cc:260] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.972208 25759 raft_consensus.cc:1240] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:22:53.965281 25726 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:22:53.959903 26140 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:53.981547 26280 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:53.981954 25879 tablet_bootstrap.cc:492] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
I20260709 12:22:53.982571 25879 ts_tablet_manager.cc:1403] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.111s	user 0.027s	sys 0.013s
I20260709 12:22:53.982273 26280 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.985199 26280 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:53.986172 26280 raft_consensus.cc:3060] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:53.986311 25879 raft_consensus.cc:359] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:53.994045 25879 raft_consensus.cc:385] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:53.994432 25879 raft_consensus.cc:740] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
I20260709 12:22:53.997859 25883 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:54.007440 25883 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:53.999398 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:53.999667 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:54.043823 25879 consensus_queue.cc:260] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:22:54.074532 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 69627.2us
I20260709 12:22:54.076756 25726 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:22:54.079440 25877 ts_tablet_manager.cc:1434] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.112s	user 0.032s	sys 0.011s
I20260709 12:22:54.080991 25877 tablet_bootstrap.cc:492] T 8dcbaf690aa54e4887d08b85cec29701 P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
I20260709 12:22:54.092595 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:54.093257 25763 raft_consensus.cc:2468] T 3d79b16002fc460a9e70bd0a5bcec639 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 0.
I20260709 12:22:54.083999 26202 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:54.115053 26202 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:54.137998 25649 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:54.138952 25883 raft_consensus.cc:2804] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:54.139312 25883 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:54.139613 25883 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:54.152069 25879 ts_tablet_manager.cc:1434] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.169s	user 0.012s	sys 0.000s
I20260709 12:22:54.153796 25879 tablet_bootstrap.cc:492] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
W20260709 12:22:54.156237 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 79603.2us
I20260709 12:22:54.157086 26282 raft_consensus.cc:2749] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:54.150818 26135 consensus_queue.cc:1059] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 12:22:54.190104 25883 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:54.193128 25680 raft_consensus.cc:2410] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 12:22:54.192824 25883 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:54.207963 25879 tablet_bootstrap.cc:654] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:54.190690 26275 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:54.214918 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:54.220948 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:22:54.221748 25837 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:54.214761 26019 raft_consensus.cc:3055] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:22:54.235378 25726 leader_election.cc:343] T 3d79b16002fc460a9e70bd0a5bcec639 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:54.256388 25650 leader_election.cc:343] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:54.236690 26019 raft_consensus.cc:740] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:22:54.240662 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:22:54.260982 25951 consensus_queue.cc:1048] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:54.263907 25726 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:22:54.264513 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:54.223423 26275 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:54.272890 25682 raft_consensus.cc:2393] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 1: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:22:54.275583 25685 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:54.280939 25726 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:22:54.269894 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:22:54.290400 26210 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:54.289973 26279 raft_consensus.cc:2749] T 63f47864b8d248a792567d96c5e453b8 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:54.316707 26019 consensus_queue.cc:260] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:54.317991 26019 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:54.323407 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:22:54.310066 25829 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:54.329758 26279 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:54.339452 25837 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 1.
W20260709 12:22:54.341657 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 60795.1us
I20260709 12:22:54.336458 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:22:54.322345 26210 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:22:54.360114 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 119205us
I20260709 12:22:54.386224 25878 tablet_bootstrap.cc:654] T 06bd2840931844279521c7e8eb8750bf P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:54.400043 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 134387us
I20260709 12:22:54.398677 26275 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:54.410949 26280 raft_consensus.cc:2749] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:54.422670 25877 tablet_bootstrap.cc:654] T 8dcbaf690aa54e4887d08b85cec29701 P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:54.424691 25801 consensus_peers.cc:597] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:54.431370 25685 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 1.
W20260709 12:22:54.434008 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 70225.1us
I20260709 12:22:54.437268 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:54.437894 25685 raft_consensus.cc:2468] T 2d9ca842256c405c98d29454943e5d01 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 0.
I20260709 12:22:54.440450 25726 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:54.450416 25879 tablet_bootstrap.cc:492] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
I20260709 12:22:54.451030 25879 ts_tablet_manager.cc:1403] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.297s	user 0.022s	sys 0.037s
I20260709 12:22:54.447443 26284 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:54.481809 26284 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:54.485556 26284 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:54.479761 25829 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 1.
I20260709 12:22:54.497185 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:54.497222 26279 raft_consensus.cc:2749] T 3d79b16002fc460a9e70bd0a5bcec639 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:54.476471 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:22:54.500191 25649 leader_election.cc:343] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:54.475175 26202 raft_consensus.cc:2804] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:54.509569 25879 raft_consensus.cc:359] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:54.510293 25879 raft_consensus.cc:385] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:54.510555 25879 raft_consensus.cc:740] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
I20260709 12:22:54.511149 25879 consensus_queue.cc:260] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:22:54.533565 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 93185.4us
I20260709 12:22:54.534722 25726 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:54.535590 26282 raft_consensus.cc:2804] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:54.536001 26282 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:54.536374 26282 raft_consensus.cc:3060] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:54.539687 26210 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:54.543183 25879 ts_tablet_manager.cc:1434] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.092s	user 0.006s	sys 0.001s
I20260709 12:22:54.514456 26202 raft_consensus.cc:697] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
W20260709 12:22:54.546514 25649 leader_election.cc:343] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:54.547237 25726 leader_election.cc:343] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:54.544945 26202 consensus_queue.cc:237] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:54.554819 25878 tablet_bootstrap.cc:492] T 06bd2840931844279521c7e8eb8750bf P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:54.555321 25878 ts_tablet_manager.cc:1403] T 06bd2840931844279521c7e8eb8750bf P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.652s	user 0.016s	sys 0.038s
I20260709 12:22:54.564357 25878 raft_consensus.cc:359] T 06bd2840931844279521c7e8eb8750bf P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:54.565016 25878 raft_consensus.cc:385] T 06bd2840931844279521c7e8eb8750bf P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:54.565323 25878 raft_consensus.cc:740] T 06bd2840931844279521c7e8eb8750bf P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
I20260709 12:22:54.565564 25877 tablet_bootstrap.cc:492] T 8dcbaf690aa54e4887d08b85cec29701 P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:54.565932 25878 consensus_queue.cc:260] T 06bd2840931844279521c7e8eb8750bf P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:54.566375 25877 ts_tablet_manager.cc:1403] T 8dcbaf690aa54e4887d08b85cec29701 P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.486s	user 0.017s	sys 0.012s
I20260709 12:22:54.566815 26282 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:54.571077 26282 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:54.574940 25878 ts_tablet_manager.cc:1434] T 06bd2840931844279521c7e8eb8750bf P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:22:54.575702 25878 tablet_bootstrap.cc:492] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:54.578907 25879 tablet_bootstrap.cc:492] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
I20260709 12:22:54.577790 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:22:54.584686 26286 consensus_queue.cc:1048] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:22:54.586887 25649 leader_election.cc:343] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:54.578087 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:22:54.590994 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
W20260709 12:22:54.591426 25726 leader_election.cc:343] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:54.591543 25685 raft_consensus.cc:3060] T 2d9ca842256c405c98d29454943e5d01 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:54.598405 25877 raft_consensus.cc:359] T 8dcbaf690aa54e4887d08b85cec29701 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:54.599107 25877 raft_consensus.cc:385] T 8dcbaf690aa54e4887d08b85cec29701 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:54.599380 25877 raft_consensus.cc:740] T 8dcbaf690aa54e4887d08b85cec29701 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
I20260709 12:22:54.602749 25879 tablet_bootstrap.cc:654] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:54.603161 25685 raft_consensus.cc:2468] T 2d9ca842256c405c98d29454943e5d01 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 1.
I20260709 12:22:54.600513 25877 consensus_queue.cc:260] T 8dcbaf690aa54e4887d08b85cec29701 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:54.604458 25726 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:22:54.606302 26202 raft_consensus.cc:2804] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:54.619197 25758 raft_consensus.cc:2468] T 3d79b16002fc460a9e70bd0a5bcec639 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 1.
I20260709 12:22:54.654790 25878 tablet_bootstrap.cc:654] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:54.654830 25877 ts_tablet_manager.cc:1434] T 8dcbaf690aa54e4887d08b85cec29701 P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.088s	user 0.005s	sys 0.000s
I20260709 12:22:54.606778 26202 raft_consensus.cc:697] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:22:54.657226 26202 consensus_queue.cc:237] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:54.617182 26135 consensus_queue.cc:1048] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.059s
I20260709 12:22:54.675405 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:54.730751 25684 raft_consensus.cc:2468] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 0.
I20260709 12:22:54.745191 25649 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:54.746507 26135 raft_consensus.cc:2804] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:54.747071 26135 raft_consensus.cc:697] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:22:54.748449 26135 consensus_queue.cc:237] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:54.751379 25877 tablet_bootstrap.cc:492] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
W20260709 12:22:54.790020 25650 leader_election.cc:343] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:54.805830 25650 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:22:54.807983 25801 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:54.820483 25883 raft_consensus.cc:2804] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:54.821264 25883 raft_consensus.cc:697] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:22:54.796032 26287 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:54.838824 25650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:22:54.822335 25883 consensus_queue.cc:237] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:54.795992 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:54.838454 26307 raft_consensus.cc:2804] T 06c3ab7c0c7a496390151c476ec675a0 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:54.798202 26288 consensus_queue.cc:1048] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.046s
I20260709 12:22:54.854156 26307 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:54.845279 26287 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:54.891301 26307 raft_consensus.cc:3060] T 06c3ab7c0c7a496390151c476ec675a0 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:54.901587 26202 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:54.912880 26202 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:54.915807 26202 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:54.925819 26287 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:54.934024 26307 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:54.940325 26307 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:54.942790 25877 tablet_bootstrap.cc:654] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:54.982831 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 142345us
I20260709 12:22:54.990283 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:54.992401 25684 raft_consensus.cc:2468] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 0.
I20260709 12:22:55.007143 25726 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:55.022007 25879 tablet_bootstrap.cc:492] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
I20260709 12:22:55.023047 25879 ts_tablet_manager.cc:1403] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.444s	user 0.014s	sys 0.025s
I20260709 12:22:55.030205 26286 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:55.030925 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:55.033056 25878 tablet_bootstrap.cc:492] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:55.035772 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:55.040899 25761 raft_consensus.cc:2468] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 0.
I20260709 12:22:55.041911 25878 ts_tablet_manager.cc:1403] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.466s	user 0.013s	sys 0.008s
I20260709 12:22:55.042680 26140 raft_consensus.cc:2804] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:55.043181 26140 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:55.043581 26140 raft_consensus.cc:3060] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:55.041962 25833 raft_consensus.cc:2393] T 06c3ab7c0c7a496390151c476ec675a0 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 1: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:22:55.057149 26279 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:22:55.057925 26279 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.077068 26281 consensus_queue.cc:1048] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:22:55.081681 25650 leader_election.cc:343] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:55.082381 25650 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:22:55.090253 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:55.091667 26279 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:55.093853 25877 tablet_bootstrap.cc:492] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:55.094612 25877 ts_tablet_manager.cc:1403] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.344s	user 0.012s	sys 0.003s
I20260709 12:22:55.094445 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:22:55.096078 25878 raft_consensus.cc:359] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.040562 26286 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.100375 26289 raft_consensus.cc:2749] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:55.099665 25878 raft_consensus.cc:385] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:55.120009 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:55.111413 25878 raft_consensus.cc:740] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
I20260709 12:22:55.124732 25878 consensus_queue.cc:260] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.127401 26286 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:55.135308 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:55.138114 25879 raft_consensus.cc:359] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.138927 25879 raft_consensus.cc:385] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:55.139245 25879 raft_consensus.cc:740] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
I20260709 12:22:55.144451 25877 raft_consensus.cc:359] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.145574 25877 raft_consensus.cc:385] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:55.145895 25878 ts_tablet_manager.cc:1434] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.103s	user 0.003s	sys 0.007s
I20260709 12:22:55.145895 25877 raft_consensus.cc:740] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
I20260709 12:22:55.139904 25879 consensus_queue.cc:260] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.148154 25879 ts_tablet_manager.cc:1434] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.125s	user 0.006s	sys 0.005s
I20260709 12:22:55.148943 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:55.149060 25877 consensus_queue.cc:260] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.131481 26140 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.150672 25762 raft_consensus.cc:2393] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 1: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:22:55.151440 25877 ts_tablet_manager.cc:1434] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.056s	user 0.004s	sys 0.007s
I20260709 12:22:55.153342 25877 tablet_bootstrap.cc:492] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
I20260709 12:22:55.154299 26140 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:55.149616 25879 tablet_bootstrap.cc:492] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
I20260709 12:22:55.176819 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:55.177680 25828 raft_consensus.cc:2468] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 0.
I20260709 12:22:55.184388 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:22:55.185091 25677 raft_consensus.cc:3060] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:55.196916 25878 tablet_bootstrap.cc:492] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:55.200125 25584 catalog_manager.cc:5697] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 1 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:55.204790 26322 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:55.207525 25584 catalog_manager.cc:5697] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 1 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:55.219889 25650 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:55.205466 26322 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.230118 26019 raft_consensus.cc:2804] T 8dcbaf690aa54e4887d08b85cec29701 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:55.230542 26019 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:55.230896 26019 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:55.243297 25632 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:55.254021 25879 tablet_bootstrap.cc:654] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:55.259795 26322 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:55.260423 26322 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:55.262949 25650 consensus_peers.cc:597] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc -> Peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Couldn't send request to peer 5cccf20a8bff46dba6601f241d172b8a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:55.263813 26322 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.266767 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:55.257440 25677 raft_consensus.cc:2468] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 1.
I20260709 12:22:55.269753 26322 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:55.270494 25877 tablet_bootstrap.cc:654] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:55.272271 25800 leader_election.cc:343] T 06bd2840931844279521c7e8eb8750bf P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:55.273773 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 64468.6us
I20260709 12:22:55.274169 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:55.277338 26140 consensus_queue.cc:1048] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:55.290237 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:22:55.291096 25833 raft_consensus.cc:2393] T 06c3ab7c0c7a496390151c476ec675a0 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 1: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:22:55.274518 26019 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:22:55.299512 25726 consensus_peers.cc:597] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Couldn't send request to peer 5cccf20a8bff46dba6601f241d172b8a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:55.325517 26019 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:55.338317 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:22:55.338806 25879 tablet_bootstrap.cc:492] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
I20260709 12:22:55.339138 25831 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:55.339324 25879 ts_tablet_manager.cc:1403] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.190s	user 0.017s	sys 0.009s
I20260709 12:22:55.341095 25878 tablet_bootstrap.cc:654] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:55.343456 25879 raft_consensus.cc:359] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.344175 25879 raft_consensus.cc:385] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:55.344473 25879 raft_consensus.cc:740] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
I20260709 12:22:55.345434 25879 consensus_queue.cc:260] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.347455 25879 ts_tablet_manager.cc:1434] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:22:55.348296 26296 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:55.348856 26296 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.350366 25879 tablet_bootstrap.cc:492] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
I20260709 12:22:55.353371 26296 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:55.355610 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:22:55.357604 25800 leader_election.cc:343] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:55.364219 25831 raft_consensus.cc:2468] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 1.
I20260709 12:22:55.366357 25650 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:55.368259 26289 raft_consensus.cc:2804] T 8dcbaf690aa54e4887d08b85cec29701 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:55.371960 26289 raft_consensus.cc:697] T 8dcbaf690aa54e4887d08b85cec29701 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:22:55.373325 26289 consensus_queue.cc:237] T 8dcbaf690aa54e4887d08b85cec29701 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.374899 25726 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:22:55.375530 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:55.376073 26275 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:55.376734 26140 raft_consensus.cc:2749] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:55.376636 26275 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.378826 26275 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:55.379449 25759 raft_consensus.cc:2468] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 0.
I20260709 12:22:55.382660 26275 consensus_queue.cc:1048] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:22:55.382984 25801 leader_election.cc:343] T 06bd2840931844279521c7e8eb8750bf P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:55.383420 25801 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:22:55.384331 26218 raft_consensus.cc:2749] T 06bd2840931844279521c7e8eb8750bf P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:55.389671 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:55.390410 25762 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 2.
I20260709 12:22:55.386873 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:55.391875 25831 raft_consensus.cc:2393] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 1: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:22:55.393173 26307 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:55.393728 26307 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.398543 26307 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:55.398909 25801 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:22:55.400592 25879 tablet_bootstrap.cc:654] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:55.400236 26209 raft_consensus.cc:2804] T 06c3ab7c0c7a496390151c476ec675a0 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:55.401206 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:22:55.402997 25800 leader_election.cc:343] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:55.402944 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:55.403762 25878 tablet_bootstrap.cc:492] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:55.404230 25878 ts_tablet_manager.cc:1403] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.208s	user 0.018s	sys 0.015s
I20260709 12:22:55.401499 25877 tablet_bootstrap.cc:492] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:55.406260 25877 ts_tablet_manager.cc:1403] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.253s	user 0.028s	sys 0.025s
I20260709 12:22:55.401422 26209 raft_consensus.cc:697] T 06c3ab7c0c7a496390151c476ec675a0 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:22:55.409294 25878 raft_consensus.cc:359] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.410171 25878 raft_consensus.cc:385] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:55.410519 25878 raft_consensus.cc:740] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
I20260709 12:22:55.410444 26209 consensus_queue.cc:237] T 06c3ab7c0c7a496390151c476ec675a0 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.411556 25878 consensus_queue.cc:260] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.414146 25878 ts_tablet_manager.cc:1434] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:22:55.415323 25878 tablet_bootstrap.cc:492] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:55.416882 26307 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:22:55.418280 26307 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.422019 25877 raft_consensus.cc:359] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.422813 25877 raft_consensus.cc:385] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:55.423659 25877 raft_consensus.cc:740] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
I20260709 12:22:55.424362 25877 consensus_queue.cc:260] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.425056 26307 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:55.426630 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:55.427486 25762 raft_consensus.cc:2393] T 63f47864b8d248a792567d96c5e453b8 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 2: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:22:55.431870 25877 ts_tablet_manager.cc:1434] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.001s
I20260709 12:22:55.434419 25877 tablet_bootstrap.cc:492] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
I20260709 12:22:55.438341 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:22:55.439018 25879 tablet_bootstrap.cc:492] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
I20260709 12:22:55.439041 25762 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:55.439603 25879 ts_tablet_manager.cc:1403] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.090s	user 0.014s	sys 0.000s
I20260709 12:22:55.442307 25879 raft_consensus.cc:359] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.446164 25878 tablet_bootstrap.cc:654] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:55.442986 25879 raft_consensus.cc:385] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:55.447664 25879 raft_consensus.cc:740] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
I20260709 12:22:55.457640 25879 consensus_queue.cc:260] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.465039 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:22:55.465922 25677 raft_consensus.cc:2393] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 1: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:22:55.470317 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:55.479176 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:55.479696 25685 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 0.
I20260709 12:22:55.481334 25681 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:55.482103 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:55.482216 25582 catalog_manager.cc:5697] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 0 to 1, leader changed from <none> to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 1 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:55.482116 25879 ts_tablet_manager.cc:1434] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.042s	user 0.009s	sys 0.000s
I20260709 12:22:55.487771 25582 catalog_manager.cc:5697] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 0 to 1, leader changed from <none> to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 1 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:55.495548 25879 tablet_bootstrap.cc:492] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
I20260709 12:22:55.495393 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:55.501209 25878 tablet_bootstrap.cc:492] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:55.501888 25878 ts_tablet_manager.cc:1403] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.087s	user 0.015s	sys 0.003s
I20260709 12:22:55.504084 25680 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 2.
I20260709 12:22:55.472226 25762 raft_consensus.cc:2468] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 1.
W20260709 12:22:55.512044 25801 leader_election.cc:343] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:55.514427 25801 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:22:55.517859 25726 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:22:55.521339 25801 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:22:55.522069 25726 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:22:55.525399 26303 raft_consensus.cc:2749] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:55.526293 26280 raft_consensus.cc:2749] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:22:55.527261 26202 raft_consensus.cc:2749] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:55.527422 26209 raft_consensus.cc:2804] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:55.527886 26209 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:55.527931 26279 consensus_queue.cc:1048] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:55.528369 26209 raft_consensus.cc:3060] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:55.529148 25883 consensus_queue.cc:1048] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:55.544857 26303 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:55.545771 26303 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.549460 26303 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:55.550343 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:22:55.554955 25800 leader_election.cc:343] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:55.555835 25879 tablet_bootstrap.cc:654] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:55.559151 25801 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:22:55.565798 26307 raft_consensus.cc:2804] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:22:55.566211 26307 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:22:55.566598 26307 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:55.580915 25877 tablet_bootstrap.cc:654] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:55.579993 25583 catalog_manager.cc:5697] T 06c3ab7c0c7a496390151c476ec675a0 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 1 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:55.593492 25878 raft_consensus.cc:359] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.594389 25878 raft_consensus.cc:385] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:55.594681 25878 raft_consensus.cc:740] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
W20260709 12:22:55.597298 26345 log.cc:927] Time spent T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:22:55.598209 26307 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.595386 25878 consensus_queue.cc:260] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.604743 26307 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:55.605841 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:22:55.606711 25759 raft_consensus.cc:2393] T 63f47864b8d248a792567d96c5e453b8 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 2: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:22:55.616483 25649 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:22:55.619881 25883 raft_consensus.cc:2804] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:22:55.620077 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 58800.2us
I20260709 12:22:55.620301 25883 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:55.620641 25883 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:55.620842 25649 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:22:55.622941 26289 raft_consensus.cc:2749] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:55.623974 26284 consensus_queue.cc:1048] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:55.632349 26209 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.636304 25883 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.638171 25883 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:55.639868 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:22:55.640496 25837 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:55.641309 25831 raft_consensus.cc:3060] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:55.644249 25878 ts_tablet_manager.cc:1434] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.142s	user 0.007s	sys 0.001s
I20260709 12:22:55.645488 25878 tablet_bootstrap.cc:492] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a: Bootstrap starting.
I20260709 12:22:55.647569 25837 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 3.
I20260709 12:22:55.648710 25650 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:55.649462 25883 raft_consensus.cc:2804] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:55.650592 25877 tablet_bootstrap.cc:492] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:55.651262 25877 ts_tablet_manager.cc:1403] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.217s	user 0.008s	sys 0.018s
I20260709 12:22:55.651396 25879 tablet_bootstrap.cc:492] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
I20260709 12:22:55.651854 25879 ts_tablet_manager.cc:1403] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.157s	user 0.010s	sys 0.003s
I20260709 12:22:55.654295 25879 raft_consensus.cc:359] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.655040 25879 raft_consensus.cc:385] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:55.655311 25879 raft_consensus.cc:740] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
I20260709 12:22:55.655982 25879 consensus_queue.cc:260] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.657401 26209 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:55.657920 25883 raft_consensus.cc:697] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
W20260709 12:22:55.658066 25649 consensus_peers.cc:597] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:55.658650 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:22:55.658793 25883 consensus_queue.cc:237] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.659287 25759 raft_consensus.cc:3060] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:55.666571 25877 raft_consensus.cc:359] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.667384 25877 raft_consensus.cc:385] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:55.669312 25877 raft_consensus.cc:740] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
I20260709 12:22:55.670130 25877 consensus_queue.cc:260] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.674006 25759 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 1.
I20260709 12:22:55.675361 25800 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:22:55.676182 26209 raft_consensus.cc:2804] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:55.676844 26209 raft_consensus.cc:697] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:22:55.678123 25877 ts_tablet_manager.cc:1434] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.002s
I20260709 12:22:55.677969 26209 consensus_queue.cc:237] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.679371 25877 tablet_bootstrap.cc:492] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
I20260709 12:22:55.683122 25879 ts_tablet_manager.cc:1434] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.000s
I20260709 12:22:55.688540 25877 tablet_bootstrap.cc:654] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:55.689409 25878 tablet_bootstrap.cc:654] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:55.691447 25879 tablet_bootstrap.cc:492] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
I20260709 12:22:55.691576 25831 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:55.693885 26288 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:22:55.694435 26288 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.712047 26202 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:55.712634 26202 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.715168 26202 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:55.719870 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:55.724195 25877 tablet_bootstrap.cc:492] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:55.724706 25877 ts_tablet_manager.cc:1403] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.046s	user 0.007s	sys 0.009s
I20260709 12:22:55.724963 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:55.726714 25879 tablet_bootstrap.cc:654] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:55.727836 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:22:55.728549 25755 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:55.728771 26299 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:22:55.728830 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:55.729393 26299 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.731719 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:22:55.732489 25682 raft_consensus.cc:3060] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:55.732771 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:55.732906 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:22:55.736094 26299 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:55.737773 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:55.741500 25878 tablet_bootstrap.cc:492] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a: No bootstrap required, opened a new log
I20260709 12:22:55.742208 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:55.742331 25877 raft_consensus.cc:359] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.770637 25877 raft_consensus.cc:385] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:55.771013 25877 raft_consensus.cc:740] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
I20260709 12:22:55.745522 26288 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:55.746132 25682 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 1.
I20260709 12:22:55.747219 25755 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 3.
I20260709 12:22:55.776222 25877 consensus_queue.cc:260] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.778283 25877 ts_tablet_manager.cc:1434] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.053s	user 0.005s	sys 0.002s
I20260709 12:22:55.779671 25878 ts_tablet_manager.cc:1403] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a: Time spent bootstrapping tablet: real 0.134s	user 0.010s	sys 0.003s
I20260709 12:22:55.779342 25877 tablet_bootstrap.cc:492] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc: Bootstrap starting.
I20260709 12:22:55.782883 25801 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:22:55.786899 26209 raft_consensus.cc:2749] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:55.787380 25878 raft_consensus.cc:359] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.787313 25801 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:22:55.788203 25878 raft_consensus.cc:385] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:55.788544 25878 raft_consensus.cc:740] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Initialized, Role: FOLLOWER
W20260709 12:22:55.789671 25801 leader_election.cc:343] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:55.790145 25801 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:22:55.789295 25878 consensus_queue.cc:260] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.790907 26307 raft_consensus.cc:2749] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:55.789301 26209 raft_consensus.cc:2749] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:22:55.791172 25582 catalog_manager.cc:5697] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 1 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:55.801358 25877 tablet_bootstrap.cc:654] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:55.808043 25879 tablet_bootstrap.cc:492] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
I20260709 12:22:55.808518 25879 ts_tablet_manager.cc:1403] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.124s	user 0.006s	sys 0.013s
I20260709 12:22:55.809125 26289 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:55.809621 26289 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.811551 26209 consensus_queue.cc:1048] T 06c3ab7c0c7a496390151c476ec675a0 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:55.811594 26289 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:55.818862 25879 raft_consensus.cc:359] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.819623 25879 raft_consensus.cc:385] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:55.819909 25879 raft_consensus.cc:740] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
I20260709 12:22:55.820258 26280 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:55.820720 25879 consensus_queue.cc:260] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.820919 26280 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.823339 25879 ts_tablet_manager.cc:1434] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:22:55.824402 25879 tablet_bootstrap.cc:492] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
I20260709 12:22:55.824575 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:55.826303 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:55.823846 26280 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:55.826999 25833 raft_consensus.cc:2468] T 06bd2840931844279521c7e8eb8750bf P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 0.
I20260709 12:22:55.828243 25726 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:22:55.829036 26280 raft_consensus.cc:2804] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:55.829407 26280 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:55.829624 25831 raft_consensus.cc:2468] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 0.
I20260709 12:22:55.829774 26280 raft_consensus.cc:3060] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:55.832458 25584 catalog_manager.cc:5697] T 8dcbaf690aa54e4887d08b85cec29701 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 0 to 1, leader changed from <none> to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 1 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:55.832305 25650 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:55.837620 26019 raft_consensus.cc:2804] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:55.838303 25883 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:55.837967 25584 catalog_manager.cc:5697] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:55.838001 26019 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:55.839452 26019 raft_consensus.cc:3060] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:55.839737 25877 tablet_bootstrap.cc:492] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc: No bootstrap required, opened a new log
I20260709 12:22:55.840200 25877 ts_tablet_manager.cc:1403] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc: Time spent bootstrapping tablet: real 0.061s	user 0.008s	sys 0.023s
I20260709 12:22:55.838733 25883 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.841897 25883 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:55.843073 25878 ts_tablet_manager.cc:1434] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a: Time spent starting tablet: real 0.063s	user 0.007s	sys 0.000s
I20260709 12:22:55.843310 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:55.844002 25831 raft_consensus.cc:2468] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 0.
I20260709 12:22:55.845767 25650 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:55.862939 25879 tablet_bootstrap.cc:654] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:55.862591 26019 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.871497 26019 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:55.880229 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:55.880800 26289 raft_consensus.cc:2804] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:55.881158 25678 raft_consensus.cc:2410] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 12:22:55.881323 26289 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:55.881786 26289 raft_consensus.cc:3060] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:55.888510 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:55.892752 25801 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:22:55.893069 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:22:55.893720 25837 raft_consensus.cc:3060] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:55.894833 26288 raft_consensus.cc:2749] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:22:55.898921 26289 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.874243 26280 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.901829 25726 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:22:55.903333 26275 raft_consensus.cc:2749] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:22:55.904909 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:22:55.905046 25726 leader_election.cc:343] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:55.907047 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:55.908473 26289 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:55.914389 25877 raft_consensus.cc:359] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.915257 25877 raft_consensus.cc:385] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:55.915622 25877 raft_consensus.cc:740] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Initialized, Role: FOLLOWER
I20260709 12:22:55.916131 26280 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:55.915473 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:22:55.916865 25877 consensus_queue.cc:260] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.925963 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:22:55.926613 25831 raft_consensus.cc:3060] T 06bd2840931844279521c7e8eb8750bf P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:55.931084 25883 consensus_queue.cc:1048] T 8dcbaf690aa54e4887d08b85cec29701 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:55.935092 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:22:55.935750 25833 raft_consensus.cc:3060] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:55.944931 25755 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:55.945317 26288 consensus_queue.cc:1048] T 06c3ab7c0c7a496390151c476ec675a0 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:55.950577 25833 raft_consensus.cc:2468] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 1.
I20260709 12:22:55.951424 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
W20260709 12:22:55.952574 25649 leader_election.cc:343] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:55.955138 25649 leader_election.cc:343] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:22:55.958408 25649 leader_election.cc:343] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:55.960615 25837 raft_consensus.cc:2468] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 1.
I20260709 12:22:55.961665 25877 ts_tablet_manager.cc:1434] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc: Time spent starting tablet: real 0.121s	user 0.007s	sys 0.000s
I20260709 12:22:55.962757 26362 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:55.963281 26362 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.965348 26362 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:55.971303 25650 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:55.974078 26322 raft_consensus.cc:2804] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:55.974601 26322 raft_consensus.cc:697] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:22:55.975467 26322 consensus_queue.cc:237] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.978626 25831 raft_consensus.cc:2468] T 06bd2840931844279521c7e8eb8750bf P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 1.
I20260709 12:22:55.980425 25726 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:22:55.980701 25650 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:22:55.981357 26280 raft_consensus.cc:2804] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:55.982163 26362 raft_consensus.cc:2804] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:55.983654 26362 raft_consensus.cc:697] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:22:55.983989 26280 raft_consensus.cc:697] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 1 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:22:55.984553 26362 consensus_queue.cc:237] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.985122 26280 consensus_queue.cc:237] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.990388 25879 tablet_bootstrap.cc:492] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
I20260709 12:22:55.990906 25879 ts_tablet_manager.cc:1403] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.167s	user 0.009s	sys 0.013s
I20260709 12:22:55.993878 25879 raft_consensus.cc:359] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:55.994562 25879 raft_consensus.cc:385] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:55.998477 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:55.999178 25831 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 0.
I20260709 12:22:56.005841 25650 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:22:56.006696 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 47696us
I20260709 12:22:55.994817 25879 raft_consensus.cc:740] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
W20260709 12:22:56.013842 25649 leader_election.cc:343] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:56.018561 25879 consensus_queue.cc:260] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:56.022368 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:22:56.023555 25678 raft_consensus.cc:3060] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:56.024081 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:56.025666 25757 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 0.
I20260709 12:22:56.018567 26289 raft_consensus.cc:2804] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:56.019860 26363 consensus_queue.cc:1048] T 8dcbaf690aa54e4887d08b85cec29701 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:22:56.030119 26289 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:56.033885 26289 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:56.042063 26289 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:56.050297 25879 ts_tablet_manager.cc:1434] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.002s
I20260709 12:22:56.052856 26361 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:56.054929 26361 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:56.059067 26361 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:56.061971 25879 tablet_bootstrap.cc:492] T 4e8d1d3d43ad47308fae5ed98608feb8 P 6e673265293d4e9a937dc45150aeb1b8: Bootstrap starting.
I20260709 12:22:56.063081 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:56.065584 26289 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:56.068863 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:22:56.069554 25829 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:56.078019 25678 raft_consensus.cc:2468] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 1.
I20260709 12:22:56.078317 25583 catalog_manager.cc:5697] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 1 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:56.097975 25829 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 1.
I20260709 12:22:56.100687 25650 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:22:56.102623 26362 raft_consensus.cc:2804] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:56.103535 26362 raft_consensus.cc:697] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:22:56.104480 26362 consensus_queue.cc:237] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:56.108579 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:56.109233 25755 raft_consensus.cc:2468] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 2.
I20260709 12:22:56.109462 25879 tablet_bootstrap.cc:654] T 4e8d1d3d43ad47308fae5ed98608feb8 P 6e673265293d4e9a937dc45150aeb1b8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:56.116016 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:22:56.118184 25757 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:56.115903 25760 raft_consensus.cc:1275] T 63f47864b8d248a792567d96c5e453b8 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:56.124238 25649 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:22:56.125211 26322 raft_consensus.cc:2804] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:22:56.125662 26322 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:56.126088 26322 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:56.127209 25757 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 1.
I20260709 12:22:56.132779 26322 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:56.135026 26322 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:56.134317 25584 catalog_manager.cc:5697] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 0 to 1, leader changed from <none> to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 1 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:56.136294 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:22:56.137984 26362 consensus_queue.cc:1048] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:56.136302 25584 catalog_manager.cc:5697] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 0 to 1, leader changed from <none> to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 1 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:56.144099 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:22:56.144660 25760 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:56.152244 25760 raft_consensus.cc:2468] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 3.
I20260709 12:22:56.155705 25831 raft_consensus.cc:1275] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:56.159054 26289 consensus_queue.cc:1048] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:56.167443 25879 tablet_bootstrap.cc:492] T 4e8d1d3d43ad47308fae5ed98608feb8 P 6e673265293d4e9a937dc45150aeb1b8: No bootstrap required, opened a new log
I20260709 12:22:56.167933 25879 ts_tablet_manager.cc:1403] T 4e8d1d3d43ad47308fae5ed98608feb8 P 6e673265293d4e9a937dc45150aeb1b8: Time spent bootstrapping tablet: real 0.106s	user 0.008s	sys 0.003s
I20260709 12:22:56.170707 25879 raft_consensus.cc:359] T 4e8d1d3d43ad47308fae5ed98608feb8 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:56.171373 25879 raft_consensus.cc:385] T 4e8d1d3d43ad47308fae5ed98608feb8 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:56.171630 25879 raft_consensus.cc:740] T 4e8d1d3d43ad47308fae5ed98608feb8 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Initialized, Role: FOLLOWER
I20260709 12:22:56.183049 25649 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:22:56.183933 26289 raft_consensus.cc:2804] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:56.184420 26289 raft_consensus.cc:697] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:22:56.185320 25879 consensus_queue.cc:260] T 4e8d1d3d43ad47308fae5ed98608feb8 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:56.189090 26289 consensus_queue.cc:237] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:56.191825 26280 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:56.192329 26280 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:56.194326 26280 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:56.195327 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:22:56.196123 25837 raft_consensus.cc:2393] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 1: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:22:56.198997 25879 ts_tablet_manager.cc:1434] T 4e8d1d3d43ad47308fae5ed98608feb8 P 6e673265293d4e9a937dc45150aeb1b8: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 12:22:56.206120 25584 catalog_manager.cc:5697] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 0 to 1, leader changed from <none> to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 1 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:56.223748 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:56.230672 26307 consensus_queue.cc:1048] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:56.240072 25726 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:22:56.240890 26280 raft_consensus.cc:3060] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:56.244451 26299 consensus_queue.cc:1048] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:56.247879 26280 raft_consensus.cc:2749] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:56.278177 26307 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:22:56.278736 26307 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:22:56.281910 26307 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:56.285302 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:22:56.286180 25757 raft_consensus.cc:2368] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 2. Current term is 3.
I20260709 12:22:56.289422 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:22:56.298399 25800 leader_election.cc:400] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Vote denied by peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267) with higher term. Message: Invalid argument: T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 2. Current term is 3.
I20260709 12:22:56.298735 25800 leader_election.cc:403] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:22:56.298791 25582 catalog_manager.cc:5697] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:56.301106 26299 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:22:56.310829 26299 raft_consensus.cc:2749] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267) with higher term. Message: Invalid argument: T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 2. Current term is 3.
I20260709 12:22:56.364442 25755 raft_consensus.cc:3060] T 4e8d1d3d43ad47308fae5ed98608feb8 P 6e673265293d4e9a937dc45150aeb1b8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:56.371454 26289 consensus_queue.cc:1048] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:56.383267 26361 consensus_queue.cc:1048] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:56.465708 26289 consensus_queue.cc:1048] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:56.470830 26280 consensus_queue.cc:1048] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:56.489764 26302 consensus_queue.cc:1048] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:56.522032 26289 consensus_queue.cc:1048] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:56.547369 26362 consensus_queue.cc:1048] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:56.584590 26284 consensus_queue.cc:1048] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:56.707748 25831 raft_consensus.cc:1275] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:56.709414 26284 consensus_queue.cc:1048] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:56.717180 25755 raft_consensus.cc:1275] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:22:56.719539 26284 consensus_queue.cc:1048] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:57.353739 24534 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:57.400498 26392 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:57.406420 26393 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:57.410801 24534 server_base.cc:1061] running on GCE node
W20260709 12:22:57.411409 26395 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:57.415246 24534 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:57.415566 24534 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:57.415802 24534 hybrid_clock.cc:648] HybridClock initialized: now 1783599777415784 us; error 0 us; skew 500 ppm
I20260709 12:22:57.417217 24534 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:57.421959 24534 webserver.cc:533] Webserver started at http://127.23.245.132:37441/ using document root <none> and password file <none>
I20260709 12:22:57.422665 24534 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:57.422940 24534 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:57.423375 24534 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:57.425160 24534 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-3-root/instance:
uuid: "a866ff967d964388a6f0dff7fd43df89"
format_stamp: "Formatted at 2026-07-09 12:22:57 on dist-test-slave-mlt7"
I20260709 12:22:57.442687 24534 fs_manager.cc:696] Time spent creating directory manager: real 0.017s	user 0.012s	sys 0.004s
I20260709 12:22:57.447419 26400 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:57.448966 24534 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:22:57.449404 24534 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-3-root
uuid: "a866ff967d964388a6f0dff7fd43df89"
format_stamp: "Formatted at 2026-07-09 12:22:57 on dist-test-slave-mlt7"
I20260709 12:22:57.449831 24534 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:57.498622 24534 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:57.500389 24534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:57.502352 24534 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:57.505160 24534 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:57.505491 24534 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:57.505910 24534 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:57.506114 24534 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:57.652477 24534 rpc_server.cc:307] RPC server started. Bound to: 127.23.245.132:35611
I20260709 12:22:57.652628 26463 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.245.132:35611 every 8 connection(s)
I20260709 12:22:57.658144 24534 auto_leader_rebalancer-test.cc:439] add a tserver: a866ff967d964388a6f0dff7fd43df89
I20260709 12:22:57.674970 26464 heartbeater.cc:344] Connected to a master server at 127.23.245.190:45099
I20260709 12:22:57.675453 26464 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:57.676247 26464 heartbeater.cc:507] Master 127.23.245.190:45099 requested a full tablet report, sending...
I20260709 12:22:57.678339 25584 ts_manager.cc:194] Registered new tserver with Master: a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:22:57.680207 25584 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52974
I20260709 12:22:58.491524 25837 consensus_queue.cc:237] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:22:58.517699 25760 raft_consensus.cc:1275] T 01372ae5f161477dab1b4c89fd847b3c P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:22:58.519863 26209 consensus_queue.cc:1048] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:58.559324 26307 raft_consensus.cc:2955] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:22:58.563552 25681 raft_consensus.cc:1275] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:22:58.570515 25760 raft_consensus.cc:2955] T 01372ae5f161477dab1b4c89fd847b3c P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:22:58.588915 25584 catalog_manager.cc:5697] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New cstate: current_term: 1 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:58.610270 25678 consensus_queue.cc:237] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:22:58.645834 26475 consensus_queue.cc:1048] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:22:58.650929 25801 consensus_peers.cc:597] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a -> Peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Couldn't send request to peer a866ff967d964388a6f0dff7fd43df89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 01372ae5f161477dab1b4c89fd847b3c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:58.653680 25681 raft_consensus.cc:2955] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:22:58.683183 26464 heartbeater.cc:499] Master 127.23.245.190:45099 was elected leader, sending a full tablet report...
I20260709 12:22:58.685999 25760 raft_consensus.cc:1275] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:22:58.687338 26391 consensus_queue.cc:1048] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:58.693869 25829 raft_consensus.cc:1275] T f1625669bcc54589846d8a3d94c097d4 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:22:58.695433 26391 consensus_queue.cc:1048] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:58.703572 26390 raft_consensus.cc:2955] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:22:58.706621 25760 raft_consensus.cc:2955] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
W20260709 12:22:58.708441 25650 consensus_peers.cc:597] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc -> Peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Couldn't send request to peer a866ff967d964388a6f0dff7fd43df89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f1625669bcc54589846d8a3d94c097d4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:58.722400 25829 consensus_queue.cc:237] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:22:58.729338 25583 catalog_manager.cc:5697] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New cstate: current_term: 1 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:22:58.731155 25837 raft_consensus.cc:2955] T f1625669bcc54589846d8a3d94c097d4 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:22:58.751742 25755 raft_consensus.cc:1275] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:22:58.755041 26475 consensus_queue.cc:1048] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:22:58.757447 25801 consensus_peers.cc:597] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a -> Peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Couldn't send request to peer a866ff967d964388a6f0dff7fd43df89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a22f8565191e471dbe96772477b84e36. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:58.759361 25678 raft_consensus.cc:1275] T a22f8565191e471dbe96772477b84e36 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:22:58.766830 26475 consensus_queue.cc:1048] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:58.780834 26209 raft_consensus.cc:2955] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:22:58.782980 25755 raft_consensus.cc:2955] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:22:58.792768 25681 raft_consensus.cc:2955] T a22f8565191e471dbe96772477b84e36 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:22:58.813954 25583 catalog_manager.cc:5697] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New cstate: current_term: 1 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:58.901463 25755 consensus_queue.cc:237] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
W20260709 12:22:58.995941 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 56612.9us
W20260709 12:22:59.065335 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 52452.5us
I20260709 12:22:59.089578 25837 raft_consensus.cc:1275] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:22:59.094003 26503 consensus_queue.cc:1048] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:59.098601 25678 raft_consensus.cc:1275] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:22:59.100669 26500 consensus_queue.cc:1048] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:59.119369 26505 ts_tablet_manager.cc:933] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89: Initiating tablet copy from peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:59.122483 26500 raft_consensus.cc:2955] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
W20260709 12:22:59.133670 25726 consensus_peers.cc:597] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 -> Peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Couldn't send request to peer a866ff967d964388a6f0dff7fd43df89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f9ea7c5f4a6a4724bfcb0c6d88c32b1c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:59.136049 25837 raft_consensus.cc:2955] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:22:59.141551 26505 tablet_copy_client.cc:323] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89: tablet copy: Beginning tablet copy session from remote peer at address 127.23.245.131:36237
I20260709 12:22:59.162849 25583 catalog_manager.cc:5697] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New cstate: current_term: 1 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:22:59.165071 25847 tablet_copy_service.cc:140] P 5cccf20a8bff46dba6601f241d172b8a: Received BeginTabletCopySession request for tablet 01372ae5f161477dab1b4c89fd847b3c from peer a866ff967d964388a6f0dff7fd43df89 ({username='slave'} at 127.0.0.1:41782)
I20260709 12:22:59.165709 25847 tablet_copy_service.cc:161] P 5cccf20a8bff46dba6601f241d172b8a: Beginning new tablet copy session on tablet 01372ae5f161477dab1b4c89fd847b3c from peer a866ff967d964388a6f0dff7fd43df89 at {username='slave'} at 127.0.0.1:41782: session id = a866ff967d964388a6f0dff7fd43df89-01372ae5f161477dab1b4c89fd847b3c
I20260709 12:22:59.165329 25683 raft_consensus.cc:2955] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:22:59.171831 26509 ts_tablet_manager.cc:933] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89: Initiating tablet copy from peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349)
I20260709 12:22:59.180513 25847 tablet_copy_source_session.cc:215] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:22:59.188527 26505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01372ae5f161477dab1b4c89fd847b3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:59.188756 26509 tablet_copy_client.cc:323] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Beginning tablet copy session from remote peer at address 127.23.245.129:37349
I20260709 12:22:59.212338 26505 tablet_copy_client.cc:806] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 0 data blocks...
I20260709 12:22:59.213012 26505 tablet_copy_client.cc:670] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 1 WAL segments...
I20260709 12:22:59.217667 26505 tablet_copy_client.cc:538] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:22:59.242509 25696 tablet_copy_service.cc:140] P f82778701b464892aab92a752ed7ffdc: Received BeginTabletCopySession request for tablet f1625669bcc54589846d8a3d94c097d4 from peer a866ff967d964388a6f0dff7fd43df89 ({username='slave'} at 127.0.0.1:51578)
I20260709 12:22:59.243192 25696 tablet_copy_service.cc:161] P f82778701b464892aab92a752ed7ffdc: Beginning new tablet copy session on tablet f1625669bcc54589846d8a3d94c097d4 from peer a866ff967d964388a6f0dff7fd43df89 at {username='slave'} at 127.0.0.1:51578: session id = a866ff967d964388a6f0dff7fd43df89-f1625669bcc54589846d8a3d94c097d4
I20260709 12:22:59.246007 26514 ts_tablet_manager.cc:933] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89: Initiating tablet copy from peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:22:59.246237 26505 tablet_bootstrap.cc:492] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89: Bootstrap starting.
I20260709 12:22:59.254761 25696 tablet_copy_source_session.cc:215] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:22:59.256271 26514 tablet_copy_client.cc:323] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Beginning tablet copy session from remote peer at address 127.23.245.131:36237
I20260709 12:22:59.258230 26509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1625669bcc54589846d8a3d94c097d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:59.258795 25847 tablet_copy_service.cc:140] P 5cccf20a8bff46dba6601f241d172b8a: Received BeginTabletCopySession request for tablet a22f8565191e471dbe96772477b84e36 from peer a866ff967d964388a6f0dff7fd43df89 ({username='slave'} at 127.0.0.1:41782)
I20260709 12:22:59.259384 25847 tablet_copy_service.cc:161] P 5cccf20a8bff46dba6601f241d172b8a: Beginning new tablet copy session on tablet a22f8565191e471dbe96772477b84e36 from peer a866ff967d964388a6f0dff7fd43df89 at {username='slave'} at 127.0.0.1:41782: session id = a866ff967d964388a6f0dff7fd43df89-a22f8565191e471dbe96772477b84e36
I20260709 12:22:59.267601 25847 tablet_copy_source_session.cc:215] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:22:59.275982 26514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a22f8565191e471dbe96772477b84e36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:59.284727 26509 tablet_copy_client.cc:806] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 0 data blocks...
I20260709 12:22:59.294528 26509 tablet_copy_client.cc:670] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 1 WAL segments...
I20260709 12:22:59.299371 26509 tablet_copy_client.cc:538] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:22:59.309856 26509 tablet_bootstrap.cc:492] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89: Bootstrap starting.
I20260709 12:22:59.317237 26514 tablet_copy_client.cc:806] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 0 data blocks...
I20260709 12:22:59.318271 26514 tablet_copy_client.cc:670] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 1 WAL segments...
I20260709 12:22:59.324534 26514 tablet_copy_client.cc:538] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:22:59.338220 26505 tablet_bootstrap.cc:492] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:59.339365 26505 tablet_bootstrap.cc:492] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89: Bootstrap complete.
I20260709 12:22:59.340198 26505 ts_tablet_manager.cc:1403] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89: Time spent bootstrapping tablet: real 0.094s	user 0.019s	sys 0.028s
I20260709 12:22:59.343504 26505 raft_consensus.cc:359] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:22:59.344406 26505 raft_consensus.cc:740] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Initialized, Role: LEARNER
I20260709 12:22:59.345032 26505 consensus_queue.cc:260] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:22:59.348376 26514 tablet_bootstrap.cc:492] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89: Bootstrap starting.
I20260709 12:22:59.365324 26505 ts_tablet_manager.cc:1434] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.010s
I20260709 12:22:59.367312 25847 tablet_copy_service.cc:342] P 5cccf20a8bff46dba6601f241d172b8a: Request end of tablet copy session a866ff967d964388a6f0dff7fd43df89-01372ae5f161477dab1b4c89fd847b3c received from {username='slave'} at 127.0.0.1:41782
I20260709 12:22:59.367816 25847 tablet_copy_service.cc:434] P 5cccf20a8bff46dba6601f241d172b8a: ending tablet copy session a866ff967d964388a6f0dff7fd43df89-01372ae5f161477dab1b4c89fd847b3c on tablet 01372ae5f161477dab1b4c89fd847b3c with peer a866ff967d964388a6f0dff7fd43df89
I20260709 12:22:59.374047 26509 tablet_bootstrap.cc:492] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:59.375008 26509 tablet_bootstrap.cc:492] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89: Bootstrap complete.
I20260709 12:22:59.375695 26509 ts_tablet_manager.cc:1403] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89: Time spent bootstrapping tablet: real 0.066s	user 0.035s	sys 0.004s
I20260709 12:22:59.378631 26509 raft_consensus.cc:359] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:22:59.379498 26509 raft_consensus.cc:740] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Initialized, Role: LEARNER
I20260709 12:22:59.380137 26509 consensus_queue.cc:260] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:22:59.387213 26509 ts_tablet_manager.cc:1434] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:22:59.389076 25696 tablet_copy_service.cc:342] P f82778701b464892aab92a752ed7ffdc: Request end of tablet copy session a866ff967d964388a6f0dff7fd43df89-f1625669bcc54589846d8a3d94c097d4 received from {username='slave'} at 127.0.0.1:51578
I20260709 12:22:59.389595 25696 tablet_copy_service.cc:434] P f82778701b464892aab92a752ed7ffdc: ending tablet copy session a866ff967d964388a6f0dff7fd43df89-f1625669bcc54589846d8a3d94c097d4 on tablet f1625669bcc54589846d8a3d94c097d4 with peer a866ff967d964388a6f0dff7fd43df89
I20260709 12:22:59.402581 26514 tablet_bootstrap.cc:492] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:59.403604 26514 tablet_bootstrap.cc:492] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89: Bootstrap complete.
I20260709 12:22:59.404448 26514 ts_tablet_manager.cc:1403] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89: Time spent bootstrapping tablet: real 0.056s	user 0.024s	sys 0.004s
I20260709 12:22:59.408911 26514 raft_consensus.cc:359] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:22:59.410806 26514 raft_consensus.cc:740] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Initialized, Role: LEARNER
I20260709 12:22:59.411499 26514 consensus_queue.cc:260] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:22:59.415382 26514 ts_tablet_manager.cc:1434] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:22:59.417191 25847 tablet_copy_service.cc:342] P 5cccf20a8bff46dba6601f241d172b8a: Request end of tablet copy session a866ff967d964388a6f0dff7fd43df89-a22f8565191e471dbe96772477b84e36 received from {username='slave'} at 127.0.0.1:41782
I20260709 12:22:59.417623 25847 tablet_copy_service.cc:434] P 5cccf20a8bff46dba6601f241d172b8a: ending tablet copy session a866ff967d964388a6f0dff7fd43df89-a22f8565191e471dbe96772477b84e36 on tablet a22f8565191e471dbe96772477b84e36 with peer a866ff967d964388a6f0dff7fd43df89
I20260709 12:22:59.538785 26514 ts_tablet_manager.cc:933] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89: Initiating tablet copy from peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:22:59.569291 26439 raft_consensus.cc:1217] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:22:59.588369 26514 tablet_copy_client.cc:323] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89: tablet copy: Beginning tablet copy session from remote peer at address 127.23.245.130:37267
I20260709 12:22:59.601378 25773 tablet_copy_service.cc:140] P 6e673265293d4e9a937dc45150aeb1b8: Received BeginTabletCopySession request for tablet f9ea7c5f4a6a4724bfcb0c6d88c32b1c from peer a866ff967d964388a6f0dff7fd43df89 ({username='slave'} at 127.0.0.1:48606)
I20260709 12:22:59.602027 25773 tablet_copy_service.cc:161] P 6e673265293d4e9a937dc45150aeb1b8: Beginning new tablet copy session on tablet f9ea7c5f4a6a4724bfcb0c6d88c32b1c from peer a866ff967d964388a6f0dff7fd43df89 at {username='slave'} at 127.0.0.1:48606: session id = a866ff967d964388a6f0dff7fd43df89-f9ea7c5f4a6a4724bfcb0c6d88c32b1c
I20260709 12:22:59.626451 25773 tablet_copy_source_session.cc:215] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:22:59.630327 26514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9ea7c5f4a6a4724bfcb0c6d88c32b1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:59.658380 26514 tablet_copy_client.cc:806] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 0 data blocks...
I20260709 12:22:59.659098 26514 tablet_copy_client.cc:670] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 1 WAL segments...
I20260709 12:22:59.663475 26514 tablet_copy_client.cc:538] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:22:59.676994 26514 tablet_bootstrap.cc:492] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89: Bootstrap starting.
W20260709 12:22:59.715116 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 61914.5us
I20260709 12:22:59.724422 26514 tablet_bootstrap.cc:492] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:22:59.725539 26514 tablet_bootstrap.cc:492] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89: Bootstrap complete.
I20260709 12:22:59.726311 26514 ts_tablet_manager.cc:1403] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89: Time spent bootstrapping tablet: real 0.050s	user 0.028s	sys 0.006s
I20260709 12:22:59.726573 26439 raft_consensus.cc:1217] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:22:59.729768 26514 raft_consensus.cc:359] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:22:59.730767 26514 raft_consensus.cc:740] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Initialized, Role: LEARNER
I20260709 12:22:59.731518 26514 consensus_queue.cc:260] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:22:59.734365 26514 ts_tablet_manager.cc:1434] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 12:22:59.736310 25773 tablet_copy_service.cc:342] P 6e673265293d4e9a937dc45150aeb1b8: Request end of tablet copy session a866ff967d964388a6f0dff7fd43df89-f9ea7c5f4a6a4724bfcb0c6d88c32b1c received from {username='slave'} at 127.0.0.1:48606
I20260709 12:22:59.736788 25773 tablet_copy_service.cc:434] P 6e673265293d4e9a937dc45150aeb1b8: ending tablet copy session a866ff967d964388a6f0dff7fd43df89-f9ea7c5f4a6a4724bfcb0c6d88c32b1c on tablet f9ea7c5f4a6a4724bfcb0c6d88c32b1c with peer a866ff967d964388a6f0dff7fd43df89
I20260709 12:22:59.749389 26439 raft_consensus.cc:1217] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:22:59.966239 26209 raft_consensus.cc:1064] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a: attempting to promote NON_VOTER a866ff967d964388a6f0dff7fd43df89 to VOTER
I20260709 12:22:59.968693 26209 consensus_queue.cc:237] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:22:59.993683 25756 raft_consensus.cc:1275] T 01372ae5f161477dab1b4c89fd847b3c P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:59.996876 26439 raft_consensus.cc:1275] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:22:59.998426 25678 raft_consensus.cc:1275] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:00.011829 26477 consensus_queue.cc:1048] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:00.020983 26477 consensus_queue.cc:1048] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:00.031327 26475 consensus_queue.cc:1048] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:00.074436 26438 raft_consensus.cc:1217] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:00.134850 26477 raft_consensus.cc:1064] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a: attempting to promote NON_VOTER a866ff967d964388a6f0dff7fd43df89 to VOTER
I20260709 12:23:00.137501 26477 consensus_queue.cc:237] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:00.151002 26438 raft_consensus.cc:1275] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:00.151994 25755 raft_consensus.cc:1275] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:00.153860 26475 consensus_queue.cc:1048] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:00.155711 26475 consensus_queue.cc:1048] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:00.157866 26501 raft_consensus.cc:1064] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc: attempting to promote NON_VOTER a866ff967d964388a6f0dff7fd43df89 to VOTER
I20260709 12:23:00.160599 26501 consensus_queue.cc:237] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:00.180840 26209 raft_consensus.cc:2955] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:00.186820 26439 raft_consensus.cc:2955] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:00.204668 25756 raft_consensus.cc:2955] T 01372ae5f161477dab1b4c89fd847b3c P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:00.209438 26437 raft_consensus.cc:1275] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:00.221946 25837 raft_consensus.cc:1275] T f1625669bcc54589846d8a3d94c097d4 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:00.224509 26502 consensus_queue.cc:1048] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:00.225584 25583 catalog_manager.cc:5697] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:00.233156 26524 consensus_queue.cc:1048] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:00.242585 25683 raft_consensus.cc:1275] T a22f8565191e471dbe96772477b84e36 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:00.250823 26524 raft_consensus.cc:2955] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:00.262157 26437 raft_consensus.cc:2955] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:00.284384 25584 catalog_manager.cc:5697] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:00.305694 25837 raft_consensus.cc:2955] T f1625669bcc54589846d8a3d94c097d4 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:00.336243 26475 raft_consensus.cc:2955] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:00.346886 25755 raft_consensus.cc:2955] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
W20260709 12:23:00.436980 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 81234.6us
I20260709 12:23:00.468297 26307 consensus_queue.cc:1048] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:00.349833 25756 raft_consensus.cc:1275] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:23:00.529290 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 68216.5us
I20260709 12:23:00.532542 26439 raft_consensus.cc:2955] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:00.602718 26503 raft_consensus.cc:1064] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8: attempting to promote NON_VOTER a866ff967d964388a6f0dff7fd43df89 to VOTER
I20260709 12:23:00.627071 26503 consensus_queue.cc:237] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:00.644218 25580 catalog_manager.cc:5697] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:00.674755 26439 raft_consensus.cc:1275] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:00.676688 26500 consensus_queue.cc:1048] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:23:00.694833 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 151260us
I20260709 12:23:00.697808 26498 consensus_queue.cc:1048] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:00.707028 25678 raft_consensus.cc:2955] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:00.748543 25837 consensus_queue.cc:237] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:00.754698 25831 consensus_queue.cc:237] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:00.758550 25683 raft_consensus.cc:2955] T a22f8565191e471dbe96772477b84e36 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:00.768060 26439 raft_consensus.cc:1275] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:00.772080 26307 consensus_queue.cc:1048] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:00.786528 25684 raft_consensus.cc:1275] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:00.801935 26549 consensus_queue.cc:1048] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:00.813428 25828 raft_consensus.cc:1275] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:00.816068 25756 raft_consensus.cc:2955] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
W20260709 12:23:00.823159 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 51504.6us
I20260709 12:23:00.831578 26438 raft_consensus.cc:1275] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:00.835697 26546 consensus_queue.cc:1048] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:00.842644 25757 raft_consensus.cc:1275] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:00.844861 26561 raft_consensus.cc:2955] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:00.863896 26549 consensus_queue.cc:1048] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:00.873971 25684 raft_consensus.cc:1275] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:00.870669 26439 raft_consensus.cc:2955] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
W20260709 12:23:00.899379 25801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:00.946099 26477 consensus_queue.cc:1048] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:00.948782 26546 consensus_queue.cc:1048] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:00.966879 26546 raft_consensus.cc:2955] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:00.980450 25581 catalog_manager.cc:5697] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: config changed from index 3 to 4, VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129) evicted. New cstate: current_term: 1 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:00.997893 26439 raft_consensus.cc:2955] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:01.005983 26503 raft_consensus.cc:2955] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:01.014166 25675 tablet_service.cc:1558] Processing DeleteTablet for tablet a22f8565191e471dbe96772477b84e36 with delete_type TABLET_DATA_TOMBSTONED (TS f82778701b464892aab92a752ed7ffdc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40214
I20260709 12:23:01.006978 25757 raft_consensus.cc:2955] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:01.028450 25569 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a22f8565191e471dbe96772477b84e36 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:01.028059 25678 raft_consensus.cc:2955] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:01.030720 26438 raft_consensus.cc:2955] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:01.047034 26564 tablet_replica.cc:333] T a22f8565191e471dbe96772477b84e36 P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
I20260709 12:23:01.055568 25581 catalog_manager.cc:5697] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 reported cstate change: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:01.056324 25684 raft_consensus.cc:2955] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:01.094744 25837 raft_consensus.cc:2955] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:01.099895 25582 catalog_manager.cc:5697] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 reported cstate change: config changed from index 3 to 4, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New cstate: current_term: 1 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:01.137779 25753 tablet_service.cc:1558] Processing DeleteTablet for tablet 01372ae5f161477dab1b4c89fd847b3c with delete_type TABLET_DATA_TOMBSTONED (TS 6e673265293d4e9a937dc45150aeb1b8 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53452
I20260709 12:23:01.139477 25761 consensus_queue.cc:237] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:01.145056 26565 tablet_replica.cc:333] T 01372ae5f161477dab1b4c89fd847b3c P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
I20260709 12:23:01.147044 26565 raft_consensus.cc:2243] T 01372ae5f161477dab1b4c89fd847b3c P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:01.147219 26439 raft_consensus.cc:1275] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:01.147845 26565 raft_consensus.cc:2272] T 01372ae5f161477dab1b4c89fd847b3c P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:01.148710 26549 consensus_queue.cc:1048] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:01.151595 25678 raft_consensus.cc:1275] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:01.153930 26549 consensus_queue.cc:1048] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:01.159297 25569 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 01372ae5f161477dab1b4c89fd847b3c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:01.161052 26564 raft_consensus.cc:2243] T a22f8565191e471dbe96772477b84e36 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:01.161837 26564 raft_consensus.cc:2272] T a22f8565191e471dbe96772477b84e36 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:01.160282 26552 raft_consensus.cc:2955] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:01.178941 26439 raft_consensus.cc:2955] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:01.216248 26564 ts_tablet_manager.cc:1916] T a22f8565191e471dbe96772477b84e36 P f82778701b464892aab92a752ed7ffdc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:01.227100 25568 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f9ea7c5f4a6a4724bfcb0c6d88c32b1c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:01.229293 26565 ts_tablet_manager.cc:1916] T 01372ae5f161477dab1b4c89fd847b3c P 6e673265293d4e9a937dc45150aeb1b8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:01.239497 25582 catalog_manager.cc:5697] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: config changed from index 3 to 4, VOTER 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) evicted. New cstate: current_term: 1 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:01.253911 25824 tablet_service.cc:1558] Processing DeleteTablet for tablet f9ea7c5f4a6a4724bfcb0c6d88c32b1c with delete_type TABLET_DATA_TOMBSTONED (TS 5cccf20a8bff46dba6601f241d172b8a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44194
I20260709 12:23:01.278124 26565 ts_tablet_manager.cc:1929] T 01372ae5f161477dab1b4c89fd847b3c P 6e673265293d4e9a937dc45150aeb1b8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:01.279645 26565 log.cc:1199] T 01372ae5f161477dab1b4c89fd847b3c P 6e673265293d4e9a937dc45150aeb1b8: Deleting WAL directory at /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-1-root/wals/01372ae5f161477dab1b4c89fd847b3c
I20260709 12:23:01.289814 26564 ts_tablet_manager.cc:1929] T a22f8565191e471dbe96772477b84e36 P f82778701b464892aab92a752ed7ffdc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:01.290150 26566 tablet_replica.cc:333] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
I20260709 12:23:01.290434 26564 log.cc:1199] T a22f8565191e471dbe96772477b84e36 P f82778701b464892aab92a752ed7ffdc: Deleting WAL directory at /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-0-root/wals/a22f8565191e471dbe96772477b84e36
I20260709 12:23:01.292126 25568 catalog_manager.cc:5028] TS 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): tablet 01372ae5f161477dab1b4c89fd847b3c (table test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]) successfully deleted
I20260709 12:23:01.293073 26566 raft_consensus.cc:2243] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:01.293951 26566 raft_consensus.cc:2272] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:01.295778 25683 raft_consensus.cc:2955] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:01.300997 26566 ts_tablet_manager.cc:1916] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 5cccf20a8bff46dba6601f241d172b8a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:01.316259 25569 catalog_manager.cc:5028] TS f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): tablet a22f8565191e471dbe96772477b84e36 (table test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]) successfully deleted
I20260709 12:23:01.333316 25683 consensus_queue.cc:237] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:01.346907 26566 ts_tablet_manager.cc:1929] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 5cccf20a8bff46dba6601f241d172b8a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:01.347388 26566 log.cc:1199] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 5cccf20a8bff46dba6601f241d172b8a: Deleting WAL directory at /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-2-root/wals/f9ea7c5f4a6a4724bfcb0c6d88c32b1c
I20260709 12:23:01.349112 25569 catalog_manager.cc:5028] TS 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): tablet f9ea7c5f4a6a4724bfcb0c6d88c32b1c (table test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]) successfully deleted
I20260709 12:23:01.354559 25756 raft_consensus.cc:1275] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:01.355887 26439 raft_consensus.cc:1275] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:01.357712 26543 consensus_queue.cc:1048] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:01.359699 26524 consensus_queue.cc:1048] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:01.368733 25761 raft_consensus.cc:2955] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:01.367388 26524 raft_consensus.cc:2955] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:01.384974 26439 raft_consensus.cc:2955] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:01.391433 25581 catalog_manager.cc:5697] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: config changed from index 3 to 4, VOTER 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) evicted. New cstate: current_term: 1 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:01.413715 25824 tablet_service.cc:1558] Processing DeleteTablet for tablet f1625669bcc54589846d8a3d94c097d4 with delete_type TABLET_DATA_TOMBSTONED (TS 5cccf20a8bff46dba6601f241d172b8a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44194
I20260709 12:23:01.415292 26566 tablet_replica.cc:333] T f1625669bcc54589846d8a3d94c097d4 P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
I20260709 12:23:01.416400 26566 raft_consensus.cc:2243] T f1625669bcc54589846d8a3d94c097d4 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:01.416999 26566 raft_consensus.cc:2272] T f1625669bcc54589846d8a3d94c097d4 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:01.419644 25569 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f1625669bcc54589846d8a3d94c097d4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:01.420785 26566 ts_tablet_manager.cc:1916] T f1625669bcc54589846d8a3d94c097d4 P 5cccf20a8bff46dba6601f241d172b8a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:01.447696 26566 ts_tablet_manager.cc:1929] T f1625669bcc54589846d8a3d94c097d4 P 5cccf20a8bff46dba6601f241d172b8a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:01.448177 26566 log.cc:1199] T f1625669bcc54589846d8a3d94c097d4 P 5cccf20a8bff46dba6601f241d172b8a: Deleting WAL directory at /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-2-root/wals/f1625669bcc54589846d8a3d94c097d4
I20260709 12:23:01.449628 25569 catalog_manager.cc:5028] TS 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): tablet f1625669bcc54589846d8a3d94c097d4 (table test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]) successfully deleted
I20260709 12:23:03.376755 26580 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:03.377451 26580 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:03.380518 26580 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:03.409071 26580 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:03.409745 26580 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:03.411736 26580 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:03.413919 26577 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:03.414408 26577 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:03.403554 26592 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:03.416329 26577 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:03.416826 26577 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:03.417237 26577 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:03.419018 26577 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:03.416358 26576 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:03.420116 26576 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:03.421996 26576 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:03.416435 26592 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:03.420131 26582 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:03.423113 26582 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:03.424156 26576 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:03.424458 26592 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:03.424760 26576 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:03.425148 26582 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:03.426648 26576 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:03.432483 26585 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:03.433023 26585 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:03.435242 26585 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:03.446369 26579 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:03.447058 26579 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:03.449277 26579 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:03.449949 26582 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:03.450491 26582 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:03.452706 26582 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:03.456604 26592 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
W20260709 12:23:03.457352 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 328441us
I20260709 12:23:03.459771 26592 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:03.461526 26576 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:03.462047 26576 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:03.462684 26592 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:03.463965 26580 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:03.469393 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:03.471524 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:03.472500 26576 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:03.474786 26592 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:03.475153 26583 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:03.475448 26592 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:03.468065 26577 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:03.477240 26577 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:03.478147 26592 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:03.475669 26583 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:03.479404 26577 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:03.464504 26580 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:03.481482 26583 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:03.468866 26582 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:03.482367 26582 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:03.486078 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:03.496275 26578 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:03.496764 26584 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:03.496896 26578 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:03.497332 26584 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:03.497839 26589 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:03.498402 26589 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:03.499229 26581 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:03.495749 26580 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:03.554199 26589 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:03.551502 26578 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:03.557747 26591 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:03.558701 26572 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:03.500265 26579 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:03.569729 26582 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:03.566877 26572 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:03.574945 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:03.575156 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:03.576166 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:03.576398 26572 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:03.576745 25681 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 1.
I20260709 12:23:03.573611 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:03.579664 25756 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 1.
I20260709 12:23:03.562774 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:03.566656 26591 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:03.556497 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:03.576959 26592 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:03.652422 26590 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:03.662588 26593 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:03.558521 26556 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:03.815899 26593 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:03.816664 26556 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:03.582216 26583 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:03.821133 26583 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:03.825387 26597 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:03.802292 26572 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:03.805025 26600 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:03.828486 26572 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:03.828661 26600 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:03.829743 26602 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:03.830611 26572 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:03.831517 26600 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:03.797307 26595 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:03.832202 26600 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:03.832465 26595 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:03.832926 26600 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:03.834775 26595 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:03.838030 26595 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:03.838693 26595 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:03.572149 26579 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:03.577275 26580 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:03.853763 26580 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:03.554585 26581 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:03.857488 26581 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:03.568480 26576 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:03.810621 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:03.809940 26598 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:03.858250 26576 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:03.858516 26598 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:03.815599 26590 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:03.860347 26576 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:03.860545 26611 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:03.860858 26576 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:03.861075 26598 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:03.861384 26576 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:03.861760 26590 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:03.628870 26577 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:03.862797 26577 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:03.863351 26576 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:03.649436 26582 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:03.864028 26582 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:03.865200 26577 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:03.866482 26582 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:03.824396 26556 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:03.674582 26584 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:03.812861 25685 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 1.
I20260709 12:23:03.827337 26583 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:23:03.650206 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 68370.9us
I20260709 12:23:03.855736 26580 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:03.830287 26602 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:03.810837 26596 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:03.835434 26600 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:03.813813 26592 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:03.836323 26597 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:03.836833 26594 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:03.880128 25756 consensus_queue.cc:237] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:03.836916 26606 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:03.612406 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:03.577847 26574 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:03.840585 26599 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:03.841905 26607 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:03.843739 26593 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:03.845618 26603 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:03.853786 26610 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:03.893843 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:03.846849 26604 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:03.848035 26605 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:03.861104 26611 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:03.822706 26591 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:03.852334 26572 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:03.877054 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:03.873041 26577 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:03.902884 26577 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } }
I20260709 12:23:03.887811 26574 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:03.846302 26608 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:03.877202 26580 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:03.895350 26599 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:03.917083 26595 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:03.892979 26582 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:03.884428 26596 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:03.907691 26610 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:03.906674 26572 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:03.891256 26607 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:03.905553 26603 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:03.887841 26594 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:03.923290 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:04.134269 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:23:04.132572 25708 debug-util.cc:398] Leaking SignalData structure 0x7b0800212aa0 after lost signal to thread 24537
W20260709 12:23:04.147470 25708 debug-util.cc:398] Leaking SignalData structure 0x7b0800217360 after lost signal to thread 25618
W20260709 12:23:04.148490 25708 debug-util.cc:398] Leaking SignalData structure 0x7b0800085ea0 after lost signal to thread 25711
I20260709 12:23:03.892386 26606 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:03.895298 26605 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:23:04.154289 25708 debug-util.cc:398] Leaking SignalData structure 0x7b08000d5160 after lost signal to thread 25787
W20260709 12:23:04.156349 25708 debug-util.cc:398] Leaking SignalData structure 0x7b08002ffe60 after lost signal to thread 25861
I20260709 12:23:03.918015 26580 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:23:04.157783 25708 debug-util.cc:398] Leaking SignalData structure 0x7b08000b0300 after lost signal to thread 26463
I20260709 12:23:04.066200 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:04.164881 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:04.166265 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:04.149740 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:04.153265 26579 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:04.068630 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:04.173219 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:03.921511 26608 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:04.247767 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:04.163836 26599 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:23:04.261312 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 389380us
I20260709 12:23:04.263795 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:04.264148 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:04.265331 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:04.265516 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:04.266248 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:04.266914 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:04.267241 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:04.171533 26612 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:04.268043 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:04.268756 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:03.925371 26582 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:04.174182 26592 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:04.270396 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:04.176640 26579 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:04.286280 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:04.288587 25801 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:03.915787 26604 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:04.302901 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:23:04.304862 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:04.285897 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:04.288228 26612 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:04.315737 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:04.292155 26597 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:23:04.320015 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:04.291353 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:04.291268 26613 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:04.314630 25800 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.320304 26603 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:04.290551 26579 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:04.329840 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:04.335461 25763 raft_consensus.cc:2468] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 1.
I20260709 12:23:04.324574 26599 raft_consensus.cc:2804] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:04.309352 26614 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:04.332190 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:04.333681 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:04.330952 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:04.318831 26574 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:04.330638 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:04.316187 26592 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:04.343374 26594 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:04.342327 25800 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
W20260709 12:23:04.351609 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 47963.8us
I20260709 12:23:04.340193 26599 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:04.344221 26572 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:04.381651 26618 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:04.395687 26604 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:04.381742 25801 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.349373 26577 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349)
I20260709 12:23:04.356374 26580 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:04.384846 26602 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:04.334287 26613 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:04.389073 26608 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:04.348963 26584 raft_consensus.cc:2749] T 8d74d1c9c8a84919a6f57b0b6721de51 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.392010 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:04.339465 26603 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:04.350204 26610 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:04.350747 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:04.350358 26592 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:04.397552 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:04.356616 26583 raft_consensus.cc:2804] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:04.406013 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:04.394835 26599 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:04.399582 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 63029us
I20260709 12:23:04.343977 26614 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:04.406085 26583 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:04.406831 26603 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:04.411648 26583 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:04.404752 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:04.395862 26618 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:04.413832 26603 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:04.416837 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:04.403434 26607 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:04.421060 25801 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:04.414084 26618 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:04.422771 26608 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:04.426056 26592 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:04.425769 26608 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:04.427124 26614 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:04.428395 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:04.428700 26611 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:04.429383 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:04.429598 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:04.430202 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:04.430410 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:04.430667 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:04.424746 26627 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:04.422791 26612 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:04.425079 26596 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:04.431595 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:04.431870 26596 raft_consensus.cc:2804] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:04.432032 25801 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.424316 26613 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:04.432788 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:04.432969 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:04.433698 26601 raft_consensus.cc:2749] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.430735 26579 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:04.432260 26596 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:04.434641 26596 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:04.435179 26608 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:04.436777 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:04.407156 26582 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:04.415512 26617 raft_consensus.cc:2749] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.431442 26627 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:04.438205 26609 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:04.441344 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:04.443209 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:04.444228 26596 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:04.444406 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:04.445235 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:04.445413 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:04.462590 25836 raft_consensus.cc:2468] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 1.
I20260709 12:23:04.445973 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:04.446090 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:04.463539 25831 raft_consensus.cc:2468] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 1.
I20260709 12:23:04.448797 26606 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:04.450443 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:04.462082 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:04.472507 25833 raft_consensus.cc:2468] T 06bd2840931844279521c7e8eb8750bf P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 1.
I20260709 12:23:04.473529 25834 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 1.
I20260709 12:23:04.473714 26605 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:04.473913 25831 raft_consensus.cc:1240] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:04.474892 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:04.475108 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:04.475522 26596 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:04.476984 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:04.459237 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:04.480062 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:04.480219 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:04.481323 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:04.481498 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:23:04.482829 25726 consensus_peers.cc:597] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Couldn't send request to peer a866ff967d964388a6f0dff7fd43df89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2d9ca842256c405c98d29454943e5d01. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:04.485214 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:04.486231 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:04.460285 26609 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:04.487576 25828 raft_consensus.cc:2468] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 1.
I20260709 12:23:04.460525 26627 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:04.468467 26617 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:04.490253 26609 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:04.490495 26617 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:04.479624 26599 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:04.494263 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:04.493765 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:04.484131 26611 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:04.498196 26617 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:04.498621 25832 raft_consensus.cc:2393] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 2: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:23:04.500335 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:04.501850 25834 raft_consensus.cc:1240] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:04.499456 26611 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:04.504051 26611 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:04.504781 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:04.505420 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:04.506556 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:04.507092 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:04.500052 26599 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:04.508121 25836 raft_consensus.cc:1275] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:04.496814 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 47212us
I20260709 12:23:04.512480 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:04.513638 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:04.515965 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:04.517987 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:04.518561 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:04.521096 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:04.525794 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:04.525466 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:04.526036 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:04.526093 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:23:04.529407 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 64631.4us
I20260709 12:23:04.519290 26583 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:04.533444 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:04.533917 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:04.535528 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:04.536249 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:04.537674 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:04.537719 26583 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:04.537973 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:04.539327 25649 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:04.543097 25650 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:04.543876 26572 raft_consensus.cc:2804] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:04.546911 26572 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:04.547340 26572 raft_consensus.cc:3060] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:04.549532 26631 raft_consensus.cc:2804] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:04.549979 26631 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:04.550325 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:04.551158 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:04.550760 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:04.553380 26402 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:04.548640 25650 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:04.549979 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:04.555617 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:04.555964 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:04.557443 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:04.559041 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:04.559233 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:04.560629 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:04.560974 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:04.550379 26631 raft_consensus.cc:3060] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:04.556995 25726 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.567622 25726 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.568012 26621 raft_consensus.cc:2749] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.568943 25650 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:04.569655 25650 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:04.571403 26556 raft_consensus.cc:2804] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:04.573078 26630 raft_consensus.cc:2804] T 5f0353e850934c9db0a248807127ca4c P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:04.572754 25650 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:04.573873 26630 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:04.571272 26579 raft_consensus.cc:2749] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.574294 26630 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:04.572652 25726 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.575997 25650 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:04.576193 25726 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.576635 26556 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:04.578063 25726 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.578019 25650 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:04.580848 26581 raft_consensus.cc:2749] T 25bd5658646b41608d707d196c6e0585 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.573125 26629 raft_consensus.cc:2804] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:04.574553 26591 raft_consensus.cc:2749] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.572692 26613 consensus_queue.cc:1059] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:23:04.583595 26629 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:04.584052 26629 raft_consensus.cc:3060] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:04.584235 26605 raft_consensus.cc:3055] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:04.580462 26579 raft_consensus.cc:2749] T 4e8d1d3d43ad47308fae5ed98608feb8 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.585325 25726 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.583032 26619 raft_consensus.cc:2749] T 43b78aa0054b4da398a8fc04d12454a7 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.581923 25649 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:04.582847 25650 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:04.588941 26603 raft_consensus.cc:2749] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.584642 26605 raft_consensus.cc:740] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:04.589884 26605 consensus_queue.cc:260] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:04.581287 26556 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:04.587343 26590 raft_consensus.cc:2804] T 870002623db3456699b2b970d066f356 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:04.596879 26590 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:04.597293 26590 raft_consensus.cc:3060] T 870002623db3456699b2b970d066f356 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:04.597186 26621 consensus_queue.cc:1059] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:04.584882 26607 raft_consensus.cc:2749] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.597677 26603 consensus_queue.cc:1048] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:23:04.597852 26591 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:04.605033 26632 raft_consensus.cc:2749] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.606525 26623 raft_consensus.cc:2749] T b679f7cf7f1e468582715c3427ced820 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:04.598188 26631 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:04.609921 26556 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:04.610252 26631 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:04.611990 26556 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:04.612983 26572 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:04.614820 26572 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:04.615568 26605 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:04.600431 26629 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:04.608508 26619 raft_consensus.cc:3055] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:04.620210 26619 raft_consensus.cc:740] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:04.620321 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:04.623271 26619 consensus_queue.cc:260] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:04.625504 26619 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:04.629508 26591 raft_consensus.cc:2749] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.630352 26630 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:04.635299 26629 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:04.636746 26630 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:23:04.640826 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 58946.3us
I20260709 12:23:04.643208 26590 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:04.646615 25801 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.647127 25726 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.648253 26607 raft_consensus.cc:2749] T 3d79b16002fc460a9e70bd0a5bcec639 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.648404 25726 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.649746 26621 raft_consensus.cc:2749] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.649247 26607 raft_consensus.cc:2955] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:04.652190 25726 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.652920 25801 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.653347 25726 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.654093 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:04.663522 25801 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.665663 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:04.666272 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:04.666741 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:04.668098 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:04.669904 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:04.670445 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:04.670578 25801 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.671353 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:04.672029 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:04.679358 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:04.673599 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:04.683490 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:04.674247 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:04.684296 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:04.671764 25801 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.685665 25801 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.686566 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:04.702140 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:04.711752 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:04.689499 25801 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.713332 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:04.687691 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:04.667749 26582 raft_consensus.cc:2749] T 04fe73edd8db49c08ea7a6adb6e443e6 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.714068 25801 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.667660 26613 raft_consensus.cc:2749] T 819272169f6f4293b6e279793be58b49 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.667583 26603 raft_consensus.cc:2749] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.687456 26627 raft_consensus.cc:2749] T b12e2b074f1b4518bcfc6728abeca136 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.720199 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:04.720825 26599 raft_consensus.cc:2749] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.680023 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:04.721257 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:04.722278 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:04.672029 26583 raft_consensus.cc:2749] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.679659 26590 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:04.726663 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:04.675238 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:04.727820 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:04.672020 26596 raft_consensus.cc:2749] T 05232536e53b419682a5f24515843652 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.719561 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:04.676126 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:04.674018 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:04.690557 26609 raft_consensus.cc:2749] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.677184 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:04.674738 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:04.715423 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:04.675038 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:04.719061 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:04.739892 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:04.740994 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:04.742307 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:04.742388 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:04.745862 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:04.746076 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:04.747270 25683 raft_consensus.cc:1275] T 2d9ca842256c405c98d29454943e5d01 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:04.747494 25726 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.747617 25686 raft_consensus.cc:1240] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:04.748142 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:04.748395 25829 raft_consensus.cc:1240] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:04.748792 26603 raft_consensus.cc:2749] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.741089 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:04.750547 25726 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.751844 26613 raft_consensus.cc:2749] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.757038 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:04.759050 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:04.669232 25830 raft_consensus.cc:2955] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:04.766219 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:04.672055 26617 raft_consensus.cc:2749] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:04.763597 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:04.760128 25726 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.767619 25682 raft_consensus.cc:1240] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:04.767619 26623 consensus_queue.cc:1059] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:04.762457 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:04.786259 26623 raft_consensus.cc:3055] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:04.769832 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:04.786685 26623 raft_consensus.cc:740] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:04.787621 26623 consensus_queue.cc:260] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:04.789112 26623 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:04.790374 25726 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.791823 25726 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.792097 26603 raft_consensus.cc:2749] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:04.792768 26613 raft_consensus.cc:2749] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.792953 26603 raft_consensus.cc:2749] T 63f47864b8d248a792567d96c5e453b8 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:04.786826 25581 catalog_manager.cc:5697] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New cstate: current_term: 1 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:04.794289 25726 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.795555 25726 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.771526 26609 raft_consensus.cc:2749] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:04.778494 25649 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:04.811554 26590 raft_consensus.cc:2749] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.812009 25649 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:04.812813 26556 raft_consensus.cc:2749] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.813256 25649 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:04.814353 26590 raft_consensus.cc:2749] T 5f0353e850934c9db0a248807127ca4c P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.814872 25649 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:04.815997 26590 raft_consensus.cc:2749] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.818032 25649 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:04.820425 25649 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:23:04.770051 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 56035.2us
I20260709 12:23:04.822475 25801 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.822853 26634 raft_consensus.cc:2749] T 870002623db3456699b2b970d066f356 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.824546 26582 raft_consensus.cc:2749] T c38d3f292da44b3dbb2e512cd53e21da P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:04.824764 25801 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.825959 26609 raft_consensus.cc:2749] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.796208 26603 raft_consensus.cc:2749] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.827098 25801 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.821077 26629 raft_consensus.cc:2749] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.827809 25726 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.828106 26609 raft_consensus.cc:2749] T 0c043718ee3a40fea4b2b1453fcb259b P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.828655 26603 raft_consensus.cc:2749] T 4734c282e09b4bbbb96de8eee61c160a P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.829299 25801 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.830042 26609 raft_consensus.cc:2749] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.832248 25801 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.832974 26609 raft_consensus.cc:2749] T 0a6b77683d6547db82cd02da9d9c938a P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.834379 25801 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.835851 26609 raft_consensus.cc:2749] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.837131 25801 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.838511 25726 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.839166 26603 raft_consensus.cc:2749] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.843389 25680 raft_consensus.cc:1240] T 870002623db3456699b2b970d066f356 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:04.844099 26609 raft_consensus.cc:2749] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.845077 25801 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.846159 26609 raft_consensus.cc:2749] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.846647 26603 raft_consensus.cc:2749] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.847271 25801 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.847613 25726 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.853595 26609 raft_consensus.cc:2749] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.855391 26603 raft_consensus.cc:2749] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.855464 25801 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.856750 25726 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.856812 26609 raft_consensus.cc:2749] T 06bd2840931844279521c7e8eb8750bf P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.858210 25801 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.860970 26603 raft_consensus.cc:2749] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.861403 26609 raft_consensus.cc:2749] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.862974 25801 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.863761 26609 raft_consensus.cc:2749] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.865029 25801 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.865842 26609 raft_consensus.cc:2749] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.865770 25680 consensus_queue.cc:237] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:04.867300 25801 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.868502 25726 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.872352 26603 raft_consensus.cc:2749] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:04.873929 26609 raft_consensus.cc:2749] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.873998 25726 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.875145 26603 raft_consensus.cc:2749] T ca1c66d4736542ecb25b33fab43ae780 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.875340 25801 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.876149 26609 raft_consensus.cc:2749] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.877375 25801 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.879321 25726 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.880084 26603 raft_consensus.cc:2749] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.881155 25726 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.881866 26603 raft_consensus.cc:2749] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.881799 26609 raft_consensus.cc:2749] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.885277 25801 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.886109 26596 raft_consensus.cc:2749] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.890580 25726 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.897294 25726 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.897646 26607 consensus_queue.cc:1048] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:04.898689 25726 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.898378 26613 raft_consensus.cc:2749] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.900317 26613 raft_consensus.cc:2749] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.897006 26603 raft_consensus.cc:2749] T 90d850895b8a4a40a4fba5caf2048ca2 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.900664 25801 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.905490 25801 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.904314 26603 consensus_queue.cc:1059] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:23:04.908900 25801 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.909605 26617 raft_consensus.cc:2749] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.904143 26596 raft_consensus.cc:2749] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.911871 25683 raft_consensus.cc:1240] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:04.913033 26599 raft_consensus.cc:2749] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.915302 25837 raft_consensus.cc:1275] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:04.917681 25801 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:04.919185 26621 consensus_queue.cc:1059] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:23:04.921901 25650 consensus_peers.cc:597] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc -> Peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Couldn't send request to peer a866ff967d964388a6f0dff7fd43df89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 819272169f6f4293b6e279793be58b49. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:04.919699 26579 raft_consensus.cc:3055] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:04.920989 26627 raft_consensus.cc:2749] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:04.921030 25762 raft_consensus.cc:1275] T 819272169f6f4293b6e279793be58b49 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:04.926790 26579 raft_consensus.cc:740] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:04.920531 26599 consensus_queue.cc:1059] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:23:04.929723 25685 raft_consensus.cc:2955] T 2d9ca842256c405c98d29454943e5d01 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:04.927848 26623 consensus_queue.cc:1048] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:23:04.943219 25682 raft_consensus.cc:1240] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:04.941491 26634 consensus_queue.cc:1048] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:23:04.933491 26579 consensus_queue.cc:260] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:04.951010 26592 raft_consensus.cc:3055] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:04.953016 26592 raft_consensus.cc:740] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:04.953608 26583 raft_consensus.cc:3055] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:04.949021 26613 consensus_queue.cc:1059] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:23:04.957731 26583 raft_consensus.cc:740] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:04.958392 26613 raft_consensus.cc:3055] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:04.958748 26613 raft_consensus.cc:740] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:04.958635 26583 consensus_queue.cc:260] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:04.959800 26613 consensus_queue.cc:260] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:04.960507 26583 raft_consensus.cc:3060] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:04.961033 26613 raft_consensus.cc:3060] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:04.965672 26592 consensus_queue.cc:260] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:04.967566 26592 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:04.972729 26579 raft_consensus.cc:3060] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:04.996942 25680 raft_consensus.cc:1240] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:04.998667 26579 consensus_queue.cc:1059] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:04.999594 26629 raft_consensus.cc:2955] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:05.001204 25830 raft_consensus.cc:2955] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:05.003316 26579 raft_consensus.cc:3055] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:05.003715 26579 raft_consensus.cc:740] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:05.005198 26579 consensus_queue.cc:260] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:05.009763 26579 raft_consensus.cc:3060] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:05.013942 25680 raft_consensus.cc:1240] T 5f0353e850934c9db0a248807127ca4c P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:05.013163 25756 raft_consensus.cc:2955] T 819272169f6f4293b6e279793be58b49 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:05.015707 26607 consensus_queue.cc:1059] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:05.016706 26607 raft_consensus.cc:3055] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:05.017035 26607 raft_consensus.cc:740] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:05.017819 26607 consensus_queue.cc:260] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:05.019066 26607 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:05.029158 25680 consensus_queue.cc:237] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:05.040113 25582 catalog_manager.cc:5697] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc reported cstate change: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New cstate: current_term: 1 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:05.092108 25830 raft_consensus.cc:1275] T 7954a5254e674b77843c0d32002d2e90 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:05.093875 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 48572.6us
W20260709 12:23:05.095237 25650 consensus_peers.cc:597] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc -> Peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Couldn't send request to peer a866ff967d964388a6f0dff7fd43df89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7954a5254e674b77843c0d32002d2e90. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:05.098649 26623 consensus_queue.cc:1048] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:05.115818 26646 ts_tablet_manager.cc:933] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89: Initiating tablet copy from peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:05.118373 26646 tablet_copy_client.cc:323] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Beginning tablet copy session from remote peer at address 127.23.245.130:37267
I20260709 12:23:05.120136 25773 tablet_copy_service.cc:140] P 6e673265293d4e9a937dc45150aeb1b8: Received BeginTabletCopySession request for tablet 2d9ca842256c405c98d29454943e5d01 from peer a866ff967d964388a6f0dff7fd43df89 ({username='slave'} at 127.0.0.1:48606)
I20260709 12:23:05.119639 26634 raft_consensus.cc:2955] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:05.120734 25773 tablet_copy_service.cc:161] P 6e673265293d4e9a937dc45150aeb1b8: Beginning new tablet copy session on tablet 2d9ca842256c405c98d29454943e5d01 from peer a866ff967d964388a6f0dff7fd43df89 at {username='slave'} at 127.0.0.1:48606: session id = a866ff967d964388a6f0dff7fd43df89-2d9ca842256c405c98d29454943e5d01
I20260709 12:23:05.126379 25830 raft_consensus.cc:2955] T 7954a5254e674b77843c0d32002d2e90 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:05.128746 25773 tablet_copy_source_session.cc:215] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:05.132334 26646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d9ca842256c405c98d29454943e5d01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.148813 26646 tablet_copy_client.cc:806] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:05.149433 26646 tablet_copy_client.cc:670] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:05.193178 25581 catalog_manager.cc:5697] T 7954a5254e674b77843c0d32002d2e90 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New cstate: current_term: 1 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:05.231593 26646 tablet_copy_client.cc:538] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:05.235622 25756 raft_consensus.cc:1275] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:05.239763 25830 consensus_queue.cc:237] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:05.257128 26646 tablet_bootstrap.cc:492] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89: Bootstrap starting.
I20260709 12:23:05.259311 26634 consensus_queue.cc:1048] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:05.303637 25754 raft_consensus.cc:2955] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
W20260709 12:23:05.311663 25801 consensus_peers.cc:597] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a -> Peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Couldn't send request to peer a866ff967d964388a6f0dff7fd43df89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 97d7984a0036411695d6b3427bff9d69. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:05.311685 25757 raft_consensus.cc:1275] T 97d7984a0036411695d6b3427bff9d69 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:05.316217 26609 consensus_queue.cc:1048] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:23:05.320575 25684 raft_consensus.cc:1275] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:05.322476 26583 consensus_queue.cc:1048] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:05.342875 26651 ts_tablet_manager.cc:933] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89: Initiating tablet copy from peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349)
I20260709 12:23:05.348362 26583 raft_consensus.cc:2955] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:05.353943 25684 raft_consensus.cc:2955] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:05.367766 26646 tablet_bootstrap.cc:492] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:05.369454 26646 tablet_bootstrap.cc:492] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89: Bootstrap complete.
I20260709 12:23:05.370518 26646 ts_tablet_manager.cc:1403] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89: Time spent bootstrapping tablet: real 0.114s	user 0.022s	sys 0.010s
I20260709 12:23:05.384095 26651 tablet_copy_client.cc:323] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Beginning tablet copy session from remote peer at address 127.23.245.129:37349
W20260709 12:23:05.384156 26652 log.cc:927] Time spent T 97d7984a0036411695d6b3427bff9d69 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:23:05.409891 25581 catalog_manager.cc:5697] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New cstate: current_term: 1 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:05.419100 25696 tablet_copy_service.cc:140] P f82778701b464892aab92a752ed7ffdc: Received BeginTabletCopySession request for tablet 819272169f6f4293b6e279793be58b49 from peer a866ff967d964388a6f0dff7fd43df89 ({username='slave'} at 127.0.0.1:51578)
I20260709 12:23:05.419767 25696 tablet_copy_service.cc:161] P f82778701b464892aab92a752ed7ffdc: Beginning new tablet copy session on tablet 819272169f6f4293b6e279793be58b49 from peer a866ff967d964388a6f0dff7fd43df89 at {username='slave'} at 127.0.0.1:51578: session id = a866ff967d964388a6f0dff7fd43df89-819272169f6f4293b6e279793be58b49
I20260709 12:23:05.427003 25757 raft_consensus.cc:2955] T 97d7984a0036411695d6b3427bff9d69 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:05.452611 26646 raft_consensus.cc:359] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:05.453610 26646 raft_consensus.cc:740] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Initialized, Role: LEARNER
I20260709 12:23:05.454352 26646 consensus_queue.cc:260] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:05.476570 25696 tablet_copy_source_session.cc:215] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:05.480469 26651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 819272169f6f4293b6e279793be58b49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.508275 26646 ts_tablet_manager.cc:1434] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89: Time spent starting tablet: real 0.091s	user 0.009s	sys 0.004s
I20260709 12:23:05.513195 25773 tablet_copy_service.cc:342] P 6e673265293d4e9a937dc45150aeb1b8: Request end of tablet copy session a866ff967d964388a6f0dff7fd43df89-2d9ca842256c405c98d29454943e5d01 received from {username='slave'} at 127.0.0.1:48606
I20260709 12:23:05.513723 25773 tablet_copy_service.cc:434] P 6e673265293d4e9a937dc45150aeb1b8: ending tablet copy session a866ff967d964388a6f0dff7fd43df89-2d9ca842256c405c98d29454943e5d01 on tablet 2d9ca842256c405c98d29454943e5d01 with peer a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:05.540941 26651 tablet_copy_client.cc:806] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:05.541540 26651 tablet_copy_client.cc:670] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:05.545725 26651 tablet_copy_client.cc:538] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:05.568300 26651 tablet_bootstrap.cc:492] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89: Bootstrap starting.
I20260709 12:23:05.568499 26634 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:05.569173 26634 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:05.572202 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:05.572964 25762 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 2.
I20260709 12:23:05.577873 25649 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:05.579789 26581 raft_consensus.cc:2804] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:05.580229 26581 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:05.580595 26581 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:05.583177 26646 ts_tablet_manager.cc:933] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89: Initiating tablet copy from peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349)
I20260709 12:23:05.590534 26634 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:05.594907 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:05.595815 25830 raft_consensus.cc:2393] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 2: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:23:05.595041 26646 tablet_copy_client.cc:323] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Beginning tablet copy session from remote peer at address 127.23.245.129:37349
I20260709 12:23:05.598757 26581 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:05.600179 25696 tablet_copy_service.cc:140] P f82778701b464892aab92a752ed7ffdc: Received BeginTabletCopySession request for tablet 7954a5254e674b77843c0d32002d2e90 from peer a866ff967d964388a6f0dff7fd43df89 ({username='slave'} at 127.0.0.1:51578)
I20260709 12:23:05.600775 25696 tablet_copy_service.cc:161] P f82778701b464892aab92a752ed7ffdc: Beginning new tablet copy session on tablet 7954a5254e674b77843c0d32002d2e90 from peer a866ff967d964388a6f0dff7fd43df89 at {username='slave'} at 127.0.0.1:51578: session id = a866ff967d964388a6f0dff7fd43df89-7954a5254e674b77843c0d32002d2e90
I20260709 12:23:05.601811 26581 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:05.602797 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:05.608153 25830 raft_consensus.cc:2393] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 2: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:23:05.610481 25696 tablet_copy_source_session.cc:215] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:05.612820 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:05.616487 26651 tablet_bootstrap.cc:492] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:05.617501 26651 tablet_bootstrap.cc:492] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89: Bootstrap complete.
I20260709 12:23:05.618163 26651 ts_tablet_manager.cc:1403] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89: Time spent bootstrapping tablet: real 0.050s	user 0.016s	sys 0.009s
I20260709 12:23:05.618759 26646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7954a5254e674b77843c0d32002d2e90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.619993 25757 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 2.
I20260709 12:23:05.621188 25649 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:23:05.621249 26651 raft_consensus.cc:359] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:05.621994 26581 raft_consensus.cc:2804] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:05.622181 26651 raft_consensus.cc:740] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Initialized, Role: LEARNER
I20260709 12:23:05.622536 26581 raft_consensus.cc:697] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 2 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:05.622964 26651 consensus_queue.cc:260] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:05.623471 26581 consensus_queue.cc:237] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:05.636653 26646 tablet_copy_client.cc:806] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:05.638348 26651 ts_tablet_manager.cc:1434] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:23:05.641578 26646 tablet_copy_client.cc:670] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:05.645251 25696 tablet_copy_service.cc:342] P f82778701b464892aab92a752ed7ffdc: Request end of tablet copy session a866ff967d964388a6f0dff7fd43df89-819272169f6f4293b6e279793be58b49 received from {username='slave'} at 127.0.0.1:51578
I20260709 12:23:05.645711 25696 tablet_copy_service.cc:434] P f82778701b464892aab92a752ed7ffdc: ending tablet copy session a866ff967d964388a6f0dff7fd43df89-819272169f6f4293b6e279793be58b49 on tablet 819272169f6f4293b6e279793be58b49 with peer a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:05.652771 26646 tablet_copy_client.cc:538] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:05.666445 26646 tablet_bootstrap.cc:492] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89: Bootstrap starting.
I20260709 12:23:05.678956 25581 catalog_manager.cc:5697] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 1 to 2, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 2 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:05.703830 26646 tablet_bootstrap.cc:492] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:05.704869 26646 tablet_bootstrap.cc:492] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89: Bootstrap complete.
I20260709 12:23:05.705538 26646 ts_tablet_manager.cc:1403] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89: Time spent bootstrapping tablet: real 0.040s	user 0.019s	sys 0.006s
I20260709 12:23:05.708853 26646 raft_consensus.cc:359] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:05.709684 26646 raft_consensus.cc:740] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Initialized, Role: LEARNER
I20260709 12:23:05.710371 26646 consensus_queue.cc:260] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:05.713644 26646 ts_tablet_manager.cc:1434] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:23:05.715247 25696 tablet_copy_service.cc:342] P f82778701b464892aab92a752ed7ffdc: Request end of tablet copy session a866ff967d964388a6f0dff7fd43df89-7954a5254e674b77843c0d32002d2e90 received from {username='slave'} at 127.0.0.1:51578
I20260709 12:23:05.715684 25696 tablet_copy_service.cc:434] P f82778701b464892aab92a752ed7ffdc: ending tablet copy session a866ff967d964388a6f0dff7fd43df89-7954a5254e674b77843c0d32002d2e90 on tablet 7954a5254e674b77843c0d32002d2e90 with peer a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:05.746641 26646 ts_tablet_manager.cc:933] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89: Initiating tablet copy from peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:05.747859 26613 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:05.748457 26613 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:05.750583 26646 tablet_copy_client.cc:323] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Beginning tablet copy session from remote peer at address 127.23.245.131:36237
I20260709 12:23:05.750929 26613 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:05.752904 25847 tablet_copy_service.cc:140] P 5cccf20a8bff46dba6601f241d172b8a: Received BeginTabletCopySession request for tablet 97d7984a0036411695d6b3427bff9d69 from peer a866ff967d964388a6f0dff7fd43df89 ({username='slave'} at 127.0.0.1:41782)
I20260709 12:23:05.753098 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:05.753545 25847 tablet_copy_service.cc:161] P 5cccf20a8bff46dba6601f241d172b8a: Beginning new tablet copy session on tablet 97d7984a0036411695d6b3427bff9d69 from peer a866ff967d964388a6f0dff7fd43df89 at {username='slave'} at 127.0.0.1:41782: session id = a866ff967d964388a6f0dff7fd43df89-97d7984a0036411695d6b3427bff9d69
I20260709 12:23:05.753824 25685 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 2.
I20260709 12:23:05.755108 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:05.755861 25830 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 2.
I20260709 12:23:05.757171 25726 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:23:05.759176 26613 raft_consensus.cc:2804] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:05.759582 26613 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:05.759970 26613 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:05.761945 26439 raft_consensus.cc:1217] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:05.770419 25847 tablet_copy_source_session.cc:215] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:05.773648 26613 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:05.776207 26613 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:05.779372 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:05.780054 25685 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:05.782480 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:05.783138 25830 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:05.789177 25685 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 3.
I20260709 12:23:05.790678 25726 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:05.793263 26646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97d7984a0036411695d6b3427bff9d69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:05.791666 26613 raft_consensus.cc:2804] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:05.805254 26613 raft_consensus.cc:697] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:05.806421 26613 consensus_queue.cc:237] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:05.813912 25830 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 3.
I20260709 12:23:05.857447 26607 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:05.858115 26607 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:05.860523 26607 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:05.862883 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:05.863080 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:05.863862 25837 raft_consensus.cc:2468] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 2.
I20260709 12:23:05.863802 25685 raft_consensus.cc:2393] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 2: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:23:05.866024 25726 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:23:05.866483 26646 tablet_copy_client.cc:806] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:05.867105 26646 tablet_copy_client.cc:670] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:05.876006 26607 raft_consensus.cc:2804] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:05.876528 26607 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:05.876865 26646 tablet_copy_client.cc:538] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:05.876971 26607 raft_consensus.cc:3060] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:05.886474 26646 tablet_bootstrap.cc:492] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89: Bootstrap starting.
I20260709 12:23:05.890713 25581 catalog_manager.cc:5697] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:05.898412 26607 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:05.900820 26607 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:05.902779 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:05.914938 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:05.915849 25685 raft_consensus.cc:2393] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 2: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:23:05.919823 26646 tablet_bootstrap.cc:492] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:05.920727 26646 tablet_bootstrap.cc:492] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89: Bootstrap complete.
I20260709 12:23:05.921339 26646 ts_tablet_manager.cc:1403] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89: Time spent bootstrapping tablet: real 0.035s	user 0.019s	sys 0.009s
I20260709 12:23:05.924024 26646 raft_consensus.cc:359] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:05.924788 26646 raft_consensus.cc:740] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Initialized, Role: LEARNER
I20260709 12:23:05.925354 26646 consensus_queue.cc:260] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:05.927625 26646 ts_tablet_manager.cc:1434] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:23:05.930905 25847 tablet_copy_service.cc:342] P 5cccf20a8bff46dba6601f241d172b8a: Request end of tablet copy session a866ff967d964388a6f0dff7fd43df89-97d7984a0036411695d6b3427bff9d69 received from {username='slave'} at 127.0.0.1:41782
I20260709 12:23:05.931386 25847 tablet_copy_service.cc:434] P 5cccf20a8bff46dba6601f241d172b8a: ending tablet copy session a866ff967d964388a6f0dff7fd43df89-97d7984a0036411695d6b3427bff9d69 on tablet 97d7984a0036411695d6b3427bff9d69 with peer a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:05.935541 25830 raft_consensus.cc:2468] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 2.
I20260709 12:23:05.940022 25726 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:23:05.941047 26607 raft_consensus.cc:2804] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:05.942437 26607 raft_consensus.cc:697] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:05.943338 26607 consensus_queue.cc:237] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:05.966965 25581 catalog_manager.cc:5697] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 1 to 2, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 2 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:06.039499 26439 raft_consensus.cc:1217] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:06.076614 25830 raft_consensus.cc:1275] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:06.079469 26634 consensus_queue.cc:1048] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:06.114369 25762 raft_consensus.cc:1275] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:06.118984 26581 consensus_queue.cc:1048] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:06.144737 26634 raft_consensus.cc:1064] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc: attempting to promote NON_VOTER a866ff967d964388a6f0dff7fd43df89 to VOTER
I20260709 12:23:06.156756 26634 consensus_queue.cc:237] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:06.188889 26439 raft_consensus.cc:1217] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:06.206045 26439 raft_consensus.cc:1275] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:06.209196 25762 raft_consensus.cc:1275] T 819272169f6f4293b6e279793be58b49 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:06.209695 26581 consensus_queue.cc:1048] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:06.211238 25830 raft_consensus.cc:1275] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:06.212791 26581 consensus_queue.cc:1048] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:06.215063 26581 consensus_queue.cc:1048] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:06.234787 26634 raft_consensus.cc:2955] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:06.237602 26438 raft_consensus.cc:2955] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:06.252981 25754 raft_consensus.cc:2955] T 819272169f6f4293b6e279793be58b49 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:06.268685 25685 raft_consensus.cc:1275] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:06.271962 26607 consensus_queue.cc:1048] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:06.280596 25830 raft_consensus.cc:1275] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:06.282517 26607 consensus_queue.cc:1048] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:06.296214 25580 catalog_manager.cc:5697] T 819272169f6f4293b6e279793be58b49 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:06.317854 25683 consensus_queue.cc:237] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:23:06.331207 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 56425.2us
W20260709 12:23:06.333969 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 77481.8us
I20260709 12:23:06.366601 25830 raft_consensus.cc:2955] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:06.377300 26438 raft_consensus.cc:1275] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:06.381235 26439 raft_consensus.cc:1217] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:06.384501 26590 consensus_queue.cc:1048] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:06.390225 25829 raft_consensus.cc:1275] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:06.392419 26613 consensus_queue.cc:1048] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:06.402045 26674 raft_consensus.cc:2955] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:06.404273 26438 raft_consensus.cc:2955] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:06.413810 26609 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:06.414462 26609 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:06.417743 26609 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:06.418777 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:06.419629 25754 raft_consensus.cc:2468] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 2.
I20260709 12:23:06.420840 25800 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:23:06.421689 26609 raft_consensus.cc:2804] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:06.422339 26609 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:06.422832 26609 raft_consensus.cc:3060] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:06.424425 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:06.425196 25684 raft_consensus.cc:2393] T 870002623db3456699b2b970d066f356 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 2: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:23:06.427620 26678 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:06.428189 26678 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:06.431762 26613 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.432281 26613 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:06.432876 25837 raft_consensus.cc:1275] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:06.434309 26613 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:06.436968 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:06.437712 25837 raft_consensus.cc:2393] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 2: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:23:06.439110 26678 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:06.437704 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:06.446738 26609 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:06.448192 26629 consensus_queue.cc:1048] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:06.449533 26599 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:06.459511 26599 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:06.458518 25580 catalog_manager.cc:5697] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: config changed from index 3 to 4, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New cstate: current_term: 1 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:06.461711 26599 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:06.454675 26675 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:06.456132 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:06.464224 25684 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 2.
I20260709 12:23:06.463656 26675 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:06.463644 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:06.466166 26675 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:06.467376 25754 raft_consensus.cc:2468] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 2.
I20260709 12:23:06.467746 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:06.468442 25762 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 2.
I20260709 12:23:06.469997 26609 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:06.471783 26607 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.472368 26607 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:06.474524 26607 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:06.475880 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:06.476079 25726 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:23:06.476409 25569 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 819272169f6f4293b6e279793be58b49 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:06.476574 25684 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 2.
I20260709 12:23:06.480100 25800 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:23:06.480989 25800 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:23:06.481843 26613 raft_consensus.cc:2804] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:06.482295 26613 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:06.482677 26613 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:06.483160 26599 raft_consensus.cc:2804] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:06.483597 26599 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:06.484125 26599 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:06.485965 26583 raft_consensus.cc:2804] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:06.486384 26583 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:06.486780 26583 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:06.483959 25753 tablet_service.cc:1558] Processing DeleteTablet for tablet 819272169f6f4293b6e279793be58b49 with delete_type TABLET_DATA_TOMBSTONED (TS 6e673265293d4e9a937dc45150aeb1b8 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53452
I20260709 12:23:06.492928 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:06.494719 26613 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:06.496760 26613 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:06.499191 25837 raft_consensus.cc:2955] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:06.501652 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:06.512574 25683 raft_consensus.cc:2393] T 870002623db3456699b2b970d066f356 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 2: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:23:06.503638 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:06.503780 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:06.513572 25684 raft_consensus.cc:2393] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 2: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:23:06.513689 25680 raft_consensus.cc:2393] T 5f0353e850934c9db0a248807127ca4c P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 2: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:23:06.514935 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:06.515847 25830 raft_consensus.cc:2468] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 1.
I20260709 12:23:06.503856 25685 raft_consensus.cc:1275] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:06.505270 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:06.517928 25682 raft_consensus.cc:2468] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 2.
I20260709 12:23:06.506517 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:06.509332 25726 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:23:06.519995 26678 raft_consensus.cc:2804] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:06.520393 26678 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:06.520736 26678 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:06.523758 25762 raft_consensus.cc:2468] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 2.
I20260709 12:23:06.525400 25800 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:23:06.526746 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:06.527526 25830 raft_consensus.cc:2393] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 2: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:23:06.528357 26678 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:06.530512 26678 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:06.531705 26675 raft_consensus.cc:2804] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:06.531453 26583 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:06.532423 26675 raft_consensus.cc:697] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 2 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:06.533823 26583 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:06.534281 25726 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:23:06.535233 25678 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 2.
I20260709 12:23:06.536813 26607 raft_consensus.cc:2804] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:06.537282 26607 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:06.537743 26607 raft_consensus.cc:3060] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:06.537410 26675 consensus_queue.cc:237] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:06.547717 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:06.547641 26607 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:06.548372 25830 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:06.550320 26607 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:06.554435 25830 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 3.
I20260709 12:23:06.554436 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:06.557096 25762 raft_consensus.cc:2368] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 2. Current term is 3.
I20260709 12:23:06.559894 25800 leader_election.cc:400] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 election: Vote denied by peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267) with higher term. Message: Invalid argument: T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 2. Current term is 3.
I20260709 12:23:06.560503 25800 leader_election.cc:403] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:23:06.562490 26609 raft_consensus.cc:2749] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267) with higher term. Message: Invalid argument: T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 2. Current term is 3.
I20260709 12:23:06.563555 26599 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:06.565642 26599 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:06.566627 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:06.566852 25726 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:23:06.568977 26607 raft_consensus.cc:2804] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:06.569520 26607 raft_consensus.cc:697] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:06.559715 26681 tablet_replica.cc:333] T 819272169f6f4293b6e279793be58b49 P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
I20260709 12:23:06.570448 26607 consensus_queue.cc:237] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:06.576176 25754 raft_consensus.cc:2468] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 2.
I20260709 12:23:06.577785 25800 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:23:06.580441 26684 consensus_queue.cc:1048] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:23:06.582378 26609 raft_consensus.cc:2804] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:06.589811 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:06.592860 25837 raft_consensus.cc:3060] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:23:06.594319 25582 catalog_manager.cc:5697] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 1 to 2, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 2 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:06.590636 26609 raft_consensus.cc:697] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 2 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:06.596805 26609 consensus_queue.cc:237] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:06.578261 26681 raft_consensus.cc:2243] T 819272169f6f4293b6e279793be58b49 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:06.608705 26681 raft_consensus.cc:2272] T 819272169f6f4293b6e279793be58b49 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:06.611212 26629 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.611788 26629 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:06.612534 26681 ts_tablet_manager.cc:1916] T 819272169f6f4293b6e279793be58b49 P 6e673265293d4e9a937dc45150aeb1b8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:06.613737 26678 raft_consensus.cc:1064] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8: attempting to promote NON_VOTER a866ff967d964388a6f0dff7fd43df89 to VOTER
I20260709 12:23:06.613961 25837 raft_consensus.cc:2468] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 3.
I20260709 12:23:06.615804 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:06.616472 26629 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:06.616312 26678 consensus_queue.cc:237] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:06.624432 25726 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:23:06.625240 26684 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.625519 25726 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:23:06.625767 26684 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:06.629076 26613 raft_consensus.cc:2804] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:06.667008 26684 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:06.667531 26690 raft_consensus.cc:2804] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:06.668080 26690 raft_consensus.cc:697] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:06.668956 26690 consensus_queue.cc:237] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:23:06.671379 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 45929.6us
I20260709 12:23:06.673380 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:06.673996 25830 raft_consensus.cc:2468] T 06bd2840931844279521c7e8eb8750bf P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 1.
I20260709 12:23:06.677526 25726 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:23:06.678766 26684 raft_consensus.cc:2804] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:06.678771 26613 raft_consensus.cc:697] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:06.679533 26684 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:06.679942 26684 raft_consensus.cc:3060] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:06.680330 26613 consensus_queue.cc:237] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:06.687249 26684 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:06.689507 26684 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:06.691128 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:06.691655 25830 raft_consensus.cc:3060] T 06bd2840931844279521c7e8eb8750bf P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:23:06.697674 25830 raft_consensus.cc:2468] T 06bd2840931844279521c7e8eb8750bf P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 3.
I20260709 12:23:06.694228 26681 ts_tablet_manager.cc:1929] T 819272169f6f4293b6e279793be58b49 P 6e673265293d4e9a937dc45150aeb1b8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:06.704826 26681 log.cc:1199] T 819272169f6f4293b6e279793be58b49 P 6e673265293d4e9a937dc45150aeb1b8: Deleting WAL directory at /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-1-root/wals/819272169f6f4293b6e279793be58b49
I20260709 12:23:06.705232 25726 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:23:06.706064 26690 raft_consensus.cc:2804] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:06.706543 26690 raft_consensus.cc:697] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:06.707510 25568 catalog_manager.cc:5028] TS 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): tablet 819272169f6f4293b6e279793be58b49 (table test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]) successfully deleted
I20260709 12:23:06.708422 26690 consensus_queue.cc:237] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:06.792812 25582 catalog_manager.cc:5697] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 1 to 2, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 2 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:06.799616 26629 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.800233 26629 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:06.802150 26629 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:06.807384 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:06.808223 25682 raft_consensus.cc:2393] T 5f0353e850934c9db0a248807127ca4c P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 2: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:23:06.809248 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:06.810186 25685 raft_consensus.cc:2393] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 2: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:23:06.812115 26674 raft_consensus.cc:1064] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc: attempting to promote NON_VOTER a866ff967d964388a6f0dff7fd43df89 to VOTER
I20260709 12:23:06.818527 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:06.822041 26438 raft_consensus.cc:1275] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:06.823945 26684 consensus_queue.cc:1048] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:06.845402 26675 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:06.845914 26675 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:06.848021 26675 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:06.850385 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:06.854326 25837 raft_consensus.cc:1275] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:06.856633 26689 consensus_queue.cc:1048] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:06.871148 26689 raft_consensus.cc:2955] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:06.876119 25582 catalog_manager.cc:5697] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:06.881731 25837 raft_consensus.cc:2955] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:06.907403 26438 raft_consensus.cc:2955] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:06.912457 26674 consensus_queue.cc:237] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:06.913795 25582 catalog_manager.cc:5697] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:06.930876 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:06.931541 25684 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 2.
I20260709 12:23:06.932173 25580 catalog_manager.cc:5697] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:06.932982 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:06.933595 25684 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:06.934044 25580 catalog_manager.cc:5697] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 1 to 2, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 2 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:06.936085 25580 catalog_manager.cc:5697] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:06.942785 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:06.943393 25678 raft_consensus.cc:3060] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:06.947746 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:06.948432 25682 raft_consensus.cc:2468] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 2.
I20260709 12:23:06.949945 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:06.950380 25684 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 3.
I20260709 12:23:06.950683 25680 raft_consensus.cc:3060] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:06.953817 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:06.954355 25762 raft_consensus.cc:2468] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 2.
I20260709 12:23:06.955404 25686 raft_consensus.cc:1275] T 2d9ca842256c405c98d29454943e5d01 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:06.962743 25678 raft_consensus.cc:2468] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 3.
I20260709 12:23:06.969233 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:06.969691 25680 raft_consensus.cc:2468] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 3.
I20260709 12:23:06.969944 25754 raft_consensus.cc:2468] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 2.
I20260709 12:23:06.972690 25756 raft_consensus.cc:1275] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:06.980561 26682 consensus_queue.cc:1048] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:06.982100 26438 raft_consensus.cc:1275] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:06.984289 26675 raft_consensus.cc:1064] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a: attempting to promote NON_VOTER a866ff967d964388a6f0dff7fd43df89 to VOTER
I20260709 12:23:06.984834 25830 raft_consensus.cc:1275] T 7954a5254e674b77843c0d32002d2e90 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:23:06.985390 25726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:06.986824 26675 consensus_queue.cc:237] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:06.991954 26634 consensus_queue.cc:1048] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:06.992393 25762 consensus_queue.cc:237] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:06.997658 26697 consensus_queue.cc:1048] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:07.004264 26438 raft_consensus.cc:1275] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:07.006072 26690 consensus_queue.cc:1048] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:07.012276 25830 raft_consensus.cc:1275] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:07.014160 26690 consensus_queue.cc:1048] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:07.016501 25762 raft_consensus.cc:1275] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:07.020975 26689 raft_consensus.cc:2955] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:07.026167 26437 raft_consensus.cc:2955] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:07.037603 26680 consensus_queue.cc:1048] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:07.042858 25830 raft_consensus.cc:1275] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:07.001179 25801 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:07.052109 26634 raft_consensus.cc:2955] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:07.055154 26683 raft_consensus.cc:2804] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:07.055562 26683 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:07.055893 26683 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:23:07.054219 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 53121.7us
I20260709 12:23:07.062292 26613 consensus_queue.cc:1048] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:07.066792 26439 raft_consensus.cc:2955] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:07.069134 25837 raft_consensus.cc:2955] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:07.074337 26683 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:07.076686 26683 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:07.084997 25568 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2d9ca842256c405c98d29454943e5d01 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:07.098500 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:07.107110 25830 raft_consensus.cc:1240] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:07.108754 25830 raft_consensus.cc:1275] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:07.112363 25830 raft_consensus.cc:2955] T 7954a5254e674b77843c0d32002d2e90 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:07.118024 25762 raft_consensus.cc:1275] T 97d7984a0036411695d6b3427bff9d69 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:07.120033 26680 consensus_queue.cc:1048] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:07.121964 26690 consensus_queue.cc:1059] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:07.122555 26613 consensus_queue.cc:1048] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:07.124295 26437 raft_consensus.cc:1275] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:07.122800 26690 raft_consensus.cc:3055] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:07.123021 25580 catalog_manager.cc:5697] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:07.125129 26690 raft_consensus.cc:740] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:07.109755 25581 catalog_manager.cc:5697] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: config changed from index 3 to 4, VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129) evicted. New cstate: current_term: 1 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:07.125985 26690 consensus_queue.cc:260] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:07.128578 26690 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:07.136591 25757 raft_consensus.cc:1275] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:07.138062 25683 raft_consensus.cc:1275] T 5f0353e850934c9db0a248807127ca4c P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:07.140280 25649 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:23:07.141099 26634 raft_consensus.cc:2804] T 870002623db3456699b2b970d066f356 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:07.141419 26634 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:07.141697 26634 raft_consensus.cc:3060] T 870002623db3456699b2b970d066f356 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:07.158562 26683 consensus_queue.cc:1048] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:07.159446 26634 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:07.162817 26634 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:07.180002 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:07.211165 25649 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:23:07.212018 26581 raft_consensus.cc:2804] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:07.212406 26581 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:07.212723 26581 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:07.233513 26712 consensus_queue.cc:1048] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:07.238793 25686 raft_consensus.cc:1240] T 870002623db3456699b2b970d066f356 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:07.242971 26689 consensus_queue.cc:1048] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:07.247253 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:07.249042 25675 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d9ca842256c405c98d29454943e5d01 with delete_type TABLET_DATA_TOMBSTONED (TS f82778701b464892aab92a752ed7ffdc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40214
I20260709 12:23:07.249929 25678 raft_consensus.cc:1275] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:07.251305 25685 raft_consensus.cc:1275] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:07.252491 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:07.252683 26607 consensus_queue.cc:1048] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:07.253113 25680 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:07.257531 26714 consensus_queue.cc:1059] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:07.259516 26599 raft_consensus.cc:3055] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:07.259884 26599 raft_consensus.cc:740] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:07.260669 26599 consensus_queue.cc:260] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:07.261924 26599 raft_consensus.cc:3060] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:07.262745 25649 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:07.263542 26709 raft_consensus.cc:2749] T 870002623db3456699b2b970d066f356 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:07.259908 26682 consensus_queue.cc:1048] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:23:07.241865 26581 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:07.269691 25677 raft_consensus.cc:1240] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:07.271786 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:07.275712 26581 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:07.282114 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:07.290634 25649 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:07.291379 26697 raft_consensus.cc:2749] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:07.296551 26675 consensus_queue.cc:1059] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:07.297959 25677 raft_consensus.cc:1275] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:07.298049 26680 raft_consensus.cc:2955] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:07.299504 26607 consensus_queue.cc:1048] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:07.300419 26682 raft_consensus.cc:3055] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:07.303979 26682 raft_consensus.cc:740] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:07.306283 26682 consensus_queue.cc:260] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:07.312654 26713 tablet_replica.cc:333] T 2d9ca842256c405c98d29454943e5d01 P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
I20260709 12:23:07.313838 26713 raft_consensus.cc:2243] T 2d9ca842256c405c98d29454943e5d01 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:07.315948 26713 raft_consensus.cc:2272] T 2d9ca842256c405c98d29454943e5d01 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:07.317067 26682 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:07.329725 25828 raft_consensus.cc:1275] T 06bd2840931844279521c7e8eb8750bf P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:07.319427 26437 raft_consensus.cc:2955] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:07.311765 25680 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 3.
I20260709 12:23:07.350461 26607 consensus_queue.cc:1048] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:07.353943 25757 raft_consensus.cc:2955] T 97d7984a0036411695d6b3427bff9d69 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:07.377454 25801 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:07.378786 26682 raft_consensus.cc:2804] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:07.380391 26682 raft_consensus.cc:697] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 3 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:07.396763 26713 ts_tablet_manager.cc:1916] T 2d9ca842256c405c98d29454943e5d01 P f82778701b464892aab92a752ed7ffdc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:07.387898 26682 consensus_queue.cc:237] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:07.420714 25580 catalog_manager.cc:5697] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:07.421741 25762 raft_consensus.cc:2955] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:07.463451 25680 raft_consensus.cc:2955] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:07.477083 25582 catalog_manager.cc:5697] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 2 to 3, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 3 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:07.502046 26713 ts_tablet_manager.cc:1929] T 2d9ca842256c405c98d29454943e5d01 P f82778701b464892aab92a752ed7ffdc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.2
I20260709 12:23:07.502539 26713 log.cc:1199] T 2d9ca842256c405c98d29454943e5d01 P f82778701b464892aab92a752ed7ffdc: Deleting WAL directory at /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-0-root/wals/2d9ca842256c405c98d29454943e5d01
I20260709 12:23:07.506444 25569 catalog_manager.cc:5028] TS f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): tablet 2d9ca842256c405c98d29454943e5d01 (table test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]) successfully deleted
I20260709 12:23:07.515812 25830 consensus_queue.cc:237] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:07.521345 26437 raft_consensus.cc:1275] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:07.522611 26680 consensus_queue.cc:1048] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:07.523999 25680 raft_consensus.cc:1275] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:07.526160 26680 consensus_queue.cc:1048] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:07.530829 26675 raft_consensus.cc:2955] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:07.538033 26437 raft_consensus.cc:2955] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:07.542277 25569 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 97d7984a0036411695d6b3427bff9d69 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:07.542661 25680 raft_consensus.cc:2955] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:07.558178 25583 catalog_manager.cc:5697] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: config changed from index 3 to 4, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New cstate: current_term: 1 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:07.586733 25753 tablet_service.cc:1558] Processing DeleteTablet for tablet 97d7984a0036411695d6b3427bff9d69 with delete_type TABLET_DATA_TOMBSTONED (TS 6e673265293d4e9a937dc45150aeb1b8 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53452
I20260709 12:23:07.592198 26723 tablet_replica.cc:333] T 97d7984a0036411695d6b3427bff9d69 P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
I20260709 12:23:07.593405 26723 raft_consensus.cc:2243] T 97d7984a0036411695d6b3427bff9d69 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:07.594220 26723 raft_consensus.cc:2272] T 97d7984a0036411695d6b3427bff9d69 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:07.597451 26723 ts_tablet_manager.cc:1916] T 97d7984a0036411695d6b3427bff9d69 P 6e673265293d4e9a937dc45150aeb1b8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:07.614588 26723 ts_tablet_manager.cc:1929] T 97d7984a0036411695d6b3427bff9d69 P 6e673265293d4e9a937dc45150aeb1b8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:07.615025 26723 log.cc:1199] T 97d7984a0036411695d6b3427bff9d69 P 6e673265293d4e9a937dc45150aeb1b8: Deleting WAL directory at /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-1-root/wals/97d7984a0036411695d6b3427bff9d69
I20260709 12:23:07.620143 25568 catalog_manager.cc:5028] TS 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): tablet 97d7984a0036411695d6b3427bff9d69 (table test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]) successfully deleted
I20260709 12:23:07.830732 25680 consensus_queue.cc:237] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:07.835824 26437 raft_consensus.cc:1275] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:07.836167 25762 raft_consensus.cc:1275] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:07.837359 26697 consensus_queue.cc:1048] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:07.838182 26674 consensus_queue.cc:1048] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:07.848191 26697 raft_consensus.cc:2955] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:07.852084 25762 raft_consensus.cc:2955] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:07.854524 26437 raft_consensus.cc:2955] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:07.870051 25582 catalog_manager.cc:5697] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: config changed from index 3 to 4, VOTER 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) evicted. New cstate: current_term: 1 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:07.891487 25680 raft_consensus.cc:1275] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:07.894253 26675 consensus_queue.cc:1048] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:07.898707 25824 tablet_service.cc:1558] Processing DeleteTablet for tablet 7954a5254e674b77843c0d32002d2e90 with delete_type TABLET_DATA_TOMBSTONED (TS 5cccf20a8bff46dba6601f241d172b8a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44194
I20260709 12:23:07.904318 25569 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7954a5254e674b77843c0d32002d2e90 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:07.905023 26724 tablet_replica.cc:333] T 7954a5254e674b77843c0d32002d2e90 P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
I20260709 12:23:07.910878 25762 raft_consensus.cc:1275] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:23:07.911304 25762 pending_rounds.cc:85] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 1
I20260709 12:23:07.911573 25762 pending_rounds.cc:107] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:23:07.911824 25762 raft_consensus.cc:2889] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:07.915251 26715 consensus_queue.cc:1048] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:07.918018 26724 raft_consensus.cc:2243] T 7954a5254e674b77843c0d32002d2e90 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:07.918905 26724 raft_consensus.cc:2272] T 7954a5254e674b77843c0d32002d2e90 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:07.925069 26724 ts_tablet_manager.cc:1916] T 7954a5254e674b77843c0d32002d2e90 P 5cccf20a8bff46dba6601f241d172b8a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:07.940732 26724 ts_tablet_manager.cc:1929] T 7954a5254e674b77843c0d32002d2e90 P 5cccf20a8bff46dba6601f241d172b8a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:07.941258 26724 log.cc:1199] T 7954a5254e674b77843c0d32002d2e90 P 5cccf20a8bff46dba6601f241d172b8a: Deleting WAL directory at /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-2-root/wals/7954a5254e674b77843c0d32002d2e90
I20260709 12:23:07.944020 25569 catalog_manager.cc:5028] TS 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): tablet 7954a5254e674b77843c0d32002d2e90 (table test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]) successfully deleted
I20260709 12:23:08.515184 26678 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:08.515777 26678 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:08.517707 26678 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:08.518658 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:08.518719 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:08.519506 25677 raft_consensus.cc:2393] T 870002623db3456699b2b970d066f356 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 3: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:23:08.519539 25831 raft_consensus.cc:2468] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 3.
I20260709 12:23:08.520766 25726 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:23:08.521489 26678 raft_consensus.cc:2804] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:08.521853 26678 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:08.522154 26678 raft_consensus.cc:3060] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:08.527576 26678 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:08.529434 26678 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:08.530275 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:08.530441 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:08.530962 25677 raft_consensus.cc:2393] T 870002623db3456699b2b970d066f356 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 3: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:23:08.535439 25831 raft_consensus.cc:2468] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 3.
I20260709 12:23:08.536463 25726 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:23:08.537238 26678 raft_consensus.cc:2804] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:08.537698 26678 raft_consensus.cc:697] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:08.538465 26678 consensus_queue.cc:237] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:08.548069 25583 catalog_manager.cc:5697] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 2 to 3, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 3 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:08.591454 26678 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:08.592034 26678 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:08.593819 26678 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:08.594859 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:08.595685 25677 raft_consensus.cc:2393] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 3: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:23:08.595948 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:08.596558 25831 raft_consensus.cc:2468] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 3.
I20260709 12:23:08.597396 25726 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:23:08.598567 26728 raft_consensus.cc:2804] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:08.598973 26728 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:08.599361 26728 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:08.606098 26728 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:08.608515 26728 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:08.609202 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:08.609987 25677 raft_consensus.cc:2393] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 3: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:23:08.611181 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:08.616487 25831 raft_consensus.cc:2468] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 3.
I20260709 12:23:08.617915 25726 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:23:08.618575 26728 raft_consensus.cc:2804] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:08.619117 26728 raft_consensus.cc:697] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:08.619874 26728 consensus_queue.cc:237] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:08.629221 25583 catalog_manager.cc:5697] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 2 to 3, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 3 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:08.973156 25632 auto_rebalancer.cc:629] Failed to schedule move for tablet 870002623db3456699b2b970d066f356: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:23:08.977279 25677 consensus_queue.cc:237] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
W20260709 12:23:08.984380 25650 consensus_peers.cc:597] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc -> Peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Couldn't send request to peer a866ff967d964388a6f0dff7fd43df89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 04fe73edd8db49c08ea7a6adb6e443e6. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:08.984723 25830 raft_consensus.cc:1275] T 04fe73edd8db49c08ea7a6adb6e443e6 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:08.984823 25756 raft_consensus.cc:1275] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:08.986302 26581 consensus_queue.cc:1048] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:08.988319 26581 consensus_queue.cc:1048] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:09.004025 26674 raft_consensus.cc:2955] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:09.010928 25830 raft_consensus.cc:2955] T 04fe73edd8db49c08ea7a6adb6e443e6 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:09.011549 25762 raft_consensus.cc:2955] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:09.022233 25756 consensus_queue.cc:237] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:09.032482 25583 catalog_manager.cc:5697] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc reported cstate change: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New cstate: current_term: 1 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:09.042523 25726 consensus_peers.cc:597] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 -> Peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Couldn't send request to peer a866ff967d964388a6f0dff7fd43df89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5f0353e850934c9db0a248807127ca4c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:09.043406 25831 raft_consensus.cc:1275] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:09.045109 25677 raft_consensus.cc:1275] T 5f0353e850934c9db0a248807127ca4c P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:09.046265 26728 consensus_queue.cc:1048] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:09.048038 26733 consensus_queue.cc:1048] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:09.058662 26728 raft_consensus.cc:2955] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:09.066053 25830 raft_consensus.cc:2955] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:09.071538 25677 raft_consensus.cc:2955] T 5f0353e850934c9db0a248807127ca4c P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:09.084491 25678 raft_consensus.cc:1275] T 870002623db3456699b2b970d066f356 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:09.079911 25828 consensus_queue.cc:237] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:09.088088 26678 consensus_queue.cc:1048] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:09.088606 25583 catalog_manager.cc:5697] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: config changed from index -1 to 3, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New cstate: current_term: 3 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:09.092731 25830 raft_consensus.cc:1275] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:09.097054 26678 consensus_queue.cc:1048] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:09.097075 25677 raft_consensus.cc:1275] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:09.110939 25762 raft_consensus.cc:1275] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:09.113705 25801 consensus_peers.cc:597] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a -> Peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Couldn't send request to peer a866ff967d964388a6f0dff7fd43df89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f5c104146a1c4ce1b19e2c6b5a1bf37a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:09.114598 26727 consensus_queue.cc:1048] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:09.122536 26678 consensus_queue.cc:1048] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:09.123677 25677 raft_consensus.cc:1275] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:09.125380 26745 consensus_queue.cc:1048] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:09.147449 26727 raft_consensus.cc:2955] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:09.153738 25762 raft_consensus.cc:2955] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:09.196298 25677 raft_consensus.cc:2955] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:09.203152 25583 catalog_manager.cc:5697] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New cstate: current_term: 1 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:09.241097 25830 raft_consensus.cc:1275] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:09.276122 26755 consensus_queue.cc:1048] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
W20260709 12:23:09.328902 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 53614.6us
I20260709 12:23:09.430243 26762 ts_tablet_manager.cc:933] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89: Initiating tablet copy from peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:09.434826 26762 tablet_copy_client.cc:323] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89: tablet copy: Beginning tablet copy session from remote peer at address 127.23.245.130:37267
I20260709 12:23:09.436533 25773 tablet_copy_service.cc:140] P 6e673265293d4e9a937dc45150aeb1b8: Received BeginTabletCopySession request for tablet 5f0353e850934c9db0a248807127ca4c from peer a866ff967d964388a6f0dff7fd43df89 ({username='slave'} at 127.0.0.1:48606)
I20260709 12:23:09.437038 25773 tablet_copy_service.cc:161] P 6e673265293d4e9a937dc45150aeb1b8: Beginning new tablet copy session on tablet 5f0353e850934c9db0a248807127ca4c from peer a866ff967d964388a6f0dff7fd43df89 at {username='slave'} at 127.0.0.1:48606: session id = a866ff967d964388a6f0dff7fd43df89-5f0353e850934c9db0a248807127ca4c
I20260709 12:23:09.442759 26764 ts_tablet_manager.cc:933] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89: Initiating tablet copy from peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349)
I20260709 12:23:09.443964 25773 tablet_copy_source_session.cc:215] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:09.445966 26764 tablet_copy_client.cc:323] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Beginning tablet copy session from remote peer at address 127.23.245.129:37349
I20260709 12:23:09.447609 25696 tablet_copy_service.cc:140] P f82778701b464892aab92a752ed7ffdc: Received BeginTabletCopySession request for tablet 04fe73edd8db49c08ea7a6adb6e443e6 from peer a866ff967d964388a6f0dff7fd43df89 ({username='slave'} at 127.0.0.1:51578)
I20260709 12:23:09.448033 26762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5f0353e850934c9db0a248807127ca4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:09.448186 25696 tablet_copy_service.cc:161] P f82778701b464892aab92a752ed7ffdc: Beginning new tablet copy session on tablet 04fe73edd8db49c08ea7a6adb6e443e6 from peer a866ff967d964388a6f0dff7fd43df89 at {username='slave'} at 127.0.0.1:51578: session id = a866ff967d964388a6f0dff7fd43df89-04fe73edd8db49c08ea7a6adb6e443e6
I20260709 12:23:09.457537 25696 tablet_copy_source_session.cc:215] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:09.464927 26764 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04fe73edd8db49c08ea7a6adb6e443e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:09.465061 26762 tablet_copy_client.cc:806] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:09.465627 26762 tablet_copy_client.cc:670] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:09.469664 26762 tablet_copy_client.cc:538] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:09.478621 26762 tablet_bootstrap.cc:492] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89: Bootstrap starting.
I20260709 12:23:09.480255 26764 tablet_copy_client.cc:806] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:09.480871 26764 tablet_copy_client.cc:670] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:09.485457 26764 tablet_copy_client.cc:538] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:09.497906 26764 tablet_bootstrap.cc:492] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89: Bootstrap starting.
I20260709 12:23:09.506323 26762 tablet_bootstrap.cc:492] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:09.507526 26762 tablet_bootstrap.cc:492] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89: Bootstrap complete.
I20260709 12:23:09.508241 26762 ts_tablet_manager.cc:1403] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89: Time spent bootstrapping tablet: real 0.030s	user 0.018s	sys 0.010s
I20260709 12:23:09.511135 26762 raft_consensus.cc:359] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:09.512048 26762 raft_consensus.cc:740] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Initialized, Role: LEARNER
I20260709 12:23:09.514973 26762 consensus_queue.cc:260] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:09.537765 26764 tablet_bootstrap.cc:492] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:09.538738 26764 tablet_bootstrap.cc:492] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89: Bootstrap complete.
I20260709 12:23:09.539443 26764 ts_tablet_manager.cc:1403] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89: Time spent bootstrapping tablet: real 0.042s	user 0.021s	sys 0.008s
I20260709 12:23:09.542443 26764 raft_consensus.cc:359] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:09.543275 26764 raft_consensus.cc:740] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Initialized, Role: LEARNER
I20260709 12:23:09.546258 26767 ts_tablet_manager.cc:933] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89: Initiating tablet copy from peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:09.547757 26764 consensus_queue.cc:260] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:09.631403 26767 tablet_copy_client.cc:323] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89: tablet copy: Beginning tablet copy session from remote peer at address 127.23.245.131:36237
I20260709 12:23:09.634364 26762 ts_tablet_manager.cc:1434] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89: Time spent starting tablet: real 0.126s	user 0.034s	sys 0.029s
I20260709 12:23:09.636271 26764 ts_tablet_manager.cc:1434] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89: Time spent starting tablet: real 0.097s	user 0.015s	sys 0.028s
I20260709 12:23:09.636557 25773 tablet_copy_service.cc:342] P 6e673265293d4e9a937dc45150aeb1b8: Request end of tablet copy session a866ff967d964388a6f0dff7fd43df89-5f0353e850934c9db0a248807127ca4c received from {username='slave'} at 127.0.0.1:48606
I20260709 12:23:09.636992 25773 tablet_copy_service.cc:434] P 6e673265293d4e9a937dc45150aeb1b8: ending tablet copy session a866ff967d964388a6f0dff7fd43df89-5f0353e850934c9db0a248807127ca4c on tablet 5f0353e850934c9db0a248807127ca4c with peer a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:09.637351 25847 tablet_copy_service.cc:140] P 5cccf20a8bff46dba6601f241d172b8a: Received BeginTabletCopySession request for tablet f5c104146a1c4ce1b19e2c6b5a1bf37a from peer a866ff967d964388a6f0dff7fd43df89 ({username='slave'} at 127.0.0.1:41782)
I20260709 12:23:09.637897 25847 tablet_copy_service.cc:161] P 5cccf20a8bff46dba6601f241d172b8a: Beginning new tablet copy session on tablet f5c104146a1c4ce1b19e2c6b5a1bf37a from peer a866ff967d964388a6f0dff7fd43df89 at {username='slave'} at 127.0.0.1:41782: session id = a866ff967d964388a6f0dff7fd43df89-f5c104146a1c4ce1b19e2c6b5a1bf37a
I20260709 12:23:09.642659 25696 tablet_copy_service.cc:342] P f82778701b464892aab92a752ed7ffdc: Request end of tablet copy session a866ff967d964388a6f0dff7fd43df89-04fe73edd8db49c08ea7a6adb6e443e6 received from {username='slave'} at 127.0.0.1:51578
I20260709 12:23:09.643118 25696 tablet_copy_service.cc:434] P f82778701b464892aab92a752ed7ffdc: ending tablet copy session a866ff967d964388a6f0dff7fd43df89-04fe73edd8db49c08ea7a6adb6e443e6 on tablet 04fe73edd8db49c08ea7a6adb6e443e6 with peer a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:09.645691 25847 tablet_copy_source_session.cc:215] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:09.649896 26767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5c104146a1c4ce1b19e2c6b5a1bf37a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:09.663582 26767 tablet_copy_client.cc:806] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:09.664247 26767 tablet_copy_client.cc:670] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:09.669714 26767 tablet_copy_client.cc:538] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:09.681725 26767 tablet_bootstrap.cc:492] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89: Bootstrap starting.
I20260709 12:23:09.703727 26767 tablet_bootstrap.cc:492] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:09.704711 26767 tablet_bootstrap.cc:492] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89: Bootstrap complete.
I20260709 12:23:09.705278 26767 ts_tablet_manager.cc:1403] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.004s
I20260709 12:23:09.707425 26767 raft_consensus.cc:359] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:09.708115 26767 raft_consensus.cc:740] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Initialized, Role: LEARNER
I20260709 12:23:09.708745 26767 consensus_queue.cc:260] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:09.711091 26767 ts_tablet_manager.cc:1434] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:23:09.712977 25847 tablet_copy_service.cc:342] P 5cccf20a8bff46dba6601f241d172b8a: Request end of tablet copy session a866ff967d964388a6f0dff7fd43df89-f5c104146a1c4ce1b19e2c6b5a1bf37a received from {username='slave'} at 127.0.0.1:41782
I20260709 12:23:09.713459 25847 tablet_copy_service.cc:434] P 5cccf20a8bff46dba6601f241d172b8a: ending tablet copy session a866ff967d964388a6f0dff7fd43df89-f5c104146a1c4ce1b19e2c6b5a1bf37a on tablet f5c104146a1c4ce1b19e2c6b5a1bf37a with peer a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:09.958979 26437 raft_consensus.cc:1217] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:10.014580 26437 raft_consensus.cc:1217] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 12:23:10.056901 26437 raft_consensus.cc:1217] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:10.423511 26581 raft_consensus.cc:1064] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc: attempting to promote NON_VOTER a866ff967d964388a6f0dff7fd43df89 to VOTER
I20260709 12:23:10.426374 26581 consensus_queue.cc:237] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:10.429723 26759 raft_consensus.cc:1064] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8: attempting to promote NON_VOTER a866ff967d964388a6f0dff7fd43df89 to VOTER
I20260709 12:23:10.432348 26759 consensus_queue.cc:237] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:10.445286 26437 raft_consensus.cc:1275] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 3 LEARNER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:23:10.447959 26755 consensus_queue.cc:1048] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:10.449108 25830 raft_consensus.cc:1275] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:23:10.453413 26755 consensus_queue.cc:1048] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:10.469882 25762 raft_consensus.cc:1275] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:10.470283 25680 raft_consensus.cc:1275] T 5f0353e850934c9db0a248807127ca4c P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:23:10.474210 26581 consensus_queue.cc:1048] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:10.477063 26755 consensus_queue.cc:1048] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:10.478706 25830 raft_consensus.cc:1275] T 04fe73edd8db49c08ea7a6adb6e443e6 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:10.480906 26438 raft_consensus.cc:1275] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:10.486227 26581 consensus_queue.cc:1048] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:10.487757 26776 consensus_queue.cc:1048] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:10.508893 26757 raft_consensus.cc:2955] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:10.516058 26773 raft_consensus.cc:2955] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:10.524057 25828 raft_consensus.cc:2955] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:10.525594 25831 raft_consensus.cc:2955] T 04fe73edd8db49c08ea7a6adb6e443e6 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:10.518744 26437 raft_consensus.cc:2955] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:10.537391 25582 catalog_manager.cc:5697] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:10.573889 25757 raft_consensus.cc:2955] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:10.582602 25677 raft_consensus.cc:2955] T 5f0353e850934c9db0a248807127ca4c P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:10.579459 26438 raft_consensus.cc:2955] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:10.615193 25581 catalog_manager.cc:5697] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc reported cstate change: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:10.629808 25757 consensus_queue.cc:237] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:10.646390 26438 raft_consensus.cc:1275] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:23:10.647171 25831 raft_consensus.cc:1275] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:23:10.648321 26757 consensus_queue.cc:1048] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:10.650993 26757 consensus_queue.cc:1048] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:10.651839 25680 consensus_queue.cc:237] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:10.659960 26755 raft_consensus.cc:2955] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:10.661859 25828 raft_consensus.cc:2955] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:10.692668 26438 raft_consensus.cc:2955] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:10.699535 26727 raft_consensus.cc:1064] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a: attempting to promote NON_VOTER a866ff967d964388a6f0dff7fd43df89 to VOTER
I20260709 12:23:10.702885 26727 consensus_queue.cc:237] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:10.712636 25762 raft_consensus.cc:1275] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:10.714560 26439 raft_consensus.cc:1275] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:10.720953 25568 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5f0353e850934c9db0a248807127ca4c with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:10.724009 26773 consensus_queue.cc:1048] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:10.722438 25580 catalog_manager.cc:5697] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 reported cstate change: config changed from index 4 to 5, VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129) evicted. New cstate: current_term: 3 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:10.733271 26697 raft_consensus.cc:2955] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:10.741008 25762 raft_consensus.cc:2955] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:10.744179 25569 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 04fe73edd8db49c08ea7a6adb6e443e6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:10.748075 25675 tablet_service.cc:1558] Processing DeleteTablet for tablet 5f0353e850934c9db0a248807127ca4c with delete_type TABLET_DATA_TOMBSTONED (TS f82778701b464892aab92a752ed7ffdc not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:40214
I20260709 12:23:10.757015 26791 tablet_replica.cc:333] T 5f0353e850934c9db0a248807127ca4c P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
I20260709 12:23:10.759651 26581 consensus_queue.cc:1048] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:10.764386 25581 catalog_manager.cc:5697] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc reported cstate change: config changed from index 3 to 4, VOTER 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) evicted. New cstate: current_term: 1 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:10.769093 26438 raft_consensus.cc:2955] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:10.773954 26439 raft_consensus.cc:1275] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:10.775955 25680 raft_consensus.cc:1275] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:10.775249 25762 raft_consensus.cc:1275] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:10.778090 26727 consensus_queue.cc:1048] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
I20260709 12:23:10.791993 26745 consensus_queue.cc:1048] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:10.793078 26751 consensus_queue.cc:1048] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:10.822501 25824 tablet_service.cc:1558] Processing DeleteTablet for tablet 04fe73edd8db49c08ea7a6adb6e443e6 with delete_type TABLET_DATA_TOMBSTONED (TS 5cccf20a8bff46dba6601f241d172b8a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44194
I20260709 12:23:10.825539 26796 tablet_replica.cc:333] T 04fe73edd8db49c08ea7a6adb6e443e6 P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
I20260709 12:23:10.829326 26796 raft_consensus.cc:2243] T 04fe73edd8db49c08ea7a6adb6e443e6 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:10.830350 26796 raft_consensus.cc:2272] T 04fe73edd8db49c08ea7a6adb6e443e6 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:10.835644 26796 ts_tablet_manager.cc:1916] T 04fe73edd8db49c08ea7a6adb6e443e6 P 5cccf20a8bff46dba6601f241d172b8a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:10.837152 25757 raft_consensus.cc:2955] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:10.835139 26792 raft_consensus.cc:2955] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:10.855203 26796 ts_tablet_manager.cc:1929] T 04fe73edd8db49c08ea7a6adb6e443e6 P 5cccf20a8bff46dba6601f241d172b8a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:10.855786 26796 log.cc:1199] T 04fe73edd8db49c08ea7a6adb6e443e6 P 5cccf20a8bff46dba6601f241d172b8a: Deleting WAL directory at /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-2-root/wals/04fe73edd8db49c08ea7a6adb6e443e6
I20260709 12:23:10.857599 25569 catalog_manager.cc:5028] TS 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): tablet 04fe73edd8db49c08ea7a6adb6e443e6 (table test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]) successfully deleted
I20260709 12:23:10.870545 25680 raft_consensus.cc:2955] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:10.877014 26439 raft_consensus.cc:2955] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:10.882802 26791 raft_consensus.cc:2243] T 5f0353e850934c9db0a248807127ca4c P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:10.882364 25581 catalog_manager.cc:5697] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:10.884444 26791 raft_consensus.cc:2272] T 5f0353e850934c9db0a248807127ca4c P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:10.887883 26791 ts_tablet_manager.cc:1916] T 5f0353e850934c9db0a248807127ca4c P f82778701b464892aab92a752ed7ffdc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:10.906970 26791 ts_tablet_manager.cc:1929] T 5f0353e850934c9db0a248807127ca4c P f82778701b464892aab92a752ed7ffdc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 12:23:10.907467 26791 log.cc:1199] T 5f0353e850934c9db0a248807127ca4c P f82778701b464892aab92a752ed7ffdc: Deleting WAL directory at /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-0-root/wals/5f0353e850934c9db0a248807127ca4c
I20260709 12:23:10.909425 25569 catalog_manager.cc:5028] TS f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): tablet 5f0353e850934c9db0a248807127ca4c (table test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]) successfully deleted
I20260709 12:23:10.928263 25831 consensus_queue.cc:237] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:10.933928 25680 raft_consensus.cc:1275] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:10.933938 26439 raft_consensus.cc:1275] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:10.935426 26784 consensus_queue.cc:1048] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:10.936342 26792 consensus_queue.cc:1048] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:10.945957 26797 raft_consensus.cc:2955] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:10.953349 26438 raft_consensus.cc:2955] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:10.962661 25569 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f5c104146a1c4ce1b19e2c6b5a1bf37a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:10.965395 25680 raft_consensus.cc:2955] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:10.982569 25583 catalog_manager.cc:5697] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 reported cstate change: config changed from index 3 to 4, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New cstate: current_term: 1 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:10.996248 25753 tablet_service.cc:1558] Processing DeleteTablet for tablet f5c104146a1c4ce1b19e2c6b5a1bf37a with delete_type TABLET_DATA_TOMBSTONED (TS 6e673265293d4e9a937dc45150aeb1b8 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53452
I20260709 12:23:11.005054 26798 tablet_replica.cc:333] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
I20260709 12:23:11.007396 26798 raft_consensus.cc:2243] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:11.008411 26798 raft_consensus.cc:2272] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:11.011909 26798 ts_tablet_manager.cc:1916] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 6e673265293d4e9a937dc45150aeb1b8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:11.024582 26798 ts_tablet_manager.cc:1929] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 6e673265293d4e9a937dc45150aeb1b8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:11.024923 26798 log.cc:1199] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 6e673265293d4e9a937dc45150aeb1b8: Deleting WAL directory at /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-1-root/wals/f5c104146a1c4ce1b19e2c6b5a1bf37a
I20260709 12:23:11.026234 25568 catalog_manager.cc:5028] TS 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): tablet f5c104146a1c4ce1b19e2c6b5a1bf37a (table test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]) successfully deleted
I20260709 12:23:12.061067 25757 consensus_queue.cc:237] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
W20260709 12:23:12.069914 25726 consensus_peers.cc:597] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Couldn't send request to peer a866ff967d964388a6f0dff7fd43df89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e535a01d34654e31ac7826205390f938. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:12.070473 25680 raft_consensus.cc:1275] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:23:12.070489 25831 raft_consensus.cc:1275] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:23:12.071832 26802 consensus_queue.cc:1048] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:12.072628 26757 consensus_queue.cc:1048] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:12.079798 26757 raft_consensus.cc:2955] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:12.081574 25831 raft_consensus.cc:2955] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:12.084596 25680 raft_consensus.cc:2955] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:12.095551 25831 consensus_queue.cc:237] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:12.098774 25580 catalog_manager.cc:5697] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: config changed from index -1 to 4, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New cstate: current_term: 3 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:12.105806 25757 raft_consensus.cc:1275] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:12.106760 25801 consensus_peers.cc:597] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a -> Peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Couldn't send request to peer a866ff967d964388a6f0dff7fd43df89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 47453d79f4484e7ea165be91f0269a2b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:12.107760 25680 raft_consensus.cc:1275] T 47453d79f4484e7ea165be91f0269a2b P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:12.107944 26800 consensus_queue.cc:1048] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:12.110419 26800 consensus_queue.cc:1048] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:12.118469 26797 raft_consensus.cc:2955] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:12.122123 25757 raft_consensus.cc:2955] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:12.122646 25680 raft_consensus.cc:2955] T 47453d79f4484e7ea165be91f0269a2b P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:12.133742 25678 consensus_queue.cc:237] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:12.139474 25583 catalog_manager.cc:5697] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New cstate: current_term: 1 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:12.159096 25831 raft_consensus.cc:1275] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:12.159803 25757 raft_consensus.cc:1275] T 63f47864b8d248a792567d96c5e453b8 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:23:12.159168 25650 consensus_peers.cc:597] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc -> Peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Couldn't send request to peer a866ff967d964388a6f0dff7fd43df89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 63f47864b8d248a792567d96c5e453b8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:12.161312 26776 consensus_queue.cc:1048] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:12.162552 26581 consensus_queue.cc:1048] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:12.170773 26773 raft_consensus.cc:2955] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:12.174175 25757 raft_consensus.cc:2955] T 63f47864b8d248a792567d96c5e453b8 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:12.180547 25828 raft_consensus.cc:2955] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:12.196053 25580 catalog_manager.cc:5697] T 63f47864b8d248a792567d96c5e453b8 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: config changed from index -1 to 3, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New cstate: current_term: 3 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:12.198330 25757 consensus_queue.cc:237] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:12.207795 25828 raft_consensus.cc:1275] T 06bd2840931844279521c7e8eb8750bf P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:12.209766 26757 consensus_queue.cc:1048] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:23:12.210810 25726 consensus_peers.cc:597] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 -> Peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Couldn't send request to peer a866ff967d964388a6f0dff7fd43df89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 06bd2840931844279521c7e8eb8750bf. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:12.211118 25680 raft_consensus.cc:1275] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:12.213974 26757 consensus_queue.cc:1048] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:12.222967 26799 raft_consensus.cc:2955] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:12.225947 25828 raft_consensus.cc:2955] T 06bd2840931844279521c7e8eb8750bf P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:12.226266 25678 raft_consensus.cc:2955] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:12.244814 25583 catalog_manager.cc:5697] T 06bd2840931844279521c7e8eb8750bf P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: config changed from index -1 to 3, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New cstate: current_term: 3 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:12.507650 26818 ts_tablet_manager.cc:933] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89: Initiating tablet copy from peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:12.511087 26818 tablet_copy_client.cc:323] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Beginning tablet copy session from remote peer at address 127.23.245.130:37267
I20260709 12:23:12.512674 25773 tablet_copy_service.cc:140] P 6e673265293d4e9a937dc45150aeb1b8: Received BeginTabletCopySession request for tablet e535a01d34654e31ac7826205390f938 from peer a866ff967d964388a6f0dff7fd43df89 ({username='slave'} at 127.0.0.1:48606)
I20260709 12:23:12.513226 25773 tablet_copy_service.cc:161] P 6e673265293d4e9a937dc45150aeb1b8: Beginning new tablet copy session on tablet e535a01d34654e31ac7826205390f938 from peer a866ff967d964388a6f0dff7fd43df89 at {username='slave'} at 127.0.0.1:48606: session id = a866ff967d964388a6f0dff7fd43df89-e535a01d34654e31ac7826205390f938
I20260709 12:23:12.525519 25773 tablet_copy_source_session.cc:215] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:12.529150 26818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e535a01d34654e31ac7826205390f938. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:12.548080 26818 tablet_copy_client.cc:806] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:12.548684 26818 tablet_copy_client.cc:670] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:12.552141 26818 tablet_copy_client.cc:538] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:12.558296 26818 tablet_bootstrap.cc:492] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89: Bootstrap starting.
I20260709 12:23:12.579679 26818 tablet_bootstrap.cc:492] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:12.580729 26818 tablet_bootstrap.cc:492] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89: Bootstrap complete.
I20260709 12:23:12.581508 26818 ts_tablet_manager.cc:1403] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89: Time spent bootstrapping tablet: real 0.023s	user 0.020s	sys 0.004s
I20260709 12:23:12.584877 26818 raft_consensus.cc:359] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:12.585779 26818 raft_consensus.cc:740] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Initialized, Role: LEARNER
I20260709 12:23:12.586465 26818 consensus_queue.cc:260] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:12.596462 26818 ts_tablet_manager.cc:1434] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.008s
I20260709 12:23:12.598835 26821 ts_tablet_manager.cc:933] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89: Initiating tablet copy from peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:12.601078 25773 tablet_copy_service.cc:342] P 6e673265293d4e9a937dc45150aeb1b8: Request end of tablet copy session a866ff967d964388a6f0dff7fd43df89-e535a01d34654e31ac7826205390f938 received from {username='slave'} at 127.0.0.1:48606
I20260709 12:23:12.601428 26821 tablet_copy_client.cc:323] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89: tablet copy: Beginning tablet copy session from remote peer at address 127.23.245.131:36237
I20260709 12:23:12.601609 25773 tablet_copy_service.cc:434] P 6e673265293d4e9a937dc45150aeb1b8: ending tablet copy session a866ff967d964388a6f0dff7fd43df89-e535a01d34654e31ac7826205390f938 on tablet e535a01d34654e31ac7826205390f938 with peer a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:12.604871 25847 tablet_copy_service.cc:140] P 5cccf20a8bff46dba6601f241d172b8a: Received BeginTabletCopySession request for tablet 47453d79f4484e7ea165be91f0269a2b from peer a866ff967d964388a6f0dff7fd43df89 ({username='slave'} at 127.0.0.1:41782)
I20260709 12:23:12.605374 25847 tablet_copy_service.cc:161] P 5cccf20a8bff46dba6601f241d172b8a: Beginning new tablet copy session on tablet 47453d79f4484e7ea165be91f0269a2b from peer a866ff967d964388a6f0dff7fd43df89 at {username='slave'} at 127.0.0.1:41782: session id = a866ff967d964388a6f0dff7fd43df89-47453d79f4484e7ea165be91f0269a2b
I20260709 12:23:12.612334 25847 tablet_copy_source_session.cc:215] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:12.615239 26821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47453d79f4484e7ea165be91f0269a2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:12.622697 26818 ts_tablet_manager.cc:933] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89: Initiating tablet copy from peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349)
I20260709 12:23:12.624431 26818 tablet_copy_client.cc:323] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Beginning tablet copy session from remote peer at address 127.23.245.129:37349
I20260709 12:23:12.626324 25696 tablet_copy_service.cc:140] P f82778701b464892aab92a752ed7ffdc: Received BeginTabletCopySession request for tablet 63f47864b8d248a792567d96c5e453b8 from peer a866ff967d964388a6f0dff7fd43df89 ({username='slave'} at 127.0.0.1:51578)
I20260709 12:23:12.626849 25696 tablet_copy_service.cc:161] P f82778701b464892aab92a752ed7ffdc: Beginning new tablet copy session on tablet 63f47864b8d248a792567d96c5e453b8 from peer a866ff967d964388a6f0dff7fd43df89 at {username='slave'} at 127.0.0.1:51578: session id = a866ff967d964388a6f0dff7fd43df89-63f47864b8d248a792567d96c5e453b8
I20260709 12:23:12.628837 26821 tablet_copy_client.cc:806] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:12.629400 26821 tablet_copy_client.cc:670] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:12.633059 26821 tablet_copy_client.cc:538] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:12.634002 25696 tablet_copy_source_session.cc:215] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:12.637228 26818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63f47864b8d248a792567d96c5e453b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:12.644407 26821 tablet_bootstrap.cc:492] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89: Bootstrap starting.
I20260709 12:23:12.656648 26818 tablet_copy_client.cc:806] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:12.657272 26818 tablet_copy_client.cc:670] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:12.662848 26818 tablet_copy_client.cc:538] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:12.668812 26821 tablet_bootstrap.cc:492] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:12.669778 26821 tablet_bootstrap.cc:492] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89: Bootstrap complete.
I20260709 12:23:12.670408 26821 ts_tablet_manager.cc:1403] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.013s
I20260709 12:23:12.670501 26818 tablet_bootstrap.cc:492] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89: Bootstrap starting.
I20260709 12:23:12.673827 26821 raft_consensus.cc:359] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:12.674690 26821 raft_consensus.cc:740] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Initialized, Role: LEARNER
I20260709 12:23:12.675326 26821 consensus_queue.cc:260] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:12.677752 26821 ts_tablet_manager.cc:1434] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:23:12.679508 25847 tablet_copy_service.cc:342] P 5cccf20a8bff46dba6601f241d172b8a: Request end of tablet copy session a866ff967d964388a6f0dff7fd43df89-47453d79f4484e7ea165be91f0269a2b received from {username='slave'} at 127.0.0.1:41782
I20260709 12:23:12.679951 25847 tablet_copy_service.cc:434] P 5cccf20a8bff46dba6601f241d172b8a: ending tablet copy session a866ff967d964388a6f0dff7fd43df89-47453d79f4484e7ea165be91f0269a2b on tablet 47453d79f4484e7ea165be91f0269a2b with peer a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:12.696038 26818 tablet_bootstrap.cc:492] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:12.696920 26818 tablet_bootstrap.cc:492] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89: Bootstrap complete.
I20260709 12:23:12.697598 26818 ts_tablet_manager.cc:1403] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.007s
I20260709 12:23:12.700402 26818 raft_consensus.cc:359] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:12.701216 26818 raft_consensus.cc:740] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Initialized, Role: LEARNER
I20260709 12:23:12.701850 26818 consensus_queue.cc:260] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:12.704154 26818 ts_tablet_manager.cc:1434] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 12:23:12.706517 25696 tablet_copy_service.cc:342] P f82778701b464892aab92a752ed7ffdc: Request end of tablet copy session a866ff967d964388a6f0dff7fd43df89-63f47864b8d248a792567d96c5e453b8 received from {username='slave'} at 127.0.0.1:51578
I20260709 12:23:12.706933 25696 tablet_copy_service.cc:434] P f82778701b464892aab92a752ed7ffdc: ending tablet copy session a866ff967d964388a6f0dff7fd43df89-63f47864b8d248a792567d96c5e453b8 on tablet 63f47864b8d248a792567d96c5e453b8 with peer a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:12.729595 26818 ts_tablet_manager.cc:933] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89: Initiating tablet copy from peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:12.731436 26818 tablet_copy_client.cc:323] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89: tablet copy: Beginning tablet copy session from remote peer at address 127.23.245.130:37267
I20260709 12:23:12.732990 25773 tablet_copy_service.cc:140] P 6e673265293d4e9a937dc45150aeb1b8: Received BeginTabletCopySession request for tablet 06bd2840931844279521c7e8eb8750bf from peer a866ff967d964388a6f0dff7fd43df89 ({username='slave'} at 127.0.0.1:48606)
I20260709 12:23:12.733525 25773 tablet_copy_service.cc:161] P 6e673265293d4e9a937dc45150aeb1b8: Beginning new tablet copy session on tablet 06bd2840931844279521c7e8eb8750bf from peer a866ff967d964388a6f0dff7fd43df89 at {username='slave'} at 127.0.0.1:48606: session id = a866ff967d964388a6f0dff7fd43df89-06bd2840931844279521c7e8eb8750bf
I20260709 12:23:12.743093 25773 tablet_copy_source_session.cc:215] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:12.745903 26818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06bd2840931844279521c7e8eb8750bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:12.759255 26818 tablet_copy_client.cc:806] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:12.759842 26818 tablet_copy_client.cc:670] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:12.763561 26818 tablet_copy_client.cc:538] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:12.771194 26818 tablet_bootstrap.cc:492] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89: Bootstrap starting.
I20260709 12:23:12.801046 26818 tablet_bootstrap.cc:492] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:12.802511 26818 tablet_bootstrap.cc:492] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89: Bootstrap complete.
I20260709 12:23:12.803143 26818 ts_tablet_manager.cc:1403] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89: Time spent bootstrapping tablet: real 0.032s	user 0.028s	sys 0.000s
I20260709 12:23:12.805842 26818 raft_consensus.cc:359] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:12.806663 26818 raft_consensus.cc:740] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Initialized, Role: LEARNER
I20260709 12:23:12.807278 26818 consensus_queue.cc:260] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:12.809727 26818 ts_tablet_manager.cc:1434] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 12:23:12.811350 25773 tablet_copy_service.cc:342] P 6e673265293d4e9a937dc45150aeb1b8: Request end of tablet copy session a866ff967d964388a6f0dff7fd43df89-06bd2840931844279521c7e8eb8750bf received from {username='slave'} at 127.0.0.1:48606
I20260709 12:23:12.811753 25773 tablet_copy_service.cc:434] P 6e673265293d4e9a937dc45150aeb1b8: ending tablet copy session a866ff967d964388a6f0dff7fd43df89-06bd2840931844279521c7e8eb8750bf on tablet 06bd2840931844279521c7e8eb8750bf with peer a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:12.930953 26439 raft_consensus.cc:1217] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 12:23:12.964185 26438 raft_consensus.cc:1217] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:13.184778 26438 raft_consensus.cc:1217] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 12:23:13.272424 26438 raft_consensus.cc:1217] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.2->[3.3-3.3]   Dedup: 3.3->[]
I20260709 12:23:13.353214 26829 raft_consensus.cc:1064] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8: attempting to promote NON_VOTER a866ff967d964388a6f0dff7fd43df89 to VOTER
I20260709 12:23:13.355837 26829 consensus_queue.cc:237] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:13.362253 26438 raft_consensus.cc:1275] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 3 LEARNER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:23:13.362824 25831 raft_consensus.cc:1275] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:23:13.363502 25680 raft_consensus.cc:1275] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:23:13.364406 26829 consensus_queue.cc:1048] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:13.365362 26799 consensus_queue.cc:1048] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:13.366282 26802 consensus_queue.cc:1048] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:13.390322 26802 raft_consensus.cc:2955] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:13.399978 25678 raft_consensus.cc:2955] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:13.421643 26438 raft_consensus.cc:2955] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:13.432070 26800 raft_consensus.cc:1064] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a: attempting to promote NON_VOTER a866ff967d964388a6f0dff7fd43df89 to VOTER
I20260709 12:23:13.435050 26800 consensus_queue.cc:237] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:23:13.477147 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 73982.4us
I20260709 12:23:13.476372 25831 raft_consensus.cc:2955] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:13.487735 25580 catalog_manager.cc:5697] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc reported cstate change: config changed from index 4 to 5, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:13.512398 25762 raft_consensus.cc:1275] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:13.515030 25678 raft_consensus.cc:1275] T 47453d79f4484e7ea165be91f0269a2b P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:13.514741 26800 consensus_queue.cc:1048] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:13.520347 26792 consensus_queue.cc:1048] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:13.529510 26438 raft_consensus.cc:1275] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:13.532115 26800 consensus_queue.cc:1048] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:23:13.616391 26840 log.cc:927] Time spent T 00000000000000000000000000000000 P 496fd6924b624e77b03ccfd15653d47b: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:23:13.630463 26792 raft_consensus.cc:2955] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:13.643357 25678 raft_consensus.cc:2955] T 47453d79f4484e7ea165be91f0269a2b P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
W20260709 12:23:13.666512 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 96689.2us
I20260709 12:23:13.675387 26438 raft_consensus.cc:2955] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:13.682292 25757 raft_consensus.cc:2955] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:13.700719 25756 consensus_queue.cc:237] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:13.707832 26439 raft_consensus.cc:1275] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:13.712245 25830 raft_consensus.cc:1275] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:13.714041 26835 consensus_queue.cc:1048] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:13.716522 26799 consensus_queue.cc:1048] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:13.712335 25581 catalog_manager.cc:5697] T 47453d79f4484e7ea165be91f0269a2b P f82778701b464892aab92a752ed7ffdc reported cstate change: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:13.721992 26837 raft_consensus.cc:2955] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:13.725566 26439 raft_consensus.cc:2955] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:13.732846 25568 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e535a01d34654e31ac7826205390f938 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:13.740813 25831 consensus_queue.cc:237] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:13.748381 26836 raft_consensus.cc:1064] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc: attempting to promote NON_VOTER a866ff967d964388a6f0dff7fd43df89 to VOTER
I20260709 12:23:13.750778 26836 consensus_queue.cc:237] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:13.757138 26438 raft_consensus.cc:1275] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:13.759176 26847 consensus_queue.cc:1048] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:13.756425 25581 catalog_manager.cc:5697] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: config changed from index 5 to 6, VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129) evicted. New cstate: current_term: 3 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:13.768829 25830 raft_consensus.cc:2955] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:13.776057 26437 raft_consensus.cc:1275] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 3 LEARNER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:23:13.778439 26836 consensus_queue.cc:1048] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:13.779019 26802 raft_consensus.cc:1064] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8: attempting to promote NON_VOTER a866ff967d964388a6f0dff7fd43df89 to VOTER
I20260709 12:23:13.781069 25756 raft_consensus.cc:1275] T 63f47864b8d248a792567d96c5e453b8 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:23:13.781445 26802 consensus_queue.cc:237] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 1, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:13.788995 25675 tablet_service.cc:1558] Processing DeleteTablet for tablet e535a01d34654e31ac7826205390f938 with delete_type TABLET_DATA_TOMBSTONED (TS f82778701b464892aab92a752ed7ffdc not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:40214
I20260709 12:23:13.789152 26844 consensus_queue.cc:1048] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:13.797345 25762 raft_consensus.cc:1275] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:13.799435 26792 raft_consensus.cc:2955] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:13.805240 26436 raft_consensus.cc:2955] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:13.807358 26854 tablet_replica.cc:333] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
I20260709 12:23:13.808562 26854 raft_consensus.cc:2243] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:13.809319 26854 raft_consensus.cc:2272] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:13.812932 26854 ts_tablet_manager.cc:1916] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:13.817436 26836 raft_consensus.cc:2955] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:13.818691 25831 raft_consensus.cc:1275] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:23:13.818990 25757 raft_consensus.cc:2955] T 63f47864b8d248a792567d96c5e453b8 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:13.821170 26844 consensus_queue.cc:1048] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:13.826581 25583 catalog_manager.cc:5697] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 reported cstate change: config changed from index 3 to 4, VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129) evicted. New cstate: current_term: 1 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:13.824834 26848 consensus_queue.cc:1048] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:13.835777 25762 raft_consensus.cc:2955] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:13.838208 25675 tablet_service.cc:1558] Processing DeleteTablet for tablet 47453d79f4484e7ea165be91f0269a2b with delete_type TABLET_DATA_TOMBSTONED (TS f82778701b464892aab92a752ed7ffdc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40214
I20260709 12:23:13.840998 26854 ts_tablet_manager.cc:1929] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 12:23:13.841593 26854 log.cc:1199] T e535a01d34654e31ac7826205390f938 P f82778701b464892aab92a752ed7ffdc: Deleting WAL directory at /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-0-root/wals/e535a01d34654e31ac7826205390f938
I20260709 12:23:13.841092 25580 catalog_manager.cc:5697] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc reported cstate change: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:13.843273 26854 tablet_replica.cc:333] T 47453d79f4484e7ea165be91f0269a2b P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
I20260709 12:23:13.844307 25569 catalog_manager.cc:5028] TS f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): tablet e535a01d34654e31ac7826205390f938 (table test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]) successfully deleted
I20260709 12:23:13.845636 26854 raft_consensus.cc:2243] T 47453d79f4484e7ea165be91f0269a2b P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:13.846755 26854 raft_consensus.cc:2272] T 47453d79f4484e7ea165be91f0269a2b P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:13.847558 25569 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 47453d79f4484e7ea165be91f0269a2b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:13.850167 26436 raft_consensus.cc:2955] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:13.866739 25678 raft_consensus.cc:1275] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:23:13.853775 25831 raft_consensus.cc:2955] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:13.875849 26837 consensus_queue.cc:1048] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:13.887286 25829 raft_consensus.cc:1275] T 06bd2840931844279521c7e8eb8750bf P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:23:13.853695 26437 raft_consensus.cc:1275] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 3 LEARNER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:23:13.894289 26837 consensus_queue.cc:1048] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:13.897315 26835 consensus_queue.cc:1048] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:13.899075 26854 ts_tablet_manager.cc:1916] T 47453d79f4484e7ea165be91f0269a2b P f82778701b464892aab92a752ed7ffdc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:13.945828 25829 raft_consensus.cc:2955] T 06bd2840931844279521c7e8eb8750bf P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:13.943132 26799 raft_consensus.cc:2955] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:13.959678 26854 ts_tablet_manager.cc:1929] T 47453d79f4484e7ea165be91f0269a2b P f82778701b464892aab92a752ed7ffdc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:13.960301 26854 log.cc:1199] T 47453d79f4484e7ea165be91f0269a2b P f82778701b464892aab92a752ed7ffdc: Deleting WAL directory at /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-0-root/wals/47453d79f4484e7ea165be91f0269a2b
I20260709 12:23:13.962347 26439 raft_consensus.cc:2955] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:13.978505 25569 catalog_manager.cc:5028] TS f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): tablet 47453d79f4484e7ea165be91f0269a2b (table test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]) successfully deleted
I20260709 12:23:13.983407 25678 raft_consensus.cc:2955] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:13.984802 25581 catalog_manager.cc:5697] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:14.021803 25757 consensus_queue.cc:237] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:14.027585 26439 raft_consensus.cc:1275] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:23:14.028013 25678 raft_consensus.cc:1275] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:23:14.029114 26799 consensus_queue.cc:1048] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:14.030057 26802 consensus_queue.cc:1048] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:14.037156 26802 raft_consensus.cc:2955] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:14.046269 26439 raft_consensus.cc:2955] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:14.049671 25568 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 06bd2840931844279521c7e8eb8750bf with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:14.046391 25678 raft_consensus.cc:2955] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:14.061012 25580 catalog_manager.cc:5697] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 reported cstate change: config changed from index 4 to 5, VOTER 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) evicted. New cstate: current_term: 3 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:14.076068 25824 tablet_service.cc:1558] Processing DeleteTablet for tablet 06bd2840931844279521c7e8eb8750bf with delete_type TABLET_DATA_TOMBSTONED (TS 5cccf20a8bff46dba6601f241d172b8a not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:44194
I20260709 12:23:14.078759 26861 tablet_replica.cc:333] T 06bd2840931844279521c7e8eb8750bf P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
I20260709 12:23:14.079782 26861 raft_consensus.cc:2243] T 06bd2840931844279521c7e8eb8750bf P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:14.080549 26861 raft_consensus.cc:2272] T 06bd2840931844279521c7e8eb8750bf P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:14.088193 26861 ts_tablet_manager.cc:1916] T 06bd2840931844279521c7e8eb8750bf P 5cccf20a8bff46dba6601f241d172b8a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:14.102931 26861 ts_tablet_manager.cc:1929] T 06bd2840931844279521c7e8eb8750bf P 5cccf20a8bff46dba6601f241d172b8a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 12:23:14.103411 26861 log.cc:1199] T 06bd2840931844279521c7e8eb8750bf P 5cccf20a8bff46dba6601f241d172b8a: Deleting WAL directory at /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-2-root/wals/06bd2840931844279521c7e8eb8750bf
I20260709 12:23:14.105031 25569 catalog_manager.cc:5028] TS 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): tablet 06bd2840931844279521c7e8eb8750bf (table test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]) successfully deleted
I20260709 12:23:14.338796 25686 consensus_queue.cc:237] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:14.344523 26439 raft_consensus.cc:1275] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:23:14.347754 25831 raft_consensus.cc:1275] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:23:14.348670 26581 consensus_queue.cc:1048] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:14.350090 26581 consensus_queue.cc:1048] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:14.357167 26773 raft_consensus.cc:2955] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:14.364557 25569 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 63f47864b8d248a792567d96c5e453b8 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:14.364847 26436 raft_consensus.cc:2955] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:14.371227 25830 raft_consensus.cc:2955] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:14.379350 25581 catalog_manager.cc:5697] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: config changed from index 4 to 5, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New cstate: current_term: 3 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:14.395583 25753 tablet_service.cc:1558] Processing DeleteTablet for tablet 63f47864b8d248a792567d96c5e453b8 with delete_type TABLET_DATA_TOMBSTONED (TS 6e673265293d4e9a937dc45150aeb1b8 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:53452
I20260709 12:23:14.397981 26862 tablet_replica.cc:333] T 63f47864b8d248a792567d96c5e453b8 P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
I20260709 12:23:14.398922 26862 raft_consensus.cc:2243] T 63f47864b8d248a792567d96c5e453b8 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:14.399662 26862 raft_consensus.cc:2272] T 63f47864b8d248a792567d96c5e453b8 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:14.402585 26862 ts_tablet_manager.cc:1916] T 63f47864b8d248a792567d96c5e453b8 P 6e673265293d4e9a937dc45150aeb1b8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:14.415825 26862 ts_tablet_manager.cc:1929] T 63f47864b8d248a792567d96c5e453b8 P 6e673265293d4e9a937dc45150aeb1b8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 12:23:14.416222 26862 log.cc:1199] T 63f47864b8d248a792567d96c5e453b8 P 6e673265293d4e9a937dc45150aeb1b8: Deleting WAL directory at /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-1-root/wals/63f47864b8d248a792567d96c5e453b8
I20260709 12:23:14.417681 25568 catalog_manager.cc:5028] TS 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): tablet 63f47864b8d248a792567d96c5e453b8 (table test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]) successfully deleted
I20260709 12:23:15.507160 25678 consensus_queue.cc:237] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
W20260709 12:23:15.516072 25650 consensus_peers.cc:597] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc -> Peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Couldn't send request to peer a866ff967d964388a6f0dff7fd43df89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3d79b16002fc460a9e70bd0a5bcec639. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:15.516863 25831 raft_consensus.cc:1275] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:15.517930 25756 raft_consensus.cc:1275] T 3d79b16002fc460a9e70bd0a5bcec639 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:15.519399 26836 consensus_queue.cc:1048] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:15.520885 26773 consensus_queue.cc:1048] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:15.529754 26773 raft_consensus.cc:2955] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:15.531154 25756 raft_consensus.cc:2955] T 3d79b16002fc460a9e70bd0a5bcec639 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:15.532002 25830 raft_consensus.cc:2955] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:15.556186 25583 catalog_manager.cc:5697] T 3d79b16002fc460a9e70bd0a5bcec639 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New cstate: current_term: 1 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:15.584530 25678 consensus_queue.cc:237] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
W20260709 12:23:15.600296 25650 consensus_peers.cc:597] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc -> Peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Couldn't send request to peer a866ff967d964388a6f0dff7fd43df89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8d74d1c9c8a84919a6f57b0b6721de51. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:15.602165 25756 raft_consensus.cc:1275] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:15.602321 25831 raft_consensus.cc:1275] T 8d74d1c9c8a84919a6f57b0b6721de51 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:15.604031 26773 consensus_queue.cc:1048] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:15.605494 26773 consensus_queue.cc:1048] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:15.619994 25756 raft_consensus.cc:2955] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:15.622026 25830 raft_consensus.cc:2955] T 8d74d1c9c8a84919a6f57b0b6721de51 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:15.616947 26581 raft_consensus.cc:2955] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:15.653134 25830 consensus_queue.cc:237] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:15.662111 25581 catalog_manager.cc:5697] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New cstate: current_term: 1 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:15.670069 25756 raft_consensus.cc:1275] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:15.670780 25678 raft_consensus.cc:1275] T a8fa32386b77471b923cc6c4241570d5 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:15.672065 25801 consensus_peers.cc:597] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a -> Peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Couldn't send request to peer a866ff967d964388a6f0dff7fd43df89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a8fa32386b77471b923cc6c4241570d5. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:15.673097 26874 consensus_queue.cc:1048] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:15.674863 26851 consensus_queue.cc:1048] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:15.690003 26792 raft_consensus.cc:2955] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:15.692684 25757 raft_consensus.cc:2955] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:15.706698 25678 raft_consensus.cc:2955] T a8fa32386b77471b923cc6c4241570d5 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:15.721760 25580 catalog_manager.cc:5697] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New cstate: current_term: 1 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:15.736472 25678 consensus_queue.cc:237] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:15.747098 25756 raft_consensus.cc:1275] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:15.748986 26868 consensus_queue.cc:1048] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:15.749788 25830 raft_consensus.cc:1275] T 0a6b77683d6547db82cd02da9d9c938a P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:15.751168 25650 consensus_peers.cc:597] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc -> Peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Couldn't send request to peer a866ff967d964388a6f0dff7fd43df89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0a6b77683d6547db82cd02da9d9c938a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:15.751375 26868 consensus_queue.cc:1048] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:15.758731 26773 raft_consensus.cc:2955] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:15.759778 25756 raft_consensus.cc:2955] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:15.778693 25583 catalog_manager.cc:5697] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New cstate: current_term: 1 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:15.882586 25831 raft_consensus.cc:2955] T 0a6b77683d6547db82cd02da9d9c938a P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:16.075637 26885 ts_tablet_manager.cc:933] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89: Initiating tablet copy from peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349)
I20260709 12:23:16.080752 26885 tablet_copy_client.cc:323] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Beginning tablet copy session from remote peer at address 127.23.245.129:37349
I20260709 12:23:16.083271 25696 tablet_copy_service.cc:140] P f82778701b464892aab92a752ed7ffdc: Received BeginTabletCopySession request for tablet 3d79b16002fc460a9e70bd0a5bcec639 from peer a866ff967d964388a6f0dff7fd43df89 ({username='slave'} at 127.0.0.1:51578)
I20260709 12:23:16.083895 25696 tablet_copy_service.cc:161] P f82778701b464892aab92a752ed7ffdc: Beginning new tablet copy session on tablet 3d79b16002fc460a9e70bd0a5bcec639 from peer a866ff967d964388a6f0dff7fd43df89 at {username='slave'} at 127.0.0.1:51578: session id = a866ff967d964388a6f0dff7fd43df89-3d79b16002fc460a9e70bd0a5bcec639
I20260709 12:23:16.093412 25696 tablet_copy_source_session.cc:215] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:16.097062 26885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d79b16002fc460a9e70bd0a5bcec639. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:16.117635 26885 tablet_copy_client.cc:806] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:16.118260 26885 tablet_copy_client.cc:670] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:16.123054 26885 tablet_copy_client.cc:538] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:16.133077 26885 tablet_bootstrap.cc:492] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89: Bootstrap starting.
I20260709 12:23:16.152709 26887 ts_tablet_manager.cc:933] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89: Initiating tablet copy from peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:16.158703 26888 ts_tablet_manager.cc:933] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89: Initiating tablet copy from peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349)
I20260709 12:23:16.170650 26885 tablet_bootstrap.cc:492] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:16.171797 26887 tablet_copy_client.cc:323] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Beginning tablet copy session from remote peer at address 127.23.245.131:36237
I20260709 12:23:16.173791 25847 tablet_copy_service.cc:140] P 5cccf20a8bff46dba6601f241d172b8a: Received BeginTabletCopySession request for tablet a8fa32386b77471b923cc6c4241570d5 from peer a866ff967d964388a6f0dff7fd43df89 ({username='slave'} at 127.0.0.1:41782)
I20260709 12:23:16.174388 25847 tablet_copy_service.cc:161] P 5cccf20a8bff46dba6601f241d172b8a: Beginning new tablet copy session on tablet a8fa32386b77471b923cc6c4241570d5 from peer a866ff967d964388a6f0dff7fd43df89 at {username='slave'} at 127.0.0.1:41782: session id = a866ff967d964388a6f0dff7fd43df89-a8fa32386b77471b923cc6c4241570d5
I20260709 12:23:16.172065 26885 tablet_bootstrap.cc:492] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89: Bootstrap complete.
I20260709 12:23:16.175527 26885 ts_tablet_manager.cc:1403] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89: Time spent bootstrapping tablet: real 0.043s	user 0.019s	sys 0.011s
I20260709 12:23:16.181490 26885 raft_consensus.cc:359] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:16.183575 26885 raft_consensus.cc:740] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Initialized, Role: LEARNER
I20260709 12:23:16.184600 26885 consensus_queue.cc:260] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:16.194819 25847 tablet_copy_source_session.cc:215] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:16.195493 26885 ts_tablet_manager.cc:1434] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.007s
I20260709 12:23:16.200026 25696 tablet_copy_service.cc:342] P f82778701b464892aab92a752ed7ffdc: Request end of tablet copy session a866ff967d964388a6f0dff7fd43df89-3d79b16002fc460a9e70bd0a5bcec639 received from {username='slave'} at 127.0.0.1:51578
I20260709 12:23:16.204317 25696 tablet_copy_service.cc:434] P f82778701b464892aab92a752ed7ffdc: ending tablet copy session a866ff967d964388a6f0dff7fd43df89-3d79b16002fc460a9e70bd0a5bcec639 on tablet 3d79b16002fc460a9e70bd0a5bcec639 with peer a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:16.207268 26888 tablet_copy_client.cc:323] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Beginning tablet copy session from remote peer at address 127.23.245.129:37349
I20260709 12:23:16.209352 25696 tablet_copy_service.cc:140] P f82778701b464892aab92a752ed7ffdc: Received BeginTabletCopySession request for tablet 8d74d1c9c8a84919a6f57b0b6721de51 from peer a866ff967d964388a6f0dff7fd43df89 ({username='slave'} at 127.0.0.1:51578)
I20260709 12:23:16.209589 26887 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8fa32386b77471b923cc6c4241570d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:16.209872 25696 tablet_copy_service.cc:161] P f82778701b464892aab92a752ed7ffdc: Beginning new tablet copy session on tablet 8d74d1c9c8a84919a6f57b0b6721de51 from peer a866ff967d964388a6f0dff7fd43df89 at {username='slave'} at 127.0.0.1:51578: session id = a866ff967d964388a6f0dff7fd43df89-8d74d1c9c8a84919a6f57b0b6721de51
I20260709 12:23:16.215404 25696 tablet_copy_source_session.cc:215] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:16.218175 26888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d74d1c9c8a84919a6f57b0b6721de51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:16.226285 26887 tablet_copy_client.cc:806] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:16.226898 26887 tablet_copy_client.cc:670] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:16.232146 26888 tablet_copy_client.cc:806] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:16.232810 26888 tablet_copy_client.cc:670] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:16.235574 26887 tablet_copy_client.cc:538] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:16.236629 26888 tablet_copy_client.cc:538] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:16.243507 26888 tablet_bootstrap.cc:492] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89: Bootstrap starting.
I20260709 12:23:16.244657 26887 tablet_bootstrap.cc:492] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89: Bootstrap starting.
I20260709 12:23:16.271742 26888 tablet_bootstrap.cc:492] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:16.272855 26888 tablet_bootstrap.cc:492] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89: Bootstrap complete.
I20260709 12:23:16.273602 26888 ts_tablet_manager.cc:1403] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.013s
I20260709 12:23:16.276618 26888 raft_consensus.cc:359] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:16.277519 26888 raft_consensus.cc:740] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Initialized, Role: LEARNER
I20260709 12:23:16.278213 26888 consensus_queue.cc:260] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:16.284078 26888 ts_tablet_manager.cc:1434] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:23:16.300702 26885 ts_tablet_manager.cc:933] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89: Initiating tablet copy from peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349)
I20260709 12:23:16.302757 25696 tablet_copy_service.cc:342] P f82778701b464892aab92a752ed7ffdc: Request end of tablet copy session a866ff967d964388a6f0dff7fd43df89-8d74d1c9c8a84919a6f57b0b6721de51 received from {username='slave'} at 127.0.0.1:51578
I20260709 12:23:16.303179 25696 tablet_copy_service.cc:434] P f82778701b464892aab92a752ed7ffdc: ending tablet copy session a866ff967d964388a6f0dff7fd43df89-8d74d1c9c8a84919a6f57b0b6721de51 on tablet 8d74d1c9c8a84919a6f57b0b6721de51 with peer a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:16.316350 26885 tablet_copy_client.cc:323] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89: tablet copy: Beginning tablet copy session from remote peer at address 127.23.245.129:37349
I20260709 12:23:16.318032 25696 tablet_copy_service.cc:140] P f82778701b464892aab92a752ed7ffdc: Received BeginTabletCopySession request for tablet 0a6b77683d6547db82cd02da9d9c938a from peer a866ff967d964388a6f0dff7fd43df89 ({username='slave'} at 127.0.0.1:51578)
I20260709 12:23:16.318498 25696 tablet_copy_service.cc:161] P f82778701b464892aab92a752ed7ffdc: Beginning new tablet copy session on tablet 0a6b77683d6547db82cd02da9d9c938a from peer a866ff967d964388a6f0dff7fd43df89 at {username='slave'} at 127.0.0.1:51578: session id = a866ff967d964388a6f0dff7fd43df89-0a6b77683d6547db82cd02da9d9c938a
I20260709 12:23:16.323120 26887 tablet_bootstrap.cc:492] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:16.324077 26887 tablet_bootstrap.cc:492] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89: Bootstrap complete.
I20260709 12:23:16.324707 26887 ts_tablet_manager.cc:1403] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89: Time spent bootstrapping tablet: real 0.080s	user 0.039s	sys 0.032s
I20260709 12:23:16.327445 25696 tablet_copy_source_session.cc:215] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:16.328118 26887 raft_consensus.cc:359] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:16.329051 26887 raft_consensus.cc:740] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Initialized, Role: LEARNER
I20260709 12:23:16.330067 26885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a6b77683d6547db82cd02da9d9c938a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:16.329679 26887 consensus_queue.cc:260] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:16.332201 26887 ts_tablet_manager.cc:1434] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:23:16.336618 25847 tablet_copy_service.cc:342] P 5cccf20a8bff46dba6601f241d172b8a: Request end of tablet copy session a866ff967d964388a6f0dff7fd43df89-a8fa32386b77471b923cc6c4241570d5 received from {username='slave'} at 127.0.0.1:41782
I20260709 12:23:16.337074 25847 tablet_copy_service.cc:434] P 5cccf20a8bff46dba6601f241d172b8a: ending tablet copy session a866ff967d964388a6f0dff7fd43df89-a8fa32386b77471b923cc6c4241570d5 on tablet a8fa32386b77471b923cc6c4241570d5 with peer a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:16.352555 26885 tablet_copy_client.cc:806] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:16.353092 26885 tablet_copy_client.cc:670] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:16.360149 26885 tablet_copy_client.cc:538] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:16.366113 26885 tablet_bootstrap.cc:492] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89: Bootstrap starting.
I20260709 12:23:16.388693 26885 tablet_bootstrap.cc:492] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:16.389407 26885 tablet_bootstrap.cc:492] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89: Bootstrap complete.
I20260709 12:23:16.389938 26885 ts_tablet_manager.cc:1403] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89: Time spent bootstrapping tablet: real 0.024s	user 0.022s	sys 0.001s
I20260709 12:23:16.392110 26885 raft_consensus.cc:359] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:16.392761 26885 raft_consensus.cc:740] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Initialized, Role: LEARNER
I20260709 12:23:16.393246 26885 consensus_queue.cc:260] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:16.395078 26885 ts_tablet_manager.cc:1434] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.004s
I20260709 12:23:16.396970 25696 tablet_copy_service.cc:342] P f82778701b464892aab92a752ed7ffdc: Request end of tablet copy session a866ff967d964388a6f0dff7fd43df89-0a6b77683d6547db82cd02da9d9c938a received from {username='slave'} at 127.0.0.1:51578
I20260709 12:23:16.397379 25696 tablet_copy_service.cc:434] P f82778701b464892aab92a752ed7ffdc: ending tablet copy session a866ff967d964388a6f0dff7fd43df89-0a6b77683d6547db82cd02da9d9c938a on tablet 0a6b77683d6547db82cd02da9d9c938a with peer a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:16.544629 26439 raft_consensus.cc:1217] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:16.655074 26439 raft_consensus.cc:1217] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:16.678900 26439 raft_consensus.cc:1217] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:16.840564 26436 raft_consensus.cc:1217] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:17.074457 26897 raft_consensus.cc:1064] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a: attempting to promote NON_VOTER a866ff967d964388a6f0dff7fd43df89 to VOTER
I20260709 12:23:17.077080 26897 consensus_queue.cc:237] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:17.090236 26436 raft_consensus.cc:1275] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:17.092324 25756 raft_consensus.cc:1275] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:17.094588 26901 consensus_queue.cc:1048] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:17.096599 26901 consensus_queue.cc:1048] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:17.106534 25686 raft_consensus.cc:1275] T a8fa32386b77471b923cc6c4241570d5 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:17.108449 26901 consensus_queue.cc:1048] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:17.120420 26897 raft_consensus.cc:2955] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:17.122227 26436 raft_consensus.cc:2955] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:17.132216 25756 raft_consensus.cc:2955] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:17.142762 25678 raft_consensus.cc:2955] T a8fa32386b77471b923cc6c4241570d5 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:17.144109 25581 catalog_manager.cc:5697] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:17.203732 25830 consensus_queue.cc:237] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:17.210541 26436 raft_consensus.cc:1275] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:17.211700 26901 consensus_queue.cc:1048] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:17.212595 25756 raft_consensus.cc:1275] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:17.213950 26901 consensus_queue.cc:1048] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:17.218253 26897 raft_consensus.cc:2955] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:17.230077 26436 raft_consensus.cc:2955] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:17.230285 25756 raft_consensus.cc:2955] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:17.247227 25582 catalog_manager.cc:5697] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: config changed from index 3 to 4, VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129) evicted. New cstate: current_term: 1 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:17.249768 25569 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a8fa32386b77471b923cc6c4241570d5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:17.261873 26884 raft_consensus.cc:1064] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc: attempting to promote NON_VOTER a866ff967d964388a6f0dff7fd43df89 to VOTER
I20260709 12:23:17.265120 25675 tablet_service.cc:1558] Processing DeleteTablet for tablet a8fa32386b77471b923cc6c4241570d5 with delete_type TABLET_DATA_TOMBSTONED (TS f82778701b464892aab92a752ed7ffdc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40214
I20260709 12:23:17.264861 26884 consensus_queue.cc:237] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:17.269944 26773 raft_consensus.cc:1064] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc: attempting to promote NON_VOTER a866ff967d964388a6f0dff7fd43df89 to VOTER
I20260709 12:23:17.271804 26909 tablet_replica.cc:333] T a8fa32386b77471b923cc6c4241570d5 P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
I20260709 12:23:17.275888 26909 raft_consensus.cc:2243] T a8fa32386b77471b923cc6c4241570d5 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:17.277101 26909 raft_consensus.cc:2272] T a8fa32386b77471b923cc6c4241570d5 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:17.281884 26773 consensus_queue.cc:237] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:17.286432 26909 ts_tablet_manager.cc:1916] T a8fa32386b77471b923cc6c4241570d5 P f82778701b464892aab92a752ed7ffdc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:17.302086 25756 raft_consensus.cc:1275] T 3d79b16002fc460a9e70bd0a5bcec639 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:17.304368 26911 consensus_queue.cc:1048] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:17.314437 25762 raft_consensus.cc:1275] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:17.316082 26773 consensus_queue.cc:1048] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:17.322225 26436 raft_consensus.cc:1275] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:17.322475 26909 ts_tablet_manager.cc:1929] T a8fa32386b77471b923cc6c4241570d5 P f82778701b464892aab92a752ed7ffdc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:17.323187 26909 log.cc:1199] T a8fa32386b77471b923cc6c4241570d5 P f82778701b464892aab92a752ed7ffdc: Deleting WAL directory at /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-0-root/wals/a8fa32386b77471b923cc6c4241570d5
I20260709 12:23:17.323571 25830 raft_consensus.cc:1275] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:17.325141 25569 catalog_manager.cc:5028] TS f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): tablet a8fa32386b77471b923cc6c4241570d5 (table test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]) successfully deleted
I20260709 12:23:17.328754 26436 raft_consensus.cc:1275] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:17.329186 26868 consensus_queue.cc:1048] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:17.330722 25831 raft_consensus.cc:1275] T 8d74d1c9c8a84919a6f57b0b6721de51 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:17.331962 26868 consensus_queue.cc:1048] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:17.334164 26868 consensus_queue.cc:1048] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:17.342321 26868 consensus_queue.cc:1048] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:17.344667 26911 raft_consensus.cc:2955] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:17.356985 25828 raft_consensus.cc:2955] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:17.367349 25762 raft_consensus.cc:2955] T 3d79b16002fc460a9e70bd0a5bcec639 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:17.383057 25582 catalog_manager.cc:5697] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc reported cstate change: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:17.389324 26439 raft_consensus.cc:2955] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:17.443473 25678 consensus_queue.cc:237] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:17.468346 25831 raft_consensus.cc:1275] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:17.484704 26911 raft_consensus.cc:2955] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:17.486289 26436 raft_consensus.cc:1275] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:17.497663 26915 raft_consensus.cc:1064] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc: attempting to promote NON_VOTER a866ff967d964388a6f0dff7fd43df89 to VOTER
I20260709 12:23:17.501646 25762 raft_consensus.cc:2955] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:17.504326 26439 raft_consensus.cc:2955] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:17.506079 26915 consensus_queue.cc:237] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:17.509747 26773 consensus_queue.cc:1048] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:17.527277 25580 catalog_manager.cc:5697] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:17.528863 26911 consensus_queue.cc:1048] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:17.537370 25831 raft_consensus.cc:2955] T 8d74d1c9c8a84919a6f57b0b6721de51 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:17.552438 25756 raft_consensus.cc:1275] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:17.552999 25678 consensus_queue.cc:237] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:17.555114 26439 raft_consensus.cc:1275] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:17.563459 26911 consensus_queue.cc:1048] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:17.566466 25828 raft_consensus.cc:1275] T 0a6b77683d6547db82cd02da9d9c938a P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:17.570569 25756 raft_consensus.cc:1275] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:17.574656 26868 consensus_queue.cc:1048] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:23:17.569831 26773 raft_consensus.cc:2955] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:17.590042 26913 consensus_queue.cc:1048] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:17.594255 26913 consensus_queue.cc:1048] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:17.598696 25569 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3d79b16002fc460a9e70bd0a5bcec639 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:17.599161 26439 raft_consensus.cc:1275] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:17.603583 26439 raft_consensus.cc:2955] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:17.608615 26913 raft_consensus.cc:2955] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:17.611907 25831 raft_consensus.cc:2955] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:17.620607 25757 raft_consensus.cc:2955] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:17.623073 25582 catalog_manager.cc:5697] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc reported cstate change: config changed from index 3 to 4, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New cstate: current_term: 1 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:17.640794 25569 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8d74d1c9c8a84919a6f57b0b6721de51 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:17.643324 25753 tablet_service.cc:1558] Processing DeleteTablet for tablet 3d79b16002fc460a9e70bd0a5bcec639 with delete_type TABLET_DATA_TOMBSTONED (TS 6e673265293d4e9a937dc45150aeb1b8 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53452
I20260709 12:23:17.644968 25582 catalog_manager.cc:5697] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: config changed from index 3 to 4, VOTER 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) evicted. New cstate: current_term: 1 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:17.655177 26915 consensus_queue.cc:1048] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:17.659443 25824 tablet_service.cc:1558] Processing DeleteTablet for tablet 8d74d1c9c8a84919a6f57b0b6721de51 with delete_type TABLET_DATA_TOMBSTONED (TS 5cccf20a8bff46dba6601f241d172b8a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44194
I20260709 12:23:17.661433 26915 raft_consensus.cc:2955] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:17.662887 26927 tablet_replica.cc:333] T 8d74d1c9c8a84919a6f57b0b6721de51 P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
I20260709 12:23:17.663977 26927 raft_consensus.cc:2243] T 8d74d1c9c8a84919a6f57b0b6721de51 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:17.666201 26927 raft_consensus.cc:2272] T 8d74d1c9c8a84919a6f57b0b6721de51 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:17.670198 26927 ts_tablet_manager.cc:1916] T 8d74d1c9c8a84919a6f57b0b6721de51 P 5cccf20a8bff46dba6601f241d172b8a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:17.677098 26439 raft_consensus.cc:2955] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:17.679495 26926 tablet_replica.cc:333] T 3d79b16002fc460a9e70bd0a5bcec639 P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
I20260709 12:23:17.680765 26926 raft_consensus.cc:2243] T 3d79b16002fc460a9e70bd0a5bcec639 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:17.686412 26926 raft_consensus.cc:2272] T 3d79b16002fc460a9e70bd0a5bcec639 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:17.687829 26437 raft_consensus.cc:2955] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:17.695372 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:17.696833 26926 ts_tablet_manager.cc:1916] T 3d79b16002fc460a9e70bd0a5bcec639 P 6e673265293d4e9a937dc45150aeb1b8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:17.698232 25828 raft_consensus.cc:2955] T 0a6b77683d6547db82cd02da9d9c938a P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:17.714437 25582 catalog_manager.cc:5697] T 0a6b77683d6547db82cd02da9d9c938a P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:17.716876 26927 ts_tablet_manager.cc:1929] T 8d74d1c9c8a84919a6f57b0b6721de51 P 5cccf20a8bff46dba6601f241d172b8a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:17.730552 25757 raft_consensus.cc:2955] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:17.731832 26927 log.cc:1199] T 8d74d1c9c8a84919a6f57b0b6721de51 P 5cccf20a8bff46dba6601f241d172b8a: Deleting WAL directory at /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-2-root/wals/8d74d1c9c8a84919a6f57b0b6721de51
I20260709 12:23:17.734923 25569 catalog_manager.cc:5028] TS 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): tablet 8d74d1c9c8a84919a6f57b0b6721de51 (table test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]) successfully deleted
I20260709 12:23:17.744732 26926 ts_tablet_manager.cc:1929] T 3d79b16002fc460a9e70bd0a5bcec639 P 6e673265293d4e9a937dc45150aeb1b8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:17.745186 26926 log.cc:1199] T 3d79b16002fc460a9e70bd0a5bcec639 P 6e673265293d4e9a937dc45150aeb1b8: Deleting WAL directory at /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-1-root/wals/3d79b16002fc460a9e70bd0a5bcec639
I20260709 12:23:17.746841 25568 catalog_manager.cc:5028] TS 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): tablet 3d79b16002fc460a9e70bd0a5bcec639 (table test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]) successfully deleted
I20260709 12:23:17.754292 25678 consensus_queue.cc:237] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:17.761059 26437 raft_consensus.cc:1275] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:17.766168 26914 consensus_queue.cc:1048] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:17.773131 25757 raft_consensus.cc:1275] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:17.784308 26911 consensus_queue.cc:1048] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:17.785287 26773 raft_consensus.cc:2955] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:17.788868 25757 raft_consensus.cc:2955] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:17.797842 26437 raft_consensus.cc:2955] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:17.804826 25569 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0a6b77683d6547db82cd02da9d9c938a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:17.813047 25582 catalog_manager.cc:5697] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 reported cstate change: config changed from index 3 to 4, VOTER 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) evicted. New cstate: current_term: 1 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:17.826046 25824 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a6b77683d6547db82cd02da9d9c938a with delete_type TABLET_DATA_TOMBSTONED (TS 5cccf20a8bff46dba6601f241d172b8a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44194
I20260709 12:23:17.826982 26927 tablet_replica.cc:333] T 0a6b77683d6547db82cd02da9d9c938a P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
I20260709 12:23:17.828202 26927 raft_consensus.cc:2243] T 0a6b77683d6547db82cd02da9d9c938a P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:17.829030 26927 raft_consensus.cc:2272] T 0a6b77683d6547db82cd02da9d9c938a P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:17.832887 26927 ts_tablet_manager.cc:1916] T 0a6b77683d6547db82cd02da9d9c938a P 5cccf20a8bff46dba6601f241d172b8a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:17.834002 25828 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25bd5658646b41608d707d196c6e0585"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:23:17.834738 25828 raft_consensus.cc:606] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Received request to transfer leadership to TS 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:17.852617 26927 ts_tablet_manager.cc:1929] T 0a6b77683d6547db82cd02da9d9c938a P 5cccf20a8bff46dba6601f241d172b8a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:17.853137 26927 log.cc:1199] T 0a6b77683d6547db82cd02da9d9c938a P 5cccf20a8bff46dba6601f241d172b8a: Deleting WAL directory at /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-2-root/wals/0a6b77683d6547db82cd02da9d9c938a
I20260709 12:23:17.854346 25569 catalog_manager.cc:5028] TS 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): tablet 0a6b77683d6547db82cd02da9d9c938a (table test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]) successfully deleted
I20260709 12:23:17.855768 25685 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
mode: GRACEFUL
new_leader_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:49108
I20260709 12:23:17.856375 25685 raft_consensus.cc:606] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 2 LEADER]: Received request to transfer leadership to TS 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:17.858594 25828 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "a866ff967d964388a6f0dff7fd43df89"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:23:17.859098 25828 raft_consensus.cc:606] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Received request to transfer leadership to TS a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:17.861421 25828 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:23:17.861941 25828 raft_consensus.cc:606] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Received request to transfer leadership to TS 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:17.864167 25828 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:23:17.864663 25828 raft_consensus.cc:606] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 3 LEADER]: Received request to transfer leadership to TS 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:17.865620 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:23:17.866626 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:17.867282 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:17.953290 26901 raft_consensus.cc:993] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a: : Instructing follower 6e673265293d4e9a937dc45150aeb1b8 to start an election
I20260709 12:23:17.953869 26792 raft_consensus.cc:1081] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 3 LEADER]: Signalling peer 6e673265293d4e9a937dc45150aeb1b8 to start an election
I20260709 12:23:17.955299 25762 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:53460
I20260709 12:23:17.955765 25762 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:17.956089 25762 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:17.960824 25762 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:17.962482 25762 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:17.963256 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:17.963610 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:17.963936 25685 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:17.964223 25828 raft_consensus.cc:3055] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:17.964529 25828 raft_consensus.cc:740] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:17.965229 25828 consensus_queue.cc:260] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:17.966442 25828 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:17.970366 25685 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 4.
I20260709 12:23:17.971750 25726 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:17.972550 25828 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 4.
I20260709 12:23:17.972568 26864 raft_consensus.cc:2804] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:17.973289 26864 raft_consensus.cc:697] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:17.974092 26864 consensus_queue.cc:237] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:17.985088 25582 catalog_manager.cc:5697] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 3 to 4, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 4 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:18.067325 26792 raft_consensus.cc:993] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a: : Instructing follower 6e673265293d4e9a937dc45150aeb1b8 to start an election
I20260709 12:23:18.067842 26897 raft_consensus.cc:1081] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Signalling peer 6e673265293d4e9a937dc45150aeb1b8 to start an election
I20260709 12:23:18.069506 25757 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:53460
I20260709 12:23:18.070029 25757 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:18.070344 25757 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:18.074139 26901 raft_consensus.cc:993] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a: : Instructing follower 6e673265293d4e9a937dc45150aeb1b8 to start an election
I20260709 12:23:18.074635 26897 raft_consensus.cc:1081] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Signalling peer 6e673265293d4e9a937dc45150aeb1b8 to start an election
I20260709 12:23:18.076087 25762 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "25bd5658646b41608d707d196c6e0585"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:53460
I20260709 12:23:18.076629 25762 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:18.076917 25762 raft_consensus.cc:3060] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:18.077512 25757 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:18.079481 25757 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:18.083214 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:18.083850 25762 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:18.084926 25828 raft_consensus.cc:3055] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:18.085536 25828 raft_consensus.cc:740] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:18.086419 25828 consensus_queue.cc:260] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:18.087635 25762 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:18.087865 25828 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:18.093327 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:18.093874 25685 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:18.094744 25828 raft_consensus.cc:2468] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 2.
I20260709 12:23:18.097918 25726 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:23:18.098670 26864 raft_consensus.cc:2804] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:18.098726 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:18.099941 26864 raft_consensus.cc:697] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:18.099972 25828 raft_consensus.cc:3055] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:18.100137 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:18.100549 25828 raft_consensus.cc:740] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:18.100759 25678 raft_consensus.cc:3060] T 25bd5658646b41608d707d196c6e0585 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:18.100970 26864 consensus_queue.cc:237] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:18.101405 25828 consensus_queue.cc:260] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:18.102576 25828 raft_consensus.cc:3060] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:18.105376 25678 raft_consensus.cc:2468] T 25bd5658646b41608d707d196c6e0585 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 2.
I20260709 12:23:18.106593 25726 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:18.107354 25685 raft_consensus.cc:2468] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 2.
I20260709 12:23:18.107836 26931 raft_consensus.cc:2804] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:18.108309 26931 raft_consensus.cc:697] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:18.109112 26931 consensus_queue.cc:237] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:18.109885 25828 raft_consensus.cc:2468] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 2.
I20260709 12:23:18.118660 25582 catalog_manager.cc:5697] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 1 to 2, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 2 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:18.131404 25582 catalog_manager.cc:5697] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 1 to 2, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 2 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:18.221629 26901 raft_consensus.cc:993] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a: : Instructing follower a866ff967d964388a6f0dff7fd43df89 to start an election
I20260709 12:23:18.222128 26897 raft_consensus.cc:1081] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Signalling peer a866ff967d964388a6f0dff7fd43df89 to start an election
I20260709 12:23:18.223744 26439 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5"
dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
 from {username='slave'} at 127.0.0.1:36508
I20260709 12:23:18.224292 26439 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:18.224627 26439 raft_consensus.cc:3060] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:18.228915 26439 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:18.230726 26439 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:18.231673 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:18.231611 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:18.232388 25828 raft_consensus.cc:3055] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:18.232698 25757 raft_consensus.cc:3060] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:18.232712 25828 raft_consensus.cc:740] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:18.233640 25828 consensus_queue.cc:260] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:18.234671 25828 raft_consensus.cc:3060] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:18.235973 26911 raft_consensus.cc:993] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc: : Instructing follower 6e673265293d4e9a937dc45150aeb1b8 to start an election
I20260709 12:23:18.236472 26773 raft_consensus.cc:1081] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 2 LEADER]: Signalling peer 6e673265293d4e9a937dc45150aeb1b8 to start an election
I20260709 12:23:18.238397 25762 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:53474
I20260709 12:23:18.238920 25762 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:18.239272 25762 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:18.240923 25757 raft_consensus.cc:2468] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 2.
I20260709 12:23:18.241034 25828 raft_consensus.cc:2468] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 2.
I20260709 12:23:18.242267 26402 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:18.243211 26892 raft_consensus.cc:2804] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:18.245354 26892 raft_consensus.cc:697] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:23:18.246255 26892 consensus_queue.cc:237] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:18.248564 25762 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:18.251856 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:18.252410 25685 raft_consensus.cc:3055] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:18.252705 25685 raft_consensus.cc:740] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:18.253320 25685 consensus_queue.cc:260] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:18.254197 25685 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:18.257265 25582 catalog_manager.cc:5697] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 1 to 2, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 2 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:18.260229 25685 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 3.
I20260709 12:23:18.261229 25726 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:18.262055 26931 raft_consensus.cc:2804] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:18.261160 25762 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:18.263257 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:18.263804 25831 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:18.262616 26931 raft_consensus.cc:697] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:18.266675 26931 consensus_queue.cc:237] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:18.271286 25831 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 3.
I20260709 12:23:18.281502 25582 catalog_manager.cc:5697] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 2 to 3, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 3 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:18.507340 25831 raft_consensus.cc:1275] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:18.508571 26864 consensus_queue.cc:1048] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:18.519567 25678 raft_consensus.cc:1275] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:18.520965 26864 consensus_queue.cc:1048] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:18.529326 25685 raft_consensus.cc:1275] T 25bd5658646b41608d707d196c6e0585 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:18.530726 26864 consensus_queue.cc:1048] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:18.546214 25828 raft_consensus.cc:1275] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:18.552680 26931 consensus_queue.cc:1048] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:18.562809 25677 raft_consensus.cc:1275] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:23:18.564128 26931 consensus_queue.cc:1048] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:18.580193 25831 raft_consensus.cc:1275] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:23:18.582003 26931 consensus_queue.cc:1048] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:18.661031 25678 raft_consensus.cc:1275] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:18.662091 26931 consensus_queue.cc:1048] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:18.671548 25831 raft_consensus.cc:1275] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:18.673398 26931 consensus_queue.cc:1048] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:18.686626 25830 raft_consensus.cc:1275] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:18.691627 26892 consensus_queue.cc:1048] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:18.714469 25760 raft_consensus.cc:1275] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:18.715638 26892 consensus_queue.cc:1048] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:18.887199 25828 consensus_queue.cc:237] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:18.892930 25760 raft_consensus.cc:1275] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:23:18.893656 25801 consensus_peers.cc:597] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a -> Peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Couldn't send request to peer a866ff967d964388a6f0dff7fd43df89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b679f7cf7f1e468582715c3427ced820. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:18.894126 26901 consensus_queue.cc:1048] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:18.895324 25678 raft_consensus.cc:1275] T b679f7cf7f1e468582715c3427ced820 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:18.897027 26901 consensus_queue.cc:1048] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:18.902185 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:18.903482 26901 raft_consensus.cc:2955] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:18.904502 25760 raft_consensus.cc:2955] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:18.924391 25678 consensus_queue.cc:237] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:18.933746 25685 raft_consensus.cc:2955] T b679f7cf7f1e468582715c3427ced820 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:18.936414 25580 catalog_manager.cc:5697] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New cstate: current_term: 2 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:18.983566 25828 raft_consensus.cc:1275] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:18.984329 25650 consensus_peers.cc:597] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc -> Peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Couldn't send request to peer a866ff967d964388a6f0dff7fd43df89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4e8d1d3d43ad47308fae5ed98608feb8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:18.985162 26915 consensus_queue.cc:1048] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:18.989463 25757 raft_consensus.cc:1275] T 4e8d1d3d43ad47308fae5ed98608feb8 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:18.991237 26911 consensus_queue.cc:1048] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:19.018620 26915 raft_consensus.cc:2955] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:19.024439 25685 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
mode: GRACEFUL
new_leader_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:49108
I20260709 12:23:19.025058 25685 raft_consensus.cc:606] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Received request to transfer leadership to TS 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:19.026646 25760 raft_consensus.cc:2955] T 4e8d1d3d43ad47308fae5ed98608feb8 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:19.029461 25828 raft_consensus.cc:2955] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:19.037931 25685 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
mode: GRACEFUL
new_leader_uuid: "a866ff967d964388a6f0dff7fd43df89"
 from {username='slave'} at 127.0.0.1:49108
I20260709 12:23:19.038555 25685 raft_consensus.cc:606] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Received request to transfer leadership to TS a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:19.041124 25685 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
mode: GRACEFUL
new_leader_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:49108
I20260709 12:23:19.041711 25685 raft_consensus.cc:606] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Received request to transfer leadership to TS 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:23:19.044421 25678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
mode: GRACEFUL
new_leader_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:49108
I20260709 12:23:19.044972 25678 raft_consensus.cc:606] T de96c5816bc14e3cb8f32ff10dc52a61 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Received request to transfer leadership to TS 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:19.047739 25685 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
mode: GRACEFUL
new_leader_uuid: "a866ff967d964388a6f0dff7fd43df89"
 from {username='slave'} at 127.0.0.1:49108
I20260709 12:23:19.048756 25685 raft_consensus.cc:606] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Received request to transfer leadership to TS a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:19.049885 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:23:19.050984 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:19.051627 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:19.055377 25685 consensus_queue.cc:237] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:19.060307 25580 catalog_manager.cc:5697] T 4e8d1d3d43ad47308fae5ed98608feb8 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New cstate: current_term: 1 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:19.075027 25760 raft_consensus.cc:1275] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:23:19.075656 25650 consensus_peers.cc:597] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc -> Peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Couldn't send request to peer a866ff967d964388a6f0dff7fd43df89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c38d3f292da44b3dbb2e512cd53e21da. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:19.076557 26957 consensus_queue.cc:1048] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:19.079978 25828 raft_consensus.cc:1275] T c38d3f292da44b3dbb2e512cd53e21da P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:19.081460 26964 consensus_queue.cc:1048] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:19.097050 26915 raft_consensus.cc:2955] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:19.107156 25828 raft_consensus.cc:2955] T c38d3f292da44b3dbb2e512cd53e21da P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:19.113866 25831 consensus_queue.cc:237] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:19.105301 25760 raft_consensus.cc:2955] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:19.123042 25762 raft_consensus.cc:1275] T ca1c66d4736542ecb25b33fab43ae780 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:19.123443 25801 consensus_peers.cc:597] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a -> Peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Couldn't send request to peer a866ff967d964388a6f0dff7fd43df89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ca1c66d4736542ecb25b33fab43ae780. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:19.125242 26901 consensus_queue.cc:1048] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:19.135881 25685 raft_consensus.cc:1275] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:19.139657 26956 consensus_queue.cc:1048] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:23:19.140769 25582 catalog_manager.cc:5697] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc reported cstate change: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New cstate: current_term: 2 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:19.160898 26915 raft_consensus.cc:993] T de96c5816bc14e3cb8f32ff10dc52a61 P f82778701b464892aab92a752ed7ffdc: : Instructing follower 6e673265293d4e9a937dc45150aeb1b8 to start an election
I20260709 12:23:19.162719 26915 raft_consensus.cc:1081] T de96c5816bc14e3cb8f32ff10dc52a61 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Signalling peer 6e673265293d4e9a937dc45150aeb1b8 to start an election
I20260709 12:23:19.166965 25760 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:53474
I20260709 12:23:19.167646 25760 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:19.168380 25760 raft_consensus.cc:3060] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:19.180738 25760 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:19.182533 25760 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:19.183432 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:19.184122 25678 raft_consensus.cc:3055] T de96c5816bc14e3cb8f32ff10dc52a61 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:19.184478 25678 raft_consensus.cc:740] T de96c5816bc14e3cb8f32ff10dc52a61 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:19.185101 25678 consensus_queue.cc:260] T de96c5816bc14e3cb8f32ff10dc52a61 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:19.186136 25678 raft_consensus.cc:3060] T de96c5816bc14e3cb8f32ff10dc52a61 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:19.185708 26897 raft_consensus.cc:2955] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:19.183872 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:19.190538 25678 raft_consensus.cc:2468] T de96c5816bc14e3cb8f32ff10dc52a61 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 2.
I20260709 12:23:19.191643 25726 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:19.190243 25831 raft_consensus.cc:3060] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:19.192708 26898 raft_consensus.cc:2804] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:19.193195 26898 raft_consensus.cc:697] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:19.194069 26898 consensus_queue.cc:237] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:19.199483 25762 raft_consensus.cc:2955] T ca1c66d4736542ecb25b33fab43ae780 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:19.199528 25678 raft_consensus.cc:2955] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:19.200963 25831 raft_consensus.cc:2468] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 2.
I20260709 12:23:19.215446 25582 catalog_manager.cc:5697] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New cstate: current_term: 1 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:19.216475 25580 catalog_manager.cc:5697] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 1 to 2, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 2 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:19.337884 26975 ts_tablet_manager.cc:933] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89: Initiating tablet copy from peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:19.340229 26975 tablet_copy_client.cc:323] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Beginning tablet copy session from remote peer at address 127.23.245.131:36237
I20260709 12:23:19.342037 25847 tablet_copy_service.cc:140] P 5cccf20a8bff46dba6601f241d172b8a: Received BeginTabletCopySession request for tablet b679f7cf7f1e468582715c3427ced820 from peer a866ff967d964388a6f0dff7fd43df89 ({username='slave'} at 127.0.0.1:41782)
I20260709 12:23:19.342566 25847 tablet_copy_service.cc:161] P 5cccf20a8bff46dba6601f241d172b8a: Beginning new tablet copy session on tablet b679f7cf7f1e468582715c3427ced820 from peer a866ff967d964388a6f0dff7fd43df89 at {username='slave'} at 127.0.0.1:41782: session id = a866ff967d964388a6f0dff7fd43df89-b679f7cf7f1e468582715c3427ced820
I20260709 12:23:19.348838 25847 tablet_copy_source_session.cc:215] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:19.351519 26975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b679f7cf7f1e468582715c3427ced820. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:19.369742 26964 raft_consensus.cc:993] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc: : Instructing follower a866ff967d964388a6f0dff7fd43df89 to start an election
I20260709 12:23:19.371877 26773 raft_consensus.cc:1081] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Signalling peer a866ff967d964388a6f0dff7fd43df89 to start an election
I20260709 12:23:19.373267 26975 tablet_copy_client.cc:806] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:19.373845 26975 tablet_copy_client.cc:670] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:19.374914 26439 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a"
dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
 from {username='slave'} at 127.0.0.1:36510
I20260709 12:23:19.375455 26439 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:19.375799 26439 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:19.380041 26975 tablet_copy_client.cc:538] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:19.383667 26439 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:19.386648 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:19.387044 26439 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:19.387176 25685 raft_consensus.cc:3055] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:19.387590 25685 raft_consensus.cc:740] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:19.388023 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:19.388525 25760 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:19.388319 25685 consensus_queue.cc:260] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:19.388978 26975 tablet_bootstrap.cc:492] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89: Bootstrap starting.
I20260709 12:23:19.389420 25685 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:19.392863 25760 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 2.
I20260709 12:23:19.394089 26401 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:19.395051 26974 raft_consensus.cc:2804] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:19.395519 26974 raft_consensus.cc:697] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 2 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:23:19.396154 25685 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 2.
I20260709 12:23:19.396395 26974 consensus_queue.cc:237] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:19.408701 26964 raft_consensus.cc:993] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc: : Instructing follower 5cccf20a8bff46dba6601f241d172b8a to start an election
I20260709 12:23:19.405681 25583 catalog_manager.cc:5697] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 1 to 2, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 2 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:19.409657 26964 raft_consensus.cc:1081] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Signalling peer 5cccf20a8bff46dba6601f241d172b8a to start an election
I20260709 12:23:19.411473 25831 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:44202
I20260709 12:23:19.411980 25831 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:19.412307 25831 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:19.418923 25831 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:19.421372 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:19.421892 25685 raft_consensus.cc:3055] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:19.422188 25685 raft_consensus.cc:740] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:19.422897 25685 consensus_queue.cc:260] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:19.423858 25685 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:19.434365 26975 tablet_bootstrap.cc:492] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:19.435283 26975 tablet_bootstrap.cc:492] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89: Bootstrap complete.
I20260709 12:23:19.435950 26975 ts_tablet_manager.cc:1403] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89: Time spent bootstrapping tablet: real 0.047s	user 0.017s	sys 0.004s
I20260709 12:23:19.436453 25685 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 2.
I20260709 12:23:19.437312 25831 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:19.437577 25801 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:19.438939 26975 raft_consensus.cc:359] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:19.439826 26975 raft_consensus.cc:740] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Initialized, Role: LEARNER
I20260709 12:23:19.439462 26956 raft_consensus.cc:2804] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:19.440727 26956 raft_consensus.cc:697] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 2 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:19.440479 26975 consensus_queue.cc:260] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:19.441606 26956 consensus_queue.cc:237] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:19.443009 26975 ts_tablet_manager.cc:1434] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:23:19.444276 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:19.444806 25760 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:19.446759 25847 tablet_copy_service.cc:342] P 5cccf20a8bff46dba6601f241d172b8a: Request end of tablet copy session a866ff967d964388a6f0dff7fd43df89-b679f7cf7f1e468582715c3427ced820 received from {username='slave'} at 127.0.0.1:41782
I20260709 12:23:19.447162 25847 tablet_copy_service.cc:434] P 5cccf20a8bff46dba6601f241d172b8a: ending tablet copy session a866ff967d964388a6f0dff7fd43df89-b679f7cf7f1e468582715c3427ced820 on tablet b679f7cf7f1e468582715c3427ced820 with peer a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:19.457304 25760 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 2.
I20260709 12:23:19.459792 26975 ts_tablet_manager.cc:933] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89: Initiating tablet copy from peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349)
I20260709 12:23:19.465276 26975 tablet_copy_client.cc:323] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Beginning tablet copy session from remote peer at address 127.23.245.129:37349
I20260709 12:23:19.466837 25696 tablet_copy_service.cc:140] P f82778701b464892aab92a752ed7ffdc: Received BeginTabletCopySession request for tablet 4e8d1d3d43ad47308fae5ed98608feb8 from peer a866ff967d964388a6f0dff7fd43df89 ({username='slave'} at 127.0.0.1:51578)
I20260709 12:23:19.467378 25696 tablet_copy_service.cc:161] P f82778701b464892aab92a752ed7ffdc: Beginning new tablet copy session on tablet 4e8d1d3d43ad47308fae5ed98608feb8 from peer a866ff967d964388a6f0dff7fd43df89 at {username='slave'} at 127.0.0.1:51578: session id = a866ff967d964388a6f0dff7fd43df89-4e8d1d3d43ad47308fae5ed98608feb8
I20260709 12:23:19.475001 25696 tablet_copy_source_session.cc:215] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:19.478866 26975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e8d1d3d43ad47308fae5ed98608feb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:19.479851 25583 catalog_manager.cc:5697] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 1 to 2, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 2 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:19.494294 26975 tablet_copy_client.cc:806] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:19.494882 26975 tablet_copy_client.cc:670] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:19.498597 26975 tablet_copy_client.cc:538] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:19.505932 26975 tablet_bootstrap.cc:492] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89: Bootstrap starting.
I20260709 12:23:19.526635 26975 tablet_bootstrap.cc:492] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:19.527443 26975 tablet_bootstrap.cc:492] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89: Bootstrap complete.
I20260709 12:23:19.528017 26975 ts_tablet_manager.cc:1403] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89: Time spent bootstrapping tablet: real 0.022s	user 0.018s	sys 0.004s
I20260709 12:23:19.530078 26975 raft_consensus.cc:359] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:19.530676 26975 raft_consensus.cc:740] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Initialized, Role: LEARNER
I20260709 12:23:19.531169 26975 consensus_queue.cc:260] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:19.533326 26975 ts_tablet_manager.cc:1434] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:23:19.535213 26979 ts_tablet_manager.cc:933] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89: Initiating tablet copy from peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349)
I20260709 12:23:19.535645 25696 tablet_copy_service.cc:342] P f82778701b464892aab92a752ed7ffdc: Request end of tablet copy session a866ff967d964388a6f0dff7fd43df89-4e8d1d3d43ad47308fae5ed98608feb8 received from {username='slave'} at 127.0.0.1:51578
I20260709 12:23:19.536113 25696 tablet_copy_service.cc:434] P f82778701b464892aab92a752ed7ffdc: ending tablet copy session a866ff967d964388a6f0dff7fd43df89-4e8d1d3d43ad47308fae5ed98608feb8 on tablet 4e8d1d3d43ad47308fae5ed98608feb8 with peer a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:19.550364 26773 raft_consensus.cc:993] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc: : Instructing follower a866ff967d964388a6f0dff7fd43df89 to start an election
I20260709 12:23:19.550841 26773 raft_consensus.cc:1081] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Signalling peer a866ff967d964388a6f0dff7fd43df89 to start an election
I20260709 12:23:19.551108 26979 tablet_copy_client.cc:323] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89: tablet copy: Beginning tablet copy session from remote peer at address 127.23.245.129:37349
I20260709 12:23:19.552654 25696 tablet_copy_service.cc:140] P f82778701b464892aab92a752ed7ffdc: Received BeginTabletCopySession request for tablet c38d3f292da44b3dbb2e512cd53e21da from peer a866ff967d964388a6f0dff7fd43df89 ({username='slave'} at 127.0.0.1:51578)
I20260709 12:23:19.553006 26439 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4"
dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
 from {username='slave'} at 127.0.0.1:36510
I20260709 12:23:19.553175 25696 tablet_copy_service.cc:161] P f82778701b464892aab92a752ed7ffdc: Beginning new tablet copy session on tablet c38d3f292da44b3dbb2e512cd53e21da from peer a866ff967d964388a6f0dff7fd43df89 at {username='slave'} at 127.0.0.1:51578: session id = a866ff967d964388a6f0dff7fd43df89-c38d3f292da44b3dbb2e512cd53e21da
I20260709 12:23:19.553535 26439 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:19.553870 26439 raft_consensus.cc:3060] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:19.568430 25696 tablet_copy_source_session.cc:215] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:19.577580 26975 ts_tablet_manager.cc:933] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89: Initiating tablet copy from peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:19.585511 26975 tablet_copy_client.cc:323] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Beginning tablet copy session from remote peer at address 127.23.245.131:36237
I20260709 12:23:19.575610 26979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c38d3f292da44b3dbb2e512cd53e21da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:19.587092 25847 tablet_copy_service.cc:140] P 5cccf20a8bff46dba6601f241d172b8a: Received BeginTabletCopySession request for tablet ca1c66d4736542ecb25b33fab43ae780 from peer a866ff967d964388a6f0dff7fd43df89 ({username='slave'} at 127.0.0.1:41782)
I20260709 12:23:19.587632 25847 tablet_copy_service.cc:161] P 5cccf20a8bff46dba6601f241d172b8a: Beginning new tablet copy session on tablet ca1c66d4736542ecb25b33fab43ae780 from peer a866ff967d964388a6f0dff7fd43df89 at {username='slave'} at 127.0.0.1:41782: session id = a866ff967d964388a6f0dff7fd43df89-ca1c66d4736542ecb25b33fab43ae780
I20260709 12:23:19.595081 25847 tablet_copy_source_session.cc:215] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:19.573431 26439 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:19.598294 26975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca1c66d4736542ecb25b33fab43ae780. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:19.601471 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:19.602057 25762 raft_consensus.cc:3060] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:19.603893 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:19.604470 25685 raft_consensus.cc:3055] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:19.604736 25685 raft_consensus.cc:740] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:19.605386 25685 consensus_queue.cc:260] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:19.608681 25762 raft_consensus.cc:2468] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 2.
I20260709 12:23:19.610023 26401 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:19.612247 26974 raft_consensus.cc:2804] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:19.612722 26974 raft_consensus.cc:697] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:23:19.613574 26974 consensus_queue.cc:237] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:19.606838 25685 raft_consensus.cc:3060] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:19.620283 26439 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:19.625046 25685 raft_consensus.cc:2468] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 2.
I20260709 12:23:19.631672 26979 tablet_copy_client.cc:806] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:19.633555 26979 tablet_copy_client.cc:670] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:19.636389 26915 raft_consensus.cc:993] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc: : Instructing follower 6e673265293d4e9a937dc45150aeb1b8 to start an election
I20260709 12:23:19.633935 26975 tablet_copy_client.cc:806] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:19.636909 26915 raft_consensus.cc:1081] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Signalling peer 6e673265293d4e9a937dc45150aeb1b8 to start an election
I20260709 12:23:19.637382 26975 tablet_copy_client.cc:670] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:19.638433 25757 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:53474
I20260709 12:23:19.638826 26979 tablet_copy_client.cc:538] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:19.638942 25757 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:19.639396 25757 raft_consensus.cc:3060] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:19.645538 25757 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:19.648142 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:19.648677 25685 raft_consensus.cc:3055] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:19.648973 25685 raft_consensus.cc:740] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:19.649121 25757 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:19.649643 25685 consensus_queue.cc:260] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:19.650941 25685 raft_consensus.cc:3060] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:19.651734 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:19.653738 25830 raft_consensus.cc:3060] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:19.653926 26975 tablet_copy_client.cc:538] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:19.654640 25583 catalog_manager.cc:5697] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 1 to 2, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 2 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:19.661355 25830 raft_consensus.cc:2468] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 2.
I20260709 12:23:19.662544 25726 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:23:19.664989 26975 tablet_bootstrap.cc:492] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89: Bootstrap starting.
I20260709 12:23:19.665052 26864 raft_consensus.cc:2804] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:19.665650 26864 raft_consensus.cc:697] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:19.666492 26864 consensus_queue.cc:237] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:19.667045 25685 raft_consensus.cc:2468] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 2.
I20260709 12:23:19.668366 26979 tablet_bootstrap.cc:492] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89: Bootstrap starting.
I20260709 12:23:19.695886 25583 catalog_manager.cc:5697] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 1 to 2, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 2 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:19.721539 25685 raft_consensus.cc:1275] T de96c5816bc14e3cb8f32ff10dc52a61 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:19.722924 26975 tablet_bootstrap.cc:492] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:19.723834 26975 tablet_bootstrap.cc:492] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89: Bootstrap complete.
I20260709 12:23:19.724774 26975 ts_tablet_manager.cc:1403] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89: Time spent bootstrapping tablet: real 0.060s	user 0.022s	sys 0.023s
I20260709 12:23:19.725384 26864 consensus_queue.cc:1048] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:19.731411 25830 raft_consensus.cc:1275] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:19.732973 26898 consensus_queue.cc:1048] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:19.734781 26979 tablet_bootstrap.cc:492] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:19.735639 26979 tablet_bootstrap.cc:492] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89: Bootstrap complete.
I20260709 12:23:19.736313 26979 ts_tablet_manager.cc:1403] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89: Time spent bootstrapping tablet: real 0.068s	user 0.022s	sys 0.000s
I20260709 12:23:19.740125 26975 raft_consensus.cc:359] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:19.741856 26975 raft_consensus.cc:740] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Initialized, Role: LEARNER
I20260709 12:23:19.742632 26975 consensus_queue.cc:260] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:19.744829 26975 ts_tablet_manager.cc:1434] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 12:23:19.745311 26979 raft_consensus.cc:359] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:19.747323 25847 tablet_copy_service.cc:342] P 5cccf20a8bff46dba6601f241d172b8a: Request end of tablet copy session a866ff967d964388a6f0dff7fd43df89-ca1c66d4736542ecb25b33fab43ae780 received from {username='slave'} at 127.0.0.1:41782
I20260709 12:23:19.748751 25847 tablet_copy_service.cc:434] P 5cccf20a8bff46dba6601f241d172b8a: ending tablet copy session a866ff967d964388a6f0dff7fd43df89-ca1c66d4736542ecb25b33fab43ae780 on tablet ca1c66d4736542ecb25b33fab43ae780 with peer a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:19.751509 26979 raft_consensus.cc:740] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Initialized, Role: LEARNER
I20260709 12:23:19.752660 26979 consensus_queue.cc:260] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:19.755292 26979 ts_tablet_manager.cc:1434] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:23:19.758975 25696 tablet_copy_service.cc:342] P f82778701b464892aab92a752ed7ffdc: Request end of tablet copy session a866ff967d964388a6f0dff7fd43df89-c38d3f292da44b3dbb2e512cd53e21da received from {username='slave'} at 127.0.0.1:51578
I20260709 12:23:19.759424 25696 tablet_copy_service.cc:434] P f82778701b464892aab92a752ed7ffdc: ending tablet copy session a866ff967d964388a6f0dff7fd43df89-c38d3f292da44b3dbb2e512cd53e21da on tablet c38d3f292da44b3dbb2e512cd53e21da with peer a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:19.878525 26439 raft_consensus.cc:1217] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 12:23:19.887406 25685 raft_consensus.cc:1275] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:19.890487 26974 consensus_queue.cc:1048] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:19.897305 25685 raft_consensus.cc:1275] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:19.899333 26995 consensus_queue.cc:1048] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:19.930292 25757 raft_consensus.cc:1275] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:19.930495 25760 raft_consensus.cc:1275] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:19.932662 26974 consensus_queue.cc:1048] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:19.933375 26956 consensus_queue.cc:1048] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:19.951681 26439 raft_consensus.cc:1217] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 12:23:20.028192 26439 raft_consensus.cc:1217] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:20.127219 26437 raft_consensus.cc:1217] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:20.132546 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:20.153332 25757 raft_consensus.cc:1275] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:20.154662 26892 consensus_queue.cc:1048] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:20.166518 25685 raft_consensus.cc:1275] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:20.168071 26892 consensus_queue.cc:1048] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:20.177665 25677 raft_consensus.cc:1275] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:20.178926 26996 consensus_queue.cc:1048] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:20.189736 25830 raft_consensus.cc:1275] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:20.195384 26864 consensus_queue.cc:1048] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:20.240099 26901 raft_consensus.cc:1064] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a: attempting to promote NON_VOTER a866ff967d964388a6f0dff7fd43df89 to VOTER
I20260709 12:23:20.242398 26901 consensus_queue.cc:237] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:20.269719 26437 raft_consensus.cc:1275] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEARNER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:20.271116 25762 raft_consensus.cc:1275] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:20.269719 25677 raft_consensus.cc:1275] T b679f7cf7f1e468582715c3427ced820 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:20.275215 26897 consensus_queue.cc:1048] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:20.276093 26956 consensus_queue.cc:1048] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:20.276916 26901 consensus_queue.cc:1048] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:20.279544 25831 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "a866ff967d964388a6f0dff7fd43df89"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:23:20.280177 25831 raft_consensus.cc:606] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Received request to transfer leadership to TS a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:20.285749 25678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
mode: GRACEFUL
new_leader_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:49108
I20260709 12:23:20.286324 25678 raft_consensus.cc:606] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Received request to transfer leadership to TS 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:20.311142 26897 raft_consensus.cc:2955] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:20.317998 26439 raft_consensus.cc:2955] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:20.321128 25760 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
mode: GRACEFUL
new_leader_uuid: "a866ff967d964388a6f0dff7fd43df89"
 from {username='slave'} at 127.0.0.1:48134
I20260709 12:23:20.321718 25760 raft_consensus.cc:606] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Received request to transfer leadership to TS a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:20.324266 25685 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "819272169f6f4293b6e279793be58b49"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
mode: GRACEFUL
new_leader_uuid: "a866ff967d964388a6f0dff7fd43df89"
 from {username='slave'} at 127.0.0.1:49108
I20260709 12:23:20.324784 25685 raft_consensus.cc:606] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Received request to transfer leadership to TS a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:20.324965 25760 raft_consensus.cc:2955] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:20.332230 25685 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
mode: GRACEFUL
new_leader_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:49108
I20260709 12:23:20.332755 25685 raft_consensus.cc:606] T 8dcbaf690aa54e4887d08b85cec29701 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Received request to transfer leadership to TS 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:23:20.338742 25583 catalog_manager.cc:5697] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:20.340548 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:23:20.342276 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:20.342976 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:20.349677 25677 raft_consensus.cc:2955] T b679f7cf7f1e468582715c3427ced820 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:20.397250 25828 consensus_queue.cc:237] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:20.406162 25760 raft_consensus.cc:1275] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:23:20.406375 26439 raft_consensus.cc:1275] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:23:20.408444 26964 raft_consensus.cc:993] T 8dcbaf690aa54e4887d08b85cec29701 P f82778701b464892aab92a752ed7ffdc: : Instructing follower 5cccf20a8bff46dba6601f241d172b8a to start an election
I20260709 12:23:20.408919 26964 raft_consensus.cc:1081] T 8dcbaf690aa54e4887d08b85cec29701 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Signalling peer 5cccf20a8bff46dba6601f241d172b8a to start an election
I20260709 12:23:20.409121 26901 consensus_queue.cc:1048] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:20.410600 25830 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:44202
I20260709 12:23:20.411089 25830 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:20.411433 25830 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:20.412664 26991 consensus_queue.cc:1048] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:20.418192 25830 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:20.421051 26995 raft_consensus.cc:2955] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:20.422865 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:20.423424 25677 raft_consensus.cc:3055] T 8dcbaf690aa54e4887d08b85cec29701 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:20.423689 25677 raft_consensus.cc:740] T 8dcbaf690aa54e4887d08b85cec29701 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:20.424430 25677 consensus_queue.cc:260] T 8dcbaf690aa54e4887d08b85cec29701 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:20.425465 25677 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:20.420068 25830 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:20.429051 26437 raft_consensus.cc:2955] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:20.431090 25762 raft_consensus.cc:2955] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:20.432179 25677 raft_consensus.cc:2468] T 8dcbaf690aa54e4887d08b85cec29701 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 2.
I20260709 12:23:20.436553 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:20.440317 25760 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:20.438998 25801 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:20.443001 26897 raft_consensus.cc:2804] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:20.443421 26897 raft_consensus.cc:697] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 2 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:20.444156 26897 consensus_queue.cc:237] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:20.457144 25760 raft_consensus.cc:2468] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 2.
I20260709 12:23:20.455143 25582 catalog_manager.cc:5697] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: config changed from index 3 to 4, VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129) evicted. New cstate: current_term: 2 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:20.461316 26964 raft_consensus.cc:1064] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc: attempting to promote NON_VOTER a866ff967d964388a6f0dff7fd43df89 to VOTER
I20260709 12:23:20.464355 26964 consensus_queue.cc:237] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:20.473162 26439 raft_consensus.cc:1275] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 2 LEARNER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:20.474119 25830 raft_consensus.cc:1275] T c38d3f292da44b3dbb2e512cd53e21da P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:20.474798 25762 raft_consensus.cc:1275] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:20.474556 26964 consensus_queue.cc:1048] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:20.476413 26915 consensus_queue.cc:1048] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:20.478106 25675 tablet_service.cc:1558] Processing DeleteTablet for tablet b679f7cf7f1e468582715c3427ced820 with delete_type TABLET_DATA_TOMBSTONED (TS f82778701b464892aab92a752ed7ffdc not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40214
I20260709 12:23:20.480556 26915 consensus_queue.cc:1048] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:20.484695 25569 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b679f7cf7f1e468582715c3427ced820 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:20.503554 25582 catalog_manager.cc:5697] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 1 to 2, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 2 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:20.511039 26996 raft_consensus.cc:993] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8: : Instructing follower a866ff967d964388a6f0dff7fd43df89 to start an election
I20260709 12:23:20.511581 26898 raft_consensus.cc:1081] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Signalling peer a866ff967d964388a6f0dff7fd43df89 to start an election
I20260709 12:23:20.513396 26437 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c"
dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
 from {username='slave'} at 127.0.0.1:36518
I20260709 12:23:20.513878 26437 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:20.514171 26437 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:20.521462 26437 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:20.525837 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:20.526401 25756 raft_consensus.cc:3055] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:20.526719 25756 raft_consensus.cc:740] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:20.527426 25756 consensus_queue.cc:260] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:20.529803 25756 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:20.535213 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:20.535799 25831 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:20.539525 26437 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:20.539717 26956 raft_consensus.cc:1064] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a: attempting to promote NON_VOTER a866ff967d964388a6f0dff7fd43df89 to VOTER
I20260709 12:23:20.542299 26956 consensus_queue.cc:237] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:20.556548 26897 raft_consensus.cc:993] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a: : Instructing follower a866ff967d964388a6f0dff7fd43df89 to start an election
I20260709 12:23:20.557317 26901 raft_consensus.cc:1081] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Signalling peer a866ff967d964388a6f0dff7fd43df89 to start an election
I20260709 12:23:20.557726 25831 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 4.
I20260709 12:23:20.559700 26437 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c"
dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
 from {username='slave'} at 127.0.0.1:36508
I20260709 12:23:20.560477 26437 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:20.560873 26437 raft_consensus.cc:3060] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:20.565435 26436 raft_consensus.cc:1275] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:20.568796 26956 consensus_queue.cc:1048] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:20.581243 25756 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 4.
I20260709 12:23:20.582551 26401 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:20.583393 26973 raft_consensus.cc:2804] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:20.583902 26973 raft_consensus.cc:697] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 4 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:23:20.584808 26973 consensus_queue.cc:237] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:20.594374 25678 raft_consensus.cc:1275] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:20.596416 25756 raft_consensus.cc:1275] T ca1c66d4736542ecb25b33fab43ae780 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:20.596510 25580 catalog_manager.cc:5697] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 3 to 4, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 4 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:20.603305 26956 consensus_queue.cc:1048] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:20.611466 26991 consensus_queue.cc:1048] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:20.627314 27018 tablet_replica.cc:333] T b679f7cf7f1e468582715c3427ced820 P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
I20260709 12:23:20.631486 26437 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:20.644037 26437 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:20.655838 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:20.656431 25677 raft_consensus.cc:3060] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:20.664398 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:20.665019 25830 raft_consensus.cc:3055] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:20.665315 25830 raft_consensus.cc:740] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:20.671339 25830 consensus_queue.cc:260] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:20.677111 27024 raft_consensus.cc:1064] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc: attempting to promote NON_VOTER a866ff967d964388a6f0dff7fd43df89 to VOTER
I20260709 12:23:20.687323 25677 raft_consensus.cc:2468] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 2.
I20260709 12:23:20.689747 26402 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:20.693179 26973 raft_consensus.cc:2804] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:20.693676 26973 raft_consensus.cc:697] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 2 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:23:20.694531 26973 consensus_queue.cc:237] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:20.699092 26437 raft_consensus.cc:2955] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:20.705536 27018 raft_consensus.cc:2243] T b679f7cf7f1e468582715c3427ced820 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:20.710683 25830 raft_consensus.cc:3060] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:20.720197 27018 raft_consensus.cc:2272] T b679f7cf7f1e468582715c3427ced820 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:20.735190 25830 raft_consensus.cc:2468] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 2.
I20260709 12:23:20.679663 27024 consensus_queue.cc:237] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:20.736939 25760 raft_consensus.cc:2955] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:20.761044 26773 raft_consensus.cc:993] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc: : Instructing follower a866ff967d964388a6f0dff7fd43df89 to start an election
I20260709 12:23:20.746428 27032 raft_consensus.cc:2955] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:20.761584 26773 raft_consensus.cc:1081] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Signalling peer a866ff967d964388a6f0dff7fd43df89 to start an election
I20260709 12:23:20.763840 25580 catalog_manager.cc:5697] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:20.766956 27018 ts_tablet_manager.cc:1916] T b679f7cf7f1e468582715c3427ced820 P f82778701b464892aab92a752ed7ffdc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:20.768126 26436 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "819272169f6f4293b6e279793be58b49"
dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
 from {username='slave'} at 127.0.0.1:36510
I20260709 12:23:20.768704 26436 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:20.769059 26436 raft_consensus.cc:3060] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:20.797176 25828 raft_consensus.cc:2955] T c38d3f292da44b3dbb2e512cd53e21da P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:20.801630 26436 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:20.803503 26436 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:20.807304 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:20.807870 25580 catalog_manager.cc:5697] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 1 to 2, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 2 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:20.807945 25830 raft_consensus.cc:3060] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:20.810688 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:20.811224 25677 raft_consensus.cc:3055] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:20.811530 25677 raft_consensus.cc:740] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:20.812340 25677 consensus_queue.cc:260] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:20.813336 25677 raft_consensus.cc:3060] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:20.823522 27036 raft_consensus.cc:993] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc: : Instructing follower 6e673265293d4e9a937dc45150aeb1b8 to start an election
I20260709 12:23:20.824059 27036 raft_consensus.cc:1081] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Signalling peer 6e673265293d4e9a937dc45150aeb1b8 to start an election
I20260709 12:23:20.828038 26897 raft_consensus.cc:2955] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:20.835421 25677 raft_consensus.cc:2468] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 2.
I20260709 12:23:20.836400 27018 ts_tablet_manager.cc:1929] T b679f7cf7f1e468582715c3427ced820 P f82778701b464892aab92a752ed7ffdc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 12:23:20.841116 27018 log.cc:1199] T b679f7cf7f1e468582715c3427ced820 P f82778701b464892aab92a752ed7ffdc: Deleting WAL directory at /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-0-root/wals/b679f7cf7f1e468582715c3427ced820
I20260709 12:23:20.837925 25678 raft_consensus.cc:2955] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:20.843225 26437 raft_consensus.cc:2955] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:20.836642 26436 raft_consensus.cc:1275] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:20.845805 27032 consensus_queue.cc:1048] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:20.852895 25756 raft_consensus.cc:2955] T ca1c66d4736542ecb25b33fab43ae780 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:20.868331 25828 raft_consensus.cc:1275] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:20.869818 27024 consensus_queue.cc:1048] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:20.885875 25830 raft_consensus.cc:2468] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 2.
I20260709 12:23:20.886888 26402 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:20.888320 26973 raft_consensus.cc:2804] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:20.888803 26973 raft_consensus.cc:697] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:23:20.889575 26973 consensus_queue.cc:237] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:20.894418 27031 raft_consensus.cc:2955] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:20.896150 25760 raft_consensus.cc:1275] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:20.895802 25831 raft_consensus.cc:2955] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:20.897648 25762 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:53474
I20260709 12:23:20.899554 26956 consensus_queue.cc:1048] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:20.901374 25762 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:20.901769 25762 raft_consensus.cc:3060] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:20.908597 25582 catalog_manager.cc:5697] T ca1c66d4736542ecb25b33fab43ae780 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:20.917681 25762 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:20.919520 25762 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:20.920905 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:20.921573 25831 raft_consensus.cc:3060] T 0c043718ee3a40fea4b2b1453fcb259b P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:20.922514 26437 raft_consensus.cc:2955] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:20.932407 25831 raft_consensus.cc:2468] T 0c043718ee3a40fea4b2b1453fcb259b P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 2.
I20260709 12:23:20.933662 25726 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:23:20.934621 27038 raft_consensus.cc:2804] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:20.934128 25581 catalog_manager.cc:5697] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 1 to 2, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 2 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:20.935179 27038 raft_consensus.cc:697] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:20.935997 27038 consensus_queue.cc:237] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:20.946822 25569 catalog_manager.cc:5028] TS f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): tablet b679f7cf7f1e468582715c3427ced820 (table test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]) successfully deleted
I20260709 12:23:20.948779 25762 raft_consensus.cc:1275] T 4e8d1d3d43ad47308fae5ed98608feb8 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:20.952560 25581 catalog_manager.cc:5697] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:20.956372 25677 raft_consensus.cc:1275] T 8dcbaf690aa54e4887d08b85cec29701 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:20.963126 26991 consensus_queue.cc:1048] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:20.967128 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:20.967672 25678 raft_consensus.cc:3055] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:20.968014 25678 raft_consensus.cc:740] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:20.968739 25678 consensus_queue.cc:260] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:20.969955 25678 raft_consensus.cc:3060] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:20.974363 25828 consensus_queue.cc:237] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:20.977516 25831 raft_consensus.cc:1275] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:23:20.978874 26973 consensus_queue.cc:1048] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:20.986994 25678 raft_consensus.cc:2468] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 2.
I20260709 12:23:20.990583 26437 raft_consensus.cc:1275] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:20.992424 26995 consensus_queue.cc:1048] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:20.994796 25762 raft_consensus.cc:1275] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:23:20.996403 26973 consensus_queue.cc:1048] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:21.003216 26995 raft_consensus.cc:2955] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:21.009480 26437 raft_consensus.cc:2955] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:21.022279 27031 consensus_queue.cc:1048] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:21.037313 25677 consensus_queue.cc:237] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:21.047379 25569 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ca1c66d4736542ecb25b33fab43ae780 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:21.051157 25685 raft_consensus.cc:1275] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:21.050872 25583 catalog_manager.cc:5697] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 1 to 2, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 2 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:21.058866 26995 consensus_queue.cc:1048] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:21.061048 26436 raft_consensus.cc:1275] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:23:21.065740 25762 raft_consensus.cc:1275] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:23:21.076967 25680 consensus_queue.cc:237] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:21.063635 27029 consensus_queue.cc:1048] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:21.079893 25682 raft_consensus.cc:2955] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:21.090535 26436 raft_consensus.cc:1275] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:21.096120 25830 raft_consensus.cc:1275] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:21.096597 27031 consensus_queue.cc:1048] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:21.095678 25580 catalog_manager.cc:5697] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: config changed from index 3 to 4, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New cstate: current_term: 1 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:21.101410 27036 consensus_queue.cc:1048] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:21.110950 25760 raft_consensus.cc:2955] T 4e8d1d3d43ad47308fae5ed98608feb8 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:21.119661 27024 consensus_queue.cc:1048] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:23:21.120289 27053 log.cc:927] Time spent T 8dcbaf690aa54e4887d08b85cec29701 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:23:21.126736 25828 raft_consensus.cc:2955] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:21.126808 26437 raft_consensus.cc:2955] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:21.149559 25753 tablet_service.cc:1558] Processing DeleteTablet for tablet ca1c66d4736542ecb25b33fab43ae780 with delete_type TABLET_DATA_TOMBSTONED (TS 6e673265293d4e9a937dc45150aeb1b8 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53452
I20260709 12:23:21.125823 27031 raft_consensus.cc:2955] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:21.134282 26964 raft_consensus.cc:2955] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:21.137020 25762 raft_consensus.cc:2955] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:21.172060 26436 raft_consensus.cc:2955] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:21.187875 27056 tablet_replica.cc:333] T ca1c66d4736542ecb25b33fab43ae780 P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
I20260709 12:23:21.194851 27056 raft_consensus.cc:2243] T ca1c66d4736542ecb25b33fab43ae780 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:21.200361 25569 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4e8d1d3d43ad47308fae5ed98608feb8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:21.200119 27056 raft_consensus.cc:2272] T ca1c66d4736542ecb25b33fab43ae780 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:21.193883 25581 catalog_manager.cc:5697] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: config changed from index 3 to 4, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New cstate: current_term: 1 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:21.206676 27056 ts_tablet_manager.cc:1916] T ca1c66d4736542ecb25b33fab43ae780 P 6e673265293d4e9a937dc45150aeb1b8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:21.209764 25569 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c38d3f292da44b3dbb2e512cd53e21da with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:21.214663 25682 raft_consensus.cc:1275] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:21.211637 25582 catalog_manager.cc:5697] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: config changed from index 3 to 4, VOTER 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) evicted. New cstate: current_term: 2 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:21.216017 26973 consensus_queue.cc:1048] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:21.228381 25824 tablet_service.cc:1558] Processing DeleteTablet for tablet c38d3f292da44b3dbb2e512cd53e21da with delete_type TABLET_DATA_TOMBSTONED (TS 5cccf20a8bff46dba6601f241d172b8a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44194
I20260709 12:23:21.232527 25828 raft_consensus.cc:1275] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:21.238123 26973 consensus_queue.cc:1048] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:23:21.258085 25753 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e8d1d3d43ad47308fae5ed98608feb8 with delete_type TABLET_DATA_TOMBSTONED (TS 6e673265293d4e9a937dc45150aeb1b8 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53452
I20260709 12:23:21.282780 27056 ts_tablet_manager.cc:1929] T ca1c66d4736542ecb25b33fab43ae780 P 6e673265293d4e9a937dc45150aeb1b8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:21.283372 27056 log.cc:1199] T ca1c66d4736542ecb25b33fab43ae780 P 6e673265293d4e9a937dc45150aeb1b8: Deleting WAL directory at /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-1-root/wals/ca1c66d4736542ecb25b33fab43ae780
I20260709 12:23:21.285033 25568 catalog_manager.cc:5028] TS 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): tablet ca1c66d4736542ecb25b33fab43ae780 (table test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]) successfully deleted
I20260709 12:23:21.300650 27058 tablet_replica.cc:333] T c38d3f292da44b3dbb2e512cd53e21da P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
I20260709 12:23:21.302188 27058 raft_consensus.cc:2243] T c38d3f292da44b3dbb2e512cd53e21da P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:21.302978 27058 raft_consensus.cc:2272] T c38d3f292da44b3dbb2e512cd53e21da P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:21.303989 25680 raft_consensus.cc:1275] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:21.298997 27056 tablet_replica.cc:333] T 4e8d1d3d43ad47308fae5ed98608feb8 P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
I20260709 12:23:21.308354 26973 consensus_queue.cc:1048] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:23:21.313578 27058 ts_tablet_manager.cc:1916] T c38d3f292da44b3dbb2e512cd53e21da P 5cccf20a8bff46dba6601f241d172b8a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:21.329496 27058 ts_tablet_manager.cc:1929] T c38d3f292da44b3dbb2e512cd53e21da P 5cccf20a8bff46dba6601f241d172b8a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 12:23:21.329911 27058 log.cc:1199] T c38d3f292da44b3dbb2e512cd53e21da P 5cccf20a8bff46dba6601f241d172b8a: Deleting WAL directory at /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-2-root/wals/c38d3f292da44b3dbb2e512cd53e21da
I20260709 12:23:21.331559 25569 catalog_manager.cc:5028] TS 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): tablet c38d3f292da44b3dbb2e512cd53e21da (table test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]) successfully deleted
I20260709 12:23:21.339265 27056 raft_consensus.cc:2243] T 4e8d1d3d43ad47308fae5ed98608feb8 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:21.340078 27056 raft_consensus.cc:2272] T 4e8d1d3d43ad47308fae5ed98608feb8 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:21.347978 27056 ts_tablet_manager.cc:1916] T 4e8d1d3d43ad47308fae5ed98608feb8 P 6e673265293d4e9a937dc45150aeb1b8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:21.352922 25828 raft_consensus.cc:1275] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:21.354607 26974 consensus_queue.cc:1048] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:21.363860 27056 ts_tablet_manager.cc:1929] T 4e8d1d3d43ad47308fae5ed98608feb8 P 6e673265293d4e9a937dc45150aeb1b8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:21.364368 27056 log.cc:1199] T 4e8d1d3d43ad47308fae5ed98608feb8 P 6e673265293d4e9a937dc45150aeb1b8: Deleting WAL directory at /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-1-root/wals/4e8d1d3d43ad47308fae5ed98608feb8
I20260709 12:23:21.365959 25568 catalog_manager.cc:5028] TS 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): tablet 4e8d1d3d43ad47308fae5ed98608feb8 (table test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]) successfully deleted
I20260709 12:23:21.441017 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:21.465322 25828 raft_consensus.cc:1275] T 0c043718ee3a40fea4b2b1453fcb259b P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:21.468068 26996 consensus_queue.cc:1048] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:21.481272 25686 raft_consensus.cc:1275] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:21.482712 27038 consensus_queue.cc:1048] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:21.490942 25760 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
mode: GRACEFUL
new_leader_uuid: "a866ff967d964388a6f0dff7fd43df89"
 from {username='slave'} at 127.0.0.1:48134
I20260709 12:23:21.491492 25760 raft_consensus.cc:606] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Received request to transfer leadership to TS a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:21.495292 25831 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:23:21.495824 25831 raft_consensus.cc:606] T 06c3ab7c0c7a496390151c476ec675a0 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Received request to transfer leadership to TS 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:21.500838 25682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
mode: GRACEFUL
new_leader_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:49108
I20260709 12:23:21.501422 25682 raft_consensus.cc:606] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Received request to transfer leadership to TS 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:23:21.504256 25682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
mode: GRACEFUL
new_leader_uuid: "a866ff967d964388a6f0dff7fd43df89"
 from {username='slave'} at 127.0.0.1:49108
I20260709 12:23:21.504803 25682 raft_consensus.cc:606] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Received request to transfer leadership to TS a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:21.509923 25686 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
mode: GRACEFUL
new_leader_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:49108
I20260709 12:23:21.510582 25686 raft_consensus.cc:606] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Received request to transfer leadership to TS 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:23:21.511785 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:23:21.513497 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:21.514283 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:21.548432 27064 raft_consensus.cc:993] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8: : Instructing follower a866ff967d964388a6f0dff7fd43df89 to start an election
I20260709 12:23:21.548923 27038 raft_consensus.cc:1081] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Signalling peer a866ff967d964388a6f0dff7fd43df89 to start an election
I20260709 12:23:21.550459 26437 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf"
dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
 from {username='slave'} at 127.0.0.1:36518
I20260709 12:23:21.550988 26437 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:21.551333 26437 raft_consensus.cc:3060] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:21.560606 26437 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:21.563396 26437 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:21.563985 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:21.564113 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:21.564566 25760 raft_consensus.cc:3055] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:21.564894 25760 raft_consensus.cc:740] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:21.564951 25686 raft_consensus.cc:3060] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:21.565614 25760 consensus_queue.cc:260] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:21.568861 25760 raft_consensus.cc:3060] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:21.572883 25686 raft_consensus.cc:2468] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 4.
I20260709 12:23:21.574095 26402 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:21.574905 26974 raft_consensus.cc:2804] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:21.575367 26974 raft_consensus.cc:697] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 4 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:23:21.575608 25760 raft_consensus.cc:2468] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 4.
I20260709 12:23:21.576237 26974 consensus_queue.cc:237] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:21.584584 25582 catalog_manager.cc:5697] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 3 to 4, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 4 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:21.682672 27029 raft_consensus.cc:993] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc: : Instructing follower 5cccf20a8bff46dba6601f241d172b8a to start an election
I20260709 12:23:21.683182 27031 raft_consensus.cc:1081] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Signalling peer 5cccf20a8bff46dba6601f241d172b8a to start an election
I20260709 12:23:21.684823 25828 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:44202
I20260709 12:23:21.685343 25828 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:21.685678 25828 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:21.691648 25828 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:21.693523 25828 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:21.693892 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:21.694672 25682 raft_consensus.cc:3055] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:21.695067 25682 raft_consensus.cc:740] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:21.694139 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:21.695753 25760 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:21.695961 25682 consensus_queue.cc:260] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:21.697399 25682 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:21.702972 25760 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 2.
I20260709 12:23:21.704221 25800 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:23:21.704867 27049 raft_consensus.cc:2804] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:21.704942 25682 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 2.
I20260709 12:23:21.705390 27049 raft_consensus.cc:697] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 2 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:21.706278 27049 consensus_queue.cc:237] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:21.709020 27029 raft_consensus.cc:993] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc: : Instructing follower 5cccf20a8bff46dba6601f241d172b8a to start an election
I20260709 12:23:21.709501 27031 raft_consensus.cc:1081] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Signalling peer 5cccf20a8bff46dba6601f241d172b8a to start an election
I20260709 12:23:21.712838 25828 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:44202
I20260709 12:23:21.713371 25828 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:21.713739 25828 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:21.716773 25582 catalog_manager.cc:5697] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 1 to 2, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 2 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:21.720453 25828 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:21.722963 25828 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:21.723484 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:21.724079 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:21.724248 25760 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:21.724802 25682 raft_consensus.cc:3055] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:21.725131 25682 raft_consensus.cc:740] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:21.725934 25682 consensus_queue.cc:260] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:21.727205 25682 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:21.731470 25760 raft_consensus.cc:2468] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 2.
I20260709 12:23:21.732656 25800 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:23:21.733400 27049 raft_consensus.cc:2804] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:21.733572 25682 raft_consensus.cc:2468] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 2.
I20260709 12:23:21.733888 27049 raft_consensus.cc:697] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 2 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:21.734910 27049 consensus_queue.cc:237] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:21.747502 25582 catalog_manager.cc:5697] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 1 to 2, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 2 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:21.779470 26995 raft_consensus.cc:993] T 06c3ab7c0c7a496390151c476ec675a0 P 5cccf20a8bff46dba6601f241d172b8a: : Instructing follower 6e673265293d4e9a937dc45150aeb1b8 to start an election
I20260709 12:23:21.779903 27049 raft_consensus.cc:1081] T 06c3ab7c0c7a496390151c476ec675a0 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Signalling peer 6e673265293d4e9a937dc45150aeb1b8 to start an election
I20260709 12:23:21.781273 25760 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:53460
I20260709 12:23:21.781749 25760 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:21.782021 25760 raft_consensus.cc:3060] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:21.786616 25760 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:21.788280 25760 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:21.789062 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:21.789175 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:21.789749 25682 raft_consensus.cc:3060] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:21.789805 25828 raft_consensus.cc:3055] T 06c3ab7c0c7a496390151c476ec675a0 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:21.790167 25828 raft_consensus.cc:740] T 06c3ab7c0c7a496390151c476ec675a0 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:21.790719 25828 consensus_queue.cc:260] T 06c3ab7c0c7a496390151c476ec675a0 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:21.791798 25828 raft_consensus.cc:3060] T 06c3ab7c0c7a496390151c476ec675a0 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:21.795817 25682 raft_consensus.cc:2468] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 2.
I20260709 12:23:21.797829 25726 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:21.798624 27064 raft_consensus.cc:2804] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:21.799144 27064 raft_consensus.cc:697] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:21.800060 27064 consensus_queue.cc:237] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:21.801086 25828 raft_consensus.cc:2468] T 06c3ab7c0c7a496390151c476ec675a0 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 2.
I20260709 12:23:21.813881 25582 catalog_manager.cc:5697] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 1 to 2, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 2 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:21.844197 27031 raft_consensus.cc:993] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc: : Instructing follower a866ff967d964388a6f0dff7fd43df89 to start an election
I20260709 12:23:21.844636 26964 raft_consensus.cc:1081] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Signalling peer a866ff967d964388a6f0dff7fd43df89 to start an election
I20260709 12:23:21.846091 26436 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639"
dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
 from {username='slave'} at 127.0.0.1:36510
I20260709 12:23:21.846724 26436 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:21.847419 26436 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:21.853174 26436 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:21.854962 26436 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:21.855543 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:21.855852 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:21.856179 25682 raft_consensus.cc:3055] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:21.856447 25828 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:21.856498 25682 raft_consensus.cc:740] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:21.857318 25682 consensus_queue.cc:260] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:21.858433 25682 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:21.862869 25828 raft_consensus.cc:2468] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 2.
I20260709 12:23:21.864084 26402 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:21.864567 25682 raft_consensus.cc:2468] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 2.
I20260709 12:23:21.864935 26974 raft_consensus.cc:2804] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:21.865634 26974 raft_consensus.cc:697] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:23:21.866515 26974 consensus_queue.cc:237] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:21.875242 25582 catalog_manager.cc:5697] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 1 to 2, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 2 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:22.044809 25760 raft_consensus.cc:1275] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:23:22.046043 26974 consensus_queue.cc:1048] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:22.059309 25686 raft_consensus.cc:1275] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:23:22.062116 26974 consensus_queue.cc:1048] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:22.100899 25686 raft_consensus.cc:1275] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:22.101994 27049 consensus_queue.cc:1048] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:22.113373 25760 raft_consensus.cc:1275] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:22.114826 26995 consensus_queue.cc:1048] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:22.149179 25686 raft_consensus.cc:1275] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:22.150426 26995 consensus_queue.cc:1048] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:22.159490 25760 raft_consensus.cc:1275] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:22.161947 26995 consensus_queue.cc:1048] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:22.337153 25760 consensus_queue.cc:237] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
W20260709 12:23:22.344813 25726 consensus_peers.cc:597] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Couldn't send request to peer a866ff967d964388a6f0dff7fd43df89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 25bd5658646b41608d707d196c6e0585. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:22.345345 25828 raft_consensus.cc:1275] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:22.346448 25686 raft_consensus.cc:1275] T 25bd5658646b41608d707d196c6e0585 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:22.346678 27038 consensus_queue.cc:1048] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:22.347602 26996 consensus_queue.cc:1048] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:22.357178 27038 raft_consensus.cc:2955] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:22.360545 25831 raft_consensus.cc:1275] T 06c3ab7c0c7a496390151c476ec675a0 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:22.360653 25828 raft_consensus.cc:2955] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:22.362087 26996 consensus_queue.cc:1048] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:22.366478 25682 raft_consensus.cc:1275] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:22.367877 26973 consensus_queue.cc:1048] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:22.401794 25682 raft_consensus.cc:1275] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:22.403198 27038 consensus_queue.cc:1048] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:22.404050 25756 consensus_queue.cc:237] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
W20260709 12:23:22.422216 25726 consensus_peers.cc:597] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 -> Peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Couldn't send request to peer a866ff967d964388a6f0dff7fd43df89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0c043718ee3a40fea4b2b1453fcb259b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:22.426874 25830 raft_consensus.cc:1275] T 0c043718ee3a40fea4b2b1453fcb259b P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:22.428373 25582 catalog_manager.cc:5697] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: config changed from index -1 to 3, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New cstate: current_term: 2 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:22.429682 26996 consensus_queue.cc:1048] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:22.431286 25830 raft_consensus.cc:1275] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:22.439632 25686 raft_consensus.cc:1275] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:22.443066 26996 consensus_queue.cc:1048] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:22.444411 26973 consensus_queue.cc:1048] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:22.451803 26996 raft_consensus.cc:2955] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:22.462234 25680 raft_consensus.cc:2955] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:22.474572 25828 consensus_queue.cc:237] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:22.467383 25686 raft_consensus.cc:2955] T 25bd5658646b41608d707d196c6e0585 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
W20260709 12:23:22.492111 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 81572.5us
I20260709 12:23:22.507066 25829 raft_consensus.cc:2955] T 0c043718ee3a40fea4b2b1453fcb259b P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
W20260709 12:23:22.522125 25801 consensus_peers.cc:597] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a -> Peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Couldn't send request to peer a866ff967d964388a6f0dff7fd43df89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 90d850895b8a4a40a4fba5caf2048ca2. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:22.525179 25680 raft_consensus.cc:1275] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:22.526733 26995 consensus_queue.cc:1048] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:22.541290 25762 raft_consensus.cc:1275] T 90d850895b8a4a40a4fba5caf2048ca2 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:22.546694 25686 raft_consensus.cc:2955] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:22.547154 26995 raft_consensus.cc:2955] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:22.558873 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:22.560348 27049 consensus_queue.cc:1048] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:22.565857 25757 consensus_queue.cc:237] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:22.566079 25583 catalog_manager.cc:5697] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: config changed from index -1 to 3, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New cstate: current_term: 2 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:22.585948 25726 consensus_peers.cc:597] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Couldn't send request to peer a866ff967d964388a6f0dff7fd43df89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: de96c5816bc14e3cb8f32ff10dc52a61. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:22.589784 25829 raft_consensus.cc:1275] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:22.590996 26996 consensus_queue.cc:1048] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:22.598369 25680 raft_consensus.cc:1275] T de96c5816bc14e3cb8f32ff10dc52a61 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:22.600250 27064 consensus_queue.cc:1048] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:22.604837 25762 raft_consensus.cc:2955] T 90d850895b8a4a40a4fba5caf2048ca2 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:22.625036 27038 raft_consensus.cc:2955] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:22.631009 25581 catalog_manager.cc:5697] T 90d850895b8a4a40a4fba5caf2048ca2 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New cstate: current_term: 1 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:22.643131 25680 raft_consensus.cc:2955] T de96c5816bc14e3cb8f32ff10dc52a61 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:22.657711 25582 catalog_manager.cc:5697] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: config changed from index -1 to 3, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New cstate: current_term: 2 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:22.662272 25829 raft_consensus.cc:2955] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:22.702749 25762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
mode: GRACEFUL
new_leader_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:48134
I20260709 12:23:22.703532 25762 raft_consensus.cc:606] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 1 LEADER]: Received request to transfer leadership to TS 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:23:22.706198 25680 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
mode: GRACEFUL
new_leader_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:49108
I20260709 12:23:22.706749 25680 raft_consensus.cc:606] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Received request to transfer leadership to TS 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:22.709271 25829 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:23:22.709776 25829 raft_consensus.cc:606] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 2 LEADER]: Received request to transfer leadership to TS 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:22.710879 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:23:22.712163 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:22.712886 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:22.790134 27099 ts_tablet_manager.cc:933] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89: Initiating tablet copy from peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:22.792503 27099 tablet_copy_client.cc:323] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Beginning tablet copy session from remote peer at address 127.23.245.130:37267
I20260709 12:23:22.794250 25773 tablet_copy_service.cc:140] P 6e673265293d4e9a937dc45150aeb1b8: Received BeginTabletCopySession request for tablet 25bd5658646b41608d707d196c6e0585 from peer a866ff967d964388a6f0dff7fd43df89 ({username='slave'} at 127.0.0.1:48606)
I20260709 12:23:22.794692 25773 tablet_copy_service.cc:161] P 6e673265293d4e9a937dc45150aeb1b8: Beginning new tablet copy session on tablet 25bd5658646b41608d707d196c6e0585 from peer a866ff967d964388a6f0dff7fd43df89 at {username='slave'} at 127.0.0.1:48606: session id = a866ff967d964388a6f0dff7fd43df89-25bd5658646b41608d707d196c6e0585
I20260709 12:23:22.802585 25773 tablet_copy_source_session.cc:215] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:22.807024 27099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25bd5658646b41608d707d196c6e0585. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.824461 27099 tablet_copy_client.cc:806] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:22.825023 27099 tablet_copy_client.cc:670] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:22.829160 27099 tablet_copy_client.cc:538] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:22.840468 27099 tablet_bootstrap.cc:492] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89: Bootstrap starting.
I20260709 12:23:22.865844 27099 tablet_bootstrap.cc:492] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:22.866815 27099 tablet_bootstrap.cc:492] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89: Bootstrap complete.
I20260709 12:23:22.867481 27099 ts_tablet_manager.cc:1403] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.007s
I20260709 12:23:22.870424 27099 raft_consensus.cc:359] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:22.871240 27099 raft_consensus.cc:740] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Initialized, Role: LEARNER
I20260709 12:23:22.871891 27099 consensus_queue.cc:260] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:22.874820 27099 ts_tablet_manager.cc:1434] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 12:23:22.876498 25773 tablet_copy_service.cc:342] P 6e673265293d4e9a937dc45150aeb1b8: Request end of tablet copy session a866ff967d964388a6f0dff7fd43df89-25bd5658646b41608d707d196c6e0585 received from {username='slave'} at 127.0.0.1:48606
I20260709 12:23:22.876868 25773 tablet_copy_service.cc:434] P 6e673265293d4e9a937dc45150aeb1b8: ending tablet copy session a866ff967d964388a6f0dff7fd43df89-25bd5658646b41608d707d196c6e0585 on tablet 25bd5658646b41608d707d196c6e0585 with peer a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:22.926465 27099 ts_tablet_manager.cc:933] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89: Initiating tablet copy from peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:22.928270 27099 tablet_copy_client.cc:323] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89: tablet copy: Beginning tablet copy session from remote peer at address 127.23.245.130:37267
I20260709 12:23:22.929950 25773 tablet_copy_service.cc:140] P 6e673265293d4e9a937dc45150aeb1b8: Received BeginTabletCopySession request for tablet 0c043718ee3a40fea4b2b1453fcb259b from peer a866ff967d964388a6f0dff7fd43df89 ({username='slave'} at 127.0.0.1:48606)
I20260709 12:23:22.930543 25773 tablet_copy_service.cc:161] P 6e673265293d4e9a937dc45150aeb1b8: Beginning new tablet copy session on tablet 0c043718ee3a40fea4b2b1453fcb259b from peer a866ff967d964388a6f0dff7fd43df89 at {username='slave'} at 127.0.0.1:48606: session id = a866ff967d964388a6f0dff7fd43df89-0c043718ee3a40fea4b2b1453fcb259b
I20260709 12:23:22.938768 25773 tablet_copy_source_session.cc:215] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:22.947643 27099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c043718ee3a40fea4b2b1453fcb259b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:22.951514 26995 raft_consensus.cc:993] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a: : Instructing follower 6e673265293d4e9a937dc45150aeb1b8 to start an election
I20260709 12:23:22.952040 27049 raft_consensus.cc:1081] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 2 LEADER]: Signalling peer 6e673265293d4e9a937dc45150aeb1b8 to start an election
I20260709 12:23:22.957675 25757 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:53460
I20260709 12:23:22.958237 25757 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:22.958580 25757 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:22.963227 27064 raft_consensus.cc:993] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8: : Instructing follower 5cccf20a8bff46dba6601f241d172b8a to start an election
I20260709 12:23:22.963766 26996 raft_consensus.cc:1081] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 1 LEADER]: Signalling peer 5cccf20a8bff46dba6601f241d172b8a to start an election
I20260709 12:23:22.966637 27031 raft_consensus.cc:993] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc: : Instructing follower 6e673265293d4e9a937dc45150aeb1b8 to start an election
I20260709 12:23:22.966367 27099 tablet_copy_client.cc:806] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:22.967125 27088 raft_consensus.cc:1081] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Signalling peer 6e673265293d4e9a937dc45150aeb1b8 to start an election
I20260709 12:23:22.967680 27099 tablet_copy_client.cc:670] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:22.968103 25829 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:44218
I20260709 12:23:22.968591 25829 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:22.968916 25829 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:22.970227 25762 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:53474
I20260709 12:23:22.970738 25762 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:22.971071 25762 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:22.973166 27099 tablet_copy_client.cc:538] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:22.986007 27099 tablet_bootstrap.cc:492] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89: Bootstrap starting.
I20260709 12:23:23.016793 25757 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:23.018751 25757 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:23.037021 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:23.037657 26439 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:23.043077 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:23.043872 25828 raft_consensus.cc:3055] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:23.044289 25828 raft_consensus.cc:740] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:23.045178 26439 raft_consensus.cc:2468] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 3.
I20260709 12:23:23.045269 25828 consensus_queue.cc:260] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:23.047283 27104 ts_tablet_manager.cc:933] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89: Initiating tablet copy from peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:23.047570 25828 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:23.036976 27103 ts_tablet_manager.cc:933] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89: Initiating tablet copy from peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:23.058139 27104 tablet_copy_client.cc:323] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Beginning tablet copy session from remote peer at address 127.23.245.131:36237
I20260709 12:23:23.063482 27103 tablet_copy_client.cc:323] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Beginning tablet copy session from remote peer at address 127.23.245.130:37267
I20260709 12:23:23.065807 25773 tablet_copy_service.cc:140] P 6e673265293d4e9a937dc45150aeb1b8: Received BeginTabletCopySession request for tablet de96c5816bc14e3cb8f32ff10dc52a61 from peer a866ff967d964388a6f0dff7fd43df89 ({username='slave'} at 127.0.0.1:48606)
I20260709 12:23:23.066329 25773 tablet_copy_service.cc:161] P 6e673265293d4e9a937dc45150aeb1b8: Beginning new tablet copy session on tablet de96c5816bc14e3cb8f32ff10dc52a61 from peer a866ff967d964388a6f0dff7fd43df89 at {username='slave'} at 127.0.0.1:48606: session id = a866ff967d964388a6f0dff7fd43df89-de96c5816bc14e3cb8f32ff10dc52a61
I20260709 12:23:23.074674 25773 tablet_copy_source_session.cc:215] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:23.076742 25847 tablet_copy_service.cc:140] P 5cccf20a8bff46dba6601f241d172b8a: Received BeginTabletCopySession request for tablet 90d850895b8a4a40a4fba5caf2048ca2 from peer a866ff967d964388a6f0dff7fd43df89 ({username='slave'} at 127.0.0.1:41782)
I20260709 12:23:23.077308 25847 tablet_copy_service.cc:161] P 5cccf20a8bff46dba6601f241d172b8a: Beginning new tablet copy session on tablet 90d850895b8a4a40a4fba5caf2048ca2 from peer a866ff967d964388a6f0dff7fd43df89 at {username='slave'} at 127.0.0.1:41782: session id = a866ff967d964388a6f0dff7fd43df89-90d850895b8a4a40a4fba5caf2048ca2
I20260709 12:23:23.082051 25726 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:23.082886 27038 raft_consensus.cc:2804] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:23.083400 27038 raft_consensus.cc:697] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:23.084337 27099 tablet_bootstrap.cc:492] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:23.084326 27038 consensus_queue.cc:237] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:23.085398 27099 tablet_bootstrap.cc:492] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89: Bootstrap complete.
I20260709 12:23:23.094302 25829 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:23.100574 25828 raft_consensus.cc:2468] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 3.
I20260709 12:23:23.086113 27099 ts_tablet_manager.cc:1403] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89: Time spent bootstrapping tablet: real 0.100s	user 0.043s	sys 0.037s
I20260709 12:23:23.115145 27099 raft_consensus.cc:359] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:23.116070 27099 raft_consensus.cc:740] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Initialized, Role: LEARNER
I20260709 12:23:23.116699 27099 consensus_queue.cc:260] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:23.119043 27099 ts_tablet_manager.cc:1434] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89: Time spent starting tablet: real 0.017s	user 0.002s	sys 0.003s
I20260709 12:23:23.086330 27103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de96c5816bc14e3cb8f32ff10dc52a61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.110494 25847 tablet_copy_source_session.cc:215] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:23.136876 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:23.137214 25773 tablet_copy_service.cc:342] P 6e673265293d4e9a937dc45150aeb1b8: Request end of tablet copy session a866ff967d964388a6f0dff7fd43df89-0c043718ee3a40fea4b2b1453fcb259b received from {username='slave'} at 127.0.0.1:48606
I20260709 12:23:23.137522 25680 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:23.137742 25773 tablet_copy_service.cc:434] P 6e673265293d4e9a937dc45150aeb1b8: ending tablet copy session a866ff967d964388a6f0dff7fd43df89-0c043718ee3a40fea4b2b1453fcb259b on tablet 0c043718ee3a40fea4b2b1453fcb259b with peer a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:23.143453 25581 catalog_manager.cc:5697] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 2 to 3, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 3 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:23.112612 25762 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:23.146338 25829 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:23.148972 25680 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 2.
I20260709 12:23:23.152071 27104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90d850895b8a4a40a4fba5caf2048ca2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:23.159566 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:23.160207 25757 raft_consensus.cc:3055] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:23.160508 25757 raft_consensus.cc:740] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:23.161275 25757 consensus_queue.cc:260] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:23.162395 25757 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:23.152328 25762 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:23.154536 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:23.164244 25682 raft_consensus.cc:3055] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:23.164582 25682 raft_consensus.cc:740] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:23.165323 25682 consensus_queue.cc:260] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:23.166429 25682 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:23.169703 27103 tablet_copy_client.cc:806] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:23.169490 25801 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:23.170291 27103 tablet_copy_client.cc:670] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:23.170866 26995 raft_consensus.cc:2804] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:23.171353 26995 raft_consensus.cc:697] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 2 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:23.172235 26995 consensus_queue.cc:237] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:23.181977 27103 tablet_copy_client.cc:538] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:23.185020 25757 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 2.
I20260709 12:23:23.188009 25682 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 2.
I20260709 12:23:23.188297 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:23.188920 25831 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:23.190704 25726 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:23.192443 27064 raft_consensus.cc:2804] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:23.192958 27064 raft_consensus.cc:697] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:23.193806 27064 consensus_queue.cc:237] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:23.195757 25831 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 2.
I20260709 12:23:23.201489 27103 tablet_bootstrap.cc:492] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89: Bootstrap starting.
I20260709 12:23:23.202046 27104 tablet_copy_client.cc:806] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:23.208693 27104 tablet_copy_client.cc:670] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:23.213321 27104 tablet_copy_client.cc:538] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:23.213958 25581 catalog_manager.cc:5697] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 1 to 2, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 2 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:23.230569 27104 tablet_bootstrap.cc:492] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89: Bootstrap starting.
I20260709 12:23:23.245693 25581 catalog_manager.cc:5697] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 1 to 2, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 2 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:23.250700 27103 tablet_bootstrap.cc:492] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:23.251711 27103 tablet_bootstrap.cc:492] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89: Bootstrap complete.
I20260709 12:23:23.252687 27103 ts_tablet_manager.cc:1403] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89: Time spent bootstrapping tablet: real 0.051s	user 0.023s	sys 0.014s
I20260709 12:23:23.260607 27103 raft_consensus.cc:359] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:23.261475 27103 raft_consensus.cc:740] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Initialized, Role: LEARNER
I20260709 12:23:23.262131 27103 consensus_queue.cc:260] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:23.264803 27103 ts_tablet_manager.cc:1434] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.005s
I20260709 12:23:23.266786 25773 tablet_copy_service.cc:342] P 6e673265293d4e9a937dc45150aeb1b8: Request end of tablet copy session a866ff967d964388a6f0dff7fd43df89-de96c5816bc14e3cb8f32ff10dc52a61 received from {username='slave'} at 127.0.0.1:48606
I20260709 12:23:23.267217 25773 tablet_copy_service.cc:434] P 6e673265293d4e9a937dc45150aeb1b8: ending tablet copy session a866ff967d964388a6f0dff7fd43df89-de96c5816bc14e3cb8f32ff10dc52a61 on tablet de96c5816bc14e3cb8f32ff10dc52a61 with peer a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:23.269259 27104 tablet_bootstrap.cc:492] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:23.270254 27104 tablet_bootstrap.cc:492] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89: Bootstrap complete.
I20260709 12:23:23.270947 27104 ts_tablet_manager.cc:1403] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89: Time spent bootstrapping tablet: real 0.041s	user 0.022s	sys 0.004s
I20260709 12:23:23.274161 27104 raft_consensus.cc:359] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:23.274930 27104 raft_consensus.cc:740] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Initialized, Role: LEARNER
I20260709 12:23:23.275568 27104 consensus_queue.cc:260] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:23.277657 27104 ts_tablet_manager.cc:1434] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 12:23:23.279278 25847 tablet_copy_service.cc:342] P 5cccf20a8bff46dba6601f241d172b8a: Request end of tablet copy session a866ff967d964388a6f0dff7fd43df89-90d850895b8a4a40a4fba5caf2048ca2 received from {username='slave'} at 127.0.0.1:41782
I20260709 12:23:23.279788 25847 tablet_copy_service.cc:434] P 5cccf20a8bff46dba6601f241d172b8a: ending tablet copy session a866ff967d964388a6f0dff7fd43df89-90d850895b8a4a40a4fba5caf2048ca2 on tablet 90d850895b8a4a40a4fba5caf2048ca2 with peer a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:23.295861 26437 raft_consensus.cc:1217] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:23:23.322841 26437 raft_consensus.cc:1217] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:23:23.371233 26437 raft_consensus.cc:1217] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:23.478471 26437 raft_consensus.cc:1217] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:23:23.507390 25831 raft_consensus.cc:1275] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:23:23.508616 26996 consensus_queue.cc:1048] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:23.525802 26437 raft_consensus.cc:1275] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:23:23.527611 27038 consensus_queue.cc:1048] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:23.590554 25757 raft_consensus.cc:1275] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:23.592505 26991 consensus_queue.cc:1048] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:23.616118 25680 raft_consensus.cc:1275] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:23.622346 26995 consensus_queue.cc:1048] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:23.672115 25828 raft_consensus.cc:1275] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:23.673426 27038 consensus_queue.cc:1048] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:23.687953 25680 raft_consensus.cc:1275] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:23.689530 26996 consensus_queue.cc:1048] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:23.762899 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:23.822503 25828 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "f82778701b464892aab92a752ed7ffdc"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:23:23.823114 25828 raft_consensus.cc:606] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Received request to transfer leadership to TS f82778701b464892aab92a752ed7ffdc
I20260709 12:23:23.825770 25680 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
mode: GRACEFUL
new_leader_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:49108
I20260709 12:23:23.826408 25680 raft_consensus.cc:606] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Received request to transfer leadership to TS 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:23.829006 25757 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
mode: GRACEFUL
new_leader_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:48134
I20260709 12:23:23.829468 25757 raft_consensus.cc:606] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Received request to transfer leadership to TS 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:23:23.831857 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:23:23.833632 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:23.834350 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:23.864653 27064 raft_consensus.cc:1064] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8: attempting to promote NON_VOTER a866ff967d964388a6f0dff7fd43df89 to VOTER
I20260709 12:23:23.867233 27064 consensus_queue.cc:237] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:23.871680 26991 raft_consensus.cc:1064] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a: attempting to promote NON_VOTER a866ff967d964388a6f0dff7fd43df89 to VOTER
I20260709 12:23:23.874219 26991 consensus_queue.cc:237] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:23.892141 27038 raft_consensus.cc:1064] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8: attempting to promote NON_VOTER a866ff967d964388a6f0dff7fd43df89 to VOTER
I20260709 12:23:23.896463 25757 raft_consensus.cc:1275] T 90d850895b8a4a40a4fba5caf2048ca2 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:23.897766 26437 raft_consensus.cc:1275] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:23.899434 26995 consensus_queue.cc:1048] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:23.901199 26995 consensus_queue.cc:1048] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:23.911592 27038 consensus_queue.cc:237] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:23.916487 25828 raft_consensus.cc:1275] T 0c043718ee3a40fea4b2b1453fcb259b P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:23:23.928563 25686 raft_consensus.cc:1275] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:23.935416 26995 raft_consensus.cc:993] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a: : Instructing follower f82778701b464892aab92a752ed7ffdc to start an election
I20260709 12:23:23.935592 26991 consensus_queue.cc:1048] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:23.936033 26995 raft_consensus.cc:1081] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Signalling peer f82778701b464892aab92a752ed7ffdc to start an election
I20260709 12:23:23.940881 26437 raft_consensus.cc:1275] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 2 LEARNER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:23:23.942502 27128 consensus_queue.cc:1048] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:23.944638 25686 raft_consensus.cc:1275] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:23:23.944774 25682 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
 from {username='slave'} at 127.0.0.1:40220
I20260709 12:23:23.945324 25682 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:23.945814 25682 raft_consensus.cc:3060] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:23.949606 26996 raft_consensus.cc:1064] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8: attempting to promote NON_VOTER a866ff967d964388a6f0dff7fd43df89 to VOTER
I20260709 12:23:23.952931 25682 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:23.954778 25682 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:23.955663 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:23.956235 25828 raft_consensus.cc:3055] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:23.956525 25828 raft_consensus.cc:740] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:23.957304 25828 consensus_queue.cc:260] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:23.958397 25828 raft_consensus.cc:3060] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:23.969241 26996 consensus_queue.cc:237] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:23.971659 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:23.972255 25757 raft_consensus.cc:3060] T 5204a6a2db104ffa90f8679086d4e6f8 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:23.988335 25828 raft_consensus.cc:2468] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 2.
I20260709 12:23:23.989528 25650 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:23.990362 27088 raft_consensus.cc:2804] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:23.991492 27088 raft_consensus.cc:697] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 2 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:23.992745 27088 consensus_queue.cc:237] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:23:23.998394 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 57256.2us
I20260709 12:23:24.000475 26437 raft_consensus.cc:1275] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEARNER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:23:23.997556 27126 raft_consensus.cc:2955] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:24.002333 25677 raft_consensus.cc:2955] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:24.004047 25682 raft_consensus.cc:1275] T 25bd5658646b41608d707d196c6e0585 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:23:24.006294 27038 consensus_queue.cc:1048] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:24.009166 27038 consensus_queue.cc:1048] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:24.011298 27038 consensus_queue.cc:1048] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:24.016002 25829 raft_consensus.cc:1275] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:23:24.015612 27128 consensus_queue.cc:1048] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:24.019029 26439 raft_consensus.cc:1275] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEARNER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:23:24.021955 25682 raft_consensus.cc:1275] T de96c5816bc14e3cb8f32ff10dc52a61 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:23:24.023339 25828 raft_consensus.cc:1275] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:23:24.025790 25757 raft_consensus.cc:2468] T 5204a6a2db104ffa90f8679086d4e6f8 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 2.
W20260709 12:23:24.083173 27134 log.cc:927] Time spent T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:23:24.027639 27038 consensus_queue.cc:1048] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 12:23:24.031020 27064 consensus_queue.cc:1048] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
W20260709 12:23:24.085242 27133 log.cc:927] Time spent T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:23:24.156013 26996 consensus_queue.cc:1048] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:23:24.223802 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 76815.8us
W20260709 12:23:24.161548 27137 log.cc:927] Time spent T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
W20260709 12:23:24.279076 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 54485.3us
W20260709 12:23:24.288524 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 108619us
I20260709 12:23:24.367158 25754 raft_consensus.cc:2955] T 90d850895b8a4a40a4fba5caf2048ca2 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:24.385426 25582 catalog_manager.cc:5697] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 1 to 2, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 2 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:24.385637 25580 catalog_manager.cc:5697] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:24.396531 26436 raft_consensus.cc:2955] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
W20260709 12:23:24.399575 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 356729us
I20260709 12:23:24.401180 25757 raft_consensus.cc:1275] T 5204a6a2db104ffa90f8679086d4e6f8 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:24.408133 27031 consensus_queue.cc:1048] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:24.464952 27141 raft_consensus.cc:2955] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:24.466238 27038 raft_consensus.cc:2955] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:24.458380 27154 consensus_queue.cc:1048] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 12:23:24.517136 27128 raft_consensus.cc:993] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8: : Instructing follower 5cccf20a8bff46dba6601f241d172b8a to start an election
I20260709 12:23:24.521418 26996 raft_consensus.cc:1081] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Signalling peer 5cccf20a8bff46dba6601f241d172b8a to start an election
I20260709 12:23:24.532570 26436 raft_consensus.cc:2955] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:24.543574 26439 raft_consensus.cc:2955] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:24.550453 25837 raft_consensus.cc:2955] T 0c043718ee3a40fea4b2b1453fcb259b P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:24.556793 25677 raft_consensus.cc:2955] T 25bd5658646b41608d707d196c6e0585 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:24.563999 25828 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:44218
I20260709 12:23:24.564597 25828 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:24.564953 25828 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:24.570305 25828 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:24.572503 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:24.573048 25756 raft_consensus.cc:3055] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:24.573282 25756 raft_consensus.cc:740] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:24.573896 25756 consensus_queue.cc:260] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:24.574651 25756 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:24.571908 25828 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:24.579100 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:24.579556 26436 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:24.595584 25756 raft_consensus.cc:2468] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 4.
I20260709 12:23:24.597709 25800 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:23:24.598483 26995 raft_consensus.cc:2804] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:24.598901 26995 raft_consensus.cc:697] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:24.599654 26995 consensus_queue.cc:237] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:24.603827 26996 raft_consensus.cc:2955] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:24.606148 25680 raft_consensus.cc:2955] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:24.614120 27151 raft_consensus.cc:993] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc: : Instructing follower 6e673265293d4e9a937dc45150aeb1b8 to start an election
I20260709 12:23:24.614601 27151 raft_consensus.cc:1081] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Signalling peer 6e673265293d4e9a937dc45150aeb1b8 to start an election
I20260709 12:23:24.624827 25828 raft_consensus.cc:1275] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:24.626039 26436 raft_consensus.cc:2468] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 4.
I20260709 12:23:24.627858 25828 raft_consensus.cc:2955] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:24.629086 25756 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:53474
I20260709 12:23:24.629627 25756 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:24.629963 25756 raft_consensus.cc:3060] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:24.657629 25756 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:24.659701 25756 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:24.661535 25677 raft_consensus.cc:2955] T de96c5816bc14e3cb8f32ff10dc52a61 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:24.648473 25833 raft_consensus.cc:2955] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:24.640079 27150 consensus_queue.cc:1048] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 12:23:24.689208 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:24.689882 25678 raft_consensus.cc:3055] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:24.690399 25678 raft_consensus.cc:740] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:24.690048 26436 raft_consensus.cc:2955] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:24.691486 25678 consensus_queue.cc:260] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:24.698573 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:24.699190 25831 raft_consensus.cc:3060] T b12e2b074f1b4518bcfc6728abeca136 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:24.702487 25678 raft_consensus.cc:3060] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:24.703141 25829 raft_consensus.cc:1240] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:24.726189 25678 raft_consensus.cc:2468] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 2.
I20260709 12:23:24.728163 25726 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:24.735069 27159 raft_consensus.cc:2804] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:24.752882 25831 raft_consensus.cc:2468] T b12e2b074f1b4518bcfc6728abeca136 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 2.
I20260709 12:23:24.756636 27159 raft_consensus.cc:697] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:24.763810 27159 consensus_queue.cc:237] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:24.789535 25584 catalog_manager.cc:5697] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:24.791793 25584 catalog_manager.cc:5697] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 reported cstate change: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:24.798012 25584 catalog_manager.cc:5697] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:24.846583 25580 catalog_manager.cc:5697] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 1 to 2, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 2 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:24.869939 25582 catalog_manager.cc:5697] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 3 to 4, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 4 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:24.873492 25754 consensus_queue.cc:237] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:24.890043 26436 raft_consensus.cc:1275] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:24.894887 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:24.898840 25756 consensus_queue.cc:237] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:23:24.914299 25800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:24.917948 27159 consensus_queue.cc:1048] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:24.930490 25754 consensus_queue.cc:237] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:24.936079 26439 raft_consensus.cc:1275] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:24.938972 27141 consensus_queue.cc:1048] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:24.942021 27146 raft_consensus.cc:2955] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:24.948570 25837 raft_consensus.cc:1275] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:24.949626 25833 raft_consensus.cc:1275] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:24.948907 27141 raft_consensus.cc:2955] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:24.953445 25568 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet de96c5816bc14e3cb8f32ff10dc52a61 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:24.920572 25831 consensus_queue.cc:237] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:24.960258 27154 consensus_queue.cc:1048] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:24.960520 26437 raft_consensus.cc:1275] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:24.961952 27172 consensus_queue.cc:1048] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:24.961645 26439 raft_consensus.cc:2955] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:24.962606 27154 consensus_queue.cc:1048] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:24.960410 26436 raft_consensus.cc:2955] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:24.970891 27049 raft_consensus.cc:2955] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:24.973205 26437 raft_consensus.cc:1275] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:24.973734 25568 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 25bd5658646b41608d707d196c6e0585 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:24.974625 27160 consensus_queue.cc:1048] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:24.981220 25569 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 90d850895b8a4a40a4fba5caf2048ca2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:24.984757 26438 raft_consensus.cc:2955] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:24.986742 27160 raft_consensus.cc:2955] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:24.988476 25837 raft_consensus.cc:2955] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:24.993213 26437 raft_consensus.cc:2955] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:25.011092 25678 raft_consensus.cc:1275] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:25.016737 25678 raft_consensus.cc:1275] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:25.017730 25831 raft_consensus.cc:2955] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:25.018517 25584 catalog_manager.cc:5697] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: config changed from index 3 to 4, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New cstate: current_term: 1 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:25.021310 25568 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0c043718ee3a40fea4b2b1453fcb259b with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:25.030704 27142 consensus_queue.cc:1048] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:25.037966 25677 raft_consensus.cc:2955] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:25.038479 25583 catalog_manager.cc:5697] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: config changed from index 4 to 5, VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129) evicted. New cstate: current_term: 2 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:25.046828 25583 catalog_manager.cc:5697] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: config changed from index 4 to 5, VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129) evicted. New cstate: current_term: 2 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:25.049232 27155 consensus_queue.cc:1048] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:25.054414 25678 raft_consensus.cc:2955] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:25.097168 25753 tablet_service.cc:1558] Processing DeleteTablet for tablet 90d850895b8a4a40a4fba5caf2048ca2 with delete_type TABLET_DATA_TOMBSTONED (TS 6e673265293d4e9a937dc45150aeb1b8 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:53452
I20260709 12:23:25.104903 27179 tablet_replica.cc:333] T 90d850895b8a4a40a4fba5caf2048ca2 P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
I20260709 12:23:25.106060 27179 raft_consensus.cc:2243] T 90d850895b8a4a40a4fba5caf2048ca2 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:25.106865 27179 raft_consensus.cc:2272] T 90d850895b8a4a40a4fba5caf2048ca2 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:25.109071 25580 catalog_manager.cc:5697] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc reported cstate change: config changed from index 4 to 5, VOTER 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) evicted. New cstate: current_term: 2 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:25.111518 25831 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "a866ff967d964388a6f0dff7fd43df89"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:23:25.112123 25831 raft_consensus.cc:606] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Received request to transfer leadership to TS a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:25.112650 27179 ts_tablet_manager.cc:1916] T 90d850895b8a4a40a4fba5caf2048ca2 P 6e673265293d4e9a937dc45150aeb1b8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:25.114897 25754 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
mode: GRACEFUL
new_leader_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:48134
I20260709 12:23:25.115448 25754 raft_consensus.cc:606] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Received request to transfer leadership to TS 5cccf20a8bff46dba6601f241d172b8a
W20260709 12:23:25.117168 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 45872.9us
I20260709 12:23:25.119900 25678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
mode: GRACEFUL
new_leader_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:49108
I20260709 12:23:25.120534 25678 raft_consensus.cc:606] T f979ddeb5c014d329931d4e2e035af60 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Received request to transfer leadership to TS 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:25.121707 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:23:25.123351 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:25.127018 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:25.128515 25676 tablet_service.cc:1558] Processing DeleteTablet for tablet 25bd5658646b41608d707d196c6e0585 with delete_type TABLET_DATA_TOMBSTONED (TS f82778701b464892aab92a752ed7ffdc not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:40214
I20260709 12:23:25.129418 25675 tablet_service.cc:1558] Processing DeleteTablet for tablet de96c5816bc14e3cb8f32ff10dc52a61 with delete_type TABLET_DATA_TOMBSTONED (TS f82778701b464892aab92a752ed7ffdc not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:40214
I20260709 12:23:25.135342 26437 raft_consensus.cc:1275] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:23:25.136921 27172 consensus_queue.cc:1048] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:25.142879 27179 ts_tablet_manager.cc:1929] T 90d850895b8a4a40a4fba5caf2048ca2 P 6e673265293d4e9a937dc45150aeb1b8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:25.143438 27179 log.cc:1199] T 90d850895b8a4a40a4fba5caf2048ca2 P 6e673265293d4e9a937dc45150aeb1b8: Deleting WAL directory at /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-1-root/wals/90d850895b8a4a40a4fba5caf2048ca2
I20260709 12:23:25.145383 25568 catalog_manager.cc:5028] TS 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): tablet 90d850895b8a4a40a4fba5caf2048ca2 (table test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]) successfully deleted
I20260709 12:23:25.155196 25756 raft_consensus.cc:1275] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:23:25.157047 27126 consensus_queue.cc:1048] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:25.176046 27180 tablet_replica.cc:333] T 25bd5658646b41608d707d196c6e0585 P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
I20260709 12:23:25.180744 27180 raft_consensus.cc:2243] T 25bd5658646b41608d707d196c6e0585 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:25.182322 27180 raft_consensus.cc:2272] T 25bd5658646b41608d707d196c6e0585 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:25.199532 25824 tablet_service.cc:1558] Processing DeleteTablet for tablet 0c043718ee3a40fea4b2b1453fcb259b with delete_type TABLET_DATA_TOMBSTONED (TS 5cccf20a8bff46dba6601f241d172b8a not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:44194
I20260709 12:23:25.203063 25677 raft_consensus.cc:1275] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:25.204717 27154 consensus_queue.cc:1048] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:25.229772 27160 raft_consensus.cc:993] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8: : Instructing follower 5cccf20a8bff46dba6601f241d172b8a to start an election
I20260709 12:23:25.230281 27160 raft_consensus.cc:1081] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Signalling peer 5cccf20a8bff46dba6601f241d172b8a to start an election
I20260709 12:23:25.230814 27180 ts_tablet_manager.cc:1916] T 25bd5658646b41608d707d196c6e0585 P f82778701b464892aab92a752ed7ffdc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:25.238816 25837 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:44218
I20260709 12:23:25.241459 25837 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:25.245798 25837 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:25.242364 27184 tablet_replica.cc:333] T 0c043718ee3a40fea4b2b1453fcb259b P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
I20260709 12:23:25.267721 27184 raft_consensus.cc:2243] T 0c043718ee3a40fea4b2b1453fcb259b P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:25.268692 27184 raft_consensus.cc:2272] T 0c043718ee3a40fea4b2b1453fcb259b P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:25.271287 25837 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:25.276229 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:25.276800 25680 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:25.277231 25837 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:25.283144 25680 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 4.
I20260709 12:23:25.283865 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:25.284193 25801 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:25.284487 25754 raft_consensus.cc:3055] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:25.284785 25754 raft_consensus.cc:740] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:25.285518 25754 consensus_queue.cc:260] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:25.287065 25754 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:25.287317 27184 ts_tablet_manager.cc:1916] T 0c043718ee3a40fea4b2b1453fcb259b P 5cccf20a8bff46dba6601f241d172b8a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:25.292507 27049 raft_consensus.cc:2804] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:25.293993 27049 raft_consensus.cc:697] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:25.294734 27049 consensus_queue.cc:237] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:25.299715 25754 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 4.
I20260709 12:23:25.320757 27180 ts_tablet_manager.cc:1929] T 25bd5658646b41608d707d196c6e0585 P f82778701b464892aab92a752ed7ffdc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:23:25.321313 27180 log.cc:1199] T 25bd5658646b41608d707d196c6e0585 P f82778701b464892aab92a752ed7ffdc: Deleting WAL directory at /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-0-root/wals/25bd5658646b41608d707d196c6e0585
I20260709 12:23:25.323021 27180 tablet_replica.cc:333] T de96c5816bc14e3cb8f32ff10dc52a61 P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
I20260709 12:23:25.323225 25833 raft_consensus.cc:1275] T b12e2b074f1b4518bcfc6728abeca136 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:25.324090 27180 raft_consensus.cc:2243] T de96c5816bc14e3cb8f32ff10dc52a61 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:25.324873 27180 raft_consensus.cc:2272] T de96c5816bc14e3cb8f32ff10dc52a61 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:25.325533 27160 consensus_queue.cc:1048] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:25.327232 27126 raft_consensus.cc:993] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a: : Instructing follower a866ff967d964388a6f0dff7fd43df89 to start an election
I20260709 12:23:25.327716 27155 raft_consensus.cc:1081] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Signalling peer a866ff967d964388a6f0dff7fd43df89 to start an election
I20260709 12:23:25.328157 27180 ts_tablet_manager.cc:1916] T de96c5816bc14e3cb8f32ff10dc52a61 P f82778701b464892aab92a752ed7ffdc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:25.329346 26437 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b"
dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
 from {username='slave'} at 127.0.0.1:36508
I20260709 12:23:25.347075 26437 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:25.347478 26437 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:25.350124 27184 ts_tablet_manager.cc:1929] T 0c043718ee3a40fea4b2b1453fcb259b P 5cccf20a8bff46dba6601f241d172b8a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:23:25.350625 27184 log.cc:1199] T 0c043718ee3a40fea4b2b1453fcb259b P 5cccf20a8bff46dba6601f241d172b8a: Deleting WAL directory at /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-2-root/wals/0c043718ee3a40fea4b2b1453fcb259b
I20260709 12:23:25.354550 26437 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:25.356598 26437 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:25.359516 27180 ts_tablet_manager.cc:1929] T de96c5816bc14e3cb8f32ff10dc52a61 P f82778701b464892aab92a752ed7ffdc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:23:25.359990 27180 log.cc:1199] T de96c5816bc14e3cb8f32ff10dc52a61 P f82778701b464892aab92a752ed7ffdc: Deleting WAL directory at /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-0-root/wals/de96c5816bc14e3cb8f32ff10dc52a61
W20260709 12:23:25.381572 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 44096.5us
I20260709 12:23:25.388939 25569 catalog_manager.cc:5028] TS 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): tablet 0c043718ee3a40fea4b2b1453fcb259b (table test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]) successfully deleted
I20260709 12:23:25.390406 25569 catalog_manager.cc:5028] TS f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): tablet 25bd5658646b41608d707d196c6e0585 (table test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]) successfully deleted
I20260709 12:23:25.391561 25569 catalog_manager.cc:5028] TS f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): tablet de96c5816bc14e3cb8f32ff10dc52a61 (table test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]) successfully deleted
I20260709 12:23:25.418292 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:25.449064 27191 raft_consensus.cc:993] T f979ddeb5c014d329931d4e2e035af60 P f82778701b464892aab92a752ed7ffdc: : Instructing follower 6e673265293d4e9a937dc45150aeb1b8 to start an election
I20260709 12:23:25.450079 27149 raft_consensus.cc:1081] T f979ddeb5c014d329931d4e2e035af60 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Signalling peer 6e673265293d4e9a937dc45150aeb1b8 to start an election
I20260709 12:23:25.419822 25757 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:25.465075 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:25.465987 25837 raft_consensus.cc:3055] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:25.466343 25837 raft_consensus.cc:740] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:25.467906 25837 consensus_queue.cc:260] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:25.470276 25837 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:25.477447 25759 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:53474
I20260709 12:23:25.478296 25759 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:25.478785 25759 raft_consensus.cc:3060] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:25.492986 25757 raft_consensus.cc:2468] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 2.
I20260709 12:23:25.495736 26401 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:25.497565 27153 raft_consensus.cc:2804] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:25.498235 27153 raft_consensus.cc:697] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 2 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:23:25.499526 27153 consensus_queue.cc:237] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:25.518471 25759 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:25.520789 25837 raft_consensus.cc:2468] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 2.
I20260709 12:23:25.544680 25759 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:25.556887 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:25.557621 25828 raft_consensus.cc:3060] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:25.560554 25583 catalog_manager.cc:5697] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 3 to 4, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 4 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:25.566947 25828 raft_consensus.cc:2468] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 2.
I20260709 12:23:25.568300 25726 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:23:25.572389 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:25.573446 25678 raft_consensus.cc:3055] T f979ddeb5c014d329931d4e2e035af60 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:25.573838 25678 raft_consensus.cc:740] T f979ddeb5c014d329931d4e2e035af60 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:25.574844 25678 consensus_queue.cc:260] T f979ddeb5c014d329931d4e2e035af60 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:25.578470 25678 raft_consensus.cc:3060] T f979ddeb5c014d329931d4e2e035af60 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:25.592655 25678 raft_consensus.cc:2468] T f979ddeb5c014d329931d4e2e035af60 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 2.
I20260709 12:23:25.593137 27141 raft_consensus.cc:2804] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:25.593600 25583 catalog_manager.cc:5697] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 1 to 2, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 2 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:25.597397 27141 raft_consensus.cc:697] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:25.598479 27141 consensus_queue.cc:237] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:25.635793 25582 catalog_manager.cc:5697] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 1 to 2, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 2 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:25.738456 25677 raft_consensus.cc:1275] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:23:25.739739 27049 consensus_queue.cc:1048] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:25.749223 25757 raft_consensus.cc:1275] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:23:25.751142 27126 consensus_queue.cc:1048] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:26.001879 25833 raft_consensus.cc:1275] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:26.005682 27194 consensus_queue.cc:1048] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:26.020514 25759 raft_consensus.cc:1275] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:26.022284 27193 consensus_queue.cc:1048] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:26.056627 25677 raft_consensus.cc:1275] T f979ddeb5c014d329931d4e2e035af60 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:26.065538 27160 consensus_queue.cc:1048] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:26.075241 25828 raft_consensus.cc:1275] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:26.076562 27141 consensus_queue.cc:1048] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:26.248270 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:26.293490 25759 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
mode: GRACEFUL
new_leader_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:48134
I20260709 12:23:26.294509 25759 raft_consensus.cc:606] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Received request to transfer leadership to TS 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:23:26.297591 25828 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "a866ff967d964388a6f0dff7fd43df89"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:23:26.298134 25828 raft_consensus.cc:606] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Received request to transfer leadership to TS a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:26.303256 25677 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
mode: GRACEFUL
new_leader_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:49108
I20260709 12:23:26.303848 25677 raft_consensus.cc:606] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Received request to transfer leadership to TS 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:26.306708 25759 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
mode: GRACEFUL
new_leader_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:48134
I20260709 12:23:26.307319 25759 raft_consensus.cc:606] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Received request to transfer leadership to TS 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:23:26.309923 25828 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "f82778701b464892aab92a752ed7ffdc"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:23:26.310448 25828 raft_consensus.cc:606] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Received request to transfer leadership to TS f82778701b464892aab92a752ed7ffdc
I20260709 12:23:26.311456 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:23:26.313403 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:26.314646 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:26.315451 25759 consensus_queue.cc:237] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:26.322132 25828 raft_consensus.cc:1275] T b12e2b074f1b4518bcfc6728abeca136 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 12:23:26.322969 25726 consensus_peers.cc:597] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Couldn't send request to peer a866ff967d964388a6f0dff7fd43df89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b12e2b074f1b4518bcfc6728abeca136. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:26.324733 25677 raft_consensus.cc:1275] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:26.325757 27146 consensus_queue.cc:1048] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:26.326717 27141 consensus_queue.cc:1048] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:26.333279 27146 raft_consensus.cc:2955] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:26.334980 25828 raft_consensus.cc:2955] T b12e2b074f1b4518bcfc6728abeca136 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:26.339984 25677 raft_consensus.cc:2955] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:26.356729 25759 consensus_queue.cc:237] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:26.360821 25583 catalog_manager.cc:5697] T b12e2b074f1b4518bcfc6728abeca136 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: config changed from index -1 to 3, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New cstate: current_term: 2 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
W20260709 12:23:26.374135 25726 consensus_peers.cc:597] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Couldn't send request to peer a866ff967d964388a6f0dff7fd43df89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 870002623db3456699b2b970d066f356. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:26.377172 25833 raft_consensus.cc:1275] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:23:26.377597 25680 raft_consensus.cc:1275] T 870002623db3456699b2b970d066f356 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:23:26.380201 27141 consensus_queue.cc:1048] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:26.382012 27141 consensus_queue.cc:1048] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:26.384274 27141 raft_consensus.cc:993] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8: : Instructing follower 5cccf20a8bff46dba6601f241d172b8a to start an election
I20260709 12:23:26.385637 27141 raft_consensus.cc:1081] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Signalling peer 5cccf20a8bff46dba6601f241d172b8a to start an election
I20260709 12:23:26.389153 25828 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:44218
I20260709 12:23:26.389663 25828 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:26.389998 25828 raft_consensus.cc:3060] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:26.399816 25828 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:26.402814 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:26.402966 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:26.403367 25759 raft_consensus.cc:3055] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:26.403451 25680 raft_consensus.cc:3060] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:26.403721 25759 raft_consensus.cc:740] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:26.404654 25759 consensus_queue.cc:260] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:26.405730 25759 raft_consensus.cc:3060] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:26.406010 25828 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:26.411403 27146 raft_consensus.cc:2955] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:26.413620 25680 raft_consensus.cc:2468] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 3.
I20260709 12:23:26.413182 25833 raft_consensus.cc:2955] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:26.421766 25801 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:26.422674 27172 raft_consensus.cc:2804] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:26.423182 27172 raft_consensus.cc:697] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 3 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:26.424108 27172 consensus_queue.cc:237] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:26.426120 25759 raft_consensus.cc:2468] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 3.
I20260709 12:23:26.428671 25581 catalog_manager.cc:5697] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: config changed from index -1 to 4, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New cstate: current_term: 3 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:26.427492 25680 consensus_queue.cc:237] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
W20260709 12:23:26.453552 25650 consensus_peers.cc:597] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc -> Peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Couldn't send request to peer a866ff967d964388a6f0dff7fd43df89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5204a6a2db104ffa90f8679086d4e6f8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:26.454241 25759 raft_consensus.cc:1275] T 5204a6a2db104ffa90f8679086d4e6f8 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:26.458236 25833 raft_consensus.cc:1275] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:26.458877 27192 consensus_queue.cc:1048] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:26.460299 27088 consensus_queue.cc:1048] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:26.459498 25680 raft_consensus.cc:2955] T 870002623db3456699b2b970d066f356 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:26.467332 25583 catalog_manager.cc:5697] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 2 to 3, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 3 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:26.485561 27192 raft_consensus.cc:2955] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:26.487545 25828 raft_consensus.cc:2955] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:26.502027 25680 consensus_queue.cc:237] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:26.505674 25759 raft_consensus.cc:2955] T 5204a6a2db104ffa90f8679086d4e6f8 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:26.518486 25583 catalog_manager.cc:5697] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc reported cstate change: config changed from index -1 to 3, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New cstate: current_term: 2 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:26.521369 25828 raft_consensus.cc:1275] T 05232536e53b419682a5f24515843652 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:26.523028 25759 raft_consensus.cc:1275] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:26.524461 25650 consensus_peers.cc:597] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc -> Peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Couldn't send request to peer a866ff967d964388a6f0dff7fd43df89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 05232536e53b419682a5f24515843652. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:26.525385 27218 consensus_queue.cc:1048] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:26.526228 27192 consensus_queue.cc:1048] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:26.539309 27192 raft_consensus.cc:2955] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:26.541740 25759 raft_consensus.cc:2955] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:26.543584 25833 raft_consensus.cc:2955] T 05232536e53b419682a5f24515843652 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:26.562724 27146 raft_consensus.cc:993] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8: : Instructing follower 5cccf20a8bff46dba6601f241d172b8a to start an election
I20260709 12:23:26.563217 27146 raft_consensus.cc:1081] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Signalling peer 5cccf20a8bff46dba6601f241d172b8a to start an election
I20260709 12:23:26.569763 27049 raft_consensus.cc:993] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a: : Instructing follower f82778701b464892aab92a752ed7ffdc to start an election
I20260709 12:23:26.570221 27049 raft_consensus.cc:1081] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Signalling peer f82778701b464892aab92a752ed7ffdc to start an election
I20260709 12:23:26.571141 25833 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:44218
I20260709 12:23:26.571664 25833 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:26.572041 25833 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:26.573417 25680 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
 from {username='slave'} at 127.0.0.1:40220
I20260709 12:23:26.573949 25680 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:26.574249 25680 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:26.564568 25583 catalog_manager.cc:5697] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New cstate: current_term: 1 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:26.601707 25680 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:26.604265 25680 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:26.605793 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:26.606398 25828 raft_consensus.cc:3055] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:26.606678 25828 raft_consensus.cc:740] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:26.607467 25828 consensus_queue.cc:260] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:26.608528 25828 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:26.608220 25833 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:26.610162 25833 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:26.611546 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:26.612109 25759 raft_consensus.cc:3055] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:26.612406 25759 raft_consensus.cc:740] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:26.613062 25759 consensus_queue.cc:260] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:26.613363 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:26.613907 25677 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:26.614135 25759 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:26.616920 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:26.617434 26436 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:26.623903 25677 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 3.
I20260709 12:23:26.624094 25759 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 3.
I20260709 12:23:26.625211 25801 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:26.626046 27172 raft_consensus.cc:2804] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:26.626508 27172 raft_consensus.cc:697] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 3 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:26.627307 27172 consensus_queue.cc:237] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:26.628929 25828 raft_consensus.cc:2468] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 2.
I20260709 12:23:26.629550 26436 raft_consensus.cc:2468] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 2.
I20260709 12:23:26.630175 25650 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:26.631430 27216 raft_consensus.cc:2804] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:26.631897 27216 raft_consensus.cc:697] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 2 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:26.632767 27216 consensus_queue.cc:237] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:26.654932 25581 catalog_manager.cc:5697] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 2 to 3, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 3 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:26.687521 25581 catalog_manager.cc:5697] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 1 to 2, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 2 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:26.724946 27172 raft_consensus.cc:993] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a: : Instructing follower a866ff967d964388a6f0dff7fd43df89 to start an election
I20260709 12:23:26.725455 27049 raft_consensus.cc:1081] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Signalling peer a866ff967d964388a6f0dff7fd43df89 to start an election
I20260709 12:23:26.726943 26436 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820"
dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
 from {username='slave'} at 127.0.0.1:36508
I20260709 12:23:26.727411 26436 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:26.727684 26436 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:26.731899 26436 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:26.733734 26436 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:26.734763 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:26.734817 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:26.735419 25759 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:26.735514 25828 raft_consensus.cc:3055] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:26.735903 25828 raft_consensus.cc:740] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:26.736696 25828 consensus_queue.cc:260] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:26.740793 25828 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:26.741974 25759 raft_consensus.cc:2468] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 5.
I20260709 12:23:26.743405 26401 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:26.744135 27193 raft_consensus.cc:2804] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:26.744650 27193 raft_consensus.cc:697] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 5 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:23:26.745527 27193 consensus_queue.cc:237] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:26.750625 25828 raft_consensus.cc:2468] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 5.
I20260709 12:23:26.755227 25581 catalog_manager.cc:5697] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 4 to 5, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 5 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:26.791566 27225 ts_tablet_manager.cc:933] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89: Initiating tablet copy from peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:26.793483 27225 tablet_copy_client.cc:323] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Beginning tablet copy session from remote peer at address 127.23.245.130:37267
I20260709 12:23:26.795439 25773 tablet_copy_service.cc:140] P 6e673265293d4e9a937dc45150aeb1b8: Received BeginTabletCopySession request for tablet 870002623db3456699b2b970d066f356 from peer a866ff967d964388a6f0dff7fd43df89 ({username='slave'} at 127.0.0.1:48606)
I20260709 12:23:26.795991 25773 tablet_copy_service.cc:161] P 6e673265293d4e9a937dc45150aeb1b8: Beginning new tablet copy session on tablet 870002623db3456699b2b970d066f356 from peer a866ff967d964388a6f0dff7fd43df89 at {username='slave'} at 127.0.0.1:48606: session id = a866ff967d964388a6f0dff7fd43df89-870002623db3456699b2b970d066f356
I20260709 12:23:26.803258 25773 tablet_copy_source_session.cc:215] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:26.806507 27225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 870002623db3456699b2b970d066f356. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:26.820724 27227 ts_tablet_manager.cc:933] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89: Initiating tablet copy from peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:26.824361 27225 tablet_copy_client.cc:806] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:26.825359 27225 tablet_copy_client.cc:670] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:26.826792 27227 tablet_copy_client.cc:323] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Beginning tablet copy session from remote peer at address 127.23.245.130:37267
I20260709 12:23:26.828555 25773 tablet_copy_service.cc:140] P 6e673265293d4e9a937dc45150aeb1b8: Received BeginTabletCopySession request for tablet b12e2b074f1b4518bcfc6728abeca136 from peer a866ff967d964388a6f0dff7fd43df89 ({username='slave'} at 127.0.0.1:48606)
I20260709 12:23:26.829046 25773 tablet_copy_service.cc:161] P 6e673265293d4e9a937dc45150aeb1b8: Beginning new tablet copy session on tablet b12e2b074f1b4518bcfc6728abeca136 from peer a866ff967d964388a6f0dff7fd43df89 at {username='slave'} at 127.0.0.1:48606: session id = a866ff967d964388a6f0dff7fd43df89-b12e2b074f1b4518bcfc6728abeca136
I20260709 12:23:26.829424 27088 raft_consensus.cc:993] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc: : Instructing follower 6e673265293d4e9a937dc45150aeb1b8 to start an election
I20260709 12:23:26.829901 27216 raft_consensus.cc:1081] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Signalling peer 6e673265293d4e9a937dc45150aeb1b8 to start an election
I20260709 12:23:26.833582 25759 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:53474
I20260709 12:23:26.834121 25759 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:26.834455 25759 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:26.835163 27225 tablet_copy_client.cc:538] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:26.836462 25773 tablet_copy_source_session.cc:215] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:26.845113 27225 tablet_bootstrap.cc:492] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89: Bootstrap starting.
I20260709 12:23:26.848541 25759 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:26.852056 25759 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:26.852187 25677 raft_consensus.cc:1275] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:26.850518 27227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b12e2b074f1b4518bcfc6728abeca136. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:26.855788 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:26.857892 25680 raft_consensus.cc:3055] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:26.858187 25680 raft_consensus.cc:740] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:26.858853 25680 consensus_queue.cc:260] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:26.860061 25680 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:26.862316 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:26.862854 25828 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:26.871426 27172 consensus_queue.cc:1048] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:26.891372 25680 raft_consensus.cc:2468] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 2.
I20260709 12:23:26.894381 25828 raft_consensus.cc:2468] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 2.
I20260709 12:23:26.895291 25726 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:26.895864 25759 raft_consensus.cc:1275] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:26.896653 27146 raft_consensus.cc:2804] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:26.897177 27146 raft_consensus.cc:697] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:26.898036 27049 consensus_queue.cc:1048] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:26.898053 27146 consensus_queue.cc:237] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:26.982091 25582 catalog_manager.cc:5697] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 1 to 2, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 2 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:27.000404 27236 ts_tablet_manager.cc:933] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89: Initiating tablet copy from peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349)
I20260709 12:23:27.008019 27236 tablet_copy_client.cc:323] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Beginning tablet copy session from remote peer at address 127.23.245.129:37349
I20260709 12:23:27.011586 25696 tablet_copy_service.cc:140] P f82778701b464892aab92a752ed7ffdc: Received BeginTabletCopySession request for tablet 5204a6a2db104ffa90f8679086d4e6f8 from peer a866ff967d964388a6f0dff7fd43df89 ({username='slave'} at 127.0.0.1:51578)
I20260709 12:23:27.012192 25696 tablet_copy_service.cc:161] P f82778701b464892aab92a752ed7ffdc: Beginning new tablet copy session on tablet 5204a6a2db104ffa90f8679086d4e6f8 from peer a866ff967d964388a6f0dff7fd43df89 at {username='slave'} at 127.0.0.1:51578: session id = a866ff967d964388a6f0dff7fd43df89-5204a6a2db104ffa90f8679086d4e6f8
I20260709 12:23:27.022459 25696 tablet_copy_source_session.cc:215] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:27.028748 27236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5204a6a2db104ffa90f8679086d4e6f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.035950 27225 tablet_bootstrap.cc:492] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:27.036931 27225 tablet_bootstrap.cc:492] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89: Bootstrap complete.
I20260709 12:23:27.037601 27225 ts_tablet_manager.cc:1403] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89: Time spent bootstrapping tablet: real 0.193s	user 0.052s	sys 0.058s
I20260709 12:23:27.038146 27227 tablet_copy_client.cc:806] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:27.039430 27227 tablet_copy_client.cc:670] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:27.046039 27227 tablet_copy_client.cc:538] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:27.046736 27225 raft_consensus.cc:359] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:27.047701 27225 raft_consensus.cc:740] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Initialized, Role: LEARNER
I20260709 12:23:27.048393 27225 consensus_queue.cc:260] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:27.051290 27225 ts_tablet_manager.cc:1434] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:23:27.056427 25773 tablet_copy_service.cc:342] P 6e673265293d4e9a937dc45150aeb1b8: Request end of tablet copy session a866ff967d964388a6f0dff7fd43df89-870002623db3456699b2b970d066f356 received from {username='slave'} at 127.0.0.1:48606
I20260709 12:23:27.056890 25773 tablet_copy_service.cc:434] P 6e673265293d4e9a937dc45150aeb1b8: ending tablet copy session a866ff967d964388a6f0dff7fd43df89-870002623db3456699b2b970d066f356 on tablet 870002623db3456699b2b970d066f356 with peer a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:27.070920 27236 tablet_copy_client.cc:806] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:27.071708 27236 tablet_copy_client.cc:670] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:27.073027 27227 tablet_bootstrap.cc:492] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89: Bootstrap starting.
I20260709 12:23:27.076242 27236 tablet_copy_client.cc:538] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:27.083824 27236 tablet_bootstrap.cc:492] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89: Bootstrap starting.
I20260709 12:23:27.100356 27225 ts_tablet_manager.cc:933] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89: Initiating tablet copy from peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349)
I20260709 12:23:27.110297 27227 tablet_bootstrap.cc:492] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:27.111250 27227 tablet_bootstrap.cc:492] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89: Bootstrap complete.
I20260709 12:23:27.111907 27227 ts_tablet_manager.cc:1403] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.017s
I20260709 12:23:27.116086 25757 raft_consensus.cc:1275] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:27.116739 27227 raft_consensus.cc:359] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:27.117551 27227 raft_consensus.cc:740] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Initialized, Role: LEARNER
I20260709 12:23:27.118172 27227 consensus_queue.cc:260] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:27.119479 27049 consensus_queue.cc:1048] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:27.126762 27227 ts_tablet_manager.cc:1434] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.004s
I20260709 12:23:27.128367 25773 tablet_copy_service.cc:342] P 6e673265293d4e9a937dc45150aeb1b8: Request end of tablet copy session a866ff967d964388a6f0dff7fd43df89-b12e2b074f1b4518bcfc6728abeca136 received from {username='slave'} at 127.0.0.1:48606
I20260709 12:23:27.128786 25773 tablet_copy_service.cc:434] P 6e673265293d4e9a937dc45150aeb1b8: ending tablet copy session a866ff967d964388a6f0dff7fd43df89-b12e2b074f1b4518bcfc6728abeca136 on tablet b12e2b074f1b4518bcfc6728abeca136 with peer a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:27.131693 27236 tablet_bootstrap.cc:492] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:27.133047 27236 tablet_bootstrap.cc:492] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89: Bootstrap complete.
I20260709 12:23:27.133698 27236 ts_tablet_manager.cc:1403] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89: Time spent bootstrapping tablet: real 0.050s	user 0.019s	sys 0.008s
I20260709 12:23:27.136674 27236 raft_consensus.cc:359] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:27.137450 27236 raft_consensus.cc:740] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Initialized, Role: LEARNER
I20260709 12:23:27.138062 27236 consensus_queue.cc:260] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:27.140601 27236 ts_tablet_manager.cc:1434] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.005s
I20260709 12:23:27.142207 25696 tablet_copy_service.cc:342] P f82778701b464892aab92a752ed7ffdc: Request end of tablet copy session a866ff967d964388a6f0dff7fd43df89-5204a6a2db104ffa90f8679086d4e6f8 received from {username='slave'} at 127.0.0.1:51578
I20260709 12:23:27.142619 25696 tablet_copy_service.cc:434] P f82778701b464892aab92a752ed7ffdc: ending tablet copy session a866ff967d964388a6f0dff7fd43df89-5204a6a2db104ffa90f8679086d4e6f8 on tablet 5204a6a2db104ffa90f8679086d4e6f8 with peer a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:27.151695 27225 tablet_copy_client.cc:323] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Beginning tablet copy session from remote peer at address 127.23.245.129:37349
I20260709 12:23:27.153342 25696 tablet_copy_service.cc:140] P f82778701b464892aab92a752ed7ffdc: Received BeginTabletCopySession request for tablet 05232536e53b419682a5f24515843652 from peer a866ff967d964388a6f0dff7fd43df89 ({username='slave'} at 127.0.0.1:51578)
I20260709 12:23:27.153887 25696 tablet_copy_service.cc:161] P f82778701b464892aab92a752ed7ffdc: Beginning new tablet copy session on tablet 05232536e53b419682a5f24515843652 from peer a866ff967d964388a6f0dff7fd43df89 at {username='slave'} at 127.0.0.1:51578: session id = a866ff967d964388a6f0dff7fd43df89-05232536e53b419682a5f24515843652
I20260709 12:23:27.181344 25677 raft_consensus.cc:1275] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:27.187937 25696 tablet_copy_source_session.cc:215] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:27.190169 26439 raft_consensus.cc:1275] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:27.194903 27172 consensus_queue.cc:1048] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:27.205549 27218 consensus_queue.cc:1048] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:27.208212 25833 raft_consensus.cc:1275] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:23:27.216946 27225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05232536e53b419682a5f24515843652. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.221436 27193 consensus_queue.cc:1048] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:27.231942 25833 raft_consensus.cc:1275] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:27.236450 27216 consensus_queue.cc:1048] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:27.239637 25757 raft_consensus.cc:1275] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:23:27.241371 27193 consensus_queue.cc:1048] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:27.331290 27225 tablet_copy_client.cc:806] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:27.331883 27225 tablet_copy_client.cc:670] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:27.355825 26436 raft_consensus.cc:1217] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 12:23:27.369341 27225 tablet_copy_client.cc:538] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:27.372061 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:27.380265 27225 tablet_bootstrap.cc:492] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89: Bootstrap starting.
I20260709 12:23:27.405313 27225 tablet_bootstrap.cc:492] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:27.406934 27225 tablet_bootstrap.cc:492] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89: Bootstrap complete.
I20260709 12:23:27.407560 27225 ts_tablet_manager.cc:1403] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89: Time spent bootstrapping tablet: real 0.028s	user 0.020s	sys 0.000s
I20260709 12:23:27.410327 27225 raft_consensus.cc:359] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:27.411121 27225 raft_consensus.cc:740] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Initialized, Role: LEARNER
I20260709 12:23:27.411739 27225 consensus_queue.cc:260] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:27.418849 27225 ts_tablet_manager.cc:1434] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:23:27.429085 25696 tablet_copy_service.cc:342] P f82778701b464892aab92a752ed7ffdc: Request end of tablet copy session a866ff967d964388a6f0dff7fd43df89-05232536e53b419682a5f24515843652 received from {username='slave'} at 127.0.0.1:51578
I20260709 12:23:27.429510 25696 tablet_copy_service.cc:434] P f82778701b464892aab92a752ed7ffdc: ending tablet copy session a866ff967d964388a6f0dff7fd43df89-05232536e53b419682a5f24515843652 on tablet 05232536e53b419682a5f24515843652 with peer a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:27.436982 26436 raft_consensus.cc:1217] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:23:27.471493 25837 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:23:27.472009 25837 raft_consensus.cc:606] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 2 LEADER]: Received request to transfer leadership to TS 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:27.474222 25677 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3767151a5d4345659810a40ea7f44873"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
mode: GRACEFUL
new_leader_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:49108
I20260709 12:23:27.474722 25677 raft_consensus.cc:606] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Received request to transfer leadership to TS 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:23:27.477401 25837 raft_consensus.cc:1275] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:27.477430 25828 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "f82778701b464892aab92a752ed7ffdc"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:23:27.478029 25828 raft_consensus.cc:606] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Received request to transfer leadership to TS f82778701b464892aab92a752ed7ffdc
I20260709 12:23:27.479761 27160 consensus_queue.cc:1048] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:27.480417 25757 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
mode: GRACEFUL
new_leader_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:48134
I20260709 12:23:27.480950 25757 raft_consensus.cc:606] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Received request to transfer leadership to TS 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:23:27.482040 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:23:27.483140 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:27.483732 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:27.494220 26436 raft_consensus.cc:1217] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:23:27.506846 25677 raft_consensus.cc:1275] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:27.522440 27146 consensus_queue.cc:1048] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:27.526857 27160 raft_consensus.cc:993] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8: : Instructing follower 5cccf20a8bff46dba6601f241d172b8a to start an election
I20260709 12:23:27.527333 27160 raft_consensus.cc:1081] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Signalling peer 5cccf20a8bff46dba6601f241d172b8a to start an election
I20260709 12:23:27.530594 25837 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:44218
I20260709 12:23:27.531100 25837 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:27.531414 25837 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:27.568001 25837 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:27.568996 25828 raft_consensus.cc:1240] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:27.572460 27160 consensus_queue.cc:1059] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:27.573194 27141 raft_consensus.cc:3055] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:27.573565 27141 raft_consensus.cc:740] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:27.574345 27141 consensus_queue.cc:260] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:27.575416 27141 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:27.577517 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:27.578085 25677 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:27.584980 25677 raft_consensus.cc:2468] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 3.
I20260709 12:23:27.586156 25801 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:27.588222 27172 raft_consensus.cc:2804] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:27.589463 27172 raft_consensus.cc:697] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 3 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:27.590337 27172 consensus_queue.cc:237] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:27.591595 25837 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:27.592767 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:27.611475 25757 raft_consensus.cc:2468] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 3.
I20260709 12:23:27.620800 25582 catalog_manager.cc:5697] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 2 to 3, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 3 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:27.632972 27172 raft_consensus.cc:993] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a: : Instructing follower f82778701b464892aab92a752ed7ffdc to start an election
I20260709 12:23:27.633625 27126 raft_consensus.cc:1081] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Signalling peer f82778701b464892aab92a752ed7ffdc to start an election
I20260709 12:23:27.635231 25677 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
 from {username='slave'} at 127.0.0.1:40220
I20260709 12:23:27.635749 25677 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:27.636021 27247 raft_consensus.cc:993] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc: : Instructing follower 5cccf20a8bff46dba6601f241d172b8a to start an election
I20260709 12:23:27.636096 25677 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:27.636637 27088 raft_consensus.cc:1081] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Signalling peer 5cccf20a8bff46dba6601f241d172b8a to start an election
I20260709 12:23:27.638159 25828 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3767151a5d4345659810a40ea7f44873"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:44202
I20260709 12:23:27.638644 25828 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:27.638991 25828 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:27.645638 25828 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:27.646546 26436 raft_consensus.cc:1217] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:27.649690 25828 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:27.650571 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:27.651134 25680 raft_consensus.cc:3055] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:27.651396 25680 raft_consensus.cc:740] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:27.646890 25677 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:27.654474 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:27.655028 25762 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:27.654949 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:27.655844 25677 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:27.655853 25757 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:27.659550 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:27.659410 25680 consensus_queue.cc:260] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:27.660065 25828 raft_consensus.cc:3055] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:27.660353 25828 raft_consensus.cc:740] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:27.660713 25680 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:27.661062 25828 consensus_queue.cc:260] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:27.662214 25828 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:27.669901 25828 raft_consensus.cc:2468] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 2.
I20260709 12:23:27.670957 25650 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:27.671792 27088 raft_consensus.cc:2804] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:27.672240 27088 raft_consensus.cc:697] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 2 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:27.672981 27088 consensus_queue.cc:237] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:27.677420 25762 raft_consensus.cc:2468] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 2.
I20260709 12:23:27.678244 25757 raft_consensus.cc:2468] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 4.
I20260709 12:23:27.679320 25680 raft_consensus.cc:2468] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 4.
I20260709 12:23:27.681648 25801 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:27.682408 27172 raft_consensus.cc:2804] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:27.682863 27172 raft_consensus.cc:697] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:27.683691 27172 consensus_queue.cc:237] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:27.700312 25582 catalog_manager.cc:5697] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 3 to 4, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 4 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:27.700870 25581 catalog_manager.cc:5697] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 1 to 2, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 2 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:27.861869 27141 raft_consensus.cc:1064] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8: attempting to promote NON_VOTER a866ff967d964388a6f0dff7fd43df89 to VOTER
I20260709 12:23:27.864004 27141 consensus_queue.cc:237] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:27.884159 27247 raft_consensus.cc:1064] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc: attempting to promote NON_VOTER a866ff967d964388a6f0dff7fd43df89 to VOTER
I20260709 12:23:27.886854 27247 consensus_queue.cc:237] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:27.904274 26436 raft_consensus.cc:1275] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 3 LEARNER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:23:27.904589 26439 raft_consensus.cc:1275] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEARNER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:23:27.906492 25828 raft_consensus.cc:1275] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:23:27.906445 27088 consensus_queue.cc:1048] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:27.906615 25757 raft_consensus.cc:1275] T 5204a6a2db104ffa90f8679086d4e6f8 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:23:27.910854 25677 raft_consensus.cc:1275] T 870002623db3456699b2b970d066f356 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:23:27.912739 25828 raft_consensus.cc:1275] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:23:27.913574 27146 consensus_queue.cc:1048] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:27.913712 27216 consensus_queue.cc:1048] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:27.916175 27216 consensus_queue.cc:1048] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:27.918987 27252 consensus_queue.cc:1048] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:27.922535 27146 consensus_queue.cc:1048] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:27.926980 27146 raft_consensus.cc:1064] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8: attempting to promote NON_VOTER a866ff967d964388a6f0dff7fd43df89 to VOTER
I20260709 12:23:27.946162 27146 consensus_queue.cc:237] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:27.967298 27172 raft_consensus.cc:993] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a: : Instructing follower 6e673265293d4e9a937dc45150aeb1b8 to start an election
I20260709 12:23:27.967787 27172 raft_consensus.cc:1081] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 2 LEADER]: Signalling peer 6e673265293d4e9a937dc45150aeb1b8 to start an election
I20260709 12:23:27.969571 25762 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:53460
I20260709 12:23:27.970111 25762 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:27.970439 25762 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:27.975100 27141 raft_consensus.cc:2955] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:27.981344 25828 raft_consensus.cc:2955] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:28.006657 25677 raft_consensus.cc:2955] T 870002623db3456699b2b970d066f356 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:28.012271 27088 raft_consensus.cc:2955] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:28.003343 25762 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:28.015580 25581 catalog_manager.cc:5697] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: config changed from index 4 to 5, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:28.017922 25762 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:28.017746 26437 raft_consensus.cc:2955] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:28.024978 25762 raft_consensus.cc:2955] T 5204a6a2db104ffa90f8679086d4e6f8 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:28.038151 25828 raft_consensus.cc:2955] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:28.052170 25583 catalog_manager.cc:5697] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc reported cstate change: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:28.058470 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:28.059130 25828 raft_consensus.cc:3055] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:28.059504 25828 raft_consensus.cc:740] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:28.060341 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:28.060300 25828 consensus_queue.cc:260] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:28.060971 25680 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:28.062017 25828 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:28.067442 25680 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 3.
I20260709 12:23:28.069855 26439 raft_consensus.cc:1275] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEARNER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:23:28.073333 25837 raft_consensus.cc:1275] T b12e2b074f1b4518bcfc6728abeca136 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:23:28.074070 25678 raft_consensus.cc:1275] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:23:28.075814 27160 consensus_queue.cc:1048] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:28.079089 27146 consensus_queue.cc:1048] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:28.080615 25726 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:28.081442 27160 raft_consensus.cc:2804] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:28.081929 27160 raft_consensus.cc:697] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:28.082791 27160 consensus_queue.cc:237] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:28.086740 27146 consensus_queue.cc:1048] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:28.088320 25762 raft_consensus.cc:1275] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:28.071256 25757 consensus_queue.cc:237] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:28.091292 27216 consensus_queue.cc:1048] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:28.091560 26437 raft_consensus.cc:2955] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:28.093659 25828 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 3.
I20260709 12:23:28.107517 25759 raft_consensus.cc:1275] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:28.109879 27049 consensus_queue.cc:1048] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:28.130971 25828 raft_consensus.cc:1275] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:28.135244 27088 consensus_queue.cc:1048] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:28.146360 26439 raft_consensus.cc:1275] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:28.159175 25678 raft_consensus.cc:1275] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:23:28.161051 27160 consensus_queue.cc:1048] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:28.161703 27049 consensus_queue.cc:1048] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:28.164968 25677 raft_consensus.cc:1275] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:28.169919 25828 raft_consensus.cc:1275] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:28.171582 27049 consensus_queue.cc:1048] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:28.173970 27160 consensus_queue.cc:1048] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:28.180336 25757 raft_consensus.cc:1275] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:23:28.182391 27172 consensus_queue.cc:1048] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:28.181973 25582 catalog_manager.cc:5697] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 2 to 3, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 3 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:28.187433 27247 raft_consensus.cc:1064] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc: attempting to promote NON_VOTER a866ff967d964388a6f0dff7fd43df89 to VOTER
I20260709 12:23:28.189968 27247 consensus_queue.cc:237] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:28.190560 25837 raft_consensus.cc:2955] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:28.187425 27160 raft_consensus.cc:2955] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:28.189736 26437 raft_consensus.cc:2955] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:28.222291 25682 consensus_queue.cc:237] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:28.229065 25828 raft_consensus.cc:1275] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:28.235204 26437 raft_consensus.cc:1275] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:28.236290 27218 consensus_queue.cc:1048] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:28.239872 25584 catalog_manager.cc:5697] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: config changed from index 5 to 6, VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129) evicted. New cstate: current_term: 3 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:28.253598 27218 consensus_queue.cc:1048] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:28.258383 27141 raft_consensus.cc:2955] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:28.262516 25568 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 870002623db3456699b2b970d066f356 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:28.265646 27216 raft_consensus.cc:2955] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:28.266330 25833 raft_consensus.cc:2955] T b12e2b074f1b4518bcfc6728abeca136 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:28.275329 26437 raft_consensus.cc:2955] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:28.280014 25676 tablet_service.cc:1558] Processing DeleteTablet for tablet 870002623db3456699b2b970d066f356 with delete_type TABLET_DATA_TOMBSTONED (TS f82778701b464892aab92a752ed7ffdc not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:40214
I20260709 12:23:28.284440 25762 raft_consensus.cc:1275] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:28.299401 27247 consensus_queue.cc:1048] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:23:28.306237 27283 tablet_replica.cc:333] T 870002623db3456699b2b970d066f356 P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
I20260709 12:23:28.308284 27283 raft_consensus.cc:2243] T 870002623db3456699b2b970d066f356 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:28.309022 27283 raft_consensus.cc:2272] T 870002623db3456699b2b970d066f356 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:28.322314 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 67480.2us
I20260709 12:23:28.323894 25582 catalog_manager.cc:5697] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:28.332697 25678 raft_consensus.cc:2955] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:28.349089 26437 raft_consensus.cc:1275] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:28.359467 25833 raft_consensus.cc:2955] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:28.362133 25569 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5204a6a2db104ffa90f8679086d4e6f8 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:28.362350 25837 raft_consensus.cc:1275] T 05232536e53b419682a5f24515843652 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:28.374884 27283 ts_tablet_manager.cc:1916] T 870002623db3456699b2b970d066f356 P f82778701b464892aab92a752ed7ffdc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:28.384512 27216 consensus_queue.cc:1048] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:28.388347 27247 consensus_queue.cc:1048] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:28.397359 27283 ts_tablet_manager.cc:1929] T 870002623db3456699b2b970d066f356 P f82778701b464892aab92a752ed7ffdc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 12:23:28.397976 27283 log.cc:1199] T 870002623db3456699b2b970d066f356 P f82778701b464892aab92a752ed7ffdc: Deleting WAL directory at /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-0-root/wals/870002623db3456699b2b970d066f356
I20260709 12:23:28.398190 25762 consensus_queue.cc:237] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:28.401623 25569 catalog_manager.cc:5028] TS f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): tablet 870002623db3456699b2b970d066f356 (table test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]) successfully deleted
I20260709 12:23:28.411226 25678 raft_consensus.cc:1275] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:28.420204 26436 raft_consensus.cc:2955] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:28.422003 25584 catalog_manager.cc:5697] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc reported cstate change: config changed from index 4 to 5, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New cstate: current_term: 2 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:28.434906 27141 consensus_queue.cc:1048] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:28.437084 25753 tablet_service.cc:1558] Processing DeleteTablet for tablet 5204a6a2db104ffa90f8679086d4e6f8 with delete_type TABLET_DATA_TOMBSTONED (TS 6e673265293d4e9a937dc45150aeb1b8 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:53452
I20260709 12:23:28.456350 27289 tablet_replica.cc:333] T 5204a6a2db104ffa90f8679086d4e6f8 P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
I20260709 12:23:28.457558 27289 raft_consensus.cc:2243] T 5204a6a2db104ffa90f8679086d4e6f8 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:28.458417 27289 raft_consensus.cc:2272] T 5204a6a2db104ffa90f8679086d4e6f8 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:28.449141 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 78052.9us
I20260709 12:23:28.462983 27141 raft_consensus.cc:2955] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:28.463201 27218 raft_consensus.cc:2955] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:28.465293 25677 raft_consensus.cc:2955] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:28.470383 26437 raft_consensus.cc:1275] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:28.471634 27289 ts_tablet_manager.cc:1916] T 5204a6a2db104ffa90f8679086d4e6f8 P 6e673265293d4e9a937dc45150aeb1b8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:28.472862 27160 consensus_queue.cc:1048] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:28.477614 25568 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b12e2b074f1b4518bcfc6728abeca136 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:28.497586 25581 catalog_manager.cc:5697] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc reported cstate change: config changed from index 4 to 5, VOTER 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) evicted. New cstate: current_term: 2 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:28.497921 26436 raft_consensus.cc:2955] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:28.490753 25828 raft_consensus.cc:2955] T 05232536e53b419682a5f24515843652 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:28.499531 26437 raft_consensus.cc:2955] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:28.509862 25824 tablet_service.cc:1558] Processing DeleteTablet for tablet b12e2b074f1b4518bcfc6728abeca136 with delete_type TABLET_DATA_TOMBSTONED (TS 5cccf20a8bff46dba6601f241d172b8a not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:44194
I20260709 12:23:28.518782 25762 raft_consensus.cc:2955] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:28.534945 27290 tablet_replica.cc:333] T b12e2b074f1b4518bcfc6728abeca136 P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
I20260709 12:23:28.536643 27290 raft_consensus.cc:2243] T b12e2b074f1b4518bcfc6728abeca136 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:28.537407 27290 raft_consensus.cc:2272] T b12e2b074f1b4518bcfc6728abeca136 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:28.538427 25582 catalog_manager.cc:5697] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:28.546816 27289 ts_tablet_manager.cc:1929] T 5204a6a2db104ffa90f8679086d4e6f8 P 6e673265293d4e9a937dc45150aeb1b8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:23:28.547367 27289 log.cc:1199] T 5204a6a2db104ffa90f8679086d4e6f8 P 6e673265293d4e9a937dc45150aeb1b8: Deleting WAL directory at /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-1-root/wals/5204a6a2db104ffa90f8679086d4e6f8
I20260709 12:23:28.549167 25568 catalog_manager.cc:5028] TS 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): tablet 5204a6a2db104ffa90f8679086d4e6f8 (table test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]) successfully deleted
I20260709 12:23:28.554494 25677 consensus_queue.cc:237] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:28.557121 27290 ts_tablet_manager.cc:1916] T b12e2b074f1b4518bcfc6728abeca136 P 5cccf20a8bff46dba6601f241d172b8a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:28.560132 26436 raft_consensus.cc:1275] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:28.562049 27218 consensus_queue.cc:1048] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:28.565609 25762 raft_consensus.cc:1275] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:28.573609 27290 ts_tablet_manager.cc:1929] T b12e2b074f1b4518bcfc6728abeca136 P 5cccf20a8bff46dba6601f241d172b8a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:23:28.573839 27280 consensus_queue.cc:1048] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:28.574190 27290 log.cc:1199] T b12e2b074f1b4518bcfc6728abeca136 P 5cccf20a8bff46dba6601f241d172b8a: Deleting WAL directory at /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-2-root/wals/b12e2b074f1b4518bcfc6728abeca136
I20260709 12:23:28.576032 25569 catalog_manager.cc:5028] TS 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): tablet b12e2b074f1b4518bcfc6728abeca136 (table test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]) successfully deleted
I20260709 12:23:28.577356 27247 raft_consensus.cc:2955] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:28.580261 25828 raft_consensus.cc:1275] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:28.583104 27252 consensus_queue.cc:1048] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:28.577422 26436 raft_consensus.cc:2955] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:28.578732 25762 raft_consensus.cc:2955] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:28.602641 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:28.610754 25677 raft_consensus.cc:1275] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:28.612389 27141 consensus_queue.cc:1048] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:28.635656 25582 catalog_manager.cc:5697] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: config changed from index 3 to 4, VOTER 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) evicted. New cstate: current_term: 1 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:28.652289 25569 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 05232536e53b419682a5f24515843652 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:28.657990 25824 tablet_service.cc:1558] Processing DeleteTablet for tablet 05232536e53b419682a5f24515843652 with delete_type TABLET_DATA_TOMBSTONED (TS 5cccf20a8bff46dba6601f241d172b8a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:44194
I20260709 12:23:28.658938 27290 tablet_replica.cc:333] T 05232536e53b419682a5f24515843652 P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
I20260709 12:23:28.659940 27290 raft_consensus.cc:2243] T 05232536e53b419682a5f24515843652 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:28.660578 27290 raft_consensus.cc:2272] T 05232536e53b419682a5f24515843652 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:28.664242 27290 ts_tablet_manager.cc:1916] T 05232536e53b419682a5f24515843652 P 5cccf20a8bff46dba6601f241d172b8a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:28.682613 25828 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:23:28.683192 25828 raft_consensus.cc:606] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 3 LEADER]: Received request to transfer leadership to TS 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:28.686663 25759 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
mode: GRACEFUL
new_leader_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:48134
I20260709 12:23:28.687196 25759 raft_consensus.cc:606] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 LEADER]: Received request to transfer leadership to TS 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:23:28.692155 25682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
mode: GRACEFUL
new_leader_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:49108
I20260709 12:23:28.692669 25682 raft_consensus.cc:606] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Received request to transfer leadership to TS 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:23:28.695329 25828 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "a866ff967d964388a6f0dff7fd43df89"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:23:28.695776 25828 raft_consensus.cc:606] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Received request to transfer leadership to TS a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:28.696899 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:23:28.698617 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:28.699331 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:28.699873 27290 ts_tablet_manager.cc:1929] T 05232536e53b419682a5f24515843652 P 5cccf20a8bff46dba6601f241d172b8a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:28.700323 27290 log.cc:1199] T 05232536e53b419682a5f24515843652 P 5cccf20a8bff46dba6601f241d172b8a: Deleting WAL directory at /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-2-root/wals/05232536e53b419682a5f24515843652
I20260709 12:23:28.701680 25569 catalog_manager.cc:5028] TS 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): tablet 05232536e53b419682a5f24515843652 (table test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]) successfully deleted
I20260709 12:23:28.792981 27172 raft_consensus.cc:993] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a: : Instructing follower a866ff967d964388a6f0dff7fd43df89 to start an election
I20260709 12:23:28.793484 27293 raft_consensus.cc:1081] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Signalling peer a866ff967d964388a6f0dff7fd43df89 to start an election
I20260709 12:23:28.795063 26436 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2"
dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
 from {username='slave'} at 127.0.0.1:36508
I20260709 12:23:28.795573 26436 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:28.795892 26436 raft_consensus.cc:3060] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:28.799811 27280 raft_consensus.cc:993] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc: : Instructing follower 5cccf20a8bff46dba6601f241d172b8a to start an election
I20260709 12:23:28.800319 27247 raft_consensus.cc:1081] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Signalling peer 5cccf20a8bff46dba6601f241d172b8a to start an election
I20260709 12:23:28.801779 25828 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:44202
I20260709 12:23:28.802194 25828 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:28.802003 26436 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:28.802511 25828 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:28.803817 26436 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:28.804325 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:28.804736 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:28.804893 25677 raft_consensus.cc:3060] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:28.805240 25837 raft_consensus.cc:3055] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:28.805518 25837 raft_consensus.cc:740] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:28.806143 25837 consensus_queue.cc:260] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:28.807111 25837 raft_consensus.cc:3060] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:28.809412 25828 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:28.813026 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:28.813104 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:28.813647 25678 raft_consensus.cc:3055] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:28.813962 25678 raft_consensus.cc:740] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:28.813661 25837 raft_consensus.cc:2468] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 2.
I20260709 12:23:28.814697 25678 consensus_queue.cc:260] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:28.815721 25678 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:28.816290 26436 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:28.816733 26402 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:28.817539 27249 raft_consensus.cc:2804] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:28.817986 27249 raft_consensus.cc:697] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:23:28.819677 27249 consensus_queue.cc:237] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:28.821411 25828 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:28.812569 25677 raft_consensus.cc:2468] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 2.
I20260709 12:23:28.826323 26436 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 4.
I20260709 12:23:28.827739 25678 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 4.
I20260709 12:23:28.830389 25801 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:28.832154 27293 raft_consensus.cc:2804] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:28.832623 27293 raft_consensus.cc:697] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:28.833420 27293 consensus_queue.cc:237] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:28.837097 25582 catalog_manager.cc:5697] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 1 to 2, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 2 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:28.845642 25584 catalog_manager.cc:5697] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 3 to 4, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 4 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:28.978732 27284 raft_consensus.cc:993] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8: : Instructing follower 5cccf20a8bff46dba6601f241d172b8a to start an election
I20260709 12:23:28.979249 27160 raft_consensus.cc:1081] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 LEADER]: Signalling peer 5cccf20a8bff46dba6601f241d172b8a to start an election
I20260709 12:23:28.980630 25837 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:44218
I20260709 12:23:28.981071 25837 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:28.981312 25837 raft_consensus.cc:3060] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:28.986989 25837 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:28.988837 25837 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:28.989702 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:28.990269 25762 raft_consensus.cc:3055] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:28.990564 25762 raft_consensus.cc:740] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:28.990561 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:28.991225 26436 raft_consensus.cc:3060] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:28.991518 25762 consensus_queue.cc:260] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:28.992692 25762 raft_consensus.cc:3060] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:28.997546 26436 raft_consensus.cc:2468] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 2.
I20260709 12:23:28.998718 25801 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:28.999460 27172 raft_consensus.cc:2804] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:28.999884 27172 raft_consensus.cc:697] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 2 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:29.000224 25762 raft_consensus.cc:2468] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 2.
I20260709 12:23:29.000627 27172 consensus_queue.cc:237] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:29.010135 25584 catalog_manager.cc:5697] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 1 to 2, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 2 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:29.090934 27293 raft_consensus.cc:993] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a: : Instructing follower 6e673265293d4e9a937dc45150aeb1b8 to start an election
I20260709 12:23:29.091442 27172 raft_consensus.cc:1081] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 3 LEADER]: Signalling peer 6e673265293d4e9a937dc45150aeb1b8 to start an election
I20260709 12:23:29.092783 25762 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:53460
I20260709 12:23:29.093240 25762 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:29.093564 25762 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:29.098448 25762 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:29.099852 25762 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:29.100502 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:29.100831 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:29.101099 25682 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:29.101434 25837 raft_consensus.cc:3055] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:29.101745 25837 raft_consensus.cc:740] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:29.102433 25837 consensus_queue.cc:260] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:29.103323 25837 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:29.106182 25682 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 4.
I20260709 12:23:29.107188 25726 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:29.107681 25837 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 4.
I20260709 12:23:29.107966 27160 raft_consensus.cc:2804] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:29.108520 27160 raft_consensus.cc:697] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:29.109217 27160 consensus_queue.cc:237] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:29.119117 25584 catalog_manager.cc:5697] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 3 to 4, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 4 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:29.222895 25682 raft_consensus.cc:1275] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:23:29.224056 27293 consensus_queue.cc:1048] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:29.306581 25678 raft_consensus.cc:1275] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:29.324836 26437 raft_consensus.cc:1275] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:23:29.327831 27293 consensus_queue.cc:1048] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:29.350849 27286 consensus_queue.cc:1048] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:29.366094 25837 raft_consensus.cc:1275] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:29.372821 27286 consensus_queue.cc:1048] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:29.544898 25759 raft_consensus.cc:1275] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:29.547163 27172 consensus_queue.cc:1048] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:29.555761 26436 raft_consensus.cc:1275] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:29.557241 27293 consensus_queue.cc:1048] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:29.580022 25837 raft_consensus.cc:1275] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:29.581406 27160 consensus_queue.cc:1048] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:29.592222 25682 raft_consensus.cc:1275] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:29.593621 27284 consensus_queue.cc:1048] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:29.727999 25828 consensus_queue.cc:237] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:29.734170 25759 raft_consensus.cc:1275] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:29.734805 25682 raft_consensus.cc:1275] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:23:29.734980 25801 consensus_peers.cc:597] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a -> Peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Couldn't send request to peer a866ff967d964388a6f0dff7fd43df89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 522704a36135481fa4fc221fa9a0801e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:29.735792 27172 consensus_queue.cc:1048] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:29.736784 27293 consensus_queue.cc:1048] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:29.742511 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:29.746361 27293 raft_consensus.cc:2955] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:29.756623 25759 raft_consensus.cc:2955] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:29.764879 25762 consensus_queue.cc:237] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:29.765866 25678 raft_consensus.cc:2955] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Committing config change with OpId 4.4: config changed from index -1 to 4, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:29.774159 25582 catalog_manager.cc:5697] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: config changed from index -1 to 4, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New cstate: current_term: 4 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
W20260709 12:23:29.789848 25726 consensus_peers.cc:597] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Couldn't send request to peer a866ff967d964388a6f0dff7fd43df89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f979ddeb5c014d329931d4e2e035af60. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:29.792464 25837 raft_consensus.cc:1275] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:29.795333 25678 raft_consensus.cc:1275] T f979ddeb5c014d329931d4e2e035af60 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:29.795097 27284 consensus_queue.cc:1048] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:29.797583 27284 consensus_queue.cc:1048] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:29.807694 27252 raft_consensus.cc:2955] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:29.816803 25678 raft_consensus.cc:2955] T f979ddeb5c014d329931d4e2e035af60 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:29.836388 25583 catalog_manager.cc:5697] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: config changed from index -1 to 3, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New cstate: current_term: 2 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:29.839488 25762 consensus_queue.cc:237] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:29.845629 25837 raft_consensus.cc:2955] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
W20260709 12:23:29.895054 25726 consensus_peers.cc:597] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Couldn't send request to peer a866ff967d964388a6f0dff7fd43df89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 06c3ab7c0c7a496390151c476ec675a0. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:29.898353 25837 raft_consensus.cc:1275] T 06c3ab7c0c7a496390151c476ec675a0 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:29.899644 25678 raft_consensus.cc:1275] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:29.900033 27284 consensus_queue.cc:1048] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:29.900432 25762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
mode: GRACEFUL
new_leader_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:48134
I20260709 12:23:29.901202 27252 consensus_queue.cc:1048] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:29.901022 25762 raft_consensus.cc:606] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 LEADER]: Received request to transfer leadership to TS 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:23:29.906970 25828 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "f82778701b464892aab92a752ed7ffdc"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:23:29.907524 25828 raft_consensus.cc:606] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Received request to transfer leadership to TS f82778701b464892aab92a752ed7ffdc
I20260709 12:23:29.910804 25828 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "f82778701b464892aab92a752ed7ffdc"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:23:29.911409 25828 raft_consensus.cc:606] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Received request to transfer leadership to TS f82778701b464892aab92a752ed7ffdc
I20260709 12:23:29.912652 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:23:29.915014 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:29.914364 27252 raft_consensus.cc:2955] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:29.916376 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:29.920763 25837 raft_consensus.cc:2955] T 06c3ab7c0c7a496390151c476ec675a0 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:29.923326 25682 raft_consensus.cc:2955] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:29.950863 25583 catalog_manager.cc:5697] T 06c3ab7c0c7a496390151c476ec675a0 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: config changed from index -1 to 3, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New cstate: current_term: 2 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
W20260709 12:23:29.959987 25632 auto_rebalancer.cc:629] Failed to schedule move for tablet 4734c282e09b4bbbb96de8eee61c160a: Remote error: Service unavailable: leader transfer in progress
I20260709 12:23:30.041567 27126 raft_consensus.cc:993] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a: : Instructing follower f82778701b464892aab92a752ed7ffdc to start an election
I20260709 12:23:30.042140 27172 raft_consensus.cc:1081] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Signalling peer f82778701b464892aab92a752ed7ffdc to start an election
I20260709 12:23:30.043838 25682 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
 from {username='slave'} at 127.0.0.1:40220
I20260709 12:23:30.044489 25682 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:30.044943 25682 raft_consensus.cc:3060] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:30.056972 25682 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:30.059491 25682 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:30.060842 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:30.061021 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:30.061472 25837 raft_consensus.cc:3055] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:30.061632 25759 raft_consensus.cc:3060] T 4734c282e09b4bbbb96de8eee61c160a P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:30.061887 25837 raft_consensus.cc:740] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:30.063225 25837 consensus_queue.cc:260] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:30.064064 25837 raft_consensus.cc:3060] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:30.068327 25759 raft_consensus.cc:2468] T 4734c282e09b4bbbb96de8eee61c160a P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 2.
I20260709 12:23:30.073629 25649 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:30.071663 25837 raft_consensus.cc:2468] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 2.
I20260709 12:23:30.074468 27326 raft_consensus.cc:2804] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:30.075055 27326 raft_consensus.cc:697] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 2 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:30.075995 27326 consensus_queue.cc:237] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:30.089392 25583 catalog_manager.cc:5697] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 1 to 2, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 2 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:30.165490 27160 raft_consensus.cc:993] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8: : Instructing follower 5cccf20a8bff46dba6601f241d172b8a to start an election
I20260709 12:23:30.166016 27252 raft_consensus.cc:1081] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 LEADER]: Signalling peer 5cccf20a8bff46dba6601f241d172b8a to start an election
I20260709 12:23:30.167661 25828 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:44218
I20260709 12:23:30.168248 25828 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:30.168641 25828 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:30.182061 25828 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:30.186461 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:30.187072 25682 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:30.190361 27172 raft_consensus.cc:993] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a: : Instructing follower f82778701b464892aab92a752ed7ffdc to start an election
I20260709 12:23:30.190865 27172 raft_consensus.cc:1081] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Signalling peer f82778701b464892aab92a752ed7ffdc to start an election
I20260709 12:23:30.194269 25678 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
 from {username='slave'} at 127.0.0.1:40220
I20260709 12:23:30.194499 25682 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 5.
I20260709 12:23:30.194849 25678 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:30.195267 25678 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:30.195868 25801 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:30.196659 27293 raft_consensus.cc:2804] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:30.198127 27293 raft_consensus.cc:697] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 5 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:30.199064 27293 consensus_queue.cc:237] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:30.202558 25678 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:30.203485 25828 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:30.205044 25678 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:30.205890 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:30.206476 25759 raft_consensus.cc:3055] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:30.206746 25759 raft_consensus.cc:740] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:30.207430 25759 consensus_queue.cc:260] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:30.210058 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:30.210652 25837 raft_consensus.cc:3055] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:30.210987 25837 raft_consensus.cc:740] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:30.212548 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:30.213156 26436 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:30.212734 25583 catalog_manager.cc:5697] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 4 to 5, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 5 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:30.213393 25837 consensus_queue.cc:260] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:30.214668 25837 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:30.217077 25759 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:30.221850 25837 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 5.
I20260709 12:23:30.223281 25650 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:30.224102 27326 raft_consensus.cc:2804] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:30.224610 27326 raft_consensus.cc:697] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 5 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:30.225531 27326 consensus_queue.cc:237] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:30.227337 26436 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 5.
I20260709 12:23:30.238200 25584 catalog_manager.cc:5697] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 4 to 5, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 5 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:30.245349 25759 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 5.
I20260709 12:23:30.248724 27329 ts_tablet_manager.cc:933] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89: Initiating tablet copy from peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:30.250387 27329 tablet_copy_client.cc:323] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Beginning tablet copy session from remote peer at address 127.23.245.130:37267
I20260709 12:23:30.252110 25773 tablet_copy_service.cc:140] P 6e673265293d4e9a937dc45150aeb1b8: Received BeginTabletCopySession request for tablet f979ddeb5c014d329931d4e2e035af60 from peer a866ff967d964388a6f0dff7fd43df89 ({username='slave'} at 127.0.0.1:48606)
I20260709 12:23:30.252599 25773 tablet_copy_service.cc:161] P 6e673265293d4e9a937dc45150aeb1b8: Beginning new tablet copy session on tablet f979ddeb5c014d329931d4e2e035af60 from peer a866ff967d964388a6f0dff7fd43df89 at {username='slave'} at 127.0.0.1:48606: session id = a866ff967d964388a6f0dff7fd43df89-f979ddeb5c014d329931d4e2e035af60
I20260709 12:23:30.259770 25773 tablet_copy_source_session.cc:215] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:30.263789 27329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f979ddeb5c014d329931d4e2e035af60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:30.281468 27329 tablet_copy_client.cc:806] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:30.282034 27329 tablet_copy_client.cc:670] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:30.285703 27329 tablet_copy_client.cc:538] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:30.294905 27329 tablet_bootstrap.cc:492] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89: Bootstrap starting.
I20260709 12:23:30.317605 27329 tablet_bootstrap.cc:492] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:30.318424 27329 tablet_bootstrap.cc:492] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89: Bootstrap complete.
I20260709 12:23:30.319018 27329 ts_tablet_manager.cc:1403] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89: Time spent bootstrapping tablet: real 0.024s	user 0.019s	sys 0.004s
I20260709 12:23:30.321751 27329 raft_consensus.cc:359] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:30.322561 27329 raft_consensus.cc:740] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Initialized, Role: LEARNER
I20260709 12:23:30.323482 27329 consensus_queue.cc:260] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:30.326050 27329 ts_tablet_manager.cc:1434] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:23:30.328562 25773 tablet_copy_service.cc:342] P 6e673265293d4e9a937dc45150aeb1b8: Request end of tablet copy session a866ff967d964388a6f0dff7fd43df89-f979ddeb5c014d329931d4e2e035af60 received from {username='slave'} at 127.0.0.1:48606
I20260709 12:23:30.328996 25773 tablet_copy_service.cc:434] P 6e673265293d4e9a937dc45150aeb1b8: ending tablet copy session a866ff967d964388a6f0dff7fd43df89-f979ddeb5c014d329931d4e2e035af60 on tablet f979ddeb5c014d329931d4e2e035af60 with peer a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:30.345669 27329 ts_tablet_manager.cc:933] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89: Initiating tablet copy from peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:30.347452 27329 tablet_copy_client.cc:323] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89: tablet copy: Beginning tablet copy session from remote peer at address 127.23.245.131:36237
I20260709 12:23:30.349221 25847 tablet_copy_service.cc:140] P 5cccf20a8bff46dba6601f241d172b8a: Received BeginTabletCopySession request for tablet 522704a36135481fa4fc221fa9a0801e from peer a866ff967d964388a6f0dff7fd43df89 ({username='slave'} at 127.0.0.1:41782)
I20260709 12:23:30.349768 25847 tablet_copy_service.cc:161] P 5cccf20a8bff46dba6601f241d172b8a: Beginning new tablet copy session on tablet 522704a36135481fa4fc221fa9a0801e from peer a866ff967d964388a6f0dff7fd43df89 at {username='slave'} at 127.0.0.1:41782: session id = a866ff967d964388a6f0dff7fd43df89-522704a36135481fa4fc221fa9a0801e
I20260709 12:23:30.358578 25847 tablet_copy_source_session.cc:215] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:30.363677 27329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 522704a36135481fa4fc221fa9a0801e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:30.378860 27329 tablet_copy_client.cc:806] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:30.380312 27329 tablet_copy_client.cc:670] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:30.384045 27329 tablet_copy_client.cc:538] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:30.393034 27329 tablet_bootstrap.cc:492] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89: Bootstrap starting.
I20260709 12:23:30.417016 27329 tablet_bootstrap.cc:492] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:30.417953 27329 tablet_bootstrap.cc:492] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89: Bootstrap complete.
I20260709 12:23:30.418642 27329 ts_tablet_manager.cc:1403] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89: Time spent bootstrapping tablet: real 0.026s	user 0.019s	sys 0.005s
I20260709 12:23:30.421933 27329 raft_consensus.cc:359] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 4 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:30.423095 27329 raft_consensus.cc:740] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 4 LEARNER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Initialized, Role: LEARNER
I20260709 12:23:30.423873 27329 consensus_queue.cc:260] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:30.426936 27329 ts_tablet_manager.cc:1434] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89: Time spent starting tablet: real 0.008s	user 0.010s	sys 0.000s
I20260709 12:23:30.432102 25847 tablet_copy_service.cc:342] P 5cccf20a8bff46dba6601f241d172b8a: Request end of tablet copy session a866ff967d964388a6f0dff7fd43df89-522704a36135481fa4fc221fa9a0801e received from {username='slave'} at 127.0.0.1:41782
I20260709 12:23:30.432700 25847 tablet_copy_service.cc:434] P 5cccf20a8bff46dba6601f241d172b8a: ending tablet copy session a866ff967d964388a6f0dff7fd43df89-522704a36135481fa4fc221fa9a0801e on tablet 522704a36135481fa4fc221fa9a0801e with peer a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:30.457932 25759 raft_consensus.cc:1275] T 4734c282e09b4bbbb96de8eee61c160a P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:30.459439 27326 consensus_queue.cc:1048] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:30.484915 25833 raft_consensus.cc:1275] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:30.486138 27329 ts_tablet_manager.cc:933] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89: Initiating tablet copy from peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:30.486681 27247 consensus_queue.cc:1048] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:30.502774 27329 tablet_copy_client.cc:323] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Beginning tablet copy session from remote peer at address 127.23.245.130:37267
I20260709 12:23:30.505887 25773 tablet_copy_service.cc:140] P 6e673265293d4e9a937dc45150aeb1b8: Received BeginTabletCopySession request for tablet 06c3ab7c0c7a496390151c476ec675a0 from peer a866ff967d964388a6f0dff7fd43df89 ({username='slave'} at 127.0.0.1:48606)
I20260709 12:23:30.506493 25773 tablet_copy_service.cc:161] P 6e673265293d4e9a937dc45150aeb1b8: Beginning new tablet copy session on tablet 06c3ab7c0c7a496390151c476ec675a0 from peer a866ff967d964388a6f0dff7fd43df89 at {username='slave'} at 127.0.0.1:48606: session id = a866ff967d964388a6f0dff7fd43df89-06c3ab7c0c7a496390151c476ec675a0
I20260709 12:23:30.516415 25773 tablet_copy_source_session.cc:215] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:30.520397 27329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06c3ab7c0c7a496390151c476ec675a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:30.540169 27329 tablet_copy_client.cc:806] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:30.541781 27329 tablet_copy_client.cc:670] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:30.545715 27329 tablet_copy_client.cc:538] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:30.560811 27329 tablet_bootstrap.cc:492] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89: Bootstrap starting.
I20260709 12:23:30.581419 27329 tablet_bootstrap.cc:492] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:30.582617 27329 tablet_bootstrap.cc:492] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89: Bootstrap complete.
I20260709 12:23:30.583319 27329 ts_tablet_manager.cc:1403] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.007s
I20260709 12:23:30.586107 27329 raft_consensus.cc:359] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:30.586967 27329 raft_consensus.cc:740] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Initialized, Role: LEARNER
I20260709 12:23:30.587623 27329 consensus_queue.cc:260] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:30.589963 27329 ts_tablet_manager.cc:1434] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:23:30.591739 25773 tablet_copy_service.cc:342] P 6e673265293d4e9a937dc45150aeb1b8: Request end of tablet copy session a866ff967d964388a6f0dff7fd43df89-06c3ab7c0c7a496390151c476ec675a0 received from {username='slave'} at 127.0.0.1:48606
I20260709 12:23:30.592188 25773 tablet_copy_service.cc:434] P 6e673265293d4e9a937dc45150aeb1b8: ending tablet copy session a866ff967d964388a6f0dff7fd43df89-06c3ab7c0c7a496390151c476ec675a0 on tablet 06c3ab7c0c7a496390151c476ec675a0 with peer a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:30.620816 26437 raft_consensus.cc:1217] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:23:30.661532 25833 raft_consensus.cc:1275] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:23:30.662830 27247 consensus_queue.cc:1048] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:30.669800 25677 raft_consensus.cc:1275] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:23:30.671388 27126 consensus_queue.cc:1048] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:30.671797 26437 raft_consensus.cc:1275] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:23:30.675895 27247 consensus_queue.cc:1048] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:30.737066 25759 raft_consensus.cc:1275] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:23:30.744566 27126 consensus_queue.cc:1048] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:30.814766 26437 raft_consensus.cc:1217] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 4 LEARNER]: Deduplicated request from leader. Original: 4.3->[4.4-4.4]   Dedup: 4.4->[]
I20260709 12:23:30.866040 26437 raft_consensus.cc:1217] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:23:31.003463 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:31.059558 27160 raft_consensus.cc:1064] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8: attempting to promote NON_VOTER a866ff967d964388a6f0dff7fd43df89 to VOTER
I20260709 12:23:31.066205 27160 consensus_queue.cc:237] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:31.072402 25677 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05232536e53b419682a5f24515843652"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
mode: GRACEFUL
new_leader_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:49108
I20260709 12:23:31.072985 25677 raft_consensus.cc:606] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Received request to transfer leadership to TS 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:31.077003 26436 raft_consensus.cc:1275] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEARNER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:23:31.077423 25677 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
mode: GRACEFUL
new_leader_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:49108
I20260709 12:23:31.077968 25677 raft_consensus.cc:606] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 2 LEADER]: Received request to transfer leadership to TS 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:23:31.078824 25828 raft_consensus.cc:1275] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:23:31.080327 25677 raft_consensus.cc:1275] T f979ddeb5c014d329931d4e2e035af60 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:23:31.082850 27349 consensus_queue.cc:1048] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:31.083765 27141 consensus_queue.cc:1048] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:31.084192 25828 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:23:31.084856 25828 raft_consensus.cc:606] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Received request to transfer leadership to TS 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:31.085458 27349 consensus_queue.cc:1048] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:31.086591 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:23:31.088343 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:31.089068 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:31.097482 27247 raft_consensus.cc:993] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc: : Instructing follower 6e673265293d4e9a937dc45150aeb1b8 to start an election
I20260709 12:23:31.097995 27247 raft_consensus.cc:1081] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Signalling peer 6e673265293d4e9a937dc45150aeb1b8 to start an election
I20260709 12:23:31.105466 25762 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "05232536e53b419682a5f24515843652"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:53474
I20260709 12:23:31.106011 25762 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:31.106349 25762 raft_consensus.cc:3060] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:31.120148 25762 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:31.132467 25762 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:31.131548 27160 raft_consensus.cc:2955] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:31.134613 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:31.135182 25677 raft_consensus.cc:3055] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:31.135449 25677 raft_consensus.cc:740] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:31.136166 25677 consensus_queue.cc:260] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:31.137292 25677 raft_consensus.cc:3060] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:31.140240 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:31.140762 26437 raft_consensus.cc:3060] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:31.145864 25682 raft_consensus.cc:2955] T f979ddeb5c014d329931d4e2e035af60 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:31.151384 25584 catalog_manager.cc:5697] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:31.133983 26436 raft_consensus.cc:2955] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:31.171238 25833 raft_consensus.cc:2955] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:31.172278 25677 raft_consensus.cc:2468] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 2.
I20260709 12:23:31.185719 26437 raft_consensus.cc:2468] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 2.
I20260709 12:23:31.191162 25726 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:31.199502 27160 raft_consensus.cc:2804] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:31.200007 27160 raft_consensus.cc:697] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:31.200757 27160 consensus_queue.cc:237] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:31.242669 25583 catalog_manager.cc:5697] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 1 to 2, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 2 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:31.254895 25759 consensus_queue.cc:237] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:31.262568 26436 raft_consensus.cc:1275] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:31.263622 25833 raft_consensus.cc:1275] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:31.264204 27160 consensus_queue.cc:1048] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:31.265030 27351 consensus_queue.cc:1048] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:31.271567 27284 raft_consensus.cc:2955] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:31.275557 27346 raft_consensus.cc:1064] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a: attempting to promote NON_VOTER a866ff967d964388a6f0dff7fd43df89 to VOTER
I20260709 12:23:31.278033 27346 consensus_queue.cc:237] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 2, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:31.280457 26436 raft_consensus.cc:2955] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:31.280825 25833 raft_consensus.cc:2955] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:31.292869 27280 raft_consensus.cc:993] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc: : Instructing follower 5cccf20a8bff46dba6601f241d172b8a to start an election
I20260709 12:23:31.293381 27280 raft_consensus.cc:1081] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 2 LEADER]: Signalling peer 5cccf20a8bff46dba6601f241d172b8a to start an election
I20260709 12:23:31.294976 25828 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:44202
I20260709 12:23:31.297641 25828 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:31.298067 25828 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:31.296222 25583 catalog_manager.cc:5697] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: config changed from index 4 to 5, VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129) evicted. New cstate: current_term: 2 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:31.302915 25568 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f979ddeb5c014d329931d4e2e035af60 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:31.314433 25676 tablet_service.cc:1558] Processing DeleteTablet for tablet f979ddeb5c014d329931d4e2e035af60 with delete_type TABLET_DATA_TOMBSTONED (TS f82778701b464892aab92a752ed7ffdc not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:40214
I20260709 12:23:31.318889 25828 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:31.321005 25828 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:31.322634 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:31.323163 25762 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:31.322120 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:31.325716 25677 raft_consensus.cc:3055] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:31.326017 25677 raft_consensus.cc:740] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:31.326846 25677 consensus_queue.cc:260] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:31.327975 25677 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:31.330057 25762 raft_consensus.cc:2468] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 3.
I20260709 12:23:31.337672 25759 raft_consensus.cc:1275] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:23:31.339864 27126 consensus_queue.cc:1048] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:31.340696 25800 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:23:31.341180 25677 raft_consensus.cc:2468] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 3.
I20260709 12:23:31.341557 27301 raft_consensus.cc:2804] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:31.342118 27301 raft_consensus.cc:697] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 3 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:31.342870 26436 raft_consensus.cc:1275] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 4 LEARNER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:23:31.342883 27360 tablet_replica.cc:333] T f979ddeb5c014d329931d4e2e035af60 P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
I20260709 12:23:31.346359 27126 consensus_queue.cc:1048] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:31.347467 27360 raft_consensus.cc:2243] T f979ddeb5c014d329931d4e2e035af60 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:31.348285 27360 raft_consensus.cc:2272] T f979ddeb5c014d329931d4e2e035af60 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:31.352662 25682 raft_consensus.cc:1275] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:23:31.355929 27360 ts_tablet_manager.cc:1916] T f979ddeb5c014d329931d4e2e035af60 P f82778701b464892aab92a752ed7ffdc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:31.356498 27126 consensus_queue.cc:1048] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:23:31.343008 27301 consensus_queue.cc:237] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:31.390668 27360 ts_tablet_manager.cc:1929] T f979ddeb5c014d329931d4e2e035af60 P f82778701b464892aab92a752ed7ffdc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:23:31.391183 27360 log.cc:1199] T f979ddeb5c014d329931d4e2e035af60 P f82778701b464892aab92a752ed7ffdc: Deleting WAL directory at /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-0-root/wals/f979ddeb5c014d329931d4e2e035af60
I20260709 12:23:31.393042 25569 catalog_manager.cc:5028] TS f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): tablet f979ddeb5c014d329931d4e2e035af60 (table test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]) successfully deleted
I20260709 12:23:31.394214 27141 raft_consensus.cc:1064] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8: attempting to promote NON_VOTER a866ff967d964388a6f0dff7fd43df89 to VOTER
I20260709 12:23:31.396471 27141 consensus_queue.cc:237] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:31.423406 26436 raft_consensus.cc:1275] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEARNER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:23:31.425583 25833 raft_consensus.cc:1275] T 06c3ab7c0c7a496390151c476ec675a0 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:23:31.425897 27141 consensus_queue.cc:1048] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:31.428534 27160 consensus_queue.cc:1048] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:31.434230 25682 raft_consensus.cc:1275] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:23:31.436404 27141 consensus_queue.cc:1048] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:31.464053 25583 catalog_manager.cc:5697] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 2 to 3, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 3 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:31.491405 27363 raft_consensus.cc:2955] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 4 to 5, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:31.499028 25677 raft_consensus.cc:2955] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:31.522869 25682 raft_consensus.cc:2955] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
W20260709 12:23:31.528314 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 49046.3us
W20260709 12:23:31.518972 27365 log.cc:927] Time spent T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:23:31.529924 27126 raft_consensus.cc:993] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a: : Instructing follower 6e673265293d4e9a937dc45150aeb1b8 to start an election
I20260709 12:23:31.543599 27301 raft_consensus.cc:1081] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Signalling peer 6e673265293d4e9a937dc45150aeb1b8 to start an election
I20260709 12:23:31.544461 25582 catalog_manager.cc:5697] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc reported cstate change: config changed from index 4 to 5, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:31.530049 27351 raft_consensus.cc:2955] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:31.581665 25762 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:53460
I20260709 12:23:31.582222 25762 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:31.582537 25762 raft_consensus.cc:3060] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:31.600780 25762 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:31.602418 25762 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:31.603529 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:31.604395 25682 raft_consensus.cc:3060] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:31.606398 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:31.606945 25831 raft_consensus.cc:3055] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:31.607205 25831 raft_consensus.cc:740] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:31.607935 25831 consensus_queue.cc:260] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:31.609091 25831 raft_consensus.cc:3060] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:31.613695 25682 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 2.
I20260709 12:23:31.615082 25726 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:31.616094 27349 raft_consensus.cc:2804] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:31.617262 27349 raft_consensus.cc:697] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:31.617913 27349 consensus_queue.cc:237] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:31.625250 25837 consensus_queue.cc:237] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:31.634505 25678 raft_consensus.cc:1275] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:23:31.638013 27293 consensus_queue.cc:1048] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:31.631738 25828 raft_consensus.cc:2955] T 06c3ab7c0c7a496390151c476ec675a0 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:31.634615 25582 catalog_manager.cc:5697] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc reported cstate change: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:31.638108 26436 raft_consensus.cc:2955] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:31.643090 25762 raft_consensus.cc:2955] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 4 to 5, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:31.649500 26436 raft_consensus.cc:1275] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:23:31.655452 27301 consensus_queue.cc:1048] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:31.664865 25581 catalog_manager.cc:5697] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 1 to 2, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 2 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:31.667400 27376 raft_consensus.cc:2955] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
W20260709 12:23:31.669385 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 136988us
I20260709 12:23:31.671744 25678 raft_consensus.cc:2955] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:31.683218 25569 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 522704a36135481fa4fc221fa9a0801e with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:31.691363 26439 raft_consensus.cc:2955] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:31.702931 25757 consensus_queue.cc:237] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:31.629300 25831 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 2.
I20260709 12:23:31.690461 26437 raft_consensus.cc:1275] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:31.710228 25680 raft_consensus.cc:1275] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:31.709965 26436 raft_consensus.cc:2955] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:31.711696 27284 consensus_queue.cc:1048] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:31.711738 27351 consensus_queue.cc:1048] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:31.715294 26437 raft_consensus.cc:1275] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:31.723553 27349 consensus_queue.cc:1048] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:31.729749 25682 raft_consensus.cc:1275] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:31.732930 27349 consensus_queue.cc:1048] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:31.735562 27284 raft_consensus.cc:2955] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:31.740567 26437 raft_consensus.cc:2955] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:31.743225 25584 catalog_manager.cc:5697] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: config changed from index 5 to 6, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New cstate: current_term: 4 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:31.782361 25680 raft_consensus.cc:2955] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:31.815982 25753 tablet_service.cc:1558] Processing DeleteTablet for tablet 522704a36135481fa4fc221fa9a0801e with delete_type TABLET_DATA_TOMBSTONED (TS 6e673265293d4e9a937dc45150aeb1b8 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:53452
I20260709 12:23:31.824537 25678 raft_consensus.cc:1275] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:31.848212 27363 consensus_queue.cc:1048] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:31.873358 27380 tablet_replica.cc:333] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
I20260709 12:23:31.875771 27380 raft_consensus.cc:2243] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:31.879520 27380 raft_consensus.cc:2272] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:31.884193 27380 ts_tablet_manager.cc:1916] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:31.897054 25568 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 06c3ab7c0c7a496390151c476ec675a0 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:31.908516 25581 catalog_manager.cc:5697] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: config changed from index 4 to 5, VOTER 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) evicted. New cstate: current_term: 2 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:31.920842 25824 tablet_service.cc:1558] Processing DeleteTablet for tablet 06c3ab7c0c7a496390151c476ec675a0 with delete_type TABLET_DATA_TOMBSTONED (TS 5cccf20a8bff46dba6601f241d172b8a not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:44194
I20260709 12:23:31.933856 27380 ts_tablet_manager.cc:1929] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
I20260709 12:23:31.934440 27380 log.cc:1199] T 522704a36135481fa4fc221fa9a0801e P 6e673265293d4e9a937dc45150aeb1b8: Deleting WAL directory at /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-1-root/wals/522704a36135481fa4fc221fa9a0801e
I20260709 12:23:31.936025 25568 catalog_manager.cc:5028] TS 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): tablet 522704a36135481fa4fc221fa9a0801e (table test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]) successfully deleted
I20260709 12:23:32.043455 25762 raft_consensus.cc:1275] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:32.051658 27385 tablet_replica.cc:333] T 06c3ab7c0c7a496390151c476ec675a0 P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
I20260709 12:23:32.052956 27385 raft_consensus.cc:2243] T 06c3ab7c0c7a496390151c476ec675a0 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:32.053457 27301 consensus_queue.cc:1048] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:32.053706 27385 raft_consensus.cc:2272] T 06c3ab7c0c7a496390151c476ec675a0 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:32.057523 27385 ts_tablet_manager.cc:1916] T 06c3ab7c0c7a496390151c476ec675a0 P 5cccf20a8bff46dba6601f241d172b8a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:32.073670 27385 ts_tablet_manager.cc:1929] T 06c3ab7c0c7a496390151c476ec675a0 P 5cccf20a8bff46dba6601f241d172b8a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:23:32.074138 27385 log.cc:1199] T 06c3ab7c0c7a496390151c476ec675a0 P 5cccf20a8bff46dba6601f241d172b8a: Deleting WAL directory at /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-2-root/wals/06c3ab7c0c7a496390151c476ec675a0
I20260709 12:23:32.076766 25569 catalog_manager.cc:5028] TS 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): tablet 06c3ab7c0c7a496390151c476ec675a0 (table test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]) successfully deleted
I20260709 12:23:32.119845 25680 raft_consensus.cc:1275] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:32.144918 27284 consensus_queue.cc:1048] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:23:32.158365 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 67868.6us
I20260709 12:23:32.170146 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:32.196275 25833 raft_consensus.cc:1275] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:32.239984 27349 consensus_queue.cc:1048] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:32.293126 25757 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25bd5658646b41608d707d196c6e0585"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
mode: GRACEFUL
new_leader_uuid: "a866ff967d964388a6f0dff7fd43df89"
 from {username='slave'} at 127.0.0.1:48134
I20260709 12:23:32.293634 25757 raft_consensus.cc:606] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Received request to transfer leadership to TS a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:32.296304 25757 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
mode: GRACEFUL
new_leader_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:48134
I20260709 12:23:32.296777 25757 raft_consensus.cc:606] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Received request to transfer leadership to TS 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:23:32.299137 25833 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "f82778701b464892aab92a752ed7ffdc"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:23:32.299654 25833 raft_consensus.cc:606] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Received request to transfer leadership to TS f82778701b464892aab92a752ed7ffdc
I20260709 12:23:32.302156 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:23:32.303515 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:32.304211 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:32.424567 27351 raft_consensus.cc:993] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8: : Instructing follower a866ff967d964388a6f0dff7fd43df89 to start an election
I20260709 12:23:32.425110 27349 raft_consensus.cc:1081] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Signalling peer a866ff967d964388a6f0dff7fd43df89 to start an election
I20260709 12:23:32.426498 26437 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "25bd5658646b41608d707d196c6e0585"
dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
 from {username='slave'} at 127.0.0.1:36518
I20260709 12:23:32.426927 26437 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:32.427194 26437 raft_consensus.cc:3060] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:32.432471 26437 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:32.434171 26437 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:32.434715 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:32.435297 25762 raft_consensus.cc:3055] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:32.435555 25762 raft_consensus.cc:740] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:32.435833 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:32.436383 25833 raft_consensus.cc:3060] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:32.436316 25762 consensus_queue.cc:260] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:32.437332 25762 raft_consensus.cc:3060] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:32.441054 25833 raft_consensus.cc:2468] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 3.
I20260709 12:23:32.442144 26402 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:32.442512 25762 raft_consensus.cc:2468] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 3.
I20260709 12:23:32.442934 27389 raft_consensus.cc:2804] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:32.443416 27389 raft_consensus.cc:697] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 3 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:23:32.444216 27389 consensus_queue.cc:237] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:32.454167 25584 catalog_manager.cc:5697] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 2 to 3, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 3 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:32.497434 27363 raft_consensus.cc:993] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a: : Instructing follower f82778701b464892aab92a752ed7ffdc to start an election
I20260709 12:23:32.497879 27376 raft_consensus.cc:1081] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Signalling peer f82778701b464892aab92a752ed7ffdc to start an election
I20260709 12:23:32.499382 25680 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
 from {username='slave'} at 127.0.0.1:40220
I20260709 12:23:32.499841 25680 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:32.500195 25680 raft_consensus.cc:3060] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:32.506409 25680 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:32.508613 25680 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:32.508785 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:32.509356 25833 raft_consensus.cc:3055] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:32.509547 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:32.509680 25833 raft_consensus.cc:740] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:32.510159 26439 raft_consensus.cc:3060] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:32.510600 25833 consensus_queue.cc:260] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:32.511817 25833 raft_consensus.cc:3060] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:32.516960 26439 raft_consensus.cc:2468] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 2.
I20260709 12:23:32.518347 25650 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:32.519109 27374 raft_consensus.cc:2804] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:32.519699 27374 raft_consensus.cc:697] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 2 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:32.520634 27374 consensus_queue.cc:237] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:32.524041 25833 raft_consensus.cc:2468] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 2.
I20260709 12:23:32.531615 27349 raft_consensus.cc:993] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8: : Instructing follower 5cccf20a8bff46dba6601f241d172b8a to start an election
I20260709 12:23:32.532089 27349 raft_consensus.cc:1081] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Signalling peer 5cccf20a8bff46dba6601f241d172b8a to start an election
I20260709 12:23:32.532711 25582 catalog_manager.cc:5697] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 1 to 2, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 2 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:32.533592 25829 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:44218
I20260709 12:23:32.534109 25829 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:32.534442 25829 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:32.540196 25829 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:32.542410 25829 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:32.543045 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:32.543265 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:32.543632 25680 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:32.543833 25762 raft_consensus.cc:3055] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:32.544193 25762 raft_consensus.cc:740] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:32.544857 25762 consensus_queue.cc:260] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:32.545915 25762 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:32.550115 25680 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 4.
I20260709 12:23:32.551294 25801 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:32.552071 27363 raft_consensus.cc:2804] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:32.552865 27363 raft_consensus.cc:697] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:32.553138 25762 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 4.
I20260709 12:23:32.553761 27363 consensus_queue.cc:237] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:32.563069 25582 catalog_manager.cc:5697] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 3 to 4, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 4 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:32.949424 25757 raft_consensus.cc:1275] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:32.951248 27363 consensus_queue.cc:1048] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:32.963459 25680 raft_consensus.cc:1275] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:32.969375 27363 consensus_queue.cc:1048] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:32.987790 25833 raft_consensus.cc:1275] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:32.989602 27389 consensus_queue.cc:1048] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:32.990056 25757 raft_consensus.cc:1275] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:32.995179 27389 consensus_queue.cc:1048] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:33.029907 25680 consensus_queue.cc:237] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:33.036518 25833 raft_consensus.cc:1275] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:33.037034 25650 consensus_peers.cc:597] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc -> Peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Couldn't send request to peer a866ff967d964388a6f0dff7fd43df89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 43b78aa0054b4da398a8fc04d12454a7. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:33.037918 25762 raft_consensus.cc:1275] T 43b78aa0054b4da398a8fc04d12454a7 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:33.038038 27247 consensus_queue.cc:1048] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:33.039954 27247 consensus_queue.cc:1048] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:33.065088 27408 raft_consensus.cc:2955] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:33.067157 25762 raft_consensus.cc:2955] T 43b78aa0054b4da398a8fc04d12454a7 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:33.068701 25833 raft_consensus.cc:2955] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:33.084101 25581 catalog_manager.cc:5697] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New cstate: current_term: 1 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:33.089679 26437 raft_consensus.cc:1275] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:33.097285 27247 consensus_queue.cc:1048] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:33.095652 25829 consensus_queue.cc:237] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:33.126056 25833 raft_consensus.cc:1275] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:33.128077 27247 consensus_queue.cc:1048] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:33.133766 25757 raft_consensus.cc:1275] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:23:33.134282 25801 consensus_peers.cc:597] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a -> Peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Couldn't send request to peer a866ff967d964388a6f0dff7fd43df89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2a278e46eb5d49edab4ba69303448a66. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:33.136577 25680 raft_consensus.cc:1275] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:23:33.136415 27293 consensus_queue.cc:1048] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:33.139094 27293 consensus_queue.cc:1048] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:23:33.151513 27363 raft_consensus.cc:2955] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 5 LEADER]: Committing config change with OpId 5.6: config changed from index -1 to 6, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:33.153653 25757 raft_consensus.cc:2955] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index -1 to 6, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:33.154408 25680 raft_consensus.cc:2955] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index -1 to 6, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:33.165408 25682 consensus_queue.cc:237] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:33.171769 25582 catalog_manager.cc:5697] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: config changed from index -1 to 6, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New cstate: current_term: 5 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:33.174220 25833 raft_consensus.cc:1275] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 12:23:33.177023 25650 consensus_peers.cc:597] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc -> Peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Couldn't send request to peer a866ff967d964388a6f0dff7fd43df89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4734c282e09b4bbbb96de8eee61c160a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:33.177785 27408 consensus_queue.cc:1048] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:33.181084 25757 raft_consensus.cc:1275] T 4734c282e09b4bbbb96de8eee61c160a P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:33.182657 27247 consensus_queue.cc:1048] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:33.193005 27374 raft_consensus.cc:2955] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:33.195061 25829 raft_consensus.cc:2955] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:33.218837 25833 consensus_queue.cc:237] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:33.221976 25757 raft_consensus.cc:2955] T 4734c282e09b4bbbb96de8eee61c160a P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:33.225035 25581 catalog_manager.cc:5697] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc reported cstate change: config changed from index -1 to 3, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New cstate: current_term: 2 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:33.253765 25801 consensus_peers.cc:597] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a -> Peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Couldn't send request to peer a866ff967d964388a6f0dff7fd43df89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8dcbaf690aa54e4887d08b85cec29701. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:33.254324 25757 raft_consensus.cc:1275] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:33.254627 25678 raft_consensus.cc:1275] T 8dcbaf690aa54e4887d08b85cec29701 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:33.256283 27376 consensus_queue.cc:1048] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:33.258430 27376 consensus_queue.cc:1048] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:33.266284 27363 raft_consensus.cc:2955] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:33.269179 25757 raft_consensus.cc:2955] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:33.268994 25678 raft_consensus.cc:2955] T 8dcbaf690aa54e4887d08b85cec29701 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:33.284782 25581 catalog_manager.cc:5697] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: config changed from index -1 to 3, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New cstate: current_term: 2 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:33.340672 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:33.383498 25833 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:23:33.384305 25833 raft_consensus.cc:606] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Received request to transfer leadership to TS 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:33.387836 25678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
mode: GRACEFUL
new_leader_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:49108
I20260709 12:23:33.388387 25678 raft_consensus.cc:606] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 5 LEADER]: Received request to transfer leadership to TS 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:23:33.389521 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:23:33.390894 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:33.391595 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:33.538712 27427 ts_tablet_manager.cc:933] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89: Initiating tablet copy from peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349)
I20260709 12:23:33.541093 27427 tablet_copy_client.cc:323] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Beginning tablet copy session from remote peer at address 127.23.245.129:37349
I20260709 12:23:33.542564 25696 tablet_copy_service.cc:140] P f82778701b464892aab92a752ed7ffdc: Received BeginTabletCopySession request for tablet 43b78aa0054b4da398a8fc04d12454a7 from peer a866ff967d964388a6f0dff7fd43df89 ({username='slave'} at 127.0.0.1:51578)
I20260709 12:23:33.543008 25696 tablet_copy_service.cc:161] P f82778701b464892aab92a752ed7ffdc: Beginning new tablet copy session on tablet 43b78aa0054b4da398a8fc04d12454a7 from peer a866ff967d964388a6f0dff7fd43df89 at {username='slave'} at 127.0.0.1:51578: session id = a866ff967d964388a6f0dff7fd43df89-43b78aa0054b4da398a8fc04d12454a7
I20260709 12:23:33.548394 25696 tablet_copy_source_session.cc:215] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:33.552023 27427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43b78aa0054b4da398a8fc04d12454a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:33.572191 27427 tablet_copy_client.cc:806] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:33.572912 27427 tablet_copy_client.cc:670] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:33.580471 27427 tablet_copy_client.cc:538] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:33.645224 27427 tablet_bootstrap.cc:492] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89: Bootstrap starting.
I20260709 12:23:33.670527 27429 ts_tablet_manager.cc:933] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89: Initiating tablet copy from peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349)
I20260709 12:23:33.695021 27293 raft_consensus.cc:993] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a: : Instructing follower 6e673265293d4e9a937dc45150aeb1b8 to start an election
I20260709 12:23:33.695693 27419 raft_consensus.cc:1081] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Signalling peer 6e673265293d4e9a937dc45150aeb1b8 to start an election
W20260709 12:23:33.700124 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 48411.8us
I20260709 12:23:33.700356 25756 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:53460
I20260709 12:23:33.700982 25756 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:33.701350 25756 raft_consensus.cc:3060] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:33.726140 25756 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:33.728612 25756 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:33.730612 27431 ts_tablet_manager.cc:933] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89: Initiating tablet copy from peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:33.733495 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:33.734292 25833 raft_consensus.cc:3055] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:33.734655 25833 raft_consensus.cc:740] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:33.735608 25833 consensus_queue.cc:260] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:33.738940 25833 raft_consensus.cc:3060] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:33.740841 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:33.741683 25678 raft_consensus.cc:3060] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:33.769908 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 52845.1us
I20260709 12:23:33.805536 27431 tablet_copy_client.cc:323] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Beginning tablet copy session from remote peer at address 127.23.245.131:36237
I20260709 12:23:33.807513 25847 tablet_copy_service.cc:140] P 5cccf20a8bff46dba6601f241d172b8a: Received BeginTabletCopySession request for tablet 8dcbaf690aa54e4887d08b85cec29701 from peer a866ff967d964388a6f0dff7fd43df89 ({username='slave'} at 127.0.0.1:41782)
I20260709 12:23:33.808249 25847 tablet_copy_service.cc:161] P 5cccf20a8bff46dba6601f241d172b8a: Beginning new tablet copy session on tablet 8dcbaf690aa54e4887d08b85cec29701 from peer a866ff967d964388a6f0dff7fd43df89 at {username='slave'} at 127.0.0.1:41782: session id = a866ff967d964388a6f0dff7fd43df89-8dcbaf690aa54e4887d08b85cec29701
I20260709 12:23:33.811743 25833 raft_consensus.cc:2468] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 2.
I20260709 12:23:33.813027 25726 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:23:33.813632 27435 ts_tablet_manager.cc:933] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89: Initiating tablet copy from peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:33.814324 27160 raft_consensus.cc:2804] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:33.814844 27160 raft_consensus.cc:697] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:33.815572 25678 raft_consensus.cc:2468] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 2.
I20260709 12:23:33.817008 27247 raft_consensus.cc:993] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc: : Instructing follower 5cccf20a8bff46dba6601f241d172b8a to start an election
I20260709 12:23:33.817435 27247 raft_consensus.cc:1081] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 5 LEADER]: Signalling peer 5cccf20a8bff46dba6601f241d172b8a to start an election
I20260709 12:23:33.817759 27160 consensus_queue.cc:237] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:33.825745 25847 tablet_copy_source_session.cc:215] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:33.830772 25829 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:44202
I20260709 12:23:33.831360 25829 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:33.831746 25829 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:33.843158 25829 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:33.839493 25582 catalog_manager.cc:5697] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 1 to 2, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 2 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:33.846637 27429 tablet_copy_client.cc:323] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89: tablet copy: Beginning tablet copy session from remote peer at address 127.23.245.129:37349
I20260709 12:23:33.846700 27435 tablet_copy_client.cc:323] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Beginning tablet copy session from remote peer at address 127.23.245.131:36237
I20260709 12:23:33.850435 27431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dcbaf690aa54e4887d08b85cec29701. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:33.855168 25696 tablet_copy_service.cc:140] P f82778701b464892aab92a752ed7ffdc: Received BeginTabletCopySession request for tablet 4734c282e09b4bbbb96de8eee61c160a from peer a866ff967d964388a6f0dff7fd43df89 ({username='slave'} at 127.0.0.1:51578)
I20260709 12:23:33.855772 25696 tablet_copy_service.cc:161] P f82778701b464892aab92a752ed7ffdc: Beginning new tablet copy session on tablet 4734c282e09b4bbbb96de8eee61c160a from peer a866ff967d964388a6f0dff7fd43df89 at {username='slave'} at 127.0.0.1:51578: session id = a866ff967d964388a6f0dff7fd43df89-4734c282e09b4bbbb96de8eee61c160a
I20260709 12:23:33.863564 25696 tablet_copy_source_session.cc:215] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:33.867156 25829 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:33.868063 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:33.867762 25847 tablet_copy_service.cc:140] P 5cccf20a8bff46dba6601f241d172b8a: Received BeginTabletCopySession request for tablet 2a278e46eb5d49edab4ba69303448a66 from peer a866ff967d964388a6f0dff7fd43df89 ({username='slave'} at 127.0.0.1:41782)
I20260709 12:23:33.850644 27427 tablet_bootstrap.cc:492] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:33.868734 25678 raft_consensus.cc:3055] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:23:33.869099 25678 raft_consensus.cc:740] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:33.867254 27429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4734c282e09b4bbbb96de8eee61c160a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:33.869602 27427 tablet_bootstrap.cc:492] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89: Bootstrap complete.
I20260709 12:23:33.869951 25678 consensus_queue.cc:260] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:33.868985 25847 tablet_copy_service.cc:161] P 5cccf20a8bff46dba6601f241d172b8a: Beginning new tablet copy session on tablet 2a278e46eb5d49edab4ba69303448a66 from peer a866ff967d964388a6f0dff7fd43df89 at {username='slave'} at 127.0.0.1:41782: session id = a866ff967d964388a6f0dff7fd43df89-2a278e46eb5d49edab4ba69303448a66
I20260709 12:23:33.872946 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:33.873991 26436 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:33.871045 25678 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:33.870437 27427 ts_tablet_manager.cc:1403] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89: Time spent bootstrapping tablet: real 0.225s	user 0.043s	sys 0.065s
I20260709 12:23:33.880460 26436 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 6.
I20260709 12:23:33.881750 25801 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:33.882512 27363 raft_consensus.cc:2804] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:23:33.882958 27363 raft_consensus.cc:697] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 6 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:33.883877 25678 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 6.
I20260709 12:23:33.883780 27363 consensus_queue.cc:237] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:33.891625 25847 tablet_copy_source_session.cc:215] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:33.902693 27435 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a278e46eb5d49edab4ba69303448a66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:33.922673 27431 tablet_copy_client.cc:806] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:33.923347 27431 tablet_copy_client.cc:670] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:33.892850 27427 raft_consensus.cc:359] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:33.941367 27427 raft_consensus.cc:740] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Initialized, Role: LEARNER
I20260709 12:23:33.941810 25582 catalog_manager.cc:5697] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 5 to 6, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 6 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:33.942121 27427 consensus_queue.cc:260] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:33.948616 27431 tablet_copy_client.cc:538] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:33.953718 27427 ts_tablet_manager.cc:1434] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89: Time spent starting tablet: real 0.074s	user 0.004s	sys 0.002s
I20260709 12:23:33.954223 27429 tablet_copy_client.cc:806] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:33.954928 27429 tablet_copy_client.cc:670] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:33.960161 27435 tablet_copy_client.cc:806] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:33.960896 27435 tablet_copy_client.cc:670] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:33.962642 25695 tablet_copy_service.cc:342] P f82778701b464892aab92a752ed7ffdc: Request end of tablet copy session a866ff967d964388a6f0dff7fd43df89-43b78aa0054b4da398a8fc04d12454a7 received from {username='slave'} at 127.0.0.1:51578
I20260709 12:23:33.963117 25695 tablet_copy_service.cc:434] P f82778701b464892aab92a752ed7ffdc: ending tablet copy session a866ff967d964388a6f0dff7fd43df89-43b78aa0054b4da398a8fc04d12454a7 on tablet 43b78aa0054b4da398a8fc04d12454a7 with peer a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:33.964427 27429 tablet_copy_client.cc:538] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:33.972635 27435 tablet_copy_client.cc:538] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:33.978469 27429 tablet_bootstrap.cc:492] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89: Bootstrap starting.
I20260709 12:23:33.990175 27431 tablet_bootstrap.cc:492] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89: Bootstrap starting.
I20260709 12:23:34.001699 27435 tablet_bootstrap.cc:492] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89: Bootstrap starting.
I20260709 12:23:34.045567 27429 tablet_bootstrap.cc:492] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:34.046808 27429 tablet_bootstrap.cc:492] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89: Bootstrap complete.
I20260709 12:23:34.047756 27429 ts_tablet_manager.cc:1403] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89: Time spent bootstrapping tablet: real 0.070s	user 0.027s	sys 0.012s
I20260709 12:23:34.048044 26436 raft_consensus.cc:1217] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:34.055328 27429 raft_consensus.cc:359] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:34.058913 27429 raft_consensus.cc:740] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Initialized, Role: LEARNER
I20260709 12:23:34.059744 27429 consensus_queue.cc:260] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:34.077716 27429 ts_tablet_manager.cc:1434] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 12:23:34.081146 25695 tablet_copy_service.cc:342] P f82778701b464892aab92a752ed7ffdc: Request end of tablet copy session a866ff967d964388a6f0dff7fd43df89-4734c282e09b4bbbb96de8eee61c160a received from {username='slave'} at 127.0.0.1:51578
I20260709 12:23:34.081604 25695 tablet_copy_service.cc:434] P f82778701b464892aab92a752ed7ffdc: ending tablet copy session a866ff967d964388a6f0dff7fd43df89-4734c282e09b4bbbb96de8eee61c160a on tablet 4734c282e09b4bbbb96de8eee61c160a with peer a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:34.103845 27431 tablet_bootstrap.cc:492] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:34.104981 27431 tablet_bootstrap.cc:492] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89: Bootstrap complete.
I20260709 12:23:34.105727 27431 ts_tablet_manager.cc:1403] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89: Time spent bootstrapping tablet: real 0.118s	user 0.030s	sys 0.008s
I20260709 12:23:34.110373 27431 raft_consensus.cc:359] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:34.111271 27431 raft_consensus.cc:740] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Initialized, Role: LEARNER
I20260709 12:23:34.111961 27431 consensus_queue.cc:260] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:34.115219 27435 tablet_bootstrap.cc:492] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:34.116147 27435 tablet_bootstrap.cc:492] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89: Bootstrap complete.
I20260709 12:23:34.116829 27435 ts_tablet_manager.cc:1403] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89: Time spent bootstrapping tablet: real 0.115s	user 0.022s	sys 0.013s
I20260709 12:23:34.118744 27431 ts_tablet_manager.cc:1434] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.001s
I20260709 12:23:34.119757 27435 raft_consensus.cc:359] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 5 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:34.120680 27435 raft_consensus.cc:740] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 5 LEARNER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Initialized, Role: LEARNER
I20260709 12:23:34.121047 25847 tablet_copy_service.cc:342] P 5cccf20a8bff46dba6601f241d172b8a: Request end of tablet copy session a866ff967d964388a6f0dff7fd43df89-8dcbaf690aa54e4887d08b85cec29701 received from {username='slave'} at 127.0.0.1:41782
I20260709 12:23:34.121515 25847 tablet_copy_service.cc:434] P 5cccf20a8bff46dba6601f241d172b8a: ending tablet copy session a866ff967d964388a6f0dff7fd43df89-8dcbaf690aa54e4887d08b85cec29701 on tablet 8dcbaf690aa54e4887d08b85cec29701 with peer a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:34.121433 27435 consensus_queue.cc:260] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:34.123879 27435 ts_tablet_manager.cc:1434] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:23:34.125759 25847 tablet_copy_service.cc:342] P 5cccf20a8bff46dba6601f241d172b8a: Request end of tablet copy session a866ff967d964388a6f0dff7fd43df89-2a278e46eb5d49edab4ba69303448a66 received from {username='slave'} at 127.0.0.1:41782
I20260709 12:23:34.126195 25847 tablet_copy_service.cc:434] P 5cccf20a8bff46dba6601f241d172b8a: ending tablet copy session a866ff967d964388a6f0dff7fd43df89-2a278e46eb5d49edab4ba69303448a66 on tablet 2a278e46eb5d49edab4ba69303448a66 with peer a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:34.142930 26436 raft_consensus.cc:1217] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:23:34.200712 26436 raft_consensus.cc:1217] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:23:34.208600 26436 raft_consensus.cc:1217] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 5 LEARNER]: Deduplicated request from leader. Original: 5.5->[5.6-5.6]   Dedup: 5.6->[]
I20260709 12:23:34.233212 25680 raft_consensus.cc:1275] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:34.234850 27160 consensus_queue.cc:1048] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:34.248764 25829 raft_consensus.cc:1275] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:34.250560 27349 consensus_queue.cc:1048] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:34.440116 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:34.465734 26436 raft_consensus.cc:1275] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:23:34.467659 27376 consensus_queue.cc:1048] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:34.475327 25680 raft_consensus.cc:1275] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:23:34.477505 27363 consensus_queue.cc:1048] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:34.727061 27293 raft_consensus.cc:1064] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a: attempting to promote NON_VOTER a866ff967d964388a6f0dff7fd43df89 to VOTER
I20260709 12:23:34.729766 27293 consensus_queue.cc:237] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:34.813051 27376 raft_consensus.cc:1064] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a: attempting to promote NON_VOTER a866ff967d964388a6f0dff7fd43df89 to VOTER
I20260709 12:23:34.817087 27376 consensus_queue.cc:237] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:23:35.577194 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:35.577770 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:35.585640 27461 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:35.586195 27461 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:35.589586 27461 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:35.590981 27467 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:35.591113 27456 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:35.591544 27467 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:35.591598 27456 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:35.593631 27467 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:35.593632 27456 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:35.594533 27464 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:35.595058 27464 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:35.597123 27464 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:35.597635 27464 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:35.598147 27464 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:35.601471 27464 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:35.604278 27464 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:35.604619 27466 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:35.604822 27464 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:35.605557 27466 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:35.607264 27464 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:35.610212 27461 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:35.611083 27466 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:35.611001 27461 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:35.615985 27461 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:35.623026 27466 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:35.623538 27466 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:35.626371 27466 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:23:35.641306 27376 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.000s	sys 0.003s
W20260709 12:23:35.647738 27376 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.000s	sys 0.004s
I20260709 12:23:35.689201 27472 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:35.694212 27472 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:35.695986 27459 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:35.697242 27459 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:35.697816 27462 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:35.698882 27462 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:35.700981 27459 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:35.716158 27466 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:35.719770 27466 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:35.720418 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:35.718672 27468 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:35.723803 27466 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:35.734203 27460 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:35.734997 27472 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:35.735216 27471 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:35.735414 27460 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:35.736366 27471 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:35.740545 27460 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:35.740300 27468 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:35.741321 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:35.743710 27468 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:35.739477 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:35.735038 27462 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:35.746048 26439 raft_consensus.cc:2468] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 2.
I20260709 12:23:35.764207 27469 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:35.765219 27469 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:35.765774 27467 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:35.766542 27467 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:35.769236 27467 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:35.739683 27471 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:35.771440 27469 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:35.759677 27459 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:35.772575 27459 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:35.784404 27467 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:35.785418 27467 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:35.787843 25761 raft_consensus.cc:1275] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:23:35.789355 27465 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:35.790267 27467 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:35.792914 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:35.793269 27463 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:35.794088 27463 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:35.790505 27465 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:35.798261 27376 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:35.798875 27465 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:23:35.800796 25801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:35.801501 25801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:35.803905 27456 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:35.804143 27474 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:35.804672 27463 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:35.804814 27456 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:23:35.807282 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 82492.7us
I20260709 12:23:35.810549 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:35.811323 25760 raft_consensus.cc:2468] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 2.
I20260709 12:23:35.816841 27471 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:35.805047 27474 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:35.817646 27471 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:35.820302 27474 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:35.821345 27471 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:35.821731 27456 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:35.822469 27459 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:35.799108 27376 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:35.824383 27463 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:35.826597 27463 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:35.829537 27463 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:35.829811 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:35.831877 25726 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:35.833386 27477 raft_consensus.cc:2804] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:35.833884 27477 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:35.834391 27477 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:35.834595 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:35.841635 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:35.842391 27463 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:35.842722 27465 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:35.843387 27463 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:35.824488 27456 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:35.853466 27476 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:35.854241 27471 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:35.855019 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:35.855360 27471 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:35.856516 27456 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:35.862474 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:35.833853 27376 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:35.859558 27471 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:35.867228 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:35.869755 27464 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:35.870616 27464 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:35.873566 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:35.874778 25754 raft_consensus.cc:2468] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 1.
W20260709 12:23:35.874794 27293 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.140s	user 0.015s	sys 0.015s
W20260709 12:23:35.876729 27293 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.142s	user 0.017s	sys 0.016s
I20260709 12:23:35.877025 27464 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:35.862475 27463 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:35.850749 27465 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:35.882031 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:35.855036 27476 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:35.893406 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:35.893689 27476 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:35.894510 27476 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:35.895546 27479 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:35.896322 27479 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:35.898586 27479 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:35.899257 27464 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
W20260709 12:23:35.899775 25802 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.068s	user 0.001s	sys 0.011s
W20260709 12:23:35.901407 25802 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.070s	user 0.002s	sys 0.011s
I20260709 12:23:35.900061 27464 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:35.901664 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:35.905442 26437 raft_consensus.cc:1275] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 5 LEARNER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:23:35.895267 27476 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:35.908735 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:35.923200 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:35.924101 25760 raft_consensus.cc:2468] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 1.
I20260709 12:23:35.928643 26401 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:35.940121 27481 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:35.923156 27464 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:35.942317 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:35.944898 25754 raft_consensus.cc:2468] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 1.
I20260709 12:23:35.929046 27293 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:35.952644 27463 raft_consensus.cc:1064] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc: attempting to promote NON_VOTER a866ff967d964388a6f0dff7fd43df89 to VOTER
I20260709 12:23:35.963091 26437 raft_consensus.cc:1275] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEARNER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:23:35.964180 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:35.965070 26439 raft_consensus.cc:2468] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 2.
I20260709 12:23:35.955644 27456 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:35.963097 27463 consensus_queue.cc:237] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:35.969259 27461 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:35.970029 27461 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:35.973536 27470 raft_consensus.cc:2804] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:35.973961 27461 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:35.974086 27470 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:35.974637 27470 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:35.956907 27471 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:35.988615 27475 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:35.989387 27475 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:35.991348 27475 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:35.984827 27456 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:35.995257 27456 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:36.000257 27471 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:23:36.000322 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:36.002607 27471 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349)
I20260709 12:23:36.004014 25581 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52974 (request call id 229) took 1405 ms. Trace:
I20260709 12:23:36.004449 25581 rpcz_store.cc:276] 0709 12:23:34.586418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:34.586732 (+   314us) service_pool.cc:224] Handling call
0709 12:23:35.991755 (+1405023us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
W20260709 12:23:36.008965 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 47712.9us
I20260709 12:23:36.011860 27465 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:36.012599 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:35.960742 27464 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:36.009771 27293 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:36.017212 27479 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:36.021698 27465 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:36.022359 27465 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:36.023068 25801 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:36.022377 27376 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:36.024906 27376 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:36.023844 27484 consensus_queue.cc:1048] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:36.026893 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:36.027204 27465 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:36.021385 27479 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:36.029356 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:36.027897 27459 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:35.949952 27481 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:35.980563 27477 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:23:36.033862 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 105312us
I20260709 12:23:36.032984 27293 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:23:36.036926 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:36.037509 27293 raft_consensus.cc:2804] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:36.037879 27293 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:36.038205 27293 raft_consensus.cc:3060] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:36.040257 27376 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:36.041546 27456 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:36.041783 27461 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:36.042395 27461 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:36.043709 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:36.045238 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:36.045568 27459 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:36.046525 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:36.048029 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:36.031070 27464 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:36.048276 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:36.053058 27461 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:36.054275 27459 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:36.054983 27476 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:36.051723 27464 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:36.055845 25760 raft_consensus.cc:1240] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:36.057482 27481 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:36.058374 27483 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
W20260709 12:23:36.059217 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 69567.4us
I20260709 12:23:36.059118 27483 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:36.061440 27474 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:36.036345 27465 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:36.062215 27474 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:36.062372 27465 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:36.069600 26401 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:36.080693 27477 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:36.082484 26401 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:36.085553 27293 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:36.087087 27405 raft_consensus.cc:2804] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:36.087539 27405 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:36.087553 27459 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:36.088084 27405 raft_consensus.cc:3060] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:36.087610 27434 raft_consensus.cc:2804] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:36.089409 27434 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:36.089547 27479 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:36.089818 27434 raft_consensus.cc:3060] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:36.091138 27483 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:36.088353 27459 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:36.096654 27474 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:36.097909 27459 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:36.098206 27465 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:36.095288 27470 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:36.107446 27293 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:23:36.108218 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 85284.7us
I20260709 12:23:36.103088 27434 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:36.109054 27483 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:36.109511 27462 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:36.116436 27460 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:36.116839 27462 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:36.117328 27460 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:36.115669 27405 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:36.121551 27462 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:36.119292 27460 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:36.116436 27483 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:36.119810 27405 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:36.114867 27484 consensus_queue.cc:1048] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:36.125635 27463 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:36.126361 27463 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:36.127220 27483 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:36.114324 27465 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:36.128252 27465 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:23:36.113555 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 197702us
I20260709 12:23:36.112250 27485 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:36.129637 27485 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:36.123235 25800 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:36.124208 27434 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:36.115754 27470 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:36.137238 25829 raft_consensus.cc:1240] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:36.138253 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:36.138648 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:36.138898 25754 raft_consensus.cc:2468] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 1.
I20260709 12:23:36.139206 25829 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 2.
I20260709 12:23:36.140393 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:36.140411 27486 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:36.141878 27486 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:36.144520 27486 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:36.145283 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:36.145890 25760 raft_consensus.cc:3060] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:36.149164 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:36.149946 25762 raft_consensus.cc:2393] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 3: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:23:36.129222 27459 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:36.154397 27485 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:36.154121 27459 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:36.155138 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:36.155711 25754 raft_consensus.cc:3060] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:36.157248 27459 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:36.153532 27465 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:36.157763 27463 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:36.166880 27465 raft_consensus.cc:2749] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:36.168375 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:36.168514 27475 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:36.169044 26438 raft_consensus.cc:3060] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:36.169471 25800 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:23:36.169176 27475 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:36.171500 27475 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:36.172497 27487 raft_consensus.cc:2804] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:36.172938 27487 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:36.173324 27487 raft_consensus.cc:3060] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:36.176334 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:36.177129 27489 consensus_queue.cc:1048] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 12:23:36.180281 27460 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:36.180954 27460 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:36.182005 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:36.182268 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:36.182942 25828 raft_consensus.cc:2468] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 1.
I20260709 12:23:36.183619 27460 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:36.183960 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:36.184212 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:36.185663 27481 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:36.186277 27481 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:36.187036 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:36.187312 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:36.187645 25828 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 4.
I20260709 12:23:36.188616 27481 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:36.188723 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:36.189493 25837 raft_consensus.cc:2468] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 1.
I20260709 12:23:36.189675 25760 raft_consensus.cc:2468] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 2.
I20260709 12:23:36.191385 25837 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3767151a5d4345659810a40ea7f44873"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "f82778701b464892aab92a752ed7ffdc"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:23:36.193923 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:36.194332 25837 raft_consensus.cc:606] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Received request to transfer leadership to TS f82778701b464892aab92a752ed7ffdc
I20260709 12:23:36.194628 25833 raft_consensus.cc:2468] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 1.
W20260709 12:23:36.196225 24539 debug-util.cc:398] Leaking SignalData structure 0x7b080000f160 after lost signal to thread 25802
I20260709 12:23:36.196439 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:36.199396 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:36.215313 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:36.216059 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:36.216133 25760 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
mode: GRACEFUL
new_leader_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:48134
I20260709 12:23:36.217360 25760 raft_consensus.cc:606] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Received request to transfer leadership to TS 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:23:36.220228 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:23:36.222265 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:36.223562 25754 raft_consensus.cc:2468] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 2.
I20260709 12:23:36.222205 26438 raft_consensus.cc:2468] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 3.
I20260709 12:23:36.232226 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:36.232697 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:36.233091 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:36.233717 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:36.232436 26435 raft_consensus.cc:1240] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:36.235456 27491 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:36.237406 26402 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:36.239059 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:36.232484 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:36.240500 26402 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:36.240669 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:36.245425 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:36.244899 27489 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:36.247668 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:36.247776 27489 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:36.247058 25762 raft_consensus.cc:1275] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:23:36.247071 26436 raft_consensus.cc:2393] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 2: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:23:36.250121 27489 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:36.250559 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:36.250720 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:36.246162 26401 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:36.261075 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:36.243726 27470 raft_consensus.cc:2749] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:36.260210 27434 raft_consensus.cc:2804] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:36.265209 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:36.266938 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:36.269017 25726 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:23:36.273104 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:36.273775 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:36.271333 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:36.265586 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:36.266490 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:36.275461 25757 raft_consensus.cc:2468] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 1.
I20260709 12:23:36.276116 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:36.271807 26401 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:36.277369 26401 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:36.278137 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:36.268954 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:36.279350 27405 raft_consensus.cc:2804] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:36.272435 27434 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:36.269570 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:36.280000 27405 raft_consensus.cc:697] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:23:36.280205 27434 raft_consensus.cc:3060] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:36.281137 27405 consensus_queue.cc:237] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:36.282050 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:36.283064 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:36.276477 25836 raft_consensus.cc:1275] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:36.283788 27485 raft_consensus.cc:2804] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:36.284368 27485 raft_consensus.cc:697] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:23:36.270145 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:36.285522 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:36.285282 27485 consensus_queue.cc:237] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:36.286209 25833 raft_consensus.cc:2393] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 3: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:23:36.286108 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:36.243391 27491 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:36.292407 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:36.291551 27460 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:36.291630 27495 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:36.297832 27486 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:36.298014 27468 raft_consensus.cc:2804] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:36.264410 25801 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:36.298630 27468 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:36.293234 27462 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:36.298074 27495 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:36.301354 27468 raft_consensus.cc:3060] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:36.301509 27462 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:36.301893 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:36.303102 25726 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:36.304646 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:36.263906 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:36.294970 25760 raft_consensus.cc:1240] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:36.298444 27486 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:36.314925 27495 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:36.315630 27462 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:36.317905 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:36.327436 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:36.301522 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:36.292398 27492 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:36.342628 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:36.343211 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:36.304379 27481 raft_consensus.cc:2804] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:23:36.402280 25615 debug-util.cc:398] Leaking SignalData structure 0x7b080003e2e0 after lost signal to thread 24537
I20260709 12:23:36.403141 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:36.399542 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:36.400123 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:36.370285 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:36.400856 27293 consensus_queue.cc:1048] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:36.401891 27490 raft_consensus.cc:2749] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:23:36.408207 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 113620us
I20260709 12:23:36.405750 25800 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
W20260709 12:23:36.403491 25615 debug-util.cc:398] Leaking SignalData structure 0x7b0800035280 after lost signal to thread 25618
I20260709 12:23:36.327819 27467 raft_consensus.cc:2749] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:36.396540 27486 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:36.411861 27293 raft_consensus.cc:2804] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:36.417004 27293 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:36.417421 27293 raft_consensus.cc:3060] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:36.417560 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:36.417795 26432 raft_consensus.cc:1275] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:36.342839 27491 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:23:36.424526 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:36.403136 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:36.409854 27481 raft_consensus.cc:697] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 3 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:36.426368 27487 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:36.446417 27487 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:36.413154 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:36.451563 25830 raft_consensus.cc:1240] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:36.452823 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:23:36.432660 25615 debug-util.cc:398] Leaking SignalData structure 0x7b0800113920 after lost signal to thread 25711
I20260709 12:23:36.434202 27468 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:36.435472 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:36.464080 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:36.440644 25754 raft_consensus.cc:1240] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:36.412024 27474 consensus_queue.cc:1059] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:23:36.466017 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:36.466650 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:36.469650 27474 raft_consensus.cc:3055] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:36.470146 27474 raft_consensus.cc:740] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:36.472718 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:36.369553 27494 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:36.406293 27492 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:36.447379 25726 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:23:36.458794 25801 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:36.478052 27293 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:36.371286 27460 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:36.475994 27494 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:36.487450 27468 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:36.488425 27494 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:36.471149 27474 consensus_queue.cc:260] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:23:36.493664 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 76652.5us
I20260709 12:23:36.493991 27474 raft_consensus.cc:3060] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:36.494501 25726 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:23:36.496243 27468 raft_consensus.cc:2804] T 43b78aa0054b4da398a8fc04d12454a7 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:36.496696 27468 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:36.496281 27464 raft_consensus.cc:2804] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:36.497139 27468 raft_consensus.cc:3060] T 43b78aa0054b4da398a8fc04d12454a7 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:36.495985 27487 raft_consensus.cc:2749] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:36.497438 27464 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:36.507794 27293 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:36.513396 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:36.502210 27464 raft_consensus.cc:3060] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:23:36.520965 25615 debug-util.cc:398] Leaking SignalData structure 0x7b08001df220 after lost signal to thread 25787
I20260709 12:23:36.521169 26437 raft_consensus.cc:1240] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEADER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 1. Current term is 2. Ops: []
W20260709 12:23:36.522327 25615 debug-util.cc:398] Leaking SignalData structure 0x7b08001db800 after lost signal to thread 25861
W20260709 12:23:36.523581 25615 debug-util.cc:398] Leaking SignalData structure 0x7b0800378ac0 after lost signal to thread 26463
I20260709 12:23:36.524184 25650 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:23:36.524911 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 115842us
I20260709 12:23:36.526250 27463 raft_consensus.cc:2804] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:36.526659 27463 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:36.527074 27463 raft_consensus.cc:3060] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:23:36.543270 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:36.551689 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 51083us
I20260709 12:23:36.559365 25650 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:36.564766 25649 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:36.565886 27459 raft_consensus.cc:2749] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:36.565706 27468 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:36.567868 27468 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:23:36.565747 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 58939.8us
I20260709 12:23:36.568060 27495 raft_consensus.cc:2804] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:36.572640 25649 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:36.573818 25759 raft_consensus.cc:1240] T 43b78aa0054b4da398a8fc04d12454a7 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:36.552627 27434 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:36.577209 27434 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:36.578254 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:36.590258 27460 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:36.592200 27475 raft_consensus.cc:2749] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:36.593550 25649 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:36.594305 27491 raft_consensus.cc:2749] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:36.532793 27481 consensus_queue.cc:237] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:23:36.604512 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:36.607295 26402 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:36.607844 25649 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:36.612483 25649 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:36.614172 27491 raft_consensus.cc:2749] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:36.614912 27491 consensus_queue.cc:1059] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:36.615834 27486 raft_consensus.cc:3055] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:36.616122 27460 raft_consensus.cc:2749] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:36.616206 27486 raft_consensus.cc:740] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:36.616828 27405 raft_consensus.cc:2749] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:36.575034 27495 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:36.639341 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:36.623639 25649 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:36.617199 27486 consensus_queue.cc:260] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:36.629148 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:36.641693 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:36.642014 27495 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:36.642151 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:36.642292 25682 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 6.
I20260709 12:23:36.642758 25677 raft_consensus.cc:2468] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 1.
I20260709 12:23:36.643885 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:36.631805 27492 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:36.632530 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:36.585207 27494 consensus_queue.cc:1048] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 12:23:36.646605 27486 raft_consensus.cc:3060] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:36.647529 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:36.638028 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:36.640762 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:36.651327 25837 raft_consensus.cc:3060] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:36.641469 27491 consensus_queue.cc:1059] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:23:36.630620 27462 consensus_queue.cc:1059] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:36.644379 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:36.634835 25583 catalog_manager.cc:5697] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 1 to 2, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 2 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:36.650992 25649 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:36.645010 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:36.630340 27487 raft_consensus.cc:2955] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 5 LEADER]: Committing config change with OpId 5.7: config changed from index 6 to 7, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:36.652073 27494 raft_consensus.cc:2749] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:36.579903 27464 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:36.654973 25583 catalog_manager.cc:5697] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 1 to 2, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 2 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:36.654449 25761 raft_consensus.cc:2955] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:36.663012 27491 raft_consensus.cc:3055] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:36.663411 27491 raft_consensus.cc:740] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:36.665190 27462 raft_consensus.cc:3055] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:36.665616 27462 raft_consensus.cc:740] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:36.672438 27462 consensus_queue.cc:260] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:36.660079 27501 raft_consensus.cc:993] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8: : Instructing follower 5cccf20a8bff46dba6601f241d172b8a to start an election
I20260709 12:23:36.675311 27501 raft_consensus.cc:1081] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Signalling peer 5cccf20a8bff46dba6601f241d172b8a to start an election
I20260709 12:23:36.677515 27475 raft_consensus.cc:2749] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:36.664191 27491 consensus_queue.cc:260] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:36.679247 27491 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:36.641717 27483 raft_consensus.cc:2955] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:36.684511 25681 raft_consensus.cc:2468] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 3.
I20260709 12:23:36.685972 27462 raft_consensus.cc:3060] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:36.691666 25649 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:36.693300 25649 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:36.693323 25650 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:36.697872 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:36.698240 27475 raft_consensus.cc:2749] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:36.699119 27474 raft_consensus.cc:2749] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:36.659236 25763 raft_consensus.cc:2955] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 6 to 7, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:36.700675 27494 raft_consensus.cc:1064] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc: attempting to promote NON_VOTER a866ff967d964388a6f0dff7fd43df89 to VOTER
I20260709 12:23:36.700501 27463 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:36.702587 27463 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:36.702713 27492 consensus_queue.cc:1048] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:36.703320 27494 consensus_queue.cc:237] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:36.707792 25650 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:36.708613 27474 raft_consensus.cc:2749] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:36.685359 27464 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:36.714967 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:36.709461 25649 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:36.720919 25649 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:36.713110 27463 raft_consensus.cc:2749] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:36.721823 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:36.725041 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:36.725411 26430 raft_consensus.cc:1240] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:36.722165 26437 raft_consensus.cc:2955] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:36.711992 25837 raft_consensus.cc:2468] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 2.
I20260709 12:23:36.726128 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:36.725641 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:36.727622 25649 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:36.728505 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:36.726253 26435 raft_consensus.cc:1240] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEADER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:36.732895 25649 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:36.733255 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:36.734139 25761 raft_consensus.cc:1275] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:36.735329 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:36.736586 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:36.736176 25726 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:23:36.738312 26402 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:23:36.739400 26402 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:23:36.744736 27434 raft_consensus.cc:2804] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:36.745141 27434 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:36.745587 27434 raft_consensus.cc:3060] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:36.745797 27495 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:36.732761 27459 raft_consensus.cc:2749] T 8dcbaf690aa54e4887d08b85cec29701 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:36.731707 27492 raft_consensus.cc:2749] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:36.749861 26402 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:36.732506 27474 raft_consensus.cc:2749] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:36.756650 27471 raft_consensus.cc:2749] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:36.761335 26402 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:23:36.762091 27471 raft_consensus.cc:2764] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:23:36.763450 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:36.763139 25582 catalog_manager.cc:5697] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 2 to 3, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 3 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:36.745208 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:36.740450 27463 raft_consensus.cc:2749] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:36.751801 27477 raft_consensus.cc:2804] T 43b78aa0054b4da398a8fc04d12454a7 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:36.766920 25650 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:36.772347 27503 consensus_queue.cc:1048] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:23:36.773891 25835 raft_consensus.cc:1240] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260709 12:23:36.775692 27459 raft_consensus.cc:2749] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:36.777630 27477 raft_consensus.cc:697] T 43b78aa0054b4da398a8fc04d12454a7 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:36.777678 27463 consensus_queue.cc:1059] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:36.778157 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:36.778836 27463 raft_consensus.cc:3055] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:36.779234 27463 raft_consensus.cc:740] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:36.778729 27477 consensus_queue.cc:237] T 43b78aa0054b4da398a8fc04d12454a7 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:36.780030 27463 consensus_queue.cc:260] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:36.767575 27475 consensus_queue.cc:1059] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:23:36.781091 27463 raft_consensus.cc:3060] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:36.781163 27475 consensus_queue.cc:1243] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer a866ff967d964388a6f0dff7fd43df89 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:23:36.781863 27475 raft_consensus.cc:3055] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:36.782197 27475 raft_consensus.cc:740] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:36.783159 27475 consensus_queue.cc:260] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:36.768177 25584 catalog_manager.cc:5697] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:36.748466 25832 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:44218
I20260709 12:23:36.786424 25832 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:36.786782 25832 raft_consensus.cc:3060] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:36.750448 27405 raft_consensus.cc:2804] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:36.792240 27405 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:36.763181 26402 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:36.747852 27495 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:36.793411 27405 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:36.802690 27480 raft_consensus.cc:2749] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:36.803162 25828 raft_consensus.cc:1275] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:23:36.804778 27475 raft_consensus.cc:3060] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:36.805236 26431 raft_consensus.cc:1275] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 2 LEARNER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:23:36.808090 27492 consensus_queue.cc:1048] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:23:36.817842 25650 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:36.828591 25761 raft_consensus.cc:1275] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:36.820396 27492 raft_consensus.cc:2749] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:23:36.830523 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 97715.5us
I20260709 12:23:36.844030 25649 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:36.831372 27471 consensus_queue.cc:1048] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:23:36.833393 27491 consensus_queue.cc:1048] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:23:36.859973 25681 raft_consensus.cc:1275] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:36.877748 27434 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:23:36.879345 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 45699.1us
I20260709 12:23:36.879889 27434 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349)
I20260709 12:23:36.880789 25649 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:36.882499 26434 raft_consensus.cc:1240] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:36.883337 27494 raft_consensus.cc:2749] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:36.883000 25832 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:36.885392 27494 raft_consensus.cc:2749] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:36.887831 26437 raft_consensus.cc:2955] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 6 to 7, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:36.889496 25683 raft_consensus.cc:1240] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:36.884012 27489 consensus_queue.cc:1059] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:23:36.903262 25680 raft_consensus.cc:1240] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:36.907397 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:36.907488 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:36.908217 25680 raft_consensus.cc:2468] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 3.
I20260709 12:23:36.907765 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:36.912338 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:36.909075 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:36.913972 25686 raft_consensus.cc:2410] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for term 2 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:23:36.917295 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:36.918072 25681 raft_consensus.cc:3060] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:36.891439 27479 consensus_queue.cc:1048] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:23:36.935099 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:36.934974 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:36.936539 25761 raft_consensus.cc:3055] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:36.936856 25761 raft_consensus.cc:740] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:36.945078 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:36.950711 25685 raft_consensus.cc:1275] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:36.945755 25678 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 5.
I20260709 12:23:36.937438 27487 raft_consensus.cc:3055] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:36.953526 27487 raft_consensus.cc:740] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:36.954377 27487 consensus_queue.cc:260] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:36.955591 27487 raft_consensus.cc:3060] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:36.956358 25761 consensus_queue.cc:260] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:36.957386 25761 raft_consensus.cc:3060] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:36.963956 25832 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:36.994004 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:36.994712 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:36.995440 25682 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 2.
I20260709 12:23:36.994768 25677 raft_consensus.cc:2468] T 8dcbaf690aa54e4887d08b85cec29701 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 2.
I20260709 12:23:36.996376 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:36.995774 27405 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:36.998486 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:36.999085 25685 raft_consensus.cc:2468] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 3.
I20260709 12:23:36.999281 27405 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:37.000079 26434 raft_consensus.cc:1240] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 6. Current term is 7. Ops: []
W20260709 12:23:37.002548 27513 log.cc:927] Time spent T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.075s	user 0.004s	sys 0.000s
I20260709 12:23:37.005780 25761 raft_consensus.cc:2468] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 3.
I20260709 12:23:37.020763 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:37.020962 25800 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:23:37.021596 25685 raft_consensus.cc:2468] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 2.
I20260709 12:23:37.021868 27478 raft_consensus.cc:2804] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:37.022375 27478 raft_consensus.cc:697] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 3 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:37.023233 27478 consensus_queue.cc:237] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:23:37.024606 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:37.024863 25681 raft_consensus.cc:2468] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 2.
W20260709 12:23:37.025911 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 65423.4us
I20260709 12:23:37.033286 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:23:37.035686 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:37.040165 27480 consensus_queue.cc:1048] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:37.041093 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:37.041770 25681 raft_consensus.cc:2468] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 2.
I20260709 12:23:37.041486 26402 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:23:37.044384 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:37.044467 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:37.045027 25685 raft_consensus.cc:2468] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 2.
I20260709 12:23:37.045704 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:37.046312 25681 raft_consensus.cc:2468] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 4.
I20260709 12:23:37.050207 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:37.072419 25685 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:37.073604 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:37.074380 26437 raft_consensus.cc:3060] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:37.075973 27465 consensus_queue.cc:1059] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:37.077553 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:37.086386 27376 raft_consensus.cc:3055] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:23:37.086882 27376 raft_consensus.cc:740] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:37.087824 27376 consensus_queue.cc:260] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:37.088994 27376 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:23:37.084573 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 47199.1us
I20260709 12:23:37.098130 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:37.100581 26437 raft_consensus.cc:2468] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 3.
I20260709 12:23:37.072046 27472 raft_consensus.cc:2804] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:37.112152 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:37.112999 25678 raft_consensus.cc:2410] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for term 2 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:23:37.116410 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:37.117455 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:37.118878 27510 raft_consensus.cc:2955] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:37.120007 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:37.119691 25685 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 7.
W20260709 12:23:37.124544 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:37.121953 27472 raft_consensus.cc:697] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:23:37.125702 27472 consensus_queue.cc:237] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:37.138870 25682 raft_consensus.cc:1240] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:37.147262 26431 raft_consensus.cc:1275] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:37.158664 27483 consensus_queue.cc:1048] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:37.163807 26402 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:23:37.171149 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:37.173213 27471 raft_consensus.cc:2804] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:23:37.192498 25832 raft_consensus.cc:2955] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:37.190748 27471 raft_consensus.cc:697] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 7 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:23:37.202770 27471 consensus_queue.cc:237] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:37.212285 25677 raft_consensus.cc:2468] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 3.
I20260709 12:23:37.213352 25828 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 7.
W20260709 12:23:37.239079 25726 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 1.586s (SENT)
I20260709 12:23:37.242878 25686 raft_consensus.cc:1275] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:23:37.242743 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:37.243969 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:37.244519 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:37.245136 25686 raft_consensus.cc:2468] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 2.
I20260709 12:23:37.178486 26434 raft_consensus.cc:2955] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:37.254387 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:37.256830 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:37.257546 25685 raft_consensus.cc:2468] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 3.
I20260709 12:23:37.262223 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:37.275755 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:23:37.300709 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:37.301762 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:37.302642 25685 raft_consensus.cc:2410] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 2 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:23:37.314364 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:37.319080 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:37.319446 25682 raft_consensus.cc:2393] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 5: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:23:37.327539 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:37.329370 25685 raft_consensus.cc:2393] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 3: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:23:37.334445 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:37.337482 25583 catalog_manager.cc:5697] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: config changed from index 6 to 7, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New cstate: current_term: 5 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:23:37.338945 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:37.348697 25583 catalog_manager.cc:5697] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 2 to 3, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 3 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:37.348399 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 109344us
I20260709 12:23:37.357424 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:37.362344 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:37.365576 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:37.372725 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:37.376928 25685 raft_consensus.cc:1240] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:37.394778 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:37.395892 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:37.400822 25828 consensus_queue.cc:237] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:37.401409 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:37.404691 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:37.405928 25583 catalog_manager.cc:5697] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 1 to 2, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 2 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:37.413477 25763 raft_consensus.cc:1275] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:37.437925 25754 raft_consensus.cc:1240] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:37.439038 27478 consensus_queue.cc:1048] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:37.441144 27478 raft_consensus.cc:993] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a: : Instructing follower f82778701b464892aab92a752ed7ffdc to start an election
I20260709 12:23:37.441622 27465 raft_consensus.cc:1081] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Signalling peer f82778701b464892aab92a752ed7ffdc to start an election
I20260709 12:23:37.407889 25583 catalog_manager.cc:5697] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 6 to 7, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 7 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:37.432583 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:37.456486 27501 consensus_queue.cc:1059] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:37.433570 25756 raft_consensus.cc:1275] T 4734c282e09b4bbbb96de8eee61c160a P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:23:37.420580 26434 raft_consensus.cc:1275] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:37.424356 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:37.435488 25682 raft_consensus.cc:2468] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 3.
I20260709 12:23:37.459503 25686 raft_consensus.cc:1275] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:37.435546 27461 consensus_queue.cc:1059] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:23:37.460507 27461 raft_consensus.cc:3055] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:37.460892 27461 raft_consensus.cc:740] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:37.461736 27461 consensus_queue.cc:260] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:37.463127 27461 raft_consensus.cc:3060] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:37.427897 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:37.434926 25829 raft_consensus.cc:1275] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:37.452020 25801 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:37.451377 27478 raft_consensus.cc:2955] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
W20260709 12:23:37.465637 25801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:37.466503 27465 raft_consensus.cc:2749] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:37.467146 27465 consensus_queue.cc:1048] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:37.471823 25829 raft_consensus.cc:1240] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:37.474047 27475 consensus_queue.cc:1059] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:37.422132 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:37.475085 27510 raft_consensus.cc:3055] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:37.475484 27510 raft_consensus.cc:740] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:37.476342 27510 consensus_queue.cc:260] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:37.477403 27510 raft_consensus.cc:3060] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:37.478875 25801 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:37.455452 25754 raft_consensus.cc:2955] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:37.459290 27502 raft_consensus.cc:3055] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:37.487069 27502 raft_consensus.cc:740] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:37.487999 27502 consensus_queue.cc:260] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:37.489254 27502 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:37.490751 27530 raft_consensus.cc:2749] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:37.411949 25832 consensus_queue.cc:237] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:37.484943 25582 catalog_manager.cc:5697] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc reported cstate change: config changed from index 3 to 4, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:37.503047 25801 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:37.504099 27465 raft_consensus.cc:2749] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:37.416309 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:37.517828 25584 catalog_manager.cc:5697] T 43b78aa0054b4da398a8fc04d12454a7 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 1 to 2, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 2 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:37.504276 25801 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:37.533648 27465 raft_consensus.cc:2749] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:37.533281 25801 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:37.535760 25681 raft_consensus.cc:2468] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 2.
I20260709 12:23:37.532114 25755 raft_consensus.cc:1275] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:23:37.536300 27465 raft_consensus.cc:2749] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:23:37.526796 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 64156.2us
I20260709 12:23:37.539770 25569 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8dcbaf690aa54e4887d08b85cec29701 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:37.540153 25582 catalog_manager.cc:5697] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: config changed from index 4 to 5, VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129) evicted. New cstate: current_term: 2 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:37.535672 25801 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:37.541390 27530 consensus_queue.cc:1048] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:37.542455 27487 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:37.542534 25801 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:37.543852 25801 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:37.522105 25762 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 3.
I20260709 12:23:37.550060 27481 raft_consensus.cc:3060] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:37.550792 27487 raft_consensus.cc:2749] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:37.551725 27487 raft_consensus.cc:2749] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:37.569646 26430 raft_consensus.cc:1240] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:37.567057 27293 raft_consensus.cc:2955] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 5 LEADER]: Committing config change with OpId 5.8: config changed from index 7 to 8, VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:37.576560 27494 consensus_queue.cc:1059] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:37.577517 27508 raft_consensus.cc:3055] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:37.577926 27508 raft_consensus.cc:740] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:37.578164 27481 raft_consensus.cc:2749] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:37.555166 25726 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:23:37.567075 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:37.568351 25681 raft_consensus.cc:1275] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 3. (term mismatch)
I20260709 12:23:37.581836 25681 pending_rounds.cc:85] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc: Aborting all ops after (but not including) 2
I20260709 12:23:37.582098 25681 pending_rounds.cc:107] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 12:23:37.579286 25801 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:37.584775 25754 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:53452
I20260709 12:23:37.585486 25754 raft_consensus.cc:606] T 43b78aa0054b4da398a8fc04d12454a7 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Received request to transfer leadership
I20260709 12:23:37.582402 25681 raft_consensus.cc:2917] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 12:23:37.586512 25681 raft_consensus.cc:2889] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:37.587342 25686 raft_consensus.cc:1275] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:37.588802 27503 consensus_queue.cc:1048] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:37.589274 27501 raft_consensus.cc:2804] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:37.589671 27501 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:37.590050 27501 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:37.592206 27508 consensus_queue.cc:260] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:37.593811 27508 raft_consensus.cc:3060] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:37.594777 25762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:53452
I20260709 12:23:37.595394 25762 raft_consensus.cc:606] T 43b78aa0054b4da398a8fc04d12454a7 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Received request to transfer leadership
I20260709 12:23:37.597400 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:37.598160 25682 raft_consensus.cc:2468] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 2.
I20260709 12:23:37.603749 25801 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:37.604585 27489 raft_consensus.cc:2749] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:37.615127 27489 raft_consensus.cc:2749] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:37.615326 25801 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:37.616434 25569 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2a278e46eb5d49edab4ba69303448a66 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:37.618162 27481 raft_consensus.cc:2749] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:37.619837 26430 raft_consensus.cc:2955] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:37.624562 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:37.625604 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:37.622880 25832 raft_consensus.cc:1275] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:37.626338 25685 raft_consensus.cc:2468] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 2.
I20260709 12:23:37.627465 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:37.632997 25754 raft_consensus.cc:1240] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:37.637874 27501 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:37.640872 25676 tablet_service.cc:1558] Processing DeleteTablet for tablet 8dcbaf690aa54e4887d08b85cec29701 with delete_type TABLET_DATA_TOMBSTONED (TS f82778701b464892aab92a752ed7ffdc not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:40214
I20260709 12:23:37.641109 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:37.642170 25649 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:37.643603 25754 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:53452
I20260709 12:23:37.645285 25754 raft_consensus.cc:606] T 43b78aa0054b4da398a8fc04d12454a7 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Received request to transfer leadership
I20260709 12:23:37.645309 25649 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:37.644862 25682 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3767151a5d4345659810a40ea7f44873"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
 from {username='slave'} at 127.0.0.1:40220
I20260709 12:23:37.647020 25682 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:37.645340 27501 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:37.649163 27475 raft_consensus.cc:2749] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:37.650427 25649 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:37.651507 27494 raft_consensus.cc:2749] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:37.650565 27475 raft_consensus.cc:2749] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:37.652441 25682 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:23:37.653877 25632 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:23:37.654347 25632 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 43b78aa0054b4da398a8fc04d12454a7 already in progress
W20260709 12:23:37.654628 25632 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 43b78aa0054b4da398a8fc04d12454a7 already in progress
I20260709 12:23:37.669186 25686 consensus_queue.cc:237] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:37.669925 25754 raft_consensus.cc:1275] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:37.671171 25726 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:23:37.676707 27475 consensus_queue.cc:1059] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:37.685088 27475 raft_consensus.cc:3055] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:37.685460 27475 raft_consensus.cc:740] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:37.686435 27475 consensus_queue.cc:260] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:37.687906 27475 raft_consensus.cc:3060] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:37.677912 25649 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:37.679222 25762 raft_consensus.cc:1240] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:37.680835 27472 consensus_queue.cc:1048] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:37.698276 25649 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:37.700892 25649 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:37.694006 25726 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:23:37.702376 25649 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:23:37.706966 27463 raft_consensus.cc:2749] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:37.707199 27483 consensus_queue.cc:1059] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:37.707507 27489 consensus_queue.cc:1048] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:37.708076 27483 raft_consensus.cc:3055] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:23:37.708432 27483 raft_consensus.cc:740] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:37.708920 27461 raft_consensus.cc:2804] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:37.709379 27494 raft_consensus.cc:2749] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:37.709265 27483 consensus_queue.cc:260] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:37.709296 27461 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:37.707686 27510 raft_consensus.cc:2804] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:37.710887 27461 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:37.711057 27510 raft_consensus.cc:697] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:37.706157 25682 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:37.710510 27483 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:37.710443 25726 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:23:37.732223 27502 raft_consensus.cc:2804] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:37.732959 27502 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:37.733521 27502 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:37.738052 25681 raft_consensus.cc:1275] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:23:37.731966 25833 raft_consensus.cc:1275] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:23:37.724025 27510 consensus_queue.cc:237] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:37.740113 27503 consensus_queue.cc:1048] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:23:37.740605 26434 raft_consensus.cc:1275] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:23:37.742456 25726 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:23:37.744138 25726 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:37.712623 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:37.750790 25726 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:37.755344 27468 raft_consensus.cc:2749] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:37.756762 27477 raft_consensus.cc:2804] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:37.775317 27477 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:37.775907 27477 raft_consensus.cc:3060] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:37.776192 25682 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:37.759789 25834 raft_consensus.cc:1275] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:37.760385 26431 raft_consensus.cc:1275] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:37.767681 26434 raft_consensus.cc:1275] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:37.764410 27476 consensus_queue.cc:1048] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:23:37.765347 27461 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:37.764451 25584 catalog_manager.cc:5697] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: config changed from index 7 to 8, VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129) evicted. New cstate: current_term: 5 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:37.770174 25726 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:37.699033 27508 raft_consensus.cc:2749] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:23:37.774509 27509 raft_consensus.cc:2764] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:23:37.699245 27501 raft_consensus.cc:2804] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:23:37.785852 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 80807.4us
I20260709 12:23:37.789080 27509 raft_consensus.cc:2764] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:23:37.788902 27501 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:37.798592 27501 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:37.799865 27494 consensus_queue.cc:1048] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:37.791906 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:37.802568 25755 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:37.802719 25801 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:37.794588 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:37.803841 25833 raft_consensus.cc:3055] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:37.804262 25833 raft_consensus.cc:740] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:37.789501 25726 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:23:37.807134 27293 raft_consensus.cc:2749] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:37.809391 25801 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:37.811491 25833 consensus_queue.cc:260] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:37.814062 27487 consensus_queue.cc:1048] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:37.814073 27463 consensus_queue.cc:1048] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:37.809679 25726 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:37.820086 25682 raft_consensus.cc:1240] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:37.839033 27293 raft_consensus.cc:2804] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:37.839618 27293 raft_consensus.cc:697] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 2 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:37.841739 25833 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:37.842334 25801 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:37.848657 25676 tablet_service.cc:1558] Processing DeleteTablet for tablet 2a278e46eb5d49edab4ba69303448a66 with delete_type TABLET_DATA_TOMBSTONED (TS f82778701b464892aab92a752ed7ffdc not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:40214
I20260709 12:23:37.851231 27293 consensus_queue.cc:237] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:37.846700 27461 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:37.884014 27461 raft_consensus.cc:2749] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:37.884277 27477 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:37.887231 27477 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:37.889269 27539 tablet_replica.cc:333] T 8dcbaf690aa54e4887d08b85cec29701 P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
I20260709 12:23:37.890686 27502 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:37.893030 27502 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:37.911224 25833 raft_consensus.cc:2468] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 5.
I20260709 12:23:37.867528 27481 raft_consensus.cc:2749] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:37.913281 25650 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:37.973905 27463 raft_consensus.cc:2804] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:23:37.986088 27518 log.cc:927] Time spent T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:23:37.996251 27503 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:38.036561 27539 raft_consensus.cc:2243] T 8dcbaf690aa54e4887d08b85cec29701 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:38.037415 27539 raft_consensus.cc:2272] T 8dcbaf690aa54e4887d08b85cec29701 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:38.038386 25583 catalog_manager.cc:5697] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 2 to 3, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 3 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:38.020975 27463 raft_consensus.cc:697] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 5 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:38.047426 25755 raft_consensus.cc:2468] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 5.
I20260709 12:23:38.057057 27539 ts_tablet_manager.cc:1916] T 8dcbaf690aa54e4887d08b85cec29701 P f82778701b464892aab92a752ed7ffdc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:23:38.057873 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:38.065946 27501 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:38.048128 27509 raft_consensus.cc:2764] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 12:23:38.106563 27547 log.cc:927] Time spent T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 12:23:38.110906 25762 raft_consensus.cc:1240] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 2. Current term is 3. Ops: []
W20260709 12:23:38.123348 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:38.042995 27503 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:23:38.138772 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 329177us
I20260709 12:23:38.139734 25726 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:38.146735 25726 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:38.155666 25726 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:38.091068 27463 consensus_queue.cc:237] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:38.158422 25726 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
W20260709 12:23:38.165928 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 297503us
I20260709 12:23:38.140870 27549 raft_consensus.cc:2749] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:38.173834 25762 raft_consensus.cc:1240] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:38.160022 27502 raft_consensus.cc:2749] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:38.177984 27501 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:38.166685 27468 raft_consensus.cc:2804] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:38.178870 25829 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "f82778701b464892aab92a752ed7ffdc"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:23:38.185618 25829 raft_consensus.cc:606] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 3 LEADER]: Received request to transfer leadership to TS f82778701b464892aab92a752ed7ffdc
I20260709 12:23:38.160472 27548 raft_consensus.cc:2749] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:38.181028 27555 consensus_queue.cc:1048] T 43b78aa0054b4da398a8fc04d12454a7 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:38.184715 25762 raft_consensus.cc:1240] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:38.180655 25726 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:38.189601 25726 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:38.190246 27477 raft_consensus.cc:2749] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:38.190783 27555 raft_consensus.cc:2749] T 4734c282e09b4bbbb96de8eee61c160a P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:38.163100 27483 consensus_queue.cc:1059] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 12:23:38.199680 27503 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:38.205874 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:38.206063 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:38.207237 25677 raft_consensus.cc:2393] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 2: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:23:38.208261 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:38.212815 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:38.215183 27555 consensus_queue.cc:1048] T 43b78aa0054b4da398a8fc04d12454a7 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:38.217005 25834 raft_consensus.cc:1240] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:38.218276 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:38.218544 27376 consensus_queue.cc:1059] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:38.226511 27483 raft_consensus.cc:3055] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:38.226967 27483 raft_consensus.cc:740] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:38.227828 27483 consensus_queue.cc:260] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:38.228374 27376 raft_consensus.cc:3055] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:38.228925 27376 raft_consensus.cc:740] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:38.229044 27483 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:38.230006 27376 consensus_queue.cc:260] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:38.231365 27376 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:38.237063 27487 consensus_queue.cc:1048] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
W20260709 12:23:38.243463 27550 log.cc:927] Time spent T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.133s	user 0.000s	sys 0.002s
W20260709 12:23:38.250231 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 46992.3us
I20260709 12:23:38.256186 25837 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 6.
I20260709 12:23:38.264410 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:38.276531 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:38.279953 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:38.299479 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:38.305864 25582 catalog_manager.cc:5697] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 1 to 2, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 2 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:38.326108 27510 raft_consensus.cc:2955] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:38.348719 25836 raft_consensus.cc:2468] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 4.
I20260709 12:23:38.352840 25726 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:23:38.357533 25726 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:38.354821 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:38.349854 27468 raft_consensus.cc:697] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:38.368906 27563 raft_consensus.cc:2749] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:38.310420 27530 consensus_queue.cc:1059] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:23:38.360324 27509 raft_consensus.cc:2804] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:23:38.382387 27509 raft_consensus.cc:697] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:38.383476 27509 consensus_queue.cc:237] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:38.371631 27468 consensus_queue.cc:237] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:38.398975 25836 raft_consensus.cc:1275] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:38.395109 25831 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 3.
I20260709 12:23:38.397490 25830 raft_consensus.cc:2955] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:38.412451 25762 raft_consensus.cc:1275] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:38.415717 27508 consensus_queue.cc:1048] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:38.418198 27508 consensus_queue.cc:1048] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:38.423362 25762 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
mode: GRACEFUL
new_leader_uuid: "f82778701b464892aab92a752ed7ffdc"
 from {username='slave'} at 127.0.0.1:48134
I20260709 12:23:38.424155 25762 raft_consensus.cc:606] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Received request to transfer leadership to TS f82778701b464892aab92a752ed7ffdc
I20260709 12:23:38.424604 25762 raft_consensus.cc:614] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:38.375398 27376 raft_consensus.cc:3055] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:23:38.439016 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 133082us
I20260709 12:23:38.457649 25677 raft_consensus.cc:1275] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:38.433393 27376 raft_consensus.cc:740] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:38.487437 27548 raft_consensus.cc:993] T 43b78aa0054b4da398a8fc04d12454a7 P 6e673265293d4e9a937dc45150aeb1b8: : Instructing follower f82778701b464892aab92a752ed7ffdc to start an election
I20260709 12:23:38.488060 27548 raft_consensus.cc:1081] T 43b78aa0054b4da398a8fc04d12454a7 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Signalling peer f82778701b464892aab92a752ed7ffdc to start an election
I20260709 12:23:38.492136 25678 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
 from {username='slave'} at 127.0.0.1:40230
I20260709 12:23:38.526772 25569 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4734c282e09b4bbbb96de8eee61c160a with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:38.500887 27552 consensus_queue.cc:1048] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:23:38.525372 27376 consensus_queue.cc:260] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:38.590270 27376 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:38.618093 27539 ts_tablet_manager.cc:1929] T 8dcbaf690aa54e4887d08b85cec29701 P f82778701b464892aab92a752ed7ffdc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 12:23:38.618693 27539 log.cc:1199] T 8dcbaf690aa54e4887d08b85cec29701 P f82778701b464892aab92a752ed7ffdc: Deleting WAL directory at /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-0-root/wals/8dcbaf690aa54e4887d08b85cec29701
I20260709 12:23:38.631789 25569 catalog_manager.cc:5028] TS f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): tablet 8dcbaf690aa54e4887d08b85cec29701 (table test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]) successfully deleted
I20260709 12:23:38.633083 27539 tablet_replica.cc:333] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
I20260709 12:23:38.639952 25726 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:23:38.641083 25754 raft_consensus.cc:1275] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:38.645599 25726 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:23:38.646389 27509 raft_consensus.cc:2804] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:38.646847 27509 raft_consensus.cc:697] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:38.647698 27509 consensus_queue.cc:237] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:23:38.654215 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 292942us
I20260709 12:23:38.660753 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:38.663878 25678 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:38.672196 25678 raft_consensus.cc:3060] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:38.679718 25582 catalog_manager.cc:5697] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 2 to 3, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 3 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:38.641022 27468 raft_consensus.cc:2804] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:38.716866 27556 consensus_queue.cc:1048] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:23:38.663131 27510 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:38.696952 27571 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:38.718791 27468 raft_consensus.cc:697] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:38.720775 27479 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:38.749713 27553 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:38.749641 27571 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:38.742914 26436 raft_consensus.cc:2955] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:38.727969 27510 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:38.754976 27559 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:38.759894 27578 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
W20260709 12:23:38.817154 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 73606us
W20260709 12:23:38.819710 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 62099.7us
I20260709 12:23:38.827531 25678 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:38.844802 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:23:38.845391 27569 log.cc:927] Time spent T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.071s	user 0.003s	sys 0.000s
I20260709 12:23:38.845667 27578 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:38.846501 27559 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:38.854434 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:38.856033 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:38.849453 26402 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:38.816213 27480 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:38.869403 27560 raft_consensus.cc:2749] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:38.868046 25583 catalog_manager.cc:5697] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 4 to 5, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 5 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:38.757225 27479 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:38.879024 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:38.848551 27559 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:38.847860 27578 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:38.908308 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:38.818856 27553 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:38.898195 26430 raft_consensus.cc:3060] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:38.909145 27539 raft_consensus.cc:2243] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:38.904235 27503 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:38.911626 27510 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:38.875806 27480 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:38.958953 27503 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:38.960160 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:38.965379 25830 raft_consensus.cc:1813] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Handling vote request from an unknown peer f82778701b464892aab92a752ed7ffdc
I20260709 12:23:38.965996 25830 raft_consensus.cc:2393] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 6: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:23:38.968263 27541 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:38.968598 27476 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:38.977936 27476 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:38.979897 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:38.980546 25677 raft_consensus.cc:2468] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 2.
I20260709 12:23:38.982039 27480 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:38.985960 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:38.987690 27503 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:39.005120 25649 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:38.968834 27558 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:39.011724 27589 raft_consensus.cc:2706] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Received pre-election callback for term 6 while not running: Illegal state: RaftConsensus is not running: State = Stopping
I20260709 12:23:39.013087 25678 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:39.017159 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:39.022230 25762 raft_consensus.cc:3055] T 43b78aa0054b4da398a8fc04d12454a7 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:39.022609 25762 raft_consensus.cc:740] T 43b78aa0054b4da398a8fc04d12454a7 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:39.004824 27476 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:39.023509 25762 consensus_queue.cc:260] T 43b78aa0054b4da398a8fc04d12454a7 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:39.029796 25762 raft_consensus.cc:3060] T 43b78aa0054b4da398a8fc04d12454a7 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:39.033382 26430 raft_consensus.cc:1275] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 3. (term mismatch)
I20260709 12:23:39.033816 26430 pending_rounds.cc:85] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89: Aborting all ops after (but not including) 2
I20260709 12:23:39.034138 26430 pending_rounds.cc:107] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 12:23:39.034442 26430 raft_consensus.cc:2917] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 12:23:39.034976 26430 raft_consensus.cc:2889] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:39.058108 26438 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780"
dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
mode: GRACEFUL
new_leader_uuid: "f82778701b464892aab92a752ed7ffdc"
 from {username='slave'} at 127.0.0.1:35548
I20260709 12:23:39.058960 26438 raft_consensus.cc:606] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEADER]: Received request to transfer leadership to TS f82778701b464892aab92a752ed7ffdc
I20260709 12:23:39.027415 27553 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:38.918277 27468 consensus_queue.cc:237] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:39.031474 27539 raft_consensus.cc:2272] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:39.069664 27478 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:39.081310 27478 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:39.080561 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:23:39.084622 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:39.085589 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:23:39.091790 25726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:39.100903 25584 catalog_manager.cc:5697] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: config changed from index 4 to 5, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New cstate: current_term: 2 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:39.067619 27571 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:39.030861 27558 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:39.013360 27541 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:23:39.133759 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 112396us
I20260709 12:23:39.113792 27479 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:39.134816 25681 raft_consensus.cc:1275] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:23:39.133283 26433 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:39.142379 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:39.142717 25755 raft_consensus.cc:1275] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:23:39.132354 27587 log.cc:927] Time spent T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:23:39.142987 25680 raft_consensus.cc:2468] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 2.
I20260709 12:23:39.153172 25801 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:23:39.154299 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 267649us
I20260709 12:23:39.154541 27597 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.138041 25762 raft_consensus.cc:2468] T 43b78aa0054b4da398a8fc04d12454a7 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 3.
I20260709 12:23:39.157472 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:39.157668 25649 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:39.160336 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:39.162962 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:39.165902 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:23:39.167449 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 247461us
I20260709 12:23:39.168179 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:39.176945 27478 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:39.176829 27592 consensus_queue.cc:1048] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 12:23:39.176888 25832 raft_consensus.cc:3060] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:39.178844 27592 raft_consensus.cc:2804] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:39.179386 27592 raft_consensus.cc:697] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
W20260709 12:23:39.180244 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:39.185734 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:23:39.186249 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:39.167541 27489 raft_consensus.cc:2804] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:39.188313 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:39.195643 25754 raft_consensus.cc:2393] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 2: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
W20260709 12:23:39.208896 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 95910us
I20260709 12:23:39.195040 27489 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:39.249354 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:23:39.251179 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 93616.5us
I20260709 12:23:39.254012 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:39.260277 27541 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:39.265169 25726 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:39.250586 27489 raft_consensus.cc:3060] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:39.175213 27597 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:39.301223 26435 raft_consensus.cc:1275] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:23:39.301498 26402 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:39.306381 25837 raft_consensus.cc:1275] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:23:39.314128 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:39.314329 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:39.254525 27592 consensus_queue.cc:237] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:39.320629 26402 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:39.323195 27595 raft_consensus.cc:2804] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:39.304569 27563 raft_consensus.cc:2749] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:39.323591 27578 raft_consensus.cc:993] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89: : Instructing follower f82778701b464892aab92a752ed7ffdc to start an election
I20260709 12:23:39.324112 27578 raft_consensus.cc:1081] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEADER]: Signalling peer f82778701b464892aab92a752ed7ffdc to start an election
I20260709 12:23:39.323594 27595 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:39.325263 27595 raft_consensus.cc:3060] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:39.325301 25832 raft_consensus.cc:2468] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 3.
I20260709 12:23:39.329398 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:39.333401 27562 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.333995 25831 raft_consensus.cc:1275] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 12:23:39.335016 25829 raft_consensus.cc:1275] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:39.341032 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:39.317153 27508 consensus_queue.cc:1048] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 12:23:39.328019 27434 raft_consensus.cc:2749] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:39.365036 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:39.368321 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:39.359025 27477 consensus_queue.cc:1048] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 12:23:39.386883 27605 consensus_queue.cc:1048] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:23:39.333930 27562 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:39.392438 27508 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.412021 27508 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:39.414525 27508 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:39.435745 27597 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:39.437325 27562 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:39.438402 27489 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:23:39.443152 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 106498us
I20260709 12:23:39.445789 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:39.446543 25828 raft_consensus.cc:2468] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 2.
I20260709 12:23:39.447469 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:39.474875 25650 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:39.484835 27463 raft_consensus.cc:2804] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:39.524771 27463 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:39.583391 27478 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.583967 27478 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:39.584452 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:39.586138 25830 raft_consensus.cc:2468] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 2.
I20260709 12:23:39.586205 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:39.587704 25835 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 5.
I20260709 12:23:39.588868 27489 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:39.589926 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:39.590579 25756 raft_consensus.cc:2468] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 2.
I20260709 12:23:39.552397 27463 raft_consensus.cc:3060] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:39.593111 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:39.600811 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:39.541075 26433 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 6.
I20260709 12:23:39.600982 25755 raft_consensus.cc:2468] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 2.
I20260709 12:23:39.611215 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:39.562062 27558 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:23:39.650722 27613 log.cc:927] Time spent T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:23:39.674189 26401 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:39.651393 27595 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:39.717147 27573 raft_consensus.cc:2749] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:23:39.718935 26402 leader_election.cc:343] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Tablet error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:39.721995 26402 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:39.733596 26401 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:39.735405 26401 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:39.738729 26401 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:39.730504 27539 ts_tablet_manager.cc:1916] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:39.740868 26401 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:39.729169 27558 raft_consensus.cc:2749] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:39.743557 26401 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:39.736872 27573 raft_consensus.cc:2749] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:39.742347 27434 raft_consensus.cc:2749] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:39.739430 27472 raft_consensus.cc:2749] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:39.743450 27479 raft_consensus.cc:2749] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:39.746120 27554 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:39.751173 27610 raft_consensus.cc:2749] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:39.751595 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:39.753013 26432 raft_consensus.cc:2468] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 3.
I20260709 12:23:39.752956 27554 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:39.755661 27554 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:39.755591 27595 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:39.757687 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:39.758469 25835 raft_consensus.cc:2468] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 3.
I20260709 12:23:39.759651 26402 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:39.760339 27595 raft_consensus.cc:2804] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:39.760664 27595 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:39.760983 27595 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:39.766753 27463 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:39.769040 27463 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:39.772800 27595 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:39.776103 27595 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:39.778491 27539 ts_tablet_manager.cc:1929] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.6
I20260709 12:23:39.782325 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:39.790969 25828 raft_consensus.cc:2468] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 3.
I20260709 12:23:39.796847 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:39.797504 25830 raft_consensus.cc:3060] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:39.805063 27509 consensus_queue.cc:1048] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:39.806578 27548 consensus_queue.cc:1048] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:39.809135 27602 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:39.809798 27602 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:39.811563 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:39.812335 25762 raft_consensus.cc:2393] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 2: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:23:39.778957 27539 log.cc:1199] T 2a278e46eb5d49edab4ba69303448a66 P f82778701b464892aab92a752ed7ffdc: Deleting WAL directory at /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-0-root/wals/2a278e46eb5d49edab4ba69303448a66
I20260709 12:23:39.813570 27539 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40214 (request call id 84) took 1970 ms. Trace:
I20260709 12:23:39.813923 27539 rpcz_store.cc:276] 0709 12:23:37.843013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:37.844123 (+  1110us) service_pool.cc:224] Handling call
0709 12:23:38.632730 (+788607us) ts_tablet_manager.cc:1151] Deleting tablet 2a278e46eb5d49edab4ba69303448a66
0709 12:23:38.632791 (+    61us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:23:39.430782 (+797991us) spinlock_profiling.cc:243] Waited 22.7 ms on lock 0x7b54000b45d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b694cd 00007f5d9d55434c 00007f5d9eb7760a 00007f5d9eba82d0 00007f5d9eb8e83d 00007f5d9eb8e7e9 00007f5d9eb8e779 00007f5d9eb8e741 00007f5d9eb8d96d 0000000000388634
0709 12:23:39.769924 (+339142us) tablet_metadata.cc:665] Metadata flushed
0709 12:23:39.778357 (+  8433us) tablet_metadata.cc:665] Metadata flushed
0709 12:23:39.813493 (+ 35136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43308,"spinlock_wait_cycles":52268928,"tablet-delete.queue_time_us":782535}
I20260709 12:23:39.814764 27478 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:39.816488 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:39.817095 25762 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 5.
I20260709 12:23:39.817106 26402 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:39.818292 27595 raft_consensus.cc:2804] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:39.818763 27595 raft_consensus.cc:697] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 3 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:23:39.819470 25800 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:23:39.837883 27596 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.852137 27530 raft_consensus.cc:2804] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:39.852609 27530 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:39.852349 27596 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:39.853094 27530 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:39.829990 27589 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:39.855715 27589 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:39.846529 27494 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:39.858428 27494 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:39.818714 27602 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:39.830209 27463 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:39.860911 27494 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:39.838814 25583 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41224 (request call id 316) took 1113 ms. Trace:
I20260709 12:23:39.861078 27463 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:39.863080 27463 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:39.819754 27595 consensus_queue.cc:237] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:39.839756 25649 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:39.868425 27596 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:39.835328 27508 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:39.869067 27596 raft_consensus.cc:2804] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:39.869483 27596 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:39.869119 27508 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:39.869837 26433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36518 (request call id 445) took 1052 ms. Trace:
I20260709 12:23:39.870355 26433 rpcz_store.cc:276] 0709 12:23:38.816957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:38.820093 (+  3136us) service_pool.cc:224] Handling call
0709 12:23:38.985787 (+165694us) spinlock_profiling.cc:243] Waited 9.09 ms on lock 0x7b5800004598. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d96a3cb71 00007f5d96a3ca22 00007f5d9f9558d9 00007f5d9eaafee0 00007f5d9eb790ab 00007f5d9eb79131 00007f5d9eb270a0 00007f5d9eb26984 00007f5d980a16d4 00007f5d980a1662
0709 12:23:39.869636 (+883849us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b54005a8554. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:23:39.869755 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":351885440}
I20260709 12:23:39.871258 27508 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:39.871646 26437 raft_consensus.cc:1275] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 12:23:39.871363 27530 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:39.822403 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:39.873664 25755 raft_consensus.cc:3060] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:39.876863 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:39.877455 25685 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 5.
I20260709 12:23:39.878490 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:39.869859 27596 raft_consensus.cc:3060] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:39.880537 27604 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:39.881063 27604 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:39.883260 27604 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:39.883903 25753 tablet_service.cc:1558] Processing DeleteTablet for tablet 4734c282e09b4bbbb96de8eee61c160a with delete_type TABLET_DATA_TOMBSTONED (TS 6e673265293d4e9a937dc45150aeb1b8 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:53452
I20260709 12:23:39.837031 25582 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41232 (request call id 365) took 1189 ms. Trace:
I20260709 12:23:39.885715 25582 rpcz_store.cc:276] 0709 12:23:38.647356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:38.647501 (+   145us) service_pool.cc:224] Handling call
0709 12:23:38.673731 (+ 26230us) spinlock_profiling.cc:243] Waited 16.7 ms on lock 0x7b5400002490. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d96a3cb71 00007f5d96a3d0b2 00007f5d9f9b6759 00007f5d9f94ea76 00007f5d9f91fd58 00007f5d9fa1e04e 00007f5d9dedf2a4 00007f5d9dedf232 00007f5d9dedf161 00007f5d9dedf0dc
0709 12:23:39.836954 (+1163223us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:38.708659 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:38.817323 (+108664us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:38.819048 (+  1725us) write_op.cc:435] Acquired schema lock
0709 12:23:38.826885 (+  7837us) tablet.cc:662] Decoding operations
0709 12:23:38.887419 (+ 60534us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:38.890599 (+  3180us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:38.896472 (+  5873us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:23:38.921571 (+ 25099us) tablet.cc:701] Row locks acquired
0709 12:23:38.936872 (+ 15301us) write_op.cc:260] PREPARE: finished
0709 12:23:38.958078 (+ 21206us) write_op.cc:270] Start()
0709 12:23:38.966408 (+  8330us) write_op.cc:276] Timestamp: P: 1783599818953023 usec, L: 0
0709 12:23:38.968858 (+  2450us) op_driver.cc:348] REPLICATION: starting
0709 12:23:38.990404 (+ 21546us) log.cc:844] Serialized 539 byte log entry
0709 12:23:39.261728 (+271324us) op_driver.cc:464] REPLICATION: finished
0709 12:23:39.485685 (+223957us) write_op.cc:301] APPLY: starting
0709 12:23:39.488040 (+  2355us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:39.512884 (+ 24844us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:39.529338 (+ 16454us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:39.539149 (+  9811us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:39.573575 (+ 34426us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:23:39.590870 (+ 17295us) write_op.cc:312] APPLY: finished
0709 12:23:39.645958 (+ 55088us) log.cc:844] Serialized 23 byte log entry
0709 12:23:39.669592 (+ 23634us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:39.673445 (+  3853us) write_op.cc:454] Released schema lock
0709 12:23:39.706128 (+ 32683us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:39.742793 (+ 36665us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:39.743645 (+   852us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":38418048,"child_traces":[["op",{"apply.queue_time_us":181077,"apply.run_cpu_time_us":2580,"apply.run_wall_time_us":258816,"num_ops":1,"prepare.queue_time_us":133,"prepare.run_cpu_time_us":6915,"prepare.run_wall_time_us":295124,"replication_time_us":292701,"thread_start_us":131326,"threads_started":1}]]}
I20260709 12:23:39.835471 25650 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:39.892445 27530 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:39.821069 25569 catalog_manager.cc:5028] TS f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): tablet 2a278e46eb5d49edab4ba69303448a66 (table test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]) successfully deleted
W20260709 12:23:39.899565 25569 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 78518.8us
I20260709 12:23:39.899621 27463 raft_consensus.cc:2804] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:23:39.899729 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 64361us
I20260709 12:23:39.861717 25583 rpcz_store.cc:276] 0709 12:23:38.725506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:38.728144 (+  2638us) service_pool.cc:224] Handling call
0709 12:23:39.838728 (+1110584us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:38.991045 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:38.991868 (+   823us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:38.991908 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:23:38.991955 (+    47us) tablet.cc:662] Decoding operations
0709 12:23:38.992399 (+   444us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:38.992459 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:38.992504 (+    45us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:23:38.992713 (+   209us) tablet.cc:701] Row locks acquired
0709 12:23:38.992736 (+    23us) write_op.cc:260] PREPARE: finished
0709 12:23:38.992901 (+   165us) write_op.cc:270] Start()
0709 12:23:38.993037 (+   136us) write_op.cc:276] Timestamp: P: 1783599818992847 usec, L: 0
0709 12:23:38.993067 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 12:23:39.026022 (+ 32955us) log.cc:844] Serialized 544 byte log entry
0709 12:23:39.785391 (+759369us) op_driver.cc:464] REPLICATION: finished
0709 12:23:39.785810 (+   419us) write_op.cc:301] APPLY: starting
0709 12:23:39.785886 (+    76us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:39.785991 (+   105us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:39.786103 (+   112us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:39.786329 (+   226us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:39.786486 (+   157us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:23:39.786538 (+    52us) write_op.cc:312] APPLY: finished
0709 12:23:39.786726 (+   188us) log.cc:844] Serialized 23 byte log entry
0709 12:23:39.786879 (+   153us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:39.786948 (+    69us) write_op.cc:454] Released schema lock
0709 12:23:39.786985 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:39.787295 (+   310us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:39.787322 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":49919,"reported_tablets":2,"spinlock_wait_cycles":511744,"child_traces":[["op",{"apply.queue_time_us":239,"apply.run_cpu_time_us":1459,"apply.run_wall_time_us":1459,"num_ops":1,"prepare.queue_time_us":114469,"prepare.run_cpu_time_us":3323,"prepare.run_wall_time_us":39754,"replication_time_us":792164}]]}
I20260709 12:23:39.894397 27589 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:39.823487 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:39.901947 25678 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 5.
I20260709 12:23:39.897750 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:39.902522 25755 raft_consensus.cc:2468] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 3.
I20260709 12:23:39.902982 25761 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:39.875653 25830 raft_consensus.cc:2468] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 3.
W20260709 12:23:39.908142 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 103775us
I20260709 12:23:39.910116 27596 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:39.911296 25677 raft_consensus.cc:2368] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 2. Current term is 3.
I20260709 12:23:39.912458 27596 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:39.913504 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:39.913617 25761 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 6.
I20260709 12:23:39.917097 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:39.918133 27530 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:39.921260 25800 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:23:39.900353 27463 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:39.922362 27463 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:39.923146 27481 raft_consensus.cc:2804] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:23:39.923540 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:39.924636 25677 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
 from {username='slave'} at 127.0.0.1:51578
I20260709 12:23:39.923651 27481 raft_consensus.cc:697] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 6 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:39.925153 25677 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:39.925542 25677 raft_consensus.cc:3060] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:39.926049 27481 consensus_queue.cc:237] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:39.928514 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:39.917121 25726 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:23:39.919807 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:39.921671 27530 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:39.930744 27468 raft_consensus.cc:2764] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:23:39.918383 27619 tablet_replica.cc:333] T 4734c282e09b4bbbb96de8eee61c160a P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
I20260709 12:23:39.934957 27619 raft_consensus.cc:2243] T 4734c282e09b4bbbb96de8eee61c160a P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:39.935559 27530 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:39.942976 25649 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:39.955220 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:39.956180 25801 leader_election.cc:400] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 election: Vote denied by peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) with higher term. Message: Invalid argument: T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 2. Current term is 3.
I20260709 12:23:39.955951 25678 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:39.948819 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:39.957190 26437 raft_consensus.cc:2368] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 2. Current term is 3.
I20260709 12:23:39.937374 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:39.933698 25761 raft_consensus.cc:2393] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 6: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:23:39.956583 25801 leader_election.cc:403] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:23:39.957543 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:39.943610 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:39.958518 25754 raft_consensus.cc:3060] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:39.961140 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:39.961870 25762 raft_consensus.cc:2393] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 3: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:23:39.983475 25677 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:23:40.002954 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 46960.5us
I20260709 12:23:39.946262 27617 raft_consensus.cc:2955] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 LEADER]: Committing config change with OpId 5.8: config changed from index 7 to 8, VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:40.032065 27619 raft_consensus.cc:2272] T 4734c282e09b4bbbb96de8eee61c160a P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:40.022322 27483 raft_consensus.cc:3060] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:39.957531 27604 raft_consensus.cc:2804] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:40.061844 25754 raft_consensus.cc:2468] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 3.
I20260709 12:23:40.068657 25677 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:40.086184 25678 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 6.
I20260709 12:23:40.068176 27604 raft_consensus.cc:697] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:40.104000 25801 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:40.104835 25678 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:40.116567 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:40.117450 25758 raft_consensus.cc:2393] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 3: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:23:40.115849 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:40.118779 25757 raft_consensus.cc:3060] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:23:40.116761 27478 raft_consensus.cc:2749] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:40.120976 27619 ts_tablet_manager.cc:1916] T 4734c282e09b4bbbb96de8eee61c160a P 6e673265293d4e9a937dc45150aeb1b8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:40.124353 27604 consensus_queue.cc:237] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:40.169910 25582 catalog_manager.cc:5697] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 2 to 3, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 3 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } }
I20260709 12:23:40.184379 25726 leader_election.cc:400] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Vote denied by peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611) with higher term. Message: Invalid argument: T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 2. Current term is 3.
I20260709 12:23:40.184907 25726 leader_election.cc:403] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:40.197283 25757 raft_consensus.cc:2468] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 3.
I20260709 12:23:40.182369 25582 catalog_manager.cc:5697] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 5 to 6, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 6 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:40.217489 27487 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.159981 27549 consensus_queue.cc:1048] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 12:23:40.257579 27483 raft_consensus.cc:2749] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) with higher term. Message: Invalid argument: T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 2. Current term is 3.
I20260709 12:23:40.307090 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:40.307013 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:40.308305 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:40.293898 25678 raft_consensus.cc:1275] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:40.312152 27502 raft_consensus.cc:2749] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611) with higher term. Message: Invalid argument: T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 2. Current term is 3.
W20260709 12:23:40.315042 27620 log.cc:927] Time spent T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 12:23:40.319393 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:40.319969 25830 raft_consensus.cc:3060] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:40.320936 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:23:40.317505 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 148209us
I20260709 12:23:40.322899 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:40.340204 25650 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:40.344467 25830 raft_consensus.cc:2468] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 3.
I20260709 12:23:40.316061 27487 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:40.357065 25828 raft_consensus.cc:2393] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 4: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:23:40.367252 27463 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:40.368752 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:40.377341 25682 raft_consensus.cc:2468] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 2.
I20260709 12:23:40.370306 27530 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
W20260709 12:23:40.373095 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 50855.7us
I20260709 12:23:40.390614 27477 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:40.393812 27487 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:40.355280 27590 raft_consensus.cc:2749] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:40.414528 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:40.391330 27477 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:40.416333 25650 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:40.423556 25682 raft_consensus.cc:1240] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:40.426098 25683 raft_consensus.cc:1240] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:23:40.427408 25650 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:40.429704 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:40.432545 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:40.430932 25828 raft_consensus.cc:1275] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:40.440675 26437 raft_consensus.cc:3060] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEARNER]: Advancing to term 3
I20260709 12:23:40.401728 27549 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:40.414012 27508 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:40.455598 27508 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:23:40.456302 27621 log.cc:927] Time spent T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.179s	user 0.000s	sys 0.000s
I20260709 12:23:40.446161 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:40.449710 27477 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:40.403229 27530 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:40.450781 25835 raft_consensus.cc:2468] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 3.
I20260709 12:23:40.451985 27494 raft_consensus.cc:2749] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:40.444052 27590 raft_consensus.cc:2804] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:40.460925 26437 raft_consensus.cc:1275] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 3 LEARNER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:23:40.477173 27590 raft_consensus.cc:697] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:40.478291 27590 consensus_queue.cc:237] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:40.484107 27530 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:40.486011 27477 consensus_queue.cc:1048] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:40.488106 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:40.488962 26431 raft_consensus.cc:3055] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:40.489396 26431 raft_consensus.cc:740] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:23:40.490440 26431 consensus_queue.cc:260] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:40.457798 27549 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:23:40.539019 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 104590us
I20260709 12:23:40.546819 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:40.554596 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:40.554929 27591 consensus_queue.cc:1048] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:23:40.562943 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 115586us
I20260709 12:23:40.549829 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:40.551797 27508 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:40.578239 25650 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:40.587127 27494 raft_consensus.cc:2749] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:40.586035 25650 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:40.569839 27463 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:40.590727 27494 raft_consensus.cc:2749] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:40.594916 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:40.595531 25680 raft_consensus.cc:2468] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 4.
I20260709 12:23:40.601401 25758 raft_consensus.cc:1275] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:23:40.604059 27530 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:40.604269 27552 consensus_queue.cc:1048] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:40.604827 27530 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:40.607348 27530 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:40.608233 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:23:40.609912 27624 log.cc:927] Time spent T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:23:40.614886 25726 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:40.589331 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:40.588420 26437 raft_consensus.cc:2955] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Committing config change with OpId 5.8: config changed from index 7 to 8, VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:40.618480 25649 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:40.620065 27502 raft_consensus.cc:2749] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:40.639060 25650 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:40.641745 27631 raft_consensus.cc:2749] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:40.644624 25832 raft_consensus.cc:1275] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:23:40.649521 25832 raft_consensus.cc:1275] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:40.653841 27619 ts_tablet_manager.cc:1929] T 4734c282e09b4bbbb96de8eee61c160a P 6e673265293d4e9a937dc45150aeb1b8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 12:23:40.654351 27619 log.cc:1199] T 4734c282e09b4bbbb96de8eee61c160a P 6e673265293d4e9a937dc45150aeb1b8: Deleting WAL directory at /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-1-root/wals/4734c282e09b4bbbb96de8eee61c160a
I20260709 12:23:40.672686 27636 raft_consensus.cc:2804] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:40.684178 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:40.684862 25677 raft_consensus.cc:3060] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:40.690061 27636 raft_consensus.cc:697] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:40.691125 27636 consensus_queue.cc:237] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:40.691646 25568 catalog_manager.cc:5028] TS 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): tablet 4734c282e09b4bbbb96de8eee61c160a (table test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]) successfully deleted
I20260709 12:23:40.693686 25677 raft_consensus.cc:2468] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 3.
I20260709 12:23:40.699020 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:40.701025 25677 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:40.703945 25681 raft_consensus.cc:1275] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:23:40.705327 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:40.707413 25763 raft_consensus.cc:1275] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:40.708523 25757 raft_consensus.cc:1275] T 43b78aa0054b4da398a8fc04d12454a7 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:23:40.709190 25677 raft_consensus.cc:1275] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:40.710248 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:40.712561 27591 consensus_queue.cc:1059] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:23:40.726286 27591 raft_consensus.cc:3055] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:40.726770 27591 raft_consensus.cc:740] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:40.727800 27591 consensus_queue.cc:260] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:40.745193 27563 consensus_queue.cc:1048] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:23:40.744946 27604 consensus_queue.cc:1048] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 12:23:40.744378 27591 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:40.774729 25758 raft_consensus.cc:1275] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:40.775094 27508 consensus_queue.cc:1048] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:40.777585 27549 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:23:40.742213 27476 consensus_queue.cc:1175] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f82778701b464892aab92a752ed7ffdc" responder_term: 3 status { last_received { term: 2 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:23:40.782577 26431 raft_consensus.cc:3060] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:40.773335 25650 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:40.769230 26402 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:40.788242 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:40.784257 25801 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:40.801910 25836 raft_consensus.cc:1240] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:40.810997 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:40.814882 25801 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:40.792625 27508 raft_consensus.cc:2749] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:40.798622 27595 raft_consensus.cc:2804] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:40.816501 27566 raft_consensus.cc:2804] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:40.816905 27566 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:40.817265 27566 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:40.819057 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:40.813464 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:40.821955 27565 raft_consensus.cc:2749] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:40.789485 27542 consensus_queue.cc:1048] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:23:40.823709 27636 consensus_queue.cc:1048] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:40.813953 27554 consensus_queue.cc:1048] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:23:40.824888 25835 raft_consensus.cc:1275] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:40.835402 27483 consensus_queue.cc:1048] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:40.831279 27503 consensus_queue.cc:1048] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:23:40.837281 25801 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:40.838307 27483 raft_consensus.cc:2749] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:40.861747 25726 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:40.864601 25650 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:40.865819 25650 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:40.871255 27631 raft_consensus.cc:2749] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:40.900251 26431 raft_consensus.cc:2468] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 3.
I20260709 12:23:40.868500 27468 raft_consensus.cc:2749] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:40.866904 27636 consensus_queue.cc:1048] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 12:23:40.933704 27566 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:40.881783 25581 catalog_manager.cc:5697] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 2 to 3, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 3 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:40.869992 27634 raft_consensus.cc:2749] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:41.004587 27595 raft_consensus.cc:697] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 3 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:23:41.026669 27595 consensus_queue.cc:237] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:41.075940 27566 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:41.081521 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:41.078152 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:41.083444 25835 raft_consensus.cc:1275] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:41.085119 27604 consensus_queue.cc:1048] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:41.087743 25801 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:41.089601 27566 raft_consensus.cc:2749] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:23:41.092327 27657 log.cc:927] Time spent T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:23:41.101567 25583 catalog_manager.cc:5697] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 2 to 3, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 3 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:41.112464 27634 raft_consensus.cc:1064] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc: attempting to promote NON_VOTER a866ff967d964388a6f0dff7fd43df89 to VOTER
I20260709 12:23:41.136719 27634 consensus_queue.cc:237] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:41.156775 25583 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41224 (request call id 317) took 1040 ms. Trace:
I20260709 12:23:41.157182 25583 rpcz_store.cc:276] 0709 12:23:40.116248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:40.125912 (+  9664us) service_pool.cc:224] Handling call
0709 12:23:41.156699 (+1030787us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:41.109493 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:41.110035 (+   542us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:41.110067 (+    32us) write_op.cc:435] Acquired schema lock
0709 12:23:41.110084 (+    17us) tablet.cc:662] Decoding operations
0709 12:23:41.110485 (+   401us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:41.110540 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:41.110564 (+    24us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:23:41.110741 (+   177us) tablet.cc:701] Row locks acquired
0709 12:23:41.110757 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:23:41.110883 (+   126us) write_op.cc:270] Start()
0709 12:23:41.110982 (+    99us) write_op.cc:276] Timestamp: P: 1783599821110845 usec, L: 0
0709 12:23:41.110997 (+    15us) op_driver.cc:348] REPLICATION: starting
0709 12:23:41.112864 (+  1867us) log.cc:844] Serialized 603 byte log entry
0709 12:23:41.151019 (+ 38155us) op_driver.cc:464] REPLICATION: finished
0709 12:23:41.151532 (+   513us) write_op.cc:301] APPLY: starting
0709 12:23:41.151634 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:41.151769 (+   135us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:41.151904 (+   135us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:41.152150 (+   246us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:41.152372 (+   222us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:23:41.152441 (+    69us) write_op.cc:312] APPLY: finished
0709 12:23:41.152680 (+   239us) log.cc:844] Serialized 23 byte log entry
0709 12:23:41.152873 (+   193us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:41.152975 (+   102us) write_op.cc:454] Released schema lock
0709 12:23:41.153024 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:41.153360 (+   336us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:41.153385 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5221,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":296,"apply.run_cpu_time_us":1811,"apply.run_wall_time_us":1811,"num_ops":1,"prepare.queue_time_us":1165,"prepare.run_cpu_time_us":2349,"prepare.run_wall_time_us":3627,"replication_time_us":39880}]]}
I20260709 12:23:41.161866 25835 consensus_queue.cc:237] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:41.162803 25584 catalog_manager.cc:5697] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 3 to 4, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 4 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:41.192938 25582 catalog_manager.cc:5697] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 4 to 6, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 6 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:41.200732 25763 raft_consensus.cc:1275] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:41.201303 25757 raft_consensus.cc:1275] T 43b78aa0054b4da398a8fc04d12454a7 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:23:41.208731 25830 raft_consensus.cc:1275] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:23:41.210002 27634 consensus_queue.cc:1048] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:23:41.223387 27542 consensus_queue.cc:1048] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:41.230638 27589 consensus_queue.cc:1048] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:41.237030 26430 raft_consensus.cc:1275] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:41.262428 25583 catalog_manager.cc:5697] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } }
I20260709 12:23:41.264647 26433 raft_consensus.cc:1275] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 3 LEARNER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:23:41.256904 27494 consensus_queue.cc:1048] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:23:41.267287 25832 raft_consensus.cc:1240] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:41.271591 25829 raft_consensus.cc:1275] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:41.277516 27590 consensus_queue.cc:1048] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:41.277957 27616 consensus_queue.cc:1059] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:41.279021 27616 raft_consensus.cc:3055] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:41.279422 27616 raft_consensus.cc:740] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:41.280318 27616 consensus_queue.cc:260] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:41.281615 27616 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:41.279207 27590 consensus_queue.cc:1048] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:41.286404 27634 raft_consensus.cc:2955] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 2 to 5, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:41.288592 26430 raft_consensus.cc:2955] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:41.298026 25681 raft_consensus.cc:1275] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:41.300307 25755 raft_consensus.cc:1275] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:41.302596 25801 consensus_peers.cc:597] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a -> Peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Couldn't send request to peer a866ff967d964388a6f0dff7fd43df89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5aae9f34f7154346afd482b3183ee180. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:41.303478 27478 consensus_queue.cc:1048] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:41.309928 25835 raft_consensus.cc:2955] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:41.317166 27478 consensus_queue.cc:1048] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:41.319736 25581 catalog_manager.cc:5697] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:41.322024 25581 catalog_manager.cc:5697] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 2 to 3, leader changed from a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 3 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:41.352391 25755 raft_consensus.cc:2955] T 43b78aa0054b4da398a8fc04d12454a7 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:41.356891 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:41.365872 25584 catalog_manager.cc:5697] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 1 to 3, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 3 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:41.370484 27566 raft_consensus.cc:2955] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:41.384006 25681 raft_consensus.cc:2955] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:41.458070 25684 consensus_queue.cc:237] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:41.473939 25581 catalog_manager.cc:5697] T 43b78aa0054b4da398a8fc04d12454a7 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: config changed from index 2 to 5, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:41.477918 25757 raft_consensus.cc:2955] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:41.491988 25831 raft_consensus.cc:1275] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 12:23:41.493592 25650 consensus_peers.cc:597] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc -> Peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Couldn't send request to peer a866ff967d964388a6f0dff7fd43df89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c87d777e7d64471f988b07272bf2441c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:41.494504 27589 consensus_queue.cc:1048] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:41.503012 25758 raft_consensus.cc:1275] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:23:41.508088 27590 consensus_queue.cc:1048] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:41.538736 25757 raft_consensus.cc:1275] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:23:41.539494 25755 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
mode: GRACEFUL
new_leader_uuid: "f82778701b464892aab92a752ed7ffdc"
 from {username='slave'} at 127.0.0.1:48134
I20260709 12:23:41.540115 25755 raft_consensus.cc:606] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Received request to transfer leadership to TS f82778701b464892aab92a752ed7ffdc
I20260709 12:23:41.542101 27633 consensus_queue.cc:1048] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:23:41.545665 26433 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6"
dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
mode: GRACEFUL
new_leader_uuid: "f82778701b464892aab92a752ed7ffdc"
 from {username='slave'} at 127.0.0.1:35548
I20260709 12:23:41.546324 26433 raft_consensus.cc:606] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 3 LEADER]: Received request to transfer leadership to TS f82778701b464892aab92a752ed7ffdc
I20260709 12:23:41.546754 25583 catalog_manager.cc:5697] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: config changed from index -1 to 2, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New cstate: current_term: 1 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:41.549232 26433 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25bd5658646b41608d707d196c6e0585"
dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
mode: GRACEFUL
new_leader_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:35548
I20260709 12:23:41.549818 26433 raft_consensus.cc:606] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 3 LEADER]: Received request to transfer leadership to TS 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:23:41.552578 26433 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90"
dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
mode: GRACEFUL
new_leader_uuid: "f82778701b464892aab92a752ed7ffdc"
 from {username='slave'} at 127.0.0.1:35548
I20260709 12:23:41.553208 26433 raft_consensus.cc:606] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEADER]: Received request to transfer leadership to TS f82778701b464892aab92a752ed7ffdc
I20260709 12:23:41.556116 25757 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
mode: GRACEFUL
new_leader_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:48134
I20260709 12:23:41.558043 25757 raft_consensus.cc:606] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Received request to transfer leadership to TS 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:23:41.566118 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:23:41.575336 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:41.576189 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:41.583452 27590 raft_consensus.cc:2955] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:41.622668 25684 raft_consensus.cc:1275] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:23:41.622026 25831 raft_consensus.cc:2955] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:41.634842 27656 consensus_queue.cc:1048] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:41.632073 25758 raft_consensus.cc:2955] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:41.663029 27633 raft_consensus.cc:993] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89: : Instructing follower 5cccf20a8bff46dba6601f241d172b8a to start an election
I20260709 12:23:41.663586 27476 raft_consensus.cc:1081] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 3 LEADER]: Signalling peer 5cccf20a8bff46dba6601f241d172b8a to start an election
I20260709 12:23:41.666153 25835 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "25bd5658646b41608d707d196c6e0585"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:41782
I20260709 12:23:41.666875 25835 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:41.667357 25835 raft_consensus.cc:3060] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:41.668321 25584 catalog_manager.cc:5697] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: config changed from index -1 to 4, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New cstate: current_term: 3 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:41.679780 25835 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:41.685267 25835 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:41.686697 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:41.687371 25755 raft_consensus.cc:3060] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:41.687692 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:41.688289 26430 raft_consensus.cc:3055] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:41.688594 26430 raft_consensus.cc:740] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:23:41.689199 27616 raft_consensus.cc:993] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8: : Instructing follower f82778701b464892aab92a752ed7ffdc to start an election
I20260709 12:23:41.689623 27616 raft_consensus.cc:1081] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Signalling peer f82778701b464892aab92a752ed7ffdc to start an election
I20260709 12:23:41.689399 26430 consensus_queue.cc:260] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:41.691563 25677 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
 from {username='slave'} at 127.0.0.1:40230
I20260709 12:23:41.692102 25677 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:41.692421 25677 raft_consensus.cc:3060] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:41.695132 26430 raft_consensus.cc:3060] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:41.701071 25677 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:41.704988 25677 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:41.709853 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:41.711421 27476 raft_consensus.cc:993] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89: : Instructing follower f82778701b464892aab92a752ed7ffdc to start an election
I20260709 12:23:41.711892 27476 raft_consensus.cc:1081] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEADER]: Signalling peer f82778701b464892aab92a752ed7ffdc to start an election
I20260709 12:23:41.710124 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:41.714030 25835 raft_consensus.cc:3060] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:41.725217 25681 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
 from {username='slave'} at 127.0.0.1:51578
I20260709 12:23:41.725914 25681 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:41.726341 25681 raft_consensus.cc:3060] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:41.714200 25763 raft_consensus.cc:3055] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:41.726895 25763 raft_consensus.cc:740] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:41.727636 25763 consensus_queue.cc:260] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:41.728816 25763 raft_consensus.cc:3060] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:41.731716 25835 raft_consensus.cc:2468] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 3.
I20260709 12:23:41.734650 25650 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:41.740097 27604 raft_consensus.cc:2804] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:41.740569 27604 raft_consensus.cc:697] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:41.741439 27604 consensus_queue.cc:237] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:41.748042 25831 consensus_queue.cc:237] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:41.767263 27633 raft_consensus.cc:993] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89: : Instructing follower f82778701b464892aab92a752ed7ffdc to start an election
I20260709 12:23:41.767853 27656 raft_consensus.cc:1081] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 3 LEADER]: Signalling peer f82778701b464892aab92a752ed7ffdc to start an election
I20260709 12:23:41.800719 25684 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
 from {username='slave'} at 127.0.0.1:51578
I20260709 12:23:41.809290 25681 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:41.811688 25763 raft_consensus.cc:2468] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 3.
I20260709 12:23:41.815243 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:41.815828 25763 raft_consensus.cc:3060] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:41.819298 25755 raft_consensus.cc:2468] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 4.
I20260709 12:23:41.820243 25800 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:23:41.811973 27677 ts_tablet_manager.cc:933] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89: Initiating tablet copy from peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:41.829751 25681 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:41.824576 26430 raft_consensus.cc:2468] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 4.
I20260709 12:23:41.824903 27478 raft_consensus.cc:2804] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:41.831790 27478 raft_consensus.cc:697] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:41.832731 27478 consensus_queue.cc:237] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:41.827129 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:41.833899 26438 raft_consensus.cc:3055] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:41.834235 26438 raft_consensus.cc:740] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:23:41.834955 26438 consensus_queue.cc:260] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:41.836285 26438 raft_consensus.cc:3060] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:41.841413 25763 raft_consensus.cc:2468] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 3.
I20260709 12:23:41.842813 25649 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:41.851038 26438 raft_consensus.cc:2468] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 3.
I20260709 12:23:41.852066 27604 raft_consensus.cc:2804] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:41.863165 27604 raft_consensus.cc:697] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:41.864132 27604 consensus_queue.cc:237] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:41.873713 25582 catalog_manager.cc:5697] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 2 to 3, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 3 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:41.878571 25801 consensus_peers.cc:597] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a -> Peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Couldn't send request to peer a866ff967d964388a6f0dff7fd43df89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 51d1a71a6e1f4e20842a35cdeb808ac0. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:41.879155 25681 raft_consensus.cc:1275] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:41.881045 27530 consensus_queue.cc:1048] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:41.889470 25763 raft_consensus.cc:1275] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:23:41.891498 27530 consensus_queue.cc:1048] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:41.906874 25684 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:41.907267 25684 raft_consensus.cc:3060] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:41.911265 27677 tablet_copy_client.cc:323] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Beginning tablet copy session from remote peer at address 127.23.245.131:36237
I20260709 12:23:41.932035 25584 catalog_manager.cc:5697] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 3 to 4, leader changed from a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 4 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:41.932862 27530 raft_consensus.cc:2955] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:41.937014 25678 raft_consensus.cc:2955] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:41.946825 25847 tablet_copy_service.cc:140] P 5cccf20a8bff46dba6601f241d172b8a: Received BeginTabletCopySession request for tablet 5aae9f34f7154346afd482b3183ee180 from peer a866ff967d964388a6f0dff7fd43df89 ({username='slave'} at 127.0.0.1:41782)
I20260709 12:23:41.947530 25847 tablet_copy_service.cc:161] P 5cccf20a8bff46dba6601f241d172b8a: Beginning new tablet copy session on tablet 5aae9f34f7154346afd482b3183ee180 from peer a866ff967d964388a6f0dff7fd43df89 at {username='slave'} at 127.0.0.1:41782: session id = a866ff967d964388a6f0dff7fd43df89-5aae9f34f7154346afd482b3183ee180
I20260709 12:23:41.961133 27685 ts_tablet_manager.cc:933] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89: Initiating tablet copy from peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349)
I20260709 12:23:41.957285 25847 tablet_copy_source_session.cc:215] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:41.965662 25684 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:41.970108 25684 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:41.975211 27685 tablet_copy_client.cc:323] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89: tablet copy: Beginning tablet copy session from remote peer at address 127.23.245.129:37349
I20260709 12:23:41.971684 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:41.977198 25755 raft_consensus.cc:3060] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:41.979663 25695 tablet_copy_service.cc:140] P f82778701b464892aab92a752ed7ffdc: Received BeginTabletCopySession request for tablet c87d777e7d64471f988b07272bf2441c from peer a866ff967d964388a6f0dff7fd43df89 ({username='slave'} at 127.0.0.1:51578)
I20260709 12:23:41.980278 25695 tablet_copy_service.cc:161] P f82778701b464892aab92a752ed7ffdc: Beginning new tablet copy session on tablet c87d777e7d64471f988b07272bf2441c from peer a866ff967d964388a6f0dff7fd43df89 at {username='slave'} at 127.0.0.1:51578: session id = a866ff967d964388a6f0dff7fd43df89-c87d777e7d64471f988b07272bf2441c
I20260709 12:23:41.980959 25758 consensus_queue.cc:237] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:41.984093 25755 raft_consensus.cc:2468] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 4.
I20260709 12:23:41.985417 25649 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:41.975109 25582 catalog_manager.cc:5697] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 2 to 3, leader changed from a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 3 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:41.976223 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:41.986153 26438 raft_consensus.cc:3055] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:41.970150 27677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5aae9f34f7154346afd482b3183ee180. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:41.986472 27604 raft_consensus.cc:2804] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:41.987818 27604 raft_consensus.cc:697] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 4 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:41.988693 27604 consensus_queue.cc:237] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:41.986490 26438 raft_consensus.cc:740] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:23:41.993424 26438 consensus_queue.cc:260] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:41.994663 26438 raft_consensus.cc:3060] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:42.004190 25763 raft_consensus.cc:2955] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:42.007038 25695 tablet_copy_source_session.cc:215] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:42.015825 27685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c87d777e7d64471f988b07272bf2441c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:42.029281 25582 catalog_manager.cc:5697] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc reported cstate change: config changed from index -1 to 3, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New cstate: current_term: 2 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:42.033726 26438 raft_consensus.cc:2468] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 4.
I20260709 12:23:42.037192 25831 raft_consensus.cc:1275] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:23:42.039036 27501 consensus_queue.cc:1048] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:42.044344 27685 tablet_copy_client.cc:806] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:42.044984 27685 tablet_copy_client.cc:670] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 1 WAL segments...
W20260709 12:23:42.050516 25726 consensus_peers.cc:597] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 -> Peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Couldn't send request to peer a866ff967d964388a6f0dff7fd43df89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 237622cb71464b3ca091560bd9d8c06b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:42.053442 27468 raft_consensus.cc:993] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8: : Instructing follower 5cccf20a8bff46dba6601f241d172b8a to start an election
I20260709 12:23:42.054005 27468 raft_consensus.cc:1081] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Signalling peer 5cccf20a8bff46dba6601f241d172b8a to start an election
I20260709 12:23:42.057335 25678 raft_consensus.cc:1275] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:23:42.058022 25832 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:44218
I20260709 12:23:42.058420 27685 tablet_copy_client.cc:538] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:42.058581 25832 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:42.059080 25832 raft_consensus.cc:3060] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:42.061998 27563 consensus_queue.cc:1048] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:42.069944 25681 consensus_queue.cc:237] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:42.070924 27677 tablet_copy_client.cc:806] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:42.071728 27677 tablet_copy_client.cc:670] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:42.077657 27685 tablet_bootstrap.cc:492] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89: Bootstrap starting.
I20260709 12:23:42.082520 25582 catalog_manager.cc:5697] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 3 to 4, leader changed from a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 4 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:42.101987 27616 raft_consensus.cc:2955] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:42.110466 26438 raft_consensus.cc:1275] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:42.112859 25835 raft_consensus.cc:1275] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:42.112671 27604 consensus_queue.cc:1048] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:42.112887 25684 raft_consensus.cc:2955] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:42.117901 27677 tablet_copy_client.cc:538] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:42.117650 27542 consensus_queue.cc:1048] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:23:42.120911 25832 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:42.125344 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:42.125883 26438 raft_consensus.cc:3060] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:42.129184 27590 raft_consensus.cc:2955] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:42.133356 25831 raft_consensus.cc:2955] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:42.136137 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:42.136755 25758 raft_consensus.cc:3055] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:42.137079 25758 raft_consensus.cc:740] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:42.137938 25758 consensus_queue.cc:260] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:42.139042 25758 raft_consensus.cc:3060] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:42.144234 26431 raft_consensus.cc:2955] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:42.155961 25569 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 43b78aa0054b4da398a8fc04d12454a7 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:42.163290 25835 raft_consensus.cc:2955] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:23:42.168666 27677 tablet_bootstrap.cc:492] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89: Bootstrap starting.
I20260709 12:23:42.171013 25763 raft_consensus.cc:1275] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:42.172592 26438 raft_consensus.cc:2468] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 3.
I20260709 12:23:42.173684 25801 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:42.174214 27604 consensus_queue.cc:1048] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:42.174479 27478 raft_consensus.cc:2804] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:42.175365 27478 raft_consensus.cc:697] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 3 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:42.176306 27478 consensus_queue.cc:237] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:42.185587 27685 tablet_bootstrap.cc:492] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:42.186693 27685 tablet_bootstrap.cc:492] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89: Bootstrap complete.
I20260709 12:23:42.165859 25832 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:42.196014 27685 ts_tablet_manager.cc:1403] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89: Time spent bootstrapping tablet: real 0.128s	user 0.047s	sys 0.005s
I20260709 12:23:42.197976 25581 catalog_manager.cc:5697] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: config changed from index -1 to 4, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New cstate: current_term: 3 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:42.207150 25758 raft_consensus.cc:2468] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 3.
I20260709 12:23:42.217324 27685 raft_consensus.cc:359] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:42.218330 27685 raft_consensus.cc:740] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Initialized, Role: LEARNER
I20260709 12:23:42.219064 27685 consensus_queue.cc:260] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:42.221446 25584 catalog_manager.cc:5697] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: config changed from index 5 to 6, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New cstate: current_term: 3 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:42.224148 27685 ts_tablet_manager.cc:1434] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 12:23:42.226778 25695 tablet_copy_service.cc:342] P f82778701b464892aab92a752ed7ffdc: Request end of tablet copy session a866ff967d964388a6f0dff7fd43df89-c87d777e7d64471f988b07272bf2441c received from {username='slave'} at 127.0.0.1:51578
I20260709 12:23:42.227216 25695 tablet_copy_service.cc:434] P f82778701b464892aab92a752ed7ffdc: ending tablet copy session a866ff967d964388a6f0dff7fd43df89-c87d777e7d64471f988b07272bf2441c on tablet c87d777e7d64471f988b07272bf2441c with peer a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:42.248329 25753 tablet_service.cc:1558] Processing DeleteTablet for tablet 43b78aa0054b4da398a8fc04d12454a7 with delete_type TABLET_DATA_TOMBSTONED (TS 6e673265293d4e9a937dc45150aeb1b8 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:53452
I20260709 12:23:42.265658 27693 tablet_replica.cc:333] T 43b78aa0054b4da398a8fc04d12454a7 P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
I20260709 12:23:42.266880 27693 raft_consensus.cc:2243] T 43b78aa0054b4da398a8fc04d12454a7 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:42.267727 27693 raft_consensus.cc:2272] T 43b78aa0054b4da398a8fc04d12454a7 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:42.272527 25758 raft_consensus.cc:1275] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:23:42.279747 27693 ts_tablet_manager.cc:1916] T 43b78aa0054b4da398a8fc04d12454a7 P 6e673265293d4e9a937dc45150aeb1b8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:42.282152 26430 raft_consensus.cc:1275] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:42.285455 27478 consensus_queue.cc:1048] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:42.295480 25829 raft_consensus.cc:1275] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:42.297791 27677 tablet_bootstrap.cc:492] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:42.298857 27677 tablet_bootstrap.cc:492] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89: Bootstrap complete.
I20260709 12:23:42.299590 27677 ts_tablet_manager.cc:1403] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89: Time spent bootstrapping tablet: real 0.131s	user 0.016s	sys 0.009s
I20260709 12:23:42.300668 27542 consensus_queue.cc:1048] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:42.303162 27616 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.303665 27616 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:42.303874 27542 consensus_queue.cc:1048] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:42.305814 27616 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:42.306542 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:42.307312 25684 raft_consensus.cc:2468] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 4.
I20260709 12:23:42.308655 25726 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:42.309482 27468 raft_consensus.cc:2804] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:42.309890 27468 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:42.310266 27468 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:42.313499 25581 catalog_manager.cc:5697] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 2 to 3, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 3 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:42.317466 27590 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:42.317981 27590 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:42.320227 27590 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:42.323529 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:42.324184 25763 raft_consensus.cc:2468] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 5.
I20260709 12:23:42.326354 25649 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:42.327069 27595 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:42.327735 27595 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:42.329597 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:42.326297 27468 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:42.330209 27595 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:42.330559 25832 raft_consensus.cc:2393] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 5: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:23:42.327747 27590 raft_consensus.cc:2804] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:42.333819 27590 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:42.334244 27590 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:42.316274 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:42.335613 26438 raft_consensus.cc:2468] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 3.
I20260709 12:23:42.338948 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:42.339191 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:42.341259 25678 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:42.346406 27468 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:42.330564 27677 raft_consensus.cc:359] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:42.349596 27677 raft_consensus.cc:740] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Initialized, Role: LEARNER
I20260709 12:23:42.350365 27677 consensus_queue.cc:260] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:42.340287 27685 ts_tablet_manager.cc:933] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89: Initiating tablet copy from peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:42.331066 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:42.353359 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:42.353914 25763 raft_consensus.cc:2368] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 4. Current term is 5.
I20260709 12:23:42.354173 26433 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:23:42.355178 26401 leader_election.cc:400] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267) with higher term. Message: Invalid argument: T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 4. Current term is 5.
I20260709 12:23:42.355597 27685 tablet_copy_client.cc:323] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Beginning tablet copy session from remote peer at address 127.23.245.131:36237
I20260709 12:23:42.355211 27677 ts_tablet_manager.cc:1434] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89: Time spent starting tablet: real 0.055s	user 0.004s	sys 0.005s
I20260709 12:23:42.355612 26401 leader_election.cc:403] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:42.348794 25678 raft_consensus.cc:2468] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 5.
I20260709 12:23:42.360700 25726 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:42.361490 27468 raft_consensus.cc:2804] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:42.362152 27468 raft_consensus.cc:697] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 5 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:42.363258 27468 consensus_queue.cc:237] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:42.369953 26433 raft_consensus.cc:2468] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 5.
I20260709 12:23:42.375317 27633 raft_consensus.cc:2749] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267) with higher term. Message: Invalid argument: T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 4. Current term is 5.
I20260709 12:23:42.385713 25846 tablet_copy_service.cc:342] P 5cccf20a8bff46dba6601f241d172b8a: Request end of tablet copy session a866ff967d964388a6f0dff7fd43df89-5aae9f34f7154346afd482b3183ee180 received from {username='slave'} at 127.0.0.1:41782
I20260709 12:23:42.385856 25847 tablet_copy_service.cc:140] P 5cccf20a8bff46dba6601f241d172b8a: Received BeginTabletCopySession request for tablet 51d1a71a6e1f4e20842a35cdeb808ac0 from peer a866ff967d964388a6f0dff7fd43df89 ({username='slave'} at 127.0.0.1:41782)
I20260709 12:23:42.386277 25846 tablet_copy_service.cc:434] P 5cccf20a8bff46dba6601f241d172b8a: ending tablet copy session a866ff967d964388a6f0dff7fd43df89-5aae9f34f7154346afd482b3183ee180 on tablet 5aae9f34f7154346afd482b3183ee180 with peer a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:42.387416 25847 tablet_copy_service.cc:161] P 5cccf20a8bff46dba6601f241d172b8a: Beginning new tablet copy session on tablet 51d1a71a6e1f4e20842a35cdeb808ac0 from peer a866ff967d964388a6f0dff7fd43df89 at {username='slave'} at 127.0.0.1:41782: session id = a866ff967d964388a6f0dff7fd43df89-51d1a71a6e1f4e20842a35cdeb808ac0
I20260709 12:23:42.402187 27590 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:42.404675 25847 tablet_copy_source_session.cc:215] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:42.407837 27693 ts_tablet_manager.cc:1929] T 43b78aa0054b4da398a8fc04d12454a7 P 6e673265293d4e9a937dc45150aeb1b8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 12:23:42.408346 27693 log.cc:1199] T 43b78aa0054b4da398a8fc04d12454a7 P 6e673265293d4e9a937dc45150aeb1b8: Deleting WAL directory at /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-1-root/wals/43b78aa0054b4da398a8fc04d12454a7
I20260709 12:23:42.410355 25568 catalog_manager.cc:5028] TS 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): tablet 43b78aa0054b4da398a8fc04d12454a7 (table test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]) successfully deleted
I20260709 12:23:42.420027 25763 raft_consensus.cc:1275] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:42.425061 27685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51d1a71a6e1f4e20842a35cdeb808ac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:42.428188 27542 consensus_queue.cc:1048] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:42.441731 27590 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:42.442237 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:42.443038 25835 raft_consensus.cc:2393] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 5: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:23:42.448163 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:42.460151 25755 raft_consensus.cc:2468] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 5.
I20260709 12:23:42.461275 25649 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:23:42.463678 27590 raft_consensus.cc:2804] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:42.487360 26430 raft_consensus.cc:1275] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:23:42.489147 27530 consensus_queue.cc:1048] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:42.500638 27590 raft_consensus.cc:697] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 5 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:42.518560 26433 raft_consensus.cc:1275] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:23:42.501762 27590 consensus_queue.cc:237] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:42.598480 27709 consensus_queue.cc:1048] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:42.607204 27685 tablet_copy_client.cc:806] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:42.607894 27685 tablet_copy_client.cc:670] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 1 WAL segments...
W20260709 12:23:42.616367 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 96252.7us
I20260709 12:23:42.618455 26438 raft_consensus.cc:1217] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
W20260709 12:23:42.631541 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 61802.5us
W20260709 12:23:42.636392 27697 log.cc:927] Time spent T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 12:23:42.658572 25582 catalog_manager.cc:5697] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:42.659452 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:23:42.679168 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 50023.6us
W20260709 12:23:42.774829 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 72630.2us
I20260709 12:23:42.779685 26435 raft_consensus.cc:1217] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:42.786185 27677 ts_tablet_manager.cc:933] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89: Initiating tablet copy from peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:23:42.799800 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 106396us
I20260709 12:23:42.818125 25758 raft_consensus.cc:1275] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:42.820669 26437 raft_consensus.cc:1275] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:42.824536 25760 raft_consensus.cc:1275] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:23:42.826448 27677 tablet_copy_client.cc:323] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89: tablet copy: Beginning tablet copy session from remote peer at address 127.23.245.130:37267
I20260709 12:23:42.826815 27685 tablet_copy_client.cc:538] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:42.830266 27716 consensus_queue.cc:1048] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:42.830286 27705 consensus_queue.cc:1048] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:42.837302 27718 consensus_queue.cc:1048] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:42.837883 25773 tablet_copy_service.cc:140] P 6e673265293d4e9a937dc45150aeb1b8: Received BeginTabletCopySession request for tablet 237622cb71464b3ca091560bd9d8c06b from peer a866ff967d964388a6f0dff7fd43df89 ({username='slave'} at 127.0.0.1:48606)
I20260709 12:23:42.845036 25773 tablet_copy_service.cc:161] P 6e673265293d4e9a937dc45150aeb1b8: Beginning new tablet copy session on tablet 237622cb71464b3ca091560bd9d8c06b from peer a866ff967d964388a6f0dff7fd43df89 at {username='slave'} at 127.0.0.1:48606: session id = a866ff967d964388a6f0dff7fd43df89-237622cb71464b3ca091560bd9d8c06b
I20260709 12:23:42.868760 25581 catalog_manager.cc:5697] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 4 to 5, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 5 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:42.841111 27685 tablet_bootstrap.cc:492] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89: Bootstrap starting.
I20260709 12:23:42.891283 25773 tablet_copy_source_session.cc:215] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:42.898975 27718 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.906023 27718 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:42.908258 27718 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:42.909386 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:42.913890 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:42.914534 25757 raft_consensus.cc:2468] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 5.
I20260709 12:23:42.917896 25800 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:23:42.922962 27718 raft_consensus.cc:2804] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:42.935879 27718 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:42.936424 27718 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:42.933838 27677 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 237622cb71464b3ca091560bd9d8c06b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:42.945647 25678 raft_consensus.cc:1275] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:23:42.952972 27707 consensus_queue.cc:1048] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:42.972916 26437 raft_consensus.cc:1275] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:23:42.974923 27707 consensus_queue.cc:1048] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:42.997013 25678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
mode: GRACEFUL
new_leader_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:49108
I20260709 12:23:42.997658 25678 raft_consensus.cc:606] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Received request to transfer leadership to TS 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:43.008522 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:23:43.013871 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:43.015699 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:42.995720 27718 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:23:43.060729 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 49384.8us
I20260709 12:23:43.108306 27718 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:43.109897 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:43.110565 25758 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:43.119264 27677 tablet_copy_client.cc:806] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:43.134039 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:43.119889 27677 tablet_copy_client.cc:670] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:43.144969 27604 raft_consensus.cc:1064] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc: attempting to promote NON_VOTER a866ff967d964388a6f0dff7fd43df89 to VOTER
I20260709 12:23:43.122169 25758 raft_consensus.cc:2468] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 6.
I20260709 12:23:43.189098 25757 raft_consensus.cc:1240] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:43.190856 25800 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:23:43.193183 27731 raft_consensus.cc:2804] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:23:43.193773 27731 raft_consensus.cc:697] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 6 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
W20260709 12:23:43.229741 27728 log.cc:927] Time spent T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
I20260709 12:23:43.221150 27731 consensus_queue.cc:237] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:43.265046 27677 tablet_copy_client.cc:538] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:43.330904 25829 raft_consensus.cc:1240] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 6 LEADER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 5. Current term is 6. Ops: []
W20260709 12:23:43.351994 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 85902us
I20260709 12:23:43.382879 27542 consensus_queue.cc:1059] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:23:43.424616 27542 consensus_queue.cc:1243] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer 5cccf20a8bff46dba6601f241d172b8a log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 12:23:43.482290 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 64771.2us
I20260709 12:23:43.411605 27604 consensus_queue.cc:237] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:23:43.488768 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 68765.8us
W20260709 12:23:43.553805 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 65445.4us
I20260709 12:23:43.564231 27706 raft_consensus.cc:3055] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:23:43.564730 27706 raft_consensus.cc:740] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
W20260709 12:23:43.596478 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 98545us
I20260709 12:23:43.491839 27710 consensus_queue.cc:1059] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.099s
I20260709 12:23:43.612509 27734 raft_consensus.cc:1064] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a: attempting to promote NON_VOTER a866ff967d964388a6f0dff7fd43df89 to VOTER
W20260709 12:23:43.667595 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 114077us
I20260709 12:23:43.675799 27706 consensus_queue.cc:260] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:23:43.678578 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:43.728921 27677 tablet_bootstrap.cc:492] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89: Bootstrap starting.
W20260709 12:23:43.730374 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 43698.1us
W20260709 12:23:43.784677 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 165605us
I20260709 12:23:43.877947 26438 raft_consensus.cc:1275] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 3 LEARNER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:23:43.909145 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 187584us
I20260709 12:23:43.895622 27750 consensus_queue.cc:1048] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:23:43.940963 25755 raft_consensus.cc:1275] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:23:43.989768 27478 consensus_queue.cc:1048] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:43.992568 25832 raft_consensus.cc:1275] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:23:43.960520 27734 consensus_queue.cc:237] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:44.043776 27604 raft_consensus.cc:993] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc: : Instructing follower 6e673265293d4e9a937dc45150aeb1b8 to start an election
I20260709 12:23:44.044363 27604 raft_consensus.cc:1081] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Signalling peer 6e673265293d4e9a937dc45150aeb1b8 to start an election
W20260709 12:23:44.059551 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 90168us
W20260709 12:23:44.064692 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:44.065917 25760 raft_consensus.cc:1275] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:23:44.070572 27706 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:44.085788 25755 raft_consensus.cc:1240] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 12:23:44.090565 27752 consensus_queue.cc:1048] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 12:23:44.139377 25757 raft_consensus.cc:1275] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:44.161024 27685 tablet_bootstrap.cc:492] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:44.162068 27685 tablet_bootstrap.cc:492] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89: Bootstrap complete.
I20260709 12:23:44.162814 27685 ts_tablet_manager.cc:1403] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89: Time spent bootstrapping tablet: real 1.322s	user 0.033s	sys 0.030s
I20260709 12:23:44.167505 27716 consensus_queue.cc:1048] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:44.192068 27685 raft_consensus.cc:359] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:44.193981 27685 raft_consensus.cc:740] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Initialized, Role: LEARNER
I20260709 12:23:44.195389 27685 consensus_queue.cc:260] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:44.207192 27685 ts_tablet_manager.cc:1434] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.005s
I20260709 12:23:44.930631 27677 tablet_bootstrap.cc:492] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:44.998358 27677 tablet_bootstrap.cc:492] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89: Bootstrap complete.
I20260709 12:23:44.999408 27677 ts_tablet_manager.cc:1403] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89: Time spent bootstrapping tablet: real 1.271s	user 0.041s	sys 0.016s
I20260709 12:23:45.002262 27677 raft_consensus.cc:359] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:45.003393 27677 raft_consensus.cc:740] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Initialized, Role: LEARNER
I20260709 12:23:45.005290 27677 consensus_queue.cc:260] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:45.008589 27677 ts_tablet_manager.cc:1434] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:23:45.311650 27773 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:45.314638 27775 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:45.315307 27775 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:45.318275 27775 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:45.320356 27775 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:45.320787 27774 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:45.321374 27774 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:45.323367 27774 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:45.323993 27775 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:45.326151 27775 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:45.326633 27776 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:45.327256 27776 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:45.329485 27776 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:45.332077 27773 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:45.333887 27773 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:45.340302 27772 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:45.340884 27772 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:45.343255 27772 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:45.343807 27772 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:45.344334 27772 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:45.346598 27772 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:45.368048 27779 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:45.368911 27779 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:45.371891 27779 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:45.380594 27747 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:45.390540 27747 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:45.393182 27747 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:45.400470 27779 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:45.401209 27779 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:45.403442 27779 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:45.411720 27780 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:45.453140 27784 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:45.453281 27780 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:45.455070 27789 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:45.455590 27789 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:45.457171 27780 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:45.457713 27789 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:23:45.412442 25758 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.235s	user 0.006s	sys 0.011s
W20260709 12:23:45.459609 25758 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.282s	user 0.006s	sys 0.011s
I20260709 12:23:45.424546 27774 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:45.460453 27772 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:45.460969 27772 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:45.461508 25758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 1832) took 1286 ms. Trace:
I20260709 12:23:45.425055 27773 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:45.462894 27772 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:45.463239 27773 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:45.430809 25581 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41232 (request call id 384) took 1779 ms. Trace:
I20260709 12:23:45.409409 27756 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:45.468672 27776 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:45.468994 27756 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:45.469705 27788 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:45.469386 27776 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:45.470198 27788 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:45.471141 27756 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:45.429270 27759 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:45.472375 27776 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:45.472930 27776 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:45.472687 27759 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:45.473182 27787 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:45.473276 27792 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:45.473448 27776 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:45.473815 27787 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:45.473948 27792 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:45.475489 27776 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:45.426518 27775 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:45.445403 27766 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:45.460235 27774 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:45.479691 27766 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:45.479403 27792 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:45.464824 25581 rpcz_store.cc:276] 0709 12:23:43.651844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:43.652141 (+   297us) service_pool.cc:224] Handling call
0709 12:23:45.430734 (+1778593us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 12:23:45.462037 25758 rpcz_store.cc:276] 0709 12:23:44.174803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:44.175024 (+   221us) service_pool.cc:224] Handling call
0709 12:23:44.175546 (+   522us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:44.176066 (+   520us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:44.176109 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:44.177201 (+  1092us) log.cc:844] Serialized 572 byte log entry
0709 12:23:45.461025 (+1283824us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:45.461083 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.461182 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:45.461239 (+    57us) raft_consensus.cc:1685] finished
0709 12:23:45.461260 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:45.461412 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1282506,"threads_started":1,"wal-append.queue_time_us":21027,"wal-append.run_cpu_time_us":2147,"wal-append.run_wall_time_us":1083055}
I20260709 12:23:45.467038 27773 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:45.430595 27737 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:45.786276 27737 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:45.471637 27756 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:45.477941 27780 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:45.788398 27756 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:45.788564 27780 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:45.478569 27784 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:45.791257 27780 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:45.792179 27784 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:45.490291 27766 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:45.792991 27766 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:45.793490 27766 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:45.795467 27766 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:45.490579 27790 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:45.491652 27775 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:45.481057 27774 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:45.484256 27792 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:45.815754 27792 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:45.818569 27792 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:45.495934 27746 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:45.819525 27746 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:45.822280 27746 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:45.495975 27772 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:45.823320 27772 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:45.826051 27772 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:45.503582 27788 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:45.487382 27787 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:45.508739 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:45.508445 27786 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:45.510242 27783 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:45.832456 26437 raft_consensus.cc:2468] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 3.
I20260709 12:23:45.515671 27794 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:45.832749 27783 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:45.833510 27794 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:45.834928 27783 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:45.517510 27791 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:45.836254 27791 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:45.519039 27781 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:45.520686 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:45.521543 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:45.504338 27779 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:45.537420 27795 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:45.540899 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:45.519552 27773 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:45.520576 27789 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:45.542430 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:45.545065 27763 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:45.544624 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:45.522092 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:45.574572 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:45.542094 27777 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:45.546419 27785 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
W20260709 12:23:45.605074 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 57695.5us
I20260709 12:23:45.848759 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:45.835639 27794 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:45.615551 27800 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:45.616842 27742 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:45.620921 27656 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:45.595718 27778 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:45.649717 27805 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
W20260709 12:23:45.660995 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 116707us
I20260709 12:23:45.668982 27776 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:45.673311 27801 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:45.680380 27803 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:45.682606 27802 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:45.694689 27810 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:45.695434 27809 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:45.697666 27815 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:45.711416 27808 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:45.696163 27797 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:45.721271 27817 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:45.701525 27813 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:45.724772 27818 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:45.871338 27797 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:45.849962 27789 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:45.861918 27742 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:45.872095 27818 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:45.848599 27773 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:45.873713 27797 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:45.725632 27798 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:45.692286 27799 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:45.700289 27812 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:45.701267 27814 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:45.731113 27807 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:45.748533 27806 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:45.781105 27782 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:45.795902 27766 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:45.799780 27759 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:45.984153 27818 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:23:45.953271 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 214980us
I20260709 12:23:45.985939 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:23:45.595081 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 63192.3us
I20260709 12:23:45.695369 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:45.695595 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:45.996841 25685 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 2.
I20260709 12:23:45.997509 25677 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 4.
I20260709 12:23:45.505045 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:23:45.640897 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 127697us
I20260709 12:23:45.999281 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:45.702793 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:45.697075 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:46.002568 25686 raft_consensus.cc:2468] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 2.
I20260709 12:23:45.730523 25755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 2208) took 1715 ms. Trace:
I20260709 12:23:46.003876 25755 rpcz_store.cc:276] 0709 12:23:44.015068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:44.015236 (+   168us) service_pool.cc:224] Handling call
0709 12:23:44.085558 (+ 70322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:44.086231 (+   673us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.730325 (+1644094us) spinlock_profiling.cc:243] Waited 36.6 ms on lock 0x7b54001dc9d0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b608ad 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:23:45.730462 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":84097280}
I20260709 12:23:45.702375 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:46.010711 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:45.703004 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:46.013183 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:46.013402 25758 raft_consensus.cc:2468] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 3.
I20260709 12:23:45.706825 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:46.016654 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:46.005717 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:46.018348 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:45.840094 25829 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 7.
I20260709 12:23:45.761576 25831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44218 (request call id 1250) took 1637 ms. Trace:
I20260709 12:23:45.594329 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:23:46.030584 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:45.619274 25773 tablet_copy_service.cc:342] P 6e673265293d4e9a937dc45150aeb1b8: Request end of tablet copy session a866ff967d964388a6f0dff7fd43df89-237622cb71464b3ca091560bd9d8c06b received from {username='slave'} at 127.0.0.1:48606
I20260709 12:23:45.848438 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:46.063279 25773 tablet_copy_service.cc:434] P 6e673265293d4e9a937dc45150aeb1b8: ending tablet copy session a866ff967d964388a6f0dff7fd43df89-237622cb71464b3ca091560bd9d8c06b on tablet 237622cb71464b3ca091560bd9d8c06b with peer a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:45.840338 25837 raft_consensus.cc:2468] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 2.
I20260709 12:23:46.063313 27819 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
W20260709 12:23:45.968447 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 130686us
I20260709 12:23:45.968621 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:45.970212 25847 tablet_copy_service.cc:342] P 5cccf20a8bff46dba6601f241d172b8a: Request end of tablet copy session a866ff967d964388a6f0dff7fd43df89-51d1a71a6e1f4e20842a35cdeb808ac0 received from {username='slave'} at 127.0.0.1:41782
I20260709 12:23:45.862949 27656 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:45.798660 27737 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:45.754736 27739 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:46.088117 25847 tablet_copy_service.cc:434] P 5cccf20a8bff46dba6601f241d172b8a: ending tablet copy session a866ff967d964388a6f0dff7fd43df89-51d1a71a6e1f4e20842a35cdeb808ac0 on tablet 51d1a71a6e1f4e20842a35cdeb808ac0 with peer a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:45.871506 27748 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:45.800856 27756 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:45.865550 27763 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:45.814930 27775 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:45.867722 27776 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:46.126210 27776 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:45.850418 27777 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:45.864017 27778 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:46.132167 26438 raft_consensus.cc:2468] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 2.
I20260709 12:23:45.849078 27779 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:45.839146 27780 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:46.132478 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:46.133544 27780 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:46.134410 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:46.135003 27779 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:45.888494 27784 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:45.867328 27785 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:46.136240 27784 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:46.138368 27785 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:45.839330 27788 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:46.139246 27784 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:46.139714 27788 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:46.140607 27780 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:45.797202 27790 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:46.150421 27790 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:45.902344 27791 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:45.848891 27795 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:46.153476 27795 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:45.880491 27798 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:45.883137 27799 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:45.852700 27800 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:45.869745 27801 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:45.870813 27802 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:45.869144 27803 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:45.867591 27805 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:45.893785 27806 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:45.888432 27807 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:45.874749 27808 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:45.875028 27809 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:45.874818 27810 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:45.741063 27811 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:45.888638 27812 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:45.874559 27813 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:45.888590 27814 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:45.874897 27815 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:45.880734 27817 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:45.975471 27766 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:45.977725 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:45.978503 27743 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:45.979943 27773 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:45.980122 27787 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:45.980844 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:45.892571 27782 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:45.982887 27783 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:45.983361 25759 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:53474
I20260709 12:23:45.983722 27794 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:45.842022 27781 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:45.521782 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:45.989254 27789 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:45.989389 27821 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:45.873731 27742 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:45.990803 27774 consensus_queue.cc:1048] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:45.992797 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:46.014868 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:46.029626 27825 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:45.987553 27595 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:46.030834 25831 rpcz_store.cc:276] 0709 12:23:44.124321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:44.124422 (+   101us) service_pool.cc:224] Handling call
0709 12:23:45.760608 (+1636186us) spinlock_profiling.cc:243] Waited 2.86 ms on lock 0x7b5800133e98. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d96a3cb71 00007f5d96a3ca22 00007f5d9f9558d9 00007f5d9eaafee0 00007f5d9eb790ab 00007f5d9eb79131 00007f5d9eb3afc0 00007f5d9eb25929 00007f5d9eb253d2 00007f5d9809cbd4
0709 12:23:45.760874 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:45.761114 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:45.761153 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:45.761208 (+    55us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:45.761256 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:45.761330 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:45.761469 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6568192}
I20260709 12:23:46.070088 27819 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:46.072687 27747 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:46.014899 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:45.338783 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:46.082484 25582 catalog_manager.cc:5697] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 5 to 6, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 6 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
W20260709 12:23:46.110085 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:46.072197 27818 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:46.117338 27748 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:46.122125 27763 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:46.088667 27739 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:45.832494 27786 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:46.144999 27788 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:46.141009 27656 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:46.157823 27798 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:46.131899 27778 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:46.167006 27801 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:46.170158 27803 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:46.186367 27805 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:46.187841 27806 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:46.188724 26437 raft_consensus.cc:2468] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 4.
I20260709 12:23:46.194128 27811 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:46.200122 25759 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:46.204344 27787 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:46.204218 25681 raft_consensus.cc:2468] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 2.
I20260709 12:23:46.189563 27823 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:46.198369 27777 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:23:46.296271 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 93142.3us
I20260709 12:23:46.356350 27783 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:46.357643 27808 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:46.359818 27766 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:46.360057 27810 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:46.360157 27799 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:46.199798 27743 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:46.361737 27813 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:46.362564 27807 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:46.366726 27800 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:46.207866 26434 raft_consensus.cc:2468] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 3.
I20260709 12:23:46.360261 25759 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:46.352571 27802 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:23:46.371094 26402 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.245.131:36237 timed out after 1.636s (SENT) [suppressed 6 similar messages]
I20260709 12:23:46.371575 27781 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:46.372184 27812 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:46.373827 27809 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:46.366825 27821 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:46.383490 25757 raft_consensus.cc:2468] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 5.
I20260709 12:23:46.389084 27814 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:46.292203 27829 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:46.218266 27794 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:46.392187 27773 raft_consensus.cc:2955] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:46.366118 27595 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:46.363739 27823 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:46.381949 27825 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:23:46.562408 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:46.575460 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 270593us
I20260709 12:23:46.569044 25686 raft_consensus.cc:1275] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:46.611820 26401 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:46.612833 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:46.643800 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:46.612432 27787 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:46.552237 27743 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349)
I20260709 12:23:46.399500 27739 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:46.592348 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:23:46.834234 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 644282us
I20260709 12:23:46.384212 27818 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:46.798823 25726 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:46.737249 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:23:46.855580 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 491030us
I20260709 12:23:46.801066 27782 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:46.847028 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:46.800475 27821 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:46.802438 27819 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:46.802719 27811 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:46.800026 27794 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:46.563386 27747 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:46.869807 27823 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:46.870426 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:46.871248 27747 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:46.871938 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:46.872594 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:46.874208 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:46.875847 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:46.876827 27786 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:46.876979 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:23:46.860280 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 61629us
I20260709 12:23:46.876988 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:46.879825 26439 raft_consensus.cc:1275] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:46.881572 27815 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:46.883097 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:46.884311 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:46.884511 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:46.885774 27815 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:46.884402 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:46.886271 27815 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:46.872692 25756 raft_consensus.cc:2468] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 3.
I20260709 12:23:46.888502 27815 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:46.888878 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:46.889046 27815 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:46.889722 27815 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:46.890045 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:46.890744 25758 raft_consensus.cc:2468] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 3.
I20260709 12:23:46.885247 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:46.891727 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:46.868008 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:23:46.797681 26460 debug-util.cc:398] Leaking SignalData structure 0x7b080006f3a0 after lost signal to thread 24537
I20260709 12:23:46.889539 25756 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 6.
I20260709 12:23:46.843204 27829 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:47.022325 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:46.978288 25686 raft_consensus.cc:1275] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
W20260709 12:23:47.084929 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:47.023557 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:47.032084 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:46.858795 27802 raft_consensus.cc:2804] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:47.036165 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:47.039073 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:47.112521 25757 raft_consensus.cc:2410] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 2 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
W20260709 12:23:46.914817 25759 consensus_meta.cc:287] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.536s	user 0.009s	sys 0.003s
I20260709 12:23:47.103359 25686 pending_rounds.cc:85] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc: Aborting all ops after (but not including) 4
W20260709 12:23:46.978803 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 63756.1us
I20260709 12:23:47.107374 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:46.863447 27787 raft_consensus.cc:2804] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:47.113376 25759 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:46.991688 25680 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 4.
I20260709 12:23:47.114499 27794 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:47.117496 27821 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:47.117578 27794 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:47.118238 27821 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:46.892437 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:47.120182 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:46.912629 26434 raft_consensus.cc:1217] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:23:47.121572 27821 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:47.122031 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:23:47.037242 26460 debug-util.cc:398] Leaking SignalData structure 0x7b08002e96e0 after lost signal to thread 25618
I20260709 12:23:46.891842 27815 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:47.020771 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:46.737521 27748 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:47.136168 25650 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:47.043231 27796 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:47.117992 25759 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:47.021610 27823 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:47.137161 27796 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:47.137614 27823 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:47.038339 27818 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:47.025624 27595 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:47.116444 27787 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:47.140348 27787 raft_consensus.cc:3060] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:47.024012 27783 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:47.137542 25759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:53474 (request call id 2214) took 1156 ms. Trace:
I20260709 12:23:47.113543 25686 pending_rounds.cc:107] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 12:23:47.112495 27802 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:47.141631 27802 raft_consensus.cc:3060] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:47.140569 26401 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:47.141235 25686 raft_consensus.cc:2889] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:47.141669 25759 rpcz_store.cc:276] 0709 12:23:45.981040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.983042 (+  2002us) service_pool.cc:224] Handling call
0709 12:23:47.137456 (+1154414us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:47.144205 27595 raft_consensus.cc:2804] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:47.146556 27595 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:47.146998 27595 raft_consensus.cc:3060] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:47.139693 27796 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:23:47.142485 26460 debug-util.cc:398] Leaking SignalData structure 0x7b0800322820 after lost signal to thread 25711
W20260709 12:23:47.152782 26460 debug-util.cc:398] Leaking SignalData structure 0x7b080034bfe0 after lost signal to thread 25712
I20260709 12:23:47.144444 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:47.144444 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:23:47.154186 26460 debug-util.cc:398] Leaking SignalData structure 0x7b0800318b00 after lost signal to thread 25787
I20260709 12:23:47.145613 25726 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:47.114728 26437 raft_consensus.cc:2468] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 3.
I20260709 12:23:47.163147 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:47.166208 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:47.167972 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:47.169097 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:47.167845 27821 raft_consensus.cc:2804] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:47.171818 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:47.176363 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:47.178027 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:47.172955 27821 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:47.184317 27821 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:47.190466 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:47.180068 25726 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:47.192402 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:47.166476 27787 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:47.196184 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:47.198808 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:47.200609 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:23:47.203341 26460 debug-util.cc:398] Leaking SignalData structure 0x7b0800300980 after lost signal to thread 25861
I20260709 12:23:47.203506 27796 raft_consensus.cc:2804] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:23:47.203775 26460 debug-util.cc:398] Leaking SignalData structure 0x7b08003841a0 after lost signal to thread 25862
I20260709 12:23:47.204087 27796 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:47.204630 27796 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:23:47.205413 26460 debug-util.cc:398] Leaking SignalData structure 0x7b080033f220 after lost signal to thread 26463
W20260709 12:23:47.205765 26460 debug-util.cc:398] Leaking SignalData structure 0x7b08001157e0 after lost signal to thread 26464
I20260709 12:23:47.207262 27794 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:47.210748 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:47.213804 27748 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:47.220137 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:47.214498 27748 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:47.232766 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:47.277634 25726 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:47.289498 26436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 588) took 1321 ms. Trace:
I20260709 12:23:47.290055 26436 rpcz_store.cc:276] 0709 12:23:45.967876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.979395 (+ 11519us) service_pool.cc:224] Handling call
0709 12:23:45.980012 (+   617us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:46.088679 (+108667us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:46.088711 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:46.088789 (+    78us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:46.088834 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:47.289053 (+1200219us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b54003cb4d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:23:47.289115 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:47.289282 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":248637184}
I20260709 12:23:47.292207 27829 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:47.292995 25754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 2215) took 1311 ms. Trace:
I20260709 12:23:47.292280 25761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 1836) took 1317 ms. Trace:
W20260709 12:23:47.296644 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:47.297724 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:47.298502 27833 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:47.299340 27833 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:47.299602 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:47.301371 27595 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:47.301872 27833 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:47.292791 27829 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:47.231495 27794 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:47.296638 25761 rpcz_store.cc:276] 0709 12:23:45.990479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.996127 (+  5648us) service_pool.cc:224] Handling call
0709 12:23:45.996737 (+   610us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:46.174158 (+177421us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:46.174192 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:46.174330 (+   138us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:46.174379 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:47.291841 (+1117462us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b54000032d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:23:47.291902 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:47.292076 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":388123008}
I20260709 12:23:47.294902 25754 rpcz_store.cc:276] 0709 12:23:45.981450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.984787 (+  3337us) service_pool.cc:224] Handling call
0709 12:23:45.985338 (+   551us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:46.191191 (+205853us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:46.191234 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:46.191302 (+    68us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:23:46.191338 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:47.292683 (+1101345us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b54003976d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:23:47.292721 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:47.292839 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":469710592}
W20260709 12:23:47.308169 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 193218us
I20260709 12:23:47.307792 27779 raft_consensus.cc:2804] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:47.311981 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:47.312206 27779 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:47.312738 27779 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:47.313175 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:47.313850 26437 raft_consensus.cc:2468] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 2.
W20260709 12:23:47.315374 26460 debug-util.cc:398] Leaking SignalData structure 0x7b08002c3820 after lost signal to thread 27685
W20260709 12:23:47.316049 26438 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 584) took 1350 ms (client timeout 1736 ms). Trace:
I20260709 12:23:47.316217 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:23:47.316568 26438 rpcz_store.cc:269] 0709 12:23:45.965634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.985323 (+ 19689us) service_pool.cc:224] Handling call
0709 12:23:47.315816 (+1330493us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b54004c8bd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:23:47.315960 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":333723392}
I20260709 12:23:47.316954 25754 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 3.
I20260709 12:23:47.317976 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:23:47.310532 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 174618us
I20260709 12:23:47.319518 25680 raft_consensus.cc:2468] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 2.
I20260709 12:23:47.310539 27833 raft_consensus.cc:2804] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:23:47.323825 25650 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:47.316108 27743 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:47.309855 27818 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:47.328500 27823 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:47.309154 27829 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:47.329099 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:47.331202 25836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41782 (request call id 414) took 1363 ms. Trace:
I20260709 12:23:47.332999 27787 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:47.333122 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:47.333614 27802 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:47.323064 26435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 582) took 1469 ms. Trace:
I20260709 12:23:47.345392 25761 raft_consensus.cc:2468] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 4.
I20260709 12:23:47.345928 25836 rpcz_store.cc:276] 0709 12:23:45.971511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:47.330163 (+1358652us) service_pool.cc:224] Handling call
0709 12:23:47.330486 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:47.330748 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:47.330775 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:47.330842 (+    67us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:47.330872 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:47.330925 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:47.331033 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:47.351403 27747 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:47.352300 27802 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:47.352438 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:47.352622 25833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44218 (request call id 1256) took 1390 ms. Trace:
I20260709 12:23:47.354504 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:47.359301 25754 raft_consensus.cc:2468] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 1.
I20260709 12:23:47.358948 25833 rpcz_store.cc:276] 0709 12:23:45.962542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.962837 (+   295us) service_pool.cc:224] Handling call
0709 12:23:45.963691 (+   854us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:46.152341 (+188650us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:46.152388 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:46.152486 (+    98us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:46.152571 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:47.352236 (+1199665us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b5400245754. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:23:47.352280 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:47.352425 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":432621440}
I20260709 12:23:47.366935 26432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36518 (request call id 543) took 1356 ms. Trace:
I20260709 12:23:47.366894 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:47.327673 27794 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:47.372299 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:47.357805 27743 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:47.375053 25754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 1840) took 1382 ms. Trace:
I20260709 12:23:47.375438 25754 rpcz_store.cc:276] 0709 12:23:45.992494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:47.373334 (+1380840us) service_pool.cc:224] Handling call
0709 12:23:47.374512 (+  1178us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:47.374744 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:47.374768 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:47.374806 (+    38us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:47.374842 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:47.374897 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:47.374998 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:47.354357 27823 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:47.353363 26435 rpcz_store.cc:276] 0709 12:23:45.849347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.978310 (+128963us) service_pool.cc:224] Handling call
0709 12:23:45.978990 (+   680us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:46.164161 (+185171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:46.165640 (+  1479us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:46.167525 (+  1885us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:46.171127 (+  3602us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:47.309641 (+1138514us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b54007d5ad4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:23:47.309700 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:47.311400 (+  1700us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":423516928}
I20260709 12:23:47.367481 26432 rpcz_store.cc:276] 0709 12:23:46.014482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:46.204230 (+189748us) service_pool.cc:224] Handling call
0709 12:23:47.320208 (+1115978us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:47.323218 (+  3010us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:47.323255 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:47.323327 (+    72us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:47.324251 (+   924us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:47.325975 (+  1724us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:47.366754 (+ 40779us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54004c8bd0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b608ad 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:23:47.366873 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2558085888}
I20260709 12:23:47.370786 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:47.358570 27796 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:47.347667 27818 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:47.358417 27821 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:47.392350 25836 raft_consensus.cc:2468] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 2.
I20260709 12:23:47.401108 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:47.402707 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:47.409583 27797 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:47.410311 27797 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:47.413286 27836 raft_consensus.cc:2804] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:47.413741 27836 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:47.414150 27836 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:47.424317 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:47.425060 27748 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:47.426342 27595 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:47.427614 27743 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:47.429219 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:47.426163 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:47.383376 27747 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:23:47.434937 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 74018.5us
I20260709 12:23:47.435031 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:47.394361 27779 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:47.441318 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:47.442312 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:47.442812 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:47.444154 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:47.445290 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:47.446425 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:47.447786 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:47.450593 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:47.397167 27823 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:47.452826 25758 raft_consensus.cc:2393] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 3: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:23:47.452958 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:47.452769 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:47.455183 27794 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:47.455289 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:47.454025 27811 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:47.457285 27811 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:47.458850 25726 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:47.460659 27796 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:47.460884 27818 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:47.458310 25836 raft_consensus.cc:2955] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:47.456362 27815 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:47.465946 27797 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:47.465900 27815 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:47.461441 27818 raft_consensus.cc:2749] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:47.463150 27747 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:47.463526 27779 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:47.455982 27821 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:47.459609 27811 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:47.469116 27817 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:47.469295 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:47.470252 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:47.471159 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:47.494614 27840 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:47.495191 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:47.495286 25583 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52974 (request call id 251) took 3843 ms. Trace:
I20260709 12:23:47.474767 25830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44218 (request call id 1252) took 1627 ms. Trace:
I20260709 12:23:47.495347 27840 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:47.496861 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:47.498517 25683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 1795) took 1133 ms. Trace:
I20260709 12:23:47.515396 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:47.496140 25830 rpcz_store.cc:276] 0709 12:23:45.847708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.847873 (+   165us) service_pool.cc:224] Handling call
0709 12:23:46.073835 (+225962us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:46.074382 (+   547us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:46.074409 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:46.074489 (+    80us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:46.074543 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:46.074636 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:47.474421 (+1399785us) spinlock_profiling.cc:243] Waited 223 ms on lock 0x7b5400117450. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b608ad 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:23:47.474603 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":512549120}
I20260709 12:23:47.500792 27815 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:23:47.496264 25762 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53474 (request call id 2218) took 1478 ms (client timeout 1955 ms). Trace:
I20260709 12:23:47.516794 25677 raft_consensus.cc:2468] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 3.
I20260709 12:23:47.516008 25685 raft_consensus.cc:3055] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:47.516925 25754 raft_consensus.cc:1240] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:47.517375 25685 raft_consensus.cc:740] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:47.518323 25685 consensus_queue.cc:260] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:47.518920 25754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 1842) took 1525 ms. Trace:
I20260709 12:23:47.519269 25685 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:47.520655 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:47.499464 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:47.522483 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:47.523015 25755 raft_consensus.cc:3060] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:47.506726 26401 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:47.529855 27833 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:47.530062 27743 raft_consensus.cc:2804] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:47.530375 27833 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:47.530719 27743 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:47.531272 27743 raft_consensus.cc:3060] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:47.533025 25760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 1839) took 1540 ms. Trace:
I20260709 12:23:47.533398 25760 rpcz_store.cc:276] 0709 12:23:45.992126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:47.532081 (+1539955us) service_pool.cc:224] Handling call
0709 12:23:47.532384 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:47.532573 (+   189us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:47.532598 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:47.532651 (+    53us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:47.532686 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:47.532757 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:47.532858 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:47.534598 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:47.535180 25760 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 4.
I20260709 12:23:47.536720 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:47.537343 25756 raft_consensus.cc:2468] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 3.
I20260709 12:23:47.538127 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:47.539314 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:23:47.516743 25762 rpcz_store.cc:269] 0709 12:23:46.017841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:47.469979 (+1452138us) service_pool.cc:224] Handling call
0709 12:23:47.496208 (+ 26229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:47.500468 25686 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 6.
I20260709 12:23:47.535211 25685 raft_consensus.cc:2468] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 2.
I20260709 12:23:47.542567 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:47.544586 25682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 1798) took 1149 ms. Trace:
I20260709 12:23:47.544500 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:47.545179 25682 rpcz_store.cc:276] 0709 12:23:46.394964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:46.420819 (+ 25855us) service_pool.cc:224] Handling call
0709 12:23:47.540430 (+1119611us) spinlock_profiling.cc:243] Waited 1.05 ms on lock 0x7b5800003698. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d96a3cb71 00007f5d96a3ca22 00007f5d9f9558d9 00007f5d9eaafee0 00007f5d9eb790ab 00007f5d9eb79131 00007f5d9eb3afc0 00007f5d9eb25929 00007f5d9eb253d2 00007f5d9809cbd4
0709 12:23:47.542992 (+  2562us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:47.543162 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:47.543189 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:47.543234 (+    45us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:47.543274 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:47.543344 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:47.544308 (+   964us) spinlock_profiling.cc:243] Waited 2.36 ms on lock 0x7b5400203850. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b608ad 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:23:47.544430 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7848576}
I20260709 12:23:47.546466 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:47.548180 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:47.549015 26438 raft_consensus.cc:2468] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 1.
I20260709 12:23:47.550160 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:47.498243 27840 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:47.553009 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:47.553890 25757 raft_consensus.cc:2468] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 2.
I20260709 12:23:47.555068 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:47.539868 25756 raft_consensus.cc:2468] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 2.
I20260709 12:23:47.556734 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:47.558091 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:47.561154 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:47.562121 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:47.565783 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:47.566557 25756 raft_consensus.cc:2393] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 2: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:23:47.568531 25837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44218 (request call id 1260) took 1603 ms. Trace:
I20260709 12:23:47.568892 25837 rpcz_store.cc:276] 0709 12:23:45.964655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:46.075844 (+111189us) service_pool.cc:224] Handling call
0709 12:23:46.106441 (+ 30597us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:46.388291 (+281850us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:46.388351 (+    60us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:46.388436 (+    85us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:46.388488 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:47.568203 (+1179715us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b5400246b54. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:23:47.568253 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:47.568379 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":623880960}
I20260709 12:23:47.514981 25683 rpcz_store.cc:276] 0709 12:23:46.365154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:46.368148 (+  2994us) service_pool.cc:224] Handling call
0709 12:23:47.497375 (+1129227us) spinlock_profiling.cc:243] Waited 21.5 ms on lock 0x7b5800003698. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d96a3ce9c 00007f5d96a3ca5b 00007f5d9f9558d9 00007f5d9eaafee0 00007f5d9eb790ab 00007f5d9eb79131 00007f5d9eb3afc0 00007f5d9eb25929 00007f5d9eb253d2 00007f5d9809cbd4
0709 12:23:47.497590 (+   215us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:47.497874 (+   284us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:47.497942 (+    68us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:47.498018 (+    76us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:47.498067 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:47.498142 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:47.498284 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49477120}
I20260709 12:23:47.571779 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:47.572427 25760 raft_consensus.cc:2468] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 3.
I20260709 12:23:47.573252 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:47.573848 25760 raft_consensus.cc:2393] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 4: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:23:47.576596 25684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51578 (request call id 405) took 1181 ms. Trace:
I20260709 12:23:47.576996 25684 rpcz_store.cc:276] 0709 12:23:46.405440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:46.420443 (+ 15003us) service_pool.cc:224] Handling call
0709 12:23:46.420777 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:46.797953 (+377176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:46.798003 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:46.798082 (+    79us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:46.798136 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:47.576249 (+778113us) spinlock_profiling.cc:243] Waited 314 ms on lock 0x7b54002a0b54. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:23:47.576301 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:47.576429 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":722193792}
I20260709 12:23:47.579171 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:47.579936 26434 raft_consensus.cc:2468] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 3.
I20260709 12:23:47.580299 25678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 1800) took 1003 ms. Trace:
I20260709 12:23:47.580700 25678 rpcz_store.cc:276] 0709 12:23:46.577217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:46.577409 (+   192us) service_pool.cc:224] Handling call
0709 12:23:47.579561 (+1002152us) spinlock_profiling.cc:243] Waited 1.2 ms on lock 0x7b5800003698. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d96a3cb71 00007f5d96a3ceee 000000000036eb39 00007f5d9eab01e0 00007f5d9eb790c4 00007f5d9eb79131 00007f5d9eb3afc0 00007f5d9eb25929 00007f5d9eb253d2 00007f5d9809cbd4
0709 12:23:47.579706 (+   145us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:47.579884 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:47.579906 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:47.579980 (+    74us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:47.580010 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:47.580057 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:47.580152 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2749824}
I20260709 12:23:47.567345 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:47.505550 25763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48606 (request call id 410) took 1800 ms. Trace:
W20260709 12:23:47.581306 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:47.583113 25756 raft_consensus.cc:1240] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 2. Current term is 3. Ops: []
W20260709 12:23:47.514420 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 46560.2us
I20260709 12:23:47.562196 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:47.519484 25754 rpcz_store.cc:276] 0709 12:23:45.993207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:47.376481 (+1383274us) service_pool.cc:224] Handling call
0709 12:23:47.516691 (+140210us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:47.517596 (+   905us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:47.518643 (+  1047us) spinlock_profiling.cc:243] Waited 140 ms on lock 0x7b5400040bd0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b608ad 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:23:47.518815 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":321643264}
I20260709 12:23:47.555804 25757 raft_consensus.cc:2468] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 5.
I20260709 12:23:47.529855 26401 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:47.558677 26431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 593) took 1588 ms. Trace:
I20260709 12:23:47.590914 26431 rpcz_store.cc:276] 0709 12:23:45.970418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:46.000930 (+ 30512us) service_pool.cc:224] Handling call
0709 12:23:46.001344 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:46.368998 (+367654us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:23:46.370022 (+  1024us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:46.371290 (+  1268us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:46.371380 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:47.558353 (+1186973us) spinlock_profiling.cc:243] Waited 367 ms on lock 0x7b54007c9f54. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:23:47.558429 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:47.558597 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":844635392}
I20260709 12:23:47.592499 25754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48606 (request call id 413) took 1431 ms. Trace:
I20260709 12:23:47.592432 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:47.592963 25754 rpcz_store.cc:276] 0709 12:23:46.160721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:47.591372 (+1430651us) service_pool.cc:224] Handling call
0709 12:23:47.591653 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:47.591843 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:47.591866 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:47.591904 (+    38us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:47.592301 (+   397us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:47.592352 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:47.592451 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:47.495896 25583 rpcz_store.cc:276] 0709 12:23:43.651339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:43.651482 (+   143us) service_pool.cc:224] Handling call
0709 12:23:47.494960 (+3843478us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2028838,"reported_tablets":1}
I20260709 12:23:47.583112 25763 rpcz_store.cc:276] 0709 12:23:45.705385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.705484 (+    99us) service_pool.cc:224] Handling call
0709 12:23:45.705706 (+   222us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:46.162144 (+456438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:46.162205 (+    61us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:46.162262 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:46.162310 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:47.505065 (+1342755us) spinlock_profiling.cc:243] Waited 454 ms on lock 0x7b54001a77d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:23:47.505123 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:47.505344 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1044808576}
I20260709 12:23:47.593825 27829 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:47.594879 27595 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
W20260709 12:23:47.594728 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 64983.4us
I20260709 12:23:47.596135 27748 raft_consensus.cc:2804] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:47.596516 27748 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:47.596891 27748 raft_consensus.cc:3060] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:47.558571 27815 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:47.599434 27815 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:47.595427 27595 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:47.600895 25756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 1847) took 1594 ms. Trace:
I20260709 12:23:47.601349 25756 rpcz_store.cc:276] 0709 12:23:45.995249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:47.582637 (+1587388us) service_pool.cc:224] Handling call
0709 12:23:47.582945 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:47.589162 (+  6217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:47.589333 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:47.602043 27595 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:47.511459 25834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41782 (request call id 415) took 1456 ms. Trace:
I20260709 12:23:47.608462 25755 raft_consensus.cc:2468] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 4.
I20260709 12:23:47.602051 25758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 2216) took 1581 ms. Trace:
I20260709 12:23:47.610100 25758 rpcz_store.cc:276] 0709 12:23:46.017042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:47.589015 (+1571973us) service_pool.cc:224] Handling call
0709 12:23:47.597043 (+  8028us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:47.597430 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:47.597455 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:47.597861 (+   406us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:47.597919 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:47.597983 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:47.598478 (+   495us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:47.603097 25834 rpcz_store.cc:276] 0709 12:23:46.055103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:47.509996 (+1454893us) service_pool.cc:224] Handling call
0709 12:23:47.510508 (+   512us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:47.510814 (+   306us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:47.510861 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:47.510947 (+    86us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:47.511019 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:47.511100 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:47.511259 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:47.614254 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:47.614929 25759 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 2.
I20260709 12:23:47.615432 27823 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:47.615885 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:47.617395 25759 raft_consensus.cc:1240] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:47.617746 25761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48606 (request call id 416) took 1428 ms. Trace:
I20260709 12:23:47.618502 25759 raft_consensus.cc:1240] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:47.588034 27836 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:47.619307 25677 raft_consensus.cc:1240] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:47.618072 25761 rpcz_store.cc:276] 0709 12:23:46.189163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:47.616859 (+1427696us) service_pool.cc:224] Handling call
0709 12:23:47.617224 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:47.617460 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:47.617485 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:47.617525 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:47.617555 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:47.617604 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:47.617692 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49280}
I20260709 12:23:47.621902 25763 raft_consensus.cc:1240] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:47.623356 27836 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:47.625774 26430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36518 (request call id 540) took 2113 ms. Trace:
I20260709 12:23:47.626256 26430 rpcz_store.cc:276] 0709 12:23:45.512014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.519467 (+  7453us) service_pool.cc:224] Handling call
0709 12:23:45.762502 (+243035us) spinlock_profiling.cc:243] Waited 3.1 ms on lock 0x7b5800004598. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d96a3cb71 00007f5d96a3ca22 00007f5d9f9558d9 00007f5d9eaafee0 00007f5d9eb790ab 00007f5d9eb79131 00007f5d9eb3afc0 00007f5d9eb25929 00007f5d9eb253d2 00007f5d9809cbd4
0709 12:23:45.762750 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:46.174118 (+411368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:46.174198 (+    80us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:46.174251 (+    53us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:46.174326 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:47.625354 (+1451028us) spinlock_profiling.cc:243] Waited 406 ms on lock 0x7b5400630e54. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:23:47.625399 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:47.625563 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":941899520}
I20260709 12:23:47.630393 27825 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:47.632453 25726 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:47.634622 25760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48606 (request call id 414) took 1464 ms. Trace:
I20260709 12:23:47.635222 25584 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41224 (request call id 332) took 3993 ms. Trace:
I20260709 12:23:47.635857 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:47.635674 25584 rpcz_store.cc:276] 0709 12:23:43.642012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:43.642120 (+   108us) service_pool.cc:224] Handling call
0709 12:23:47.635024 (+3992904us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1090019,"reported_tablets":3,"spinlock_wait_cycles":949376}
I20260709 12:23:47.636977 25758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48606 (request call id 415) took 1459 ms. Trace:
I20260709 12:23:47.636234 27818 raft_consensus.cc:2749] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:47.635113 25760 rpcz_store.cc:276] 0709 12:23:46.169685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:47.607261 (+1437576us) service_pool.cc:224] Handling call
0709 12:23:47.634018 (+ 26757us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:47.634246 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:47.634280 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:47.634333 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:47.634376 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:47.634439 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:47.634561 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:47.637373 25758 rpcz_store.cc:276] 0709 12:23:46.177300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:47.612144 (+1434844us) service_pool.cc:224] Handling call
0709 12:23:47.612438 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:47.636655 (+ 24217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:47.636684 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:47.636726 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:47.636761 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:47.636826 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:47.636924 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:47.635562 25726 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:47.618959 27748 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:47.642087 27821 raft_consensus.cc:2804] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:47.644277 25650 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:47.645510 25726 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:47.648720 27821 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:47.649194 27821 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:47.654142 27817 consensus_queue.cc:1048] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:47.655227 27825 consensus_queue.cc:1048] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:47.655709 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:47.659896 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:47.637549 27815 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:47.669723 27748 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:47.671288 27829 raft_consensus.cc:2804] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:47.676144 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:47.679870 27829 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:47.680176 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:47.680382 27829 raft_consensus.cc:3060] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:47.681486 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:47.682576 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:47.684222 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:47.689008 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:47.689277 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:47.690697 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:47.691341 26401 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:47.692034 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:47.692169 27802 raft_consensus.cc:2804] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:47.692734 27802 raft_consensus.cc:697] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 4 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:23:47.693476 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:47.693687 27802 consensus_queue.cc:237] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:47.695240 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:47.695524 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:47.663260 27833 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:23:47.702009 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 71049.3us
W20260709 12:23:47.702207 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 843638us
W20260709 12:23:47.697674 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 52268.9us
I20260709 12:23:47.701073 27821 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:47.701442 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:47.714360 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:47.714362 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:47.703881 25726 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:47.719398 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:47.719625 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:47.720309 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:47.720896 25829 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 3.
I20260709 12:23:47.722162 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:47.701100 27779 raft_consensus.cc:2804] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:47.724051 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:47.722998 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:47.723510 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:47.726672 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:47.727411 25832 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:47.729035 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:47.730991 25649 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:47.731289 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:47.731804 27838 raft_consensus.cc:2749] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:47.731909 26431 raft_consensus.cc:1217] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 12:23:47.732475 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:47.732800 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:47.733471 25649 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:23:47.734246 27838 raft_consensus.cc:2804] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:47.734385 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:47.734630 27838 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:47.735000 27838 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:47.735033 26432 raft_consensus.cc:2468] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 2.
I20260709 12:23:47.735366 25830 raft_consensus.cc:2468] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 3.
I20260709 12:23:47.736068 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:47.736718 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:47.737528 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:47.726668 27779 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:47.741077 27779 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:47.733511 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:47.743417 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:47.719239 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:47.745088 27838 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:47.746909 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:47.747182 27838 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:47.749426 27821 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:47.749485 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:47.726893 27796 raft_consensus.cc:2804] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:47.758455 27833 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:47.759809 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:47.760452 25834 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:47.761647 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:47.762668 27796 raft_consensus.cc:697] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:47.762812 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:47.764009 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:47.763759 27796 consensus_queue.cc:237] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:47.764225 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:47.765065 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:47.765630 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:47.766764 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:23:47.772859 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 51782.1us
I20260709 12:23:47.769073 25649 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:23:47.777591 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:47.778537 27743 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:47.781633 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:47.788278 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:47.792994 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:47.792896 27829 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:47.794891 27743 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:47.795017 27829 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:47.758340 27779 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:47.802345 27833 raft_consensus.cc:2804] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:47.802760 27833 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:47.803138 27833 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:47.806932 27840 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:47.807547 27840 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:47.808293 25650 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:47.809283 27836 raft_consensus.cc:2749] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:47.820860 27840 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:23:47.831274 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 62243.2us
I20260709 12:23:47.841267 25832 raft_consensus.cc:2468] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 3.
I20260709 12:23:47.846833 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:47.848171 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:47.850273 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:47.850756 26402 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:47.851723 27748 raft_consensus.cc:2804] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:47.850454 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:47.852978 25650 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:47.855594 25649 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:47.860321 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:47.861157 26439 raft_consensus.cc:2468] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 4.
I20260709 12:23:47.852124 27748 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:47.852025 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:47.859565 26430 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 1 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 1.
I20260709 12:23:47.881307 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:47.882738 27779 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:23:47.887883 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 167231us
I20260709 12:23:47.886232 25649 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:47.883622 25800 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:47.862671 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:47.846101 27833 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:47.884447 25650 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:47.877473 27823 raft_consensus.cc:2804] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:47.887355 27748 raft_consensus.cc:3060] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:47.887856 27841 raft_consensus.cc:2749] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:47.896196 27823 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:47.904978 27823 raft_consensus.cc:3060] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:47.892095 25834 raft_consensus.cc:2468] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 2.
I20260709 12:23:47.888492 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:23:47.910701 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 68059.8us
I20260709 12:23:47.912189 25681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
mode: GRACEFUL
new_leader_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:49108
I20260709 12:23:47.912869 25681 raft_consensus.cc:606] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Received request to transfer leadership to TS 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:23:47.922452 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:23:47.920418 27773 raft_consensus.cc:2804] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:47.925005 27773 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:47.925463 27773 raft_consensus.cc:3060] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:47.928524 25650 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:47.930209 27836 raft_consensus.cc:2749] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:47.930389 25650 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:47.931186 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:47.931357 27837 raft_consensus.cc:2749] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:47.932376 27838 raft_consensus.cc:2804] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:47.932852 27838 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:47.933275 27838 raft_consensus.cc:3060] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:23:47.933470 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 47360.4us
I20260709 12:23:47.934842 25649 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:47.936201 27793 raft_consensus.cc:2749] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:47.936529 25801 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:47.937719 27842 raft_consensus.cc:2749] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:47.936858 27773 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:47.938367 25801 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:47.920938 27817 raft_consensus.cc:2749] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:47.939515 27817 raft_consensus.cc:2749] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:47.940014 25801 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:47.932435 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:47.940394 26402 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:47.941972 25649 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:47.945063 25800 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:47.949214 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:47.951429 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:47.951865 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:47.954542 25649 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:47.957552 25650 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:47.958675 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:47.936201 27833 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:47.962801 25650 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:47.963306 25801 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:47.983021 26402 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:47.952272 27811 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:47.953269 27836 raft_consensus.cc:2749] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:47.952546 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:47.958748 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:47.989550 25801 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:47.956521 27743 raft_consensus.cc:2749] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:47.960462 27842 raft_consensus.cc:2749] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:47.998109 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:47.972076 27841 raft_consensus.cc:2749] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:47.960240 27815 raft_consensus.cc:2749] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:47.961199 27837 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:47.988240 25650 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:48.004591 25800 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:47.986591 27840 raft_consensus.cc:2804] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:47.972251 27829 raft_consensus.cc:2749] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:47.981559 27825 consensus_queue.cc:1048] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:23:48.009618 25649 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:48.010918 27840 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
W20260709 12:23:48.027504 27849 log.cc:927] Time spent T 00000000000000000000000000000000 P 496fd6924b624e77b03ccfd15653d47b: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 12:23:48.031507 27840 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:48.026018 27794 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:48.032887 27794 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:48.034979 27794 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:48.028071 27773 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:48.028908 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:48.026211 27815 raft_consensus.cc:2749] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:48.003866 26434 raft_consensus.cc:2955] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:48.037016 27815 raft_consensus.cc:2804] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:48.037497 27815 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:48.037921 27815 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:48.013288 27836 raft_consensus.cc:2804] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:48.021531 27802 raft_consensus.cc:2804] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:23:48.052068 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 69153.8us
I20260709 12:23:48.000358 27811 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:23:48.058295 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 46115us
I20260709 12:23:48.060143 25649 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:48.060940 27773 raft_consensus.cc:2804] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:48.061345 27773 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:48.061771 27773 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:48.062084 27793 consensus_queue.cc:1059] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:23:48.064086 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 74601.2us
I20260709 12:23:48.042207 27833 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:48.077576 25801 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:23:48.078990 27756 raft_consensus.cc:2749] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:48.020557 27837 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:48.094944 27823 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:48.091454 27773 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:48.065429 27829 raft_consensus.cc:3055] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:48.045396 27836 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:48.092993 27840 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:48.054425 27802 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:48.101431 26402 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:48.120523 27802 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:48.121306 27595 raft_consensus.cc:2804] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:48.121830 27595 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:48.122243 27595 raft_consensus.cc:3060] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:48.109882 27837 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:48.103143 27843 raft_consensus.cc:2804] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:48.140714 27843 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:48.141189 27843 raft_consensus.cc:3060] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:48.112142 27748 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:48.102898 27829 raft_consensus.cc:740] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:48.119079 27836 raft_consensus.cc:3060] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:48.115309 27838 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:48.154366 27815 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:48.159718 25649 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:23:48.162962 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 85468.2us
I20260709 12:23:48.163977 25801 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
W20260709 12:23:48.165642 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 164760us
I20260709 12:23:48.167279 27823 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:48.167378 27773 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:48.168989 27840 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:48.173779 25801 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:48.173826 27823 raft_consensus.cc:2749] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:48.180145 27825 raft_consensus.cc:2749] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:48.182945 25800 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:48.183799 27817 raft_consensus.cc:2749] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:48.188453 27829 consensus_queue.cc:260] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:48.190653 27829 raft_consensus.cc:3060] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:48.197728 27838 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:48.158803 27833 raft_consensus.cc:2749] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:23:48.199237 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 211456us
I20260709 12:23:48.189311 25649 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:48.205842 25650 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:48.207113 25649 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:48.201567 25801 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:48.195652 25582 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41240 (request call id 367) took 4320 ms. Trace:
I20260709 12:23:48.208010 25650 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:48.228478 25800 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:48.215158 25649 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:48.208843 27825 raft_consensus.cc:2804] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:48.213464 27838 raft_consensus.cc:2749] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:48.231132 27841 raft_consensus.cc:2804] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:48.232967 27825 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:48.243990 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:48.244604 27825 raft_consensus.cc:3060] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:48.236696 26438 raft_consensus.cc:1240] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:48.242650 25581 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41232 (request call id 385) took 2692 ms. Trace:
I20260709 12:23:48.318166 25581 rpcz_store.cc:276] 0709 12:23:45.536766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:45.536897 (+   131us) service_pool.cc:224] Handling call
0709 12:23:48.229323 (+2692426us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":541574,"reported_tablets":3}
I20260709 12:23:48.320542 27811 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:48.216044 27832 raft_consensus.cc:2749] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:48.213528 27856 raft_consensus.cc:2804] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:48.314224 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:48.315635 26439 raft_consensus.cc:1240] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 1. Current term is 2. Ops: []
W20260709 12:23:48.338079 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 179510us
I20260709 12:23:48.209057 27837 raft_consensus.cc:2749] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:48.317312 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:48.236953 27853 raft_consensus.cc:2749] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:23:48.359859 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 121736us
I20260709 12:23:48.356750 25833 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:48.356200 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:48.363338 25800 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:48.374028 25800 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:23:48.337419 27856 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:48.376856 25800 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:48.208496 25582 rpcz_store.cc:276] 0709 12:23:43.875717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:43.881859 (+  6142us) service_pool.cc:224] Handling call
0709 12:23:48.195565 (+4313706us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:47.809601 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:47.820623 (+ 11022us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:47.820675 (+    52us) write_op.cc:435] Acquired schema lock
0709 12:23:47.820706 (+    31us) tablet.cc:662] Decoding operations
0709 12:23:47.821111 (+   405us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:47.821203 (+    92us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:47.821236 (+    33us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:23:47.821545 (+   309us) tablet.cc:701] Row locks acquired
0709 12:23:47.821590 (+    45us) write_op.cc:260] PREPARE: finished
0709 12:23:47.821754 (+   164us) write_op.cc:270] Start()
0709 12:23:47.821887 (+   133us) write_op.cc:276] Timestamp: P: 1783599827821690 usec, L: 0
0709 12:23:47.821904 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 12:23:47.822618 (+   714us) log.cc:844] Serialized 544 byte log entry
0709 12:23:48.059124 (+236506us) op_driver.cc:464] REPLICATION: finished
0709 12:23:48.171150 (+112026us) write_op.cc:301] APPLY: starting
0709 12:23:48.171278 (+   128us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:48.171418 (+   140us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:48.171552 (+   134us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:48.171816 (+   264us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:48.172104 (+   288us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:23:48.172146 (+    42us) write_op.cc:312] APPLY: finished
0709 12:23:48.172453 (+   307us) log.cc:844] Serialized 23 byte log entry
0709 12:23:48.191746 (+ 19293us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:48.191865 (+   119us) write_op.cc:454] Released schema lock
0709 12:23:48.192006 (+   141us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":3301778,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":111685,"apply.run_cpu_time_us":2328,"apply.run_wall_time_us":37860,"num_ops":1,"prepare.queue_time_us":165905,"prepare.run_cpu_time_us":54507,"prepare.run_wall_time_us":90544,"raft.queue_time_us":26465,"raft.run_cpu_time_us":14041,"raft.run_wall_time_us":84748,"replication_time_us":237033,"thread_start_us":239370,"threads_started":4,"wal-append.queue_time_us":130377}]]}
I20260709 12:23:48.384517 25800 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:48.360649 27838 raft_consensus.cc:2749] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:48.389828 27756 raft_consensus.cc:2804] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:48.390970 25800 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:48.396653 25833 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 4.
I20260709 12:23:48.400223 27853 raft_consensus.cc:2804] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:48.407020 27756 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:48.379848 27811 raft_consensus.cc:2804] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:48.377009 27832 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:48.417929 27756 raft_consensus.cc:3060] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:48.409382 27853 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:48.382246 27743 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:48.382558 27856 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:48.411824 25800 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:48.440490 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:48.442366 25650 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:48.421692 27842 raft_consensus.cc:2804] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:48.383777 27595 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:48.446671 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:48.448738 25650 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:48.419344 27811 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:48.430783 27853 raft_consensus.cc:3060] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:48.433554 27817 raft_consensus.cc:2749] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:48.453759 25650 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:48.435127 27748 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:48.434015 27815 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:23:48.457923 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 242864us
I20260709 12:23:48.430977 27832 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:48.483042 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
W20260709 12:23:48.457358 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 70074.9us
I20260709 12:23:48.451272 27773 raft_consensus.cc:2749] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:48.450062 27842 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:48.492789 27842 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:48.496191 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:48.497519 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:48.498637 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:48.499253 25762 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:48.500413 27815 raft_consensus.cc:2749] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:48.502804 27870 raft_consensus.cc:2749] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:48.504153 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:48.451116 27838 raft_consensus.cc:2749] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:23:48.451093 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:48.452080 27811 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:23:48.509202 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 55551.2us
I20260709 12:23:48.490612 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:48.491256 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:48.488783 25761 raft_consensus.cc:2955] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:48.501435 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
W20260709 12:23:48.507475 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 95753.2us
I20260709 12:23:48.443029 27743 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:48.517220 25726 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:48.520093 25800 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:48.524334 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:48.524991 25755 raft_consensus.cc:2393] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 3: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:23:48.468365 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:48.532599 25762 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 3.
I20260709 12:23:48.484867 27841 raft_consensus.cc:697] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:48.536742 25726 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:48.551270 25800 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:23:48.532212 25581 catalog_manager.cc:5697] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 3 to 4, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 4 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:48.556787 26438 raft_consensus.cc:1240] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:48.544613 27794 raft_consensus.cc:2749] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:48.547040 26432 raft_consensus.cc:3060] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:48.574411 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:48.536775 27818 consensus_queue.cc:1059] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 12:23:48.577517 25681 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 3.
I20260709 12:23:48.558884 27815 raft_consensus.cc:2749] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:48.581859 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:48.581746 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:48.571779 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:48.584417 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:48.585122 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:48.584488 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:48.591630 25684 raft_consensus.cc:2468] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 2.
I20260709 12:23:48.583315 27794 raft_consensus.cc:2749] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:48.603197 25680 raft_consensus.cc:1240] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:48.585886 27863 raft_consensus.cc:2804] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:48.611163 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:48.612439 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:48.613018 25679 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:48.574404 27802 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:48.617208 25800 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:23:48.625682 25763 raft_consensus.cc:1240] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:48.630501 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:48.629899 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:48.633085 25680 raft_consensus.cc:1240] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:48.610222 27863 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:48.636066 27863 raft_consensus.cc:3060] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:48.636180 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:48.632669 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:48.637413 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:48.650772 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:48.650707 25683 raft_consensus.cc:2468] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 2.
I20260709 12:23:48.653208 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:48.653829 26437 raft_consensus.cc:1240] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:48.629762 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:48.663347 25649 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:48.663494 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:48.654973 27873 consensus_queue.cc:1059] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 12:23:48.597496 27875 consensus_queue.cc:1059] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 12:23:48.666520 25683 raft_consensus.cc:1240] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:48.668551 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:48.669791 25650 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:48.670014 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:48.670910 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:48.606529 27815 consensus_queue.cc:1059] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:23:48.709316 25650 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:48.681058 25649 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:48.681770 25754 raft_consensus.cc:2393] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 5: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:23:48.648691 27595 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:48.655448 27855 raft_consensus.cc:2804] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:48.726261 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:48.626911 27825 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:48.702538 27838 raft_consensus.cc:2749] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:23:48.726298 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 45352.9us
I20260709 12:23:48.730868 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:48.733937 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:23:48.727873 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 154461us
I20260709 12:23:48.742228 25680 raft_consensus.cc:2393] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 3: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:23:48.601472 27841 consensus_queue.cc:237] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:48.724067 27869 raft_consensus.cc:2804] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:48.743647 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:48.744585 25683 raft_consensus.cc:2468] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 2.
I20260709 12:23:48.746119 25833 raft_consensus.cc:1240] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:48.732105 27840 raft_consensus.cc:2749] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:48.727720 27855 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:48.719676 27856 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:48.739249 27773 raft_consensus.cc:2749] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:48.775223 25649 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:48.826471 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:48.770135 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:48.911216 26431 raft_consensus.cc:2393] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 5: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:23:48.743188 27743 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:48.731632 27878 raft_consensus.cc:3055] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:23:48.931126 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 155994us
I20260709 12:23:48.939414 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:48.939937 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:23:48.940670 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 196781us
I20260709 12:23:48.942237 25649 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:48.732394 27842 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:48.944113 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:48.966975 25649 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:48.940536 27860 raft_consensus.cc:2749] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:48.968801 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:48.771492 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:48.904918 27855 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:48.741500 27866 consensus_queue.cc:1059] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.203s
I20260709 12:23:48.971530 25649 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:48.974328 25682 raft_consensus.cc:1240] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:48.976351 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:48.748544 27756 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:48.941625 27878 raft_consensus.cc:740] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:48.947302 25679 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 3.
W20260709 12:23:48.986960 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 193891us
I20260709 12:23:48.970928 27833 raft_consensus.cc:2749] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:23:48.988533 25682 raft_consensus.cc:1240] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:48.977965 27840 raft_consensus.cc:2804] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:48.993919 25837 raft_consensus.cc:1240] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 3. Current term is 4. Ops: []
W20260709 12:23:49.003845 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 260142us
I20260709 12:23:49.014627 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:49.017686 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:49.022409 25680 raft_consensus.cc:2393] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 3: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:23:49.025993 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:49.032809 26402 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:48.989713 27879 raft_consensus.cc:2749] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:49.022359 27802 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:49.027429 27869 raft_consensus.cc:697] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 4 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:49.138810 27832 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:49.140520 25680 raft_consensus.cc:1240] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:49.019862 27873 raft_consensus.cc:3055] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:49.141556 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:23:49.164229 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 131484us
I20260709 12:23:49.165058 26402 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:49.167157 26402 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:49.034147 27840 raft_consensus.cc:697] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:49.159281 27878 consensus_queue.cc:260] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:49.173020 27878 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:49.173070 27856 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:49.168670 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:49.174463 25680 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:49.175037 25677 raft_consensus.cc:1240] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:49.164494 27873 raft_consensus.cc:740] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
W20260709 12:23:49.184412 25726 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.001s	sys 0.013s
I20260709 12:23:49.177027 27748 raft_consensus.cc:2804] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:23:49.194016 25726 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.001s	sys 0.013s
I20260709 12:23:49.176265 27825 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:49.034579 27865 consensus_queue.cc:1059] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.436s
I20260709 12:23:49.178465 25679 raft_consensus.cc:1240] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:49.205560 25650 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:23:49.205579 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 621797us
I20260709 12:23:49.201821 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:49.217816 25726 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
W20260709 12:23:49.300748 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 83037.8us
I20260709 12:23:49.204521 27748 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:49.186776 27864 raft_consensus.cc:2749] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:49.308519 27756 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:23:49.324210 27843 consensus_meta.cc:287] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 1.183s	user 0.012s	sys 0.000s
I20260709 12:23:49.203329 27891 consensus_queue.cc:1059] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.153s
I20260709 12:23:49.309226 27869 consensus_queue.cc:237] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:49.347836 25801 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:49.307689 27796 raft_consensus.cc:2749] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:23:49.329150 27836 consensus_meta.cc:287] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 1.130s	user 0.009s	sys 0.005s
I20260709 12:23:49.346060 27870 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:49.347560 27840 consensus_queue.cc:237] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:49.359351 27842 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:49.347064 27748 raft_consensus.cc:3060] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:49.395805 25582 catalog_manager.cc:5697] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 1 to 2, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 2 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:49.413259 27829 consensus_meta.cc:287] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 1.222s	user 0.012s	sys 0.003s
W20260709 12:23:49.414783 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 67076.6us
I20260709 12:23:49.425150 25801 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:49.422969 25680 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 5.
I20260709 12:23:49.429718 25683 raft_consensus.cc:1240] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 4. Current term is 5. Ops: []
W20260709 12:23:49.410545 27881 log.cc:927] Time spent T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.439s	user 0.001s	sys 0.000s
W20260709 12:23:49.439298 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 81057.7us
I20260709 12:23:49.440965 25726 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:23:49.443284 25801 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:49.441462 25682 raft_consensus.cc:1240] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:49.425721 27817 raft_consensus.cc:2804] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:49.447475 25801 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:49.334049 27852 consensus_queue.cc:1059] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.106s
I20260709 12:23:49.450891 27874 raft_consensus.cc:3055] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:49.448788 27817 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:49.383211 27843 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:49.452410 26435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 521) took 1240 ms. Trace:
W20260709 12:23:49.454844 27863 consensus_meta.cc:287] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.818s	user 0.006s	sys 0.002s
I20260709 12:23:49.457010 27875 raft_consensus.cc:3055] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:49.409584 27836 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:49.449275 27891 raft_consensus.cc:2804] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:49.457962 27796 raft_consensus.cc:2804] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:49.500948 25684 raft_consensus.cc:1240] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:49.491701 27875 raft_consensus.cc:740] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
W20260709 12:23:49.503180 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 297677us
W20260709 12:23:49.504741 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 57378.5us
I20260709 12:23:49.505259 25828 raft_consensus.cc:1240] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:49.461568 27874 raft_consensus.cc:740] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:23:49.484201 27817 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:49.501590 27891 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:49.458323 27899 raft_consensus.cc:2749] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:23:49.503223 27796 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
W20260709 12:23:49.510394 27815 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.009s	sys 0.013s
I20260709 12:23:49.509409 27865 raft_consensus.cc:2749] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:23:49.538103 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 291069us
I20260709 12:23:49.543107 26402 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:49.544531 27894 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:49.544828 27874 consensus_queue.cc:260] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:49.545118 27894 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:49.545606 26402 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:49.546358 27874 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:49.533000 27891 raft_consensus.cc:3060] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:49.494700 27863 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:49.581542 27836 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:23:49.537052 27815 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.796s	user 0.010s	sys 0.014s
I20260709 12:23:49.582981 26402 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:49.539088 27796 raft_consensus.cc:3060] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:49.587422 27884 consensus_queue.cc:1059] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
W20260709 12:23:49.548820 27896 log.cc:927] Time spent T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
I20260709 12:23:49.579908 27864 raft_consensus.cc:2749] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:49.596241 25829 raft_consensus.cc:1240] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 3. Current term is 4. Ops: []
W20260709 12:23:49.590497 27811 consensus_meta.cc:287] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 1.074s	user 0.011s	sys 0.000s
I20260709 12:23:49.484913 26435 rpcz_store.cc:276] 0709 12:23:48.211974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.212796 (+   822us) service_pool.cc:224] Handling call
0709 12:23:48.319733 (+106937us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b5800004598. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d96a3cb71 00007f5d96a3ca22 00007f5d9f9558d9 00007f5d9eaafee0 00007f5d9eb790ab 00007f5d9eb79131 00007f5d9eb3afc0 00007f5d9eb25929 00007f5d9eb253d2 00007f5d9809cbd4
0709 12:23:48.319950 (+   217us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:48.320366 (+   416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:48.320401 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:48.515484 (+195083us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b2c000d5dd8. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9845aa11 00007f5d9846a372 00007f5d99b9ca01 00007f5d99b6143a 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2
0709 12:23:48.550510 (+ 35026us) log.cc:844] Serialized 572 byte log entry
0709 12:23:48.740184 (+189674us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:48.744093 (+  3909us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:48.749769 (+  5676us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:49.452170 (+702401us) raft_consensus.cc:1685] finished
0709 12:23:49.452190 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:49.452349 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34625024,"thread_start_us":148942,"threads_started":1,"wal-append.queue_time_us":189221}
I20260709 12:23:49.608724 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:49.609623 25832 raft_consensus.cc:3060] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:49.610783 25678 raft_consensus.cc:1240] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 4 LEADER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:49.600200 27843 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:23:49.599000 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 99546.5us
I20260709 12:23:49.599375 27743 raft_consensus.cc:2804] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:49.612778 27743 raft_consensus.cc:697] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 5 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:23:49.613161 25726 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:49.613924 27794 raft_consensus.cc:2804] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:49.614347 27794 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:49.614014 27743 consensus_queue.cc:237] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:49.614820 27794 raft_consensus.cc:3060] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:49.614770 27878 consensus_queue.cc:1059] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:49.621357 27894 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:49.585872 27802 consensus_queue.cc:1059] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:23:49.626922 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:49.537793 27867 consensus_queue.cc:1059] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 12:23:49.533614 27895 consensus_queue.cc:1059] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 12:23:49.625285 25681 raft_consensus.cc:2468] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 4.
I20260709 12:23:49.546923 27907 raft_consensus.cc:2749] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:49.587693 27756 consensus_queue.cc:1059] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:23:49.627872 25835 raft_consensus.cc:2468] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 2.
W20260709 12:23:49.636116 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 53224.2us
W20260709 12:23:49.637339 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 130300us
I20260709 12:23:49.617575 27811 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:49.588130 27873 consensus_queue.cc:260] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:49.648903 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:49.649892 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:23:49.652900 26402 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:49.597838 27906 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:49.653227 25686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 1825) took 1073 ms. Trace:
I20260709 12:23:49.600019 27898 consensus_queue.cc:1059] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:23:49.655778 25801 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:49.669451 25832 raft_consensus.cc:2468] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 4.
I20260709 12:23:49.655283 25686 rpcz_store.cc:276] 0709 12:23:48.579397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.579536 (+   139us) service_pool.cc:224] Handling call
0709 12:23:48.586560 (+  7024us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:48.785025 (+198465us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:48.785051 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:48.905157 (+120106us) log.cc:844] Serialized 26 byte log entry
0709 12:23:49.051946 (+146789us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:49.194186 (+142240us) log.cc:844] Serialized 14 byte log entry
0709 12:23:49.359851 (+165665us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:49.359992 (+   141us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:49.653055 (+293063us) raft_consensus.cc:1685] finished
0709 12:23:49.653072 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:49.653178 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31211,"prepare.queue_time_us":295208,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":2626,"raft.queue_time_us":119734,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":6433,"thread_start_us":446839,"threads_started":4,"wal-append.queue_time_us":211465}
I20260709 12:23:49.671103 27756 raft_consensus.cc:2749] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:49.687004 27872 raft_consensus.cc:3055] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:49.685916 27905 consensus_queue.cc:1059] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:23:49.688442 27872 raft_consensus.cc:740] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:49.689260 27872 consensus_queue.cc:260] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:49.690143 27872 raft_consensus.cc:3060] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:23:49.683543 27853 consensus_meta.cc:287] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 1.213s	user 0.002s	sys 0.010s
I20260709 12:23:49.692695 27853 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:49.660863 27906 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:49.706176 27842 raft_consensus.cc:2955] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
W20260709 12:23:49.715505 26432 consensus_meta.cc:287] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 1.129s	user 0.008s	sys 0.003s
I20260709 12:23:49.716060 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:23:49.717216 27855 consensus_meta.cc:287] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.733s	user 0.005s	sys 0.005s
I20260709 12:23:49.728268 27903 raft_consensus.cc:3055] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:49.728844 27903 raft_consensus.cc:740] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:49.728096 27855 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:49.731029 25830 raft_consensus.cc:1240] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:49.700032 27853 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:49.702109 27863 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:49.734738 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:49.736157 25758 raft_consensus.cc:1275] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:23:49.718047 27756 raft_consensus.cc:3055] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:49.737583 27756 raft_consensus.cc:740] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:49.738588 27756 consensus_queue.cc:260] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:23:49.741957 27882 log.cc:927] Time spent T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.601s	user 0.004s	sys 0.010s
I20260709 12:23:49.741381 27748 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:49.730513 26432 raft_consensus.cc:2468] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 3.
I20260709 12:23:49.743099 27880 raft_consensus.cc:2749] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:49.743131 25685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 1824) took 1165 ms. Trace:
I20260709 12:23:49.744508 27903 consensus_queue.cc:260] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:49.745154 27859 consensus_queue.cc:1048] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:49.745707 27903 raft_consensus.cc:3060] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:49.747877 26432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 615) took 1316 ms. Trace:
I20260709 12:23:49.745877 26431 raft_consensus.cc:2955] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:49.744102 25685 rpcz_store.cc:276] 0709 12:23:48.577857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.577966 (+   109us) service_pool.cc:224] Handling call
0709 12:23:48.578445 (+   479us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:48.578771 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:48.578803 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:48.595690 (+ 16887us) log.cc:844] Serialized 572 byte log entry
0709 12:23:48.733663 (+137973us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:48.733708 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:48.733818 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:49.741373 (+1007555us) spinlock_profiling.cc:243] Waited 72.2 ms on lock 0x7b4400022b4c. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db 00007f5d99708aaf 00007f5d996fc86e 00007f5d996fbbb6 00007f5d996fb7d8 00007f5d99705221 00007f5d997051d9 00007f5d99705169
0709 12:23:49.742838 (+  1465us) raft_consensus.cc:1685] finished
0709 12:23:49.742865 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:49.743067 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":166042880,"thread_start_us":107706,"threads_started":1,"wal-append.queue_time_us":377443}
I20260709 12:23:49.748319 26432 rpcz_store.cc:276] 0709 12:23:48.431729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.432660 (+   931us) service_pool.cc:224] Handling call
0709 12:23:49.747812 (+1315152us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:49.754067 27796 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:49.755597 27817 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
W20260709 12:23:49.769042 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:49.754680 27870 raft_consensus.cc:2749] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:49.785578 27794 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:49.786007 27855 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:49.786718 25754 raft_consensus.cc:1240] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:49.786875 27748 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:49.763316 27756 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:49.795607 27825 raft_consensus.cc:3055] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:49.795948 25650 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:49.796209 27825 raft_consensus.cc:740] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:49.796932 25650 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:49.797324 27890 raft_consensus.cc:2804] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:49.798091 27833 raft_consensus.cc:2804] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:49.798768 27833 raft_consensus.cc:697] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 4 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:49.798877 27870 consensus_queue.cc:1059] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:49.798182 27890 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:49.797178 27825 consensus_queue.cc:260] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:49.799872 27833 consensus_queue.cc:237] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:49.801717 27825 raft_consensus.cc:3060] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:49.800069 27870 raft_consensus.cc:3055] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:49.803007 27870 raft_consensus.cc:740] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:49.805222 25828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 2254) took 1567 ms. Trace:
I20260709 12:23:49.800354 27890 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:49.805624 25828 rpcz_store.cc:276] 0709 12:23:48.238102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.238251 (+   149us) service_pool.cc:224] Handling call
0709 12:23:48.314980 (+ 76729us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:49.507352 (+1192372us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:49.804956 (+297604us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54001b1554. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:23:49.805157 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2736789888}
I20260709 12:23:49.812032 27796 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:49.813237 27883 consensus_queue.cc:1059] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:49.814507 27883 raft_consensus.cc:3055] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:49.814905 27883 raft_consensus.cc:740] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:49.815824 27883 consensus_queue.cc:260] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:49.817796 27883 raft_consensus.cc:3060] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:49.818111 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:23:49.821761 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 203772us
I20260709 12:23:49.823967 25763 raft_consensus.cc:1240] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:49.833710 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:49.835167 27856 consensus_queue.cc:1059] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:49.835397 27859 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:49.836014 27859 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:49.836557 25681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51578 (request call id 425) took 1168 ms. Trace:
I20260709 12:23:49.836939 25681 rpcz_store.cc:276] 0709 12:23:48.668099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.668294 (+   195us) service_pool.cc:224] Handling call
0709 12:23:49.836353 (+1168059us) spinlock_profiling.cc:243] Waited 730 ms on lock 0x7b54000b36d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:23:49.836468 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1678251392}
I20260709 12:23:49.837595 25763 raft_consensus.cc:1275] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:49.773257 27891 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:49.838281 27859 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:49.838405 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:49.839133 26430 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:49.840845 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:49.843000 26439 raft_consensus.cc:1240] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:49.845489 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:49.849026 26433 raft_consensus.cc:1240] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:49.849366 26437 raft_consensus.cc:1240] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:49.840647 27891 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:49.803788 27870 consensus_queue.cc:260] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:49.852473 26432 raft_consensus.cc:1240] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:49.854995 25686 raft_consensus.cc:1275] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 12:23:49.856889 27888 log.cc:927] Time spent T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.683s	user 0.004s	sys 0.000s
I20260709 12:23:49.858850 25679 raft_consensus.cc:1240] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 7. Current term is 8. Ops: []
I20260709 12:23:49.862705 27875 consensus_queue.cc:260] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:49.864434 27838 raft_consensus.cc:3055] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:49.864593 27595 raft_consensus.cc:3055] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:23:49.864915 27838 raft_consensus.cc:740] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:49.865061 27595 raft_consensus.cc:740] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:23:49.865892 27595 consensus_queue.cc:260] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:49.865859 27838 consensus_queue.cc:260] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:49.867057 27595 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:49.870676 25801 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:49.871135 27815 raft_consensus.cc:3055] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:49.871565 27815 raft_consensus.cc:740] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:49.871985 27916 raft_consensus.cc:3055] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:49.872360 27916 raft_consensus.cc:740] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:23:49.872443 27815 consensus_queue.cc:260] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:49.873220 27916 consensus_queue.cc:260] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:49.873781 27815 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:49.874254 27916 raft_consensus.cc:3060] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:49.875206 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:49.875432 25650 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:49.891839 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:49.897208 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:49.898380 25726 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:49.900220 27868 raft_consensus.cc:2804] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:49.901161 25685 raft_consensus.cc:1240] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 2. Current term is 3. Ops: []
W20260709 12:23:49.903981 25726 leader_election.cc:336] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Timed out: RequestConsensusVote RPC to 127.23.245.131:36237 timed out after 1.549s (SENT)
I20260709 12:23:49.906411 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:49.907117 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:49.890967 27756 raft_consensus.cc:2749] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:49.912331 25726 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:49.897424 27875 raft_consensus.cc:3060] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:49.918941 27794 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:49.886152 27796 consensus_queue.cc:1059] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:23:49.909523 27821 raft_consensus.cc:2804] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:49.920071 27868 raft_consensus.cc:697] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:49.924759 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:49.936693 27918 consensus_queue.cc:1059] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:23:49.937274 26430 raft_consensus.cc:2468] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 4.
I20260709 12:23:49.949740 27821 raft_consensus.cc:697] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:49.924355 27855 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:49.950506 27872 raft_consensus.cc:2749] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:49.962548 25801 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:49.963709 27868 consensus_queue.cc:237] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:49.970585 27917 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:49.974723 27909 consensus_queue.cc:1059] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:23:49.975841 27909 raft_consensus.cc:3055] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:49.976179 27909 raft_consensus.cc:740] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:49.976944 27909 consensus_queue.cc:260] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:49.978076 27909 raft_consensus.cc:3060] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:49.987594 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:49.984907 27855 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:49.971163 27917 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:49.990206 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
W20260709 12:23:49.991067 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:49.991398 27818 consensus_queue.cc:1059] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:49.996345 27852 raft_consensus.cc:2804] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:49.989214 26435 raft_consensus.cc:1240] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:49.996914 27852 raft_consensus.cc:697] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
W20260709 12:23:50.002555 25800 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.306s	user 0.008s	sys 0.013s
W20260709 12:23:50.006587 25800 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.310s	user 0.008s	sys 0.013s
W20260709 12:23:50.006911 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 1.31019e+06us
W20260709 12:23:50.008133 26402 leader_election.cc:336] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Timed out: RequestConsensusVote RPC to 127.23.245.131:36237 timed out after 1.636s (SENT)
I20260709 12:23:50.009009 27901 consensus_queue.cc:1059] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 12:23:49.987386 27837 consensus_queue.cc:1048] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 12:23:50.005522 27887 raft_consensus.cc:3055] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:50.010375 27887 raft_consensus.cc:740] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:50.011276 27887 consensus_queue.cc:260] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:50.012368 27887 raft_consensus.cc:3060] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:49.985841 27878 consensus_queue.cc:1059] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:23:49.995005 27863 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:49.994668 27892 raft_consensus.cc:3055] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:50.027166 27892 raft_consensus.cc:740] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:50.024856 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:50.026340 27863 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:50.032514 27917 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:50.032678 27906 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:50.035799 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:50.056403 27873 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:50.057317 25830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 2261) took 1347 ms. Trace:
I20260709 12:23:50.057751 25682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51578 (request call id 433) took 1059 ms. Trace:
I20260709 12:23:50.057710 25830 rpcz_store.cc:276] 0709 12:23:48.710038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.711287 (+  1249us) service_pool.cc:224] Handling call
0709 12:23:48.732412 (+ 21125us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:49.733599 (+1001187us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:50.057098 (+323499us) spinlock_profiling.cc:243] Waited 997 ms on lock 0x7b5400118d54. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:23:50.057262 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2293227392}
I20260709 12:23:50.058203 25682 rpcz_store.cc:276] 0709 12:23:48.998604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.006009 (+  7405us) service_pool.cc:224] Handling call
0709 12:23:49.006263 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:49.444106 (+437843us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:50.057524 (+613418us) spinlock_profiling.cc:243] Waited 435 ms on lock 0x7b54000b27d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:23:50.057689 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1000301312}
I20260709 12:23:50.059347 25678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40230 (request call id 1226) took 1424 ms. Trace:
I20260709 12:23:50.036789 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:50.037856 26439 raft_consensus.cc:1240] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:50.041015 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:49.718003 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:50.042166 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:49.999892 27821 consensus_queue.cc:237] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:50.042878 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:50.046522 27796 raft_consensus.cc:3055] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:50.051116 27852 consensus_queue.cc:237] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:50.051149 25684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40230 (request call id 1213) took 1441 ms. Trace:
I20260709 12:23:50.054502 27908 raft_consensus.cc:3055] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:50.054654 27794 raft_consensus.cc:3055] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:50.080121 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:50.059738 25678 rpcz_store.cc:276] 0709 12:23:48.634890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.972563 (+337673us) service_pool.cc:224] Handling call
0709 12:23:48.983004 (+ 10441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:49.611261 (+628257us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:50.059041 (+447780us) spinlock_profiling.cc:243] Waited 628 ms on lock 0x7b5400263ed4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:23:50.059288 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1443281152}
I20260709 12:23:50.075222 25684 rpcz_store.cc:276] 0709 12:23:48.610068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.629610 (+ 19542us) service_pool.cc:224] Handling call
0709 12:23:48.653106 (+ 23496us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:49.503425 (+850319us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:50.050932 (+547507us) spinlock_profiling.cc:243] Waited 848 ms on lock 0x7b540007b2d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:23:50.051091 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1949373312}
I20260709 12:23:50.060367 25581 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52974 (request call id 252) took 1803 ms. Trace:
I20260709 12:23:50.072698 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:50.028946 27855 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:50.078820 25801 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
W20260709 12:23:50.061544 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:50.061424 25834 raft_consensus.cc:1275] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:50.088291 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:50.092097 27811 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:50.099017 27908 raft_consensus.cc:740] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:50.080317 27794 raft_consensus.cc:740] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:50.080853 25683 raft_consensus.cc:2955] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:50.088914 27892 consensus_queue.cc:260] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:23:50.133505 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 56072.9us
I20260709 12:23:50.137763 25801 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:50.140905 25682 raft_consensus.cc:1240] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 2. Current term is 3. Ops: []
W20260709 12:23:50.141705 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 59266.9us
I20260709 12:23:50.075031 27796 raft_consensus.cc:740] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:50.131007 27917 raft_consensus.cc:2749] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:50.155447 25754 raft_consensus.cc:1240] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:50.137328 27894 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:50.148440 27867 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:50.147229 27595 consensus_queue.cc:1059] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:23:50.142014 27841 consensus_queue.cc:1059] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:23:50.166498 27898 raft_consensus.cc:2749] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:50.221060 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:50.220461 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:50.199586 27917 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
W20260709 12:23:50.226308 25726 leader_election.cc:336] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Timed out: RequestConsensusVote RPC to 127.23.245.131:36237 timed out after 1.961s (SENT)
I20260709 12:23:50.227727 25726 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:50.229302 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:50.230026 25829 raft_consensus.cc:2393] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 4: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:23:50.229956 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:50.230700 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:50.231557 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:50.232087 25833 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 6.
I20260709 12:23:50.233042 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:50.233340 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:50.238004 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:50.238054 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:50.081699 25581 rpcz_store.cc:276] 0709 12:23:48.355551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:48.375866 (+ 20315us) service_pool.cc:224] Handling call
0709 12:23:50.042355 (+1666489us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:48.991104 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:49.000877 (+  9773us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:49.000914 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:23:49.000934 (+    20us) tablet.cc:662] Decoding operations
0709 12:23:49.001290 (+   356us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:49.001348 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:49.001381 (+    33us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:23:49.001561 (+   180us) tablet.cc:701] Row locks acquired
0709 12:23:49.001580 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:23:49.001760 (+   180us) write_op.cc:270] Start()
0709 12:23:49.001877 (+   117us) write_op.cc:276] Timestamp: P: 1783599829001714 usec, L: 0
0709 12:23:49.001901 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:23:49.002728 (+   827us) log.cc:844] Serialized 539 byte log entry
0709 12:23:49.381599 (+378871us) op_driver.cc:464] REPLICATION: finished
0709 12:23:49.542236 (+160637us) write_op.cc:301] APPLY: starting
0709 12:23:49.542486 (+   250us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:49.542596 (+   110us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:49.542749 (+   153us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:49.543059 (+   310us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:49.543299 (+   240us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:23:49.543370 (+    71us) write_op.cc:312] APPLY: finished
0709 12:23:49.543562 (+   192us) log.cc:844] Serialized 23 byte log entry
0709 12:23:49.543769 (+   207us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:49.543858 (+    89us) write_op.cc:454] Released schema lock
0709 12:23:49.543905 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:49.544358 (+   453us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:49.581146 (+ 36788us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":515,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":157203,"apply.run_cpu_time_us":1946,"apply.run_wall_time_us":2084,"num_ops":1,"prepare.queue_time_us":360149,"prepare.run_cpu_time_us":2834,"prepare.run_wall_time_us":17713,"replication_time_us":334406,"thread_start_us":282108,"threads_started":2}]]}
I20260709 12:23:50.240347 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:50.242043 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:50.242347 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:50.212095 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:50.247356 27922 raft_consensus.cc:3060] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:50.248319 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:50.251334 25759 raft_consensus.cc:1240] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:50.252542 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:50.253773 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:50.254388 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:50.219465 27817 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:50.184967 27894 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:50.258812 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:50.226687 27917 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:50.260303 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:50.260864 25828 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 5.
I20260709 12:23:50.261686 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:50.261991 27917 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:50.262228 25828 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 6.
I20260709 12:23:50.263288 25828 raft_consensus.cc:1240] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:50.263937 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:50.264120 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:50.264674 25831 raft_consensus.cc:2468] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 3.
W20260709 12:23:50.258313 25726 leader_election.cc:336] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Timed out: RequestConsensusVote RPC to 127.23.245.131:36237 timed out after 2.062s (SENT)
I20260709 12:23:50.265761 25726 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:50.266024 25679 raft_consensus.cc:2468] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 4.
I20260709 12:23:50.267584 27901 raft_consensus.cc:2749] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:50.268247 27901 consensus_queue.cc:1059] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:50.268910 27901 consensus_queue.cc:1243] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer f82778701b464892aab92a752ed7ffdc log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:23:50.216497 27908 consensus_queue.cc:260] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:50.269342 26434 raft_consensus.cc:2468] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 3.
I20260709 12:23:50.269363 27901 consensus_queue.cc:1059] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:50.270123 27908 raft_consensus.cc:3060] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:50.259955 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:50.205965 27867 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:50.280294 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:50.247675 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:23:50.275525 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 51622us
I20260709 12:23:50.283665 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:50.283895 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:50.284359 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:50.285156 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:50.293653 25829 raft_consensus.cc:2393] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 4: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:23:50.295311 25828 raft_consensus.cc:1240] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:50.296514 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:50.297585 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:50.298112 27867 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:50.298519 25834 raft_consensus.cc:2393] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 2: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:23:50.298646 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:50.299374 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:50.299767 27918 raft_consensus.cc:3055] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:50.300266 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:50.303671 25830 raft_consensus.cc:2393] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 4: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:23:50.303565 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:50.304141 25828 raft_consensus.cc:1240] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 3. Current term is 4. Ops: []
W20260709 12:23:50.304277 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:50.207437 27794 consensus_queue.cc:260] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:50.285403 27821 raft_consensus.cc:3055] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:50.307951 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:50.308782 25837 raft_consensus.cc:2393] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 6: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:23:50.309439 27821 raft_consensus.cc:740] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:50.310989 25830 raft_consensus.cc:1240] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 3. Current term is 4. Ops: []
W20260709 12:23:50.307843 27890 consensus_meta.cc:287] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.501s	user 0.000s	sys 0.010s
I20260709 12:23:50.312270 25830 raft_consensus.cc:1275] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:50.312691 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:50.315874 25680 raft_consensus.cc:2468] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 4.
I20260709 12:23:50.319274 25828 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "f82778701b464892aab92a752ed7ffdc"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:23:50.242718 27796 consensus_queue.cc:260] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:50.332372 25832 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 5.
I20260709 12:23:50.320089 25828 raft_consensus.cc:606] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Received request to transfer leadership to TS f82778701b464892aab92a752ed7ffdc
I20260709 12:23:50.333176 25828 raft_consensus.cc:614] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:50.319308 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:50.303393 27918 raft_consensus.cc:740] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:50.329311 25755 raft_consensus.cc:1240] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 2. Current term is 3. Ops: []
W20260709 12:23:50.333361 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 179944us
W20260709 12:23:50.333746 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 66614.1us
I20260709 12:23:50.377774 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:23:50.381402 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 44531.7us
W20260709 12:23:50.384994 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 54839us
I20260709 12:23:50.311597 27821 consensus_queue.cc:260] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:50.388746 25726 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:50.388778 25833 raft_consensus.cc:2468] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 2.
I20260709 12:23:50.335287 27909 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:50.390329 26402 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:50.390542 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:50.391466 25836 raft_consensus.cc:2468] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 5.
I20260709 12:23:50.312304 27890 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:23:50.417029 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:50.437911 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:50.440220 27895 consensus_queue.cc:1048] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:50.447250 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:50.447985 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:23:50.448068 25755 raft_consensus.cc:3060] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:23:50.438155 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 44385.1us
I20260709 12:23:50.449772 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:50.450601 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:50.452860 25831 raft_consensus.cc:2468] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 4.
I20260709 12:23:50.454746 27922 raft_consensus.cc:2749] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:50.455513 27922 raft_consensus.cc:2749] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:50.456141 27922 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:50.458837 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:50.472797 25755 raft_consensus.cc:2468] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 4.
I20260709 12:23:50.475179 25685 raft_consensus.cc:1240] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:50.494158 25686 raft_consensus.cc:2468] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 5.
I20260709 12:23:50.486590 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
W20260709 12:23:50.477658 26402 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:50.460644 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:50.460196 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:50.503286 25835 raft_consensus.cc:2468] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 4.
I20260709 12:23:50.459476 25762 raft_consensus.cc:2955] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:50.460979 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:23:50.504743 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:50.505944 25683 raft_consensus.cc:2376] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 4. Re-sending same reply.
W20260709 12:23:50.457412 27927 log.cc:927] Time spent T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:23:50.585837 27894 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:50.586488 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:50.587770 27838 raft_consensus.cc:3060] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:50.591343 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:50.592536 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:23:50.478330 27924 log.cc:927] Time spent T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.332s	user 0.001s	sys 0.000s
I20260709 12:23:50.593873 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:50.596549 25835 raft_consensus.cc:2376] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 2. Re-sending same reply.
I20260709 12:23:50.593214 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:50.602783 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:50.608619 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:50.606600 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:50.609190 26439 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 8.
I20260709 12:23:50.466382 27890 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:50.615000 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:50.620325 25829 raft_consensus.cc:2393] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 3: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:23:50.620524 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:50.621275 25835 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:23:50.628254 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 179950us
W20260709 12:23:50.639633 25801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:50.621336 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:50.653823 25829 raft_consensus.cc:2393] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 3: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:23:50.657202 25758 raft_consensus.cc:1240] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:50.615715 25650 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:23:50.659137 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 43580.6us
W20260709 12:23:50.667114 25726 leader_election.cc:336] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Timed out: RequestConsensusVote RPC to 127.23.245.131:36237 timed out after 2.137s (SENT)
I20260709 12:23:50.667809 25726 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:50.668725 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:50.473018 27909 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:50.474893 27908 consensus_queue.cc:1059] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.178s
I20260709 12:23:50.687466 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:50.688598 25832 raft_consensus.cc:2393] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 5: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:23:50.460134 27918 consensus_queue.cc:260] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:50.456581 27922 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:50.694284 25835 raft_consensus.cc:2468] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 3.
I20260709 12:23:50.697997 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:23:50.703173 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:50.706189 27922 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:50.708122 27833 raft_consensus.cc:3055] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:23:50.672348 27868 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:50.718343 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:50.672123 27894 raft_consensus.cc:2804] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:50.720768 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:50.697175 25650 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:50.721608 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:50.655239 25834 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 7.
W20260709 12:23:50.733839 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:50.742456 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:50.742703 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:50.746176 25835 raft_consensus.cc:2468] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 3.
I20260709 12:23:50.750662 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:50.735527 27833 raft_consensus.cc:740] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:50.752563 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:50.738499 27894 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:50.753931 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:50.752671 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:50.760218 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:50.746472 27890 raft_consensus.cc:2804] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:50.748796 27898 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:50.762759 25800 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:50.750211 27933 raft_consensus.cc:2749] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:23:50.764794 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 134043us
I20260709 12:23:50.767905 25726 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
W20260709 12:23:50.769505 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:50.736712 27868 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:50.759032 27894 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:50.781081 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:50.786283 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:50.788121 25726 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:50.781905 27890 raft_consensus.cc:697] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:50.779088 27811 raft_consensus.cc:2749] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:50.764986 27817 consensus_queue.cc:1059] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
W20260709 12:23:50.797629 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 141214us
I20260709 12:23:50.779742 27898 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:50.791671 27909 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:50.803583 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:50.804796 25837 raft_consensus.cc:2393] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 6: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:23:50.808825 27898 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:50.810854 27932 raft_consensus.cc:2749] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:50.811592 27932 consensus_queue.cc:1059] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:50.812393 27932 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:50.799561 27833 consensus_queue.cc:260] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:50.813387 27833 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:50.816526 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:50.817553 25837 raft_consensus.cc:2368] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 2. Current term is 3.
I20260709 12:23:50.823755 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:50.824625 26439 raft_consensus.cc:2468] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 3.
I20260709 12:23:50.831173 27936 consensus_queue.cc:1059] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:50.832491 27870 raft_consensus.cc:3060] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:50.833864 25833 raft_consensus.cc:1240] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:50.833915 25650 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:50.823276 27933 raft_consensus.cc:3055] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:50.841480 25837 raft_consensus.cc:1275] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:23:50.843281 27868 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:50.844882 27863 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:50.841058 27838 raft_consensus.cc:2804] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:50.845630 27838 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:50.845989 27838 raft_consensus.cc:3060] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:50.845986 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:50.841300 27933 raft_consensus.cc:740] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:50.856726 25828 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 3.
I20260709 12:23:50.864553 27838 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:50.867190 27838 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:50.868312 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:50.868980 26432 raft_consensus.cc:3060] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:50.870826 27894 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:50.873296 25801 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:50.875358 27863 consensus_queue.cc:1059] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:50.876704 27863 raft_consensus.cc:2804] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:50.876787 26432 raft_consensus.cc:2468] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 4.
I20260709 12:23:50.877188 27863 raft_consensus.cc:697] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:50.878127 27863 consensus_queue.cc:237] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:50.826848 27890 consensus_queue.cc:237] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:50.882745 25831 raft_consensus.cc:1275] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:50.892926 27838 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:50.893512 27838 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:50.894455 27868 consensus_queue.cc:1048] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:50.852583 27933 consensus_queue.cc:260] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:50.896138 27841 consensus_queue.cc:1048] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:50.896627 27933 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:50.895737 27838 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:50.899461 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:50.899713 26437 raft_consensus.cc:1275] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:50.900123 26430 raft_consensus.cc:2468] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 3.
W20260709 12:23:50.906587 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:50.927908 27879 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:50.931280 27836 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:50.930966 27879 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:50.932863 27892 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:50.934216 27879 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:50.936317 27907 raft_consensus.cc:3055] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:50.936792 27907 raft_consensus.cc:740] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:23:50.937616 27907 consensus_queue.cc:260] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:50.940131 27907 raft_consensus.cc:3060] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:50.940232 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:50.940819 25828 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 3.
I20260709 12:23:50.942008 25650 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:23:50.943337 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 178279us
I20260709 12:23:50.964177 27841 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:50.945852 25650 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:50.960364 27773 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:50.963670 27811 raft_consensus.cc:3055] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:23:50.972733 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:50.973747 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:50.960708 27909 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:50.977023 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:50.942773 27879 raft_consensus.cc:2804] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:50.982724 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:50.978922 25800 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:50.965765 27903 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:50.985564 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:50.985659 27903 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:50.971100 27811 raft_consensus.cc:740] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:50.988088 27860 consensus_queue.cc:1048] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:50.987905 27903 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:50.988852 27811 consensus_queue.cc:260] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:50.988217 25685 raft_consensus.cc:2393] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 3: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:23:50.970606 27832 raft_consensus.cc:2804] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:50.990392 27832 raft_consensus.cc:697] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 4 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:50.971254 27773 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:50.931871 27836 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:23:51.001974 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:50.964798 27841 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:50.981056 27879 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:51.028733 25800 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:51.037695 25677 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:23:51.029270 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 241225us
I20260709 12:23:50.991307 27832 consensus_queue.cc:237] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:50.997687 27885 raft_consensus.cc:2749] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:23:51.043596 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 169414us
I20260709 12:23:51.036156 27879 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:50.982553 27909 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:51.048729 25685 raft_consensus.cc:1240] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:51.040022 27894 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:51.057233 27794 raft_consensus.cc:3060] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:51.061297 27773 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:51.061410 27836 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:51.063279 25686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40230 (request call id 1232) took 1076 ms. Trace:
I20260709 12:23:51.063719 25686 rpcz_store.cc:276] 0709 12:23:49.986981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.987113 (+   132us) service_pool.cc:224] Handling call
0709 12:23:51.063110 (+1075997us) spinlock_profiling.cc:243] Waited 326 ms on lock 0x7b54002648d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:23:51.063218 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":750270720}
I20260709 12:23:51.069733 26435 raft_consensus.cc:1240] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:51.070713 27841 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:51.071312 27796 raft_consensus.cc:3060] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:51.073177 27922 raft_consensus.cc:3055] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:51.073693 27922 raft_consensus.cc:740] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:51.073997 25677 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 4.
I20260709 12:23:51.074752 27922 consensus_queue.cc:260] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:23:51.076000 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.077942 25760 raft_consensus.cc:1240] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:51.078385 25761 raft_consensus.cc:1275] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:51.079483 25760 raft_consensus.cc:1275] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:51.080293 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:51.080452 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:51.081187 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:51.080559 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:51.083640 26437 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEARNER]: Advancing to term 3
I20260709 12:23:51.048974 25726 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:51.080294 25680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 1836) took 1184 ms. Trace:
I20260709 12:23:51.084887 26402 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
W20260709 12:23:51.085731 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.085995 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:51.085292 25680 rpcz_store.cc:276] 0709 12:23:49.896818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.896944 (+   126us) service_pool.cc:224] Handling call
0709 12:23:51.080147 (+1183203us) spinlock_profiling.cc:243] Waited 408 ms on lock 0x7b54002652d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:23:51.080240 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":937591040}
I20260709 12:23:51.100601 27946 raft_consensus.cc:2749] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:51.101876 27932 raft_consensus.cc:2749] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:51.102578 25754 raft_consensus.cc:1240] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:51.114017 25678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 1847) took 1065 ms. Trace:
I20260709 12:23:51.114454 25678 rpcz_store.cc:276] 0709 12:23:50.048575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:50.161358 (+112783us) service_pool.cc:224] Handling call
0709 12:23:50.202872 (+ 41514us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:50.300735 (+ 97863us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:50.300761 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:50.300814 (+    53us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:50.300845 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:51.113812 (+812967us) spinlock_profiling.cc:243] Waited 97.7 ms on lock 0x7b5400203354. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:23:51.113852 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:51.113959 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":224674560}
I20260709 12:23:51.117323 27936 consensus_queue.cc:1048] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:51.099000 27940 raft_consensus.cc:2749] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:51.045563 27937 consensus_queue.cc:1048] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 12:23:51.122278 25755 raft_consensus.cc:2468] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 3.
W20260709 12:23:51.124390 27947 log.cc:927] Time spent T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 12:23:51.133155 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:51.133795 25757 raft_consensus.cc:2468] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 3.
I20260709 12:23:51.134320 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:51.134699 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:51.135294 25760 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 7.
I20260709 12:23:51.049248 27948 raft_consensus.cc:2749] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:51.135555 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:51.136330 25759 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 4.
W20260709 12:23:51.174201 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 125272us
I20260709 12:23:51.177904 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:51.182196 25726 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:51.182293 25759 raft_consensus.cc:2468] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 3.
W20260709 12:23:51.178143 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.178911 25681 raft_consensus.cc:2468] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 4.
I20260709 12:23:51.123698 25581 catalog_manager.cc:5697] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 reported cstate change: config changed from index 4 to 5, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:51.187110 25581 catalog_manager.cc:5697] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 4 to 5, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 5 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:51.194976 25581 catalog_manager.cc:5697] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: config changed from index 2 to 3, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:51.214231 26437 raft_consensus.cc:1275] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 3 LEARNER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:23:51.193804 25726 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:51.216185 25726 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:51.218793 25726 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:23:51.220777 25726 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:51.222962 27937 raft_consensus.cc:2749] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:23:51.229648 25801 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:51.230640 25649 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:51.231784 25649 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:51.217396 27940 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:51.233180 25801 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:51.193326 27838 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:51.214231 27944 raft_consensus.cc:2749] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:51.237092 25726 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:51.241367 25649 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:23:51.251883 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 199422us
W20260709 12:23:51.244822 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 275796us
I20260709 12:23:51.234551 27907 consensus_queue.cc:1059] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:23:51.253412 25800 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:51.253485 27907 raft_consensus.cc:3055] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:23:51.254015 27907 raft_consensus.cc:740] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:23:51.254509 25800 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:23:51.255370 25800 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:51.255246 27817 raft_consensus.cc:2749] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:51.255430 27815 raft_consensus.cc:2804] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:51.256263 27842 raft_consensus.cc:2749] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:23:51.256646 25800 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:51.256678 27815 raft_consensus.cc:697] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:51.255203 27907 consensus_queue.cc:260] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:51.257776 25800 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:51.257941 27815 consensus_queue.cc:237] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:51.258737 27907 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:51.223690 27918 raft_consensus.cc:3060] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:51.221133 27929 raft_consensus.cc:2749] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:51.268285 25726 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:51.269766 27901 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:51.270040 25726 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:51.225718 27938 raft_consensus.cc:2764] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:23:51.271337 25726 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:51.234831 27821 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:51.234153 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:51.272934 25680 raft_consensus.cc:1240] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:51.279273 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:51.275040 25800 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:51.277832 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:23:51.274371 26402 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.245.131:36237 timed out after 1.518s (SENT) [suppressed 46 similar messages]
I20260709 12:23:51.292240 25677 raft_consensus.cc:1275] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:23:51.234402 27841 raft_consensus.cc:2749] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:51.272976 25801 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:23:51.295626 26437 raft_consensus.cc:1275] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:51.296103 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:51.250954 27898 raft_consensus.cc:2804] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:51.303536 26439 raft_consensus.cc:2393] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 3: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:23:51.303594 25763 raft_consensus.cc:2468] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 3.
I20260709 12:23:51.291270 25649 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:51.250662 27945 raft_consensus.cc:2804] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:51.249873 27794 raft_consensus.cc:2749] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:51.236289 27949 raft_consensus.cc:2749] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:51.227010 27837 consensus_queue.cc:1048] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:23:51.225550 27833 consensus_queue.cc:1048] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
I20260709 12:23:51.273984 27928 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:51.317195 25681 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 1837) took 1417 ms (client timeout 1657 ms). Trace:
I20260709 12:23:51.318292 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:51.315259 25649 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:23:51.288183 27852 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.820s	user 0.028s	sys 0.023s
W20260709 12:23:51.338138 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:51.336824 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 61865.8us
I20260709 12:23:51.339255 25800 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:51.271821 27872 raft_consensus.cc:2749] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:51.324352 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:51.341802 25828 raft_consensus.cc:2468] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 2.
I20260709 12:23:51.268972 27817 raft_consensus.cc:2749] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:23:51.319373 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:51.289328 27796 raft_consensus.cc:3060] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:51.234073 27887 consensus_queue.cc:1059] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 12:23:51.274204 27909 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:51.276533 27895 raft_consensus.cc:2804] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:23:51.316079 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 44817.5us
I20260709 12:23:51.235440 27940 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:51.335161 25832 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Advancing to term 9
W20260709 12:23:51.334885 25681 rpcz_store.cc:269] 0709 12:23:49.899700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:49.899832 (+   132us) service_pool.cc:224] Handling call
0709 12:23:51.317043 (+1417211us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54002cfbd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:23:51.317145 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2725563648}
I20260709 12:23:51.355515 25726 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:51.331408 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:51.264123 27838 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:51.308485 27916 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:51.307679 27883 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:51.357555 25649 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
W20260709 12:23:51.358645 25726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.317358 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:51.311476 27944 raft_consensus.cc:2749] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:51.324419 27836 raft_consensus.cc:2804] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:23:51.338657 27852 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.871s	user 0.029s	sys 0.023s
I20260709 12:23:51.363057 27938 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:51.366842 27872 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:51.341826 27793 consensus_queue.cc:1048] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:23:51.357137 27895 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:51.368080 27957 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:51.396907 27957 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:51.384231 27870 raft_consensus.cc:2804] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:51.397485 27940 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:51.397864 27870 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:51.398304 27870 raft_consensus.cc:3060] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:51.399274 27957 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:51.373282 27916 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:51.372306 27949 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:51.401887 27949 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:51.404134 27872 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:51.405407 25762 raft_consensus.cc:1275] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:51.405457 27811 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:51.386541 27836 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:51.406693 27836 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:51.376560 27838 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:51.377542 25649 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:51.343884 27928 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:51.413590 27928 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:51.414111 27928 raft_consensus.cc:2804] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:51.414496 27928 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:51.414752 25758 raft_consensus.cc:1275] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:23:51.414866 27928 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:23:51.417619 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.357795 27875 raft_consensus.cc:2804] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:51.419126 27875 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:51.419569 27875 raft_consensus.cc:3060] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:51.422966 25650 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:51.389065 27879 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:51.425971 27879 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:23:51.427348 27954 log.cc:927] Time spent T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 12:23:51.352768 27885 raft_consensus.cc:2749] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:51.429064 27901 raft_consensus.cc:2749] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:51.429530 27872 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:51.356521 27868 raft_consensus.cc:2764] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:23:51.350090 27945 raft_consensus.cc:697] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:51.432713 27945 consensus_queue.cc:237] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:51.437861 27909 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:51.438573 27909 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:51.441692 25681 raft_consensus.cc:1240] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:51.442020 25678 raft_consensus.cc:1240] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:51.442875 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:51.443483 25755 raft_consensus.cc:2468] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 4.
I20260709 12:23:51.378846 27883 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:51.414608 27796 raft_consensus.cc:2749] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:51.447561 27883 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:51.449195 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:51.449879 25828 raft_consensus.cc:2468] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 4.
I20260709 12:23:51.451248 25831 raft_consensus.cc:1275] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:51.452308 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:51.452888 25833 raft_consensus.cc:2468] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 2.
I20260709 12:23:51.379136 27930 consensus_queue.cc:1048] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:51.348278 27956 raft_consensus.cc:2749] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:51.380702 27842 raft_consensus.cc:3055] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:23:51.468089 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 195181us
I20260709 12:23:51.470013 27898 raft_consensus.cc:697] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:51.470487 25763 raft_consensus.cc:1240] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:51.471553 27842 raft_consensus.cc:740] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:51.380970 27794 consensus_queue.cc:1059] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:51.388453 25726 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:51.393921 25832 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 9.
I20260709 12:23:51.470006 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:23:51.395166 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 56006.2us
I20260709 12:23:51.396270 26430 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 3.
I20260709 12:23:51.397287 27895 raft_consensus.cc:3060] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:51.478817 25760 raft_consensus.cc:1240] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:51.479192 27842 consensus_queue.cc:260] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:51.480335 27922 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:51.480412 27842 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:51.480947 27595 consensus_queue.cc:1059] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:51.481933 27595 raft_consensus.cc:3055] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:51.482242 27595 raft_consensus.cc:740] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:23:51.482523 27833 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:51.483001 27833 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:51.483075 27595 consensus_queue.cc:260] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:51.384871 26434 raft_consensus.cc:2468] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 3.
I20260709 12:23:51.484006 27793 consensus_queue.cc:1048] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:51.378077 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:51.485025 27909 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:51.465085 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:51.477015 27868 raft_consensus.cc:2804] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:51.485848 27868 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:51.486193 27868 raft_consensus.cc:3060] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:51.465452 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:51.486680 27833 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:23:51.466951 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 44082us
I20260709 12:23:51.466987 27949 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:51.467355 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:51.373467 25829 raft_consensus.cc:2468] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 3.
I20260709 12:23:51.476471 25649 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:51.478363 27794 raft_consensus.cc:3055] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:23:51.489880 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 101500us
I20260709 12:23:51.491771 27948 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:51.492429 27930 raft_consensus.cc:2804] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:51.492980 27794 raft_consensus.cc:740] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:51.502368 27930 raft_consensus.cc:697] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:51.502692 27794 consensus_queue.cc:260] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:51.503301 27930 consensus_queue.cc:237] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:51.504711 25832 raft_consensus.cc:1275] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:23:51.504444 27895 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:51.506433 27895 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:51.507014 27948 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:51.507767 27870 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:51.499255 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:51.495186 25726 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:51.501718 25833 raft_consensus.cc:1240] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:23:51.498601 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:51.503798 27794 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:51.499585 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:51.512001 25754 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 4.
I20260709 12:23:51.476265 27957 consensus_queue.cc:1048] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:23:51.513644 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:51.513922 25758 raft_consensus.cc:1240] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:51.500438 27823 raft_consensus.cc:2804] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:51.514990 27823 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:51.515348 27823 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:51.516880 27916 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:51.517110 27863 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:51.517755 27863 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:51.471352 27898 consensus_queue.cc:237] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:51.524209 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:51.526899 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:51.527596 25757 raft_consensus.cc:3060] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:51.535099 25726 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:51.492791 27595 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:51.548878 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:23:51.546991 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 272647us
W20260709 12:23:51.547363 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 56343.7us
I20260709 12:23:51.510901 27907 consensus_queue.cc:1059] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:23:51.550650 27872 raft_consensus.cc:2804] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:51.551079 27872 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:51.551239 27907 raft_consensus.cc:3055] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:51.551453 27872 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:51.551628 27907 raft_consensus.cc:740] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:23:51.552628 27907 consensus_queue.cc:260] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:51.553839 27907 raft_consensus.cc:3060] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:23:51.554839 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.545179 27937 raft_consensus.cc:2749] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:51.563838 26402 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:51.568675 25726 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:51.540335 27867 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:51.528337 27963 raft_consensus.cc:2749] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:51.560111 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:51.572343 25726 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:51.577172 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:51.577702 26402 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:51.578538 25726 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:51.569342 27898 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:51.579528 27898 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:51.581748 27898 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:51.568262 27863 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:51.572794 27796 raft_consensus.cc:2749] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:51.572602 27938 raft_consensus.cc:2749] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:51.600178 25836 raft_consensus.cc:1240] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:51.596833 27936 raft_consensus.cc:2749] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:51.605423 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:51.588249 27916 raft_consensus.cc:2749] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:51.606205 26435 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:51.609882 25726 leader_election.cc:400] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 election: Vote denied by peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237) with higher term. Message: Invalid argument: T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 2. Current term is 3.
I20260709 12:23:51.610622 25726 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:51.612852 26402 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:51.616135 26402 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:51.618121 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:51.619506 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:51.595736 27937 raft_consensus.cc:2749] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:51.598290 27901 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:51.630266 27872 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:51.588455 25834 raft_consensus.cc:2376] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 5. Re-sending same reply.
I20260709 12:23:51.621148 27940 raft_consensus.cc:2804] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:51.632759 27940 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:51.633137 27940 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:51.635182 27875 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:51.575074 27836 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:51.625560 25836 raft_consensus.cc:1275] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:23:51.612665 27918 raft_consensus.cc:2749] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:23:51.622308 26402 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:51.605523 27936 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:51.574986 27867 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:51.650141 27880 raft_consensus.cc:2749] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:51.650370 25834 raft_consensus.cc:1240] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 2. Current term is 3. Ops: []
W20260709 12:23:51.652839 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 163446us
I20260709 12:23:51.638304 27934 raft_consensus.cc:2804] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:51.656098 27934 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:51.656476 27934 raft_consensus.cc:3060] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:51.635587 27823 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:51.663295 25757 raft_consensus.cc:2468] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 4.
I20260709 12:23:51.675359 27872 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:51.657661 27930 consensus_queue.cc:1059] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 12:23:51.686233 25831 raft_consensus.cc:1240] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:51.690845 25829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44218 (request call id 1320) took 1031 ms. Trace:
I20260709 12:23:51.657156 27880 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:51.623049 27916 consensus_queue.cc:1059] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:23:51.691205 25829 rpcz_store.cc:276] 0709 12:23:50.659263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:50.758071 (+ 98808us) service_pool.cc:224] Handling call
0709 12:23:51.690688 (+932617us) spinlock_profiling.cc:243] Waited 571 ms on lock 0x7b540010ac54. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:23:51.690796 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1313869056}
I20260709 12:23:51.694656 25836 raft_consensus.cc:1240] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:51.649511 27936 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:51.689096 27836 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:23:51.708860 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:51.717128 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:51.722746 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 187188us
I20260709 12:23:51.730676 25836 raft_consensus.cc:1240] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:51.730993 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:51.731892 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:51.732813 25761 raft_consensus.cc:2393] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 3: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:23:51.722584 27793 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:51.736788 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 83254.7us
I20260709 12:23:51.736946 27793 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:51.737468 25650 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:51.738193 27928 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:51.738437 27895 consensus_queue.cc:1048] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:51.739161 27793 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:51.740176 27863 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:51.740671 27863 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:51.742333 27883 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:51.742903 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:51.744534 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:51.745296 25833 raft_consensus.cc:2376] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 4. Re-sending same reply.
I20260709 12:23:51.747164 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:51.748200 25754 raft_consensus.cc:2468] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 3.
I20260709 12:23:51.748476 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:51.742835 27883 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:51.739117 27949 raft_consensus.cc:2804] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:51.750080 27949 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:51.750453 27949 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:51.751255 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:51.751425 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:51.751824 25758 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:51.752243 25828 raft_consensus.cc:2376] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 5. Re-sending same reply.
I20260709 12:23:51.738291 25650 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:51.750955 27934 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:51.757129 25680 raft_consensus.cc:1275] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:23:51.758303 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:51.758584 25649 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:51.757097 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:51.760040 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:51.760624 25680 raft_consensus.cc:2376] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 4. Re-sending same reply.
I20260709 12:23:51.761329 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:51.761951 25685 raft_consensus.cc:2468] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 2.
I20260709 12:23:51.762838 27936 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:51.762887 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:51.763507 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:51.764269 25831 raft_consensus.cc:2393] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 2: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:23:51.764534 27872 raft_consensus.cc:3055] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:51.764917 27872 raft_consensus.cc:740] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:51.765887 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:51.759754 27934 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:51.771409 25761 raft_consensus.cc:3060] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:51.768808 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:51.773330 25836 raft_consensus.cc:2468] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 2.
I20260709 12:23:51.764923 27867 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:51.780153 27841 raft_consensus.cc:2804] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:51.780602 27883 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:51.780745 27841 raft_consensus.cc:697] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 4 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
W20260709 12:23:51.781903 27972 log.cc:927] Time spent T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.144s	user 0.001s	sys 0.000s
W20260709 12:23:51.783105 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 44882.2us
I20260709 12:23:51.716090 27940 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:51.787668 25800 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:23:51.788093 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:51.791508 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:51.792286 25831 raft_consensus.cc:2376] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 2. Re-sending same reply.
I20260709 12:23:51.762153 27875 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:51.701992 27880 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:51.788911 27773 raft_consensus.cc:2804] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:51.772183 27895 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:51.823968 27895 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:51.765771 27872 consensus_queue.cc:260] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:51.825157 27870 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:51.816332 27928 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:51.825671 27872 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:51.826076 27895 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:51.816316 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:51.815439 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:51.827370 25833 raft_consensus.cc:2468] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 2.
I20260709 12:23:51.793377 27823 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:51.795729 27842 raft_consensus.cc:2804] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:51.828441 27842 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:51.828963 27842 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:51.829195 27940 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:51.829293 27880 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:51.819340 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:51.832283 25830 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:23:51.832665 27974 log.cc:927] Time spent T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.170s	user 0.000s	sys 0.004s
I20260709 12:23:51.782244 27841 consensus_queue.cc:237] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:51.791356 27833 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:51.837312 27833 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:51.838271 25755 raft_consensus.cc:1275] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:23:51.838625 25755 pending_rounds.cc:85] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 1
I20260709 12:23:51.838851 25755 pending_rounds.cc:107] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:23:51.839123 25755 raft_consensus.cc:2889] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:51.839394 27833 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:23:51.824388 27979 log.cc:927] Time spent T 00000000000000000000000000000000 P 496fd6924b624e77b03ccfd15653d47b: Append to log took a long time: real 0.161s	user 0.002s	sys 0.000s
W20260709 12:23:51.827994 27944 consensus_queue.cc:1175] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5cccf20a8bff46dba6601f241d172b8a" responder_term: 3 status { last_received { term: 2 index: 3 } last_committed_idx: 3 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:23:51.831645 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:51.782438 27868 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:51.785686 25726 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:23:51.843623 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:51.846947 25762 raft_consensus.cc:1275] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:23:51.850136 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 64538.1us
I20260709 12:23:51.844240 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:51.847014 25755 raft_consensus.cc:2468] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 3.
I20260709 12:23:51.855702 25800 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
W20260709 12:23:51.859869 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 58985us
I20260709 12:23:51.864519 25649 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:51.868698 25761 raft_consensus.cc:1275] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:23:51.871552 26402 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.842154 27948 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:23:51.858156 27978 log.cc:927] Time spent T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:23:51.877959 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:23:51.878897 26402 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.880510 27838 consensus_queue.cc:1048] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:51.881171 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:51.890377 26436 raft_consensus.cc:3060] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:51.891110 25757 raft_consensus.cc:1240] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:51.858489 27937 raft_consensus.cc:2804] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:51.881909 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:51.882900 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:51.884192 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:51.884294 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:51.885015 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:51.895601 25754 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:51.881669 25683 raft_consensus.cc:2368] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 3. Current term is 4.
I20260709 12:23:51.896553 25726 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:23:51.885897 25762 raft_consensus.cc:3060] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:51.898604 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:51.899760 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:51.888885 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:51.893512 25801 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:51.900950 26437 raft_consensus.cc:2393] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 3: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:23:51.901782 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:51.902437 25801 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:51.871480 27966 raft_consensus.cc:2804] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:51.902827 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:51.903179 27966 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:51.903393 26437 raft_consensus.cc:2468] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 3.
I20260709 12:23:51.903585 27966 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:51.894949 25755 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 5.
I20260709 12:23:51.905833 27980 raft_consensus.cc:3055] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:51.906495 27980 raft_consensus.cc:740] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:23:51.907295 27980 consensus_queue.cc:260] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:51.908149 27936 consensus_queue.cc:1059] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:51.900110 27940 consensus_queue.cc:1048] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:51.910691 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:51.912804 27963 raft_consensus.cc:2804] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:51.915720 26437 raft_consensus.cc:2468] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 3.
I20260709 12:23:51.913558 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:51.915278 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:51.871758 27773 raft_consensus.cc:697] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 9 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:51.911546 27875 raft_consensus.cc:2749] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:51.864547 27898 consensus_queue.cc:1048] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 12:23:51.916204 26402 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
W20260709 12:23:52.012985 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 49187.1us
I20260709 12:23:52.021554 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:51.972728 25830 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 4.
I20260709 12:23:51.887017 27841 raft_consensus.cc:2804] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:52.023356 25678 raft_consensus.cc:2393] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 5: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:23:52.017403 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:51.967028 25758 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 8.
I20260709 12:23:51.916074 27963 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:51.946671 25649 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:51.965898 27937 raft_consensus.cc:697] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:51.915345 25762 raft_consensus.cc:1275] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:23:51.949081 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:23:51.935662 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:51.950661 25650 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:51.921885 25759 raft_consensus.cc:1240] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:51.871313 27901 raft_consensus.cc:2749] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:51.945596 27956 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:51.921602 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:52.035316 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 88691.6us
I20260709 12:23:52.016379 25754 raft_consensus.cc:2468] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 5.
I20260709 12:23:51.950158 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:23:52.032954 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 116833us
I20260709 12:23:51.934712 27894 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:51.917258 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:52.030792 27938 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:52.046779 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:23:52.048552 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 97979.9us
I20260709 12:23:52.091814 25801 leader_election.cc:400] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 election: Vote denied by peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) with higher term. Message: Invalid argument: T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 3. Current term is 4.
I20260709 12:23:52.092902 25801 leader_election.cc:403] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:23:52.055625 25649 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:23:51.917006 27981 log.cc:927] Time spent T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
W20260709 12:23:52.110975 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 55419us
W20260709 12:23:52.048883 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:52.112164 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 56035.5us
W20260709 12:23:52.115388 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 59509.8us
I20260709 12:23:52.116633 26402 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:23:52.115293 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 60115.6us
I20260709 12:23:52.033900 27940 raft_consensus.cc:2749] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:51.894657 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:51.887324 27885 consensus_queue.cc:1048] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.164s
I20260709 12:23:52.039690 27963 raft_consensus.cc:3060] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:52.147542 26402 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:52.035501 27957 raft_consensus.cc:2804] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:52.052790 27879 raft_consensus.cc:2749] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:52.036119 27773 consensus_queue.cc:237] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:52.136544 27934 raft_consensus.cc:2749] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:52.143827 27986 consensus_queue.cc:1059] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
W20260709 12:23:52.159478 27907 consensus_meta.cc:287] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.598s	user 0.007s	sys 0.000s
I20260709 12:23:52.118455 27867 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:52.044091 27841 raft_consensus.cc:697] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:52.162925 26430 raft_consensus.cc:1240] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:52.162701 27966 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:23:52.166357 27987 log.cc:927] Time spent T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 12:23:51.936241 26435 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 9.
I20260709 12:23:52.169314 26438 raft_consensus.cc:1275] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:23:52.204278 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 56836.9us
I20260709 12:23:52.118775 27909 raft_consensus.cc:2804] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:52.204391 25650 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:52.208801 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:52.118609 27815 raft_consensus.cc:3060] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:52.213469 26437 raft_consensus.cc:2468] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 3.
I20260709 12:23:52.216041 26436 raft_consensus.cc:2468] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 4.
I20260709 12:23:52.039325 27949 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:52.250732 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:52.264438 25828 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:52.264879 26436 raft_consensus.cc:1240] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 6. Current term is 7. Ops: []
W20260709 12:23:52.252714 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:52.124573 27883 consensus_queue.cc:1048] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.088s
I20260709 12:23:52.095345 27956 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:52.111986 27938 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:52.111510 27894 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:52.205504 27940 raft_consensus.cc:2804] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:23:52.259661 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 55353.2us
I20260709 12:23:52.289850 25650 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:52.207329 27957 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:52.273051 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:52.277176 26402 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:52.277784 27880 consensus_queue.cc:1059] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:52.279268 26438 raft_consensus.cc:1240] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:52.261382 27967 raft_consensus.cc:2749] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:52.279819 27932 raft_consensus.cc:2804] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:52.286253 25828 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 8.
I20260709 12:23:52.293920 25686 raft_consensus.cc:1240] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:52.293800 25650 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:52.251709 27868 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:52.297111 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:52.280480 27909 raft_consensus.cc:697] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 8 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:52.306087 25836 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 5.
I20260709 12:23:52.298435 26402 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:52.251389 27867 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:52.307399 25649 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:52.293001 27957 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:52.311540 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:52.267426 27907 consensus_queue.cc:1048] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:23:52.314723 25650 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:52.317919 27967 consensus_queue.cc:1048] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:52.317826 27841 consensus_queue.cc:237] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:52.319123 27863 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:23:52.320261 27985 log.cc:927] Time spent T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:23:52.325363 27983 raft_consensus.cc:2749] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:52.326368 27773 raft_consensus.cc:2804] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:52.327066 27773 raft_consensus.cc:697] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 5 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:52.328156 27773 consensus_queue.cc:237] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:52.259511 27937 consensus_queue.cc:237] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:52.328652 27909 consensus_queue.cc:237] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:52.335081 27932 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:52.337569 27949 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:52.338127 27949 raft_consensus.cc:2749] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:52.338657 27796 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:52.339711 27867 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:52.339361 27796 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:52.341717 27796 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:52.343122 27956 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:52.344129 27836 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:52.344586 27836 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:52.346410 27836 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:52.347102 25650 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:52.347638 27938 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:52.347836 27836 raft_consensus.cc:2804] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:52.348268 27836 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:52.348592 27836 raft_consensus.cc:3060] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:52.349577 27894 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:52.298928 27895 raft_consensus.cc:2804] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:52.352097 27895 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:52.352500 27895 raft_consensus.cc:3060] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:52.353080 25650 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:23:52.356043 27842 consensus_meta.cc:287] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.527s	user 0.011s	sys 0.000s
I20260709 12:23:52.356670 27842 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:52.357280 27836 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:52.358136 27940 raft_consensus.cc:697] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 5 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
W20260709 12:23:52.358770 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 60436.3us
I20260709 12:23:52.359365 27836 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:52.359076 27940 consensus_queue.cc:237] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:52.380038 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:52.359544 26402 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:52.373733 26439 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 3 LEARNER]: Advancing to term 4
I20260709 12:23:52.371721 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:23:52.361883 27595 consensus_meta.cc:287] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.797s	user 0.008s	sys 0.003s
W20260709 12:23:52.384047 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 68382.3us
I20260709 12:23:52.362938 27870 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:52.380446 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:52.360246 27916 raft_consensus.cc:2804] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:52.419286 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:52.212280 27945 consensus_queue.cc:1048] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.095s
I20260709 12:23:52.361063 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:52.426851 25836 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:52.311774 27833 raft_consensus.cc:2749] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:52.360004 27883 raft_consensus.cc:2804] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:52.379244 27966 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:52.371642 26432 raft_consensus.cc:3060] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:52.396211 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:52.399546 25835 raft_consensus.cc:1240] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 4. Current term is 5. Ops: []
W20260709 12:23:52.432914 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 140741us
I20260709 12:23:52.441239 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:52.442142 25684 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 5.
I20260709 12:23:52.401521 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:52.402405 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:52.335675 27932 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:23:52.406486 27971 log.cc:927] Time spent T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.697s	user 0.002s	sys 0.002s
I20260709 12:23:52.407239 27842 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:52.408401 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:52.412072 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:52.413671 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:52.448944 25682 raft_consensus.cc:2393] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 3: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:23:52.416047 25680 raft_consensus.cc:1275] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:23:52.394590 25650 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:52.416831 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:52.417939 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:52.420269 27595 raft_consensus.cc:2749] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:52.449709 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:52.445358 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:52.450740 25686 raft_consensus.cc:2393] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 4: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
W20260709 12:23:52.420390 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 60909.8us
I20260709 12:23:52.420269 25681 raft_consensus.cc:2468] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 4.
I20260709 12:23:52.372550 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:52.423672 25759 raft_consensus.cc:1275] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:23:52.424794 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
W20260709 12:23:52.456533 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 62017.3us
I20260709 12:23:52.456936 25837 raft_consensus.cc:2393] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 4: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:23:52.425994 26433 raft_consensus.cc:2468] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 1.
I20260709 12:23:52.433717 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:52.451582 26402 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:52.431116 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:52.462777 25678 raft_consensus.cc:2393] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 4: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:23:52.460677 25762 raft_consensus.cc:1275] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:23:52.426417 27956 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:52.473657 25836 raft_consensus.cc:2468] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 5.
I20260709 12:23:52.439534 27930 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:52.438362 27916 raft_consensus.cc:697] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 4 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:23:52.485569 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:52.490061 26430 raft_consensus.cc:3060] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:52.407232 27870 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:52.489019 26402 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:52.508116 26402 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:52.455111 27883 raft_consensus.cc:697] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 4 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:52.461719 27860 raft_consensus.cc:2749] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:52.457847 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:52.516081 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:23:52.524856 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:52.520620 25760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 1890) took 1023 ms. Trace:
I20260709 12:23:52.521697 27934 raft_consensus.cc:3060] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:52.522778 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:52.532618 26402 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:23:52.488324 27986 raft_consensus.cc:2749] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:52.559075 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:52.565476 27870 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:52.485875 27956 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:52.573858 27956 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:52.582137 27934 raft_consensus.cc:2749] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:52.582894 26436 raft_consensus.cc:3060] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:52.585721 27963 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:52.509821 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:52.528280 25760 rpcz_store.cc:276] 0709 12:23:51.496694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:51.496796 (+   102us) service_pool.cc:224] Handling call
0709 12:23:51.513366 (+ 16570us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:52.210181 (+696815us) spinlock_profiling.cc:243] Waited 2.75 ms on lock 0x7b54000e8ba0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99adc858 00007f5d99b60e9d 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c
0709 12:23:52.210262 (+    81us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:52.210304 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:52.210365 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:52.210426 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:52.520305 (+309879us) spinlock_profiling.cc:243] Waited 375 ms on lock 0x7b54001004d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:23:52.520379 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:52.520547 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18876,"raft.queue_time_us":1674,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":42591,"spinlock_wait_cycles":869288576}
I20260709 12:23:52.589665 26436 raft_consensus.cc:2468] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 3.
W20260709 12:23:52.602038 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 85538.8us
I20260709 12:23:52.602855 26402 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:52.605798 26439 raft_consensus.cc:1275] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 4 LEARNER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:23:52.511453 27948 consensus_queue.cc:1048] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.093s
I20260709 12:23:52.597117 27936 raft_consensus.cc:3055] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:52.619450 26402 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:23:52.682469 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:52.604446 25679 raft_consensus.cc:1275] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:23:52.506645 27930 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:52.587883 27963 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:52.603754 27986 raft_consensus.cc:2804] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:52.595438 26430 raft_consensus.cc:2468] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 4.
I20260709 12:23:52.724987 25650 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:23:52.725363 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 289666us
I20260709 12:23:52.727319 27903 raft_consensus.cc:2749] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:23:52.728056 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 108717us
I20260709 12:23:52.728798 26402 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:52.686069 27821 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:52.729801 25650 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:52.731171 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:52.732995 25836 raft_consensus.cc:2393] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 3: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:23:52.683689 27936 raft_consensus.cc:740] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:23:52.686185 27998 raft_consensus.cc:2804] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:52.738737 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:52.735587 25650 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:52.688432 27986 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:52.733525 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:52.743270 25837 raft_consensus.cc:3060] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:52.631263 27895 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:52.751658 27982 raft_consensus.cc:2749] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:52.752655 27982 raft_consensus.cc:2749] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:23:52.765686 27895 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:52.747210 28006 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:52.769340 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:52.769141 28006 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:52.769963 26433 raft_consensus.cc:2468] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 4.
I20260709 12:23:52.770915 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:52.745354 27986 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:52.732091 27815 raft_consensus.cc:2749] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) with higher term. Message: Invalid argument: T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 3. Current term is 4.
I20260709 12:23:52.773502 25685 raft_consensus.cc:2468] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 3.
I20260709 12:23:52.772393 27983 raft_consensus.cc:3055] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:52.697773 27916 consensus_queue.cc:237] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:52.741132 27836 raft_consensus.cc:2749] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:52.788957 27903 raft_consensus.cc:2749] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:52.777392 27983 raft_consensus.cc:740] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:23:52.763531 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:52.745507 27892 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:52.828325 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 84385us
I20260709 12:23:52.829229 25650 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:52.829763 25832 raft_consensus.cc:1275] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:23:52.772485 27980 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:52.740346 27909 consensus_queue.cc:1059] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 12:23:52.747532 27998 raft_consensus.cc:697] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:23:52.750152 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:52.834379 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:52.844987 25757 raft_consensus.cc:2393] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 3: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:23:52.728641 27883 consensus_queue.cc:237] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:52.741792 27821 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:52.832918 25726 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:23:52.827891 27934 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:52.795743 27880 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:52.864741 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:52.837915 27841 raft_consensus.cc:3060] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:52.863478 25829 raft_consensus.cc:2468] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 4.
I20260709 12:23:52.791136 27957 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:52.875126 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:52.878826 25684 raft_consensus.cc:3060] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:52.846015 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:52.852617 26430 raft_consensus.cc:1275] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:23:52.852682 25834 raft_consensus.cc:2468] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 6.
W20260709 12:23:52.898152 27997 log.cc:927] Time spent T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 12:23:52.860575 27934 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:52.920338 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:52.921146 25757 raft_consensus.cc:2468] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 3.
I20260709 12:23:52.923075 26401 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:52.929011 25837 raft_consensus.cc:2468] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 3.
I20260709 12:23:52.924273 27907 raft_consensus.cc:2804] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:52.932894 27907 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:52.933414 27907 raft_consensus.cc:3060] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:52.935187 27895 raft_consensus.cc:3055] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:52.935585 27895 raft_consensus.cc:740] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
W20260709 12:23:52.936913 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:52.879865 27892 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:52.899286 27909 consensus_queue.cc:1048] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:23:52.846779 27936 consensus_queue.cc:260] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:52.888044 27986 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:52.948086 27937 raft_consensus.cc:2804] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:52.925388 27901 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:52.960330 27937 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:52.905588 27918 consensus_queue.cc:1048] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:23:52.979365 27937 raft_consensus.cc:3060] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:52.979423 26439 raft_consensus.cc:1240] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:52.884922 27880 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:52.930944 27934 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:52.992674 25684 raft_consensus.cc:2468] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 3.
W20260709 12:23:52.998720 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 269982us
I20260709 12:23:53.000206 27936 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:53.027037 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:53.027755 25757 raft_consensus.cc:2468] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 6.
I20260709 12:23:53.029250 26401 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:52.991578 27901 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:52.930135 27983 consensus_queue.cc:260] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:53.041816 27983 raft_consensus.cc:3060] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:53.042153 27980 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.040602 26434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 654) took 1180 ms. Trace:
I20260709 12:23:53.041039 27901 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:53.019584 27934 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:53.043015 26437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36518 (request call id 591) took 1149 ms. Trace:
W20260709 12:23:53.034626 26432 consensus_meta.cc:287] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.580s	user 0.008s	sys 0.002s
I20260709 12:23:53.076391 26432 raft_consensus.cc:1275] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:23:53.077721 27595 raft_consensus.cc:2749] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:53.067224 27895 consensus_queue.cc:260] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:53.079264 27895 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:53.070266 28017 raft_consensus.cc:2804] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:53.084174 28017 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:53.084681 28017 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:52.960974 27998 consensus_queue.cc:237] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:53.101531 27934 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:53.074018 26437 rpcz_store.cc:276] 0709 12:23:51.893958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:52.262796 (+368838us) service_pool.cc:224] Handling call
0709 12:23:52.263037 (+   241us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:52.263341 (+   304us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:52.263359 (+    18us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:52.263757 (+   398us) log.cc:844] Serialized 26 byte log entry
0709 12:23:52.475558 (+211801us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:52.475616 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:52.475700 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:53.011431 (+535731us) raft_consensus.cc:1685] finished
0709 12:23:53.011449 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:53.042942 (+ 31493us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19028,"raft.queue_time_us":4468,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":15122,"thread_start_us":201156,"threads_started":1,"wal-append.queue_time_us":334774}
I20260709 12:23:53.104199 28006 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:53.106701 27880 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:53.104521 27980 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:53.108180 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:53.116958 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:53.117601 25763 raft_consensus.cc:2468] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 3.
I20260709 12:23:53.118656 26401 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:53.103798 27934 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:53.073961 27957 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:53.119571 27980 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:23:53.132035 28008 log.cc:927] Time spent T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 12:23:53.133186 27821 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:23:53.136329 27932 consensus_meta.cc:287] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.673s	user 0.004s	sys 0.007s
I20260709 12:23:53.138541 27932 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:53.145776 25755 raft_consensus.cc:1240] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 3. Current term is 4. Ops: []
W20260709 12:23:53.146297 25756 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53474 (request call id 2316) took 1253 ms (client timeout 1628 ms). Trace:
W20260709 12:23:53.146868 25756 rpcz_store.cc:269] 0709 12:23:51.883899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:51.884046 (+   147us) service_pool.cc:224] Handling call
0709 12:23:53.134996 (+1250950us) spinlock_profiling.cc:243] Waited 956 ms on lock 0x7b5400040bd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:23:53.137651 (+  2655us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2198450560}
I20260709 12:23:53.129936 27930 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:53.133183 27980 raft_consensus.cc:2804] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:53.146694 27986 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:23:53.168593 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:53.158972 27980 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:53.095075 28017 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:53.162958 27966 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.184724 25582 catalog_manager.cc:5697] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 2 to 3, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 3 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:53.173856 27963 consensus_queue.cc:1048] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:23:53.173277 27980 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:53.183209 27863 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.221320 25581 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52974 (request call id 253) took 2330 ms. Trace:
I20260709 12:23:53.224520 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:53.221457 25582 catalog_manager.cc:5697] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 2 to 3, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 3 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } }
I20260709 12:23:53.204526 27821 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.190027 28004 consensus_queue.cc:1048] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:23:53.211611 27932 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:53.221843 25581 rpcz_store.cc:276] 0709 12:23:50.891118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:50.891465 (+   347us) service_pool.cc:224] Handling call
0709 12:23:51.083752 (+192287us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b5400078854. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99acb090 00007f5d99b69f3a 00007f5d9f91fe9c 00007f5d9fa1e04e 00007f5d9dedf2a4 00007f5d9dedf232 00007f5d9dedf161 00007f5d9dedf0dc 00007f5d9dede392 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:23:53.221251 (+2137499us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:51.464674 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:51.465185 (+   511us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:51.465227 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:23:51.465243 (+    16us) tablet.cc:662] Decoding operations
0709 12:23:51.465724 (+   481us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:51.465798 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:51.465823 (+    25us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:23:51.466104 (+   281us) tablet.cc:701] Row locks acquired
0709 12:23:51.466122 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:23:51.466261 (+   139us) write_op.cc:270] Start()
0709 12:23:51.473179 (+  6918us) write_op.cc:276] Timestamp: P: 1783599831466216 usec, L: 0
0709 12:23:51.477977 (+  4798us) op_driver.cc:348] REPLICATION: starting
0709 12:23:51.606748 (+128771us) log.cc:844] Serialized 1439 byte log entry
0709 12:23:52.317519 (+710771us) op_driver.cc:464] REPLICATION: finished
0709 12:23:52.740679 (+423160us) write_op.cc:301] APPLY: starting
0709 12:23:52.740781 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:52.740919 (+   138us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:52.741021 (+   102us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:52.846475 (+105454us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:52.876282 (+ 29807us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:23:52.881668 (+  5386us) write_op.cc:312] APPLY: finished
0709 12:23:52.913312 (+ 31644us) log.cc:844] Serialized 35 byte log entry
0709 12:23:52.913528 (+   216us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:52.913617 (+    89us) write_op.cc:454] Released schema lock
0709 12:23:52.913653 (+    36us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:52.914043 (+   390us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:52.914073 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":333,"reported_tablets":3,"spinlock_wait_cycles":246437632,"child_traces":[["op",{"apply.queue_time_us":421280,"apply.run_cpu_time_us":3140,"apply.run_wall_time_us":173329,"num_ops":3,"prepare.queue_time_us":199923,"prepare.run_cpu_time_us":14530,"prepare.run_wall_time_us":234510,"raft.queue_time_us":439461,"raft.run_cpu_time_us":27138,"raft.run_wall_time_us":228168,"replication_time_us":822984,"thread_start_us":723503,"threads_started":4,"wal-append.queue_time_us":56693}]]}
W20260709 12:23:53.239909 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 374365us
W20260709 12:23:53.236047 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 487961us
I20260709 12:23:53.186918 27966 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:53.247746 25801 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:53.255765 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:23:53.255909 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 371268us
W20260709 12:23:53.288726 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:53.245954 27940 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.733s	user 0.006s	sys 0.019s
I20260709 12:23:53.293884 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:53.294849 25763 raft_consensus.cc:2468] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 5.
W20260709 12:23:53.301651 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 54020.5us
I20260709 12:23:53.216033 27863 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:23:53.309089 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:53.251636 27842 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:53.322650 25726 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:53.316143 25649 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:23:53.321271 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 462257us
W20260709 12:23:53.376457 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 53921.7us
I20260709 12:23:53.238675 27821 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:23:53.379379 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 76642.9us
I20260709 12:23:53.381769 25801 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:53.380146 25726 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:23:53.315829 27916 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:53.291306 27940 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.007s	sys 0.020s
I20260709 12:23:53.393666 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:53.071460 26434 rpcz_store.cc:276] 0709 12:23:51.860711 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:51.863888 (+  3177us) service_pool.cc:224] Handling call
0709 12:23:52.381083 (+517195us) spinlock_profiling.cc:243] Waited 30.9 ms on lock 0x7b5800004598. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d96a3cb71 00007f5d96a3ca22 00007f5d9f9558d9 00007f5d9eaafee0 00007f5d9eb790ab 00007f5d9eb79131 00007f5d9eb3afc0 00007f5d9eb25929 00007f5d9eb253d2 00007f5d9809cbd4
0709 12:23:52.381254 (+   171us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:52.381604 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:52.381636 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:52.382130 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 12:23:52.740446 (+358316us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:52.754151 (+ 13705us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:52.754294 (+   143us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:53.040275 (+285981us) raft_consensus.cc:1685] finished
0709 12:23:53.040299 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:53.040531 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12761,"raft.queue_time_us":1097,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":13755,"spinlock_wait_cycles":71090048,"thread_start_us":317042,"threads_started":1,"wal-append.queue_time_us":591923}
I20260709 12:23:53.289804 27928 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:53.397735 25755 raft_consensus.cc:2468] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 4.
W20260709 12:23:53.403101 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 384810us
I20260709 12:23:53.380968 27901 raft_consensus.cc:2749] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:53.387843 25650 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:53.407403 25801 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:53.391162 27815 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.387571 27944 raft_consensus.cc:2804] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:53.524107 25763 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:53.301283 27892 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:53.387348 27963 consensus_queue.cc:1048] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
W20260709 12:23:53.413002 27773 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.007s	sys 0.026s
W20260709 12:23:53.541949 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 225765us
I20260709 12:23:53.415203 28021 raft_consensus.cc:2749] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:23:53.396466 27860 consensus_queue.cc:1048] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.119s
W20260709 12:23:53.412837 27903 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.016s	sys 0.018s
I20260709 12:23:53.315184 27945 raft_consensus.cc:2804] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:53.573421 26402 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
W20260709 12:23:53.702522 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 129179us
I20260709 12:23:53.703538 26402 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
W20260709 12:23:53.573643 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 185881us
W20260709 12:23:53.575356 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 168036us
I20260709 12:23:53.705596 25801 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
W20260709 12:23:53.596787 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:53.396852 27916 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:53.535048 28017 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:23:53.637652 27773 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.007s	sys 0.026s
W20260709 12:23:53.533720 26403 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.050s	sys 0.085s
W20260709 12:23:53.532357 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:53.570917 27967 raft_consensus.cc:2749] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:23:53.697058 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:53.705534 25650 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:53.707728 26402 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
W20260709 12:23:53.542801 27907 consensus_meta.cc:287] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.609s	user 0.015s	sys 0.005s
I20260709 12:23:53.631143 27872 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
W20260709 12:23:53.739562 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 101227us
I20260709 12:23:53.577056 27944 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:53.576316 27948 raft_consensus.cc:2749] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:53.778855 28025 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.782253 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:53.707103 27945 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:53.701300 27903 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.911s	user 0.016s	sys 0.018s
W20260709 12:23:53.785115 28022 log.cc:927] Time spent T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.251s	user 0.000s	sys 0.000s
I20260709 12:23:53.636735 27870 raft_consensus.cc:2804] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:53.786912 27916 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:53.788463 27860 consensus_queue.cc:1059] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:53.719700 28006 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.720561 28004 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:53.720410 27986 raft_consensus.cc:2749] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:53.720763 27994 raft_consensus.cc:2749] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:53.719144 27998 raft_consensus.cc:3060] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:23:53.812753 28024 log.cc:927] Time spent T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 12:23:53.635581 28028 consensus_queue.cc:1059] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.189s
W20260709 12:23:53.837297 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:53.697645 27901 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
W20260709 12:23:53.850171 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 450125us
I20260709 12:23:53.524910 27842 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:23:53.859946 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 154506us
I20260709 12:23:53.860339 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:53.602115 27815 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:23:53.864854 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 158148us
I20260709 12:23:53.867990 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:53.538493 27930 consensus_queue.cc:1059] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.316s
I20260709 12:23:54.437918 27821 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:54.532485 27821 raft_consensus.cc:3055] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:23:53.849179 26403 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.826s	user 0.050s	sys 0.100s
I20260709 12:23:54.532945 27821 raft_consensus.cc:740] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:54.533741 27982 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.533888 27983 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:54.534396 27870 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:54.534348 27982 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:54.534957 27870 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:54.534487 27983 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:23:54.194967 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:54.536942 25801 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.009s	sys 0.020s
W20260709 12:23:53.932767 25727 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.045s	sys 0.038s
W20260709 12:23:54.537519 25727 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.132s	user 0.057s	sys 0.045s
I20260709 12:23:53.883039 25763 raft_consensus.cc:2468] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 7.
I20260709 12:23:54.538250 25760 raft_consensus.cc:2468] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 3.
I20260709 12:23:53.926501 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:53.918752 25685 raft_consensus.cc:1240] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:54.540254 25650 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:23:54.139199 25758 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.738s	user 0.053s	sys 0.100s
W20260709 12:23:54.541695 25758 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.147s	user 0.060s	sys 0.115s
W20260709 12:23:54.543152 25800 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.000s	sys 0.021s
I20260709 12:23:54.543062 26402 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
W20260709 12:23:54.543726 25800 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.000s	sys 0.022s
I20260709 12:23:53.873831 28017 raft_consensus.cc:2749] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:53.871817 25755 raft_consensus.cc:1275] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 12:23:54.537393 25801 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.009s	sys 0.020s
I20260709 12:23:54.538345 25763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48606 (request call id 502) took 1145 ms. Trace:
W20260709 12:23:54.240881 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 103161us
W20260709 12:23:53.815858 28026 log.cc:927] Time spent T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
W20260709 12:23:54.166648 27980 consensus_meta.cc:287] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.956s	user 0.009s	sys 0.001s
W20260709 12:23:54.580147 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 855372us
I20260709 12:23:53.854543 28033 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.174553 27932 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:54.550241 27937 consensus_meta.cc:287] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 1.552s	user 0.029s	sys 0.015s
I20260709 12:23:54.581740 28017 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.582063 25763 rpcz_store.cc:276] 0709 12:23:53.393223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:53.393407 (+   184us) service_pool.cc:224] Handling call
0709 12:23:54.538292 (+1144885us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:23:54.167281 27936 consensus_meta.cc:287] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 1.143s	user 0.012s	sys 0.000s
W20260709 12:23:53.974617 27841 consensus_meta.cc:287] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 1.099s	user 0.013s	sys 0.000s
I20260709 12:23:54.221596 27863 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:54.587854 25681 raft_consensus.cc:1275] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:23:54.591423 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:54.074119 28035 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:54.611124 26436 raft_consensus.cc:1275] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:23:54.589849 28032 raft_consensus.cc:2804] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:54.542815 27944 raft_consensus.cc:3060] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:23:54.573488 26434 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.792s	user 0.017s	sys 0.014s
I20260709 12:23:54.080235 27966 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:53.600603 27928 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:54.084934 27836 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:54.390964 27963 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:54.422971 27918 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:53.895465 28021 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.642908 28021 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:54.607062 28033 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:54.644433 27966 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:54.644954 27966 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:54.645680 28021 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:54.646387 28021 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:54.646854 27966 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:54.646971 28021 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:54.588653 25831 raft_consensus.cc:1240] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:54.583782 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:53.947944 27793 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:54.543515 28028 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.352767 28040 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:54.571430 27945 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:23:54.612183 26437 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.823s	user 0.013s	sys 0.025s
I20260709 12:23:54.549818 25686 raft_consensus.cc:1275] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:23:54.612608 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:54.614231 27595 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.588493 27948 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:53.874172 27867 raft_consensus.cc:2804] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:53.874466 27872 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:53.874583 27907 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:54.602196 27986 raft_consensus.cc:2749] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:54.549971 28006 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:54.573645 28004 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:54.573058 27901 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:54.613013 27841 raft_consensus.cc:2749] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:23:54.626717 26434 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.844s	user 0.018s	sys 0.014s
I20260709 12:23:54.609364 28017 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:54.639359 27982 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:54.629150 27821 consensus_queue.cc:260] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:53.941392 27956 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:54.645740 28033 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:54.649159 27928 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:54.606619 27932 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:54.626384 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:54.604257 27937 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:23:54.655138 25725 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.760s	user 0.009s	sys 0.017s
I20260709 12:23:54.656826 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:23:54.746268 25725 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.851s	user 0.009s	sys 0.017s
I20260709 12:23:54.746450 25836 raft_consensus.cc:2468] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 6.
I20260709 12:23:54.626592 25834 raft_consensus.cc:1240] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:54.751425 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:54.574113 28025 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:54.726490 27986 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:54.638718 25728 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.011s	sys 0.014s
I20260709 12:23:54.601529 27980 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:23:54.666718 26437 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.878s	user 0.013s	sys 0.025s
I20260709 12:23:54.627029 28032 raft_consensus.cc:697] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 4 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:54.666785 25828 raft_consensus.cc:2468] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 5.
I20260709 12:23:54.678798 27948 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:54.629294 28042 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:54.780331 28042 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:54.781239 27932 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:54.781930 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:54.628145 27936 consensus_queue.cc:1059] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:23:54.647440 27963 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:54.782936 27936 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.783056 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:54.783483 27936 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:54.784402 27963 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:23:54.687618 25802 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.791s	user 0.014s	sys 0.015s
I20260709 12:23:54.678426 28040 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:23:54.785178 25802 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.889s	user 0.015s	sys 0.015s
I20260709 12:23:54.785452 27936 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:54.785962 27936 raft_consensus.cc:3055] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:54.781963 27932 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:54.663313 27898 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.007s	sys 0.012s
I20260709 12:23:54.638662 27836 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:54.786757 28040 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:54.787514 28040 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.788380 27836 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:54.625123 28035 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:54.731703 25757 raft_consensus.cc:3060] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:54.657797 27918 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:54.805096 27918 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:54.805965 27983 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:54.751030 27928 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.806834 27928 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:54.809182 27928 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:54.810189 25757 raft_consensus.cc:1275] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:54.810873 27957 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.811360 27957 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:54.812007 28017 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:54.813575 27841 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.736917 25801 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:54.814090 27841 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:23:54.815304 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 78508.1us
I20260709 12:23:54.693389 27867 raft_consensus.cc:697] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:54.671484 26432 raft_consensus.cc:2468] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 3.
I20260709 12:23:54.816980 27867 consensus_queue.cc:237] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:23:54.747475 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:54.748144 26401 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:54.822309 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:54.822556 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:23:54.661991 25754 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.005s	sys 0.021s
I20260709 12:23:54.752072 25836 raft_consensus.cc:2468] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 4.
W20260709 12:23:54.852761 25754 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.880s	user 0.005s	sys 0.021s
I20260709 12:23:54.670706 27793 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:54.651289 27870 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:23:54.754794 25728 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.871s	user 0.011s	sys 0.014s
I20260709 12:23:54.667245 27595 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:54.763149 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:54.764209 25650 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:54.764359 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:54.860051 25684 raft_consensus.cc:2468] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 1.
I20260709 12:23:54.750490 28047 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:54.765648 28029 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:54.766095 25686 raft_consensus.cc:1240] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:54.766182 27937 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:54.766681 27821 raft_consensus.cc:3060] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:54.767765 27883 raft_consensus.cc:3055] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:54.768790 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:54.770685 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:54.772015 28054 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.772593 27872 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:54.772847 28049 raft_consensus.cc:3055] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:23:54.773663 28043 log.cc:927] Time spent T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 12:23:54.774456 28041 log.cc:927] Time spent T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:23:54.778450 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:54.779389 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:54.782078 25762 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:54.670521 28028 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:54.784721 27907 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:54.786265 27936 raft_consensus.cc:740] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:23:54.724714 25830 raft_consensus.cc:1240] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:54.725718 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:54.783694 26436 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 9.
I20260709 12:23:54.789404 28053 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.797852 28035 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:23:54.786914 27898 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.008s	sys 0.012s
I20260709 12:23:54.797736 28032 consensus_queue.cc:237] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:54.790712 28033 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:54.783697 28021 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:54.799822 26435 raft_consensus.cc:1240] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:54.790844 28040 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:54.782894 28042 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:54.801352 27980 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:54.801913 28004 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:54.803148 28006 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:54.815995 28025 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:54.732702 27982 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:54.824558 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:54.816246 27963 raft_consensus.cc:2749] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:54.823230 25801 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:54.823156 25755 raft_consensus.cc:2468] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 3.
W20260709 12:23:54.852056 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 103987us
I20260709 12:23:54.854251 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:54.854619 25800 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:23:54.765210 27860 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
W20260709 12:23:54.862371 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:54.863830 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 99685.5us
I20260709 12:23:54.786903 27932 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:54.814388 27957 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:54.871220 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:54.816279 27841 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:54.738839 27956 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:54.846779 27815 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:54.877805 28047 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:54.886205 27983 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:54.849259 27918 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:54.856802 28017 raft_consensus.cc:2804] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:54.857247 27842 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:54.921924 25754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 2338) took 1049 ms. Trace:
I20260709 12:23:54.820798 27986 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:54.875840 28057 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:54.880192 28029 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:23:55.364977 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 510387us
I20260709 12:23:55.311744 28056 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:55.365772 27983 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:55.204517 25762 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 6.
I20260709 12:23:55.366537 28056 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:55.300107 27901 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:55.336526 27793 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:55.368950 27956 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:55.367996 25754 rpcz_store.cc:276] 0709 12:23:53.872445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:53.874360 (+  1915us) service_pool.cc:224] Handling call
0709 12:23:53.874602 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:53.874825 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:23:54.855969 (+981144us) log.cc:844] Serialized 14 byte log entry
0709 12:23:54.918503 (+ 62534us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:54.920690 (+  2187us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:54.920800 (+   110us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:54.921719 (+   919us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:54.921862 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5883,"prepare.queue_time_us":864794,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":3554,"raft.queue_time_us":6016,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":5711,"thread_start_us":935942,"threads_started":2,"wal-append.queue_time_us":204859}
I20260709 12:23:55.370102 28057 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:55.370833 25831 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 4.
W20260709 12:23:55.037915 28044 log.cc:927] Time spent T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.183s	user 0.000s	sys 0.000s
I20260709 12:23:54.914826 27883 raft_consensus.cc:740] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:55.372123 27982 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:55.372527 26437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 583) took 1591 ms. Trace:
I20260709 12:23:55.372954 26437 rpcz_store.cc:276] 0709 12:23:53.780649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:53.787162 (+  6513us) service_pool.cc:224] Handling call
0709 12:23:53.787530 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:53.787957 (+   427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:53.787996 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:53.788528 (+   532us) log.cc:844] Serialized 26 byte log entry
0709 12:23:54.755262 (+966734us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:54.755299 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:54.755369 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:55.372331 (+616962us) raft_consensus.cc:1685] finished
0709 12:23:55.372352 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:55.372474 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1388,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"thread_start_us":966163,"threads_started":1,"wal-append.queue_time_us":942671}
I20260709 12:23:55.374449 27982 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:55.374640 27986 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:55.008505 25679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40230 (request call id 1253) took 1059 ms. Trace:
I20260709 12:23:55.317850 25726 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:54.922063 28049 raft_consensus.cc:740] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:55.006596 28058 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:55.377409 28053 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:55.373405 27883 consensus_queue.cc:260] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:55.377771 28058 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:55.378244 27983 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:55.062145 26430 raft_consensus.cc:2393] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 7: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:23:55.378662 25835 raft_consensus.cc:1275] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:23:55.365191 25836 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:55.379248 27936 consensus_queue.cc:260] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:55.377871 28017 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:55.380276 28017 raft_consensus.cc:3060] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:23:55.380405 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 557271us
I20260709 12:23:55.380618 27936 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:54.921157 28054 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:55.380664 28006 raft_consensus.cc:2804] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:55.170722 27930 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:55.383085 28035 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:55.394352 26434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 581) took 1655 ms. Trace:
I20260709 12:23:55.405378 26434 rpcz_store.cc:276] 0709 12:23:53.779858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:53.780017 (+   159us) service_pool.cc:224] Handling call
0709 12:23:53.780554 (+   537us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:53.780966 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:53.780998 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:53.781473 (+   475us) log.cc:844] Serialized 26 byte log entry
0709 12:23:54.729633 (+948160us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:54.736951 (+  7318us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:54.745630 (+  8679us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:55.394125 (+648495us) raft_consensus.cc:1685] finished
0709 12:23:55.394152 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:55.394294 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":453,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"thread_start_us":931951,"threads_started":1,"wal-append.queue_time_us":855665}
I20260709 12:23:55.394029 27860 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:55.402878 28059 raft_consensus.cc:2804] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:55.374893 27932 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:55.383903 27930 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:55.395668 25650 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:54.924120 26433 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:55.395499 28033 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:23:55.411410 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 93695.9us
I20260709 12:23:55.396044 25836 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 6.
I20260709 12:23:55.066026 25682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 1874) took 1136 ms. Trace:
W20260709 12:23:54.950239 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:55.415628 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:55.377045 28040 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:54.877242 28060 raft_consensus.cc:2804] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:55.403831 26401 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:55.047675 25758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 1912) took 1788 ms. Trace:
I20260709 12:23:55.408263 28059 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:55.378696 27883 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:23:55.423421 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 352147us
W20260709 12:23:55.424320 25762 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53474 (request call id 2335) took 1556 ms (client timeout 1732 ms). Trace:
I20260709 12:23:55.376845 28049 consensus_queue.cc:260] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:55.428208 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:54.978857 27937 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:55.440240 25758 rpcz_store.cc:276] 0709 12:23:53.258869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:53.259332 (+   463us) service_pool.cc:224] Handling call
0709 12:23:53.312913 (+ 53581us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:53.313111 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:53.313136 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:53.327408 (+ 14272us) log.cc:844] Serialized 26 byte log entry
0709 12:23:54.542347 (+1214939us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:23:54.737906 (+195559us) log.cc:844] Serialized 14 byte log entry
0709 12:23:54.740164 (+  2258us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:54.740317 (+   153us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:55.047378 (+307061us) raft_consensus.cc:1685] finished
0709 12:23:55.047407 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:55.047597 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1438,"prepare.queue_time_us":307594,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":48971,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":74,"thread_start_us":1287427,"threads_started":2,"wal-append.queue_time_us":1249805}
I20260709 12:23:55.412921 25682 rpcz_store.cc:276] 0709 12:23:53.929268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:53.929402 (+   134us) service_pool.cc:224] Handling call
0709 12:23:54.549403 (+620001us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:54.592775 (+ 43372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:54.592810 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:54.604252 (+ 11442us) log.cc:844] Serialized 26 byte log entry
0709 12:23:54.870622 (+266370us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:54.870682 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:54.874830 (+  4148us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:55.065799 (+190969us) raft_consensus.cc:1685] finished
0709 12:23:55.065819 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:55.065961 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35190,"raft.queue_time_us":46782,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":8332,"spinlock_wait_cycles":24960,"thread_start_us":237510,"threads_started":1,"wal-append.queue_time_us":409690}
I20260709 12:23:55.375665 25679 rpcz_store.cc:276] 0709 12:23:53.926379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:53.939808 (+ 13429us) service_pool.cc:224] Handling call
0709 12:23:54.768598 (+828790us) spinlock_profiling.cc:243] Waited 29 ms on lock 0x7b5800003698. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d96a3cb71 00007f5d96a3ca22 00007f5d9f9558d9 00007f5d9eaafee0 00007f5d9eb790ab 00007f5d9eb79131 00007f5d9eb270a0 00007f5d9eb26984 00007f5d980a16d4 00007f5d980a1662
0709 12:23:54.985270 (+216672us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":66589952}
I20260709 12:23:55.400708 27872 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:55.006132 27945 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:55.377772 27918 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:55.466646 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:23:55.604871 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 222762us
I20260709 12:23:55.820389 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:55.546789 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:55.819475 25683 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 5.
I20260709 12:23:55.456970 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:23:55.448719 25762 rpcz_store.cc:269] 0709 12:23:53.867585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:53.867728 (+   143us) service_pool.cc:224] Handling call
0709 12:23:55.424140 (+1556412us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b54001e7654. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:23:55.424259 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":556386176}
W20260709 12:23:55.444304 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:55.420698 27901 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:55.446313 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:55.465924 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:23:55.675084 26439 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.003s	sys 0.005s
I20260709 12:23:55.564427 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:23:55.753487 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 312160us
W20260709 12:23:55.736150 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 370018us
W20260709 12:23:55.758556 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:55.821682 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:23:55.509799 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:55.830523 25682 raft_consensus.cc:2393] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 7: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:23:55.828735 25686 raft_consensus.cc:2393] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 6: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:23:55.827981 26436 raft_consensus.cc:2393] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 4: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
W20260709 12:23:55.828758 26439 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.007s	sys 0.007s
I20260709 12:23:55.825066 26401 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:23:55.853888 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:55.853993 25800 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:55.422273 27948 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:55.423328 27957 raft_consensus.cc:2749] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:23:55.818815 28075 log.cc:927] Time spent T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:23:55.399158 28056 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:55.372750 28057 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:55.421154 28035 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:55.425630 27983 consensus_queue.cc:1048] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.486s
I20260709 12:23:56.093420 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:55.987043 25761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 2339) took 2114 ms. Trace:
W20260709 12:23:55.978447 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:56.055128 26439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 679) took 1446 ms. Trace:
I20260709 12:23:55.988132 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:55.907820 25829 raft_consensus.cc:1240] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 12:23:55.988027 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 134115us
I20260709 12:23:55.435704 28060 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:55.908967 27595 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:55.791992 27892 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:55.818030 28068 log.cc:927] Time spent T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 12:23:55.472157 27833 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.001s	sys 0.014s
I20260709 12:23:56.097424 25761 rpcz_store.cc:276] 0709 12:23:53.872779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:53.872908 (+   129us) service_pool.cc:224] Handling call
0709 12:23:54.539649 (+666741us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:54.743814 (+204165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:54.743862 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:54.744445 (+   583us) log.cc:844] Serialized 26 byte log entry
0709 12:23:55.165892 (+421447us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:55.165950 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:55.166048 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:55.986775 (+820727us) raft_consensus.cc:1685] finished
0709 12:23:55.986799 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:55.986948 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35525,"raft.queue_time_us":231204,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"thread_start_us":551834,"threads_started":2,"wal-append.queue_time_us":1215837}
I20260709 12:23:56.067962 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:55.898038 25835 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:23:56.117460 25835 raft_consensus.cc:606] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 3 LEADER]: Received request to transfer leadership to TS 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:55.825913 28021 consensus_queue.cc:1048] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.287s
I20260709 12:23:55.618620 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:55.771811 28042 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
W20260709 12:23:56.058871 27936 consensus_meta.cc:287] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.678s	user 0.006s	sys 0.009s
I20260709 12:23:55.380437 28053 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:56.098784 26439 rpcz_store.cc:276] 0709 12:23:54.608963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:54.613077 (+  4114us) service_pool.cc:224] Handling call
0709 12:23:54.746858 (+133781us) spinlock_profiling.cc:243] Waited 19.6 ms on lock 0x7b5800004598. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d96a3cb71 00007f5d96a3ca22 00007f5d9f9558d9 00007f5d9eaafee0 00007f5d9eb790ab 00007f5d9eb79131 00007f5d9eb3afc0 00007f5d9eb25929 00007f5d9eb253d2 00007f5d9809cbd4
0709 12:23:54.747038 (+   180us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:54.789606 (+ 42568us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:23:55.164326 (+374720us) log.cc:844] Serialized 14 byte log entry
0709 12:23:55.832121 (+667795us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:55.832194 (+    73us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:55.832253 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:56.054800 (+222547us) spinlock_profiling.cc:243] Waited 42.4 ms on lock 0x7b54004c8bd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:23:56.054873 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:56.055050 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":807723,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":21543,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":22130,"spinlock_wait_cycles":142602752,"thread_start_us":982498,"threads_started":2,"wal-append.queue_time_us":942440}
I20260709 12:23:55.455653 27932 raft_consensus.cc:2804] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:55.990226 28065 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:55.488267 27982 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:55.431088 28058 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:23:55.906219 27998 consensus_meta.cc:287] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 1.363s	user 0.003s	sys 0.009s
I20260709 12:23:55.852093 28062 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:55.986806 26431 consensus_meta.cc:287] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 1.008s	user 0.010s	sys 0.000s
W20260709 12:23:55.902462 27821 consensus_meta.cc:287] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.984s	user 0.007s	sys 0.000s
W20260709 12:23:55.879384 27944 consensus_meta.cc:287] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 1.250s	user 0.008s	sys 0.004s
I20260709 12:23:55.760454 27963 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:55.901695 28076 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:55.445142 27986 raft_consensus.cc:2804] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:23:55.591367 28006 raft_consensus.cc:697] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 3 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:55.510377 27870 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:55.636754 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:55.432132 27867 consensus_queue.cc:1048] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.678s
I20260709 12:23:56.005105 27860 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:55.897643 27815 raft_consensus.cc:2804] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:55.448239 28029 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:55.972209 28078 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:55.481773 28040 consensus_queue.cc:1059] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.632s
I20260709 12:23:55.445678 28059 raft_consensus.cc:3060] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:56.175364 28040 raft_consensus.cc:3055] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:55.903478 28047 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:56.175750 28040 raft_consensus.cc:740] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:56.130622 28089 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.176443 28089 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:56.176585 28040 consensus_queue.cc:260] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:56.177771 28040 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:56.178781 28089 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:56.062072 28033 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:55.456401 27793 consensus_queue.cc:1059] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.662s
I20260709 12:23:56.180063 27793 raft_consensus.cc:3055] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:56.180454 27793 raft_consensus.cc:740] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:56.181310 27793 consensus_queue.cc:260] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:23:56.116137 27833 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.351s	user 0.006s	sys 0.027s
I20260709 12:23:56.075611 27930 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:55.506609 28064 consensus_queue.cc:1048] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.666s
I20260709 12:23:55.547127 27903 consensus_queue.cc:1048] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.611s
I20260709 12:23:56.110611 28056 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:55.610544 28054 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:56.111380 28060 raft_consensus.cc:3060] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:55.897380 28028 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:55.852450 28046 consensus_queue.cc:1048] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.282s
I20260709 12:23:56.187433 28059 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:56.189036 28049 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:56.191897 28059 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:23:56.229638 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 148951us
I20260709 12:23:56.232421 25678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51578 (request call id 461) took 1471 ms. Trace:
W20260709 12:23:56.233294 25650 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.008s	sys 0.008s
W20260709 12:23:56.234026 25650 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.008s	sys 0.008s
W20260709 12:23:56.234643 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 735881us
I20260709 12:23:56.233031 25678 rpcz_store.cc:276] 0709 12:23:54.761284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:54.761477 (+   193us) service_pool.cc:224] Handling call
0709 12:23:54.802256 (+ 40779us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:54.802596 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:54.802624 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:54.803029 (+   405us) log.cc:844] Serialized 26 byte log entry
0709 12:23:54.933988 (+130959us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:23:54.934113 (+   125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:54.934314 (+   201us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:56.231672 (+1297358us) raft_consensus.cc:1685] finished
0709 12:23:56.231758 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:56.232112 (+   354us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7187,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":103,"thread_start_us":130364,"threads_started":1,"wal-append.queue_time_us":800894}
W20260709 12:23:56.236830 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 406703us
I20260709 12:23:56.246348 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:56.249305 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:56.250519 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:56.250782 25686 raft_consensus.cc:2393] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 3: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:23:56.251407 25754 raft_consensus.cc:3060] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:56.252625 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:56.255467 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:56.256950 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:56.258042 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:56.264827 25761 raft_consensus.cc:1275] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 4. (term mismatch)
I20260709 12:23:56.261484 25755 raft_consensus.cc:1275] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:23:56.265403 25761 pending_rounds.cc:85] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 3
I20260709 12:23:56.265264 25763 raft_consensus.cc:2468] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 4.
I20260709 12:23:56.262530 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:56.265827 25761 pending_rounds.cc:107] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 3.4
I20260709 12:23:56.263746 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:56.263805 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:56.266332 25761 raft_consensus.cc:2889] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:56.266782 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:56.267861 25755 raft_consensus.cc:2410] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 12:23:56.268031 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:56.269011 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:56.270025 25755 raft_consensus.cc:2468] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 2.
I20260709 12:23:56.271288 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:56.272136 25755 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 5.
I20260709 12:23:56.263773 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:56.267742 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:56.273852 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:56.274600 25760 raft_consensus.cc:2393] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 7: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:23:56.275125 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:56.125758 25801 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:23:56.275544 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:56.275952 25755 raft_consensus.cc:2376] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 6. Re-sending same reply.
I20260709 12:23:56.276396 25760 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:56.277127 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:23:56.277493 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 151743us
I20260709 12:23:56.268898 25761 raft_consensus.cc:2468] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 4.
I20260709 12:23:56.283265 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:56.284487 25761 raft_consensus.cc:2468] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 3.
I20260709 12:23:56.291992 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:56.292543 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:56.293032 25836 raft_consensus.cc:2468] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 3.
I20260709 12:23:56.293419 25833 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:56.294451 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:56.295284 25836 raft_consensus.cc:2468] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 3.
I20260709 12:23:56.289004 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:56.296641 25830 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:56.302417 25833 raft_consensus.cc:2468] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 7.
I20260709 12:23:56.290905 25831 raft_consensus.cc:1240] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 5. Current term is 6. Ops: []
I20260709 12:23:56.303427 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:56.304085 25833 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:56.304528 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:56.305392 25831 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 3.
I20260709 12:23:56.306291 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:56.307545 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:55.900429 25834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44218 (request call id 1345) took 1053 ms. Trace:
I20260709 12:23:56.310298 25834 rpcz_store.cc:276] 0709 12:23:54.846664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:55.899251 (+1052587us) service_pool.cc:224] Handling call
0709 12:23:55.899684 (+   433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:55.899956 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:55.900006 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:55.900077 (+    71us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:23:55.900130 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:55.900215 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:55.900356 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:23:56.312990 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:56.313810 25831 raft_consensus.cc:2468] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 3.
I20260709 12:23:56.292074 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:56.285341 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:56.316246 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:56.317183 25758 raft_consensus.cc:2410] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:23:56.164402 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:56.317916 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:56.318681 25832 raft_consensus.cc:2376] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 7. Re-sending same reply.
I20260709 12:23:56.320053 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:56.320859 25832 raft_consensus.cc:2468] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 3.
I20260709 12:23:56.322340 25832 raft_consensus.cc:1275] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:56.323967 25761 raft_consensus.cc:2468] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 3.
I20260709 12:23:56.308434 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:56.318085 25760 raft_consensus.cc:2468] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 7.
I20260709 12:23:56.326855 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:56.327735 25760 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 4.
I20260709 12:23:56.308275 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:56.328852 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:56.331571 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:56.367240 28028 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:56.367851 25760 raft_consensus.cc:2393] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 4: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:23:56.368396 28028 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:56.369503 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:56.372342 28028 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:56.373204 25829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41782 (request call id 476) took 1828 ms. Trace:
I20260709 12:23:56.373569 25829 rpcz_store.cc:276] 0709 12:23:54.545082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:54.545210 (+   128us) service_pool.cc:224] Handling call
0709 12:23:54.545567 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:56.099852 (+1554285us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:56.372649 (+272797us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54002c15d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:23:56.373023 (+   374us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3132110592}
I20260709 12:23:56.374675 25833 raft_consensus.cc:2468] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 4.
I20260709 12:23:56.325050 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:56.328933 25678 raft_consensus.cc:2468] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 4.
I20260709 12:23:56.137749 28042 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:56.383433 28035 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:56.384222 28042 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:23:56.145385 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 320383us
I20260709 12:23:56.385087 28004 raft_consensus.cc:1064] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a: attempting to promote NON_VOTER a866ff967d964388a6f0dff7fd43df89 to VOTER
I20260709 12:23:56.388337 28035 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:56.389192 28035 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:56.390377 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:56.392627 28035 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349)
W20260709 12:23:56.396286 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:56.398622 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:56.396814 25755 raft_consensus.cc:2468] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 2.
I20260709 12:23:56.403322 26402 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:23:56.336494 25726 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.245.132:35611 timed out after 1.635s (SENT) [suppressed 12 similar messages]
I20260709 12:23:56.405226 28033 raft_consensus.cc:2804] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:56.405685 28033 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:56.406059 28033 raft_consensus.cc:3060] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:56.406179 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:56.406725 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:56.137262 26432 raft_consensus.cc:2468] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 3.
W20260709 12:23:56.164788 26433 consensus_meta.cc:287] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.657s	user 0.011s	sys 0.000s
I20260709 12:23:55.896723 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:56.420269 26433 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 4.
W20260709 12:23:56.421078 26433 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36518 (request call id 599) took 1829 ms (client timeout 1635 ms). Trace:
I20260709 12:23:56.421447 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:23:56.421518 26433 rpcz_store.cc:269] 0709 12:23:54.597372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:54.600391 (+  3019us) service_pool.cc:224] Handling call
0709 12:23:54.770532 (+170141us) spinlock_profiling.cc:243] Waited 8.23 ms on lock 0x7b5800004598. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d96a3cb71 00007f5d96a3ceee 000000000036eb39 00007f5d9eab01e0 00007f5d9eb790c4 00007f5d9eb79131 00007f5d9eb270a0 00007f5d9eb26984 00007f5d980a16d4 00007f5d980a1662
0709 12:23:56.420956 (+1650424us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18931968}
I20260709 12:23:56.423036 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:56.423223 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:56.140509 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:56.424741 26439 raft_consensus.cc:2468] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 3.
I20260709 12:23:56.426003 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:56.426744 26439 raft_consensus.cc:2468] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 4.
I20260709 12:23:56.427433 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:56.165210 26431 raft_consensus.cc:2468] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 3.
W20260709 12:23:56.428494 26431 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 677) took 1821 ms (client timeout 1513 ms). Trace:
I20260709 12:23:56.428532 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:23:56.428988 26431 rpcz_store.cc:269] 0709 12:23:54.607232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:54.607352 (+   120us) service_pool.cc:224] Handling call
0709 12:23:54.779248 (+171896us) spinlock_profiling.cc:243] Waited 3.56 ms on lock 0x7b5800004598. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d96a3cb71 00007f5d96a3ca22 00007f5d9f9558d9 00007f5d9eaafee0 00007f5d9eb790ab 00007f5d9eb79131 00007f5d9eb270a0 00007f5d9eb26984 00007f5d980a16d4 00007f5d980a1662
0709 12:23:56.428277 (+1649029us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8192896}
I20260709 12:23:56.430413 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:56.430544 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:56.173745 27815 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:56.182592 27793 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:56.344835 27841 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:56.344894 27833 consensus_queue.cc:1059] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
W20260709 12:23:56.350895 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:56.118953 27892 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:55.874567 27901 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:56.439137 27833 raft_consensus.cc:3055] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:56.439555 27833 raft_consensus.cc:740] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:55.852782 27937 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:56.440670 27892 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:56.442840 27937 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:56.356662 27860 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:56.444098 25756 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:56.443738 27860 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:56.446520 27860 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:56.358217 27870 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:55.874840 27872 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:56.437687 27916 raft_consensus.cc:2804] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:56.447582 28004 consensus_queue.cc:237] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:56.450026 27872 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:56.359079 27903 consensus_queue.cc:1048] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:56.450397 27916 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:56.450852 27916 raft_consensus.cc:3060] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:56.161365 27918 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:56.437125 25755 raft_consensus.cc:2468] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 3.
I20260709 12:23:56.447439 27870 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:56.453553 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:56.455168 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:56.455224 27870 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:56.120843 27945 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:56.361253 27948 raft_consensus.cc:2804] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:23:56.459070 27948 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:56.459666 27948 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:23:56.459830 26433 raft_consensus.cc:2468] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 3.
I20260709 12:23:56.361656 27930 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:56.141083 27932 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:56.168238 27944 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:56.169075 27963 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:56.466471 25759 raft_consensus.cc:1240] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:56.159197 27982 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:56.169852 27986 raft_consensus.cc:697] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 7 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:23:56.469810 27944 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:56.470575 27932 raft_consensus.cc:3060] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:56.470468 27986 consensus_queue.cc:237] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:56.471747 27982 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:56.467096 27930 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:56.477646 26432 raft_consensus.cc:1275] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:23:56.478152 27930 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:56.164780 27998 raft_consensus.cc:2749] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:56.174446 28006 consensus_queue.cc:237] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:23:56.187263 28017 consensus_meta.cc:287] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.806s	user 0.008s	sys 0.000s
I20260709 12:23:56.485181 26438 raft_consensus.cc:1275] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:23:56.485100 28017 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:56.486581 26434 raft_consensus.cc:2393] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 4: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:23:56.487496 28017 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:56.318027 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:56.184924 28056 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:56.488325 25758 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 8.
I20260709 12:23:56.166342 28062 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:56.162998 28058 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:56.158227 28065 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:56.497761 28058 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:56.499289 28065 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:23:56.164597 28073 log.cc:927] Time spent T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:23:56.501554 25759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 2340) took 2628 ms. Trace:
I20260709 12:23:56.170195 28076 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:23:56.183404 28077 log.cc:927] Time spent T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:23:56.182018 28078 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:56.527161 25801 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:23:56.572188 28056 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:56.574226 28045 raft_consensus.cc:2804] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:56.574445 28058 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:56.574785 28045 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:56.331884 25830 raft_consensus.cc:2468] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 3.
I20260709 12:23:56.184867 28085 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:56.379081 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:56.604740 28085 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:56.392813 25761 raft_consensus.cc:2468] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 4.
I20260709 12:23:56.394488 28054 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:56.606078 28054 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:56.606487 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:56.607281 28085 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:56.407817 25832 raft_consensus.cc:1275] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:23:56.608449 28054 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:56.609189 25755 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 7.
W20260709 12:23:56.337462 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:56.335541 25649 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:23:56.610307 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 274861us
I20260709 12:23:56.611038 25649 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:23:56.409250 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 72791.6us
I20260709 12:23:56.410006 28092 consensus_queue.cc:1048] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:23:56.416098 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:56.415933 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:56.418274 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:56.436538 26439 raft_consensus.cc:2393] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 4: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:23:56.437660 27841 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:56.436903 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:56.615813 28017 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:56.456410 25763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48606 (request call id 508) took 1634 ms. Trace:
I20260709 12:23:56.617363 25763 rpcz_store.cc:276] 0709 12:23:54.821944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:54.822059 (+   115us) service_pool.cc:224] Handling call
0709 12:23:56.456216 (+1634157us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b54001dbfd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:23:56.456344 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3315983744}
I20260709 12:23:56.616710 28017 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:56.607278 25761 raft_consensus.cc:2468] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 2.
I20260709 12:23:56.618932 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:56.461625 25835 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 5.
I20260709 12:23:56.587848 28076 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:56.423939 26430 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 3.
W20260709 12:23:56.366310 27883 consensus_meta.cc:287] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.886s	user 0.007s	sys 0.007s
I20260709 12:23:56.489387 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:56.464084 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:56.624868 25758 raft_consensus.cc:3060] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:56.625123 26431 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 5.
I20260709 12:23:56.502264 25757 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 3.
I20260709 12:23:56.502058 25759 rpcz_store.cc:276] 0709 12:23:53.873075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:53.875455 (+  2380us) service_pool.cc:224] Handling call
0709 12:23:53.895731 (+ 20276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:56.466869 (+2571138us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:56.501198 (+ 34329us) spinlock_profiling.cc:243] Waited 2.57 s on lock 0x7b54003a6bd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:23:56.501459 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5911222656}
I20260709 12:23:56.627544 25726 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:56.628686 28065 raft_consensus.cc:2764] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:23:56.574870 25681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 1881) took 1749 ms. Trace:
I20260709 12:23:56.495321 26401 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:56.629594 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:56.570820 25837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 2341) took 1661 ms. Trace:
W20260709 12:23:56.557457 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 158578us
I20260709 12:23:56.588577 25836 raft_consensus.cc:1240] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 2. Current term is 3. Ops: []
W20260709 12:23:56.630015 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 210607us
I20260709 12:23:56.591722 25756 raft_consensus.cc:2468] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 4.
I20260709 12:23:56.592906 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:56.585203 28045 raft_consensus.cc:3060] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:56.599653 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:23:56.604054 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:56.604126 28062 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:56.605193 25834 raft_consensus.cc:2468] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 4.
I20260709 12:23:56.393575 28064 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:56.609125 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:56.432487 27815 raft_consensus.cc:3060] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:56.643836 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:56.646317 25833 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:56.647188 25830 raft_consensus.cc:2468] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 3.
I20260709 12:23:56.647390 25582 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41232 (request call id 387) took 5292 ms. Trace:
I20260709 12:23:56.648202 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:56.648880 25830 raft_consensus.cc:2468] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 2.
I20260709 12:23:56.648931 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:56.635740 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:56.648232 27595 raft_consensus.cc:2804] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:56.615882 27870 raft_consensus.cc:2804] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:23:56.440670 27833 consensus_queue.cc:260] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:56.456539 27901 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:56.360163 25754 raft_consensus.cc:2468] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 4.
I20260709 12:23:56.615430 28078 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:56.622852 27928 raft_consensus.cc:2804] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:56.657680 27928 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:56.658102 27928 raft_consensus.cc:3060] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:56.658924 27833 raft_consensus.cc:3060] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:56.623289 25760 raft_consensus.cc:1240] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:56.623425 25831 raft_consensus.cc:2468] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 2.
I20260709 12:23:56.660475 25832 raft_consensus.cc:2393] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 5: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:23:56.661105 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:56.621227 28056 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:56.374693 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:56.632827 25762 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 5.
I20260709 12:23:56.629683 25681 rpcz_store.cc:276] 0709 12:23:54.825441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:54.858539 (+ 33098us) service_pool.cc:224] Handling call
0709 12:23:54.858872 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:54.863097 (+  4225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:54.863130 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:54.875746 (+ 12616us) log.cc:844] Serialized 26 byte log entry
0709 12:23:55.383145 (+507399us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:23:55.770996 (+387851us) log.cc:844] Serialized 14 byte log entry
0709 12:23:56.237505 (+466509us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:56.237696 (+   191us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:56.574501 (+336805us) raft_consensus.cc:1685] finished
0709 12:23:56.574520 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:56.574678 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":588545,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":116,"raft.queue_time_us":136515,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":41800,"thread_start_us":1294440,"threads_started":3,"wal-append.queue_time_us":903542}
W20260709 12:23:56.633837 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:56.641449 27963 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:56.642537 28064 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:56.614511 25649 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:56.650039 27595 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:56.701323 27595 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:56.638763 26401 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:23:56.614070 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 96194.4us
I20260709 12:23:56.635706 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:56.656759 28049 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:56.657073 25754 raft_consensus.cc:1275] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:23:56.659629 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:56.703044 25836 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 5.
I20260709 12:23:56.671629 25831 raft_consensus.cc:2393] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 2: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:23:56.671757 25829 raft_consensus.cc:2468] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 3.
I20260709 12:23:56.630791 25837 rpcz_store.cc:276] 0709 12:23:54.881259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:54.881395 (+   136us) service_pool.cc:224] Handling call
0709 12:23:54.881705 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:54.882048 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:54.882076 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:54.882535 (+   459us) log.cc:844] Serialized 26 byte log entry
0709 12:23:54.926916 (+ 44381us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:23:54.926960 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:54.927030 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:56.508469 (+1581439us) raft_consensus.cc:1685] finished
0709 12:23:56.518256 (+  9787us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:56.540063 (+ 21807us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1267,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":133,"thread_start_us":43934,"threads_started":1,"wal-append.queue_time_us":1098785}
I20260709 12:23:56.719900 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:56.738097 25761 raft_consensus.cc:1240] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:56.661530 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:56.738868 25832 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 6.
W20260709 12:23:56.742189 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 114777us
W20260709 12:23:56.750123 28060 consensus_meta.cc:287] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.558s	user 0.012s	sys 0.002s
I20260709 12:23:56.700110 28056 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:56.750689 28060 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:56.752025 25685 raft_consensus.cc:1240] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 12:23:56.752058 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 52876.9us
I20260709 12:23:56.756644 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:56.757352 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:23:56.760927 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 122217us
I20260709 12:23:56.763146 25833 raft_consensus.cc:2468] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 7.
W20260709 12:23:56.767800 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 52998.1us
I20260709 12:23:56.768079 27986 consensus_queue.cc:1059] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:56.768263 28062 raft_consensus.cc:2804] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:56.768908 28062 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:56.769497 28062 raft_consensus.cc:3060] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:56.730984 27870 raft_consensus.cc:697] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 6 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:56.837535 25800 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:56.866920 25801 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:56.822191 25759 raft_consensus.cc:1240] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:56.880820 28056 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:56.870621 25829 raft_consensus.cc:1275] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:23:56.880277 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 108673us
I20260709 12:23:56.885901 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:56.890976 25835 raft_consensus.cc:2393] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 6: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
W20260709 12:23:56.823866 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 211109us
I20260709 12:23:56.892655 26401 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:56.885901 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:56.893393 25761 raft_consensus.cc:3060] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:23:56.831807 28108 log.cc:927] Time spent T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.123s	user 0.001s	sys 0.001s
I20260709 12:23:56.897161 25726 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89
W20260709 12:23:56.899206 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 90419.6us
I20260709 12:23:56.836319 28021 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:56.900032 25759 raft_consensus.cc:1275] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:23:56.899888 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 101635us
I20260709 12:23:56.769933 27986 raft_consensus.cc:3055] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:56.832150 27833 raft_consensus.cc:2804] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:23:56.768097 28092 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:56.910686 25758 raft_consensus.cc:2468] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 6.
I20260709 12:23:56.740418 28049 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:56.905705 25801 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:23:56.772447 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:56.771929 28054 consensus_queue.cc:1059] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.132s
I20260709 12:23:56.889122 27841 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:56.897482 28060 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:23:56.912506 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 139849us
I20260709 12:23:56.896907 28017 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:56.921582 27595 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:56.925037 26401 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:56.927055 26438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36518 (request call id 596) took 2343 ms. Trace:
I20260709 12:23:56.919706 25649 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:56.904603 27986 raft_consensus.cc:740] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:23:56.943224 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:56.943972 25800 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:23:56.945513 25800 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
W20260709 12:23:56.942217 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 52568.6us
I20260709 12:23:56.936470 26438 rpcz_store.cc:276] 0709 12:23:54.583660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:54.583778 (+   118us) service_pool.cc:224] Handling call
0709 12:23:54.584020 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:56.485715 (+1901695us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:56.918012 (+432297us) spinlock_profiling.cc:243] Waited 1.9 s on lock 0x7b54004db054. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:23:56.926976 (+  8964us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4365812608}
I20260709 12:23:56.946805 25800 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:23:56.956657 27595 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:56.923377 27833 raft_consensus.cc:697] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 7 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
W20260709 12:23:56.964325 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 58542.7us
I20260709 12:23:56.647802 25582 rpcz_store.cc:276] 0709 12:23:51.354751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:51.355029 (+   278us) service_pool.cc:224] Handling call
0709 12:23:56.647172 (+5292143us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:54.353896 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:54.354622 (+   726us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:54.354675 (+    53us) write_op.cc:435] Acquired schema lock
0709 12:23:54.354709 (+    34us) tablet.cc:662] Decoding operations
0709 12:23:54.355293 (+   584us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:54.355369 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:54.355410 (+    41us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:23:54.355757 (+   347us) tablet.cc:701] Row locks acquired
0709 12:23:54.355778 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:23:54.355973 (+   195us) write_op.cc:270] Start()
0709 12:23:54.356114 (+   141us) write_op.cc:276] Timestamp: P: 1783599834355898 usec, L: 0
0709 12:23:54.356138 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:23:54.370400 (+ 14262us) log.cc:844] Serialized 994 byte log entry
0709 12:23:55.336390 (+965990us) op_driver.cc:464] REPLICATION: finished
0709 12:23:56.074035 (+737645us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b5400078854. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b5e32a 00007f5d99ae3f14 00007f5d99ae3ec3 00007f5d99ae3e38 00007f5d99ae3df3 00007f5d99ae30dc 00007f5d99b0ce16 00007f5d99af4cbb 00007f5d99adf39d 00007f5d99ae2d75
0709 12:23:56.443800 (+369765us) spinlock_profiling.cc:243] Waited 2.8 ms on lock 0x7b54000786a8. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9ff1d9e1 00007f5d9ff1c64c 00007f5d9d598845 00007f5d9d59cd61 00007f5d9d59cd19 00007f5d9d59cca9 00007f5d9d59cc71 00007f5d9d59be9d 0000000000388634 0000000000388479 00007f5d96a74475
0709 12:23:56.443934 (+   134us) write_op.cc:301] APPLY: starting
0709 12:23:56.444100 (+   166us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:56.444265 (+   165us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:56.444294 (+    29us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:56.444824 (+   530us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:56.445195 (+   371us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:23:56.445271 (+    76us) write_op.cc:312] APPLY: finished
0709 12:23:56.445652 (+   381us) log.cc:844] Serialized 29 byte log entry
0709 12:23:56.567311 (+121659us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:56.567498 (+   187us) write_op.cc:454] Released schema lock
0709 12:23:56.567551 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:56.569328 (+  1777us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:56.569366 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":287176,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":753161,"apply.run_cpu_time_us":31977,"apply.run_wall_time_us":451434,"num_ops":2,"prepare.queue_time_us":1062173,"prepare.run_cpu_time_us":31802,"prepare.run_wall_time_us":404100,"raft.queue_time_us":169900,"raft.run_cpu_time_us":13873,"raft.run_wall_time_us":1066527,"replication_time_us":943700,"spinlock_wait_cycles":613239296,"thread_start_us":1418809,"threads_started":5,"wal-append.queue_time_us":569449,"wal-append.run_cpu_time_us":4246,"wal-append.run_wall_time_us":1107083}]]}
W20260709 12:23:56.968398 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 49453.7us
W20260709 12:23:56.972764 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 60536.5us
I20260709 12:23:56.949342 28085 raft_consensus.cc:2804] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:56.978371 28053 raft_consensus.cc:2804] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:56.983592 27998 raft_consensus.cc:2804] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:56.984014 28053 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:56.984128 27998 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:56.984611 28053 raft_consensus.cc:3060] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:56.985224 28057 raft_consensus.cc:2804] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:56.985641 28057 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:56.985987 28057 raft_consensus.cc:3060] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:23:56.987303 27932 consensus_meta.cc:287] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.516s	user 0.003s	sys 0.008s
I20260709 12:23:56.987735 27932 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:56.990382 27932 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:56.955106 27963 raft_consensus.cc:2749] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:56.992132 28083 raft_consensus.cc:2804] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:56.992658 28083 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:56.993106 28083 raft_consensus.cc:3060] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:56.996268 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:56.954802 27815 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:57.000133 28096 raft_consensus.cc:2804] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:57.000253 25828 raft_consensus.cc:1240] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:56.984651 27998 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:56.976189 26434 raft_consensus.cc:2393] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 6: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:23:57.004421 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:23:56.979447 27948 consensus_meta.cc:287] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.519s	user 0.015s	sys 0.016s
I20260709 12:23:56.968106 28004 raft_consensus.cc:2804] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:56.926275 28092 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:56.924736 28021 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:56.968302 28064 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:56.995324 27928 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:57.002563 25800 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:23:57.000631 28096 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:57.006819 27863 raft_consensus.cc:2804] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:57.012913 28004 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:56.979714 28085 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:57.025797 28092 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:57.007063 27986 consensus_queue.cc:260] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:57.018988 28096 raft_consensus.cc:3060] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:57.027738 27986 raft_consensus.cc:3060] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:23:57.030453 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 604854us
W20260709 12:23:57.031584 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 55996.8us
I20260709 12:23:57.006887 28054 raft_consensus.cc:2804] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:23:57.033006 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 57295.1us
I20260709 12:23:56.954867 27870 consensus_queue.cc:237] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:57.036559 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:57.037190 25649 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:57.030876 28004 raft_consensus.cc:3060] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:57.048010 25800 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
W20260709 12:23:57.048190 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:57.050429 26401 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:57.021879 27863 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:57.033574 28085 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:57.034477 28054 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:57.047693 28033 consensus_meta.cc:287] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.641s	user 0.006s	sys 0.007s
I20260709 12:23:57.067718 25757 raft_consensus.cc:1240] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 12:23:57.014488 27948 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:57.069900 25650 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:57.048910 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:57.060308 27863 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:23:57.070741 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 47167.3us
W20260709 12:23:57.075799 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 54521.1us
I20260709 12:23:57.056537 27956 raft_consensus.cc:2804] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:57.068285 28054 raft_consensus.cc:3060] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:57.080828 25757 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:53452
I20260709 12:23:57.087486 25757 raft_consensus.cc:606] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Received request to transfer leadership
I20260709 12:23:57.087942 25757 raft_consensus.cc:614] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:23:57.079555 27956 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:57.067075 27841 consensus_queue.cc:1048] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:23:57.121951 27595 consensus_queue.cc:1059] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:23:57.124610 25650 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:57.072063 28033 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:57.128885 27793 raft_consensus.cc:2749] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:57.129964 28021 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:57.091874 28092 raft_consensus.cc:2804] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:57.084012 26432 raft_consensus.cc:2468] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 4.
I20260709 12:23:57.150249 27793 consensus_queue.cc:1059] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:57.151412 27841 raft_consensus.cc:2749] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:57.196111 27841 raft_consensus.cc:3055] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:57.196519 27841 raft_consensus.cc:740] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:57.197466 27841 consensus_queue.cc:260] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:57.151996 28099 raft_consensus.cc:2804] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:23:57.198312 27916 consensus_meta.cc:287] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.747s	user 0.013s	sys 0.000s
I20260709 12:23:57.198665 28099 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:57.199163 28099 raft_consensus.cc:3060] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:57.198833 27916 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:57.159467 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:57.152498 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:57.200474 25755 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:23:57.153671 28115 log.cc:927] Time spent T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:23:57.157212 28021 raft_consensus.cc:2749] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:57.157168 28092 raft_consensus.cc:697] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 4 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:23:57.157783 27595 raft_consensus.cc:3055] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:23:57.208560 27595 raft_consensus.cc:740] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:23:57.158710 25726 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:57.103711 27956 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:57.185997 27928 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:57.187110 28062 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:57.190155 28053 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:57.192780 27948 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:57.200414 25759 raft_consensus.cc:2468] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 4.
I20260709 12:23:57.186007 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:23:57.216259 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 172486us
I20260709 12:23:57.212270 27595 consensus_queue.cc:260] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:23:57.214500 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 138974us
I20260709 12:23:57.219015 26438 raft_consensus.cc:2393] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 4: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
W20260709 12:23:57.211575 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 242442us
I20260709 12:23:57.211009 25761 raft_consensus.cc:2468] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 4.
W20260709 12:23:57.223532 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 64911.7us
I20260709 12:23:57.224591 26401 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:57.093577 27833 consensus_queue.cc:237] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:57.213726 27815 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:57.250614 27595 raft_consensus.cc:3060] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:57.246937 26401 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:57.254410 26401 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:23:57.261128 28119 log.cc:927] Time spent T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 12:23:57.269234 27982 raft_consensus.cc:2804] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:23:57.276516 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:57.258267 28035 raft_consensus.cc:2804] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:57.281237 25800 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:23:57.269805 27872 raft_consensus.cc:2804] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:57.284626 26401 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:57.292982 27872 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:57.299077 27872 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:57.278297 28017 raft_consensus.cc:2804] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:23:57.304772 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 183636us
W20260709 12:23:57.302386 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 60971.8us
I20260709 12:23:57.283649 28035 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:57.316218 25760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 2351) took 1058 ms. Trace:
I20260709 12:23:57.316629 25760 rpcz_store.cc:276] 0709 12:23:56.251885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:56.660018 (+408133us) service_pool.cc:224] Handling call
0709 12:23:57.020996 (+360978us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:57.044173 (+ 23177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:57.044205 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:23:57.044257 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:23:57.044289 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:57.044362 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:57.309617 (+265255us) spinlock_profiling.cc:243] Waited 361 ms on lock 0x7b54001e6250. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b608ad 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:23:57.309734 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":829372672}
W20260709 12:23:57.309127 28118 log.cc:927] Time spent T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
W20260709 12:23:57.300993 28045 consensus_meta.cc:287] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.600s	user 0.009s	sys 0.002s
W20260709 12:23:57.325366 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 200864us
I20260709 12:23:57.299191 27916 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:57.326749 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:57.335131 25757 raft_consensus.cc:2393] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 4: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:23:57.301137 27815 raft_consensus.cc:2804] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:23:57.328646 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:23:57.329322 26432 raft_consensus.cc:1275] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 4 LEARNER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:23:57.324551 28064 raft_consensus.cc:2804] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:57.343441 25755 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 6.
I20260709 12:23:57.331056 28057 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:57.332464 28122 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:57.308990 28092 consensus_queue.cc:237] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:57.312620 28017 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:57.318945 28035 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:57.339320 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:57.340026 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:57.341624 26402 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:57.341874 28054 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:57.342847 28062 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:57.336877 27815 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:57.354097 25754 raft_consensus.cc:1240] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:23:57.329805 25726 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:23:57.347455 25801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:57.348057 26401 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:57.351049 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:57.345428 28125 consensus_queue.cc:1048] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:57.358116 28122 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:57.359475 28057 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:57.358920 28083 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:57.360957 27595 raft_consensus.cc:2804] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:57.363387 27595 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:57.348748 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:57.363906 27595 raft_consensus.cc:3060] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:57.370013 28124 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:57.370169 27870 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.372432 27773 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.372169 28124 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:57.372932 27773 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:57.375000 27773 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:57.375044 28124 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:57.375893 27907 raft_consensus.cc:2804] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:23:57.376513 27907 raft_consensus.cc:697] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 6 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:23:57.377394 27907 consensus_queue.cc:237] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:57.367251 28056 raft_consensus.cc:2804] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:57.380143 28056 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:57.380589 28056 raft_consensus.cc:3060] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:57.381953 28099 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:57.386366 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:57.387568 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:57.372200 27870 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:57.389273 26402 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:57.391037 27870 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:57.352262 28064 raft_consensus.cc:697] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 4 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:23:57.396672 28064 consensus_queue.cc:237] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:57.352095 28017 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:57.395253 27998 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:57.339387 28085 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:57.397091 28099 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:57.361979 25801 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:57.400429 25650 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:57.356384 27815 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:57.334136 28045 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:57.379338 28096 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:57.352502 27982 raft_consensus.cc:697] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 4 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:23:57.409984 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:57.412453 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:57.416085 28122 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:57.416265 25758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48606 (request call id 523) took 1026 ms. Trace:
I20260709 12:23:57.406522 27916 raft_consensus.cc:2804] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:57.416848 27916 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:57.401641 28053 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:57.417336 27916 raft_consensus.cc:3060] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:57.416716 25758 rpcz_store.cc:276] 0709 12:23:56.389415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:56.911368 (+521953us) service_pool.cc:224] Handling call
0709 12:23:56.919737 (+  8369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:56.974428 (+ 54691us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:23:56.974587 (+   159us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:23:57.006434 (+ 31847us) log.cc:844] Serialized 26 byte log entry
0709 12:23:57.269896 (+263462us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:23:57.269937 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:57.270349 (+   412us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:23:57.416038 (+145689us) raft_consensus.cc:1685] finished
0709 12:23:57.416055 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:23:57.416188 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7202,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":20291,"spinlock_wait_cycles":102144,"thread_start_us":234652,"threads_started":1,"wal-append.queue_time_us":327579}
I20260709 12:23:57.416085 26437 raft_consensus.cc:2393] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 5: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:23:57.427258 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:23:57.431001 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 61388.9us
W20260709 12:23:57.421137 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 59330.2us
I20260709 12:23:57.436003 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
W20260709 12:23:57.437211 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 47008.8us
I20260709 12:23:57.413211 28124 raft_consensus.cc:2749] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:57.442960 27595 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:57.446724 28004 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:57.448032 28126 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:57.448607 28126 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:57.449018 28004 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:57.449642 27872 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:57.451054 28126 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:57.451905 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:57.452034 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:57.444434 28125 raft_consensus.cc:2804] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:57.452811 28125 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:57.453153 28125 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:57.437762 28099 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.456362 28099 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:57.459345 28099 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:57.413677 27870 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:57.469442 25726 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:57.470657 28057 raft_consensus.cc:2749] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:57.471113 25726 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:57.472204 28057 raft_consensus.cc:2749] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:57.410719 28062 consensus_queue.cc:1048] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:23:57.475319 27595 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:57.475800 25801 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:57.479703 27998 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:57.480903 27872 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:57.481323 28045 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:57.484047 27870 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:57.484246 28131 consensus_queue.cc:1059] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:57.443950 28053 consensus_queue.cc:1059] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 12:23:57.485334 28131 raft_consensus.cc:3055] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:23:57.485695 28131 raft_consensus.cc:740] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:23:57.485734 28053 raft_consensus.cc:3055] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:57.486150 28053 raft_consensus.cc:740] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:57.486502 27870 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:57.486588 28033 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:57.486641 28131 consensus_queue.cc:260] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:57.487856 25800 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:23:57.486984 28053 consensus_queue.cc:260] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:23:57.488622 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 43653.4us
I20260709 12:23:57.488937 28053 raft_consensus.cc:3060] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:23:57.489084 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:57.489689 25800 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:57.490782 27948 raft_consensus.cc:2804] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:57.491169 27948 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:57.491541 27948 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:57.488188 28131 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:57.493258 28120 raft_consensus.cc:2804] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:23:57.493878 28120 raft_consensus.cc:697] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 6 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:57.487779 27916 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:57.476236 27773 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.509861 27773 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:57.504882 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:57.499137 25685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40230 (request call id 1256) took 2649 ms. Trace:
I20260709 12:23:57.512080 25685 rpcz_store.cc:276] 0709 12:23:54.849891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:54.878314 (+ 28423us) service_pool.cc:224] Handling call
0709 12:23:54.878672 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:56.756306 (+1877634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:57.498813 (+742507us) spinlock_profiling.cc:243] Waited 1.87 s on lock 0x7b54002648d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:23:57.499036 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4307240192}
W20260709 12:23:57.512633 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:57.504576 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:57.514055 25681 raft_consensus.cc:2393] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 5: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:23:57.512601 28060 consensus_queue.cc:1048] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 12:23:57.541121 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:57.541996 25681 raft_consensus.cc:2393] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 3: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
W20260709 12:23:57.543071 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 67359.5us
I20260709 12:23:57.507177 28096 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:57.544471 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:57.499493 28085 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:57.517117 28083 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:57.531896 27773 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:23:57.538615 27986 consensus_meta.cc:287] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.507s	user 0.007s	sys 0.003s
I20260709 12:23:57.534145 28053 raft_consensus.cc:2749] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:57.546376 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:23:57.545380 26402 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:57.550956 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:57.552229 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:57.544343 28049 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:57.569728 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:57.552529 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:57.552441 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:57.553314 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:57.553896 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:57.571393 25686 raft_consensus.cc:2410] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:23:57.571334 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:57.571769 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:57.572544 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:57.573158 26438 raft_consensus.cc:2376] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 4. Re-sending same reply.
I20260709 12:23:57.574003 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:57.574316 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:57.574702 25837 raft_consensus.cc:2468] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 2.
I20260709 12:23:57.575326 25828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41782 (request call id 484) took 1304 ms. Trace:
I20260709 12:23:57.575549 25678 raft_consensus.cc:2468] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 3.
I20260709 12:23:57.575757 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:57.560814 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:57.576805 25830 raft_consensus.cc:2393] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 4: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:23:57.573169 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:57.556885 28035 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:23:57.562551 28108 log.cc:927] Time spent T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.530s	user 0.008s	sys 0.012s
I20260709 12:23:57.562196 28056 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:57.564848 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:57.566927 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:57.593753 25833 raft_consensus.cc:2393] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 4: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:23:57.503436 27863 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:57.568511 25726 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:57.499393 27982 consensus_queue.cc:237] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:57.552390 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:57.498729 28120 consensus_queue.cc:237] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:57.560308 28054 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:57.582856 26436 raft_consensus.cc:1275] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:57.575749 25828 rpcz_store.cc:276] 0709 12:23:56.271375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:56.291388 (+ 20013us) service_pool.cc:224] Handling call
0709 12:23:56.291880 (+   492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:57.002182 (+710302us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:57.575084 (+572902us) spinlock_profiling.cc:243] Waited 708 ms on lock 0x7b5400246654. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:23:57.575263 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1627964672}
I20260709 12:23:57.586374 27916 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:57.587182 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:23:57.605101 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 58161.3us
I20260709 12:23:57.605684 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:57.588708 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:57.539636 27956 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:57.590217 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:57.609241 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:57.610183 26433 raft_consensus.cc:2393] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 4: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:23:57.611148 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:57.611826 27863 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:57.611999 27872 consensus_queue.cc:1048] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:57.612748 25829 raft_consensus.cc:2468] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 4.
I20260709 12:23:57.614907 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:57.617841 28035 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:57.591289 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:57.602622 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:57.619302 25828 raft_consensus.cc:1275] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:23:57.619942 27841 raft_consensus.cc:3060] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:57.602228 28125 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:57.628139 28049 raft_consensus.cc:2804] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:57.628708 28049 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:57.629148 28049 raft_consensus.cc:3060] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:57.633958 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:57.634811 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:23:57.635351 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:57.636193 25762 raft_consensus.cc:2393] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 7: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:23:57.637226 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:57.637744 25678 raft_consensus.cc:1240] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 2. Current term is 4. Ops: []
I20260709 12:23:57.637895 25682 raft_consensus.cc:2468] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 3.
I20260709 12:23:57.639387 25678 raft_consensus.cc:1240] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:57.639489 25758 raft_consensus.cc:1275] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:23:57.556528 28017 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:57.642277 26430 raft_consensus.cc:2368] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 7. Current term is 8.
I20260709 12:23:57.643519 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:57.619973 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:57.644567 25833 raft_consensus.cc:3060] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:57.645064 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:57.645251 28017 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:57.646441 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:57.649390 25754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48606 (request call id 522) took 1260 ms. Trace:
I20260709 12:23:57.649844 25754 rpcz_store.cc:276] 0709 12:23:56.389119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:56.912030 (+522911us) service_pool.cc:224] Handling call
0709 12:23:56.925943 (+ 13913us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:23:57.354607 (+428664us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:57.649105 (+294498us) spinlock_profiling.cc:243] Waited 428 ms on lock 0x7b54003971d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:23:57.649322 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":983894400}
I20260709 12:23:57.650610 27956 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:23:57.651592 28123 log.cc:927] Time spent T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.311s	user 0.000s	sys 0.003s
I20260709 12:23:57.652143 25756 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 5.
I20260709 12:23:57.652974 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:57.624694 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:57.655381 26435 raft_consensus.cc:2393] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 5: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:23:57.609942 25726 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
W20260709 12:23:57.656517 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 46651us
I20260709 12:23:57.657272 25758 raft_consensus.cc:1240] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:57.657137 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:57.659472 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:57.623175 27948 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:57.660595 25832 raft_consensus.cc:2393] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 6: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:23:57.660866 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:57.663365 27948 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:57.664805 26436 raft_consensus.cc:1240] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:57.665455 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:57.666174 25761 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:23:57.666281 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:57.667114 26436 raft_consensus.cc:2393] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 4: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:23:57.667652 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:57.669121 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:57.669299 28056 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:57.669763 25756 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:23:57.671260 25632 auto_rebalancer.cc:893] Removing replace marker failed: Replica 6e673265293d4e9a937dc45150aeb1b8 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
W20260709 12:23:57.671779 25632 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 12:23:57.672472 25632 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 12:23:57.672600 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:57.673764 28127 consensus_queue.cc:1059] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:23:57.674690 28127 consensus_queue.cc:1059] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:23:57.675839 28127 raft_consensus.cc:3055] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:57.675997 27916 raft_consensus.cc:3055] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:57.676518 28127 raft_consensus.cc:740] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:23:57.676613 27916 raft_consensus.cc:740] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:23:57.672361 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:57.677353 25754 raft_consensus.cc:3060] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:57.677698 27916 consensus_queue.cc:260] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:57.678238 27815 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:57.679226 27916 raft_consensus.cc:3060] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:57.680495 25581 catalog_manager.cc:5697] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 3 to 4, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 4 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:57.682322 25581 catalog_manager.cc:5697] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 2 to 4, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 4 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:57.683873 25581 catalog_manager.cc:5697] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 3 to 4, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 4 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:57.685362 25581 catalog_manager.cc:5697] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 2 to 3, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 3 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:57.686393 25756 raft_consensus.cc:2468] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 5.
I20260709 12:23:57.673480 25833 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 4.
W20260709 12:23:57.692185 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 86027.1us
I20260709 12:23:57.687434 28125 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:57.686939 25581 catalog_manager.cc:5697] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 2 to 4, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 4 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:57.689076 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:57.677531 28127 consensus_queue.cc:260] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:57.690496 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:57.692919 26401 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:57.694145 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:57.705440 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:57.705883 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:57.706141 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:57.706300 25756 raft_consensus.cc:2468] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 3.
I20260709 12:23:57.706703 25763 raft_consensus.cc:2393] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 4: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:23:57.707026 28127 raft_consensus.cc:3060] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:57.708247 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:57.706073 28017 raft_consensus.cc:2804] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:57.708983 28017 raft_consensus.cc:697] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 5 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:23:57.710114 28017 consensus_queue.cc:237] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:57.703794 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:57.705614 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:57.712977 25755 raft_consensus.cc:2368] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 4. Current term is 5.
I20260709 12:23:57.713171 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:57.713835 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:57.714761 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:57.702926 25754 raft_consensus.cc:2468] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 5.
I20260709 12:23:57.720063 26401 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:57.721539 25682 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 4.
I20260709 12:23:57.722954 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:57.728996 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:57.736615 25684 raft_consensus.cc:1240] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:57.680442 27815 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:57.738291 25581 catalog_manager.cc:5697] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 3 to 5, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 5 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:57.743813 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:57.746933 25761 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 8.
I20260709 12:23:57.722895 28056 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.733031 28131 raft_consensus.cc:2804] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:57.761961 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:57.733078 27956 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.752271 26401 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:57.766433 25801 leader_election.cc:400] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Vote denied by peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611) with higher term. Message: Invalid argument: T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 7. Current term is 8.
I20260709 12:23:57.766963 25801 leader_election.cc:403] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:23:57.764801 25581 catalog_manager.cc:5697] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 7 to 9, leader changed from a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 9 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:57.769049 25686 raft_consensus.cc:2468] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 4.
I20260709 12:23:57.780834 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:57.781615 25684 raft_consensus.cc:3060] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:57.768256 25679 raft_consensus.cc:2410] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:23:57.736162 27863 consensus_queue.cc:1048] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:23:57.782650 25581 catalog_manager.cc:5697] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 2 to 3, leader changed from a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 3 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:23:57.784714 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 45198.7us
I20260709 12:23:57.749305 28053 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.797086 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:57.781421 28085 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:57.804572 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:57.780728 28064 raft_consensus.cc:2804] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:23:57.781133 28131 raft_consensus.cc:697] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 5 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:23:57.808846 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:57.811363 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:23:57.813642 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 153410us
I20260709 12:23:57.814733 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:57.811357 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:57.814769 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:57.817770 25831 raft_consensus.cc:2468] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 3.
I20260709 12:23:57.817919 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:57.815222 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:57.809031 25581 catalog_manager.cc:5697] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 2 to 3, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 3 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:57.762807 28056 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:57.815017 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:57.819391 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:57.821360 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:57.825461 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:57.825675 26430 raft_consensus.cc:3060] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:57.814364 25836 raft_consensus.cc:2468] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 3.
I20260709 12:23:57.821360 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:57.822734 25828 raft_consensus.cc:2393] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 4: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:23:57.770094 27956 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:57.827414 25829 raft_consensus.cc:2393] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 9: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:23:57.802150 27872 raft_consensus.cc:2804] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:57.831641 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:57.852768 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:57.853093 25800 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:57.853518 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:57.854307 25761 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:57.855628 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:57.850382 25581 catalog_manager.cc:5697] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 2 to 3, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 3 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:57.855734 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:57.852315 25801 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:57.859206 25835 raft_consensus.cc:2393] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 4: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:23:57.812089 27948 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:57.862534 27945 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:23:57.863457 28021 consensus_queue.cc:1048] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:57.812508 28049 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:57.814728 28053 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:57.812347 28083 consensus_queue.cc:1048] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 12:23:57.864763 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:57.813297 28085 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:57.872467 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:57.873441 27872 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:57.873765 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:57.875815 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:57.876540 28131 consensus_queue.cc:237] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:57.871690 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:57.954933 25830 raft_consensus.cc:2393] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 5: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:23:57.884352 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:57.889163 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:57.885574 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:23:57.915944 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 56270.1us
I20260709 12:23:57.919680 26430 raft_consensus.cc:2468] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 4.
I20260709 12:23:57.956868 25829 raft_consensus.cc:2393] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 5: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:23:57.877674 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:57.921339 25758 raft_consensus.cc:1275] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:23:57.881999 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:57.949836 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:57.949939 25833 raft_consensus.cc:2468] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 5.
I20260709 12:23:57.828577 28064 raft_consensus.cc:697] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 8 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:23:57.877591 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:57.966478 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:57.967518 26402 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:57.999523 26438 raft_consensus.cc:1240] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:57.965627 25683 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 5.
I20260709 12:23:57.974176 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:57.982378 25831 raft_consensus.cc:2393] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 5: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:23:57.995235 28056 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:57.995568 27963 raft_consensus.cc:2749] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:23:57.966617 25581 catalog_manager.cc:5697] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 6 to 8, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 8 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:58.003860 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 178596us
I20260709 12:23:58.015888 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:57.880316 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:58.028335 25678 raft_consensus.cc:2368] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 3. Current term is 4.
I20260709 12:23:58.030078 25685 raft_consensus.cc:1240] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 2. Current term is 3. Ops: []
W20260709 12:23:58.046277 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:58.046671 25761 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 9.
I20260709 12:23:58.052102 28045 raft_consensus.cc:993] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a: : Instructing follower 6e673265293d4e9a937dc45150aeb1b8 to start an election
I20260709 12:23:58.052703 28045 raft_consensus.cc:1081] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 3 LEADER]: Signalling peer 6e673265293d4e9a937dc45150aeb1b8 to start an election
I20260709 12:23:58.055146 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:58.056612 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:58.057889 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:58.058944 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:58.060809 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:58.061862 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:58.063148 25683 raft_consensus.cc:1275] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:23:58.065253 28033 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:23:58.065794 28033 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:57.964335 27872 raft_consensus.cc:3060] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:58.070385 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:57.995818 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:58.075771 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:58.068564 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:58.079412 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:58.081979 25681 raft_consensus.cc:2468] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 4.
I20260709 12:23:57.995702 28120 raft_consensus.cc:2749] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:23:58.096046 25835 raft_consensus.cc:2376] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 3. Re-sending same reply.
W20260709 12:23:58.112092 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 81308.4us
I20260709 12:23:58.009181 28085 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:58.111469 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
W20260709 12:23:58.116904 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:58.121304 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 153862us
I20260709 12:23:58.136552 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:58.136641 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:58.138221 25760 raft_consensus.cc:2393] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 6: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:23:58.096055 26432 raft_consensus.cc:2468] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 2.
I20260709 12:23:58.073861 27948 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:58.160264 26402 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:23:58.155997 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:58.157440 25726 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:58.120832 27773 consensus_queue.cc:1048] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 12:23:58.132562 27998 raft_consensus.cc:2804] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:58.168448 26402 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:58.174126 26402 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:58.177069 25726 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:58.152483 28033 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:58.181783 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:58.187901 25829 raft_consensus.cc:3060] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:23:58.186051 27982 raft_consensus.cc:2749] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:58.171891 27916 raft_consensus.cc:2749] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:58.192777 27956 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:58.193274 28064 consensus_queue.cc:237] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:58.181926 28017 consensus_queue.cc:1048] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
W20260709 12:23:58.197959 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 344909us
I20260709 12:23:58.198762 25800 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:23:58.200429 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:58.201592 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:58.202435 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:58.206284 25684 raft_consensus.cc:2468] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 4.
I20260709 12:23:58.186259 27907 raft_consensus.cc:2804] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:58.208433 27907 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:58.208834 27907 raft_consensus.cc:3060] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:58.209007 25833 raft_consensus.cc:1240] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:58.209110 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:58.209807 26439 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 6.
I20260709 12:23:58.210672 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:58.211357 25833 raft_consensus.cc:1240] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:23:58.176265 28056 raft_consensus.cc:2764] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:23:58.211921 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:58.222121 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:58.177440 27998 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:58.224512 26439 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 4.
I20260709 12:23:58.224709 26430 raft_consensus.cc:2393] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 2: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:23:58.235679 26402 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:58.183450 28125 consensus_queue.cc:1048] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 12:23:58.248363 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:58.254741 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:58.255576 25831 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:58.248725 25800 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
W20260709 12:23:58.252513 28140 log.cc:927] Time spent T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:23:58.233438 28057 raft_consensus.cc:2749] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:58.261559 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:58.239449 27998 raft_consensus.cc:3060] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:58.217249 28033 consensus_queue.cc:1048] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:23:58.260546 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:58.281239 25833 raft_consensus.cc:2468] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 3.
I20260709 12:23:58.241735 28035 raft_consensus.cc:2749] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:23:58.261857 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 101443us
I20260709 12:23:58.285673 26439 raft_consensus.cc:2468] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 3.
W20260709 12:23:58.277765 26402 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:58.242667 27948 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:58.233708 28085 raft_consensus.cc:2804] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:58.280258 25800 leader_election.cc:400] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 election: Vote denied by peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267) with higher term. Message: Invalid argument: T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 4. Current term is 5.
I20260709 12:23:58.245615 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:23:58.287153 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 110153us
I20260709 12:23:58.289117 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:58.290468 25800 leader_election.cc:403] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:23:58.292771 25800 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:23:58.295830 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:23:58.285293 28143 log.cc:927] Time spent T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.290s	user 0.004s	sys 0.000s
I20260709 12:23:58.280831 28049 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:58.284642 27963 raft_consensus.cc:2804] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:58.300828 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:58.305189 25756 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 6.
I20260709 12:23:58.305234 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:58.283767 28053 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:58.304641 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:58.306892 26430 raft_consensus.cc:1240] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:58.288754 28054 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:58.349357 26430 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 3 LEARNER]: Advancing to term 4
I20260709 12:23:58.349552 28054 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:58.350181 27907 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:58.290266 28085 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:58.352167 28085 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:58.353434 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:58.355123 26437 raft_consensus.cc:1240] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:58.320235 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:58.315109 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:58.356220 25833 raft_consensus.cc:2393] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 6: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:23:58.319818 25755 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:53460
I20260709 12:23:58.357008 25755 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:58.357340 25755 raft_consensus.cc:3060] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:58.358659 26430 raft_consensus.cc:1275] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 4 LEARNER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 4. (term mismatch)
I20260709 12:23:58.359030 26430 pending_rounds.cc:85] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89: Aborting all ops after (but not including) 3
I20260709 12:23:58.359249 26430 pending_rounds.cc:107] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89: Aborting uncommitted NO_OP operation due to leader change: 3.4
I20260709 12:23:58.359448 26430 raft_consensus.cc:2889] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 4 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:58.351804 28054 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:58.298674 26433 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 1.
I20260709 12:23:58.309520 27948 raft_consensus.cc:2804] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:23:58.327632 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:58.330192 27945 raft_consensus.cc:2749] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611) with higher term. Message: Invalid argument: T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 7. Current term is 8.
W20260709 12:23:58.332854 28148 log.cc:927] Time spent T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 12:23:58.334426 27872 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:58.336306 28120 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:58.400767 28120 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:58.339063 25837 raft_consensus.cc:1240] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
W20260709 12:23:58.408581 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 210226us
I20260709 12:23:58.343712 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:58.422147 25754 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 4.
I20260709 12:23:58.422224 28149 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:58.318548 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:58.421169 27948 raft_consensus.cc:697] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 9 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:58.347265 25829 raft_consensus.cc:2468] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 5.
I20260709 12:23:58.309067 27963 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:58.423221 25761 raft_consensus.cc:2468] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 5.
I20260709 12:23:58.422829 28149 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:58.424772 26437 raft_consensus.cc:1240] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:58.379890 25831 raft_consensus.cc:2468] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 5.
I20260709 12:23:58.382261 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:58.425819 25833 raft_consensus.cc:2468] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 3.
I20260709 12:23:58.426259 28149 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:58.426630 28150 raft_consensus.cc:2749] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267) with higher term. Message: Invalid argument: T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 4. Current term is 5.
I20260709 12:23:58.396788 25801 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:58.428880 28006 raft_consensus.cc:2749] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:58.429164 25801 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:58.422276 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:58.403577 28120 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:58.424094 27963 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:58.430656 28120 raft_consensus.cc:2804] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:58.431205 28120 raft_consensus.cc:697] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:58.338212 27998 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:58.432256 28120 consensus_queue.cc:237] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:58.424072 25835 raft_consensus.cc:1275] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:23:58.433493 27998 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:58.435191 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:58.436043 25757 raft_consensus.cc:2410] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:23:58.430261 25801 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:58.437135 26402 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:58.437367 25754 raft_consensus.cc:1275] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:23:58.437542 25801 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:58.399930 27872 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:58.416909 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:58.418534 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:58.417835 25726 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:23:58.430122 25832 raft_consensus.cc:2468] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 4.
I20260709 12:23:58.390293 25755 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:58.411736 27907 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:58.440819 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:58.443050 25763 raft_consensus.cc:2410] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:23:58.442528 25837 raft_consensus.cc:2393] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 6: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:23:58.453480 25801 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:58.453701 25800 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:23:58.455267 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:58.443277 26402 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:58.443585 25726 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:23:58.460053 25755 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:58.461309 25726 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:58.463991 26402 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
W20260709 12:23:58.467007 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 136713us
I20260709 12:23:58.467015 25762 raft_consensus.cc:1275] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:23:58.441902 28149 raft_consensus.cc:2749] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:23:58.472141 26402 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:23:58.468930 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:58.462992 28004 raft_consensus.cc:2749] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:23:58.455413 27998 raft_consensus.cc:2749] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:58.475549 25832 raft_consensus.cc:1240] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:58.416901 26431 raft_consensus.cc:2468] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 3.
I20260709 12:23:58.458289 28154 raft_consensus.cc:2764] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:23:58.460652 28006 raft_consensus.cc:2804] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:23:58.462664 27907 raft_consensus.cc:2749] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:58.466684 27945 raft_consensus.cc:2804] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:58.479162 26402 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:58.474526 25649 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:58.469471 28049 raft_consensus.cc:2804] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:58.430274 28085 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:58.474385 28057 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:58.477739 25800 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:23:58.529356 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:58.551182 25829 raft_consensus.cc:2468] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 4.
W20260709 12:23:58.551295 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 72228.2us
I20260709 12:23:58.452405 28017 consensus_queue.cc:1059] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:23:58.529011 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:58.476631 28092 raft_consensus.cc:2749] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:58.423951 27948 consensus_queue.cc:237] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:58.552145 26402 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:58.479655 28131 raft_consensus.cc:2804] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:23:58.564740 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 90276.9us
I20260709 12:23:58.565685 25830 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 8.
I20260709 12:23:58.478087 28064 consensus_queue.cc:1059] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
W20260709 12:23:58.570659 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 109398us
I20260709 12:23:58.572284 25726 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
W20260709 12:23:58.573057 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 95385.8us
I20260709 12:23:58.537281 27945 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:58.534495 28006 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:58.540378 28049 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:58.580114 25726 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:23:58.590061 27872 raft_consensus.cc:2804] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:58.590507 27872 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:58.590853 27872 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:58.593658 27841 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:58.594197 27841 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:58.594749 28057 raft_consensus.cc:2749] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:58.596554 25829 raft_consensus.cc:1240] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:23:58.597576 28154 raft_consensus.cc:2749] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:58.598455 28168 raft_consensus.cc:2804] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:58.598930 28168 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:58.599296 28168 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:58.604544 27986 raft_consensus.cc:3055] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:58.604935 27986 raft_consensus.cc:740] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:23:58.605844 27986 consensus_queue.cc:260] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:58.607002 27986 raft_consensus.cc:3060] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:58.608647 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:23:58.611445 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 59409.4us
I20260709 12:23:58.612231 26402 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:58.556036 27998 raft_consensus.cc:2749] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:58.624271 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:58.625867 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:58.620970 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:58.628762 25832 raft_consensus.cc:2393] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 4: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:23:58.540865 27863 consensus_queue.cc:1059] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:23:58.623864 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:58.631451 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:58.633620 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:58.635231 25833 raft_consensus.cc:2393] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 7: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:23:58.637496 25762 raft_consensus.cc:1275] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:23:58.610283 28158 log.cc:927] Time spent T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:23:58.640693 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:58.644250 25831 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:58.641450 27841 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:58.609217 28049 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:58.641963 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:58.649818 25828 raft_consensus.cc:3060] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:58.578895 28083 raft_consensus.cc:2804] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:58.580359 27945 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:23:58.643569 25726 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:58.666296 25762 raft_consensus.cc:1275] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:23:58.646620 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:58.667377 25829 raft_consensus.cc:2468] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 4.
I20260709 12:23:58.668182 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:58.638810 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:58.603514 27963 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:58.680532 27932 raft_consensus.cc:2749] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:58.686553 28168 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:23:58.687959 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:58.651417 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 64544.9us
I20260709 12:23:58.651863 25756 raft_consensus.cc:1275] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:23:58.656059 28021 raft_consensus.cc:3055] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:58.656875 28064 raft_consensus.cc:2749] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:58.656082 28017 consensus_queue.cc:1048] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:23:58.659457 28085 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:23:58.660516 28163 log.cc:927] Time spent T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 12:23:58.624838 27833 consensus_queue.cc:1048] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:23:58.669148 25760 raft_consensus.cc:2393] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 4: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:23:58.625784 28127 raft_consensus.cc:2749] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:58.708823 25726 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:58.712757 25831 raft_consensus.cc:2468] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 4.
I20260709 12:23:58.681761 28122 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:58.667284 28083 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:58.571991 28131 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:58.716864 25836 raft_consensus.cc:2468] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 5.
I20260709 12:23:58.793776 25836 raft_consensus.cc:1240] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 9. Current term is 10. Ops: []
W20260709 12:23:58.794502 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 85760.7us
I20260709 12:23:58.794932 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:58.795236 25726 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:58.795486 25831 raft_consensus.cc:3055] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:58.795776 25831 raft_consensus.cc:740] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:58.796422 25726 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:58.796532 25831 consensus_queue.cc:260] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:58.797399 28154 raft_consensus.cc:3060] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:58.800184 28057 raft_consensus.cc:3060] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:23:58.800740 28160 log.cc:927] Time spent T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 12:23:58.802615 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 172225us
I20260709 12:23:58.806066 28131 raft_consensus.cc:3060] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:58.809871 28083 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:58.813736 27963 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:58.709774 28006 raft_consensus.cc:3060] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:23:58.822080 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 344883us
I20260709 12:23:58.706169 28021 raft_consensus.cc:740] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
W20260709 12:23:58.827368 25801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:58.834992 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:58.835140 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:58.835592 26430 raft_consensus.cc:3060] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:58.828285 25801 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:58.787249 27932 consensus_queue.cc:1059] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.105s
I20260709 12:23:58.835605 26436 raft_consensus.cc:3060] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:23:59.004236 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 434168us
W20260709 12:23:59.012532 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 184350us
W20260709 12:23:58.892061 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:58.956537 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 160170us
I20260709 12:23:58.835939 26402 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:59.020929 25726 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
W20260709 12:23:59.022065 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 186221us
W20260709 12:23:59.022105 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 244084us
I20260709 12:23:59.022989 26402 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:23:59.023029 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:23:59.046965 25756 raft_consensus.cc:1275] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:23:58.833218 27998 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:58.825842 28054 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:23:59.044230 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:59.041507 25837 raft_consensus.cc:3060] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:59.039871 26430 raft_consensus.cc:2468] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 5.
I20260709 12:23:58.945901 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
W20260709 12:23:58.949828 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 53304.7us
I20260709 12:23:58.949307 25836 raft_consensus.cc:1275] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:23:59.033874 28120 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.058s	sys 0.069s
I20260709 12:23:58.792762 28064 consensus_queue.cc:1048] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.252s
I20260709 12:23:59.053217 25757 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:59.054405 25801 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:58.818674 25834 raft_consensus.cc:1240] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:59.076542 25650 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:59.044801 28150 raft_consensus.cc:2764] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 12:23:59.078011 25837 raft_consensus.cc:2468] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 3.
I20260709 12:23:59.078444 25836 raft_consensus.cc:1275] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:23:59.035624 28092 raft_consensus.cc:2749] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:23:59.096616 25763 raft_consensus.cc:1240] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:23:58.823698 28122 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:59.103140 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:59.103956 25681 raft_consensus.cc:2468] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 4.
I20260709 12:23:59.112260 28057 raft_consensus.cc:2749] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:59.113808 28057 raft_consensus.cc:3060] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:59.119395 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:59.095423 28168 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:59.120546 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:59.120639 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:59.121603 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:59.122144 25678 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:59.124392 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:59.124392 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:59.128990 28167 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.129448 28167 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:59.130124 28049 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:59.131469 28167 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:59.132192 28049 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:59.122464 25686 raft_consensus.cc:1275] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:23:59.092799 28120 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.059s	sys 0.069s
I20260709 12:23:59.136183 25757 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 5.
I20260709 12:23:59.136583 26436 raft_consensus.cc:2468] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 5.
I20260709 12:23:59.142387 25678 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 6.
I20260709 12:23:59.120754 28057 raft_consensus.cc:2749] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:59.140537 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:23:59.139504 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 118658us
I20260709 12:23:59.138998 25828 raft_consensus.cc:2468] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 4.
I20260709 12:23:59.162146 25726 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:59.163448 25835 raft_consensus.cc:1240] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:59.162881 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:59.164444 25677 raft_consensus.cc:2468] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 4.
I20260709 12:23:59.165738 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:23:59.133970 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:59.167857 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:23:59.168593 25828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41782 (request call id 515) took 1338 ms. Trace:
I20260709 12:23:59.084558 28127 consensus_queue.cc:1048] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 12:23:59.172617 25828 rpcz_store.cc:276] 0709 12:23:57.824020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:58.618855 (+794835us) service_pool.cc:224] Handling call
0709 12:23:59.161859 (+543004us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11136}
I20260709 12:23:59.052250 27998 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:59.137001 28017 raft_consensus.cc:2804] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:59.196537 26431 raft_consensus.cc:1240] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 3. Current term is 5. Ops: []
I20260709 12:23:59.196797 28017 raft_consensus.cc:697] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 3 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:23:59.197638 28122 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:59.198210 28017 consensus_queue.cc:237] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:23:59.202294 27945 consensus_meta.cc:287] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.538s	user 0.006s	sys 0.003s
I20260709 12:23:59.083563 28054 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:59.202787 27945 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:59.204188 25829 raft_consensus.cc:2368] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 6. Current term is 7.
I20260709 12:23:59.204591 26435 raft_consensus.cc:1275] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 8. (term mismatch)
I20260709 12:23:59.205003 26435 pending_rounds.cc:85] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89: Aborting all ops after (but not including) 7
I20260709 12:23:59.205320 26435 pending_rounds.cc:107] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89: Aborting uncommitted NO_OP operation due to leader change: 5.8
I20260709 12:23:59.105413 28175 raft_consensus.cc:2749] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:23:59.175112 25726 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:59.175962 28167 consensus_queue.cc:1048] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:23:59.176653 28171 log.cc:927] Time spent T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:23:59.176999 28178 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.177820 25649 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:59.178879 28126 consensus_queue.cc:1059] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:59.220044 27945 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:59.232167 28126 raft_consensus.cc:3055] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:23:59.232596 28126 raft_consensus.cc:740] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:59.182691 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:59.233549 26438 raft_consensus.cc:2393] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 3: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
W20260709 12:23:59.184376 27872 consensus_meta.cc:287] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.593s	user 0.007s	sys 0.003s
I20260709 12:23:59.233687 28126 consensus_queue.cc:260] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:59.231068 28162 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:59.234356 27872 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:59.234992 28126 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:23:59.235152 28162 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:23:59.236617 27872 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:59.237293 27872 raft_consensus.cc:2749] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:59.237524 28162 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:59.237900 27872 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.234272 28178 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:59.238404 27872 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:59.239867 25760 raft_consensus.cc:1240] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:23:59.188896 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:59.240739 25757 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:23:59.242746 27986 consensus_meta.cc:287] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.635s	user 0.010s	sys 0.000s
I20260709 12:23:59.190485 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:59.160174 28174 raft_consensus.cc:2749] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:23:59.245357 25762 raft_consensus.cc:1240] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:59.246963 25762 raft_consensus.cc:1240] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:59.192706 25761 raft_consensus.cc:1240] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:59.193787 27998 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:59.132970 28021 consensus_queue.cc:260] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:59.204895 28054 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:59.213095 25756 raft_consensus.cc:1240] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 3. Current term is 5. Ops: []
I20260709 12:23:59.250075 25761 raft_consensus.cc:1240] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 3. Current term is 4. Ops: []
I20260709 12:23:59.189899 25763 raft_consensus.cc:1275] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:23:59.213630 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:59.214936 27907 raft_consensus.cc:3055] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:59.164134 28173 consensus_queue.cc:1048] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 12:23:59.252705 27907 raft_consensus.cc:740] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:23:59.172452 28120 raft_consensus.cc:2749] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:23:59.218106 25726 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:59.217922 28006 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:59.225526 25759 raft_consensus.cc:1240] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:59.232647 28167 raft_consensus.cc:2804] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:59.179529 28049 raft_consensus.cc:2749] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:59.243716 28178 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:59.205551 26435 raft_consensus.cc:2889] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:59.233705 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:23:59.261758 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 43740.8us
W20260709 12:23:59.276429 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 222179us
I20260709 12:23:59.277472 28184 raft_consensus.cc:2764] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
W20260709 12:23:59.139338 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 116261us
W20260709 12:23:59.271447 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:59.279476 28054 consensus_queue.cc:1059] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:59.280534 28054 raft_consensus.cc:3055] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:59.280884 28054 raft_consensus.cc:740] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:23:59.282099 28054 consensus_queue.cc:260] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:59.269691 25757 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 6.
I20260709 12:23:59.253592 28154 raft_consensus.cc:2749] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:59.274225 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:59.279623 26402 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:59.285646 27998 raft_consensus.cc:2804] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:23:59.286041 27998 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:59.286521 27998 raft_consensus.cc:3060] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:59.289388 27986 consensus_queue.cc:1048] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:23:59.290110 28187 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.290637 28187 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:59.291671 26402 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:59.283743 28054 raft_consensus.cc:3060] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:59.293588 28187 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:59.206933 28083 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:59.276280 25754 raft_consensus.cc:2468] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 4.
W20260709 12:23:59.281070 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:59.295953 25726 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:59.303453 25801 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:59.215726 28131 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:59.307993 25726 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:59.303453 25649 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:59.309645 25801 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:59.270514 28167 raft_consensus.cc:697] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 5 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
W20260709 12:23:59.311450 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 235013us
I20260709 12:23:59.321947 25726 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:59.271018 28169 consensus_queue.cc:1059] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 12:23:59.262125 28162 consensus_queue.cc:1059] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:23:59.324712 25650 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:59.328959 25726 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:59.325480 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:59.271894 28099 consensus_queue.cc:1059] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 12:23:59.261319 28174 consensus_queue.cc:1059] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 12:23:59.313113 28187 raft_consensus.cc:2749] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:23:59.341598 25801 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:59.313887 27932 raft_consensus.cc:2749] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:59.342965 25726 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:59.314697 26402 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:23:59.344529 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 295338us
I20260709 12:23:59.336750 27986 raft_consensus.cc:2804] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:59.337119 28057 raft_consensus.cc:2749] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:59.338299 28049 raft_consensus.cc:2749] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:23:59.348242 25801 leader_election.cc:400] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 election: Vote denied by peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) with higher term. Message: Invalid argument: T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 3. Current term is 4.
I20260709 12:23:59.348599 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:59.349300 25757 raft_consensus.cc:2468] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 4.
I20260709 12:23:59.350247 25726 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:59.350448 25801 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:59.336629 28127 consensus_queue.cc:1048] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:23:59.316924 28182 consensus_queue.cc:1059] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:23:59.345789 28184 raft_consensus.cc:2804] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:59.358031 25726 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:59.342743 28185 raft_consensus.cc:2749] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:59.362277 26402 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:59.365993 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:59.372587 25754 raft_consensus.cc:1275] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:23:59.347195 27986 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:59.411947 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 51569.4us
W20260709 12:23:59.412191 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 50029.8us
I20260709 12:23:59.412286 27595 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.413830 27595 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:23:59.416105 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 61284.2us
I20260709 12:23:59.347579 28150 consensus_queue.cc:1048] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 12:23:59.351610 28154 raft_consensus.cc:2804] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:59.417104 25801 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:59.419134 25763 raft_consensus.cc:2468] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 6.
I20260709 12:23:59.380208 25757 raft_consensus.cc:1275] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:23:59.420225 26401 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:59.355953 28155 raft_consensus.cc:3055] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:59.424190 25801 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:59.354089 28187 raft_consensus.cc:2749] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:23:59.379704 28006 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:23:59.428344 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 70371.5us
I20260709 12:23:59.379305 27773 raft_consensus.cc:3055] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:59.413421 28168 raft_consensus.cc:3055] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:59.434864 25726 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:59.379420 28178 raft_consensus.cc:2804] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:59.417094 28162 raft_consensus.cc:2749] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:59.437593 25726 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:59.440117 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:23:59.422474 28184 raft_consensus.cc:697] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:59.379041 27872 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:23:59.416343 27986 raft_consensus.cc:3060] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:59.431757 25801 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:59.426443 28092 raft_consensus.cc:2804] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:59.378420 28064 consensus_queue.cc:1048] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 12:23:59.440958 25757 raft_consensus.cc:2468] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 5.
I20260709 12:23:59.441520 27595 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:59.463116 27595 raft_consensus.cc:2804] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:23:59.463526 27595 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:59.463883 27595 raft_consensus.cc:3060] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:23:59.431970 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 107321us
I20260709 12:23:59.425154 28045 raft_consensus.cc:2749] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:23:59.422830 28191 raft_consensus.cc:2749] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:59.425993 28155 raft_consensus.cc:740] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:59.440863 28181 raft_consensus.cc:2804] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:59.447185 28085 raft_consensus.cc:2955] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 4 to 6, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:23:59.448951 28183 raft_consensus.cc:2749] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:59.425329 26433 raft_consensus.cc:2468] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 5.
I20260709 12:23:59.432926 27948 raft_consensus.cc:2749] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:59.435792 27956 consensus_queue.cc:1059] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:23:59.444774 28186 raft_consensus.cc:2804] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:59.436123 28178 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:59.453357 25801 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:59.434091 27773 raft_consensus.cc:740] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:59.460924 25726 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:59.434406 28168 raft_consensus.cc:740] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
W20260709 12:23:59.489302 26402 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:59.462023 28053 raft_consensus.cc:2804] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:23:59.455530 27872 raft_consensus.cc:2749] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:59.441653 28182 consensus_queue.cc:1048] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:23:59.438933 28166 consensus_queue.cc:1048] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
W20260709 12:23:59.519556 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 81790.2us
I20260709 12:23:59.441264 28167 consensus_queue.cc:237] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:23:59.521778 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 68516.8us
I20260709 12:23:59.541002 25801 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:59.519620 28131 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:23:59.520839 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 59978.2us
I20260709 12:23:59.523252 28178 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:59.517712 28083 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:59.519544 28154 raft_consensus.cc:697] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:59.520251 28186 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:23:59.563174 25801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:59.536445 28057 raft_consensus.cc:2749] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:59.551599 27595 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:59.526180 27963 raft_consensus.cc:2804] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:23:59.554004 25726 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:23:59.494340 28175 consensus_queue.cc:1059] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:23:59.503705 28194 consensus_queue.cc:1048] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 12:23:59.523463 28127 consensus_queue.cc:1048] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
W20260709 12:23:59.574849 26402 leader_election.cc:336] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 1.592s (SENT)
I20260709 12:23:59.575484 26402 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:59.544317 28053 raft_consensus.cc:697] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 6 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:59.573642 27963 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:59.585156 25650 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:23:59.585106 27963 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:59.586185 25650 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:59.584692 27595 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:23:59.547379 28092 raft_consensus.cc:697] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 4 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:23:59.588392 28092 consensus_queue.cc:237] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:59.593573 25650 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:59.593581 25801 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:59.571774 28183 raft_consensus.cc:2749] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:59.571029 28186 raft_consensus.cc:3060] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:23:59.601240 26402 leader_election.cc:336] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 1.652s (SENT)
I20260709 12:23:59.581364 28181 raft_consensus.cc:697] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 3 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:23:59.594120 28169 consensus_queue.cc:1059] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 12:23:59.640811 28199 raft_consensus.cc:2749] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:23:59.641796 28188 consensus_queue.cc:1048] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.163s
W20260709 12:23:59.665493 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:59.660168 27773 consensus_queue.cc:260] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:59.669849 27773 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:59.555428 28155 consensus_queue.cc:260] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:23:59.647331 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 53824.1us
W20260709 12:23:59.700664 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 99469.4us
W20260709 12:23:59.713245 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:59.749467 25831 raft_consensus.cc:3060] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Advancing to term 5
W20260709 12:23:59.642571 28201 log.cc:927] Time spent T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:23:59.664355 28209 raft_consensus.cc:2804] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:59.659945 27945 raft_consensus.cc:2749] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:59.643332 28131 raft_consensus.cc:2749] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:23:59.668393 27833 raft_consensus.cc:2749] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:23:59.757140 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 163651us
I20260709 12:23:59.741963 27841 raft_consensus.cc:3060] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:59.658200 28199 raft_consensus.cc:2804] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:59.658842 28053 consensus_queue.cc:237] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:59.665076 27963 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:59.760381 25650 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:23:59.768224 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 183881us
I20260709 12:23:59.770097 25726 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:59.753974 28209 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:23:59.771309 25726 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:23:59.766973 28199 raft_consensus.cc:697] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 5 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:59.582508 28184 consensus_queue.cc:237] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:59.664424 28181 consensus_queue.cc:237] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:59.771700 28049 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.770778 28155 raft_consensus.cc:3060] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:59.658406 28154 consensus_queue.cc:237] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:59.784113 25650 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:59.784663 25726 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:59.768833 28169 raft_consensus.cc:3055] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:23:59.833679 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:59.835280 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:59.787868 25831 raft_consensus.cc:2468] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 5.
I20260709 12:23:59.775554 28209 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:59.788676 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:23:59.903964 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:59.791893 28049 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:59.792937 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:23:59.794977 27986 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:59.798485 28215 raft_consensus.cc:2804] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:59.800860 28178 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:23:59.802148 26401 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:23:59.803972 28180 raft_consensus.cc:3055] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:23:59.920331 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 118267us
I20260709 12:23:59.808480 25834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 2355) took 1625 ms. Trace:
I20260709 12:23:59.810894 28122 raft_consensus.cc:3055] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:59.813416 27963 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:23:59.816371 28168 consensus_queue.cc:260] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:59.788708 28126 raft_consensus.cc:2804] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:23:59.820160 28192 log.cc:927] Time spent T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.231s	user 0.000s	sys 0.001s
I20260709 12:23:59.822801 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:23:59.886442 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 101821us
I20260709 12:23:59.832969 28169 raft_consensus.cc:740] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
W20260709 12:23:59.893146 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 109268us
I20260709 12:23:59.948272 25650 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:23:59.939664 25726 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:23:59.893671 27833 raft_consensus.cc:2749] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:23:59.900108 25831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44218 (request call id 1385) took 1194 ms. Trace:
I20260709 12:23:59.900364 28152 raft_consensus.cc:3055] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:23:59.910931 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:23:59.911264 26402 leader_election.cc:336] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 1.664s (SENT)
I20260709 12:23:59.824373 27907 consensus_queue.cc:260] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:59.953570 25829 raft_consensus.cc:1240] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 6. Current term is 7. Ops: []
I20260709 12:23:59.954578 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:59.955761 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:59.957962 25831 rpcz_store.cc:276] 0709 12:23:58.644951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:58.788320 (+143369us) service_pool.cc:224] Handling call
0709 12:23:59.749059 (+960739us) spinlock_profiling.cc:243] Waited 408 ms on lock 0x7b5800219bd0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99abd0aa 00007f5d99b3f447 00007f5d99b57fe7 00007f5d99b597de 00007f5d99b6527c 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c
0709 12:23:59.839498 (+ 90439us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":938968448}
I20260709 12:23:59.970706 25650 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:59.975651 25650 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:23:59.977967 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:23:59.980427 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 69205us
W20260709 12:23:59.990861 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 552830us
I20260709 12:23:59.993197 26430 raft_consensus.cc:1240] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 4 LEADER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:23:59.995009 27595 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:59.995141 25835 raft_consensus.cc:1275] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:23:59.995496 27595 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:59.997304 28210 raft_consensus.cc:2749] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:23:59.998041 28210 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:59.999130 25828 raft_consensus.cc:1240] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:00.000119 25830 raft_consensus.cc:1240] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:00.000670 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:00.001312 26438 raft_consensus.cc:2468] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 3.
I20260709 12:23:59.932093 28064 raft_consensus.cc:2804] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:23:59.932153 28198 raft_consensus.cc:2804] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:00.003472 25756 raft_consensus.cc:1240] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:59.916491 28017 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:23:59.920423 28180 raft_consensus.cc:740] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:23:59.923442 28122 raft_consensus.cc:740] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:23:59.929517 27932 raft_consensus.cc:2749] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:23:59.948314 28126 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:59.947754 28215 raft_consensus.cc:697] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:00.001071 28194 raft_consensus.cc:2749] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:00.010365 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:00.040400 26438 raft_consensus.cc:2393] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 3: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
W20260709 12:24:00.012665 26402 leader_election.cc:336] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 1.771s (SENT)
I20260709 12:24:00.013945 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:00.014211 25800 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:00.041095 26437 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:00.014070 27907 raft_consensus.cc:3060] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:59.974128 27773 consensus_queue.cc:1048] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
W20260709 12:24:00.013969 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 74367us
I20260709 12:24:00.013989 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:23:59.963769 28152 raft_consensus.cc:740] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:23:59.959549 28211 raft_consensus.cc:2749] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:23:59.989711 28168 raft_consensus.cc:3060] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:59.998476 28210 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:00.053176 26438 raft_consensus.cc:2955] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 4 to 6, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:24:00.007380 26431 raft_consensus.cc:1240] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 4. Current term is 5. Ops: []
I20260709 12:23:59.974318 28099 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:00.037261 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:00.065883 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:00.014070 26434 raft_consensus.cc:2368] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 4. Current term is 5.
I20260709 12:24:00.005652 28064 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:00.016364 28045 consensus_queue.cc:1048] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:24:00.047133 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:00.056324 28150 raft_consensus.cc:2804] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:00.057610 25833 raft_consensus.cc:1275] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:00.003050 25650 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:00.059613 25831 raft_consensus.cc:1275] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:00.038170 28126 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:00.065531 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:00.086897 25837 raft_consensus.cc:2468] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 4.
I20260709 12:24:00.020550 28017 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:23:59.979302 28174 consensus_queue.cc:1059] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.084s
I20260709 12:24:00.060134 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:00.089723 25829 raft_consensus.cc:2393] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 6: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:00.069386 28178 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:00.042002 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:23:59.939760 25834 rpcz_store.cc:276] 0709 12:23:58.183044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:58.419369 (+236325us) service_pool.cc:224] Handling call
0709 12:23:58.419870 (+   501us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:23:59.102174 (+682304us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:23:59.808199 (+706025us) spinlock_profiling.cc:243] Waited 362 ms on lock 0x7b54001b1054. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:23:59.808410 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":832039296}
I20260709 12:24:00.070394 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:00.105561 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:00.078510 25835 raft_consensus.cc:2393] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 4: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:00.107254 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:00.107870 25831 raft_consensus.cc:2468] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 5.
I20260709 12:24:00.083341 28064 raft_consensus.cc:3060] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:23:59.933820 27986 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:00.080751 25759 raft_consensus.cc:2393] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 5: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:00.054459 25726 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:00.085469 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:00.086917 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 83938.4us
I20260709 12:24:00.103124 25829 raft_consensus.cc:1275] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:00.105829 25756 raft_consensus.cc:2393] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 6: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:00.070003 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:23:59.975099 28199 consensus_queue.cc:237] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:00.078640 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 66025.4us
I20260709 12:24:00.084769 28150 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:00.116403 25830 raft_consensus.cc:2393] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 10: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:00.127095 26430 raft_consensus.cc:1240] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 3 LEADER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:00.127265 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
W20260709 12:24:00.133451 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 79055.6us
I20260709 12:24:00.133816 25650 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
W20260709 12:24:00.100054 26434 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36518 (request call id 626) took 1255 ms (client timeout 1549 ms). Trace:
I20260709 12:24:00.090214 28194 raft_consensus.cc:2749] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:00.111761 27998 consensus_meta.cc:287] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.822s	user 0.007s	sys 0.006s
I20260709 12:24:00.134404 25726 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:00.112002 25757 raft_consensus.cc:2955] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 4 to 6, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:24:00.114275 28054 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.086452 28099 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:00.079829 28180 consensus_queue.cc:260] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:00.063637 28169 consensus_queue.cc:260] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:00.186688 27595 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:00.166666 26402 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:24:00.193224 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 45848.6us
W20260709 12:24:00.194067 26402 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:00.194562 27595 raft_consensus.cc:2749] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:00.178264 25759 raft_consensus.cc:1275] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:24:00.119519 28175 raft_consensus.cc:2749] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:00.197707 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 63362.3us
I20260709 12:24:00.201821 25726 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:00.203059 26437 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 5.
I20260709 12:24:00.205085 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:00.205734 25830 raft_consensus.cc:3060] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:00.147661 26435 raft_consensus.cc:2368] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for earlier term 3. Current term is 4.
W20260709 12:24:00.188256 28212 log.cc:927] Time spent T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.266s	user 0.001s	sys 0.000s
I20260709 12:24:00.141134 28208 raft_consensus.cc:2749] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:00.215377 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:00.134955 28150 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:00.169092 26432 raft_consensus.cc:1240] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:24:00.249253 25759 raft_consensus.cc:1240] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:00.178828 28178 raft_consensus.cc:2749] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:00.227639 25832 raft_consensus.cc:1275] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:00.174000 26431 raft_consensus.cc:1240] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:00.143280 27833 raft_consensus.cc:2749] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:00.261229 28219 raft_consensus.cc:3060] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:00.253333 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 51589.9us
I20260709 12:24:00.148880 28215 consensus_queue.cc:237] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:00.265100 25726 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:24:00.165771 28207 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:00.201112 28049 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:00.257367 26437 raft_consensus.cc:1275] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:24:00.258895 26432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 694) took 2086 ms. Trace:
I20260709 12:24:00.261046 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:00.184233 28054 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:00.186367 28210 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:00.184855 28151 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.277715 25830 raft_consensus.cc:2468] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 5.
I20260709 12:24:00.278581 28199 raft_consensus.cc:2804] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:00.279289 25726 leader_election.cc:400] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237) with higher term. Message: Invalid argument: T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 6. Current term is 7.
I20260709 12:24:00.301709 25726 leader_election.cc:403] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:00.172950 27986 consensus_queue.cc:1048] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 12:24:00.163704 28127 consensus_queue.cc:1048] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.102s
I20260709 12:24:00.256299 28180 raft_consensus.cc:3060] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:00.182762 27998 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:00.244139 28198 raft_consensus.cc:697] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 5 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:00.191059 28174 consensus_queue.cc:1059] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.090s
I20260709 12:24:00.173365 28188 consensus_queue.cc:1048] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.092s
I20260709 12:24:00.333521 27986 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.333742 28188 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:00.137763 26434 rpcz_store.cc:269] 0709 12:23:58.834063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:58.872153 (+ 38090us) service_pool.cc:224] Handling call
0709 12:23:59.822606 (+950453us) spinlock_profiling.cc:243] Waited 20.5 ms on lock 0x7b5800004598. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d96a3cb71 00007f5d96a3ca22 00007f5d9f9558d9 00007f5d9eaafee0 00007f5d9eb790ab 00007f5d9eb79131 00007f5d9eb270a0 00007f5d9eb26984 00007f5d980a16d4 00007f5d980a1662
0709 12:24:00.089457 (+266851us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47045504}
I20260709 12:24:00.286509 28169 raft_consensus.cc:3060] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:00.322520 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:00.292755 28004 consensus_queue.cc:1048] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:24:00.138613 28152 consensus_queue.cc:260] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
W20260709 12:24:00.335991 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 56902.7us
W20260709 12:24:00.365904 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:00.336683 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 201029us
I20260709 12:24:00.358209 27863 consensus_queue.cc:1048] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:00.334105 27986 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:00.367640 25650 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:00.284987 28207 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:00.377660 28198 consensus_queue.cc:237] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:00.372442 25650 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:00.373173 28231 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:00.382257 28211 raft_consensus.cc:2749] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:00.374076 27833 raft_consensus.cc:2804] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:00.300165 28124 consensus_queue.cc:1059] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:24:00.366413 25726 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:00.380362 28188 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:00.360787 28179 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.387909 27833 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:00.388450 28207 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:00.300542 28151 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:00.388976 28211 consensus_queue.cc:1059] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:00.389216 28195 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.284873 26432 rpcz_store.cc:276] 0709 12:23:58.172489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:58.176325 (+  3836us) service_pool.cc:224] Handling call
0709 12:23:59.011654 (+835329us) spinlock_profiling.cc:243] Waited 7.22 ms on lock 0x7b5800004598. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d96a3cb71 00007f5d96a3ca22 00007f5d9f9558d9 00007f5d9eaafee0 00007f5d9eb790ab 00007f5d9eb79131 00007f5d9eb3afc0 00007f5d9eb25929 00007f5d9eb253d2 00007f5d9809cbd4
0709 12:24:00.168649 (+1156995us) spinlock_profiling.cc:243] Waited 20.4 ms on lock 0x7b5800004598. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d96a3ce9c 00007f5d96a3ca5b 00007f5d9f9558d9 00007f5d9eaafee0 00007f5d9eb790ab 00007f5d9eb79131 00007f5d9eb3afc0 00007f5d9eb25929 00007f5d9eb253d2 00007f5d9809cbd4
0709 12:24:00.168823 (+   174us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:00.258561 (+ 89738us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:00.258814 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":63585408}
I20260709 12:24:00.401172 28179 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:00.400691 27833 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:00.403486 28021 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:00.403602 28188 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:00.391588 27956 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.404990 27998 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:00.406186 28054 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:00.407711 27986 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349)
I20260709 12:24:00.371699 28210 raft_consensus.cc:3055] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:00.344766 28199 raft_consensus.cc:697] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
W20260709 12:24:00.413148 28186 consensus_meta.cc:287] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.768s	user 0.010s	sys 0.001s
I20260709 12:24:00.391644 25650 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
W20260709 12:24:00.450183 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 58735us
I20260709 12:24:00.413894 28195 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:00.417538 28064 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:00.418694 28228 log.cc:927] Time spent T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:24:00.419616 28230 log.cc:927] Time spent T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 12:24:00.385720 28049 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.329455 28120 consensus_queue.cc:1059] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
W20260709 12:24:00.426789 28209 consensus_meta.cc:287] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.509s	user 0.011s	sys 0.000s
I20260709 12:24:00.435214 28237 consensus_queue.cc:1048] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:24:00.435771 28231 raft_consensus.cc:2749] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237) with higher term. Message: Invalid argument: T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 6. Current term is 7.
I20260709 12:24:00.162715 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:00.442965 27963 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:00.453876 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 159096us
W20260709 12:24:00.452828 27841 consensus_meta.cc:287] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.686s	user 0.011s	sys 0.000s
I20260709 12:24:00.472874 25650 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:24:00.586108 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 113312us
I20260709 12:24:00.440872 28210 raft_consensus.cc:740] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:00.455093 28211 raft_consensus.cc:2804] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:00.611400 25757 raft_consensus.cc:1240] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 5 LEADER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:00.613312 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:00.614884 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:00.452348 27956 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:00.579527 28099 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:00.444723 28126 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:00.454908 28125 consensus_queue.cc:1059] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.146s
I20260709 12:24:00.584455 27815 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.455269 28186 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:00.592903 27963 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:00.639336 28210 consensus_queue.cc:260] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:00.602408 27841 raft_consensus.cc:2749] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:00.646366 25756 raft_consensus.cc:1240] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:00.612010 28004 raft_consensus.cc:3055] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:00.610608 28208 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:00.578850 28049 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:00.664469 27841 raft_consensus.cc:3055] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:00.651852 28166 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.665341 28199 consensus_queue.cc:237] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:00.578668 28209 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:00.657101 27815 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:00.631146 28235 raft_consensus.cc:2749] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:00.682905 28150 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:00.683566 28186 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:00.683944 28209 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:00.685343 27956 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:00.706463 28219 raft_consensus.cc:2749] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:00.706660 28205 raft_consensus.cc:3055] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:00.686394 27815 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:00.686523 27833 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:00.687383 28188 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:00.665388 27963 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:00.691774 28151 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:00.694315 28155 consensus_meta.cc:287] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.865s	user 0.009s	sys 0.000s
I20260709 12:24:00.696648 28126 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:00.697525 28179 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:00.700941 28168 consensus_meta.cc:287] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.637s	user 0.008s	sys 0.001s
I20260709 12:24:00.657852 28099 consensus_queue.cc:1059] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:24:00.703141 28210 raft_consensus.cc:3060] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:00.660115 28004 raft_consensus.cc:740] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:00.671705 27841 raft_consensus.cc:740] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:00.722326 25831 raft_consensus.cc:1240] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:24:00.722988 25759 raft_consensus.cc:1240] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:00.702069 28049 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:00.680495 28208 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:00.707235 28205 raft_consensus.cc:740] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:00.678974 28166 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:00.725419 28188 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:00.798648 28168 raft_consensus.cc:3055] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:00.824259 27841 consensus_queue.cc:260] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:00.824337 28168 raft_consensus.cc:740] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:00.830343 28205 consensus_queue.cc:260] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:00.842691 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:00.849203 27841 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:00.854705 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 477227us
I20260709 12:24:00.863085 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:00.872653 28168 consensus_queue.cc:260] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:00.891883 26439 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.026s	sys 0.038s
W20260709 12:24:00.892308 26439 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.026s	sys 0.038s
I20260709 12:24:00.873776 28150 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:00.853155 28004 consensus_queue.cc:260] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:00.918794 25761 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.011s	sys 0.053s
W20260709 12:24:00.965328 25761 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.011s	sys 0.053s
W20260709 12:24:00.928134 28215 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.019s	sys 0.035s
W20260709 12:24:00.991406 28215 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.019s	sys 0.036s
W20260709 12:24:00.991729 26404 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.010s	sys 0.009s
W20260709 12:24:00.996477 26438 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.010s	sys 0.008s
W20260709 12:24:00.996673 26404 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.010s	sys 0.009s
W20260709 12:24:00.948742 28194 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.019s	sys 0.041s
W20260709 12:24:00.992274 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 442603us
W20260709 12:24:00.996891 26438 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.725s	user 0.010s	sys 0.008s
I20260709 12:24:01.032214 26438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 629) took 1038 ms. Trace:
I20260709 12:24:01.032601 26438 rpcz_store.cc:276] 0709 12:23:59.993563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:00.052590 (+ 59027us) service_pool.cc:224] Handling call
0709 12:24:00.052864 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:00.053067 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:00.271819 (+218752us) log.cc:844] Serialized 14 byte log entry
0709 12:24:01.031835 (+760016us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:01.031889 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:01.031956 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:01.032025 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:01.032159 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":759571,"threads_started":1}
W20260709 12:24:00.998437 26436 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.007s	sys 0.007s
W20260709 12:24:01.035096 26436 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.008s	sys 0.007s
I20260709 12:24:01.037117 26439 raft_consensus.cc:1240] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:24:00.994129 28178 raft_consensus.cc:2804] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:00.996881 28188 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:24:01.074012 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 486956us
W20260709 12:24:01.050783 25801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:01.055359 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:01.078052 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:01.083628 26438 raft_consensus.cc:2393] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 4: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:01.084501 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:01.084942 28240 log.cc:927] Time spent T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:24:01.085493 26435 raft_consensus.cc:2410] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:24:01.084954 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:01.031205 28194 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.019s	sys 0.044s
I20260709 12:24:01.105506 27815 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.120910 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:01.075466 28004 raft_consensus.cc:3060] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:01.072527 28215 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:01.116819 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:01.107126 28150 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.138489 28196 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.077186 27833 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:01.086565 28180 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:01.087020 28167 consensus_queue.cc:1048] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:24:01.113785 28175 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.109728 28214 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.110297 28231 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.129504 27963 consensus_queue.cc:1059] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 12:24:01.147230 28175 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:01.148006 26434 raft_consensus.cc:2410] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:24:01.141992 28126 consensus_queue.cc:1059] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
W20260709 12:24:01.148638 28239 log.cc:927] Time spent T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.278s	user 0.000s	sys 0.001s
I20260709 12:24:01.133494 27815 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:01.142598 28215 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:01.132707 28155 consensus_queue.cc:1059] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:24:01.153157 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:01.155653 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:24:01.249286 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 105183us
I20260709 12:24:01.254630 25760 raft_consensus.cc:1275] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:01.255599 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:01.258140 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:01.259603 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:01.260684 25684 raft_consensus.cc:2368] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 4. Current term is 5.
I20260709 12:24:01.261927 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:01.143693 28150 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:01.263443 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:01.264496 25677 raft_consensus.cc:2393] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 4: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:01.265359 28150 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:01.265462 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:01.266187 25685 raft_consensus.cc:2468] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 3.
I20260709 12:24:01.267093 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:01.267701 25681 raft_consensus.cc:2468] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 5.
I20260709 12:24:01.267819 28126 raft_consensus.cc:3055] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:01.268344 28126 raft_consensus.cc:740] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:01.269164 28126 consensus_queue.cc:260] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:01.270306 28126 raft_consensus.cc:3060] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:01.258942 25760 raft_consensus.cc:2468] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 2.
W20260709 12:24:01.172858 28131 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.054s	user 0.031s	sys 0.103s
I20260709 12:24:01.273617 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:01.273811 25680 raft_consensus.cc:1240] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:01.150117 27932 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:01.284798 26402 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.020s	sys 0.015s
I20260709 12:24:01.293130 25763 raft_consensus.cc:2410] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:24:01.180847 28154 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:01.287240 26402 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.020s	sys 0.015s
I20260709 12:24:01.181886 28017 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:01.150089 28195 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:24:01.295670 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 712867us
W20260709 12:24:01.293278 28211 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.021s	sys 0.048s
W20260709 12:24:01.314613 26402 leader_election.cc:336] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 2.016s (SENT)
I20260709 12:24:01.296795 28248 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.179339 28064 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:24:01.274842 28131 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.160s	user 0.031s	sys 0.107s
I20260709 12:24:01.179962 28180 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:01.259989 28231 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:24:01.148784 28196 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:01.328227 28248 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:01.180442 28214 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:01.328745 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:01.546016 25649 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.920s	user 0.030s	sys 0.038s
I20260709 12:24:01.933393 25763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53460 (request call id 1995) took 1058 ms. Trace:
W20260709 12:24:01.990079 25649 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.365s	user 0.044s	sys 0.045s
I20260709 12:24:01.897341 25831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41782 (request call id 532) took 1837 ms. Trace:
I20260709 12:24:01.495270 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
W20260709 12:24:01.399713 27595 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.023s	sys 0.038s
W20260709 12:24:01.578552 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:01.743686 26436 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.014s	sys 0.016s
W20260709 12:24:01.832450 26402 leader_election.cc:336] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 2.110s (SENT)
I20260709 12:24:01.454082 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:01.993829 26436 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.958s	user 0.016s	sys 0.026s
I20260709 12:24:01.834360 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:24:01.994531 27595 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.326s	user 0.024s	sys 0.067s
I20260709 12:24:01.987931 25678 raft_consensus.cc:1240] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:01.363545 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
W20260709 12:24:01.899614 25726 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 1.835s (SENT) [suppressed 27 similar messages]
I20260709 12:24:01.363900 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:01.990626 25649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:01.914119 25728 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.801s	user 0.000s	sys 0.010s
I20260709 12:24:01.996313 25677 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 10.
W20260709 12:24:01.996647 25649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:01.951639 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:01.928303 25581 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41224 (request call id 333) took 7957 ms. Trace:
W20260709 12:24:01.997108 25649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:01.992697 25830 raft_consensus.cc:2393] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 5: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:01.990238 25763 rpcz_store.cc:276] 0709 12:24:00.874894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:00.875064 (+   170us) service_pool.cc:224] Handling call
0709 12:24:01.155508 (+280444us) spinlock_profiling.cc:243] Waited 1.43 ms on lock 0x7b580013b998. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d96a3cb71 00007f5d96a3ca22 00007f5d9f9558d9 00007f5d9eaafee0 00007f5d9eb790ab 00007f5d9eb79131 00007f5d9eb270a0 00007f5d9eb26984 00007f5d980a16d4 00007f5d980a1662
0709 12:24:01.933201 (+777693us) spinlock_profiling.cc:243] Waited 39.6 ms on lock 0x7b54003a66d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:01.933338 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":94383744}
I20260709 12:24:01.960675 26401 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:24:01.315048 28211 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.021s	sys 0.049s
W20260709 12:24:01.999485 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 99910us
I20260709 12:24:02.006134 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:01.515199 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:01.991345 25831 rpcz_store.cc:276] 0709 12:24:00.059516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:00.108440 (+ 48924us) service_pool.cc:224] Handling call
0709 12:24:00.126513 (+ 18073us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:00.777778 (+651265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:01.896970 (+1119192us) spinlock_profiling.cc:243] Waited 596 ms on lock 0x7b5400246154. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:01.897255 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1369654656}
I20260709 12:24:02.007073 25678 raft_consensus.cc:2468] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 4.
I20260709 12:24:01.994501 25758 raft_consensus.cc:2468] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 2.
I20260709 12:24:02.008329 25680 raft_consensus.cc:2393] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 4: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:01.811712 25759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 2400) took 1178 ms. Trace:
W20260709 12:24:01.914258 25760 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.009s	sys 0.000s
W20260709 12:24:02.009523 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 177131us
W20260709 12:24:02.009783 25760 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.010s	sys 0.001s
W20260709 12:24:01.913937 28035 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.005s	sys 0.003s
I20260709 12:24:01.930998 28150 raft_consensus.cc:3055] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:01.650223 28152 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:01.996553 25728 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.883s	user 0.000s	sys 0.010s
W20260709 12:24:01.365547 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:01.393599 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:01.924126 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:01.514763 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:02.009194 25759 rpcz_store.cc:276] 0709 12:24:00.608427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:00.610476 (+  2049us) service_pool.cc:224] Handling call
0709 12:24:00.610790 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:00.778095 (+167305us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:01.786915 (+1008820us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b5400298e54. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:01.787187 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":257485568}
W20260709 12:24:01.495501 28199 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.817s	user 0.013s	sys 0.035s
I20260709 12:24:02.016103 27595 raft_consensus.cc:2804] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:02.016510 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:24:01.930146 28004 consensus_meta.cc:287] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.790s	user 0.009s	sys 0.000s
W20260709 12:24:02.134682 28251 log.cc:927] Time spent T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 12:24:02.134791 28004 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:02.135449 28004 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:02.136650 25832 raft_consensus.cc:2410] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for term 9 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 9.
I20260709 12:24:02.137811 28004 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:02.138979 28214 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:02.139575 28214 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:01.866490 28241 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.860378 28219 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.338105 28213 raft_consensus.cc:3055] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:02.022369 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:01.368081 27963 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.992794 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:01.651677 28174 raft_consensus.cc:3055] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:01.577656 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:01.929177 28184 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:01.297502 27932 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:02.175307 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:01.555089 28179 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.104722 28175 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:02.005570 28211 raft_consensus.cc:697] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 4 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:02.012106 28215 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:01.313028 28154 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:02.021703 28035 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.005s	sys 0.003s
I20260709 12:24:01.890370 28057 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:02.079443 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:02.222317 25685 raft_consensus.cc:3060] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:01.880498 27872 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:02.140865 28099 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:02.141680 28258 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:01.997342 25581 rpcz_store.cc:276] 0709 12:23:53.970629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:53.971060 (+   431us) service_pool.cc:224] Handling call
0709 12:24:01.928232 (+7957172us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:23:58.534888 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:23:58.535705 (+   817us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:23:58.535760 (+    55us) write_op.cc:435] Acquired schema lock
0709 12:23:58.535786 (+    26us) tablet.cc:662] Decoding operations
0709 12:23:58.663294 (+127508us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:23:58.663502 (+   208us) write_op.cc:641] Partition lock acquired for write op
0709 12:23:58.663531 (+    29us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:23:58.664624 (+  1093us) tablet.cc:701] Row locks acquired
0709 12:23:58.664706 (+    82us) write_op.cc:260] PREPARE: finished
0709 12:23:58.664878 (+   172us) write_op.cc:270] Start()
0709 12:23:58.665048 (+   170us) write_op.cc:276] Timestamp: P: 1783599838664820 usec, L: 0
0709 12:23:58.665076 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 12:23:58.816434 (+151358us) log.cc:844] Serialized 4425 byte log entry
0709 12:23:59.451212 (+634778us) op_driver.cc:464] REPLICATION: finished
0709 12:23:59.642055 (+190843us) write_op.cc:301] APPLY: starting
0709 12:23:59.642153 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0709 12:23:59.642503 (+   350us) tablet.cc:1370] finished BulkCheckPresence
0709 12:23:59.751889 (+109386us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:23:59.821518 (+ 69629us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:23:59.821749 (+   231us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 12:23:59.821796 (+    47us) write_op.cc:312] APPLY: finished
0709 12:23:59.822079 (+   283us) log.cc:844] Serialized 83 byte log entry
0709 12:23:59.822247 (+   168us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:59.822377 (+   130us) write_op.cc:454] Released schema lock
0709 12:23:59.822428 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 12:23:59.822825 (+   397us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:23:59.822853 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":70562,"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":190521,"apply.run_cpu_time_us":3938,"apply.run_wall_time_us":180743,"num_ops":11,"prepare.queue_time_us":272555,"prepare.run_cpu_time_us":65591,"prepare.run_wall_time_us":585326,"raft.queue_time_us":197717,"raft.run_cpu_time_us":14704,"raft.run_wall_time_us":122946,"replication_time_us":768186,"thread_start_us":690811,"threads_started":4,"wal-append.queue_time_us":357391,"wal-append.run_cpu_time_us":31830,"wal-append.run_wall_time_us":1665513}]]}
I20260709 12:24:02.158814 28214 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:02.214039 28175 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:02.146036 27595 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:02.022943 28249 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.241955 27595 raft_consensus.cc:3060] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:02.149080 25803 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.022s	sys 0.053s
W20260709 12:24:02.242852 25803 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.022s	sys 0.054s
I20260709 12:24:02.192886 27963 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:01.931218 28204 consensus_queue.cc:1048] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.212s
I20260709 12:24:01.827121 28122 consensus_queue.cc:260] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:02.319552 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:02.320544 26434 raft_consensus.cc:2468] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 3.
I20260709 12:24:02.161254 25677 raft_consensus.cc:2468] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 3.
I20260709 12:24:02.168195 25828 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 6.
I20260709 12:24:02.333938 28266 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:02.334734 28266 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:02.336387 28264 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.337081 28264 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:02.339274 28264 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:02.338873 27595 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:02.340596 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:02.343324 28205 raft_consensus.cc:3060] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:02.349604 28266 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:02.351009 28264 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:02.351735 28264 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:02.354174 28264 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:02.361516 27595 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:02.312124 28180 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:02.105790 28231 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:02.172616 28184 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:01.649025 26432 raft_consensus.cc:1240] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:02.175652 27932 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:02.177817 28208 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:02.182380 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:02.419042 25755 raft_consensus.cc:3060] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:02.139631 28248 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:02.195704 25727 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.005s	sys 0.009s
W20260709 12:24:02.420605 25727 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.310s	user 0.006s	sys 0.009s
I20260709 12:24:02.107966 28092 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.160995 28213 raft_consensus.cc:740] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:02.196775 28179 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:02.169641 28174 raft_consensus.cc:740] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:02.424239 28092 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:02.424539 28174 consensus_queue.cc:260] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:02.425670 28174 raft_consensus.cc:3060] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:02.426493 28092 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:01.986866 25761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48606 (request call id 568) took 1851 ms. Trace:
I20260709 12:24:02.213864 28255 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.430160 28255 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:02.166098 28219 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:02.433699 28219 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:02.434969 28179 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:02.428079 25761 rpcz_store.cc:276] 0709 12:24:00.135204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:00.135395 (+   191us) service_pool.cc:224] Handling call
0709 12:24:00.135748 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:00.141847 (+  6099us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:00.141888 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:00.214447 (+ 72559us) log.cc:844] Serialized 26 byte log entry
0709 12:24:00.965933 (+751486us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:00.965990 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:00.966091 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:01.986472 (+1020381us) raft_consensus.cc:1685] finished
0709 12:24:01.986495 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:01.986756 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14416,"raft.queue_time_us":82,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":6397,"thread_start_us":678532,"threads_started":1,"wal-append.queue_time_us":1150054}
I20260709 12:24:02.436867 28255 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:02.145714 25836 raft_consensus.cc:3060] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:02.161769 28241 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:02.442018 28241 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:02.216886 28215 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:02.442842 28215 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:02.445371 28215 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:02.243866 28258 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:02.447780 28258 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:02.244097 28249 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:02.246031 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:02.448777 25682 raft_consensus.cc:2468] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 3.
I20260709 12:24:02.449265 25682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51578 (request call id 509) took 1096 ms. Trace:
I20260709 12:24:02.449576 25682 rpcz_store.cc:276] 0709 12:24:01.352463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:01.463361 (+110898us) service_pool.cc:224] Handling call
0709 12:24:02.245867 (+782506us) spinlock_profiling.cc:243] Waited 48.1 ms on lock 0x7b5800003698. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d96a3cb71 00007f5d96a3ca22 00007f5d9f9558d9 00007f5d9eaafee0 00007f5d9eb790ab 00007f5d9eb79131 00007f5d9eb270a0 00007f5d9eb26984 00007f5d980a16d4 00007f5d980a1662
0709 12:24:02.449210 (+203343us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":110521216}
I20260709 12:24:02.450011 28249 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:02.245754 28175 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:02.452250 28175 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:02.247507 28045 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:02.249810 28154 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:02.249879 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:02.021934 28150 raft_consensus.cc:740] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:02.453256 25679 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 4.
I20260709 12:24:02.453809 25679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51578 (request call id 508) took 1103 ms. Trace:
I20260709 12:24:02.453605 28150 consensus_queue.cc:260] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:02.153025 28199 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.468s	user 0.029s	sys 0.065s
I20260709 12:24:02.254555 28085 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:02.265656 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
W20260709 12:24:02.267566 28262 log.cc:927] Time spent T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:24:02.269578 26430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 638) took 1271 ms. Trace:
I20260709 12:24:02.234383 28211 consensus_queue.cc:237] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:02.456301 26430 rpcz_store.cc:276] 0709 12:24:00.997852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:00.998216 (+   364us) service_pool.cc:224] Handling call
0709 12:24:01.041031 (+ 42815us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:01.041431 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:01.041472 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:01.042064 (+   592us) log.cc:844] Serialized 26 byte log entry
0709 12:24:01.515129 (+473065us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:01.515169 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:01.515289 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:02.269331 (+754042us) raft_consensus.cc:1685] finished
0709 12:24:02.269360 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:02.269514 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":437,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":73,"thread_start_us":472622,"threads_started":1,"wal-append.queue_time_us":1123633}
I20260709 12:24:02.458004 28045 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:02.246990 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:02.459507 25683 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 6.
I20260709 12:24:02.459990 25683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51578 (request call id 510) took 1034 ms. Trace:
I20260709 12:24:02.460090 28045 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:02.460305 25683 rpcz_store.cc:276] 0709 12:24:01.425239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:01.425377 (+   138us) service_pool.cc:224] Handling call
0709 12:24:02.246846 (+821469us) spinlock_profiling.cc:243] Waited 48.5 ms on lock 0x7b5800003698. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d96a3cb71 00007f5d96a3ca22 00007f5d9f9558d9 00007f5d9eaafee0 00007f5d9eb790ab 00007f5d9eb79131 00007f5d9eb270a0 00007f5d9eb26984 00007f5d980a16d4 00007f5d980a1662
0709 12:24:02.459934 (+213088us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":111602560}
I20260709 12:24:02.455396 28085 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:02.288367 28214 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:02.305158 28166 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:02.317101 26436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 630) took 2323 ms. Trace:
I20260709 12:24:02.317368 28178 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:02.462126 28178 raft_consensus.cc:3060] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:02.462594 28085 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:02.317785 28204 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.319195 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:02.319501 28049 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:02.464524 28049 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:02.463639 28204 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:02.468315 28204 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:02.461858 26436 rpcz_store.cc:276] 0709 12:23:59.993808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:00.087266 (+ 93458us) service_pool.cc:224] Handling call
0709 12:24:00.168165 (+ 80899us) spinlock_profiling.cc:243] Waited 7.69 ms on lock 0x7b5800004598. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d96a3cb71 00007f5d96a3ca22 00007f5d9f9558d9 00007f5d9eaafee0 00007f5d9eb790ab 00007f5d9eb79131 00007f5d9eb3afc0 00007f5d9eb25929 00007f5d9eb253d2 00007f5d9809cbd4
0709 12:24:00.168369 (+   204us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:00.386690 (+218321us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:00.408174 (+ 21484us) log.cc:844] Serialized 14 byte log entry
0709 12:24:01.994262 (+1586088us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:01.994318 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:01.994359 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:02.316796 (+322437us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b5400604fd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:02.316864 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:02.317034 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":16075,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":6069,"raft.run_cpu_time_us":57,"raft.run_wall_time_us":56,"spinlock_wait_cycles":519200896,"thread_start_us":1585618,"threads_started":2,"wal-append.queue_time_us":1590652}
I20260709 12:24:02.470384 28049 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:02.358157 28168 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:02.398064 25801 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.105s	user 0.021s	sys 0.019s
W20260709 12:24:02.411636 25800 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.974s	user 0.066s	sys 0.065s
I20260709 12:24:02.423255 28213 consensus_queue.cc:260] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:02.454160 25679 rpcz_store.cc:276] 0709 12:24:01.350486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:01.364278 (+ 13792us) service_pool.cc:224] Handling call
0709 12:24:02.249710 (+885432us) spinlock_profiling.cc:243] Waited 50.2 ms on lock 0x7b5800003698. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d96a3cb71 00007f5d96a3ca22 00007f5d9f9558d9 00007f5d9eaafee0 00007f5d9eb790ab 00007f5d9eb79131 00007f5d9eb270a0 00007f5d9eb26984 00007f5d980a16d4 00007f5d980a1662
0709 12:24:02.453719 (+204009us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":115372288}
I20260709 12:24:02.221587 28259 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
W20260709 12:24:02.477831 25800 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.040s	user 0.066s	sys 0.065s
W20260709 12:24:02.490065 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 1.09194e+06us
I20260709 12:24:02.475893 28178 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:02.357223 28260 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:02.477676 25801 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.184s	user 0.021s	sys 0.019s
W20260709 12:24:02.488628 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:02.492190 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:02.492900 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 1.24369e+06us
I20260709 12:24:02.331810 28099 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:02.495666 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:02.496333 25800 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:02.491570 28260 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:02.500403 26430 raft_consensus.cc:1240] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:24:02.238890 28057 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:02.505198 25800 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:02.506531 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:02.510227 26436 raft_consensus.cc:2468] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 3.
I20260709 12:24:02.510639 25836 raft_consensus.cc:2468] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 4.
I20260709 12:24:02.511211 25836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41782 (request call id 546) took 1119 ms. Trace:
I20260709 12:24:02.417881 27872 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:02.515058 25759 raft_consensus.cc:1275] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:24:02.497046 28196 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:02.517836 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:02.497996 27932 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.496071 26432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 718) took 1047 ms. Trace:
I20260709 12:24:02.511529 25836 rpcz_store.cc:276] 0709 12:24:01.391872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:01.392021 (+   149us) service_pool.cc:224] Handling call
0709 12:24:02.511153 (+1119132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:02.521651 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:02.502223 27815 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:02.523582 25755 raft_consensus.cc:2468] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 6.
I20260709 12:24:02.537143 25755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48606 (request call id 578) took 1224 ms. Trace:
I20260709 12:24:02.501036 28049 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:02.506496 28085 raft_consensus.cc:2749] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:24:02.542794 25801 connection.cc:256] RPC call timeout handler was delayed by -1.0537719810004091s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2093s for a response
I20260709 12:24:02.546818 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:02.547487 25757 raft_consensus.cc:2468] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 4.
W20260709 12:24:02.547224 25801 connection.cc:256] RPC call timeout handler was delayed by -1.0438719810003931s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21040000000000003s for a response
I20260709 12:24:02.536528 25584 catalog_manager.cc:5697] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 3 to 4, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 4 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:24:02.548493 25801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:02.512006 28004 raft_consensus.cc:2749] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:24:02.533896 25754 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.006s	sys 0.016s
W20260709 12:24:02.549715 25754 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.006s	sys 0.016s
W20260709 12:24:02.516994 28131 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.022s	user 0.046s	sys 0.065s
I20260709 12:24:02.551949 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:02.528571 28213 raft_consensus.cc:3060] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:02.537529 25755 rpcz_store.cc:276] 0709 12:24:01.313251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:01.313507 (+   256us) service_pool.cc:224] Handling call
0709 12:24:02.182225 (+868718us) spinlock_profiling.cc:243] Waited 1.57 ms on lock 0x7b580013b998. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d96a3cb71 00007f5d96a3ceee 000000000036eb39 00007f5d9eab01e0 00007f5d9eb790c4 00007f5d9eb79131 00007f5d9eb270a0 00007f5d9eb26984 00007f5d980a16d4 00007f5d980a1662
0709 12:24:02.537089 (+354864us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3601536}
I20260709 12:24:02.542001 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:02.560536 25763 raft_consensus.cc:2468] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 4.
I20260709 12:24:02.530354 27956 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:02.536903 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:02.565635 25756 raft_consensus.cc:2468] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 5.
I20260709 12:24:02.554150 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:24:02.533150 28194 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.236s	user 0.014s	sys 0.034s
I20260709 12:24:02.551673 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:02.494776 28259 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:02.561609 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:02.597378 25763 raft_consensus.cc:2468] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 1.
I20260709 12:24:02.552829 26436 raft_consensus.cc:2468] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 5.
I20260709 12:24:02.562525 25800 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:02.598737 28259 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:02.592860 28263 log.cc:927] Time spent T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.444s	user 0.000s	sys 0.001s
I20260709 12:24:02.599557 25800 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:02.583410 28122 raft_consensus.cc:3060] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:02.549157 25584 catalog_manager.cc:5697] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 3 to 4, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 4 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:02.590041 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:02.550968 27815 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:02.569057 28274 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:02.569751 25801 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:02.562045 28248 consensus_queue.cc:1048] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:24:02.561506 28178 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:02.538643 26432 rpcz_store.cc:276] 0709 12:24:01.446051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:01.453604 (+  7553us) service_pool.cc:224] Handling call
0709 12:24:01.648731 (+195127us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:02.417126 (+768395us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:02.493633 (+ 76507us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:02.576646 27956 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:02.556106 28131 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.089s	user 0.047s	sys 0.065s
I20260709 12:24:02.581542 26439 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 6.
I20260709 12:24:02.632462 26439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 720) took 1185 ms. Trace:
I20260709 12:24:02.632803 26439 rpcz_store.cc:276] 0709 12:24:01.446835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:01.447077 (+   242us) service_pool.cc:224] Handling call
0709 12:24:02.632403 (+1185326us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:02.552713 28166 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.585364 27872 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:02.560578 28150 raft_consensus.cc:3060] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:02.600098 25684 raft_consensus.cc:3060] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:02.566375 25757 raft_consensus.cc:2468] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 7.
I20260709 12:24:02.544152 27932 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:02.664359 28178 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:02.676510 28178 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:02.678069 27932 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:02.601207 28184 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:02.678980 25759 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 4.
I20260709 12:24:02.679240 28178 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:02.551330 28049 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:02.683503 28049 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:02.603994 25584 catalog_manager.cc:5697] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 3 to 4, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 4 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:02.685341 25584 catalog_manager.cc:5697] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 3 to 4, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 4 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:02.686970 25584 catalog_manager.cc:5697] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 3 to 4, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 4 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:02.567971 28099 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:02.604046 25800 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
W20260709 12:24:02.689795 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 85811.4us
I20260709 12:24:02.690452 25800 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:02.691201 25800 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:02.606264 28004 raft_consensus.cc:2804] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:02.692099 28004 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:02.692454 28004 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:02.694800 25684 raft_consensus.cc:2468] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 5.
I20260709 12:24:02.696254 28151 raft_consensus.cc:2804] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:02.696677 28151 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:02.696790 25685 raft_consensus.cc:2468] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 4.
I20260709 12:24:02.697077 28151 raft_consensus.cc:3060] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:02.697299 25685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51578 (request call id 511) took 1254 ms. Trace:
I20260709 12:24:02.697640 25685 rpcz_store.cc:276] 0709 12:24:01.443370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:02.005780 (+562410us) service_pool.cc:224] Handling call
0709 12:24:02.697240 (+691460us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:02.700100 28149 raft_consensus.cc:2804] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:02.700524 28149 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:02.700898 28149 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:02.606717 28085 raft_consensus.cc:2804] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:02.695837 25684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51578 (request call id 505) took 1348 ms. Trace:
I20260709 12:24:02.704102 28085 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:02.704509 28085 raft_consensus.cc:3060] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:02.704282 25684 rpcz_store.cc:276] 0709 12:24:01.347899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:01.348028 (+   129us) service_pool.cc:224] Handling call
0709 12:24:02.265442 (+917414us) spinlock_profiling.cc:243] Waited 48.1 ms on lock 0x7b5800003698. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d96a3cb71 00007f5d96a3ca22 00007f5d9f9558d9 00007f5d9eaafee0 00007f5d9eb790ab 00007f5d9eb79131 00007f5d9eb270a0 00007f5d9eb26984 00007f5d980a16d4 00007f5d980a1662
0709 12:24:02.695672 (+430230us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b54002652d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:02.695778 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":441434624}
I20260709 12:24:02.608543 28266 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.709436 28266 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:02.612272 25762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 1991) took 1754 ms. Trace:
I20260709 12:24:02.712072 25762 rpcz_store.cc:276] 0709 12:24:00.857484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:00.857658 (+   174us) service_pool.cc:224] Handling call
0709 12:24:00.858039 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:00.858443 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:00.858481 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:00.871277 (+ 12796us) log.cc:844] Serialized 26 byte log entry
0709 12:24:01.255733 (+384456us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:01.255771 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:01.255831 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:02.611991 (+1356160us) raft_consensus.cc:1685] finished
0709 12:24:02.612019 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:02.612192 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":511,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":26796,"thread_start_us":384024,"threads_started":1,"wal-append.queue_time_us":1073733}
I20260709 12:24:02.596742 27963 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:02.626796 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 57130.8us
I20260709 12:24:02.717268 25801 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:24:02.596231 28194 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.299s	user 0.014s	sys 0.035s
I20260709 12:24:02.627832 28045 raft_consensus.cc:2749] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:02.722815 25651 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.029s	sys 0.033s
W20260709 12:24:02.723286 25651 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.029s	sys 0.033s
I20260709 12:24:02.630966 28260 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:24:02.727947 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:02.749163 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:02.752907 25726 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.052s	sys 0.142s
I20260709 12:24:02.662221 28196 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
W20260709 12:24:02.753373 25726 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.052s	sys 0.142s
I20260709 12:24:02.626747 27815 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:02.756692 26437 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.017s	sys 0.017s
W20260709 12:24:02.760421 26437 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.017s	sys 0.017s
W20260709 12:24:02.765682 25650 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.758s	user 0.021s	sys 0.054s
W20260709 12:24:02.766078 25650 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.021s	sys 0.054s
W20260709 12:24:02.772835 25649 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.757s	user 0.037s	sys 0.041s
W20260709 12:24:02.773180 25649 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.757s	user 0.037s	sys 0.041s
W20260709 12:24:02.776384 26402 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.764s	user 0.014s	sys 0.019s
W20260709 12:24:02.776746 26402 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.014s	sys 0.019s
W20260709 12:24:02.777472 26402 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:02.628382 28274 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:02.780030 25652 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.007s	sys 0.031s
W20260709 12:24:02.780423 25652 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.007s	sys 0.031s
W20260709 12:24:02.785537 25760 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.775s	user 0.035s	sys 0.040s
W20260709 12:24:02.787384 25760 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.035s	sys 0.040s
I20260709 12:24:02.788416 25650 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:24:02.790117 25760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48606 (request call id 577) took 1502 ms. Trace:
I20260709 12:24:02.792644 25760 rpcz_store.cc:276] 0709 12:24:01.287617 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:01.288214 (+   597us) service_pool.cc:224] Handling call
0709 12:24:01.288593 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:01.288843 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:02.010320 (+721477us) log.cc:844] Serialized 14 byte log entry
0709 12:24:02.789795 (+779475us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:02.789845 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:02.789886 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:02.789947 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:02.790054 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":790875,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":282,"thread_start_us":1475860,"threads_started":2}
I20260709 12:24:02.665325 28166 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:02.757632 28260 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:02.804584 25802 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.018s	sys 0.018s
I20260709 12:24:02.771809 28258 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:02.794440 28126 consensus_meta.cc:287] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 1.524s	user 0.013s	sys 0.002s
I20260709 12:24:02.776917 28155 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:02.819187 26439 raft_consensus.cc:1275] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:02.785606 28049 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:02.800303 28242 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.009s	sys 0.019s
I20260709 12:24:02.796794 28248 raft_consensus.cc:2804] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:24:02.823079 26401 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.811s	user 0.012s	sys 0.018s
W20260709 12:24:02.833372 26401 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.821s	user 0.012s	sys 0.018s
W20260709 12:24:02.833737 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 873124us
W20260709 12:24:02.826033 25833 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.009s	sys 0.023s
W20260709 12:24:02.834399 25833 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.010s	sys 0.023s
W20260709 12:24:02.804929 25802 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.019s	sys 0.018s
I20260709 12:24:02.835822 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:02.842187 26430 raft_consensus.cc:1275] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:02.843175 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:02.843593 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:02.844039 26431 raft_consensus.cc:2368] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 3. Current term is 4.
I20260709 12:24:02.844259 26433 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 5.
I20260709 12:24:02.844470 26439 raft_consensus.cc:3060] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:02.843252 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:02.844851 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:02.845618 26438 raft_consensus.cc:2468] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 3.
I20260709 12:24:02.845669 26431 raft_consensus.cc:2468] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 5.
I20260709 12:24:02.842206 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:02.847811 28204 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.848021 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:02.848734 26430 raft_consensus.cc:2393] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 5: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:02.848361 28204 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:02.850610 28204 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:02.852741 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:02.857956 26439 raft_consensus.cc:1275] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:24:02.853468 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:02.858795 26431 raft_consensus.cc:2468] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 4.
I20260709 12:24:02.859153 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:02.859829 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:02.860128 26439 raft_consensus.cc:2393] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 7: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:02.853662 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:02.799661 28124 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.855250 26402 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:02.872314 26402 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:02.855898 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:02.854508 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:02.874136 26433 raft_consensus.cc:2468] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 2.
I20260709 12:24:02.858148 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:02.867882 25835 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.015s	sys 0.027s
W20260709 12:24:02.875437 25835 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.015s	sys 0.027s
I20260709 12:24:02.875527 26430 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 4.
I20260709 12:24:02.781358 28194 consensus_queue.cc:1059] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
W20260709 12:24:02.833878 28242 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.009s	sys 0.019s
I20260709 12:24:02.809432 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:02.772293 28196 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:02.886225 26431 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 1.
I20260709 12:24:02.833313 28248 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:02.884064 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 108871us
I20260709 12:24:02.866886 28179 raft_consensus.cc:2804] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:24:02.896292 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 179097us
I20260709 12:24:02.890265 26402 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:02.894176 28035 consensus_queue.cc:1059] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:24:02.821396 28258 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:02.879551 28204 raft_consensus.cc:2804] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:02.909750 28278 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:02.911675 28259 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.833011 28155 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:02.882211 28099 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:02.890924 26432 raft_consensus.cc:1240] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:02.883754 28057 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:02.897907 28248 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:02.881914 26434 raft_consensus.cc:2468] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 5.
I20260709 12:24:02.909142 28045 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.862578 28049 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:02.924908 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:02.935408 28266 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:02.881161 28124 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:02.922142 27963 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.879467 28241 raft_consensus.cc:2749] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:02.813551 28260 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:02.945482 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 55311.4us
I20260709 12:24:02.949400 28204 raft_consensus.cc:697] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 5 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:02.970070 25684 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
mode: GRACEFUL
new_leader_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:49108
I20260709 12:24:02.893959 25754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48606 (request call id 581) took 1284 ms. Trace:
I20260709 12:24:02.965462 28152 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:02.968652 28131 raft_consensus.cc:2804] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:02.981870 26402 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:02.984673 25754 rpcz_store.cc:276] 0709 12:24:01.610094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:01.929321 (+319227us) service_pool.cc:224] Handling call
0709 12:24:01.929627 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:01.929866 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:24:02.550080 (+620214us) log.cc:844] Serialized 14 byte log entry
0709 12:24:02.893233 (+343153us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:02.893377 (+   144us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:24:02.893613 (+   236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:02.893753 (+   140us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:02.893898 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2218,"prepare.queue_time_us":210104,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":457,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":10601,"thread_start_us":961718,"threads_started":2}
I20260709 12:24:02.943619 28194 raft_consensus.cc:2804] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:02.973394 28277 raft_consensus.cc:3055] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:02.949678 28259 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:02.979374 28174 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:03.007809 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 232115us
W20260709 12:24:03.022161 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 123166us
I20260709 12:24:02.965202 28099 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:02.989144 28131 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:02.950011 28278 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:02.947574 25725 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.795s	user 0.006s	sys 0.020s
I20260709 12:24:02.975437 28045 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:02.993388 28272 log.cc:927] Time spent T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:24:03.051095 25684 raft_consensus.cc:606] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Received request to transfer leadership to TS 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:03.053686 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:03.076021 25725 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.923s	user 0.008s	sys 0.021s
I20260709 12:24:03.080737 25684 raft_consensus.cc:614] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:03.080925 25683 raft_consensus.cc:2393] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 5: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:03.077340 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:03.081674 25680 raft_consensus.cc:2393] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 5: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:03.072839 25726 leader_election.cc:400] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Vote denied by peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611) with higher term. Message: Invalid argument: T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 3. Current term is 4.
W20260709 12:24:03.082993 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 294668us
I20260709 12:24:03.083138 25726 leader_election.cc:403] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:03.052598 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:03.017637 28264 raft_consensus.cc:2804] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:03.001976 28277 raft_consensus.cc:740] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:02.991371 28194 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
W20260709 12:24:03.089828 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:02.980481 27963 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:24:03.084882 25678 raft_consensus.cc:1275] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:02.992231 28152 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:03.106695 26401 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:03.027019 28274 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:03.109375 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:03.120745 25760 raft_consensus.cc:2468] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 4.
W20260709 12:24:03.051153 28284 log.cc:927] Time spent T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 12:24:03.110677 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:03.121511 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:03.113119 25836 raft_consensus.cc:1275] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:03.123968 26401 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:03.128397 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:03.129632 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:03.131381 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:03.113104 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:03.109565 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:03.115167 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:03.115422 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:03.115011 25650 leader_election.cc:400] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 election: Vote denied by peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611) with higher term. Message: Invalid argument: T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for earlier term 3. Current term is 4.
I20260709 12:24:03.050909 28259 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:03.029335 27815 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:03.053683 28166 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:03.079618 28131 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:03.156806 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:03.159359 25831 raft_consensus.cc:1240] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:24:03.159489 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:03.160142 25832 raft_consensus.cc:2393] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 6: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:03.160631 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:03.160777 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:03.161250 25761 raft_consensus.cc:3060] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:24:03.133232 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:03.162876 25680 raft_consensus.cc:2393] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 3: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:03.163807 25650 leader_election.cc:403] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:24:03.158247 25829 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:03.113708 28296 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:03.111115 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
W20260709 12:24:03.180967 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 74936us
I20260709 12:24:03.163513 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:03.156661 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:03.183199 25757 raft_consensus.cc:2410] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:24:03.183145 25762 raft_consensus.cc:2468] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 6.
I20260709 12:24:03.167852 25837 raft_consensus.cc:2393] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 5: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:03.108042 27932 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:03.027560 28174 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:03.173467 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:03.201956 26402 connection.cc:256] RPC call timeout handler was delayed by -2.2108793789998344s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21989999999999998s for a response
I20260709 12:24:03.111896 27872 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:03.202243 25680 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 6.
I20260709 12:24:03.159021 28241 raft_consensus.cc:2804] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:03.153229 25685 raft_consensus.cc:2468] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 4.
I20260709 12:24:03.116545 28194 raft_consensus.cc:3060] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:03.117029 28205 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
W20260709 12:24:03.202425 26402 connection.cc:256] RPC call timeout handler was delayed by -2.1946793789998083s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2217s for a response
W20260709 12:24:03.204983 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 79800.6us
I20260709 12:24:03.207468 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:03.187438 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:03.220476 25680 raft_consensus.cc:2468] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 6.
I20260709 12:24:03.220570 25759 raft_consensus.cc:2468] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 5.
W20260709 12:24:03.218278 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 98408.8us
I20260709 12:24:03.102000 28285 consensus_queue.cc:1048] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.088s
I20260709 12:24:03.201901 27815 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:03.194381 28269 log.cc:927] Time spent T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.285s	user 0.001s	sys 0.001s
I20260709 12:24:03.111241 28266 consensus_queue.cc:1048] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 12:24:03.162194 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:03.217312 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:03.234324 25757 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 5.
I20260709 12:24:03.217419 25829 raft_consensus.cc:2468] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 4.
W20260709 12:24:03.221700 26402 connection.cc:256] RPC call timeout handler was delayed by -2.0741262659998938s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16710000000000003s for a response
W20260709 12:24:03.219034 28279 log.cc:927] Time spent T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.270s	user 0.001s	sys 0.001s
I20260709 12:24:03.225904 25678 raft_consensus.cc:2468] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 5.
I20260709 12:24:03.215540 28241 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:03.241221 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:03.226883 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:03.228871 25682 raft_consensus.cc:1240] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:24:03.212579 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:03.217923 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 145167us
I20260709 12:24:03.215975 27872 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:03.212028 28092 raft_consensus.cc:2804] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:03.234736 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:03.129163 28204 consensus_queue.cc:237] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:03.240593 25761 raft_consensus.cc:2468] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 4.
I20260709 12:24:03.131466 28126 consensus_queue.cc:1059] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.091s
I20260709 12:24:03.297994 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:03.297436 25726 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:03.296838 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:03.302811 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:03.304040 25685 raft_consensus.cc:2468] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 3.
W20260709 12:24:03.236023 26402 connection.cc:256] RPC call timeout handler was delayed by -1.7034890499999165s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1962s for a response
W20260709 12:24:03.306124 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:03.243120 25834 raft_consensus.cc:1240] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:03.308471 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:03.308882 28085 consensus_meta.cc:287] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.604s	user 0.008s	sys 0.003s
I20260709 12:24:03.309180 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:03.310026 26437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 722) took 1349 ms. Trace:
W20260709 12:24:03.396448 28004 consensus_meta.cc:287] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.704s	user 0.010s	sys 0.000s
W20260709 12:24:03.310693 28288 log.cc:927] Time spent T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.281s	user 0.001s	sys 0.000s
I20260709 12:24:03.396994 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:03.397687 25682 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 4.
I20260709 12:24:03.312548 28155 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:03.314435 28196 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:24:03.316074 28287 log.cc:927] Time spent T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.332s	user 0.001s	sys 0.000s
I20260709 12:24:03.192276 28296 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:03.388903 26431 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 9.
W20260709 12:24:03.389346 26402 connection.cc:256] RPC call timeout handler was delayed by -1.5228167239997674s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1655s for a response
I20260709 12:24:03.245385 28258 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:03.389400 27872 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:03.383618 28045 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:03.390452 28278 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:03.390913 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:03.450276 25685 raft_consensus.cc:2468] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 3.
W20260709 12:24:03.391587 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 94229.5us
W20260709 12:24:03.392000 28213 consensus_meta.cc:287] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.828s	user 0.009s	sys 0.002s
I20260709 12:24:03.384598 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:03.395161 28122 consensus_meta.cc:287] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.791s	user 0.004s	sys 0.004s
I20260709 12:24:03.224380 28277 consensus_queue.cc:260] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:03.398535 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:03.234831 27815 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:03.468207 25682 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 1.
I20260709 12:24:03.216207 27932 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:03.383807 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:03.396356 26437 rpcz_store.cc:276] 0709 12:24:01.960269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:01.960449 (+   180us) service_pool.cc:224] Handling call
0709 12:24:01.999521 (+ 39072us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:02.010743 (+ 11222us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:02.010773 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:02.011216 (+   443us) log.cc:844] Serialized 26 byte log entry
0709 12:24:02.760914 (+749698us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:02.922805 (+161891us) log.cc:844] Serialized 14 byte log entry
0709 12:24:02.935832 (+ 13027us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:02.935911 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:03.309841 (+373930us) raft_consensus.cc:1685] finished
0709 12:24:03.309861 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:03.309972 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21210,"prepare.queue_time_us":207707,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":29858,"raft.run_cpu_time_us":291,"raft.run_wall_time_us":6712,"thread_start_us":717022,"threads_started":2,"wal-append.queue_time_us":950441}
W20260709 12:24:03.406895 25584 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.003s	sys 0.008s
I20260709 12:24:03.307933 28099 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:03.405334 27963 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:03.302361 28264 raft_consensus.cc:697] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 4 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:03.303342 28124 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:03.421234 25683 raft_consensus.cc:2376] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 4. Re-sending same reply.
W20260709 12:24:03.493333 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 378412us
I20260709 12:24:03.493656 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:03.430171 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:03.494518 25680 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 5.
I20260709 12:24:03.495344 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:03.298153 28241 raft_consensus.cc:3060] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:03.231423 28205 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:03.446805 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 226792us
W20260709 12:24:03.444953 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 64621.9us
W20260709 12:24:03.502892 25801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:03.504252 25801 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:24:03.371537 28293 log.cc:927] Time spent T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.303s	user 0.001s	sys 0.000s
I20260709 12:24:03.503300 26401 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:03.303663 28297 raft_consensus.cc:2749] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611) with higher term. Message: Invalid argument: T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for earlier term 3. Current term is 4.
I20260709 12:24:03.461143 25835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41782 (request call id 543) took 2093 ms. Trace:
I20260709 12:24:03.396252 28085 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:03.403705 28184 raft_consensus.cc:2749] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611) with higher term. Message: Invalid argument: T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 3. Current term is 4.
I20260709 12:24:03.451890 25726 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:03.342043 28092 raft_consensus.cc:697] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 6 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:03.443701 28166 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:03.472271 25584 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.004s	sys 0.008s
I20260709 12:24:03.472064 25684 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 4.
I20260709 12:24:03.471678 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:03.475010 25682 raft_consensus.cc:1275] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:24:03.396930 28004 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:03.474073 26402 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:03.477669 28296 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:03.477968 25833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41782 (request call id 542) took 2110 ms. Trace:
I20260709 12:24:03.479539 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:03.481339 27932 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:03.481962 25677 raft_consensus.cc:1275] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:24:03.525450 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:03.525859 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:03.526986 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:03.481866 28131 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:03.475185 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:03.487094 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:03.467186 28258 raft_consensus.cc:3055] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:03.451268 28300 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:03.534169 28300 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:03.522822 28290 raft_consensus.cc:2804] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:03.500272 25680 raft_consensus.cc:2393] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 5: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:03.536736 28131 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:03.537559 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:03.538168 25680 raft_consensus.cc:2468] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 3.
I20260709 12:24:03.539114 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:03.524938 25833 rpcz_store.cc:276] 0709 12:24:01.367457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:01.369650 (+  2193us) service_pool.cc:224] Handling call
0709 12:24:01.369941 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:01.370265 (+   324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:01.370293 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:02.305927 (+935634us) spinlock_profiling.cc:243] Waited 469 ms on lock 0x7b2c00105e78. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9845aa11 00007f5d9846a372 00007f5d99b9ca01 00007f5d99b6143a 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2
0709 12:24:02.316352 (+ 10425us) log.cc:844] Serialized 26 byte log entry
0709 12:24:02.834776 (+518424us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:02.834813 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:02.834883 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:03.477641 (+642758us) raft_consensus.cc:1685] finished
0709 12:24:03.477665 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:03.477887 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":45539,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":39421,"spinlock_wait_cycles":1079803648,"thread_start_us":518008,"threads_started":1,"wal-append.queue_time_us":629051}
I20260709 12:24:03.464062 28280 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:03.540370 28280 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:03.541462 28194 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:03.507121 28255 raft_consensus.cc:3055] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:03.472481 27872 raft_consensus.cc:2804] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:24:03.509959 25800 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.015s	sys 0.013s
I20260709 12:24:03.510751 25681 raft_consensus.cc:2468] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 3.
I20260709 12:24:03.478032 27815 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:03.474676 28291 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:03.511669 26401 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:24:03.516724 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 64980.5us
W20260709 12:24:03.568210 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 56602us
I20260709 12:24:03.494278 28308 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:03.501479 28035 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:03.569639 26401 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:03.527585 25677 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 4.
I20260709 12:24:03.529130 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:03.536494 28290 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:03.542520 28280 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:03.506305 28260 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:03.543074 26434 raft_consensus.cc:2468] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 2.
I20260709 12:24:03.527962 28166 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:03.532879 28258 raft_consensus.cc:740] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:03.528067 28152 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:03.533392 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:03.546370 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:03.531613 28049 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:03.527741 28314 consensus_queue.cc:1059] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 12:24:03.530277 25650 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:03.531327 25686 raft_consensus.cc:2468] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 2.
W20260709 12:24:03.551810 28150 consensus_meta.cc:287] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.828s	user 0.003s	sys 0.007s
I20260709 12:24:03.523102 27963 raft_consensus.cc:2804] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:03.552697 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:03.520016 28277 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:03.565724 25800 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.016s	sys 0.014s
W20260709 12:24:03.510794 28289 log.cc:927] Time spent T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.212s	user 0.000s	sys 0.002s
I20260709 12:24:03.528002 28311 raft_consensus.cc:2804] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:03.568360 25726 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:03.512197 25835 rpcz_store.cc:276] 0709 12:24:01.367819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:01.367979 (+   160us) service_pool.cc:224] Handling call
0709 12:24:01.368322 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:01.368621 (+   299us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:01.368649 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:02.302399 (+933750us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b2c00105e78. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9845aa11 00007f5d9846a372 00007f5d99b9ca01 00007f5d99b6143a 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2
0709 12:24:02.302867 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 12:24:02.875895 (+573028us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:02.988962 (+113067us) log.cc:844] Serialized 14 byte log entry
0709 12:24:02.989310 (+   348us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:02.989536 (+   226us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:03.398562 (+409026us) raft_consensus.cc:1685] finished
0709 12:24:03.460888 (+ 62326us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:03.461067 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11971,"prepare.queue_time_us":288088,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":140158,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":10642,"spinlock_wait_cycles":1082341760,"thread_start_us":683417,"threads_started":2,"wal-append.queue_time_us":652664}
I20260709 12:24:03.571574 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:03.572213 28196 raft_consensus.cc:2804] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:03.573102 26401 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:03.565577 28255 raft_consensus.cc:740] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:03.565474 27872 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:03.576493 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:03.635771 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 740547us
W20260709 12:24:03.601846 28248 consensus_meta.cc:287] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.625s	user 0.006s	sys 0.004s
I20260709 12:24:03.628896 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:03.629175 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:03.615893 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:03.651590 25758 raft_consensus.cc:2468] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 4.
I20260709 12:24:03.651996 25757 raft_consensus.cc:2393] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 5: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:03.631644 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:03.616724 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:24:03.571394 28149 consensus_meta.cc:287] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.870s	user 0.009s	sys 0.003s
W20260709 12:24:03.642091 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 73824.3us
I20260709 12:24:03.654407 25726 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
W20260709 12:24:03.654505 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 81476.7us
I20260709 12:24:03.635890 25682 raft_consensus.cc:2468] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 4.
I20260709 12:24:03.568141 28174 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:03.645128 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 114952us
I20260709 12:24:03.635637 27963 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:03.596784 28151 consensus_meta.cc:287] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.899s	user 0.007s	sys 0.004s
I20260709 12:24:03.648404 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:24:03.634567 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:03.575027 28290 raft_consensus.cc:3060] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:03.650193 25684 raft_consensus.cc:2393] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 4: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:03.652829 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:03.651604 25761 raft_consensus.cc:3060] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:03.655196 26401 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:03.613636 28300 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:03.595984 28205 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:03.612476 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:03.611817 28131 raft_consensus.cc:2804] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:03.686854 28131 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:03.657619 25726 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:03.688112 28150 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:03.688632 28150 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:03.689931 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:03.690507 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:03.690712 28150 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:03.690977 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:03.691315 28285 raft_consensus.cc:2804] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:03.691552 25831 raft_consensus.cc:2468] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 3.
I20260709 12:24:03.692554 28194 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:03.691705 28285 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:03.693509 28285 raft_consensus.cc:3060] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:03.646636 28316 raft_consensus.cc:2804] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:03.690497 25832 raft_consensus.cc:3060] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:03.694659 28316 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:03.695151 28316 raft_consensus.cc:3060] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:03.695622 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:03.681000 28057 consensus_queue.cc:1048] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:24:03.699173 25834 raft_consensus.cc:1275] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:03.594949 28085 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:03.641567 28311 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:03.677435 25650 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:03.709489 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:03.644730 28196 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:03.681586 25755 raft_consensus.cc:2468] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 2.
I20260709 12:24:03.574575 28035 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:03.682171 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:03.723328 25682 raft_consensus.cc:2468] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 4.
I20260709 12:24:03.659821 28281 raft_consensus.cc:2804] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:03.724192 28281 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:03.724638 28281 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:03.656533 28248 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:03.572729 28308 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:03.681883 28301 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:03.685258 28300 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:03.684986 28255 consensus_queue.cc:260] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:03.649189 28260 raft_consensus.cc:2804] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:03.682308 28151 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:03.685943 28320 raft_consensus.cc:2804] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:03.681170 28179 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:03.570035 28291 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:03.686798 26432 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 4.
W20260709 12:24:03.597208 28168 consensus_meta.cc:287] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 1.111s	user 0.001s	sys 0.010s
I20260709 12:24:03.689034 25835 raft_consensus.cc:1240] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:24:03.650982 27872 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:03.658624 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:03.700629 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:03.763705 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:03.764310 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:03.705436 25832 raft_consensus.cc:2468] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 6.
I20260709 12:24:03.707363 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:03.764719 25683 raft_consensus.cc:2410] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:24:03.764746 25757 raft_consensus.cc:2468] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 3.
I20260709 12:24:03.765096 25759 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 8.
I20260709 12:24:03.709565 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:03.765915 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:03.765980 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:03.766278 25829 raft_consensus.cc:2468] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 5.
I20260709 12:24:03.700625 25726 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:03.727334 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:03.766582 25759 raft_consensus.cc:3060] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:03.655000 28314 consensus_queue.cc:1243] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer f82778701b464892aab92a752ed7ffdc log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:24:03.660451 28049 raft_consensus.cc:2749] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 LEADER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:03.571017 28264 consensus_queue.cc:237] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:03.683178 27963 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:03.730543 25830 raft_consensus.cc:1240] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:03.731794 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:03.776504 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:03.776726 25831 raft_consensus.cc:2393] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 6: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:03.734293 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:03.740509 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:03.745544 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:03.777667 25755 raft_consensus.cc:2393] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 6: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:03.742194 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:03.743391 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:03.739780 25650 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:03.748831 28308 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:03.750903 28035 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:03.740322 27956 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:03.597409 28092 consensus_queue.cc:237] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:03.782712 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:03.755123 25761 raft_consensus.cc:2410] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:24:03.784025 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:03.721632 28131 raft_consensus.cc:3060] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:03.725967 28196 raft_consensus.cc:3060] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:03.757682 25833 raft_consensus.cc:2368] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 4. Current term is 5.
I20260709 12:24:03.660035 28149 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:03.726179 28174 raft_consensus.cc:2804] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:03.792531 28174 raft_consensus.cc:697] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 6 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:03.793797 28149 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:03.758272 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:03.722008 28311 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:03.764894 25763 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:24:03.708632 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:03.795433 25758 raft_consensus.cc:2393] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 5: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:03.796286 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:03.797111 25758 raft_consensus.cc:2410] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 12:24:03.797796 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:03.767135 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:03.798534 25829 raft_consensus.cc:2468] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 5.
I20260709 12:24:03.799439 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:03.682454 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:03.767361 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:03.800356 25686 raft_consensus.cc:2393] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 5: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
W20260709 12:24:03.768743 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 79095.8us
I20260709 12:24:03.800660 25756 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 4.
I20260709 12:24:03.801617 25726 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:03.770128 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:03.754235 28260 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:03.770875 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:03.754187 28300 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:03.772574 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:03.771893 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:03.744372 28301 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:03.758077 28320 raft_consensus.cc:697] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 4 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:03.774746 28151 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:03.761096 28179 raft_consensus.cc:3060] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:03.778154 26438 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 1.
I20260709 12:24:03.779167 25650 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:03.743855 28152 consensus_queue.cc:1048] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:24:03.765321 28282 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:03.782111 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:03.782047 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:03.709403 28194 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:03.784487 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:03.820107 25726 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:03.820401 25755 raft_consensus.cc:2468] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 3.
I20260709 12:24:03.784025 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:03.789736 25649 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:03.790978 28308 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:03.793488 28174 consensus_queue.cc:237] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:03.763868 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:03.772266 28205 raft_consensus.cc:2804] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:03.803495 25834 raft_consensus.cc:1275] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:24:03.804144 25836 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 4.
I20260709 12:24:03.765974 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:03.825304 28282 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:03.833307 25832 raft_consensus.cc:2393] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 5: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:03.833824 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:03.834486 25830 raft_consensus.cc:2468] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 2.
I20260709 12:24:03.835177 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:03.807161 25763 raft_consensus.cc:2468] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 6.
I20260709 12:24:03.727162 28258 consensus_queue.cc:260] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:03.810282 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:03.838116 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:03.811527 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:03.821473 25761 raft_consensus.cc:2468] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 4.
I20260709 12:24:03.822213 25649 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:03.838696 25830 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:03.839052 25829 raft_consensus.cc:2410] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:24:03.839812 28297 raft_consensus.cc:2749] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:24:03.839636 28312 consensus_queue.cc:1175] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5cccf20a8bff46dba6601f241d172b8a" responder_term: 5 status { last_received { term: 2 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 4. Current term is 5. Ops: [4.6-4.6]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:24:03.839869 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:03.825325 28317 raft_consensus.cc:2804] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:03.842096 25829 raft_consensus.cc:2393] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 3: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:03.808854 28260 raft_consensus.cc:3060] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:03.844914 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:03.845765 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:03.846163 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:03.846799 25834 raft_consensus.cc:2468] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 3.
I20260709 12:24:03.846894 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:03.823626 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:03.848706 27872 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:03.860498 26433 raft_consensus.cc:2393] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 5: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:03.860623 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:03.860774 28301 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:03.862048 28248 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:03.860188 25830 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 7.
I20260709 12:24:03.865310 28320 consensus_queue.cc:237] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:03.867225 25759 raft_consensus.cc:2468] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 5.
I20260709 12:24:03.825333 28296 raft_consensus.cc:2804] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:03.830770 25726 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:03.808245 28049 raft_consensus.cc:2804] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:03.837210 25650 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:03.838253 25831 raft_consensus.cc:2393] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 5: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:03.838342 28258 raft_consensus.cc:3060] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:03.839656 25649 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:03.842041 28317 raft_consensus.cc:697] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 4 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:03.826408 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:03.829238 28194 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:03.843981 28196 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:03.829839 28308 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:03.848930 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:03.850426 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:03.850813 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:03.828820 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:03.852352 28166 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:03.852646 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:03.881135 25829 raft_consensus.cc:2368] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 5. Current term is 6.
I20260709 12:24:03.851833 28260 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:03.803948 26439 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 4.
I20260709 12:24:03.875022 28057 raft_consensus.cc:2804] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:03.823586 27932 consensus_queue.cc:1048] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:24:03.882387 28057 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:03.882853 28057 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:03.780190 28168 raft_consensus.cc:2749] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:03.857209 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:03.872458 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:03.884145 25836 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 5.
I20260709 12:24:03.870776 25649 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:03.873915 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:03.885469 25680 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 10.
I20260709 12:24:03.871572 25726 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:03.831202 28205 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:03.869426 28296 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:03.831365 28266 raft_consensus.cc:2749] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:03.854838 28311 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:03.879565 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:03.876628 25835 raft_consensus.cc:2468] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 3.
I20260709 12:24:03.881770 25760 raft_consensus.cc:1240] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:03.886757 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:03.874127 28155 raft_consensus.cc:2749] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:03.874630 28301 raft_consensus.cc:2764] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:24:03.893136 25829 raft_consensus.cc:1240] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:03.890372 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:03.910634 25831 raft_consensus.cc:2393] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 8: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:03.876358 28194 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:03.873437 28049 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:03.870776 25650 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:03.913688 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:03.913978 25650 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:03.914528 25684 raft_consensus.cc:2468] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 4.
I20260709 12:24:03.915938 25650 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:03.899034 25649 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:03.906136 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:03.918695 25726 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:03.891294 28205 raft_consensus.cc:3060] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:03.895875 28168 raft_consensus.cc:2804] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:03.889796 27932 raft_consensus.cc:2804] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:03.909718 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:03.916363 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:03.934412 25677 raft_consensus.cc:2410] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 12:24:03.934672 25650 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:03.936358 28211 raft_consensus.cc:2749] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:03.936553 28312 raft_consensus.cc:2749] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:03.936703 25649 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:03.936398 28297 raft_consensus.cc:2749] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:03.938166 28211 raft_consensus.cc:2804] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:03.938805 25649 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:03.938807 28211 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:03.939540 28211 raft_consensus.cc:3060] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:03.876358 28308 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:03.939873 28297 raft_consensus.cc:2804] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:03.834331 28285 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:03.928758 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:03.941259 25684 raft_consensus.cc:2393] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 4: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:03.919636 25726 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:03.892586 28296 raft_consensus.cc:3060] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:03.867496 28241 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:03.931782 25680 raft_consensus.cc:3060] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:03.900075 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:03.943825 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:03.946415 25828 raft_consensus.cc:1240] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:24:03.947096 25762 raft_consensus.cc:2393] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 4: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
W20260709 12:24:03.953308 25681 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51578 (request call id 502) took 2591 ms (client timeout 1801 ms). Trace:
W20260709 12:24:03.953804 25681 rpcz_store.cc:269] 0709 12:24:01.335872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:01.336797 (+   925us) service_pool.cc:224] Handling call
0709 12:24:02.318998 (+982201us) spinlock_profiling.cc:243] Waited 48.3 ms on lock 0x7b5800003698. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d96a3cb71 00007f5d96a3ca22 00007f5d9f9558d9 00007f5d9eaafee0 00007f5d9eb790ab 00007f5d9eb79131 00007f5d9eb270a0 00007f5d9eb26984 00007f5d980a16d4 00007f5d980a1662
0709 12:24:03.926628 (+1607630us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54000b13d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:03.926726 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2414323840}
I20260709 12:24:03.954712 25726 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:24:03.955286 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:03.956521 25681 raft_consensus.cc:2368] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 4. Current term is 5.
I20260709 12:24:03.955902 25726 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:03.883595 28316 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:03.918010 28049 raft_consensus.cc:3060] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:03.961628 25682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05232536e53b419682a5f24515843652"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
mode: GRACEFUL
new_leader_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:49108
I20260709 12:24:03.967279 25682 raft_consensus.cc:606] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Received request to transfer leadership to TS 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:03.967772 25682 raft_consensus.cc:614] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:24:03.962615 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:03.963227 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:03.926532 28301 raft_consensus.cc:3060] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:03.928174 28155 raft_consensus.cc:2804] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:03.969951 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:03.942054 28266 raft_consensus.cc:2804] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:03.933794 28168 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:03.974202 25757 raft_consensus.cc:1240] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:04.035367 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:04.039875 25684 raft_consensus.cc:2468] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 5.
I20260709 12:24:03.940671 28297 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:03.940963 27932 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:04.035240 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:04.035837 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:04.043937 25678 raft_consensus.cc:2393] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 5: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:04.044420 25758 raft_consensus.cc:2393] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 6: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:03.964196 28308 raft_consensus.cc:2804] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:03.965824 28184 raft_consensus.cc:2804] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:04.005167 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:04.070482 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:04.070717 25681 raft_consensus.cc:2393] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 3: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:04.071442 25684 raft_consensus.cc:2468] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 6.
I20260709 12:24:04.079391 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:04.080533 25828 raft_consensus.cc:2393] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 2: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:04.081700 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:04.083568 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:03.974376 28155 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:04.030772 28266 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:04.045912 28168 raft_consensus.cc:3060] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:04.058629 28297 raft_consensus.cc:3060] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:04.044219 28300 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:04.055586 28308 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:04.074654 28152 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:04.095644 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:04.100144 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:04.062151 28196 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:04.106678 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
W20260709 12:24:04.108104 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 152270us
I20260709 12:24:04.118852 25726 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:04.119405 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:04.058004 27932 raft_consensus.cc:3060] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:04.121919 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:04.122936 25684 raft_consensus.cc:2393] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 6: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:04.094877 28155 raft_consensus.cc:3060] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:04.097509 28266 raft_consensus.cc:3060] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:04.140542 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:04.159227 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:04.163079 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:04.166297 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:04.160997 25678 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 1.
I20260709 12:24:04.178957 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:04.180487 25801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:04.184324 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:04.185235 25832 raft_consensus.cc:2468] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 7.
I20260709 12:24:04.187513 25801 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:04.193706 25682 raft_consensus.cc:2393] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 5: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:04.195269 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:04.195942 25682 raft_consensus.cc:2468] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 5.
I20260709 12:24:04.197059 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:04.118553 28308 raft_consensus.cc:3060] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:04.197527 25679 raft_consensus.cc:2410] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:24:04.057153 28317 consensus_queue.cc:237] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:04.213788 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:04.214401 25832 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 4.
I20260709 12:24:04.193468 28249 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:04.202548 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:04.218137 25684 raft_consensus.cc:2376] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 3. Re-sending same reply.
W20260709 12:24:04.205715 28326 log.cc:927] Time spent T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.368s	user 0.000s	sys 0.001s
I20260709 12:24:04.201298 27872 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:04.141808 28152 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:04.226645 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:04.227643 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:04.230007 25758 raft_consensus.cc:1240] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:04.211135 28166 raft_consensus.cc:2804] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:04.206207 25801 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:04.232244 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:04.212826 28174 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:04.237385 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:04.275511 25758 raft_consensus.cc:2468] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 2.
I20260709 12:24:04.262730 25762 raft_consensus.cc:1240] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 4. Current term is 5. Ops: []
W20260709 12:24:04.269093 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 62978.5us
I20260709 12:24:04.269301 25682 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 10.
I20260709 12:24:04.270494 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:04.280607 25801 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:04.293135 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:04.214038 28260 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:04.238612 28323 log.cc:927] Time spent T 00000000000000000000000000000000 P 496fd6924b624e77b03ccfd15653d47b: Append to log took a long time: real 0.355s	user 0.002s	sys 0.000s
I20260709 12:24:04.335042 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:04.325621 28150 raft_consensus.cc:2749] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:04.336405 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:04.337497 28330 log.cc:927] Time spent T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.218s	user 0.000s	sys 0.000s
I20260709 12:24:04.366042 25682 raft_consensus.cc:2468] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 4.
I20260709 12:24:04.211503 28057 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:04.273247 28166 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:04.385900 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:04.326020 28151 raft_consensus.cc:2804] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:04.407338 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:04.408241 25682 raft_consensus.cc:2468] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 3.
I20260709 12:24:04.409405 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:04.328003 28311 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:04.339776 28241 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:04.225674 28249 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:04.420399 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:04.379151 28285 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:04.394732 28166 raft_consensus.cc:3060] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:04.404798 28178 raft_consensus.cc:2804] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:04.421463 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
W20260709 12:24:04.409585 28331 log.cc:927] Time spent T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.374s	user 0.001s	sys 0.000s
W20260709 12:24:04.410333 28332 log.cc:927] Time spent T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
W20260709 12:24:04.428048 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 147529us
I20260709 12:24:04.328318 28174 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:04.406970 28151 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:04.432317 25682 raft_consensus.cc:2393] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 6: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:04.436443 25801 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:04.443660 25801 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:04.445109 25801 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:04.446305 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:04.424527 28316 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:04.447142 25681 raft_consensus.cc:2376] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 5. Re-sending same reply.
I20260709 12:24:04.451139 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:04.432446 28178 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:04.436280 25650 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:04.427341 25834 raft_consensus.cc:1275] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:04.459681 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
W20260709 12:24:04.452092 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 333305us
I20260709 12:24:04.453105 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:04.456607 25801 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:04.446064 28150 raft_consensus.cc:2749] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:04.457647 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:04.462908 25681 raft_consensus.cc:2468] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 3.
I20260709 12:24:04.441154 28285 raft_consensus.cc:2804] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:04.461463 26436 raft_consensus.cc:2468] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 5.
W20260709 12:24:04.461858 25836 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.013s	sys 0.009s
W20260709 12:24:04.465569 25836 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.013s	sys 0.009s
I20260709 12:24:04.462033 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:04.441361 28151 raft_consensus.cc:3060] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:04.463403 25801 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:04.452445 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:04.463734 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:04.448908 28300 raft_consensus.cc:2749] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:04.514477 25682 raft_consensus.cc:2376] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 4. Re-sending same reply.
I20260709 12:24:04.449893 28184 raft_consensus.cc:697] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
W20260709 12:24:04.517222 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 56052.4us
I20260709 12:24:04.514302 25681 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 4.
W20260709 12:24:04.464021 28276 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.361s	user 0.010s	sys 0.017s
I20260709 12:24:04.519675 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
W20260709 12:24:04.520257 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:04.464885 28248 raft_consensus.cc:2749] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:24:04.510547 28281 consensus_meta.cc:287] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.785s	user 0.014s	sys 0.010s
I20260709 12:24:04.525012 25726 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:04.514247 28292 raft_consensus.cc:2804] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:04.459578 28178 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:04.537657 25726 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:04.532333 25829 raft_consensus.cc:2393] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 5: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:04.528462 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:04.538970 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:04.469260 28285 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:04.466496 28280 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.009s	sys 0.015s
W20260709 12:24:04.528967 28276 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.444s	user 0.011s	sys 0.018s
I20260709 12:24:04.545627 25726 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:04.534477 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
W20260709 12:24:04.518898 28296 consensus_meta.cc:287] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.553s	user 0.017s	sys 0.011s
I20260709 12:24:04.536860 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:04.546901 25685 raft_consensus.cc:2410] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:24:04.466491 28316 consensus_queue.cc:1048] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 12:24:04.547637 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:04.534099 28300 raft_consensus.cc:2749] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:04.554735 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:04.559583 25685 raft_consensus.cc:2410] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:24:04.527508 28337 consensus_queue.cc:1048] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
W20260709 12:24:04.572300 25680 consensus_meta.cc:287] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.627s	user 0.008s	sys 0.013s
I20260709 12:24:04.573418 25680 raft_consensus.cc:1275] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:24:04.548926 28333 log.cc:927] Time spent T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.332s	user 0.001s	sys 0.000s
I20260709 12:24:04.553694 28296 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:04.543756 28285 raft_consensus.cc:3060] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:04.550292 28280 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.011s	sys 0.015s
I20260709 12:24:04.596058 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:04.600590 25680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40230 (request call id 1300) took 1518 ms. Trace:
I20260709 12:24:04.553767 28343 raft_consensus.cc:2804] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:04.618616 26436 raft_consensus.cc:2393] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 6: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:04.553864 28341 raft_consensus.cc:2804] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:04.554994 28342 raft_consensus.cc:2749] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:04.619750 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 158444us
I20260709 12:24:04.601294 28260 raft_consensus.cc:2749] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:04.542016 28281 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:04.618345 25680 rpcz_store.cc:276] 0709 12:24:03.081770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:03.931234 (+849464us) service_pool.cc:224] Handling call
0709 12:24:03.931629 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:04.600321 (+668692us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:04.600533 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:04.629237 28184 consensus_queue.cc:237] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:04.630858 25686 raft_consensus.cc:2393] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 5: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:04.631464 25650 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:04.666942 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:04.632090 28057 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:04.674968 28312 raft_consensus.cc:2749] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:04.676923 28242 raft_consensus.cc:3055] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:04.677616 28242 raft_consensus.cc:740] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:04.678777 28242 consensus_queue.cc:260] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:04.680929 28242 raft_consensus.cc:3060] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:04.697090 26430 raft_consensus.cc:1240] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:04.631263 28341 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:04.628891 28343 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
W20260709 12:24:04.774536 25683 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 1926) took 1291 ms (client timeout 1548 ms). Trace:
I20260709 12:24:04.775434 25830 raft_consensus.cc:1240] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:04.776216 25830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41782 (request call id 564) took 1019 ms. Trace:
I20260709 12:24:04.776603 25830 rpcz_store.cc:276] 0709 12:24:03.756964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:03.924456 (+167492us) service_pool.cc:224] Handling call
0709 12:24:04.775007 (+850551us) spinlock_profiling.cc:243] Waited 2.28 ms on lock 0x7b5800133e98. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d96a3cb71 00007f5d96a3ca22 00007f5d9f9558d9 00007f5d9eaafee0 00007f5d9eb790ab 00007f5d9eb79131 00007f5d9eb3afc0 00007f5d9eb25929 00007f5d9eb253d2 00007f5d9809cbd4
0709 12:24:04.775238 (+   231us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:04.775955 (+   717us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:04.776159 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5236992}
W20260709 12:24:04.703109 28344 log.cc:927] Time spent T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.080s	user 0.004s	sys 0.000s
I20260709 12:24:04.795104 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:04.775058 25683 rpcz_store.cc:269] 0709 12:24:03.483159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:03.493405 (+ 10246us) service_pool.cc:224] Handling call
0709 12:24:04.774250 (+1280845us) spinlock_profiling.cc:243] Waited 270 ms on lock 0x7b54001b6cd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:04.774469 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":621526272}
I20260709 12:24:04.802213 28004 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:04.802304 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:04.803148 25681 raft_consensus.cc:2468] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 4.
W20260709 12:24:04.804340 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 258759us
I20260709 12:24:04.804556 25686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 1945) took 1289 ms. Trace:
I20260709 12:24:04.805342 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:04.720731 28249 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:04.808780 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 177413us
I20260709 12:24:04.732388 28341 raft_consensus.cc:3060] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:04.816314 25650 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:04.810325 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:04.817411 25759 raft_consensus.cc:2393] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 5: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:04.805047 25686 rpcz_store.cc:276] 0709 12:24:03.515414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:03.872156 (+356742us) service_pool.cc:224] Handling call
0709 12:24:04.804362 (+932206us) spinlock_profiling.cc:243] Waited 746 ms on lock 0x7b5400233554. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:04.804500 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1715924736}
I20260709 12:24:04.808882 25683 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
mode: GRACEFUL
new_leader_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:49108
I20260709 12:24:04.818162 25683 raft_consensus.cc:606] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 5 LEADER]: Received request to transfer leadership to TS 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:24:04.821823 28338 log.cc:927] Time spent T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.484s	user 0.001s	sys 0.000s
I20260709 12:24:04.822882 25831 raft_consensus.cc:1240] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:04.823899 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:04.825194 25831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 2398) took 1092 ms. Trace:
I20260709 12:24:04.825544 25831 rpcz_store.cc:276] 0709 12:24:03.733134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:03.911362 (+178228us) service_pool.cc:224] Handling call
0709 12:24:04.441601 (+530239us) spinlock_profiling.cc:243] Waited 1.09 ms on lock 0x7b5800133e98. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d96a3cb71 00007f5d96a3ca22 00007f5d9f9558d9 00007f5d9eaafee0 00007f5d9eb790ab 00007f5d9eb79131 00007f5d9eb3afc0 00007f5d9eb25929 00007f5d9eb253d2 00007f5d9809cbd4
0709 12:24:04.822694 (+381093us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:04.823327 (+   633us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:04.825029 (+  1702us) spinlock_profiling.cc:243] Waited 381 ms on lock 0x7b54001b1a50. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b608ad 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:04.825141 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":878484480}
W20260709 12:24:04.828384 28297 consensus_meta.cc:287] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.710s	user 0.021s	sys 0.016s
I20260709 12:24:04.828599 28255 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:04.828855 28297 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:04.830116 25678 raft_consensus.cc:2393] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 4: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
W20260709 12:24:04.831024 28131 consensus_meta.cc:287] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 1.022s	user 0.004s	sys 0.006s
W20260709 12:24:04.831492 28345 log.cc:927] Time spent T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 12:24:04.821854 25833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41782 (request call id 551) took 1131 ms. Trace:
I20260709 12:24:04.832418 28297 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:04.832516 25833 rpcz_store.cc:276] 0709 12:24:03.690158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:03.690306 (+   148us) service_pool.cc:224] Handling call
0709 12:24:04.821658 (+1131352us) spinlock_profiling.cc:243] Waited 66.3 ms on lock 0x7b54001b1a54. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:04.821800 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":152519040}
W20260709 12:24:04.834187 28155 consensus_meta.cc:287] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.641s	user 0.012s	sys 0.017s
W20260709 12:24:04.844511 26434 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36518 (request call id 656) took 1384 ms (client timeout 1669 ms). Trace:
I20260709 12:24:04.854518 25726 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
W20260709 12:24:04.872162 26434 rpcz_store.cc:269] 0709 12:24:03.460545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:03.464860 (+  4315us) service_pool.cc:224] Handling call
0709 12:24:04.844318 (+1379458us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b5400630e54. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:04.844445 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36176768}
I20260709 12:24:04.873826 28337 raft_consensus.cc:2749] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:04.873822 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:04.875470 25726 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
W20260709 12:24:04.845862 28339 log.cc:927] Time spent T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.510s	user 0.002s	sys 0.000s
I20260709 12:24:04.876971 25685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 1922) took 1432 ms. Trace:
I20260709 12:24:04.849946 28292 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:04.849493 28341 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:04.854460 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:04.839489 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:04.890715 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:04.856320 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:04.893289 25833 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 7.
I20260709 12:24:04.857107 28281 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:04.778501 28343 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:04.860371 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:04.900326 25836 raft_consensus.cc:2393] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 5: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:04.861943 25758 raft_consensus.cc:1275] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:04.861840 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:04.862732 28249 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:04.863101 25763 raft_consensus.cc:1275] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 12:24:04.863656 28205 consensus_meta.cc:287] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.915s	user 0.012s	sys 0.011s
I20260709 12:24:04.863976 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:04.864240 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:04.864527 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:04.906421 25830 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 6.
I20260709 12:24:04.904347 26437 raft_consensus.cc:2468] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 5.
I20260709 12:24:04.865065 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
W20260709 12:24:04.865361 27932 consensus_meta.cc:287] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.689s	user 0.006s	sys 0.012s
I20260709 12:24:04.866416 28285 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:04.831514 28131 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:04.914659 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:04.865355 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:04.868139 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:04.888316 28292 raft_consensus.cc:3060] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:04.871498 28266 consensus_meta.cc:287] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.672s	user 0.010s	sys 0.009s
W20260709 12:24:04.871755 28168 consensus_meta.cc:287] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.720s	user 0.006s	sys 0.002s
W20260709 12:24:04.846782 28258 consensus_meta.cc:287] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.971s	user 0.004s	sys 0.004s
W20260709 12:24:04.877956 28211 consensus_meta.cc:287] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.938s	user 0.010s	sys 0.000s
I20260709 12:24:04.878620 26434 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:04.880025 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:04.876619 28155 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:04.884657 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 69185.2us
I20260709 12:24:04.888713 25682 raft_consensus.cc:2468] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 3.
I20260709 12:24:04.889951 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:24:04.896415 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 433076us
I20260709 12:24:04.890300 25683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 1923) took 1421 ms. Trace:
I20260709 12:24:04.903357 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:04.814867 28152 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:04.906010 25762 raft_consensus.cc:2393] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 6: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:04.953293 25801 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:04.953014 25683 rpcz_store.cc:276] 0709 12:24:03.468978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.889326 (+1420348us) service_pool.cc:224] Handling call
0709 12:24:04.889723 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:04.889940 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:04.889979 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:04.890034 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:04.890075 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:04.890134 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:04.890243 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:04.954273 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:04.955480 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:04.909965 25726 leader_election.cc:400] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237) with higher term. Message: Invalid argument: T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 5. Current term is 6.
I20260709 12:24:04.942507 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:04.867545 26401 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:04.956670 25726 leader_election.cc:403] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:24:04.899741 28333 log.cc:927] Time spent T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:24:04.865065 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:04.889801 28057 consensus_queue.cc:1048] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:24:04.888222 28337 raft_consensus.cc:2749] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:04.917968 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:04.949827 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 133574us
W20260709 12:24:04.909850 28179 consensus_meta.cc:287] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 1.081s	user 0.011s	sys 0.006s
I20260709 12:24:04.956890 25763 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:04.978099 25800 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
W20260709 12:24:04.957041 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 89556.5us
I20260709 12:24:04.959481 25684 raft_consensus.cc:2410] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:24:04.965385 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:04.984350 25763 raft_consensus.cc:2468] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 8.
W20260709 12:24:04.966123 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 56304.4us
I20260709 12:24:04.910907 28205 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:04.977401 26431 raft_consensus.cc:2393] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 6: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:04.977487 25682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 1924) took 1506 ms. Trace:
I20260709 12:24:04.988365 25682 rpcz_store.cc:276] 0709 12:24:03.471511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.976703 (+1505192us) service_pool.cc:224] Handling call
0709 12:24:04.976997 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:04.977176 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:04.977200 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:04.977239 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:04.977277 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:04.977326 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:04.977434 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:04.984179 25762 raft_consensus.cc:2468] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 6.
I20260709 12:24:04.984952 25683 raft_consensus.cc:1240] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:04.985360 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:04.985942 25726 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:04.966662 28184 raft_consensus.cc:2749] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237) with higher term. Message: Invalid argument: T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 5. Current term is 6.
I20260709 12:24:04.996776 25801 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:04.998196 25801 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:05.001518 28241 consensus_queue.cc:1048] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:04.995366 28242 consensus_queue.cc:1059] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:24:05.008086 28350 raft_consensus.cc:2804] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:05.008921 28350 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:05.009459 28350 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:05.010041 28004 raft_consensus.cc:2749] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:04.949589 28266 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:05.011024 28166 consensus_meta.cc:287] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.577s	user 0.002s	sys 0.014s
I20260709 12:24:04.995641 25683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 1929) took 1511 ms. Trace:
I20260709 12:24:05.011500 28166 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:05.012099 25683 rpcz_store.cc:276] 0709 12:24:03.483965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.984501 (+1500536us) service_pool.cc:224] Handling call
0709 12:24:04.984799 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:04.995392 (+ 10593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:04.995588 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:05.013339 28131 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:05.013492 28166 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:05.013863 25754 raft_consensus.cc:1240] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 2. Current term is 3. Ops: []
W20260709 12:24:05.014739 27963 consensus_meta.cc:287] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 1.229s	user 0.008s	sys 0.008s
I20260709 12:24:05.014938 28205 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:05.015148 27963 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:05.013494 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:05.017210 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:05.018054 25683 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 9.
I20260709 12:24:05.019166 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:04.910871 28249 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:05.021373 25757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 2423) took 1252 ms. Trace:
I20260709 12:24:05.021621 28300 raft_consensus.cc:2749] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:05.022395 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:05.022956 28300 raft_consensus.cc:2749] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:05.023522 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:05.012126 28266 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:05.024104 25682 raft_consensus.cc:3060] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:05.021409 25801 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:04.958973 28211 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:05.026360 25679 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40230 (request call id 1290) took 1973 ms (client timeout 1835 ms). Trace:
W20260709 12:24:05.026821 25679 rpcz_store.cc:269] 0709 12:24:03.052728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:03.065743 (+ 13015us) service_pool.cc:224] Handling call
0709 12:24:05.026158 (+1960415us) spinlock_profiling.cc:243] Waited 914 ms on lock 0x7b54003d9ad4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:05.026291 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2102891264}
I20260709 12:24:05.029081 28291 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:04.996110 28179 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:05.030736 25680 raft_consensus.cc:1275] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:24:05.030968 28179 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:05.028651 28211 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:04.958509 28317 raft_consensus.cc:2749] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:04.988833 28255 raft_consensus.cc:2804] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:05.032354 26437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36518 (request call id 665) took 1204 ms. Trace:
I20260709 12:24:05.032517 28255 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:05.032929 28255 raft_consensus.cc:3060] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:05.033493 25801 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:05.019831 25683 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:05.009549 28337 raft_consensus.cc:2749] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:04.996332 25726 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:05.008224 28242 raft_consensus.cc:3055] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:05.026206 28300 raft_consensus.cc:2804] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:04.883572 25685 rpcz_store.cc:276] 0709 12:24:03.444655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.875066 (+1430411us) service_pool.cc:224] Handling call
0709 12:24:04.875606 (+   540us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:04.876304 (+   698us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:04.876334 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:04.876443 (+   109us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:04.876513 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:04.876639 (+   126us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:04.876856 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6728}
I20260709 12:24:05.053951 26402 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:05.037388 25835 raft_consensus.cc:1240] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:05.032742 26437 rpcz_store.cc:276] 0709 12:24:03.828250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:03.860337 (+ 32087us) service_pool.cc:224] Handling call
0709 12:24:05.032198 (+1171861us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54006b67d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:05.032299 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2398510464}
I20260709 12:24:05.021806 25757 rpcz_store.cc:276] 0709 12:24:03.769370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:03.805472 (+ 36102us) service_pool.cc:224] Handling call
0709 12:24:03.805701 (+   229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:04.041032 (+235331us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:05.021164 (+980132us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b54000a9e54. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:05.021319 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":387068672}
I20260709 12:24:05.044384 25801 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:05.055555 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:05.056301 25757 raft_consensus.cc:2393] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 6: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
W20260709 12:24:05.044749 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 44268.6us
I20260709 12:24:05.031107 25680 pending_rounds.cc:85] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc: Aborting all ops after (but not including) 4
I20260709 12:24:04.993813 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:05.057123 25680 pending_rounds.cc:107] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:24:05.057401 25680 raft_consensus.cc:2889] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:05.058174 25680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 1931) took 1573 ms. Trace:
I20260709 12:24:05.058463 25680 rpcz_store.cc:276] 0709 12:24:03.484541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:05.030154 (+1545613us) service_pool.cc:224] Handling call
0709 12:24:05.030440 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:05.057910 (+ 27470us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:05.058119 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:05.059144 26438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36518 (request call id 661) took 1239 ms. Trace:
I20260709 12:24:05.061362 28285 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:05.039050 25756 raft_consensus.cc:1240] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:05.062294 28258 consensus_queue.cc:1059] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:05.062798 26431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 731) took 1296 ms. Trace:
I20260709 12:24:05.063066 28155 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:05.063155 26431 rpcz_store.cc:276] 0709 12:24:03.766309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:03.783767 (+ 17458us) service_pool.cc:224] Handling call
0709 12:24:05.062601 (+1278834us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54006f4854. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:05.062741 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2742777600}
I20260709 12:24:05.048365 28352 raft_consensus.cc:2749] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:05.064347 26430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 723) took 1346 ms. Trace:
I20260709 12:24:05.044579 28242 raft_consensus.cc:740] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:05.064710 26430 rpcz_store.cc:276] 0709 12:24:03.718092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:03.719458 (+  1366us) service_pool.cc:224] Handling call
0709 12:24:03.730762 (+ 11304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:04.719787 (+989025us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:05.064157 (+344370us) spinlock_profiling.cc:243] Waited 955 ms on lock 0x7b5400474fd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:05.064295 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2196772736}
I20260709 12:24:05.065625 28242 consensus_queue.cc:260] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:05.066502 25760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 2409) took 1451 ms. Trace:
I20260709 12:24:05.067163 28242 raft_consensus.cc:3060] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:04.942065 27932 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:05.068841 25758 raft_consensus.cc:2393] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 4: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:05.059700 25680 raft_consensus.cc:1240] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:05.069489 27932 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:05.069617 25680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 1932) took 1584 ms. Trace:
I20260709 12:24:05.071985 27963 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:05.072582 28241 raft_consensus.cc:2749] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:05.073302 28241 consensus_queue.cc:1048] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:24:05.074302 28308 consensus_meta.cc:287] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.862s	user 0.017s	sys 0.008s
I20260709 12:24:05.074704 28308 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:05.075328 28264 consensus_queue.cc:1059] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:05.050539 28174 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:05.021796 28249 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:05.076299 28281 raft_consensus.cc:3055] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:05.076678 28281 raft_consensus.cc:740] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:05.077185 28341 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:05.077518 28281 consensus_queue.cc:260] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:05.042107 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 45872.3us
I20260709 12:24:05.066910 25760 rpcz_store.cc:276] 0709 12:24:03.614781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:03.616101 (+  1320us) service_pool.cc:224] Handling call
0709 12:24:03.629328 (+ 13227us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:03.898121 (+268793us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:05.066294 (+1168173us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b54001a5ed4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:05.066441 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":580115712}
I20260709 12:24:05.079269 25726 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:05.079717 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:05.080416 25760 raft_consensus.cc:2393] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 5: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:05.080325 25726 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:05.081398 25726 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:05.082051 28343 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:05.082866 25726 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:05.084198 28337 raft_consensus.cc:2749] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:05.084797 28337 raft_consensus.cc:3060] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:05.085151 28290 consensus_meta.cc:287] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 1.375s	user 0.004s	sys 0.014s
I20260709 12:24:05.085564 28290 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:05.085989 28296 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:24:05.086843 28151 consensus_meta.cc:287] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.563s	user 0.010s	sys 0.003s
I20260709 12:24:05.087251 28151 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:05.088361 28341 raft_consensus.cc:2749] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:05.089022 28341 raft_consensus.cc:2804] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:05.089321 28341 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:05.089748 28151 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:05.089663 28341 raft_consensus.cc:3060] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:05.090656 28301 consensus_meta.cc:287] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 1.063s	user 0.019s	sys 0.000s
I20260709 12:24:05.091100 28301 raft_consensus.cc:2749] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:05.045517 28266 raft_consensus.cc:2749] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:05.085166 25678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 1935) took 1599 ms. Trace:
I20260709 12:24:05.059494 26438 rpcz_store.cc:276] 0709 12:24:03.820012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:03.876580 (+ 56568us) service_pool.cc:224] Handling call
0709 12:24:03.876954 (+   374us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:03.877339 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:03.877368 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:03.877966 (+   598us) log.cc:844] Serialized 52 byte log entry
0709 12:24:03.966878 (+ 88912us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:03.979754 (+ 12876us) log.cc:844] Serialized 14 byte log entry
0709 12:24:03.980655 (+   901us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:03.980817 (+   162us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:04.169135 (+188318us) spinlock_profiling.cc:243] Waited 27.5 ms on lock 0x7b1800246520. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d96a743f3 00007f5d96a767c1 00007f5d96a76779 00007f5d96a76709 00007f5d96a766d1 00007f5d96a759cd 0000000000388634 0000000000388479 00007f5d96a5783a
0709 12:24:05.058830 (+889695us) raft_consensus.cc:1685] finished
0709 12:24:05.058933 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:05.059061 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17885,"prepare.queue_time_us":61745,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":3810,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":7797,"spinlock_wait_cycles":63146368,"thread_start_us":88468,"threads_started":1,"wal-append.queue_time_us":252184}
I20260709 12:24:05.092512 25678 rpcz_store.cc:276] 0709 12:24:03.485634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:05.084442 (+1598808us) service_pool.cc:224] Handling call
0709 12:24:05.084700 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:05.084846 (+   146us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:05.084870 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:05.084911 (+    41us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:05.084940 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:05.084992 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:05.085107 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:04.951295 28168 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:05.093236 25681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 1936) took 1607 ms. Trace:
I20260709 12:24:05.094002 25678 raft_consensus.cc:1240] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 2. Current term is 4. Ops: []
I20260709 12:24:05.094702 25678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 1937) took 1608 ms. Trace:
I20260709 12:24:05.094848 25683 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 7.
I20260709 12:24:05.095175 25677 raft_consensus.cc:1240] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 1. Current term is 3. Ops: []
I20260709 12:24:05.070001 25680 rpcz_store.cc:276] 0709 12:24:03.484806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:05.059238 (+1574432us) service_pool.cc:224] Handling call
0709 12:24:05.059516 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:05.069346 (+  9830us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:05.069528 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:05.095054 25678 rpcz_store.cc:276] 0709 12:24:03.486188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:05.093574 (+1607386us) service_pool.cc:224] Handling call
0709 12:24:05.093836 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:05.094446 (+   610us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:05.094640 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:05.096927 28282 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:05.097343 25761 raft_consensus.cc:3060] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:05.108457 25680 raft_consensus.cc:1240] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:05.109974 25680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 1941) took 1602 ms. Trace:
I20260709 12:24:05.110298 25680 rpcz_store.cc:276] 0709 12:24:03.507385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:05.106995 (+1599610us) service_pool.cc:224] Handling call
0709 12:24:05.108252 (+  1257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:05.108885 (+   633us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:05.109781 (+   896us) spinlock_profiling.cc:243] Waited 924 us on lock 0x7b5400263ed0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b608ad 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:05.109921 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2125568}
I20260709 12:24:05.106009 26402 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:05.098248 25754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 2015) took 1389 ms. Trace:
I20260709 12:24:05.112059 25754 rpcz_store.cc:276] 0709 12:24:03.708821 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:03.799643 (+ 90822us) service_pool.cc:224] Handling call
0709 12:24:03.799962 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:05.014295 (+1214333us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:05.098036 (+ 83741us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54001dced4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:05.098194 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2791309696}
W20260709 12:24:05.116231 26435 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36508 (request call id 661) took 1789 ms (client timeout 1569 ms). Trace:
W20260709 12:24:05.116722 26435 rpcz_store.cc:269] 0709 12:24:03.379680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:03.384344 (+  4664us) service_pool.cc:224] Handling call
0709 12:24:05.116000 (+1731656us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b5400334354. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:05.116144 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3797883264}
I20260709 12:24:05.117161 25726 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:05.118414 25680 raft_consensus.cc:1240] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 4 LEADER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:05.119115 25680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51578 (request call id 516) took 1168 ms. Trace:
I20260709 12:24:05.119408 25680 rpcz_store.cc:276] 0709 12:24:03.950771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:05.111069 (+1160298us) service_pool.cc:224] Handling call
0709 12:24:05.118242 (+  7173us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:05.118891 (+   649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:05.119048 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:05.120976 27932 raft_consensus.cc:2749] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:05.121272 25683 raft_consensus.cc:1275] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:24:05.121742 25683 pending_rounds.cc:85] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc: Aborting all ops after (but not including) 4
I20260709 12:24:05.122004 25683 pending_rounds.cc:107] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:24:05.122293 25683 raft_consensus.cc:2889] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:05.122447 25726 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:05.123499 25683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51578 (request call id 515) took 1173 ms. Trace:
I20260709 12:24:05.100637 26434 raft_consensus.cc:1275] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:05.101258 25758 raft_consensus.cc:1240] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:05.101317 28255 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:05.087646 28290 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:04.990120 25800 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:05.125746 27932 raft_consensus.cc:2749] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:24:05.126123 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 136072us
I20260709 12:24:05.127108 25800 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:05.120595 25680 raft_consensus.cc:1275] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:05.128139 28151 raft_consensus.cc:2804] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:05.128571 28151 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:05.054041 25685 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
mode: GRACEFUL
new_leader_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:49108
I20260709 12:24:05.129732 28151 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:05.129846 25685 raft_consensus.cc:606] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Received request to transfer leadership to TS 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:24:05.130404 25685 raft_consensus.cc:614] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:05.130543 25680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51578 (request call id 517) took 1177 ms. Trace:
I20260709 12:24:05.131431 27932 consensus_queue.cc:1048] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:24:05.133415 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 53812.8us
I20260709 12:24:05.127135 28255 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:05.136997 25801 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:05.137831 28249 raft_consensus.cc:2749] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:05.138012 28308 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:05.140461 25801 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:05.141244 27963 raft_consensus.cc:2749] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:05.141356 25682 raft_consensus.cc:2468] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 6.
I20260709 12:24:05.141692 25801 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:05.142231 25682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d32f766d8f384968a837db40f23c072c"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
mode: GRACEFUL
new_leader_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:49108
I20260709 12:24:05.142546 27963 raft_consensus.cc:2749] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:05.142788 25682 raft_consensus.cc:606] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 4 LEADER]: Received request to transfer leadership to TS 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:05.121529 25761 raft_consensus.cc:2468] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 4.
I20260709 12:24:05.144059 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:24:05.144047 28341 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:05.146072 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:05.146543 28341 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:05.130906 25680 rpcz_store.cc:276] 0709 12:24:03.951115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:05.120092 (+1168977us) service_pool.cc:224] Handling call
0709 12:24:05.120331 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:05.128206 (+  7875us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:05.128420 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:05.143322 25726 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:05.149269 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:05.150277 26434 raft_consensus.cc:2468] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 7.
I20260709 12:24:05.152067 28308 raft_consensus.cc:2749] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:05.152223 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:05.153347 25680 raft_consensus.cc:1240] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
W20260709 12:24:05.155046 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 98091.9us
I20260709 12:24:05.051745 28350 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:05.156702 25678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:40214 (request call id 86) took 1464 ms. Trace:
I20260709 12:24:05.157085 25678 rpcz_store.cc:276] 0709 12:24:03.692503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:05.107222 (+1414719us) service_pool.cc:224] Handling call
0709 12:24:05.156615 (+ 49393us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:05.158070 28350 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:05.159197 25834 raft_consensus.cc:1240] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:05.159654 25831 raft_consensus.cc:1240] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:05.160351 28343 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:05.160717 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:05.161109 28312 consensus_queue.cc:1059] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:05.161932 28312 raft_consensus.cc:3055] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:05.162056 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:05.162298 28312 raft_consensus.cc:740] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:05.162823 25830 raft_consensus.cc:2393] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 5: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:05.035040 28280 consensus_queue.cc:1048] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.129s
I20260709 12:24:05.163159 28312 consensus_queue.cc:260] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:05.124032 25683 rpcz_store.cc:276] 0709 12:24:03.950434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:05.108517 (+1158083us) service_pool.cc:224] Handling call
0709 12:24:05.108876 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:05.123168 (+ 14292us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:05.123424 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:05.128779 28248 raft_consensus.cc:3060] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:05.093588 25681 rpcz_store.cc:276] 0709 12:24:03.485889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:05.092465 (+1606576us) service_pool.cc:224] Handling call
0709 12:24:05.092751 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:05.092905 (+   154us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:05.092927 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:05.092966 (+    39us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:05.092994 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:05.093048 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:05.093168 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:05.128597 25800 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:05.180651 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:05.160295 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:05.165957 26401 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:24:05.164299 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 58358us
I20260709 12:24:05.177340 25801 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:05.166895 25835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41782 (request call id 565) took 1407 ms. Trace:
I20260709 12:24:05.174860 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:05.192075 26402 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:05.185264 25763 raft_consensus.cc:2393] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 3: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:05.166112 25677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40230 (request call id 1301) took 2084 ms. Trace:
W20260709 12:24:05.193630 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:05.164628 28092 raft_consensus.cc:2804] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:24:05.194300 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 65790.4us
I20260709 12:24:05.196642 25800 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:05.198836 26402 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:05.199950 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:05.197713 28092 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:05.197765 28352 raft_consensus.cc:2749] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:05.201395 28092 raft_consensus.cc:3060] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:05.201768 28291 raft_consensus.cc:2749] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:05.202569 28241 raft_consensus.cc:2804] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:05.202999 28281 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:05.203073 28241 raft_consensus.cc:697] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 4 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:05.204118 28255 raft_consensus.cc:2749] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:05.094897 28168 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:05.205274 25686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40230 (request call id 1302) took 2123 ms. Trace:
I20260709 12:24:05.166337 28297 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:05.205634 25686 rpcz_store.cc:276] 0709 12:24:03.082223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.840012 (+1757789us) service_pool.cc:224] Handling call
0709 12:24:04.840310 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:05.204185 (+363875us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:05.204214 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:05.204254 (+    40us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:05.204284 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:05.205038 (+   754us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b54000b2cd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:05.205078 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:05.205192 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":106276,"raft.queue_time_us":106770,"raft.run_cpu_time_us":67,"raft.run_wall_time_us":66,"spinlock_wait_cycles":591665024}
I20260709 12:24:05.206247 28297 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:05.195199 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:05.207135 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:05.191293 25835 rpcz_store.cc:276] 0709 12:24:03.759686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:03.934418 (+174732us) service_pool.cc:224] Handling call
0709 12:24:04.680440 (+746022us) spinlock_profiling.cc:243] Waited 6.37 ms on lock 0x7b5800133e98. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d96a3cb71 00007f5d96a3ca22 00007f5d9f9558d9 00007f5d9eaafee0 00007f5d9eb790ab 00007f5d9eb79131 00007f5d9eb3afc0 00007f5d9eb25929 00007f5d9eb253d2 00007f5d9809cbd4
0709 12:24:04.680662 (+   222us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:05.103508 (+422846us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:05.166678 (+ 63170us) spinlock_profiling.cc:243] Waited 354 ms on lock 0x7b5400118354. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:05.166842 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":829309952}
I20260709 12:24:05.207602 28337 raft_consensus.cc:2749] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:05.240087 25686 raft_consensus.cc:1275] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:24:05.235803 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:05.247449 25686 pending_rounds.cc:85] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc: Aborting all ops after (but not including) 5
I20260709 12:24:05.212277 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:05.154945 28179 raft_consensus.cc:2804] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:05.236148 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:05.207695 26430 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:24:05.215286 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:05.238518 25650 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:05.194888 25677 rpcz_store.cc:276] 0709 12:24:03.081988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:03.935213 (+853225us) service_pool.cc:224] Handling call
0709 12:24:03.935512 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:05.106541 (+1171029us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:05.165860 (+ 59319us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54002cf6d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:05.166061 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2666555264}
I20260709 12:24:05.253119 26431 raft_consensus.cc:3060] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:05.254009 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:05.248474 25686 pending_rounds.cc:107] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:24:05.238206 25683 raft_consensus.cc:3060] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:05.254980 25677 raft_consensus.cc:2393] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 6: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:05.165083 28258 raft_consensus.cc:3055] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:05.253075 25837 raft_consensus.cc:2393] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 5: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:05.236333 25800 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:05.254886 25686 raft_consensus.cc:2889] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:05.197568 27963 raft_consensus.cc:2804] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:05.272816 25800 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:24:05.239818 26402 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:05.260743 25681 raft_consensus.cc:1240] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:24:05.225493 25682 raft_consensus.cc:1240] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:05.212423 28312 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:05.053582 28300 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:05.282217 26402 leader_election.cc:400] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237) with higher term. Message: Invalid argument: T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 4. Current term is 5.
I20260709 12:24:05.261483 25683 raft_consensus.cc:1275] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:05.276675 25650 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:05.277285 25800 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:05.272073 27963 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:05.264005 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:05.253654 28179 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:05.264963 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:05.308485 25650 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:05.282569 26402 leader_election.cc:403] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:05.262913 28258 raft_consensus.cc:740] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:05.309713 25650 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:05.249790 28264 raft_consensus.cc:2749] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:05.310290 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:05.278321 26439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36518 (request call id 664) took 1450 ms. Trace:
I20260709 12:24:05.310978 25830 raft_consensus.cc:3060] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:05.281008 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 92723.1us
I20260709 12:24:05.264303 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:05.197973 28311 consensus_queue.cc:1059] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.094s
I20260709 12:24:05.208353 28297 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:05.204128 28241 consensus_queue.cc:237] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:05.280624 28249 raft_consensus.cc:2804] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:05.275838 28301 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:05.313215 26430 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 11.
I20260709 12:24:05.280303 28255 raft_consensus.cc:2804] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:05.281778 28166 raft_consensus.cc:2804] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:24:05.298557 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:05.343518 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 62664.7us
I20260709 12:24:05.311093 26439 rpcz_store.cc:276] 0709 12:24:03.827870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:03.882564 (+ 54694us) service_pool.cc:224] Handling call
0709 12:24:03.882915 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:03.888492 (+  5577us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:03.888543 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:03.898487 (+  9944us) log.cc:844] Serialized 26 byte log entry
0709 12:24:05.077394 (+1178907us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b18000c7ba0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d96a56e07 00007f5d9f8b19a9 00007f5d96a7369b 00007f5d96a7193f 00007f5d96a73c02 00007f5d996fb20b 00007f5d99700d23 00007f5d997010d1 00007f5d99b1ca0f
0709 12:24:05.259333 (+181939us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:05.259386 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:05.259458 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:05.265129 (+  5671us) raft_consensus.cc:1685] finished
0709 12:24:05.265150 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:05.278242 (+ 13092us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5111,"raft.queue_time_us":5273,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":6459,"spinlock_wait_cycles":29396224,"thread_start_us":180759,"threads_started":1,"wal-append.queue_time_us":1359823}
I20260709 12:24:05.283861 28300 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:05.312808 25726 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:05.289150 25684 raft_consensus.cc:2955] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 4 to 6, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:24:05.287740 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:05.299209 27963 raft_consensus.cc:3060] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:05.307504 28179 raft_consensus.cc:3060] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:05.329247 26431 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 5.
I20260709 12:24:05.334627 25830 raft_consensus.cc:2468] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 4.
I20260709 12:24:05.316201 28349 raft_consensus.cc:2749] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:05.340559 28372 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:05.341606 28297 consensus_queue.cc:1059] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:05.342831 25650 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:05.326879 25834 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 7.
I20260709 12:24:05.261094 28131 consensus_queue.cc:1048] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:24:05.373698 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:05.358572 28373 consensus_queue.cc:1059] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:24:05.374563 26435 raft_consensus.cc:2393] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 3: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
W20260709 12:24:05.374745 28364 log.cc:927] Time spent T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:24:05.375401 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:05.362919 28292 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:05.378190 28292 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:05.314492 28174 raft_consensus.cc:2749] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:05.349262 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:05.349511 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:24:05.323068 28049 consensus_meta.cc:287] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 1.287s	user 0.031s	sys 0.005s
I20260709 12:24:05.347762 25801 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:05.328166 28368 raft_consensus.cc:2749] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:05.287092 28355 consensus_queue.cc:1059] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:24:05.353529 26402 leader_election.cc:400] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Vote denied by peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) with higher term. Message: Invalid argument: T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 4. Current term is 5.
I20260709 12:24:05.296809 28194 consensus_queue.cc:1059] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:24:05.411823 26402 leader_election.cc:403] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:24:05.336355 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 59118.6us
I20260709 12:24:05.412703 25800 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:05.361088 28308 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:05.363793 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:24:05.415242 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 62566.9us
I20260709 12:24:05.415544 26439 raft_consensus.cc:2393] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 6: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:05.364987 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:05.344954 28168 raft_consensus.cc:2749] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:05.368633 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:05.358047 28337 raft_consensus.cc:2804] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:05.351140 28301 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:05.406522 28249 raft_consensus.cc:697] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 6 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:05.408130 28378 raft_consensus.cc:2804] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:05.358397 28255 raft_consensus.cc:697] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 7 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:05.321869 28152 raft_consensus.cc:2749] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:05.416113 25800 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:05.417094 26402 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
W20260709 12:24:05.418615 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 70906.4us
I20260709 12:24:05.405210 26438 raft_consensus.cc:2393] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 6: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:05.369338 28166 raft_consensus.cc:697] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 5 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:05.433995 28166 consensus_queue.cc:237] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:05.434481 28248 raft_consensus.cc:2749] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:05.414307 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:05.437521 25684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 1934) took 1952 ms. Trace:
I20260709 12:24:05.438011 25684 rpcz_store.cc:276] 0709 12:24:03.485372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:05.083631 (+1598259us) service_pool.cc:224] Handling call
0709 12:24:05.098719 (+ 15088us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:05.099037 (+   318us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:24:05.099358 (+   321us) log.cc:844] Serialized 14 byte log entry
0709 12:24:05.207999 (+108641us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:05.283967 (+ 75968us) spinlock_profiling.cc:243] Waited 8.86 ms on lock 0x7b2c00013008. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9845aa11 00007f5d9846a372 00007f5d99b9ca01 00007f5d99b6143a 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2
0709 12:24:05.288880 (+  4913us) log.cc:844] Serialized 572 byte log entry
0709 12:24:05.289030 (+   150us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:05.405552 (+116522us) log.cc:844] Serialized 14 byte log entry
0709 12:24:05.428496 (+ 22944us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:05.428595 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:05.437277 (+  8682us) raft_consensus.cc:1685] finished
0709 12:24:05.437304 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:05.437453 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":99219,"prepare.queue_time_us":532,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":77398,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":96,"spinlock_wait_cycles":20384000,"thread_start_us":31573,"threads_started":1,"wal-append.queue_time_us":29646}
I20260709 12:24:05.427647 26433 raft_consensus.cc:2393] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 5: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:05.434980 28249 consensus_queue.cc:237] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:05.442641 26402 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:05.444046 25800 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:05.451696 26402 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:24:05.453670 26402 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:24:05.423317 28292 raft_consensus.cc:2749] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:24:05.455842 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 158085us
I20260709 12:24:05.427038 28242 raft_consensus.cc:3060] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:05.458561 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
W20260709 12:24:05.443760 28178 consensus_meta.cc:287] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.895s	user 0.008s	sys 0.008s
I20260709 12:24:05.372035 28092 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:05.460634 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:05.464576 25763 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 7.
I20260709 12:24:05.430702 28260 raft_consensus.cc:3055] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:05.459728 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:05.461712 25726 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:05.411316 28049 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:05.467559 25760 raft_consensus.cc:2393] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 3: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:05.429563 28337 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:05.469880 28337 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:05.467607 25801 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
W20260709 12:24:05.471072 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 152401us
I20260709 12:24:05.473881 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:05.455111 28131 raft_consensus.cc:2749] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:05.468210 25726 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:24:05.473938 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 131232us
I20260709 12:24:05.426028 28308 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:05.483865 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:05.483676 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:05.484484 25678 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:05.484495 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:05.486245 25682 raft_consensus.cc:2393] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 5: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
W20260709 12:24:05.486269 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:05.487569 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:05.490334 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:05.492039 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:05.493701 25649 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:05.484746 25684 raft_consensus.cc:3060] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:05.484701 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:05.501770 25677 raft_consensus.cc:2393] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 4: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:05.476354 26434 raft_consensus.cc:2393] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 3: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:05.510020 25759 raft_consensus.cc:2368] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 6. Current term is 7.
I20260709 12:24:05.503567 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:05.511427 25677 raft_consensus.cc:2393] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 3: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:05.504098 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:05.478503 25650 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:24:05.506500 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 52914.9us
I20260709 12:24:05.512012 25683 raft_consensus.cc:2468] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 5.
I20260709 12:24:05.512440 26402 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:24:05.512888 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:05.514189 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:05.467469 28378 raft_consensus.cc:697] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 11 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:05.474785 28248 raft_consensus.cc:2804] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:24:05.527971 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:05.467298 28260 raft_consensus.cc:740] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
W20260709 12:24:05.520954 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:05.474660 28292 raft_consensus.cc:2749] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:05.523336 25678 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 11.
I20260709 12:24:05.474553 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:05.532956 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:05.534185 25684 raft_consensus.cc:2468] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 4.
I20260709 12:24:05.546543 25682 raft_consensus.cc:2393] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 5: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:05.476529 28205 raft_consensus.cc:2804] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:05.501214 28341 raft_consensus.cc:2804] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:05.478639 28178 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:24:05.520613 28291 raft_consensus.cc:2749] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:05.505955 28383 raft_consensus.cc:2749] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:05.577873 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 99450.9us
I20260709 12:24:05.585246 25650 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:05.500373 28150 consensus_queue.cc:1048] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 12:24:05.556599 28151 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:05.576131 25834 raft_consensus.cc:2468] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 5.
W20260709 12:24:05.592973 28375 log.cc:927] Time spent T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:24:05.578799 26402 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:24:05.607045 26402 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
W20260709 12:24:05.597522 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 115690us
I20260709 12:24:05.536458 28386 raft_consensus.cc:2804] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:24:05.600346 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 97329.3us
I20260709 12:24:05.500300 28377 consensus_queue.cc:1059] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.107s
I20260709 12:24:05.575129 28379 raft_consensus.cc:2764] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:24:05.571139 28384 raft_consensus.cc:2804] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:05.578336 28205 raft_consensus.cc:697] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
W20260709 12:24:05.548945 25569 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet c87d777e7d64471f988b07272bf2441c with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica f82778701b464892aab92a752ed7ffdc is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:24:05.587126 28341 raft_consensus.cc:697] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:05.593933 28373 raft_consensus.cc:2749] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:05.593706 28178 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:05.534001 28255 consensus_queue.cc:237] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:05.614009 26402 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
W20260709 12:24:05.616149 25569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 136775us
I20260709 12:24:05.622583 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:05.609027 28386 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:05.589056 28382 consensus_queue.cc:1059] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:24:05.609383 28368 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:05.595049 28277 consensus_queue.cc:1059] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:24:05.618796 28131 raft_consensus.cc:2804] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:05.638465 26402 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:05.637434 28092 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:05.641829 28092 raft_consensus.cc:2749] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:05.642542 28092 raft_consensus.cc:2804] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:05.642902 28092 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:05.643430 28092 raft_consensus.cc:3060] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:05.610916 28292 consensus_queue.cc:1059] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:24:05.629765 28386 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:05.681625 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 60695us
I20260709 12:24:05.624442 28384 raft_consensus.cc:697] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 3 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:05.622947 28389 raft_consensus.cc:2804] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:05.606364 28260 consensus_queue.cc:260] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:05.689594 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:05.690399 28389 raft_consensus.cc:697] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 5 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:05.648973 28131 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:05.678247 28391 raft_consensus.cc:2804] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:05.687583 28371 raft_consensus.cc:3055] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:24:05.720914 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 80083us
I20260709 12:24:05.725641 26402 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:05.632354 28368 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:05.729158 28383 raft_consensus.cc:2749] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:05.696983 28049 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:05.697865 28151 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:05.697326 28205 consensus_queue.cc:237] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:05.724514 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 249032us
I20260709 12:24:05.732239 26402 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
W20260709 12:24:05.732441 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 47345.4us
W20260709 12:24:05.709611 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 241462us
I20260709 12:24:05.685099 28150 consensus_queue.cc:1059] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:24:05.620121 28378 consensus_queue.cc:237] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:05.711318 28131 raft_consensus.cc:3060] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:05.728283 28260 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:05.726008 28371 raft_consensus.cc:740] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:05.710752 28391 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:05.723477 28311 consensus_queue.cc:1048] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:24:05.695746 28388 consensus_queue.cc:1048] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 12:24:05.752753 25801 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:05.766986 25829 raft_consensus.cc:1275] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:24:05.725163 28305 consensus_queue.cc:1059] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:24:05.756970 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:05.788257 25757 raft_consensus.cc:2393] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 5: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:05.757252 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:05.757601 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:05.758232 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:05.758824 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:05.759328 25758 raft_consensus.cc:1240] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:05.760453 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:05.761107 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:05.742844 28308 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:05.756319 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:05.768682 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:05.768810 25801 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:05.769006 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:05.769379 25835 raft_consensus.cc:1240] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:24:05.769567 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:05.770147 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:05.794793 25832 raft_consensus.cc:2393] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 5: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:05.794996 25837 raft_consensus.cc:2393] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 4: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:05.770308 28368 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:05.770653 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:05.771221 28376 raft_consensus.cc:2804] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:05.774106 28301 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:05.775650 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:05.777201 28174 raft_consensus.cc:3055] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:05.776891 28371 consensus_queue.cc:260] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:05.777997 28389 consensus_queue.cc:237] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:05.740511 28379 consensus_queue.cc:1048] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:24:05.781929 28179 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:05.755404 28049 consensus_queue.cc:1059] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:24:05.791828 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:05.749791 28313 raft_consensus.cc:2749] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:05.798112 25831 raft_consensus.cc:2393] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 3: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
W20260709 12:24:05.828625 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 59894.6us
I20260709 12:24:05.766309 28241 consensus_queue.cc:1059] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:24:05.830777 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:05.725068 28341 consensus_queue.cc:237] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:05.832027 26402 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:05.767753 28390 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:05.747489 28396 consensus_queue.cc:1048] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.088s
I20260709 12:24:05.867440 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:05.836652 28363 log.cc:927] Time spent T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:24:05.868369 26435 raft_consensus.cc:2410] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:24:05.837313 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:05.869323 25831 raft_consensus.cc:1275] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:05.828298 28376 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:05.870232 28376 raft_consensus.cc:3060] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:05.829928 28174 raft_consensus.cc:740] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:05.831815 28291 raft_consensus.cc:2804] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:05.767906 28391 raft_consensus.cc:3060] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:05.861485 25755 raft_consensus.cc:2410] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:24:05.864077 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:05.866734 28311 raft_consensus.cc:2749] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:05.848474 27963 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:05.885176 27963 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:05.884984 28174 consensus_queue.cc:260] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:05.886191 28174 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:05.865068 28388 consensus_queue.cc:1048] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:24:05.888150 28291 raft_consensus.cc:697] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:05.889088 28291 consensus_queue.cc:237] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:05.890445 25836 raft_consensus.cc:2368] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 7. Current term is 8.
I20260709 12:24:05.870735 25831 raft_consensus.cc:1275] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:24:05.787942 28300 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:05.873109 26402 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:05.876657 28152 raft_consensus.cc:3055] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:05.894342 28152 raft_consensus.cc:740] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:05.880336 28242 raft_consensus.cc:2749] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) with higher term. Message: Invalid argument: T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 4. Current term is 5.
I20260709 12:24:05.905773 25755 raft_consensus.cc:1240] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:05.908432 28396 consensus_queue.cc:1048] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:05.908257 28152 consensus_queue.cc:260] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:05.909586 28152 raft_consensus.cc:3060] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:05.909881 28300 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:05.896230 28379 consensus_queue.cc:1048] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:24:05.895008 28179 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:05.912266 28394 log.cc:927] Time spent T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 12:24:05.766986 28384 consensus_queue.cc:237] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:05.894635 28313 raft_consensus.cc:2749] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:05.924363 28049 raft_consensus.cc:3055] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:05.926635 28397 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:05.927186 28397 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:05.929505 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 166238us
I20260709 12:24:05.879752 28390 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:05.891510 28092 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:05.940093 25759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48606 (request call id 601) took 1079 ms. Trace:
I20260709 12:24:05.942106 25759 rpcz_store.cc:276] 0709 12:24:04.860261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.864858 (+  4597us) service_pool.cc:224] Handling call
0709 12:24:05.939889 (+1075031us) spinlock_profiling.cc:243] Waited 602 ms on lock 0x7b54001a6dd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:05.940038 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1384933120}
I20260709 12:24:05.940352 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:05.943285 26430 raft_consensus.cc:3060] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:05.944415 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:06.012576 28308 consensus_queue.cc:1059] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:06.013875 28397 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:06.026952 28131 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:06.027810 28398 log.cc:927] Time spent T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.263s	user 0.001s	sys 0.000s
W20260709 12:24:06.013306 28404 log.cc:927] Time spent T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:24:05.929037 28049 raft_consensus.cc:740] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:06.035614 26430 raft_consensus.cc:2468] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 7.
I20260709 12:24:06.013309 26435 raft_consensus.cc:2393] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 3: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:06.042039 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:06.042748 26436 raft_consensus.cc:1240] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:06.045930 26439 raft_consensus.cc:1240] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 4. Current term is 5. Ops: []
W20260709 12:24:06.034413 28312 consensus_meta.cc:287] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.750s	user 0.010s	sys 0.001s
W20260709 12:24:06.042372 28337 consensus_meta.cc:287] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.572s	user 0.011s	sys 0.000s
I20260709 12:24:06.023474 28057 raft_consensus.cc:476] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 LEADER]: Not starting pre-election -- already a leader
I20260709 12:24:06.058516 28391 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:06.082002 28281 consensus_meta.cc:287] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.878s	user 0.007s	sys 0.007s
I20260709 12:24:06.097901 28280 raft_consensus.cc:3055] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:06.098385 28280 raft_consensus.cc:740] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:06.102213 28386 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:06.103323 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:06.103892 25836 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:06.099241 28280 consensus_queue.cc:260] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:06.107362 28372 consensus_meta.cc:287] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.737s	user 0.011s	sys 0.000s
I20260709 12:24:06.107475 28280 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:06.120253 26401 leader_election.cc:400] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 election: Vote denied by peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267) with higher term. Message: Invalid argument: T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 6. Current term is 7.
I20260709 12:24:06.120653 26401 leader_election.cc:403] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:24:06.084787 26434 raft_consensus.cc:1240] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:06.086840 28248 raft_consensus.cc:697] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 8 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:06.129097 25759 raft_consensus.cc:1275] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:06.074651 28337 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:06.088153 28049 consensus_queue.cc:260] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:06.133558 28349 raft_consensus.cc:993] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc: : Instructing follower 6e673265293d4e9a937dc45150aeb1b8 to start an election
I20260709 12:24:06.133910 28049 raft_consensus.cc:3060] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:06.134595 25832 raft_consensus.cc:1240] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:06.134963 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:06.135682 26437 raft_consensus.cc:2393] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 7: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:06.130393 28281 raft_consensus.cc:2749] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267) with higher term. Message: Invalid argument: T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 6. Current term is 7.
I20260709 12:24:06.139577 28390 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:06.144579 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:06.145205 26437 raft_consensus.cc:3060] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:06.148979 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:06.141331 25836 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 6.
I20260709 12:24:06.152869 25800 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:06.155547 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:06.156169 26437 raft_consensus.cc:2468] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 8.
I20260709 12:24:06.153117 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:06.121750 28372 raft_consensus.cc:2749] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237) with higher term. Message: Invalid argument: T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 4. Current term is 5.
I20260709 12:24:06.163638 28281 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:06.170258 28281 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:06.172084 25680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40230 (request call id 1335) took 1190 ms. Trace:
I20260709 12:24:06.172540 28281 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:06.172480 25680 rpcz_store.cc:276] 0709 12:24:04.981699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:05.195675 (+213976us) service_pool.cc:224] Handling call
0709 12:24:05.196010 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:05.261787 (+ 65777us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:05.261817 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:05.262289 (+   472us) log.cc:844] Serialized 26 byte log entry
0709 12:24:05.311485 (+ 49196us) spinlock_profiling.cc:243] Waited 1.5 ms on lock 0x7b18003a2b20. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d96a422a6 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d997094bc 00007f5d96a5748b
0709 12:24:05.339366 (+ 27881us) spinlock_profiling.cc:243] Waited 1.93 ms on lock 0x7b18003a2b20. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d997094bc 00007f5d96a5748b 00007f5d9f8b19a9 00007f5d96a7369b 00007f5d96a7193f 00007f5d96a73c02 00007f5d996fb20b 00007f5d99700d23 00007f5d997010d1
0709 12:24:05.339524 (+   158us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:05.339564 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:05.339635 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:06.167544 (+827909us) spinlock_profiling.cc:243] Waited 1.75 ms on lock 0x7b18003a2b20. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d96a743f3 00007f5d96a767c1 00007f5d96a76779 00007f5d96a76709 00007f5d96a766d1 00007f5d96a759cd 0000000000388634 0000000000388479 00007f5d96a5783a
0709 12:24:06.171873 (+  4329us) raft_consensus.cc:1685] finished
0709 12:24:06.171893 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:06.172029 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75920,"raft.queue_time_us":80874,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":4834,"spinlock_wait_cycles":11908480,"thread_start_us":16356,"threads_started":1,"wal-append.queue_time_us":16665}
I20260709 12:24:06.176805 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:06.178359 28131 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349)
I20260709 12:24:06.178658 25801 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:06.179752 28092 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:06.179955 28300 raft_consensus.cc:2804] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:06.180508 28300 raft_consensus.cc:697] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 8 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:06.181337 28300 consensus_queue.cc:237] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:06.185602 25800 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:06.188948 28248 consensus_queue.cc:237] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:06.189401 28150 raft_consensus.cc:2749] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:06.191095 28376 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:06.193348 28376 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:06.194262 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:06.194576 25836 raft_consensus.cc:1240] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:24:06.194859 25759 raft_consensus.cc:3060] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:06.198474 25800 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:06.200459 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:06.232589 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:06.235301 25800 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:06.243395 25800 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:06.247376 28376 raft_consensus.cc:2749] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:06.240988 28388 consensus_queue.cc:1048] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:24:06.249445 25754 raft_consensus.cc:1240] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 LEADER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:06.228536 28401 raft_consensus.cc:2749] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:06.253281 25800 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:06.237985 28378 raft_consensus.cc:2749] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:06.241004 26432 raft_consensus.cc:1240] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:06.261708 25800 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:06.268193 28355 raft_consensus.cc:3055] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:06.268723 28355 raft_consensus.cc:740] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:06.256721 28400 raft_consensus.cc:2749] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:06.273341 25761 raft_consensus.cc:1275] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:06.274930 25756 raft_consensus.cc:1240] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:06.256938 28376 raft_consensus.cc:2749] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:06.277561 28292 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:06.269914 28350 raft_consensus.cc:3055] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:06.263041 28386 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:06.307809 28350 raft_consensus.cc:740] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:06.313205 28350 consensus_queue.cc:260] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:06.318641 25759 raft_consensus.cc:2468] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 8.
I20260709 12:24:06.261505 28391 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:06.251508 28249 consensus_queue.cc:1059] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
W20260709 12:24:06.316231 28405 log.cc:927] Time spent T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.380s	user 0.001s	sys 0.000s
I20260709 12:24:06.261327 28179 consensus_queue.cc:1059] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 12:24:06.324213 28297 raft_consensus.cc:2749] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:06.341105 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:06.341818 25757 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:06.371824 25828 raft_consensus.cc:1240] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:24:06.387929 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:06.388609 25759 raft_consensus.cc:2468] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 6.
I20260709 12:24:06.324009 28401 consensus_queue.cc:1048] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 12:24:06.336762 28373 raft_consensus.cc:2749] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:06.310842 28292 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:06.341271 28350 raft_consensus.cc:3060] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:06.393653 28406 log.cc:927] Time spent T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 12:24:06.402024 25759 raft_consensus.cc:1240] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:06.376153 28296 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:06.412765 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:06.413359 25685 raft_consensus.cc:3060] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:06.413964 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:06.414232 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:06.414565 25681 raft_consensus.cc:3060] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:06.414891 25677 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:06.416308 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:06.416666 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:06.416935 25680 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:06.417250 25683 raft_consensus.cc:3060] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:06.418619 25649 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:06.380558 25679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 1930) took 2896 ms. Trace:
I20260709 12:24:06.419608 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:06.423687 25682 raft_consensus.cc:2468] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 4.
I20260709 12:24:06.429226 25681 raft_consensus.cc:2468] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 6.
I20260709 12:24:06.430681 25681 raft_consensus.cc:1240] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:06.432034 25681 raft_consensus.cc:1275] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:24:06.434243 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 849014us
I20260709 12:24:06.442224 25757 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 8.
I20260709 12:24:06.405900 28152 raft_consensus.cc:1081] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 4 LEADER]: Signalling peer 6e673265293d4e9a937dc45150aeb1b8 to start an election
I20260709 12:24:06.455444 25680 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 6.
I20260709 12:24:06.408102 28337 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:24:06.467013 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 51154.3us
I20260709 12:24:06.470902 25683 raft_consensus.cc:2468] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 6.
I20260709 12:24:06.472437 25650 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:06.433701 28391 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:06.419358 28400 consensus_queue.cc:1059] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:24:06.484082 25650 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:06.485318 25650 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:06.487321 25650 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:06.489452 25685 raft_consensus.cc:2468] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 7.
I20260709 12:24:06.492522 28260 raft_consensus.cc:2764] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 12:24:06.506060 28414 log.cc:927] Time spent T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.178s	user 0.000s	sys 0.000s
I20260709 12:24:06.490888 28152 raft_consensus.cc:2749] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:06.419615 28296 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:06.509907 28296 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:06.475045 28301 raft_consensus.cc:2804] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:06.515339 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:06.516351 25832 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:06.494899 28349 raft_consensus.cc:2804] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:06.493536 28373 raft_consensus.cc:2749] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:06.512660 28296 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:06.518369 28301 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:06.535094 25832 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 8.
I20260709 12:24:06.536428 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:06.520877 28368 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:06.494886 28391 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:06.537225 25832 raft_consensus.cc:2468] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 6.
I20260709 12:24:06.532891 28296 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:06.542164 28418 log.cc:927] Time spent T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 12:24:06.543498 28391 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:06.543597 28296 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:06.543951 28292 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:06.534606 28301 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:06.534046 28401 raft_consensus.cc:3055] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:06.531819 28349 raft_consensus.cc:697] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 4 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:06.548208 28401 raft_consensus.cc:740] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:06.540120 28368 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:06.552165 28401 consensus_queue.cc:260] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:06.553059 28401 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:06.553956 28368 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:06.556562 28301 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:06.558732 28301 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:06.551688 28349 consensus_queue.cc:237] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:06.597416 25650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:06.602253 25650 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:06.605036 25677 raft_consensus.cc:2468] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 5.
I20260709 12:24:06.606773 25682 raft_consensus.cc:1275] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:06.423439 25679 rpcz_store.cc:276] 0709 12:24:03.484253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:05.027806 (+1543553us) service_pool.cc:224] Handling call
0709 12:24:05.028188 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:05.167001 (+138813us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:05.194435 (+ 27434us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:05.287263 (+ 92828us) log.cc:844] Serialized 26 byte log entry
0709 12:24:05.461440 (+174177us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:05.537352 (+ 75912us) log.cc:844] Serialized 14 byte log entry
0709 12:24:06.322212 (+784860us) spinlock_profiling.cc:243] Waited 3.07 ms on lock 0x7b18000b2a20. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d969eec0a 00007f5da012e219 00007f5d96a76a40 00007f5d96a714e4 00007f5d96a71455 00007f5d99b59060 00007f5d99b6b716 00007f5d99b7c287 00007f5d99b7c208
0709 12:24:06.322400 (+   188us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:06.322484 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:06.322528 (+    44us) raft_consensus.cc:1685] finished
0709 12:24:06.338425 (+ 15897us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:06.378357 (+ 39932us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":180128,"prepare.queue_time_us":50983,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":850844,"raft.run_cpu_time_us":336,"raft.run_wall_time_us":52872,"spinlock_wait_cycles":7061888,"thread_start_us":90836,"threads_started":1,"wal-append.queue_time_us":192905}
I20260709 12:24:06.608577 25677 raft_consensus.cc:1240] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:24:06.610414 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:06.612015 25685 raft_consensus.cc:2393] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 3: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:06.624845 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:06.626150 25759 raft_consensus.cc:2468] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 5.
I20260709 12:24:06.633762 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:06.636327 25726 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:24:06.644816 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:06.646159 25726 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:06.646437 25763 raft_consensus.cc:2468] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 5.
I20260709 12:24:06.648340 25837 raft_consensus.cc:1240] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:06.655808 26401 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:06.674253 25763 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d32f766d8f384968a837db40f23c072c"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:53474
I20260709 12:24:06.681392 25681 raft_consensus.cc:1240] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:24:06.675460 26401 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:06.686101 25763 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:06.682271 28004 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:06.679510 25761 raft_consensus.cc:1240] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:24:06.680486 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
W20260709 12:24:06.675868 25569 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet c87d777e7d64471f988b07272bf2441c with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica f82778701b464892aab92a752ed7ffdc is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:24:06.678383 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:06.688555 25754 raft_consensus.cc:2410] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:24:06.690778 25763 raft_consensus.cc:3060] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:06.678966 25649 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:06.700525 28280 raft_consensus.cc:2804] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:06.701177 28280 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:06.701650 28280 raft_consensus.cc:3060] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:06.702557 28282 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:06.703382 28282 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:06.709695 25759 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:06.710683 28282 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:06.712312 28004 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:06.713518 28292 consensus_queue.cc:1059] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:06.716900 28395 raft_consensus.cc:2804] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:24:06.717281 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:06.717419 28395 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:06.718060 28395 raft_consensus.cc:3060] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:06.718392 28369 raft_consensus.cc:3055] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:06.718750 28152 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:06.719987 28152 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:06.722144 28378 raft_consensus.cc:2749] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:06.723170 28387 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:06.723412 28152 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:06.724198 28131 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:06.725145 28131 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:06.723987 28387 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:06.718816 28369 raft_consensus.cc:740] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:06.703745 28349 raft_consensus.cc:2749] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:06.759378 28282 raft_consensus.cc:2804] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:06.759205 28004 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:06.760812 28369 consensus_queue.cc:260] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:06.762668 28369 raft_consensus.cc:3060] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:06.767557 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:06.768854 25758 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 4.
I20260709 12:24:06.771543 25754 raft_consensus.cc:1240] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:06.773557 28049 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:06.774631 28049 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:06.776723 28370 raft_consensus.cc:3055] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:06.777218 28370 raft_consensus.cc:740] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:06.778767 28370 consensus_queue.cc:260] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:06.782500 28371 raft_consensus.cc:3060] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:06.783660 25754 raft_consensus.cc:1275] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:24:06.784204 28131 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:06.787389 28004 consensus_queue.cc:1059] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:06.788870 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:06.789951 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:06.789876 25828 raft_consensus.cc:1240] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:06.791807 27932 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:06.792464 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:06.793634 28205 raft_consensus.cc:2764] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:24:06.793970 25761 raft_consensus.cc:1240] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:06.795624 25757 raft_consensus.cc:1275] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:24:06.796144 28282 raft_consensus.cc:697] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 8 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:06.769174 28355 consensus_queue.cc:260] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:06.739555 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 61043.9us
W20260709 12:24:06.745024 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 81901.2us
W20260709 12:24:06.811731 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 209787us
I20260709 12:24:06.824195 28311 consensus_queue.cc:1059] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:24:06.828384 25755 raft_consensus.cc:1240] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:06.828734 28049 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:06.829367 28049 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:06.829968 28049 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:06.830178 25763 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:06.832074 27932 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:06.832551 25763 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:06.823534 28370 raft_consensus.cc:3060] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:06.859166 28407 raft_consensus.cc:3055] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:06.859716 28407 raft_consensus.cc:740] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:06.861233 28407 consensus_queue.cc:260] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:06.861955 28382 consensus_queue.cc:1048] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:06.865754 28152 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:06.844560 25726 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:06.866457 28152 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:06.867257 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:06.867692 25726 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:06.868546 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:06.868861 28413 log.cc:927] Time spent T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.621s	user 0.000s	sys 0.001s
I20260709 12:24:06.869058 25726 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:06.870049 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:06.870504 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:06.870877 25828 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:06.871613 25726 leader_election.cc:400] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 election: Vote denied by peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237) with higher term. Message: Invalid argument: T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 7. Current term is 8.
I20260709 12:24:06.869222 26439 raft_consensus.cc:1275] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:24:06.872043 25836 raft_consensus.cc:1275] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:06.878073 25726 leader_election.cc:403] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 12:24:06.875691 28361 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.886s	user 0.003s	sys 0.005s
I20260709 12:24:06.875627 25831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41782 (request call id 574) took 1114 ms. Trace:
I20260709 12:24:06.859233 28311 raft_consensus.cc:3055] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:24:06.879007 28361 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.950s	user 0.004s	sys 0.005s
I20260709 12:24:06.879271 28311 raft_consensus.cc:740] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:06.879096 25831 rpcz_store.cc:276] 0709 12:24:05.761002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:05.904590 (+143588us) service_pool.cc:224] Handling call
0709 12:24:05.911452 (+  6862us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:05.924124 (+ 12672us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:05.924158 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:06.660505 (+736347us) spinlock_profiling.cc:243] Waited 910 us on lock 0x7b2c00105e78. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9845aa11 00007f5d9846a372 00007f5d99b9ca01 00007f5d99b6143a 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2
0709 12:24:06.661403 (+   898us) log.cc:844] Serialized 26 byte log entry
0709 12:24:06.810377 (+148974us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:06.815104 (+  4727us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:06.821735 (+  6631us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:06.875121 (+ 53386us) raft_consensus.cc:1685] finished
0709 12:24:06.875141 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:06.875431 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6671,"raft.queue_time_us":5869,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":5533,"spinlock_wait_cycles":2092928,"thread_start_us":137890,"threads_started":1,"wal-append.queue_time_us":211561}
I20260709 12:24:06.840276 28184 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:06.880594 28311 consensus_queue.cc:260] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:06.824255 28395 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:06.829368 28341 consensus_queue.cc:1059] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 12:24:06.817111 28297 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:06.874329 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:06.850787 28337 raft_consensus.cc:2749] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:06.875428 28373 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:06.838687 25837 raft_consensus.cc:2468] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 5.
I20260709 12:24:06.839531 27932 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:06.884066 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:06.875628 28205 raft_consensus.cc:2749] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:06.878175 26439 pending_rounds.cc:85] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89: Aborting all ops after (but not including) 5
I20260709 12:24:06.843745 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:06.862825 28407 raft_consensus.cc:3060] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:06.877605 25759 raft_consensus.cc:2468] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 7.
I20260709 12:24:06.891412 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:06.849153 28355 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:06.901986 28285 raft_consensus.cc:2749] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237) with higher term. Message: Invalid argument: T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 7. Current term is 8.
I20260709 12:24:06.901099 26439 pending_rounds.cc:107] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:24:06.902479 28266 raft_consensus.cc:2749] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:06.902422 26432 raft_consensus.cc:2393] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 6: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
W20260709 12:24:06.859231 28402 log.cc:927] Time spent T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.930s	user 0.001s	sys 0.004s
I20260709 12:24:06.899483 25833 raft_consensus.cc:2468] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 3.
I20260709 12:24:06.888469 28292 consensus_queue.cc:1059] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:24:06.903252 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:06.835644 28131 consensus_queue.cc:1175] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6e673265293d4e9a937dc45150aeb1b8" responder_term: 5 status { last_received { term: 5 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 5 index: 7 } }
I20260709 12:24:06.911056 26439 raft_consensus.cc:2889] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:06.933593 25762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48606 (request call id 614) took 1461 ms. Trace:
I20260709 12:24:06.934522 25761 raft_consensus.cc:2410] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:24:06.915292 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:06.915978 28249 raft_consensus.cc:3055] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:06.935977 28249 raft_consensus.cc:740] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
W20260709 12:24:06.936223 25800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:06.937188 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:06.917284 28392 raft_consensus.cc:3055] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:06.918275 25684 raft_consensus.cc:1240] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:24:06.938558 28392 raft_consensus.cc:740] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:06.938925 28397 raft_consensus.cc:3055] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:06.939381 28397 raft_consensus.cc:740] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:06.939754 28392 consensus_queue.cc:260] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:06.940585 28397 consensus_queue.cc:260] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:06.941413 28392 raft_consensus.cc:3060] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:06.919754 25678 raft_consensus.cc:1275] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:24:06.942190 28397 raft_consensus.cc:3060] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:06.922716 28297 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:06.934068 25762 rpcz_store.cc:276] 0709 12:24:05.472580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:05.472750 (+   170us) service_pool.cc:224] Handling call
0709 12:24:05.473112 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:05.535405 (+ 62293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:05.535435 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:05.551464 (+ 16029us) log.cc:844] Serialized 26 byte log entry
0709 12:24:05.745205 (+193741us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:05.745262 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:05.921291 (+176029us) spinlock_profiling.cc:243] Waited 61.9 ms on lock 0x7b54001dabd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:05.921359 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:06.858165 (+936806us) spinlock_profiling.cc:243] Waited 7 ms on lock 0x7b4400022b4c. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db 00007f5d99708aaf 00007f5d996fc86e 00007f5d996fbbb6 00007f5d996fb7d8 00007f5d99705221 00007f5d997051d9 00007f5d99705169
0709 12:24:06.933222 (+ 75057us) raft_consensus.cc:1685] finished
0709 12:24:06.933243 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:06.933409 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":433,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":14055,"spinlock_wait_cycles":158572160,"thread_start_us":138156,"threads_started":1,"wal-append.queue_time_us":241101}
I20260709 12:24:06.945768 28297 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:06.923593 28373 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:06.923346 28258 consensus_queue.cc:260] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:06.946756 28258 raft_consensus.cc:3060] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:06.948077 28373 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:06.881798 28184 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:06.930365 28049 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:06.839118 28282 consensus_queue.cc:237] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:06.931749 28308 raft_consensus.cc:2749] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:06.913323 28004 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:06.932878 25835 raft_consensus.cc:2468] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 5.
I20260709 12:24:06.936094 28412 raft_consensus.cc:3055] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:06.888559 28150 consensus_queue.cc:1048] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:24:06.954046 25828 raft_consensus.cc:2468] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 7.
I20260709 12:24:06.923305 28152 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:06.958248 26434 raft_consensus.cc:1275] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:24:06.952579 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 120354us
I20260709 12:24:06.963987 25726 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:06.967551 25650 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:06.948607 28387 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:06.937273 28249 consensus_queue.cc:260] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:06.971218 25684 raft_consensus.cc:1275] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:06.965116 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:06.963057 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:06.956758 28412 raft_consensus.cc:740] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:06.978395 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:06.951730 28297 consensus_queue.cc:1048] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:24:06.965021 28131 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:06.982257 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 70801.5us
I20260709 12:24:06.984954 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:06.984658 28276 consensus_queue.cc:1175] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5cccf20a8bff46dba6601f241d172b8a" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:24:06.985781 25681 raft_consensus.cc:2468] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 5.
I20260709 12:24:06.988528 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:06.990172 28311 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:06.958292 28004 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:06.996253 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:06.996876 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
W20260709 12:24:06.998019 28393 log.cc:927] Time spent T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 1.121s	user 0.000s	sys 0.003s
I20260709 12:24:06.997908 28092 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.002410 28248 raft_consensus.cc:3055] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:07.002656 28308 raft_consensus.cc:2804] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:07.016016 28248 raft_consensus.cc:740] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:07.016286 28308 raft_consensus.cc:697] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:07.017635 28308 consensus_queue.cc:237] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:24:07.017232 28248 consensus_queue.cc:260] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:06.970288 28349 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:07.005450 28280 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:06.993202 25649 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:07.013288 28092 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:07.027209 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:07.029253 25686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40230 (request call id 1336) took 1540 ms. Trace:
I20260709 12:24:07.029338 28092 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:07.030673 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:07.029784 25686 rpcz_store.cc:276] 0709 12:24:05.488998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:05.489127 (+   129us) service_pool.cc:224] Handling call
0709 12:24:05.489468 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:05.489872 (+   404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:05.489912 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:05.490420 (+   508us) log.cc:844] Serialized 26 byte log entry
0709 12:24:05.688319 (+197899us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:05.688359 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:05.688418 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:06.992799 (+1304381us) spinlock_profiling.cc:243] Waited 3.07 ms on lock 0x7b4400022b4c. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db 00007f5d99708aaf 00007f5d996fc86e 00007f5d996fbbb6 00007f5d996fb7d8 00007f5d99705221 00007f5d997051d9 00007f5d99705169
0709 12:24:07.028322 (+ 35523us) raft_consensus.cc:1685] finished
0709 12:24:07.028362 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:07.028981 (+   619us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47581,"raft.queue_time_us":773,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":13587,"spinlock_wait_cycles":7054208,"thread_start_us":98594,"threads_started":1,"wal-append.queue_time_us":239671}
W20260709 12:24:07.013823 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:07.031558 25760 raft_consensus.cc:2468] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 4.
I20260709 12:24:07.014135 25763 raft_consensus.cc:2393] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 4: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:07.015543 28004 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:07.011679 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:07.032475 25681 raft_consensus.cc:3060] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:07.024405 28131 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:07.016314 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:07.068758 26401 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:07.072485 25761 raft_consensus.cc:1240] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:07.020933 28248 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:07.073076 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 105656us
I20260709 12:24:07.033936 28387 raft_consensus.cc:2804] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:07.019891 28184 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:07.068600 25801 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:07.082139 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:07.067571 28249 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:07.088907 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:07.089629 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:07.090912 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:07.091431 25763 raft_consensus.cc:3060] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:07.086881 26439 raft_consensus.cc:2468] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 4.
I20260709 12:24:07.094974 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:07.078395 28387 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:07.078441 28395 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:07.101610 25829 raft_consensus.cc:2468] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 5.
I20260709 12:24:07.104087 28442 raft_consensus.cc:2804] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:07.104651 28442 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:07.105065 28442 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:07.109650 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:07.110649 25679 raft_consensus.cc:2393] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 3: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:07.120076 28305 consensus_queue.cc:1059] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:24:07.121229 28280 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:07.121433 28092 raft_consensus.cc:3055] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:07.121935 28092 raft_consensus.cc:740] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:07.123092 28092 consensus_queue.cc:260] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:07.124481 28092 raft_consensus.cc:3060] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:07.124511 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 142045us
I20260709 12:24:07.126040 28377 raft_consensus.cc:2804] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:07.126436 25801 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:07.126552 28377 raft_consensus.cc:697] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 6 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:07.128079 28378 consensus_queue.cc:1048] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:07.127846 28377 consensus_queue.cc:237] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:07.129751 28378 raft_consensus.cc:2804] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:07.130404 28378 raft_consensus.cc:697] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 6 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
W20260709 12:24:07.131544 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 47299.6us
I20260709 12:24:07.021096 28349 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:07.127817 25801 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:07.095830 28373 raft_consensus.cc:2804] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:07.133332 28387 raft_consensus.cc:3060] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:07.155654 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:07.162667 25758 raft_consensus.cc:3060] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:07.161247 25680 raft_consensus.cc:3060] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:07.166714 28400 raft_consensus.cc:2804] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:07.167404 28400 raft_consensus.cc:697] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 5 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:07.168503 28400 consensus_queue.cc:237] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:07.156456 28276 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:07.169649 28276 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:07.171414 25835 raft_consensus.cc:2393] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 6: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
W20260709 12:24:07.172441 28389 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.208s	user 0.000s	sys 0.015s
W20260709 12:24:07.172964 28389 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.296s	user 0.000s	sys 0.015s
I20260709 12:24:07.181746 25834 raft_consensus.cc:2468] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 4.
I20260709 12:24:07.182720 28349 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:07.183043 25834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44218 (request call id 1422) took 1426 ms. Trace:
I20260709 12:24:07.183420 25834 rpcz_store.cc:276] 0709 12:24:05.756331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:05.763344 (+  7013us) service_pool.cc:224] Handling call
0709 12:24:07.182831 (+1419487us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b5400050fd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:07.182974 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3093273344}
I20260709 12:24:07.185400 28382 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.186193 28382 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:07.188171 25726 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:07.188777 25650 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:07.189577 25726 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:07.190034 28412 consensus_queue.cc:260] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:07.191016 25726 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:07.191244 28049 raft_consensus.cc:2749] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:07.191831 28337 raft_consensus.cc:2749] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:07.192096 28049 raft_consensus.cc:2749] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:24:07.189842 28255 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.173s	user 0.005s	sys 0.017s
W20260709 12:24:07.196262 28255 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.295s	user 0.005s	sys 0.017s
I20260709 12:24:07.196782 28131 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:07.197451 26433 raft_consensus.cc:1240] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 7 LEADER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:07.191251 28412 raft_consensus.cc:3060] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:07.171780 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:07.205022 28442 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:07.147411 28297 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.221207 25758 raft_consensus.cc:2468] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 6.
I20260709 12:24:07.144356 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:07.207466 28168 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.212172 28378 consensus_queue.cc:237] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:07.213459 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 46576.8us
I20260709 12:24:07.223366 25763 raft_consensus.cc:2468] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 6.
I20260709 12:24:07.171746 28276 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:07.220249 25680 raft_consensus.cc:2468] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 5.
I20260709 12:24:07.198973 28373 raft_consensus.cc:697] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 7 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:07.227415 26401 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:07.147060 28282 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:07.231402 28297 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:07.232407 25650 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:07.232883 25833 raft_consensus.cc:1275] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:07.233547 25650 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:07.233667 28297 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:07.234258 28297 consensus_queue.cc:1048] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:07.234988 28152 raft_consensus.cc:3060] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:07.234941 28280 consensus_queue.cc:1059] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:07.229247 26401 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:07.239542 25650 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:07.244361 25650 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:07.250578 25681 raft_consensus.cc:2468] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 4.
I20260709 12:24:07.252112 28277 raft_consensus.cc:2749] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:07.257033 25650 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:07.257776 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:07.261891 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:24:07.265198 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 137509us
I20260709 12:24:07.263660 28281 raft_consensus.cc:2804] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:07.267445 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:07.269199 28260 consensus_queue.cc:1048] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:24:07.254076 28131 raft_consensus.cc:2804] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:07.269629 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:07.271806 28374 raft_consensus.cc:2804] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:07.272454 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:07.273329 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:07.260114 28349 raft_consensus.cc:2804] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:07.258553 28355 raft_consensus.cc:3060] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:07.272791 28442 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:07.266371 28382 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:07.245769 28282 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:07.237843 28168 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:07.297304 26439 raft_consensus.cc:2393] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 5: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:07.264324 28276 raft_consensus.cc:3060] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:07.289742 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:07.302380 25757 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:24:07.280577 28374 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:07.298780 25833 raft_consensus.cc:2468] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 5.
I20260709 12:24:07.270180 28280 consensus_queue.cc:1243] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer 5cccf20a8bff46dba6601f241d172b8a log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:24:07.283121 28258 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.273856 28281 raft_consensus.cc:697] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 6 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:07.286949 28349 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:07.288846 28131 raft_consensus.cc:697] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 6 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
W20260709 12:24:07.320793 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:07.321967 28373 consensus_queue.cc:237] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:07.315508 28389 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.328686 25833 raft_consensus.cc:3060] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:07.329262 25756 raft_consensus.cc:1275] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:07.329057 28389 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:07.331313 28255 raft_consensus.cc:3055] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:07.331761 28255 raft_consensus.cc:740] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:07.332717 28255 consensus_queue.cc:260] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:07.334177 28255 raft_consensus.cc:3060] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:07.334906 25800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:07.336400 28281 consensus_queue.cc:237] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:07.305265 28374 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:07.295885 26434 raft_consensus.cc:2468] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 5.
I20260709 12:24:07.342278 25584 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41240 (request call id 368) took 11120 ms. Trace:
I20260709 12:24:07.331329 28389 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:07.347321 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:07.348101 25829 raft_consensus.cc:1240] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 6 LEADER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:07.348589 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:07.350416 25835 raft_consensus.cc:1275] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:07.351720 28258 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:07.304088 26432 raft_consensus.cc:2468] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 5.
I20260709 12:24:07.353878 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:24:07.357182 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 118865us
I20260709 12:24:07.314561 28349 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:07.363034 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:07.363834 25835 raft_consensus.cc:2468] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 5.
I20260709 12:24:07.338097 28282 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:07.371065 25830 raft_consensus.cc:2468] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 4.
I20260709 12:24:07.376212 26433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 743) took 1891 ms. Trace:
I20260709 12:24:07.376801 28442 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:07.377445 28442 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:07.380230 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:07.376643 26433 rpcz_store.cc:276] 0709 12:24:05.480959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:05.481126 (+   167us) service_pool.cc:224] Handling call
0709 12:24:05.481433 (+   307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:07.197862 (+1716429us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:07.364926 (+167064us) spinlock_profiling.cc:243] Waited 1.72 s on lock 0x7b5400333954. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:07.371830 (+  6904us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3945294208}
I20260709 12:24:07.380884 25834 raft_consensus.cc:3060] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:07.385128 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:07.385730 25828 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:07.386451 28397 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.386967 28397 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:07.387588 28280 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:07.388176 28280 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:07.389001 28397 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:07.389482 28397 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.389932 28397 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:07.364573 28369 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.403937 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:07.411018 28387 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:07.360347 28297 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:07.417167 25834 raft_consensus.cc:2468] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 6.
W20260709 12:24:07.417098 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 44213.8us
W20260709 12:24:07.424978 25650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:07.426626 25650 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:07.433799 25650 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:24:07.436043 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 78204.1us
I20260709 12:24:07.436203 25833 raft_consensus.cc:1275] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:07.447031 25828 raft_consensus.cc:2468] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 6.
I20260709 12:24:07.433732 28370 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.425534 28369 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:07.451853 28305 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
W20260709 12:24:07.448576 28392 consensus_meta.cc:287] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.507s	user 0.008s	sys 0.004s
I20260709 12:24:07.456453 28277 raft_consensus.cc:2749] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:07.459412 28438 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:07.460881 26402 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:07.464833 28369 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:07.466140 28456 raft_consensus.cc:2804] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:07.474073 25837 raft_consensus.cc:2468] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 4.
I20260709 12:24:07.486195 28389 raft_consensus.cc:2749] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:07.491703 28184 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.492317 28184 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:07.494305 28184 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:07.483873 28370 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:07.496737 28168 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:07.498724 28397 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:07.499158 28438 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:07.500459 28453 log.cc:927] Time spent T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 12:24:07.502063 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:07.508827 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:07.508993 28382 consensus_queue.cc:1048] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:24:07.509472 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 52884.5us
I20260709 12:24:07.509778 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:07.509703 28400 consensus_queue.cc:1048] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:07.485313 28355 raft_consensus.cc:2749] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:07.511123 25801 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:07.457604 28297 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:07.344683 25584 rpcz_store.cc:276] 0709 12:23:56.218531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:56.218992 (+   461us) service_pool.cc:224] Handling call
0709 12:24:07.338208 (+11119216us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:03.572494 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:03.593925 (+ 21431us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:03.593960 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:24:03.593976 (+    16us) tablet.cc:662] Decoding operations
0709 12:24:03.594785 (+   809us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:03.594846 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:03.594873 (+    27us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:24:03.595446 (+   573us) tablet.cc:701] Row locks acquired
0709 12:24:03.595468 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:24:03.595611 (+   143us) write_op.cc:270] Start()
0709 12:24:03.595715 (+   104us) write_op.cc:276] Timestamp: P: 1783599843595565 usec, L: 0
0709 12:24:03.595737 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:24:03.615488 (+ 19751us) log.cc:844] Serialized 2158 byte log entry
0709 12:24:03.883458 (+267970us) spinlock_profiling.cc:243] Waited 20.7 ms on lock 0x7b1800359980. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d96a743f3 00007f5d96a767c1 00007f5d96a76779 00007f5d96a76709 00007f5d96a766d1 00007f5d96a759cd 0000000000388634 0000000000388479 00007f5d96a5783a
0709 12:24:05.051303 (+1167845us) op_driver.cc:464] REPLICATION: finished
0709 12:24:05.926838 (+875535us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b1800359980. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d96a743f3 00007f5d96a767c1 00007f5d96a76779 00007f5d96a76709 00007f5d96a766d1 00007f5d96a759cd 0000000000388634 0000000000388479 00007f5d96a5783a
0709 12:24:05.926966 (+   128us) write_op.cc:301] APPLY: starting
0709 12:24:05.927046 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:05.927231 (+   185us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:05.927253 (+    22us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:05.927947 (+   694us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:05.928152 (+   205us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:24:05.928210 (+    58us) write_op.cc:312] APPLY: finished
0709 12:24:05.928438 (+   228us) log.cc:844] Serialized 47 byte log entry
0709 12:24:06.773188 (+844750us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b4400022b4c. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db 00007f5d99708aaf 00007f5d96a570ac 00007f5d9f8b19a9 00007f5d96a7369b 00007f5d96a7193f 00007f5d96a73c02 00007f5d996fb20b
0709 12:24:06.879701 (+106513us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:06.879969 (+   268us) write_op.cc:454] Released schema lock
0709 12:24:06.880055 (+    86us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:06.880611 (+   556us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:06.880644 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":14,"spinlock_wait_cycles":41216,"child_traces":[["op",{"apply.queue_time_us":149773,"apply.run_cpu_time_us":12311,"apply.run_wall_time_us":953552,"num_ops":5,"prepare.queue_time_us":756687,"prepare.run_cpu_time_us":12830,"prepare.run_wall_time_us":87727,"raft.queue_time_us":608107,"raft.run_cpu_time_us":12749,"raft.run_wall_time_us":145058,"replication_time_us":1455410,"spinlock_wait_cycles":101507968,"thread_start_us":2185281,"threads_started":5,"wal-append.queue_time_us":1111983,"wal-append.run_cpu_time_us":48656,"wal-append.run_wall_time_us":1945043}]]}
I20260709 12:24:07.452248 28131 consensus_queue.cc:237] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:07.523837 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:07.474882 28456 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:07.532939 25758 raft_consensus.cc:2393] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 5: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:07.541922 25763 raft_consensus.cc:2393] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 3: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:07.485113 28277 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.481897 28391 consensus_queue.cc:1048] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 12:24:07.553027 28355 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.553638 28355 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:07.554248 28255 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.554806 28255 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:07.541821 28456 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:07.560917 28277 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:07.548445 25726 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:07.482030 28305 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:07.536067 28311 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
W20260709 12:24:07.566354 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 55320.8us
I20260709 12:24:07.569449 28277 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:07.572021 28397 raft_consensus.cc:2749] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:07.572160 28387 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:07.574631 28349 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:07.577375 28305 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:07.523054 28168 consensus_queue.cc:1048] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 12:24:07.578029 28311 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:07.580070 28311 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:07.581224 28297 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:07.582938 28438 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:07.583583 28152 raft_consensus.cc:2749] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:07.589164 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:07.589924 25680 raft_consensus.cc:2393] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 4: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:07.555747 28355 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:07.607370 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:07.609102 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:07.595780 28297 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.608054 25678 raft_consensus.cc:2468] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 2.
I20260709 12:24:07.594525 28369 raft_consensus.cc:3060] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:07.616364 25681 raft_consensus.cc:2410] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:24:07.622921 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 189223us
I20260709 12:24:07.625449 25650 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:24:07.636137 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:07.610924 28297 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:07.637283 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:07.637910 25761 raft_consensus.cc:2468] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 4.
I20260709 12:24:07.638387 28297 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:07.638818 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:07.639055 28349 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:07.646201 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:07.646370 28467 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:07.650095 25761 raft_consensus.cc:2468] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 2.
I20260709 12:24:07.650862 25835 raft_consensus.cc:2468] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 2.
I20260709 12:24:07.643168 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:07.650949 28467 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:07.653895 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:07.654008 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:07.644428 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:07.654742 26438 raft_consensus.cc:2410] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:24:07.655246 25830 raft_consensus.cc:3060] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:07.657390 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:07.657972 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:07.658564 25828 raft_consensus.cc:2468] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 4.
I20260709 12:24:07.659518 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:07.660231 26438 raft_consensus.cc:2468] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 5.
I20260709 12:24:07.630987 28378 consensus_queue.cc:1059] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:24:07.662212 28382 raft_consensus.cc:3055] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:07.639536 25800 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:07.663209 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:07.662611 28382 raft_consensus.cc:740] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:07.663762 26438 raft_consensus.cc:2468] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 4.
W20260709 12:24:07.641187 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 100371us
I20260709 12:24:07.622162 28372 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.641942 26439 raft_consensus.cc:1275] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:24:07.669663 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:07.625589 28281 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.676258 25757 raft_consensus.cc:2468] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 6.
I20260709 12:24:07.664350 28382 consensus_queue.cc:260] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:07.692217 26438 raft_consensus.cc:1275] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:24:07.755237 26438 pending_rounds.cc:85] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89: Aborting all ops after (but not including) 5
I20260709 12:24:07.755515 26438 pending_rounds.cc:107] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:24:07.755751 26438 raft_consensus.cc:2889] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:07.647516 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:07.728696 26436 raft_consensus.cc:1275] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:24:07.732257 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:07.733073 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:07.734836 28462 raft_consensus.cc:2804] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:07.674285 25801 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:24:07.736158 28255 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:24:07.736241 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 275423us
I20260709 12:24:07.736819 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:07.743292 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:07.744275 28442 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:07.744052 28378 consensus_queue.cc:1048] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:07.749919 28374 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:07.750996 26433 raft_consensus.cc:1275] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:24:07.752305 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:07.879154 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:07.753008 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:07.753196 28276 raft_consensus.cc:2749] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:07.753330 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:07.628464 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:07.754585 25726 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
W20260709 12:24:07.881222 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 117518us
W20260709 12:24:07.763412 28446 log.cc:927] Time spent T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.535s	user 0.000s	sys 0.004s
I20260709 12:24:07.767098 25754 raft_consensus.cc:1275] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:24:07.886849 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 118240us
I20260709 12:24:07.771184 25830 raft_consensus.cc:2468] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 4.
I20260709 12:24:07.780582 28258 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:07.788576 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:07.788698 26401 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:24:07.874732 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 203210us
I20260709 12:24:07.769274 28281 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:07.899111 25685 raft_consensus.cc:1240] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:07.876631 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:07.880271 25762 raft_consensus.cc:2468] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 2.
I20260709 12:24:07.654430 28467 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:24:07.761727 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:07.782720 28248 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:07.875037 28349 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.890802 25650 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:24:07.914532 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 248113us
I20260709 12:24:07.914764 25650 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:07.915673 25650 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:24:07.893070 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 104440us
I20260709 12:24:07.877514 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:07.784673 28462 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:07.892966 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:07.918560 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:07.908895 25680 raft_consensus.cc:1240] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:07.919251 25754 raft_consensus.cc:2468] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 5.
I20260709 12:24:07.909540 25760 raft_consensus.cc:2393] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 2: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:07.910373 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:07.883065 28168 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.677431 28372 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:07.891527 28438 raft_consensus.cc:2804] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:07.925825 28297 consensus_queue.cc:1048] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:07.922492 28276 raft_consensus.cc:2749] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:07.927408 28387 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:07.928076 28387 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:07.932325 25758 raft_consensus.cc:1240] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:07.932917 25650 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:07.900067 28397 raft_consensus.cc:2749] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:07.902841 25800 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:07.884316 28463 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.913499 25757 raft_consensus.cc:2468] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 3.
I20260709 12:24:07.933395 25649 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:07.935649 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:07.910745 28464 raft_consensus.cc:2804] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:07.936199 25726 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:07.920861 28462 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:07.937938 25681 raft_consensus.cc:1240] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:07.920444 28258 raft_consensus.cc:2804] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:07.920567 28373 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:07.930371 28249 raft_consensus.cc:2804] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:07.968498 28249 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:07.969103 28249 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:07.970742 25682 raft_consensus.cc:2468] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 6.
I20260709 12:24:07.972437 28373 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:07.973948 28412 raft_consensus.cc:2804] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:07.974684 28412 raft_consensus.cc:697] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:07.975873 28412 consensus_queue.cc:237] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:07.921651 28382 raft_consensus.cc:3060] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:07.979565 28281 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:07.934566 28442 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.980394 28442 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:07.983001 28442 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:07.931635 28277 raft_consensus.cc:2804] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:07.984136 28258 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:07.984812 28258 raft_consensus.cc:3060] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:07.985996 28387 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:07.988269 28372 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:07.984189 28277 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:07.989590 28260 raft_consensus.cc:2804] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:07.989795 28277 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:07.990154 28260 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:07.990733 28260 raft_consensus.cc:3060] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:07.953145 28168 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:07.992425 28472 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:07.993227 28472 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:07.994562 28168 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:07.995273 28168 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.956647 28282 raft_consensus.cc:2804] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:07.996901 28282 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:07.997393 28282 raft_consensus.cc:3060] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:07.964221 28461 log.cc:927] Time spent T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
I20260709 12:24:07.959504 28248 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:07.953428 28463 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:07.965236 28466 log.cc:927] Time spent T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:24:08.028513 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:08.010393 26402 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:08.048200 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:08.049121 26436 raft_consensus.cc:2393] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 5: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:08.006788 28463 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:08.037788 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:08.009181 28460 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
W20260709 12:24:08.060425 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 50096.5us
I20260709 12:24:07.934149 28349 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:08.033300 28464 raft_consensus.cc:697] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 6 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:08.028546 28472 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:08.068097 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:08.097533 26402 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:08.071165 28260 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:07.995818 28168 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:08.077080 26433 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 6.
I20260709 12:24:08.078596 28369 raft_consensus.cc:2749] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:08.079613 28249 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:08.081353 28460 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:08.081543 28308 consensus_queue.cc:1059] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:08.081377 28184 consensus_queue.cc:1059] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:08.065483 28395 raft_consensus.cc:2749] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:08.089540 28438 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:08.044209 28131 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:08.124514 28468 log.cc:927] Time spent T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 12:24:08.125905 28249 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:08.124533 28131 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:08.130586 28168 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:08.003886 28456 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:08.123543 28460 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:08.133936 28349 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:08.109457 26434 raft_consensus.cc:2410] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 12:24:08.111605 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:08.086819 28258 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:08.120597 28369 raft_consensus.cc:2804] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:08.121287 28260 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:08.121637 28281 raft_consensus.cc:2804] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:08.123497 28463 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:08.113533 28438 raft_consensus.cc:3060] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:08.147461 26402 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:24:08.149041 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 265447us
I20260709 12:24:08.168180 28472 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:08.168902 28472 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:08.171656 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:08.172700 28472 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:08.152993 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 219684us
I20260709 12:24:08.175092 25759 raft_consensus.cc:3055] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:08.175484 25759 raft_consensus.cc:740] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:08.175117 25649 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:08.176261 28260 raft_consensus.cc:2749] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:08.176441 25759 consensus_queue.cc:260] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:08.177819 25759 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:08.178076 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:08.178884 25760 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 8.
I20260709 12:24:08.135246 28456 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:08.185668 25800 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:08.150228 28369 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:08.190830 25759 raft_consensus.cc:1275] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:24:08.193602 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:08.195843 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:08.160956 28280 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:08.196549 25759 pending_rounds.cc:85] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 2
I20260709 12:24:08.204207 25759 pending_rounds.cc:107] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:24:08.204581 25759 raft_consensus.cc:2889] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:08.205178 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 92545.1us
I20260709 12:24:08.182924 28281 raft_consensus.cc:697] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 4 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
W20260709 12:24:08.208945 28475 log.cc:927] Time spent T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 12:24:08.209072 28374 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:08.182796 28463 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:08.212020 28477 consensus_queue.cc:1059] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 12:24:08.212540 28397 raft_consensus.cc:3055] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:08.212983 28397 raft_consensus.cc:740] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:08.199182 28464 consensus_queue.cc:237] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:08.213212 28477 raft_consensus.cc:3055] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:08.213826 28477 raft_consensus.cc:740] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:08.213917 28397 consensus_queue.cc:260] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:08.214748 28477 consensus_queue.cc:260] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:08.216264 28477 raft_consensus.cc:3060] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:08.217581 28373 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:08.220928 28462 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:08.221905 28092 raft_consensus.cc:2804] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:08.222501 28092 raft_consensus.cc:697] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 5 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:08.223567 28092 consensus_queue.cc:237] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:08.225195 28389 consensus_queue.cc:1059] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:08.226068 28389 consensus_queue.cc:1059] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:08.227321 28131 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:08.228096 28131 raft_consensus.cc:3055] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:08.228444 28131 raft_consensus.cc:740] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:08.229547 28131 consensus_queue.cc:260] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:08.229919 28349 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:08.230831 28349 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:08.231462 28258 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:08.232961 28349 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:08.234349 28131 raft_consensus.cc:3060] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:08.242903 25569 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet c87d777e7d64471f988b07272bf2441c with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica f82778701b464892aab92a752ed7ffdc is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:24:08.247216 28478 consensus_queue.cc:1048] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:08.212571 28463 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:08.248288 28349 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:08.248901 28349 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:08.251015 28349 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:08.251438 28463 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:08.250882 25650 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:08.195720 28369 raft_consensus.cc:3060] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:08.223271 28462 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:08.199558 28472 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:08.264194 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:08.265058 25755 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:08.199863 28260 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:08.267598 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:08.268813 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:08.207402 28249 raft_consensus.cc:2804] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:08.282377 25650 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:08.256573 28374 raft_consensus.cc:2804] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:08.266479 28280 raft_consensus.cc:3055] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:08.299764 28280 raft_consensus.cc:740] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:08.300910 28280 consensus_queue.cc:260] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:08.286235 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:08.302963 25754 raft_consensus.cc:2410] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:24:08.289527 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:08.304271 25835 raft_consensus.cc:2468] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 5.
I20260709 12:24:08.207185 28277 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:08.307301 28277 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:08.285945 28349 raft_consensus.cc:2804] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:08.289543 28282 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:08.292737 25837 raft_consensus.cc:1240] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:08.292629 28260 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:08.263183 28463 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:08.293694 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:08.323685 25760 raft_consensus.cc:2393] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 10: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:08.308804 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:08.325433 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:08.285566 25650 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:08.276592 28249 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:08.290264 28370 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:08.290303 28374 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:08.333902 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:08.348146 25837 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 10.
I20260709 12:24:08.322299 25835 raft_consensus.cc:1275] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:24:08.336262 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 50830.6us
I20260709 12:24:08.350180 25650 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:08.343757 28249 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:08.352629 28281 consensus_queue.cc:237] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:08.353864 28282 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:08.354662 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:08.347642 25836 raft_consensus.cc:1275] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:24:08.356051 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:08.320408 28349 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:08.359148 25830 raft_consensus.cc:2410] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:24:08.289897 28472 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:08.362567 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:08.356808 25757 raft_consensus.cc:2393] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 7: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:08.358049 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:08.365906 25760 raft_consensus.cc:3060] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:08.364913 25754 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 6.
I20260709 12:24:08.361968 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:08.344311 28277 raft_consensus.cc:2749] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:08.356761 28374 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:08.374311 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:08.375039 25830 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:08.373628 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 292643us
I20260709 12:24:08.358151 28258 raft_consensus.cc:2804] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:08.362061 28349 raft_consensus.cc:3060] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:08.379123 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:08.384156 25836 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:08.385015 25755 raft_consensus.cc:2410] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:08.381500 28282 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:08.388289 28282 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:08.388927 28258 raft_consensus.cc:697] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 4 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:08.389982 28258 consensus_queue.cc:237] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:08.390556 28282 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:08.381997 28463 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:08.382579 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:08.398028 25828 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 7.
I20260709 12:24:08.383375 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:08.398512 25836 raft_consensus.cc:2468] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 6.
I20260709 12:24:08.393561 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:08.399289 25759 raft_consensus.cc:3060] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:08.394034 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:08.405361 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 167364us
I20260709 12:24:08.406296 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:08.404377 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 197268us
W20260709 12:24:08.412402 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 174375us
I20260709 12:24:08.416797 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:08.417416 25754 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:24:08.434037 25830 raft_consensus.cc:2468] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 6.
I20260709 12:24:08.436769 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:08.442530 28260 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:08.443468 28479 log.cc:927] Time spent T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:24:08.444288 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:08.480458 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:08.481389 25833 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:08.458300 25759 raft_consensus.cc:2468] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 6.
I20260709 12:24:08.483742 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:08.484558 25759 raft_consensus.cc:2468] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 3.
I20260709 12:24:08.482560 25650 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:08.488945 25650 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:24:08.494585 26402 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:08.496825 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:08.404811 28184 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:08.498497 28355 consensus_queue.cc:1059] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:08.498703 28184 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:08.501830 28184 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:08.499596 28463 raft_consensus.cc:2804] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:08.506381 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:08.526850 25836 raft_consensus.cc:2468] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 7.
W20260709 12:24:08.527515 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:08.504081 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 59214.8us
I20260709 12:24:08.531814 25830 raft_consensus.cc:1240] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:08.533073 25686 raft_consensus.cc:2368] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 5. Current term is 6.
I20260709 12:24:08.534171 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:08.534544 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 45675.7us
I20260709 12:24:08.535620 25650 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:24:08.481640 28473 log.cc:927] Time spent T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:24:08.535055 25829 raft_consensus.cc:2468] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 3.
I20260709 12:24:08.544919 26402 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:08.546756 25650 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:08.487903 28484 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:08.507120 28373 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:08.546757 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:08.549494 25833 raft_consensus.cc:2468] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 5.
I20260709 12:24:08.552567 25650 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:08.556099 25650 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:08.557236 25650 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:08.559485 25677 raft_consensus.cc:1240] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:24:08.526255 28463 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:08.567385 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:08.569135 25759 raft_consensus.cc:2393] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 2: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:08.570744 26402 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:08.573705 28442 raft_consensus.cc:2749] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:08.574602 28442 consensus_queue.cc:1048] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:08.545038 28282 raft_consensus.cc:2804] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:08.435595 28400 consensus_queue.cc:1059] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.132s
I20260709 12:24:08.584201 25800 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:08.587221 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:08.587877 25759 raft_consensus.cc:2468] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 3.
I20260709 12:24:08.588920 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:08.589936 25681 raft_consensus.cc:2393] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 6: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:08.590699 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:08.591528 25678 raft_consensus.cc:2468] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 5.
I20260709 12:24:08.553036 28276 raft_consensus.cc:2749] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:24:08.595752 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:08.557204 28456 raft_consensus.cc:2804] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:08.605357 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:08.593468 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:08.606302 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:08.647521 25677 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 1.
I20260709 12:24:08.565452 28387 raft_consensus.cc:2804] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:08.547394 28355 consensus_queue.cc:1048] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 12:24:08.581451 28463 raft_consensus.cc:3060] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:08.568041 28460 raft_consensus.cc:2804] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:08.580329 28168 raft_consensus.cc:2804] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:08.553303 28277 consensus_queue.cc:1048] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 12:24:08.655534 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:08.651898 25684 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 5.
W20260709 12:24:08.656950 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 84822.9us
I20260709 12:24:08.560761 28249 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:08.585469 28282 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:08.580394 28370 raft_consensus.cc:2749] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:08.653453 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:08.667021 25754 raft_consensus.cc:2468] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 5.
W20260709 12:24:08.659859 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 130348us
I20260709 12:24:08.620466 28487 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:08.677898 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:08.619983 28486 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:08.664865 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:08.651561 28456 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:08.568024 28484 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:08.685388 25683 raft_consensus.cc:2468] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 6.
I20260709 12:24:08.682543 25759 raft_consensus.cc:1275] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:08.686553 26402 leader_election.cc:400] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 pre-election: Vote denied by peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) with higher term. Message: Invalid argument: T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 5. Current term is 6.
I20260709 12:24:08.585148 28373 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:24:08.691847 26402 leader_election.cc:403] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:08.679142 28282 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:08.664124 28168 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:08.678654 28387 raft_consensus.cc:697] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 6 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:08.698310 25684 raft_consensus.cc:1240] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:08.698681 28387 consensus_queue.cc:237] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:08.699491 28498 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:08.699728 28497 consensus_queue.cc:1048] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:08.700038 28498 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:08.701745 25686 raft_consensus.cc:1240] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 4. Current term is 6. Ops: []
I20260709 12:24:08.697647 26402 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:08.690539 28456 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:08.688536 28092 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:08.717470 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:08.724855 25832 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 2.
I20260709 12:24:08.722996 28395 raft_consensus.cc:2804] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:08.727859 28395 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:08.728302 28395 raft_consensus.cc:3060] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:08.731019 28501 raft_consensus.cc:2804] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:08.731508 28501 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:08.731858 28501 raft_consensus.cc:3060] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:08.697489 28168 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:08.717754 28370 raft_consensus.cc:3060] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:24:08.732739 25760 raft_consensus.cc:2468] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 3.
I20260709 12:24:08.724097 28276 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:08.739602 28276 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:08.740593 28349 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:08.731992 28092 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:08.753429 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 72423.5us
I20260709 12:24:08.755064 25801 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
W20260709 12:24:08.757716 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:08.759568 28497 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:08.759975 25801 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:08.760145 28497 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:08.762450 28497 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:08.765280 28484 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:08.736642 28482 consensus_queue.cc:1048] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.212s
I20260709 12:24:08.768821 28249 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:08.769917 28438 consensus_meta.cc:287] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.583s	user 0.000s	sys 0.010s
I20260709 12:24:08.770346 28438 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:08.772020 25834 raft_consensus.cc:1240] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:08.688567 28487 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:08.722416 28460 raft_consensus.cc:697] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 6 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
W20260709 12:24:08.796810 26402 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:08.720355 28369 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:08.772347 28276 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:08.757105 28400 raft_consensus.cc:3055] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:08.694161 28486 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:08.782265 28484 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:08.784474 28281 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:08.837566 25828 raft_consensus.cc:2393] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 3: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:08.864595 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:08.873034 28092 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:08.874840 28092 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:08.875073 28168 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:08.803411 28497 consensus_queue.cc:1048] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
W20260709 12:24:08.875790 28131 consensus_meta.cc:287] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.641s	user 0.007s	sys 0.002s
W20260709 12:24:08.877015 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 115906us
I20260709 12:24:08.879194 25801 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:08.875348 28092 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:08.886096 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:08.886884 26438 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 9.
I20260709 12:24:08.817576 28481 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:08.817759 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:08.856916 28184 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:08.812587 28400 raft_consensus.cc:740] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:08.889676 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:08.818493 28507 raft_consensus.cc:2749] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:08.876307 28500 raft_consensus.cc:2749] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:08.890250 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:08.893635 25680 raft_consensus.cc:1275] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:24:08.862941 28505 consensus_queue.cc:1048] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 12:24:08.894081 28481 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:08.894642 28486 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:08.894888 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
W20260709 12:24:08.895583 28499 log.cc:927] Time spent T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 12:24:08.891832 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:08.876091 28484 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:08.943732 28092 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:08.896070 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:24:09.085692 28496 log.cc:927] Time spent T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
W20260709 12:24:09.102717 26402 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:09.102843 25683 raft_consensus.cc:1275] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:24:08.896287 25684 raft_consensus.cc:1240] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:08.897855 26439 raft_consensus.cc:1275] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 12:24:09.104975 26439 pending_rounds.cc:85] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89: Aborting all ops after (but not including) 5
I20260709 12:24:09.105294 26439 pending_rounds.cc:107] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:24:09.105592 26439 raft_consensus.cc:2889] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:08.943675 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:09.107046 25681 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 7.
I20260709 12:24:08.996253 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:24:09.055155 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:09.064502 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:09.108536 26438 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:09.111092 26433 raft_consensus.cc:2393] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 6: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:09.103549 28482 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:08.877039 28281 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:09.085486 28477 consensus_meta.cc:287] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.869s	user 0.009s	sys 0.001s
I20260709 12:24:08.888283 28438 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:09.159956 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:09.083510 28504 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:08.963862 28507 raft_consensus.cc:2749] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:09.017849 28498 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:08.893682 28373 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:24:09.168455 25800 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.003s	sys 0.031s
W20260709 12:24:09.232132 25800 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.003s	sys 0.031s
W20260709 12:24:09.232446 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 651765us
I20260709 12:24:08.984781 28276 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.084961 28131 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:08.944546 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:09.112722 28497 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:09.205569 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:09.165623 28503 log.cc:927] Time spent T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.354s	user 0.001s	sys 0.000s
I20260709 12:24:08.979811 28508 consensus_queue.cc:1048] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.295s
I20260709 12:24:09.090477 28395 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:08.896515 28184 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:08.982265 28460 consensus_queue.cc:237] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:08.977011 28400 consensus_queue.cc:260] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:09.234195 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:09.461102 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:09.296937 26438 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 10.
W20260709 12:24:09.312387 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:09.287218 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:09.284323 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:09.463892 25832 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 2.
I20260709 12:24:09.464385 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:09.244433 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:09.288491 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:09.465399 25836 raft_consensus.cc:2468] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 5.
I20260709 12:24:09.159228 28462 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:09.501765 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:09.288838 28509 log.cc:927] Time spent T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.270s	user 0.000s	sys 0.000s
I20260709 12:24:09.507378 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:09.315575 28282 consensus_meta.cc:287] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.598s	user 0.009s	sys 0.000s
I20260709 12:24:09.513207 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:09.513844 25832 raft_consensus.cc:2468] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 6.
I20260709 12:24:09.513259 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:09.429540 28514 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.517447 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:09.316670 26432 raft_consensus.cc:1275] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:24:09.517477 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:09.512305 26402 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:09.327440 28374 consensus_meta.cc:287] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.942s	user 0.008s	sys 0.000s
I20260709 12:24:09.515252 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:09.230024 28477 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:09.312162 28369 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:09.307883 28349 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:09.527697 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:09.527737 25830 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 5.
I20260709 12:24:09.529862 25684 raft_consensus.cc:2393] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 3: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:09.159346 28501 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:09.519491 25681 raft_consensus.cc:2468] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 5.
W20260709 12:24:09.510113 25801 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.039s	sys 0.033s
W20260709 12:24:09.533133 25801 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.039s	sys 0.033s
W20260709 12:24:09.533510 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 644832us
I20260709 12:24:09.297241 28168 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:24:09.519747 26402 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:09.533875 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:09.285570 28281 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:09.531854 25831 raft_consensus.cc:2393] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 10: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:09.541035 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:09.540292 25830 raft_consensus.cc:1275] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:09.319115 25679 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
mode: GRACEFUL
new_leader_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:49108
I20260709 12:24:09.526350 25680 raft_consensus.cc:2468] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 5.
I20260709 12:24:09.500427 28131 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:09.164124 28482 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:09.529407 28514 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:09.521778 28400 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:09.552922 25836 raft_consensus.cc:2368] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 3. Current term is 4.
I20260709 12:24:09.550282 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:09.541559 28484 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:09.514817 28276 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:09.307276 28481 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:09.518718 28462 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:09.527004 28374 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:09.542851 28373 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.230307 28504 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:09.517287 28282 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:09.551395 28456 consensus_meta.cc:287] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.811s	user 0.011s	sys 0.000s
I20260709 12:24:09.571722 25831 raft_consensus.cc:1275] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:09.572834 25678 raft_consensus.cc:1275] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:24:09.550964 28520 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.649103 28456 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:09.578305 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:09.650375 25680 raft_consensus.cc:2393] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 3: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:09.579200 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:09.507102 28497 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:09.540740 28477 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:09.589807 28248 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:09.602772 28508 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.607007 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:09.626940 28412 raft_consensus.cc:3055] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:24:09.600325 28476 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.010s	sys 0.019s
I20260709 12:24:09.628065 28395 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:09.628347 28131 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:09.630211 28276 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:09.630504 25569 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 5aae9f34f7154346afd482b3183ee180 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5cccf20a8bff46dba6601f241d172b8a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:24:09.695662 25834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 2458) took 1252 ms. Trace:
W20260709 12:24:09.661834 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:09.717314 25569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 86861.8us
I20260709 12:24:09.631037 28507 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:09.586611 28505 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:09.586125 25832 raft_consensus.cc:1275] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:24:09.572257 28484 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:09.592034 26435 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.023s	sys 0.027s
I20260709 12:24:09.574961 28525 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:09.575330 28481 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:09.628544 28462 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:09.637012 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:24:09.639729 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:09.632081 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 55033.1us
W20260709 12:24:09.631827 28370 consensus_meta.cc:287] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.877s	user 0.011s	sys 0.005s
I20260709 12:24:09.731047 25801 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:09.637702 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:09.644368 25760 raft_consensus.cc:1275] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:09.732499 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:09.644409 25756 raft_consensus.cc:1275] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:24:09.665505 28493 log.cc:927] Time spent T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.980s	user 0.009s	sys 0.003s
I20260709 12:24:09.742522 25801 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:24:09.724968 28476 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.820s	user 0.010s	sys 0.026s
I20260709 12:24:09.647173 25686 raft_consensus.cc:2393] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 10: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:09.647413 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:24:09.725934 26435 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.023s	sys 0.029s
W20260709 12:24:09.648279 28463 consensus_meta.cc:287] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.968s	user 0.006s	sys 0.007s
I20260709 12:24:09.651520 25681 raft_consensus.cc:2468] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 6.
I20260709 12:24:09.630254 28523 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:09.668768 26402 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:09.717329 25834 rpcz_store.cc:276] 0709 12:24:08.443333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:08.444498 (+  1165us) service_pool.cc:224] Handling call
0709 12:24:08.503400 (+ 58902us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:08.772372 (+268972us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:09.695372 (+923000us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b5400117954. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:09.695570 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":617273088}
I20260709 12:24:09.630304 28498 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.730784 26434 raft_consensus.cc:2468] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 5.
W20260709 12:24:09.653168 28518 log.cc:927] Time spent T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.079s	user 0.001s	sys 0.001s
I20260709 12:24:09.644657 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:09.733860 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:09.646203 28282 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:09.718151 28527 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:09.741221 25756 raft_consensus.cc:1275] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:09.646420 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:09.690701 28501 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:09.652947 28514 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:09.666803 28374 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:09.665575 28184 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:09.694363 28456 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:09.753841 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:09.721467 28168 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.699824 28369 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.658567 25679 raft_consensus.cc:606] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Received request to transfer leadership to TS 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:09.657742 28477 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:24:09.890664 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 43879.8us
I20260709 12:24:09.719108 28412 raft_consensus.cc:740] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:09.692925 28482 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:09.744846 25759 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 8.
I20260709 12:24:09.741721 28378 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.697136 28280 raft_consensus.cc:3060] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:09.664331 28504 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:09.768790 25758 raft_consensus.cc:2468] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 5.
I20260709 12:24:09.654315 28438 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.779241 28527 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:10.062929 28438 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:24:10.064502 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:10.065356 28438 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:09.770251 25754 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 5.
I20260709 12:24:09.762941 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:24:09.772894 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 104228us
I20260709 12:24:10.066429 25761 raft_consensus.cc:2468] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 5.
I20260709 12:24:10.067471 26402 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:09.643623 28373 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:09.728618 28508 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:09.743064 28370 raft_consensus.cc:2749] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) with higher term. Message: Invalid argument: T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 5. Current term is 6.
I20260709 12:24:09.886235 28476 raft_consensus.cc:2804] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:09.649864 28520 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:09.890883 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 148417us
I20260709 12:24:09.729651 28484 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:09.764117 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:09.892911 25834 raft_consensus.cc:1240] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:09.883946 28467 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:09.769800 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:09.745420 28481 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:10.065940 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:09.761462 28248 raft_consensus.cc:3060] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:09.757336 28526 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.085822 25801 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:10.072701 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:09.741564 28505 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:09.890884 25679 raft_consensus.cc:614] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:09.769289 28488 consensus_queue.cc:1048] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.317s
I20260709 12:24:10.107649 25762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 2471) took 1849 ms. Trace:
I20260709 12:24:10.108011 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:10.061574 28477 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.112792 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
W20260709 12:24:10.073949 25726 connection.cc:256] RPC call timeout handler was delayed by -1.4481963610001003s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2042s for a response
I20260709 12:24:09.733130 28525 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:09.890396 28184 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:10.114122 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:10.115943 25759 raft_consensus.cc:2393] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 7: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:09.761511 28463 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:10.128687 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:10.128980 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:10.129082 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 61664.3us
I20260709 12:24:10.129524 25680 raft_consensus.cc:2410] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 7 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 12:24:10.129650 25678 raft_consensus.cc:2393] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 5: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:09.768196 28498 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:10.131780 26402 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:10.132089 28372 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:10.132467 26402 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:10.118767 25831 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 6.
I20260709 12:24:10.115566 25762 rpcz_store.cc:276] 0709 12:24:08.258213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:08.263080 (+  4867us) service_pool.cc:224] Handling call
0709 12:24:08.287822 (+ 24742us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:08.435367 (+147545us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:24:08.435397 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:08.451389 (+ 15992us) log.cc:844] Serialized 26 byte log entry
0709 12:24:09.664919 (+1213530us) spinlock_profiling.cc:243] Waited 2.53 ms on lock 0x7b4400022b4c. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db 00007f5d99708aaf 00007f5d996fc86e 00007f5d996fbbb6 00007f5d996fb7d8 00007f5d99705221 00007f5d997051d9 00007f5d99705169
0709 12:24:10.107169 (+442250us) spinlock_profiling.cc:243] Waited 6.29 ms on lock 0x7b180013bfa0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d997094bc 00007f5d96a5748b 00007f5d9f8b19a9 00007f5d96a7369b 00007f5d96a7193f 00007f5d96a73c02 00007f5d996fb20b 00007f5d99700d23 00007f5d997010d1
0709 12:24:10.107325 (+   156us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:10.107360 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:10.107421 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:10.107459 (+    38us) raft_consensus.cc:1685] finished
0709 12:24:10.107469 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:10.107597 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":239405,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":13751,"spinlock_wait_cycles":20303616,"thread_start_us":170196,"threads_started":2,"wal-append.queue_time_us":122162}
I20260709 12:24:09.885463 28395 consensus_queue.cc:1048] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.223s
I20260709 12:24:10.068840 28456 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:10.135578 28456 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:09.741878 28507 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:10.137841 28472 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:10.085566 28535 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:10.138741 28535 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:10.129092 25686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40230 (request call id 1350) took 1334 ms. Trace:
I20260709 12:24:10.141686 25686 rpcz_store.cc:276] 0709 12:24:08.794902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:08.864006 (+ 69104us) service_pool.cc:224] Handling call
0709 12:24:10.128896 (+1264890us) spinlock_profiling.cc:243] Waited 782 ms on lock 0x7b5400203854. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:10.129010 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1797837056}
I20260709 12:24:10.132570 28372 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:10.143952 28535 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:10.146561 28535 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.147023 28535 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:10.145058 28372 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:10.145383 28456 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:10.144344 28498 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:10.148185 28507 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:10.150882 28535 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:10.144654 26402 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:10.106235 28397 raft_consensus.cc:3060] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:10.153345 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:10.157598 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:10.001600 28369 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:10.164651 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:10.165516 26433 raft_consensus.cc:2410] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 8 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:24:10.154197 26402 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:09.893409 28168 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:10.165645 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:10.001814 28281 consensus_queue.cc:1048] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.125s
I20260709 12:24:10.111393 28476 raft_consensus.cc:697] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 10 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:10.171478 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:10.113739 26434 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 11.
I20260709 12:24:10.086651 28378 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:10.173110 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:10.123057 28370 raft_consensus.cc:2804] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:09.780009 28523 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:10.116888 28505 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:10.174998 25801 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:10.190742 25801 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:10.181476 26402 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:10.180888 25759 raft_consensus.cc:2410] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:24:10.186754 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:10.192049 25836 raft_consensus.cc:3060] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:10.168932 28372 raft_consensus.cc:2804] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:10.116209 28477 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:10.179520 28370 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:10.192433 25834 raft_consensus.cc:2468] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 6.
I20260709 12:24:10.156512 28532 raft_consensus.cc:2749] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:10.203783 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:10.198098 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:10.204121 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:10.204516 25761 raft_consensus.cc:2393] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 10: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:10.204794 25834 raft_consensus.cc:2468] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 4.
I20260709 12:24:10.204602 25759 raft_consensus.cc:2468] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 5.
I20260709 12:24:10.190922 28377 raft_consensus.cc:2749] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:10.194334 28476 consensus_queue.cc:237] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:10.202955 28392 raft_consensus.cc:2804] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:10.206898 28392 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:10.207257 28392 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:10.207512 26402 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:10.199956 28168 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:10.209085 26402 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:10.209510 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:10.209971 26402 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:10.210353 26432 raft_consensus.cc:2393] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 6: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:10.106969 28467 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:10.211330 26402 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:24:10.202304 25800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:10.152305 28526 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:10.193488 28524 log.cc:927] Time spent T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.349s	user 0.001s	sys 0.000s
I20260709 12:24:10.203164 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:10.201022 25801 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:10.195822 28372 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:10.152863 28184 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:10.179525 28255 raft_consensus.cc:2804] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:10.231220 26433 raft_consensus.cc:2468] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 6.
I20260709 12:24:10.211288 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:10.234133 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 229862us
I20260709 12:24:10.242100 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:10.234019 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:10.246874 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:10.242309 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 125296us
I20260709 12:24:10.213371 28370 raft_consensus.cc:3060] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:10.263860 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:10.270423 25726 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:10.271682 25754 raft_consensus.cc:2468] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 5.
I20260709 12:24:10.283846 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:10.229952 28395 raft_consensus.cc:2749] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:10.230038 28438 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.290729 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:10.171651 28412 consensus_queue.cc:260] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:10.212810 28472 consensus_queue.cc:1048] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
I20260709 12:24:10.296774 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:10.298344 28529 log.cc:927] Time spent T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 12:24:10.298628 28488 raft_consensus.cc:2804] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:10.245790 28168 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:10.300534 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:10.305672 25835 raft_consensus.cc:2468] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 7.
I20260709 12:24:10.307082 25836 raft_consensus.cc:2468] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 5.
I20260709 12:24:10.235754 28372 raft_consensus.cc:3060] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:10.241129 28255 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:10.315289 25829 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 10.
I20260709 12:24:10.211972 28474 consensus_queue.cc:1048] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.090s
I20260709 12:24:10.239548 28539 raft_consensus.cc:2749] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:24:10.292506 25649 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.245.130:37267 timed out after 1.881s (SENT) [suppressed 27 similar messages]
I20260709 12:24:10.320681 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:10.411316 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:10.411716 25762 raft_consensus.cc:2393] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 3: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:10.412022 25829 raft_consensus.cc:2468] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 4.
I20260709 12:24:10.325798 28537 consensus_queue.cc:1048] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 12:24:10.354751 25761 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:10.326365 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:10.355273 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:10.356022 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 144743us
I20260709 12:24:10.415445 26402 leader_election.cc:400] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237) with higher term. Message: Invalid argument: T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 3. Current term is 4.
I20260709 12:24:10.338078 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:10.404781 26438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36518 (request call id 687) took 1237 ms. Trace:
I20260709 12:24:10.390566 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:10.404955 26430 raft_consensus.cc:2468] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 6.
I20260709 12:24:10.402648 25830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41782 (request call id 607) took 1120 ms. Trace:
I20260709 12:24:10.404811 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:10.300148 28538 raft_consensus.cc:2749] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:10.284489 28498 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.415743 26402 leader_election.cc:403] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:10.418473 25835 raft_consensus.cc:2368] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 5. Current term is 6.
I20260709 12:24:10.418730 25754 raft_consensus.cc:2410] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:24:10.419970 25758 raft_consensus.cc:3060] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:10.420394 26433 raft_consensus.cc:3060] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:24:10.407025 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
W20260709 12:24:10.390544 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 142097us
I20260709 12:24:10.422260 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:10.418705 25830 rpcz_store.cc:276] 0709 12:24:09.282178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:09.552805 (+270627us) service_pool.cc:224] Handling call
0709 12:24:09.553221 (+   416us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:09.586548 (+ 33327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:09.629041 (+ 42493us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:09.629651 (+   610us) log.cc:844] Serialized 52 byte log entry
0709 12:24:09.885838 (+256187us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:10.283218 (+397380us) log.cc:844] Serialized 14 byte log entry
0709 12:24:10.365951 (+ 82733us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:10.366067 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:10.402379 (+ 36312us) raft_consensus.cc:1685] finished
0709 12:24:10.402404 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:10.402585 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":103643,"prepare.queue_time_us":353299,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":46,"raft.queue_time_us":151859,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":26186,"thread_start_us":479703,"threads_started":2,"wal-append.queue_time_us":465996}
W20260709 12:24:10.332561 28400 consensus_meta.cc:287] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.774s	user 0.008s	sys 0.001s
I20260709 12:24:10.420653 26438 rpcz_store.cc:276] 0709 12:24:09.167659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:09.511035 (+343376us) service_pool.cc:224] Handling call
0709 12:24:09.528709 (+ 17674us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:09.528893 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:09.778029 (+249136us) log.cc:844] Serialized 14 byte log entry
0709 12:24:10.404459 (+626430us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:10.404509 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:10.404556 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:10.404620 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:10.404732 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":636930,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"thread_start_us":520823,"threads_started":2}
I20260709 12:24:10.321560 28488 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:10.330700 28483 raft_consensus.cc:2804] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:10.328109 28527 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:10.342293 28463 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:10.326848 28467 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:10.338110 28487 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:10.440135 25757 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:24:10.454778 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:10.455431 25829 raft_consensus.cc:3060] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:10.330894 28540 raft_consensus.cc:2804] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:10.411831 28412 raft_consensus.cc:3060] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:10.500984 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:10.522640 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 67664.6us
I20260709 12:24:10.450086 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:10.524037 25754 raft_consensus.cc:3060] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:10.403760 28255 raft_consensus.cc:3060] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:10.326591 28531 raft_consensus.cc:2804] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:10.415014 28131 raft_consensus.cc:3060] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:10.316176 28438 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:10.337266 28369 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:10.404517 28168 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:10.445550 28488 raft_consensus.cc:3060] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:10.526471 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:10.540941 25754 raft_consensus.cc:2468] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 4.
I20260709 12:24:10.458791 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:10.448776 28483 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:10.459149 28484 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:10.563891 25837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41782 (request call id 612) took 1271 ms. Trace:
I20260709 12:24:10.446072 28498 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:10.520776 28508 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:10.592468 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 58107us
I20260709 12:24:10.538290 28373 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:10.528563 28481 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:10.457316 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:10.570441 25837 rpcz_store.cc:276] 0709 12:24:09.292423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:09.594511 (+302088us) service_pool.cc:224] Handling call
0709 12:24:09.626818 (+ 32307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:10.212402 (+585584us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:10.212446 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:10.212500 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:10.212527 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:10.563677 (+351150us) spinlock_profiling.cc:243] Waited 580 ms on lock 0x7b54003c5354. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:10.563724 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:10.563839 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1333294336}
I20260709 12:24:10.566632 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:10.541428 28540 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:10.555747 28400 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:10.537343 28531 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:10.565857 28483 raft_consensus.cc:3060] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:10.620841 25828 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44202 (request call id 2454) took 2204 ms (client timeout 1881 ms). Trace:
I20260709 12:24:10.658207 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:10.660604 25757 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 10.
I20260709 12:24:10.664311 25758 raft_consensus.cc:2468] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 5.
I20260709 12:24:10.665849 25829 raft_consensus.cc:2468] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 5.
I20260709 12:24:10.592518 28487 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.596239 28369 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:10.612354 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 320445us
W20260709 12:24:10.657876 25828 rpcz_store.cc:269] 0709 12:24:08.407345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:08.407516 (+   171us) service_pool.cc:224] Handling call
0709 12:24:10.611390 (+2203874us) spinlock_profiling.cc:243] Waited 400 ms on lock 0x7b54002f5654. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:10.611571 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":919828352}
I20260709 12:24:10.593271 28520 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:24:10.659227 28280 consensus_meta.cc:287] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.597s	user 0.005s	sys 0.005s
W20260709 12:24:10.660877 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 218022us
W20260709 12:24:10.620508 28550 log.cc:927] Time spent T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:24:10.675503 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:10.561909 28467 consensus_queue.cc:1048] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.096s
I20260709 12:24:10.620627 28540 raft_consensus.cc:3060] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:10.665918 28512 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:10.688302 25758 raft_consensus.cc:2468] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 4.
I20260709 12:24:10.696153 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:10.696887 25762 raft_consensus.cc:2468] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 3.
I20260709 12:24:10.697238 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:10.697945 25754 raft_consensus.cc:2393] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 5: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:10.691530 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:10.678414 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:10.666976 28531 raft_consensus.cc:3060] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:10.701273 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:10.704759 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:10.705292 25837 raft_consensus.cc:2393] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 10: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:10.724047 26431 raft_consensus.cc:1275] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 8. (term mismatch)
I20260709 12:24:10.724267 25679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:49108 (request call id 28) took 1445 ms. Trace:
I20260709 12:24:10.724761 25679 rpcz_store.cc:276] 0709 12:24:09.279002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:09.318837 (+ 39835us) service_pool.cc:224] Handling call
0709 12:24:10.724032 (+1405195us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b5400233554. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b5b853 00007f5d9eb2960a 00007f5d980af7d4 00007f5d980af762 00007f5d980af691 00007f5d980af60c 00007f5d980ae8c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:10.724158 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":234279296}
I20260709 12:24:10.682729 28400 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:10.729368 28553 log.cc:927] Time spent T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 12:24:10.729547 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:10.729746 28400 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:10.695580 26434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 768) took 1051 ms. Trace:
I20260709 12:24:10.730520 26434 rpcz_store.cc:276] 0709 12:24:09.639372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:10.410902 (+771530us) service_pool.cc:224] Handling call
0709 12:24:10.691209 (+280307us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:10.731735 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:10.732343 26434 raft_consensus.cc:3060] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:24:10.730281 25832 raft_consensus.cc:2393] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 3: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:10.724525 26431 pending_rounds.cc:85] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89: Aborting all ops after (but not including) 7
I20260709 12:24:10.690526 28378 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:10.693863 28184 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:10.825976 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:10.813125 25761 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 7.
I20260709 12:24:10.740787 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:10.826820 26431 pending_rounds.cc:107] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89: Aborting uncommitted NO_OP operation due to leader change: 5.8
I20260709 12:24:10.827150 26431 raft_consensus.cc:2889] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:10.776310 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:10.740442 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:10.687166 28487 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:10.679955 28369 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:10.741540 25684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40230 (request call id 1359) took 1200 ms. Trace:
I20260709 12:24:10.829672 25837 raft_consensus.cc:2393] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 6: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:10.835096 26434 raft_consensus.cc:2468] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 5.
I20260709 12:24:10.839567 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:10.702457 28526 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:10.842953 25684 rpcz_store.cc:276] 0709 12:24:09.541600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:09.542140 (+   540us) service_pool.cc:224] Handling call
0709 12:24:10.740600 (+1198460us) spinlock_profiling.cc:243] Waited 3.16 ms on lock 0x7b5800003698. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d96a3cb71 00007f5d96a3ca22 00007f5d9f9558d9 00007f5d9eaafee0 00007f5d9eb790ab 00007f5d9eb79131 00007f5d9eb3afc0 00007f5d9eb25929 00007f5d9eb253d2 00007f5d9809cbd4
0709 12:24:10.740780 (+   180us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:10.741105 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:10.741148 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:10.741204 (+    56us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:10.741246 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:10.741331 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:10.741470 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":88718,"spinlock_wait_cycles":7276416}
I20260709 12:24:10.852245 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:10.851570 25726 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:10.849632 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:10.855119 25762 raft_consensus.cc:2410] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:24:10.733870 28463 raft_consensus.cc:3055] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:10.852710 28281 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.857049 28463 raft_consensus.cc:740] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:10.857606 28281 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:10.858697 28370 consensus_meta.cc:287] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.558s	user 0.002s	sys 0.005s
I20260709 12:24:10.858477 28463 consensus_queue.cc:260] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:10.859124 28370 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:10.860260 28517 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:10.859498 28463 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:10.860800 28517 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:10.857059 28543 consensus_queue.cc:1048] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:24:10.855123 28560 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.863016 28560 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:10.864241 25837 raft_consensus.cc:1240] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 4. Current term is 6. Ops: []
I20260709 12:24:10.864898 28526 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:10.865212 28487 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:10.865486 28526 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:10.866051 25832 raft_consensus.cc:2393] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 6: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:10.848794 28559 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:10.867518 28559 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:10.867973 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:10.868600 25761 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 6.
I20260709 12:24:10.869117 26433 raft_consensus.cc:2468] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 4.
I20260709 12:24:10.859805 28281 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:10.870252 25801 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:24:10.870524 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:10.871155 28487 raft_consensus.cc:2804] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:10.715958 28527 consensus_queue.cc:1059] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.149s
I20260709 12:24:10.808521 28467 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:10.871634 28487 raft_consensus.cc:697] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:10.872558 28467 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:10.873153 28487 consensus_queue.cc:237] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:10.871712 28498 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:10.874650 28467 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349)
I20260709 12:24:10.872159 28539 raft_consensus.cc:2749] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237) with higher term. Message: Invalid argument: T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 3. Current term is 4.
I20260709 12:24:10.876739 26438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 775) took 1160 ms. Trace:
I20260709 12:24:10.877170 26438 rpcz_store.cc:276] 0709 12:24:09.716575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:10.839279 (+1122704us) service_pool.cc:224] Handling call
0709 12:24:10.876657 (+ 37378us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:10.742069 28497 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:10.879216 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:10.879995 25828 raft_consensus.cc:2393] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 6: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:10.881352 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:10.882037 25757 raft_consensus.cc:2468] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 6.
I20260709 12:24:10.882323 25726 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:10.705979 28392 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:10.888862 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:10.893819 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:10.855787 26434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 773) took 1155 ms. Trace:
I20260709 12:24:10.704118 28512 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:10.903105 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:10.866931 28369 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:10.910029 28560 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:10.887713 28535 raft_consensus.cc:2804] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:10.913146 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:10.905455 25834 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:24:10.732365 28557 consensus_queue.cc:1048] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.163s
I20260709 12:24:10.879666 26435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 713) took 1986 ms. Trace:
I20260709 12:24:10.823423 28372 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:10.907768 25726 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:24:10.913453 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:10.860272 28438 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:10.914976 25834 raft_consensus.cc:606] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Received request to transfer leadership to TS 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:10.866871 28255 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:10.920547 25834 raft_consensus.cc:614] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:10.897866 28544 raft_consensus.cc:2804] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:10.926997 25828 raft_consensus.cc:1240] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:10.897832 26434 rpcz_store.cc:276] 0709 12:24:09.698393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:10.731459 (+1033066us) service_pool.cc:224] Handling call
0709 12:24:10.853689 (+122230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:10.918592 28535 raft_consensus.cc:697] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 5 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:10.920953 28168 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:10.926352 28544 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:10.956091 26432 raft_consensus.cc:2393] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 2: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:10.951423 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:10.960172 25828 raft_consensus.cc:2468] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 5.
W20260709 12:24:10.960700 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 56596us
I20260709 12:24:10.962841 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:10.935756 28184 raft_consensus.cc:2804] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:10.963887 26436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 767) took 1324 ms. Trace:
I20260709 12:24:10.967674 25726 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
W20260709 12:24:10.968722 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 79485.1us
I20260709 12:24:10.968724 26436 rpcz_store.cc:276] 0709 12:24:09.639086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:10.150907 (+511821us) service_pool.cc:224] Handling call
0709 12:24:10.962679 (+811772us) spinlock_profiling.cc:243] Waited 3.32 ms on lock 0x7b5800004598. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d96a3cb71 00007f5d96a3ca22 00007f5d9f9558d9 00007f5d9eaafee0 00007f5d9eb790ab 00007f5d9eb79131 00007f5d9eb270a0 00007f5d9eb26984 00007f5d980a16d4 00007f5d980a1662
0709 12:24:10.963808 (+  1129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7638784}
I20260709 12:24:10.956938 28523 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:10.982277 28535 consensus_queue.cc:237] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:10.961460 28544 raft_consensus.cc:3060] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:10.984813 25726 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:10.948333 28531 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:11.002975 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 74164.8us
W20260709 12:24:11.007014 28397 consensus_meta.cc:287] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.838s	user 0.007s	sys 0.003s
I20260709 12:24:10.999890 28557 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:11.008383 28481 raft_consensus.cc:2749] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:11.008797 25726 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:24:11.010001 25583 catalog_manager.cc:5697] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 3 to 4, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 4 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:10.917701 26435 rpcz_store.cc:276] 0709 12:24:08.892010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:08.979311 (+ 87301us) service_pool.cc:224] Handling call
0709 12:24:08.979805 (+   494us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:08.980280 (+   475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:08.980314 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:08.980994 (+   680us) log.cc:844] Serialized 52 byte log entry
0709 12:24:09.780165 (+799171us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:24:10.248583 (+468418us) log.cc:844] Serialized 14 byte log entry
0709 12:24:10.460162 (+211579us) log.cc:844] Serialized 14 byte log entry
0709 12:24:10.839448 (+379286us) spinlock_profiling.cc:243] Waited 5.82 ms on lock 0x7b180035ef60. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d969eec0a 00007f5da012e219 00007f5d99717d70 00007f5d9970b293 00007f5d99700cea 00007f5d9970123a 00007f5d99b6ba2a 00007f5d99b7b0bf 00007f5d99b7b038
0709 12:24:10.839718 (+   270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:10.839802 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:10.845804 (+  6002us) raft_consensus.cc:1685] finished
0709 12:24:10.845829 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:10.877824 (+ 31995us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":207832,"prepare.queue_time_us":333347,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":73,"raft.queue_time_us":77851,"raft.run_cpu_time_us":350,"raft.run_wall_time_us":31742,"spinlock_wait_cycles":13383552,"thread_start_us":1054730,"threads_started":3,"wal-append.queue_time_us":747087}
I20260709 12:24:11.012848 25833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 2462) took 1169 ms. Trace:
I20260709 12:24:11.019623 25800 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
W20260709 12:24:11.014537 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 324820us
I20260709 12:24:11.026930 25649 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:11.026108 25833 rpcz_store.cc:276] 0709 12:24:09.843978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:09.889761 (+ 45783us) service_pool.cc:224] Handling call
0709 12:24:09.890221 (+   460us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:10.283879 (+393658us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:10.283934 (+    55us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:10.291153 (+  7219us) log.cc:844] Serialized 52 byte log entry
0709 12:24:10.660441 (+369288us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:10.660478 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:10.660544 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:11.012554 (+352010us) raft_consensus.cc:1685] finished
0709 12:24:11.012584 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:11.012780 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65470,"raft.queue_time_us":84643,"spinlock_wait_cycles":10237824,"thread_start_us":361609,"threads_started":2,"wal-append.queue_time_us":624067}
I20260709 12:24:11.022105 25759 raft_consensus.cc:2468] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 5.
I20260709 12:24:10.978515 28412 raft_consensus.cc:2749] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:11.027801 25649 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:10.999337 28184 raft_consensus.cc:697] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:11.033288 28463 consensus_queue.cc:1048] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:11.034267 28392 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:11.033841 28184 consensus_queue.cc:237] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:11.035168 28131 raft_consensus.cc:2749] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:11.035337 28531 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:11.028417 28527 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.037153 25726 leader_election.cc:400] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237) with higher term. Message: Invalid argument: T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 5. Current term is 6.
I20260709 12:24:11.037581 25726 leader_election.cc:403] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:11.033883 28258 raft_consensus.cc:2804] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:11.039776 25649 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:11.036358 28527 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:11.051719 28463 raft_consensus.cc:2804] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:11.052274 28463 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:11.052673 28463 raft_consensus.cc:3060] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:11.052702 25583 catalog_manager.cc:5697] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 4 to 5, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 5 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:24:11.051709 28258 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:11.054411 25583 catalog_manager.cc:5697] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:11.055256 28258 raft_consensus.cc:3060] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:11.059548 25583 catalog_manager.cc:5697] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:11.065945 28531 raft_consensus.cc:2749] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237) with higher term. Message: Invalid argument: T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 5. Current term is 6.
I20260709 12:24:11.069737 28463 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:11.044471 28168 raft_consensus.cc:2804] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:11.071393 28168 raft_consensus.cc:697] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 5 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:11.071749 25836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44202 (request call id 2467) took 1226 ms. Trace:
I20260709 12:24:11.063670 28258 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:11.072190 25836 rpcz_store.cc:276] 0709 12:24:09.845442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:09.846977 (+  1535us) service_pool.cc:224] Handling call
0709 12:24:11.071585 (+1224608us) spinlock_profiling.cc:243] Waited 85.7 ms on lock 0x7b5400116a54. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:11.071693 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":197166464}
I20260709 12:24:11.073985 28258 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:11.074878 28463 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:11.048710 25649 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:11.077924 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:11.078510 25677 raft_consensus.cc:2468] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 4.
I20260709 12:24:11.078882 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:11.082257 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:11.083027 25757 raft_consensus.cc:2376] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 3. Re-sending same reply.
I20260709 12:24:11.084260 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:11.085218 25754 raft_consensus.cc:2393] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 7: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:11.087006 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:11.185380 28517 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:11.121337 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:11.186183 28255 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:11.187112 28526 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:11.188546 25757 raft_consensus.cc:2376] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 6. Re-sending same reply.
I20260709 12:24:11.171711 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:11.079727 25686 raft_consensus.cc:2468] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 4.
I20260709 12:24:11.132259 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:11.206609 25684 raft_consensus.cc:2393] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 5: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:11.097261 28463 raft_consensus.cc:2804] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:11.192561 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:11.031574 28557 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:11.194252 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
W20260709 12:24:11.090866 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 47307us
I20260709 12:24:11.213841 25755 raft_consensus.cc:3060] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:11.204003 28562 log.cc:927] Time spent T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.282s	user 0.004s	sys 0.006s
I20260709 12:24:11.159910 28487 raft_consensus.cc:2804] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:11.218418 28487 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:11.218832 28487 raft_consensus.cc:3060] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:11.214351 25800 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:11.132146 25583 catalog_manager.cc:5697] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:11.171205 28370 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:11.182654 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:11.229331 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:11.231021 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:11.221648 25726 connection.cc:256] RPC call timeout handler was delayed by -1.1628358299999491s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.163s for a response
W20260709 12:24:11.232143 25726 connection.cc:256] RPC call timeout handler was delayed by -1.1601358299999447s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1633s for a response
I20260709 12:24:11.072310 28168 consensus_queue.cc:237] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:11.208554 28463 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:11.237524 28488 consensus_meta.cc:287] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.653s	user 0.009s	sys 0.000s
W20260709 12:24:11.238162 28483 consensus_meta.cc:287] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.563s	user 0.009s	sys 0.000s
I20260709 12:24:11.237416 28463 raft_consensus.cc:3060] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:11.238556 28483 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:11.240377 26437 raft_consensus.cc:2393] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 7: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:11.241595 26433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 716) took 1463 ms. Trace:
I20260709 12:24:11.242002 26433 rpcz_store.cc:276] 0709 12:24:09.778440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:10.912668 (+1134228us) service_pool.cc:224] Handling call
0709 12:24:10.913043 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:10.921174 (+  8131us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:10.921215 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:10.922990 (+  1775us) log.cc:844] Serialized 26 byte log entry
0709 12:24:11.028388 (+105398us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:11.094523 (+ 66135us) log.cc:844] Serialized 14 byte log entry
0709 12:24:11.094782 (+   259us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:11.094876 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:11.241391 (+146515us) raft_consensus.cc:1685] finished
0709 12:24:11.241411 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:11.241536 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12155,"prepare.queue_time_us":55349,"prepare.run_cpu_time_us":8825,"prepare.run_wall_time_us":40974,"raft.queue_time_us":8643,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":44320,"thread_start_us":67970,"threads_started":1,"wal-append.queue_time_us":231709}
I20260709 12:24:11.224268 28412 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.244694 28412 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:11.245411 28372 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:11.214686 28526 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
W20260709 12:24:11.246589 28566 log.cc:927] Time spent T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:24:11.246831 28526 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:11.214888 28540 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:11.224076 28484 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.250166 25837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44218 (request call id 1433) took 1008 ms. Trace:
I20260709 12:24:11.250092 28484 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:11.250705 25837 rpcz_store.cc:276] 0709 12:24:10.242043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:10.854467 (+612424us) service_pool.cc:224] Handling call
0709 12:24:10.857796 (+  3329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:10.864649 (+  6853us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:11.249870 (+385221us) spinlock_profiling.cc:243] Waited 6.24 ms on lock 0x7b54001b1054. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:11.250091 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14347520}
W20260709 12:24:11.253360 28248 consensus_meta.cc:287] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 1.136s	user 0.012s	sys 0.000s
I20260709 12:24:11.253897 28248 raft_consensus.cc:2749] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:11.254635 25832 raft_consensus.cc:1240] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:11.255868 25832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44218 (request call id 1440) took 1012 ms. Trace:
I20260709 12:24:11.256210 25832 rpcz_store.cc:276] 0709 12:24:10.243850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:10.915417 (+671567us) service_pool.cc:224] Handling call
0709 12:24:10.922084 (+  6667us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:11.255006 (+332922us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:11.255657 (+   651us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x7b540010b654. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:11.255812 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":764362624}
I20260709 12:24:11.256687 28527 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:11.241617 26437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36508 (request call id 715) took 1493 ms. Trace:
I20260709 12:24:11.259362 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:11.260035 26433 raft_consensus.cc:2468] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 3.
I20260709 12:24:11.237985 28488 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:11.299027 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 85032.6us
W20260709 12:24:11.303992 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 71057.4us
I20260709 12:24:11.305112 25726 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:11.305966 28184 raft_consensus.cc:2749] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:11.307322 28184 consensus_queue.cc:1048] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:11.273691 28484 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:11.276698 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:11.277262 28526 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:11.277966 28579 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.308565 25684 raft_consensus.cc:2393] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 4: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:11.308732 28579 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:11.309617 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:11.310689 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:11.311096 28557 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:11.278599 25686 raft_consensus.cc:1275] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:24:11.279711 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:11.312304 25677 raft_consensus.cc:2468] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 6.
I20260709 12:24:11.312762 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
W20260709 12:24:11.312942 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 57545.5us
I20260709 12:24:11.313112 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:11.313303 25686 raft_consensus.cc:3060] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:11.280153 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:11.313683 25801 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:11.313926 25685 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 1.
I20260709 12:24:11.314755 25801 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:11.315016 25685 raft_consensus.cc:1240] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:11.281280 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:11.281622 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:11.315382 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:11.282356 25682 raft_consensus.cc:1275] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:24:11.315656 25726 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:11.294356 25583 catalog_manager.cc:5697] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 2 to 3, leader changed from a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 3 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:24:11.282310 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:11.311709 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:11.316490 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:11.316583 25683 raft_consensus.cc:2468] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 6.
I20260709 12:24:11.315583 25680 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 5.
I20260709 12:24:11.257627 26437 rpcz_store.cc:276] 0709 12:24:09.748789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:10.442609 (+693820us) service_pool.cc:224] Handling call
0709 12:24:11.241381 (+798772us) spinlock_profiling.cc:243] Waited 679 ms on lock 0x7b54002e8bd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:11.241544 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1561795456}
I20260709 12:24:11.295794 26438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 717) took 1236 ms. Trace:
I20260709 12:24:11.311621 28513 raft_consensus.cc:2749] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:11.345098 26433 raft_consensus.cc:2393] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 6: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:11.345732 25684 raft_consensus.cc:2393] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 6: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:11.268553 25755 raft_consensus.cc:2468] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 4.
I20260709 12:24:11.346369 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:11.318367 26438 rpcz_store.cc:276] 0709 12:24:10.059555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:10.947023 (+887468us) service_pool.cc:224] Handling call
0709 12:24:10.966904 (+ 19881us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:10.967385 (+   481us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:10.967427 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:10.972651 (+  5224us) log.cc:844] Serialized 26 byte log entry
0709 12:24:11.028677 (+ 56026us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:24:11.295269 (+266592us) log.cc:844] Serialized 14 byte log entry
0709 12:24:11.295477 (+   208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:11.295546 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:11.295586 (+    40us) raft_consensus.cc:1685] finished
0709 12:24:11.295597 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:11.295738 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61182,"prepare.queue_time_us":175173,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":1318,"raft.queue_time_us":4966,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":4708,"thread_start_us":220911,"threads_started":2,"wal-append.queue_time_us":231744}
I20260709 12:24:11.349700 25800 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:11.315544 25801 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:11.349578 25583 catalog_manager.cc:5697] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:11.355800 25834 raft_consensus.cc:1240] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 5. Current term is 7. Ops: [5.4-5.4]
I20260709 12:24:11.354602 28438 raft_consensus.cc:2804] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:11.357354 28438 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:11.357898 28438 raft_consensus.cc:3060] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:11.354661 28484 raft_consensus.cc:2749] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:11.355315 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:11.353899 28551 raft_consensus.cc:2804] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:11.362051 28551 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:11.362474 28551 raft_consensus.cc:3060] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:11.353439 28568 consensus_queue.cc:1059] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 12:24:11.355211 25583 catalog_manager.cc:5697] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 6 to 8, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 8 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:11.367798 25583 catalog_manager.cc:5697] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 3 to 5, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 5 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:11.378618 25583 catalog_manager.cc:5697] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:24:11.395591 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 80094.9us
W20260709 12:24:11.402458 26430 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 761) took 1757 ms (client timeout 2223 ms). Trace:
W20260709 12:24:11.407742 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 58129.4us
I20260709 12:24:11.409305 25800 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:24:11.412434 25800 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
W20260709 12:24:11.403043 26430 rpcz_store.cc:269] 0709 12:24:09.636588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:09.636726 (+   138us) service_pool.cc:224] Handling call
0709 12:24:11.394102 (+1757376us) spinlock_profiling.cc:243] Waited 380 ms on lock 0x7b54004c8bd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:11.394236 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":874397056}
I20260709 12:24:11.315029 28544 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:11.428766 26430 raft_consensus.cc:1240] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:11.432678 25681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2012) took 1304 ms. Trace:
I20260709 12:24:11.426421 25800 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:11.400507 28478 raft_consensus.cc:2749] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:11.433084 25681 rpcz_store.cc:276] 0709 12:24:10.127860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:10.128016 (+   156us) service_pool.cc:224] Handling call
0709 12:24:10.128313 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:10.140163 (+ 11850us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:10.194979 (+ 54816us) log.cc:844] Serialized 14 byte log entry
0709 12:24:10.407673 (+212694us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:10.407733 (+    60us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:10.407789 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:11.432468 (+1024679us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b54000b31d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:11.432511 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:11.432625 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47438,"prepare.queue_time_us":130922,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":52,"raft.queue_time_us":47743,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":23215,"spinlock_wait_cycles":26609024,"thread_start_us":218910,"threads_started":2,"wal-append.queue_time_us":249253}
I20260709 12:24:11.430039 28513 raft_consensus.cc:2749] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:11.437983 28392 raft_consensus.cc:2749] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:11.444137 28579 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:11.445405 28488 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:11.448657 28578 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:11.449391 28578 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:11.420579 28382 raft_consensus.cc:2749] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:11.420401 28258 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.453239 28258 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:11.456821 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:11.460371 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:11.437252 25800 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:11.464229 26401 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:11.464655 25800 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:11.427062 28248 raft_consensus.cc:2804] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:11.480687 25686 raft_consensus.cc:2468] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 5.
I20260709 12:24:11.472536 25800 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:11.482494 25762 raft_consensus.cc:1275] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:11.483999 25759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53474 (request call id 2495) took 1165 ms. Trace:
I20260709 12:24:11.485332 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:11.486021 25755 raft_consensus.cc:3060] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:11.487545 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:11.488296 25761 raft_consensus.cc:2468] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 3.
I20260709 12:24:11.484372 25759 rpcz_store.cc:276] 0709 12:24:10.313240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:10.400211 (+ 86971us) service_pool.cc:224] Handling call
0709 12:24:11.477872 (+1077661us) spinlock_profiling.cc:243] Waited 581 ms on lock 0x7b54003a5cd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:11.478017 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1337065344}
I20260709 12:24:11.492918 26430 raft_consensus.cc:1275] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:24:11.462393 28526 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:11.496673 25760 raft_consensus.cc:1240] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:11.478591 28557 raft_consensus.cc:2804] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:11.479553 28382 raft_consensus.cc:2804] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:11.429930 28438 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:11.476858 28522 raft_consensus.cc:2749] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:11.507418 25755 raft_consensus.cc:2468] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 7.
I20260709 12:24:11.473973 28482 consensus_queue.cc:1048] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:24:11.519788 28438 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:11.512941 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:11.521521 25832 raft_consensus.cc:2468] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 3.
I20260709 12:24:11.521636 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:11.513209 26430 raft_consensus.cc:1240] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 5. Current term is 7. Ops: []
I20260709 12:24:11.522229 25830 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 2.
I20260709 12:24:11.491743 28478 raft_consensus.cc:2804] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:11.501377 28557 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:11.496951 28392 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.516263 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:11.495512 28248 raft_consensus.cc:697] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 5 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:11.538929 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:11.510682 28382 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:11.544481 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:11.511950 28412 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:11.534840 28557 raft_consensus.cc:3060] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:11.575459 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:11.524410 28478 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:11.570523 28382 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:11.584728 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 396173us
I20260709 12:24:11.585804 25759 raft_consensus.cc:2393] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 2: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:11.501926 28526 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:11.588752 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:11.590165 25832 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 5.
I20260709 12:24:11.592348 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:11.605412 25650 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:11.584728 28478 raft_consensus.cc:3060] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:11.621781 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:11.541293 28551 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:11.542963 28392 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:11.614393 28258 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:11.620745 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:11.622576 25755 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 4.
I20260709 12:24:11.623829 25650 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
W20260709 12:24:11.635488 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 286028us
I20260709 12:24:11.637239 25650 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:11.624936 28578 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:11.638360 25726 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:11.640483 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:11.641283 25759 raft_consensus.cc:2468] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 5.
I20260709 12:24:11.633342 28579 raft_consensus.cc:2749] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:11.651166 25650 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:24:11.653272 25650 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:24:11.654424 25650 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:11.654649 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:11.655320 25686 raft_consensus.cc:2468] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 7.
I20260709 12:24:11.656675 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:11.657368 25832 raft_consensus.cc:2410] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:24:11.652030 28535 raft_consensus.cc:2804] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:11.642207 28248 consensus_queue.cc:237] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:11.691794 28526 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:11.661073 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:11.692584 25686 raft_consensus.cc:2468] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 4.
I20260709 12:24:11.693460 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:11.693967 25686 raft_consensus.cc:3060] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:11.672276 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:11.688486 25569 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 5aae9f34f7154346afd482b3183ee180 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5cccf20a8bff46dba6601f241d172b8a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:24:11.677258 28568 raft_consensus.cc:2804] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:11.698149 28568 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:11.698632 28568 raft_consensus.cc:3060] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:11.702620 28369 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:11.688685 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:11.703787 25759 raft_consensus.cc:2393] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 10: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:11.661345 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:11.678103 28535 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:11.704919 25681 raft_consensus.cc:2468] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 6.
I20260709 12:24:11.690140 28438 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:11.705848 28438 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:11.706614 25681 raft_consensus.cc:1275] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:24:11.659462 28258 raft_consensus.cc:2804] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:11.659019 28584 raft_consensus.cc:2749] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:11.708143 28258 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
W20260709 12:24:11.683805 28575 log.cc:927] Time spent T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.447s	user 0.006s	sys 0.003s
I20260709 12:24:11.684983 25834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44218 (request call id 1444) took 1366 ms. Trace:
I20260709 12:24:11.709590 25834 rpcz_store.cc:276] 0709 12:24:10.318373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:10.960752 (+642379us) service_pool.cc:224] Handling call
0709 12:24:10.961175 (+   423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:11.356478 (+395303us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:11.684639 (+328161us) spinlock_profiling.cc:243] Waited 394 ms on lock 0x7b54001b0654. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:11.684891 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":906794240}
I20260709 12:24:11.710767 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:11.711269 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:11.712699 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:11.714013 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:11.714689 25833 raft_consensus.cc:2468] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 7.
I20260709 12:24:11.677673 28579 raft_consensus.cc:2749] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:11.631889 28487 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:11.726866 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:11.705066 28535 raft_consensus.cc:3060] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:11.716380 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:11.731735 25830 raft_consensus.cc:2468] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 7.
I20260709 12:24:11.711902 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:11.675403 26431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 706) took 3126 ms. Trace:
I20260709 12:24:11.686003 26401 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:11.733443 25834 raft_consensus.cc:1240] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
W20260709 12:24:11.733669 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 47741.7us
I20260709 12:24:11.651808 28544 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:11.664202 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:11.708732 28258 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:11.703258 28369 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:11.690461 28382 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:11.729481 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:11.749568 25833 raft_consensus.cc:2393] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 5: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:11.665872 28512 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:11.737466 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:11.737795 26401 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:11.739305 25682 raft_consensus.cc:2468] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 5.
I20260709 12:24:11.741029 25686 raft_consensus.cc:2468] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 6.
I20260709 12:24:11.754335 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:11.754921 25686 raft_consensus.cc:2468] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 5.
I20260709 12:24:11.745743 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:11.662586 28578 raft_consensus.cc:2749] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:11.732633 26431 rpcz_store.cc:276] 0709 12:24:08.549432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:08.556388 (+  6956us) service_pool.cc:224] Handling call
0709 12:24:08.585851 (+ 29463us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:10.844301 (+2258450us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:11.675126 (+830825us) spinlock_profiling.cc:243] Waited 2.11 s on lock 0x7b5400227254. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:11.675320 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4844077312}
I20260709 12:24:11.751480 25837 raft_consensus.cc:2368] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 6. Current term is 7.
I20260709 12:24:11.756678 25836 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 2.
I20260709 12:24:11.769906 25830 raft_consensus.cc:3060] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:11.755863 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:11.687455 28482 consensus_queue.cc:1048] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 12:24:11.786860 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:11.790632 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:11.750661 28502 raft_consensus.cc:2804] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:11.794142 25686 raft_consensus.cc:2468] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 4.
W20260709 12:24:11.819250 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 157344us
I20260709 12:24:11.830881 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:11.774868 28395 raft_consensus.cc:2804] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:11.837587 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:11.867647 25682 raft_consensus.cc:2468] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 6.
I20260709 12:24:11.748313 28370 consensus_queue.cc:1059] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
W20260709 12:24:11.792835 28463 consensus_meta.cc:287] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.554s	user 0.007s	sys 0.004s
W20260709 12:24:11.898720 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:11.842061 28438 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:11.857694 25830 raft_consensus.cc:2468] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 7.
I20260709 12:24:11.859997 28535 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:11.850309 25726 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:11.795590 28502 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:11.981221 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:11.931448 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:11.912286 26437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 722) took 1628 ms. Trace:
W20260709 12:24:12.167452 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:12.184803 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 530419us
W20260709 12:24:12.158022 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 146438us
I20260709 12:24:12.190858 25650 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:11.863770 25686 raft_consensus.cc:3060] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:12.195871 28478 consensus_meta.cc:287] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.570s	user 0.006s	sys 0.003s
I20260709 12:24:12.196367 28597 raft_consensus.cc:2749] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:12.196353 28478 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:11.905707 28369 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:12.198603 28478 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:12.198949 28535 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:12.165131 28395 raft_consensus.cc:697] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 7 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
W20260709 12:24:12.199779 28593 log.cc:927] Time spent T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.178s	user 0.000s	sys 0.000s
I20260709 12:24:12.200469 28395 consensus_queue.cc:237] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:12.201538 28382 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:11.969192 28551 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:11.901710 28392 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:11.864188 28544 consensus_queue.cc:1048] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.340s
I20260709 12:24:12.204583 28502 raft_consensus.cc:3060] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:11.937430 28591 log.cc:927] Time spent T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:24:12.206526 25679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2017) took 1128 ms. Trace:
I20260709 12:24:12.206924 25679 rpcz_store.cc:276] 0709 12:24:11.078182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.090431 (+ 12249us) service_pool.cc:224] Handling call
0709 12:24:11.177871 (+ 87440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:11.178314 (+   443us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:11.178355 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:11.256020 (+ 77665us) spinlock_profiling.cc:243] Waited 1.21 ms on lock 0x7b2c00013008. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9845aa11 00007f5d9846a372 00007f5d99b9ca01 00007f5d99b6143a 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2
0709 12:24:11.256614 (+   594us) log.cc:844] Serialized 26 byte log entry
0709 12:24:11.651314 (+394700us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:11.655419 (+  4105us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:11.688047 (+ 32628us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:12.206206 (+518159us) raft_consensus.cc:1685] finished
0709 12:24:12.206232 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:12.206460 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":45523,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":97,"spinlock_wait_cycles":2777344,"thread_start_us":377732,"threads_started":1,"wal-append.queue_time_us":473569}
I20260709 12:24:12.208853 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:12.209455 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:12.210112 25683 raft_consensus.cc:3060] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:12.030902 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 277256us
I20260709 12:24:12.212258 25679 raft_consensus.cc:1240] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:12.214334 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 364089us
I20260709 12:24:12.215468 28594 raft_consensus.cc:2804] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:12.215544 25726 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:12.214459 26401 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:24:11.904206 28598 log.cc:927] Time spent T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 12:24:12.207540 28568 consensus_meta.cc:287] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.508s	user 0.007s	sys 0.000s
I20260709 12:24:12.222764 25650 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:12.223701 25650 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:12.188125 26437 rpcz_store.cc:276] 0709 12:24:10.284061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.388261 (+1104200us) service_pool.cc:224] Handling call
0709 12:24:11.405893 (+ 17632us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:11.406302 (+   409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:11.406343 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:11.421546 (+ 15203us) log.cc:844] Serialized 26 byte log entry
0709 12:24:11.659426 (+237880us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:11.659466 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:11.659528 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:11.911991 (+252463us) raft_consensus.cc:1685] finished
0709 12:24:11.912019 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:11.912209 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9375,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":6742,"thread_start_us":193209,"threads_started":1,"wal-append.queue_time_us":341418}
I20260709 12:24:12.232793 25650 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:12.228287 28412 consensus_queue.cc:1048] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
W20260709 12:24:12.243939 28586 log.cc:927] Time spent T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.949s	user 0.000s	sys 0.020s
I20260709 12:24:12.246807 25754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 2503) took 1147 ms. Trace:
I20260709 12:24:12.255124 25686 raft_consensus.cc:2468] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 5.
I20260709 12:24:12.275339 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:12.276224 25686 raft_consensus.cc:2468] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 7.
I20260709 12:24:12.238965 28526 raft_consensus.cc:2804] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:12.288316 28526 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:12.288769 28526 raft_consensus.cc:3060] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:12.239775 28582 raft_consensus.cc:2804] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:12.292536 28582 raft_consensus.cc:697] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 5 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:12.293710 28582 consensus_queue.cc:237] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:12.240381 28578 raft_consensus.cc:2749] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:12.239233 28487 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:12.299042 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:12.216018 28594 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:12.247512 25754 rpcz_store.cc:276] 0709 12:24:11.098987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.099163 (+   176us) service_pool.cc:224] Handling call
0709 12:24:11.186374 (+ 87211us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:11.186723 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:11.186752 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:11.187303 (+   551us) log.cc:844] Serialized 52 byte log entry
0709 12:24:11.294187 (+106884us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:11.298106 (+  3919us) log.cc:844] Serialized 14 byte log entry
0709 12:24:11.298865 (+   759us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:11.298935 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:12.243343 (+944408us) spinlock_profiling.cc:243] Waited 27.8 ms on lock 0x7b4400022b4c. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db 00007f5d99708aaf 00007f5d996fc86e 00007f5d996fbbb6 00007f5d996fb7d8 00007f5d99705221 00007f5d997051d9 00007f5d99705169
0709 12:24:12.246351 (+  3008us) raft_consensus.cc:1685] finished
0709 12:24:12.246487 (+   136us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:12.246701 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6749,"prepare.queue_time_us":3326,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"raft.queue_time_us":14155,"raft.run_cpu_time_us":271,"raft.run_wall_time_us":38917,"spinlock_wait_cycles":63873792,"thread_start_us":110002,"threads_started":2,"wal-append.queue_time_us":106859}
I20260709 12:24:12.313500 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:12.322547 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:12.315557 28557 consensus_meta.cc:287] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.706s	user 0.010s	sys 0.000s
I20260709 12:24:12.189978 28463 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:12.314738 28590 raft_consensus.cc:2804] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:12.321942 28594 raft_consensus.cc:3060] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:12.323884 28477 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:12.372198 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:12.390275 25677 raft_consensus.cc:2393] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 4: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:12.372815 28608 raft_consensus.cc:2749] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:12.366382 28557 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:12.409528 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:12.395273 28590 raft_consensus.cc:697] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 6 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:12.426858 25683 raft_consensus.cc:2468] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 7.
I20260709 12:24:12.403476 28605 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:12.472914 28605 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:12.477190 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:12.478193 25756 raft_consensus.cc:2393] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 7: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:12.480001 28605 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:12.480722 28605 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:12.480472 28590 consensus_queue.cc:237] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:12.481407 28605 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:12.443754 25682 raft_consensus.cc:1240] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 4. Current term is 5. Ops: []
W20260709 12:24:12.452598 28606 log.cc:927] Time spent T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:24:12.489797 28502 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:12.491374 28607 log.cc:927] Time spent T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:24:12.493178 28557 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:12.493746 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:12.494879 25683 raft_consensus.cc:1275] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:12.499357 25684 raft_consensus.cc:1275] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:12.509744 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:12.534684 26439 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:12.535007 25756 raft_consensus.cc:2468] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 6.
I20260709 12:24:12.511261 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:12.536211 25757 raft_consensus.cc:2393] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 6: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:12.538224 28605 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:12.536914 26401 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:12.241154 28568 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:12.491503 28525 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:12.547380 26402 connection.cc:256] RPC call timeout handler was delayed by -1.1340874440002153s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21120000000000003s for a response
W20260709 12:24:12.548648 26402 connection.cc:256] RPC call timeout handler was delayed by -1.1340874440002153s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21120000000000003s for a response
W20260709 12:24:12.549248 26402 connection.cc:256] RPC call timeout handler was delayed by -1.0202207259999341s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2109s for a response
I20260709 12:24:12.552439 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:12.561939 25685 raft_consensus.cc:1275] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:12.564601 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:12.542690 28592 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:12.567018 25681 raft_consensus.cc:2393] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 6: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:12.568763 28592 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:12.569993 28559 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:12.571583 28592 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:12.572186 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:12.578128 25831 raft_consensus.cc:2376] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 5. Re-sending same reply.
W20260709 12:24:12.564895 28258 consensus_meta.cc:287] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.804s	user 0.012s	sys 0.000s
I20260709 12:24:12.563148 28611 raft_consensus.cc:2804] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:12.582310 25726 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:12.584437 26431 raft_consensus.cc:1275] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:24:12.585095 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:12.587296 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:12.587497 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:12.588653 26438 raft_consensus.cc:2468] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 5.
I20260709 12:24:12.587234 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:12.563611 28395 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:12.589568 25754 raft_consensus.cc:2468] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 8.
I20260709 12:24:12.594991 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:12.598398 25726 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:12.599336 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:12.599469 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:12.599790 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:12.600625 25831 raft_consensus.cc:2393] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 10: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:12.600865 25680 raft_consensus.cc:2393] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 6: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:12.595826 26401 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:12.602790 25726 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:12.609475 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:12.610260 25763 raft_consensus.cc:2468] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 5.
I20260709 12:24:12.588263 28611 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:12.615897 28481 raft_consensus.cc:2804] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:12.618571 25754 raft_consensus.cc:1240] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:12.618412 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:12.624646 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:12.576203 28525 consensus_queue.cc:1059] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:24:12.624496 25680 raft_consensus.cc:1240] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:24:12.625283 25754 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 4.
I20260709 12:24:12.626847 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:12.631264 25831 raft_consensus.cc:2393] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 3: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:12.609663 28544 raft_consensus.cc:2804] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:12.607331 28412 raft_consensus.cc:2804] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:12.589584 28592 consensus_queue.cc:1059] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:24:12.626989 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:12.619717 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:12.624476 28559 raft_consensus.cc:2804] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:12.636353 28373 raft_consensus.cc:3055] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:12.638969 28502 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:12.602958 28395 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:12.647899 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:12.647796 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:12.639840 25682 raft_consensus.cc:1240] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:12.597406 28613 consensus_queue.cc:1048] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:24:12.640101 28412 raft_consensus.cc:697] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:12.652697 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:12.622327 28611 raft_consensus.cc:3060] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:12.588140 28258 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:12.635574 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:12.642292 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:12.643256 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:12.644140 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:12.652052 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:12.656370 25836 raft_consensus.cc:2468] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 5.
I20260709 12:24:12.640017 28568 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:12.644790 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:12.658391 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:12.645889 26439 raft_consensus.cc:2468] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 6.
I20260709 12:24:12.622860 28481 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:12.652148 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:12.640444 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:12.654564 25684 raft_consensus.cc:2468] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 5.
I20260709 12:24:12.634536 28544 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:12.659355 25685 raft_consensus.cc:2410] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:24:12.646965 28559 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:12.648293 28616 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:12.648065 28373 raft_consensus.cc:740] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:12.789752 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:12.709424 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:12.740352 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:12.660522 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:12.798485 25754 raft_consensus.cc:2376] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 7. Re-sending same reply.
W20260709 12:24:12.733378 25569 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 5aae9f34f7154346afd482b3183ee180 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5cccf20a8bff46dba6601f241d172b8a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:24:12.709805 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
W20260709 12:24:12.799772 25569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 66454.3us
I20260709 12:24:12.798784 26430 raft_consensus.cc:2393] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 6: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:12.660995 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:12.801017 25831 raft_consensus.cc:2393] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 6: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:12.801200 25682 raft_consensus.cc:3060] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:12.705889 26439 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 763) took 3021 ms (client timeout 1772 ms). Trace:
I20260709 12:24:12.798579 25760 raft_consensus.cc:3060] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:12.658389 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 62659.9us
W20260709 12:24:12.802368 26439 rpcz_store.cc:269] 0709 12:24:09.637988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:10.149479 (+511491us) service_pool.cc:224] Handling call
0709 12:24:12.493604 (+2344125us) spinlock_profiling.cc:243] Waited 4.5 ms on lock 0x7b5800004598. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d96a3cb71 00007f5d96a3ca22 00007f5d9f9558d9 00007f5d9eaafee0 00007f5d9eb790ab 00007f5d9eb79131 00007f5d9eb270a0 00007f5d9eb26984 00007f5d980a16d4 00007f5d980a1662
0709 12:24:12.659648 (+166044us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10342784}
I20260709 12:24:12.800295 25756 raft_consensus.cc:2393] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 4: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
W20260709 12:24:12.673873 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:12.737205 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:12.817224 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:12.821686 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:12.822602 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:12.824204 25686 raft_consensus.cc:2393] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 7: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:12.824357 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:12.824987 25681 raft_consensus.cc:2468] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 5.
I20260709 12:24:12.826864 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:12.816493 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:12.828823 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:12.770843 28613 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:12.763437 25679 raft_consensus.cc:1240] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 11. Current term is 12. Ops: []
I20260709 12:24:12.789220 28258 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:12.741034 28576 log.cc:927] Time spent T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 1.496s	user 0.009s	sys 0.028s
I20260709 12:24:12.769486 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:12.809644 28481 raft_consensus.cc:3060] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:12.832283 26430 raft_consensus.cc:2393] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 4: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:12.811362 28559 raft_consensus.cc:3060] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:12.734128 26432 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 771) took 3088 ms (client timeout 2091 ms). Trace:
I20260709 12:24:12.864662 25833 raft_consensus.cc:1275] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:24:12.796669 28483 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:12.840320 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:12.842378 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:12.810540 28544 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:12.844647 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:12.844803 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:12.845454 25682 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 2.
W20260709 12:24:12.846081 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 243384us
I20260709 12:24:12.852706 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:12.841365 28613 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:12.711042 28594 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:12.857048 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:12.866382 25686 raft_consensus.cc:2393] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 6: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:12.867269 25761 raft_consensus.cc:3060] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:24:12.861052 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:12.866979 25756 raft_consensus.cc:2393] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 4: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:12.844448 28531 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:12.858574 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:12.874698 25830 raft_consensus.cc:2468] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 4.
I20260709 12:24:12.870335 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:12.870335 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:12.876536 25836 raft_consensus.cc:1275] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:12.876547 25829 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:12.732337 28412 consensus_queue.cc:237] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:12.868113 25726 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:12.872215 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:12.868471 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:12.817735 28616 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:12.873575 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
W20260709 12:24:12.881429 25650 connection.cc:256] RPC call timeout handler was delayed by -3.0488391320000119s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17720000000000002s for a response
W20260709 12:24:12.888317 25650 connection.cc:256] RPC call timeout handler was delayed by -2.9088959929999874s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18810000000000002s for a response
W20260709 12:24:12.888899 25650 connection.cc:256] RPC call timeout handler was delayed by -2.5241913410000052s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20910000000000004s for a response
W20260709 12:24:12.889226 25650 connection.cc:256] RPC call timeout handler was delayed by -1.8257036479999442s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1514s for a response
W20260709 12:24:12.889619 25650 connection.cc:256] RPC call timeout handler was delayed by -1.8014036479999049s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15410000000000001s for a response
W20260709 12:24:12.889921 25650 connection.cc:256] RPC call timeout handler was delayed by -1.6601036479996765s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1698s for a response
W20260709 12:24:12.890439 25650 connection.cc:256] RPC call timeout handler was delayed by -1.649303647999659s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.171s for a response
W20260709 12:24:12.890764 25650 connection.cc:256] RPC call timeout handler was delayed by -1.5629036479999741s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1806s for a response
I20260709 12:24:12.891460 25650 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:12.892362 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:12.893450 25763 raft_consensus.cc:2376] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 4. Re-sending same reply.
I20260709 12:24:12.894897 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:12.896123 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:12.896533 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:12.898087 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:12.898234 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:12.898728 25762 raft_consensus.cc:2468] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 5.
I20260709 12:24:12.900451 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:12.900883 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:12.901273 25834 raft_consensus.cc:2468] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 5.
I20260709 12:24:12.902427 25650 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:12.881954 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:12.902809 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:12.903614 25836 raft_consensus.cc:3060] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:12.904255 25830 raft_consensus.cc:2410] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:24:12.883281 25756 raft_consensus.cc:2468] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 7.
I20260709 12:24:12.885852 25833 raft_consensus.cc:2393] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 5: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:12.905444 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:12.853186 28373 consensus_queue.cc:260] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:12.908073 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
W20260709 12:24:12.864681 26432 rpcz_store.cc:269] 0709 12:24:09.645254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:10.211008 (+565754us) service_pool.cc:224] Handling call
0709 12:24:12.733861 (+2522853us) spinlock_profiling.cc:243] Waited 687 ms on lock 0x7b54006126d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:12.734038 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1579113728}
I20260709 12:24:12.902427 25726 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:12.919724 25726 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:12.921233 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:12.922109 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:12.910184 25761 raft_consensus.cc:2468] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 7.
I20260709 12:24:12.925046 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:12.911284 25650 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:12.907980 28373 raft_consensus.cc:3060] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:12.913516 28628 raft_consensus.cc:2804] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:12.914543 28613 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:12.917464 28616 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:12.968760 25800 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:12.971019 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:12.974789 25759 raft_consensus.cc:1240] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 LEADER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:12.866008 25760 raft_consensus.cc:2468] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 6.
I20260709 12:24:12.963768 25829 raft_consensus.cc:2410] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
W20260709 12:24:12.964883 25649 leader_election.cc:336] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Timed out: RequestConsensusVote RPC to 127.23.245.130:37267 timed out after 1.881s (SENT)
I20260709 12:24:12.924015 28582 raft_consensus.cc:2804] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:12.940424 25756 raft_consensus.cc:2393] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 7: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:12.956645 26437 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 4 LEARNER]: Advancing to term 6
I20260709 12:24:12.919724 28590 raft_consensus.cc:2749] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:12.960386 25831 raft_consensus.cc:1240] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 5 LEADER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:12.937121 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:12.946542 25762 raft_consensus.cc:1275] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:24:12.983050 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:12.983574 25762 raft_consensus.cc:2468] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 4.
I20260709 12:24:12.982661 28369 raft_consensus.cc:2804] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:12.967859 25836 raft_consensus.cc:2468] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 4.
I20260709 12:24:12.884696 28531 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:12.974011 28630 consensus_queue.cc:1048] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:24:12.976799 28628 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:12.968838 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:12.984246 28369 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:12.997695 28369 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:12.998919 28526 consensus_meta.cc:287] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.710s	user 0.006s	sys 0.006s
I20260709 12:24:13.001849 26432 raft_consensus.cc:1240] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:12.997728 28631 log.cc:927] Time spent T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 12:24:13.004671 25832 raft_consensus.cc:2468] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 5.
I20260709 12:24:13.006234 26437 raft_consensus.cc:1275] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 6 LEARNER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:24:12.968838 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 49217.6us
I20260709 12:24:12.978102 25800 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
W20260709 12:24:12.974136 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 62994us
I20260709 12:24:13.007467 28534 raft_consensus.cc:2804] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:13.007592 25650 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:13.007905 28534 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:13.008373 28534 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:13.008447 28258 raft_consensus.cc:2764] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:24:13.009239 28628 raft_consensus.cc:3060] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:13.009449 28572 log.cc:927] Time spent T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 1.773s	user 0.013s	sys 0.022s
I20260709 12:24:13.010604 26436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 719) took 2846 ms. Trace:
I20260709 12:24:13.010972 26436 rpcz_store.cc:276] 0709 12:24:10.164719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:10.979216 (+814497us) service_pool.cc:224] Handling call
0709 12:24:11.008485 (+ 29269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:11.008946 (+   461us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:11.008978 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:11.009585 (+   607us) log.cc:844] Serialized 26 byte log entry
0709 12:24:11.032749 (+ 23164us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:11.351389 (+318640us) log.cc:844] Serialized 14 byte log entry
0709 12:24:11.351668 (+   279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:11.351750 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:11.579137 (+227387us) spinlock_profiling.cc:243] Waited 1.11 ms on lock 0x7b180019b280. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d96a422a6 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db
0709 12:24:13.008915 (+1429778us) spinlock_profiling.cc:243] Waited 30.3 ms on lock 0x7b4400022b4c. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db 00007f5d99708aaf 00007f5d996fc86e 00007f5d996fbbb6 00007f5d996fb7d8 00007f5d99705221 00007f5d997051d9 00007f5d99705169
0709 12:24:13.010396 (+  1481us) raft_consensus.cc:1685] finished
0709 12:24:13.010419 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:13.010547 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":98798,"prepare.queue_time_us":197372,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":172,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":1981,"spinlock_wait_cycles":72316544,"thread_start_us":179492,"threads_started":2,"wal-append.queue_time_us":170425}
W20260709 12:24:13.013574 25837 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44218 (request call id 1448) took 1502 ms (client timeout 1766 ms). Trace:
I20260709 12:24:13.013722 25649 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
W20260709 12:24:13.014000 25837 rpcz_store.cc:269] 0709 12:24:11.511616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.511844 (+   228us) service_pool.cc:224] Handling call
0709 12:24:13.013399 (+1501555us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b5400118354. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:13.013519 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":495510272}
I20260709 12:24:13.015291 25649 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
W20260709 12:24:12.989720 28573 log.cc:927] Time spent T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 1.758s	user 0.010s	sys 0.022s
I20260709 12:24:13.016213 28590 raft_consensus.cc:2749] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:13.016896 28590 raft_consensus.cc:3060] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:13.017388 25835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41782 (request call id 620) took 2137 ms. Trace:
W20260709 12:24:12.988749 28627 log.cc:927] Time spent T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 12:24:13.017812 25835 rpcz_store.cc:276] 0709 12:24:10.879852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:10.982229 (+102377us) service_pool.cc:224] Handling call
0709 12:24:10.982524 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:11.001466 (+ 18942us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:11.001499 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:11.020465 (+ 18966us) log.cc:844] Serialized 26 byte log entry
0709 12:24:11.191200 (+170735us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:11.191236 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:11.191299 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:12.989074 (+1797775us) spinlock_profiling.cc:243] Waited 28.7 ms on lock 0x7b4400022b4c. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db 00007f5d99708aaf 00007f5d996fc86e 00007f5d996fbbb6 00007f5d996fb7d8 00007f5d99705221 00007f5d997051d9 00007f5d99705169
0709 12:24:13.017100 (+ 28026us) raft_consensus.cc:1685] finished
0709 12:24:13.017121 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:13.017326 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6292,"raft.queue_time_us":16900,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":5322,"spinlock_wait_cycles":66097024,"thread_start_us":53608,"threads_started":1,"wal-append.queue_time_us":175293}
I20260709 12:24:13.020516 25649 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:13.022112 25677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40230 (request call id 1371) took 1739 ms. Trace:
I20260709 12:24:13.010030 25650 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:13.022480 25677 rpcz_store.cc:276] 0709 12:24:11.282881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.312889 (+ 30008us) service_pool.cc:224] Handling call
0709 12:24:13.021927 (+1709038us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54002cf6d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:13.022054 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2452840320}
I20260709 12:24:13.023655 28543 raft_consensus.cc:3055] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:13.024055 28543 raft_consensus.cc:740] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:13.024140 28597 raft_consensus.cc:2804] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:13.024628 28597 raft_consensus.cc:697] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 4 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:13.024953 28543 consensus_queue.cc:260] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:13.025517 28597 consensus_queue.cc:237] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:13.026432 28543 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:12.981048 28582 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:12.976341 28568 raft_consensus.cc:2764] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:24:12.984938 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:12.992767 26434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 718) took 2883 ms. Trace:
I20260709 12:24:12.976569 28634 raft_consensus.cc:2804] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:13.043318 26434 rpcz_store.cc:276] 0709 12:24:10.109261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:10.959870 (+850609us) service_pool.cc:224] Handling call
0709 12:24:10.972971 (+ 13101us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:11.398411 (+425440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:11.398453 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:11.415387 (+ 16934us) log.cc:844] Serialized 26 byte log entry
0709 12:24:11.730256 (+314869us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:24:11.792085 (+ 61829us) log.cc:844] Serialized 14 byte log entry
0709 12:24:12.030628 (+238543us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:12.985097 (+954469us) spinlock_profiling.cc:243] Waited 344 ms on lock 0x7b540078df54. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:12.985140 (+    43us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:12.985183 (+    43us) raft_consensus.cc:1685] finished
0709 12:24:12.992554 (+  7371us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:12.992702 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10164,"prepare.queue_time_us":65043,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":7085,"raft.queue_time_us":413203,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":170,"spinlock_wait_cycles":792118528,"thread_start_us":515485,"threads_started":2,"wal-append.queue_time_us":483407}
I20260709 12:24:12.968585 25761 raft_consensus.cc:2410] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 7 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:12.976315 28592 raft_consensus.cc:2804] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:13.017554 28594 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:12.992051 26435 raft_consensus.cc:1240] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:24:13.050443 25758 raft_consensus.cc:1275] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:24:13.052408 25758 pending_rounds.cc:85] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 2
I20260709 12:24:13.052677 25758 pending_rounds.cc:107] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:24:13.052961 25758 raft_consensus.cc:2889] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:13.037204 28531 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:13.037695 25763 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 8.
I20260709 12:24:13.037952 28395 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:13.038128 28637 consensus_queue.cc:1048] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:24:13.006960 28369 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:13.066229 28481 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:13.066794 28369 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:13.067395 28369 consensus_queue.cc:1048] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:12.999389 28526 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:13.070555 28526 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:13.071300 25754 raft_consensus.cc:1240] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:13.048245 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:12.980412 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:13.073508 25760 raft_consensus.cc:1240] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:13.072702 28559 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:13.048458 25833 raft_consensus.cc:1275] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:24:13.056910 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:13.058156 25756 raft_consensus.cc:1275] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:13.063654 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:13.028374 28258 raft_consensus.cc:2804] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:13.068312 25762 raft_consensus.cc:1240] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:13.068624 28481 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:13.041342 28582 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:13.078298 25835 raft_consensus.cc:2393] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 7: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:13.079856 26430 raft_consensus.cc:1240] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:13.027766 28611 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:13.087463 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 77510.9us
I20260709 12:24:13.045425 28634 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:13.096203 28540 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:13.096868 28634 raft_consensus.cc:3060] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:13.098592 28621 log.cc:927] Time spent T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.453s	user 0.001s	sys 0.000s
W20260709 12:24:13.101666 28632 log.cc:927] Time spent T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.187s	user 0.000s	sys 0.002s
I20260709 12:24:13.093281 25650 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:13.115896 26439 raft_consensus.cc:2393] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 7: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:13.085007 28592 raft_consensus.cc:697] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
W20260709 12:24:13.117986 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 84615.5us
I20260709 12:24:13.125289 25649 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:13.131563 28463 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:13.112857 28258 raft_consensus.cc:697] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 7 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
W20260709 12:24:13.133339 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 90910us
I20260709 12:24:13.105392 28534 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:13.105880 28544 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:13.111533 28168 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.875s	user 0.011s	sys 0.033s
I20260709 12:24:13.151875 25726 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
W20260709 12:24:13.153679 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:13.144783 28628 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:13.154338 25726 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:13.155131 28613 raft_consensus.cc:2764] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:24:13.155609 28628 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:13.155887 28613 raft_consensus.cc:2804] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:13.156255 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:13.156644 28613 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:13.157102 26436 raft_consensus.cc:2393] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 7: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:13.155857 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:13.158488 25726 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:13.156508 28592 consensus_queue.cc:237] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:13.160144 25726 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:13.164968 28628 raft_consensus.cc:2749] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:13.161639 25649 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:13.161585 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:24:13.149806 28168 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.913s	user 0.012s	sys 0.033s
I20260709 12:24:13.167188 25649 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:13.165452 25726 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:13.145133 28559 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:13.166286 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:13.157076 28613 raft_consensus.cc:3060] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:13.165963 28481 raft_consensus.cc:2804] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:13.171514 25759 raft_consensus.cc:1240] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:13.177862 28645 raft_consensus.cc:2804] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:13.172293 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:13.213138 28645 raft_consensus.cc:697] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 7 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:13.213323 28525 raft_consensus.cc:3055] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:13.158034 28463 raft_consensus.cc:2804] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:13.213768 28525 raft_consensus.cc:740] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:13.214016 28463 raft_consensus.cc:697] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 10 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:13.214668 28525 consensus_queue.cc:260] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:13.214916 28463 consensus_queue.cc:237] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:13.214282 28645 consensus_queue.cc:237] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:13.173265 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:13.173859 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:13.217290 28571 log.cc:927] Time spent T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 1.978s	user 0.005s	sys 0.038s
I20260709 12:24:13.217790 28527 raft_consensus.cc:3055] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:13.218032 28597 consensus_queue.cc:1059] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:13.219152 28597 raft_consensus.cc:3055] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:13.219478 28597 raft_consensus.cc:740] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:13.220230 25828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41782 (request call id 614) took 2665 ms. Trace:
I20260709 12:24:13.220363 28597 consensus_queue.cc:260] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:13.221603 28597 raft_consensus.cc:3060] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:13.220649 25828 rpcz_store.cc:276] 0709 12:24:10.555060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:10.960812 (+405752us) service_pool.cc:224] Handling call
0709 12:24:10.974046 (+ 13234us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:10.974371 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:10.974396 (+    25us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:10.974942 (+   546us) log.cc:844] Serialized 52 byte log entry
0709 12:24:11.084675 (+109733us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:11.207750 (+123075us) log.cc:844] Serialized 14 byte log entry
0709 12:24:11.221985 (+ 14235us) log.cc:844] Serialized 14 byte log entry
0709 12:24:11.354897 (+132912us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:11.355007 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:13.156288 (+1801281us) spinlock_profiling.cc:243] Waited 1.32 ms on lock 0x7b18004703e0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d96a422a6 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db
0709 12:24:13.216411 (+ 60123us) spinlock_profiling.cc:243] Waited 27.7 ms on lock 0x7b4400022b4c. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db 00007f5d99708aaf 00007f5d996fc86e 00007f5d996fbbb6 00007f5d996fb7d8 00007f5d99705221 00007f5d997051d9 00007f5d99705169
0709 12:24:13.219997 (+  3586us) raft_consensus.cc:1685] finished
0709 12:24:13.220020 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:13.220153 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":180744,"prepare.queue_time_us":113562,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":89,"raft.queue_time_us":98636,"raft.run_cpu_time_us":353,"raft.run_wall_time_us":24270,"spinlock_wait_cycles":66852480,"thread_start_us":152188,"threads_started":2,"wal-append.queue_time_us":204078}
I20260709 12:24:13.209146 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:13.179196 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:13.209854 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:13.225790 26433 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:13.177847 28634 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:13.228295 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:24:13.183290 28600 log.cc:927] Time spent T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 1.321s	user 0.019s	sys 0.008s
I20260709 12:24:13.184456 28649 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:13.217353 25679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2032) took 1378 ms. Trace:
I20260709 12:24:13.229601 28649 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:13.229712 25679 rpcz_store.cc:276] 0709 12:24:11.839534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:12.214104 (+374570us) service_pool.cc:224] Handling call
0709 12:24:12.362305 (+148201us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:12.845355 (+483050us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:13.216998 (+371643us) spinlock_profiling.cc:243] Waited 368 ms on lock 0x7b54002657d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:13.217294 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":845953792}
I20260709 12:24:13.230351 25755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48606 (request call id 683) took 1550 ms. Trace:
I20260709 12:24:13.180503 28168 raft_consensus.cc:2804] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:13.231657 28168 raft_consensus.cc:697] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 6 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:13.230722 25755 rpcz_store.cc:276] 0709 12:24:11.679899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.680048 (+   149us) service_pool.cc:224] Handling call
0709 12:24:11.680416 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:11.680833 (+   417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:11.680874 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:11.681457 (+   583us) log.cc:844] Serialized 26 byte log entry
0709 12:24:11.709356 (+ 27899us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:11.709416 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:11.709518 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:13.182711 (+1473193us) spinlock_profiling.cc:243] Waited 2.83 ms on lock 0x7b4400022b4c. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db 00007f5d99708aaf 00007f5d996fc86e 00007f5d996fbbb6 00007f5d996fb7d8 00007f5d99705221 00007f5d997051d9 00007f5d99705169
0709 12:24:13.230082 (+ 47371us) raft_consensus.cc:1685] finished
0709 12:24:13.230102 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:13.230296 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1323,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":96,"spinlock_wait_cycles":6501632,"thread_start_us":27423,"threads_started":1,"wal-append.queue_time_us":79525}
I20260709 12:24:13.232579 28168 consensus_queue.cc:237] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:13.176756 28641 raft_consensus.cc:2804] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:13.234647 28641 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:13.189213 28625 log.cc:927] Time spent T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.405s	user 0.001s	sys 0.001s
I20260709 12:24:13.191264 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:13.236011 25682 raft_consensus.cc:2393] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 7: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:13.192783 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:13.195243 28544 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:13.196452 28590 raft_consensus.cc:2749] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:13.196666 25726 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:13.197379 28637 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:13.197813 28633 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:13.147854 28543 consensus_queue.cc:1059] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 12:24:13.206357 25683 raft_consensus.cc:1275] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:13.207492 28534 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:13.212486 28481 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:13.218297 28527 raft_consensus.cc:740] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:13.188314 28258 consensus_queue.cc:237] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:13.190208 28611 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:13.235152 28641 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:13.241456 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 44882.4us
I20260709 12:24:13.241501 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:13.247707 28373 consensus_queue.cc:1048] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:13.252354 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:13.253113 26438 raft_consensus.cc:1275] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:13.245049 28544 raft_consensus.cc:2749] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:13.253995 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:13.236920 28525 raft_consensus.cc:3060] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:13.252413 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:13.274515 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:13.274816 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 181649us
I20260709 12:24:13.295004 26437 raft_consensus.cc:2393] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 4: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:13.295217 25650 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:13.276767 28481 raft_consensus.cc:3060] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:13.301241 25650 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:13.253070 28633 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:13.288074 26436 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 4.
I20260709 12:24:13.252980 28582 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:24:13.277431 26433 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 7.
W20260709 12:24:13.288204 26402 leader_election.cc:336] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 1.581s (SENT)
I20260709 12:24:13.292774 25726 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:24:13.289314 28534 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:13.311398 26402 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:13.312330 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:13.311091 25726 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:13.303990 28477 raft_consensus.cc:2749] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:13.316716 26401 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:13.316779 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:13.320179 26434 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:13.320927 26401 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:24:13.320009 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 170439us
I20260709 12:24:13.324608 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:13.308154 28634 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:13.318465 26435 raft_consensus.cc:2393] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 5: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:13.325222 26436 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 10.
I20260709 12:24:13.311813 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:13.315716 28544 raft_consensus.cc:2804] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:13.366513 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:13.367841 25755 raft_consensus.cc:3060] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:13.369117 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:13.369879 25758 raft_consensus.cc:2393] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 7: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
W20260709 12:24:13.368470 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 49922.2us
I20260709 12:24:13.362967 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:13.326503 28592 raft_consensus.cc:2749] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:13.313447 28611 raft_consensus.cc:2749] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:13.327291 28280 raft_consensus.cc:2804] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:13.339564 25726 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:13.315543 28534 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:13.370756 26432 raft_consensus.cc:2393] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 4: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:13.366587 28608 consensus_queue.cc:1059] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:24:13.328788 28463 raft_consensus.cc:2804] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:24:13.371366 28574 log.cc:927] Time spent T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 2.095s	user 0.015s	sys 0.019s
I20260709 12:24:13.325409 28255 raft_consensus.cc:2804] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:13.385231 26437 raft_consensus.cc:3060] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:13.327952 28559 consensus_queue.cc:1059] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:24:13.383488 26434 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 12.
W20260709 12:24:13.374303 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 71748.4us
I20260709 12:24:13.377187 25726 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:13.325551 28395 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:13.391505 25726 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:24:13.326160 28649 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:13.366055 28544 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:13.362448 28616 consensus_queue.cc:1059] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:24:13.381656 28463 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:13.384972 28543 raft_consensus.cc:2749] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:13.374984 28280 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:13.416910 25650 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:13.359743 28651 consensus_queue.cc:1048] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.086s
I20260709 12:24:13.373502 28626 consensus_queue.cc:1048] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:24:13.414832 25726 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:13.433315 25755 raft_consensus.cc:2468] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 9.
W20260709 12:24:13.434625 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 107480us
I20260709 12:24:13.414835 28397 raft_consensus.cc:2749] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:13.416092 28592 raft_consensus.cc:2804] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:13.419145 28544 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:13.418481 28540 consensus_queue.cc:1059] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
W20260709 12:24:13.470872 28656 log.cc:927] Time spent T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 12:24:13.462980 28568 raft_consensus.cc:2804] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:13.472397 28568 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:13.472864 28568 raft_consensus.cc:3060] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:13.458115 26437 raft_consensus.cc:2468] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 7.
I20260709 12:24:13.461107 25650 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:24:13.465126 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 50387.6us
I20260709 12:24:13.477137 25726 leader_election.cc:400] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237) with higher term. Message: Invalid argument: T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 6. Current term is 7.
I20260709 12:24:13.477442 25726 leader_election.cc:403] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:13.478322 25726 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:13.480281 25726 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:13.481297 25726 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:13.482522 25726 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:13.435889 28463 raft_consensus.cc:3060] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:13.484498 25800 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:13.492116 28630 raft_consensus.cc:2749] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:13.456511 28280 raft_consensus.cc:3060] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:13.424216 28649 consensus_queue.cc:1059] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 12:24:13.483877 28412 raft_consensus.cc:2749] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:13.521752 28671 consensus_queue.cc:1048] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:13.525013 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:13.505064 25650 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:13.427280 28395 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:13.584415 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 79437.4us
W20260709 12:24:13.582906 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 209152us
W20260709 12:24:13.585453 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 210330us
I20260709 12:24:13.586095 28395 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:13.484161 28531 raft_consensus.cc:2749] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:13.518893 28397 consensus_queue.cc:1059] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 12:24:13.500345 28669 consensus_queue.cc:1048] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.080s
I20260709 12:24:13.587960 28669 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:13.588454 28669 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:13.526870 28662 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:13.517164 28482 raft_consensus.cc:3055] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:13.483706 28634 raft_consensus.cc:2749] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237) with higher term. Message: Invalid argument: T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 6. Current term is 7.
I20260709 12:24:13.481370 28592 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
W20260709 12:24:13.577610 28654 log.cc:927] Time spent T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 12:24:13.444463 28660 consensus_queue.cc:1048] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.099s
I20260709 12:24:13.502874 28650 raft_consensus.cc:2804] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:13.518980 28255 raft_consensus.cc:697] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 7 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:13.569168 28540 consensus_queue.cc:1243] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer f82778701b464892aab92a752ed7ffdc log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:24:13.529235 28559 consensus_queue.cc:1243] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer 6e673265293d4e9a937dc45150aeb1b8 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:24:13.586352 26402 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:13.622041 26402 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:13.592350 25650 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:13.593539 26401 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:24:13.599485 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 78714.6us
I20260709 12:24:13.484802 28628 raft_consensus.cc:2749] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:13.522594 28502 consensus_queue.cc:1048] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 12:24:13.624889 25650 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:13.590559 28669 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:13.581678 28655 raft_consensus.cc:2804] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:13.597400 28483 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:13.597966 28373 raft_consensus.cc:2749] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:13.666903 28481 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:13.603984 28482 raft_consensus.cc:740] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
W20260709 12:24:13.668325 28664 log.cc:927] Time spent T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:24:13.500746 28670 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:13.670704 28670 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:13.670985 28641 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:13.672070 28648 raft_consensus.cc:2749] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:13.672513 25686 raft_consensus.cc:2393] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 7: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:13.673177 28641 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:13.673520 28670 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:13.674079 28670 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:13.674544 28670 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:13.620651 28543 raft_consensus.cc:2749] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:13.676545 25763 raft_consensus.cc:2393] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 6: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:13.677222 28534 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:13.679958 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 86433.9us
I20260709 12:24:13.684357 28280 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:13.686606 28280 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:13.687237 28280 raft_consensus.cc:2804] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:13.688787 28637 raft_consensus.cc:2749] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:13.656556 28655 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:13.690253 28655 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:13.692253 28667 raft_consensus.cc:2804] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:13.692857 28667 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:13.693307 28667 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:13.693513 28168 raft_consensus.cc:2749] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:13.696120 28544 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:13.644305 28255 consensus_queue.cc:237] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:13.624094 28650 raft_consensus.cc:697] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 5 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:13.702646 28650 consensus_queue.cc:237] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:13.664186 28634 consensus_queue.cc:1059] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:24:13.624133 28633 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:13.614830 28662 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:24:13.609730 28592 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:13.655767 28502 consensus_queue.cc:1243] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer f82778701b464892aab92a752ed7ffdc log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:24:13.607568 28582 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:13.666676 28483 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:13.643970 28604 consensus_queue.cc:1059] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
W20260709 12:24:13.819716 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 67784.7us
I20260709 12:24:13.823966 25754 raft_consensus.cc:1275] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:24:13.698879 25650 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:13.701138 28373 consensus_queue.cc:1048] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:24:13.687696 28280 raft_consensus.cc:697] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 9 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:13.614358 28649 consensus_queue.cc:1059] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.084s
I20260709 12:24:13.735944 28590 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:13.666725 28675 raft_consensus.cc:2749] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:13.745676 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:13.947252 25684 raft_consensus.cc:1240] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:13.948102 25680 raft_consensus.cc:2410] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:24:13.745906 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:13.948801 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:13.949649 25681 raft_consensus.cc:3060] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:13.956378 28628 raft_consensus.cc:3055] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:13.963821 28628 raft_consensus.cc:740] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:13.964083 28657 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:13.964881 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:13.964824 28628 consensus_queue.cc:260] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:13.965762 25679 raft_consensus.cc:3060] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:13.966378 28628 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:13.966238 28280 consensus_queue.cc:237] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:13.968477 25755 raft_consensus.cc:1240] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:13.970422 25758 raft_consensus.cc:1275] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:13.969529 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:13.970162 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:13.971076 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:13.957176 28648 consensus_queue.cc:1048] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 12:24:14.021668 25680 raft_consensus.cc:1240] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:13.946877 28168 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:14.019819 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:14.025161 25678 raft_consensus.cc:3060] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:13.994179 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 329160us
I20260709 12:24:14.024145 25680 raft_consensus.cc:1275] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:13.998864 28659 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.027771 28670 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:14.028123 28659 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:14.031877 28659 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:14.032272 28674 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.032569 28659 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.033033 28674 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:14.034322 28483 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:14.035578 28674 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:13.964742 28657 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:14.039569 28674 raft_consensus.cc:3055] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:14.040061 28674 raft_consensus.cc:740] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:14.041100 28674 consensus_queue.cc:260] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:14.042233 28657 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:14.044235 28670 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.044862 28670 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:14.045701 25801 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:14.047196 25801 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:14.048615 28534 raft_consensus.cc:2804] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:14.049173 28534 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:14.049630 28534 raft_consensus.cc:3060] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:14.052053 28544 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:14.024096 28168 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:14.053846 28662 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:14.054382 28168 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:13.971612 28590 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:14.057462 25800 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.049s	sys 0.136s
W20260709 12:24:14.057832 25800 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.049s	sys 0.136s
W20260709 12:24:14.058122 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 505515us
I20260709 12:24:14.032371 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:14.054448 28662 raft_consensus.cc:2749] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:14.033244 28659 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:13.969949 28633 raft_consensus.cc:3055] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:24:14.070966 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 44719.2us
I20260709 12:24:14.115069 26402 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:14.081429 25681 raft_consensus.cc:2468] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 7.
I20260709 12:24:14.086208 28590 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:13.969486 28582 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:14.088518 28653 log.cc:927] Time spent T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.809s	user 0.000s	sys 0.012s
I20260709 12:24:14.106635 28484 consensus_queue.cc:1059] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:14.107218 26430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 735) took 1532 ms. Trace:
I20260709 12:24:14.143682 26430 rpcz_store.cc:276] 0709 12:24:12.574778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:12.851864 (+277086us) service_pool.cc:224] Handling call
0709 12:24:12.852311 (+   447us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:13.080315 (+228004us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:14.107005 (+1026690us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b5400316ad4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:14.107159 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":522801920}
I20260709 12:24:14.025609 28373 raft_consensus.cc:2749] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:14.134938 25802 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.010s	sys 0.030s
W20260709 12:24:14.171514 25802 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.010s	sys 0.030s
W20260709 12:24:14.172705 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:14.135331 25725 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.014s	sys 0.026s
I20260709 12:24:13.729336 28613 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:14.174477 25725 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.014s	sys 0.026s
I20260709 12:24:14.208922 25761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 2520) took 1022 ms. Trace:
W20260709 12:24:14.213377 28652 log.cc:927] Time spent T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.935s	user 0.007s	sys 0.000s
I20260709 12:24:14.057897 28634 consensus_queue.cc:1059] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.125s
I20260709 12:24:14.214100 28482 consensus_queue.cc:260] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:14.214685 28634 raft_consensus.cc:3055] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:14.215034 28634 raft_consensus.cc:740] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:14.216084 28634 consensus_queue.cc:260] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
W20260709 12:24:14.219002 28568 consensus_meta.cc:287] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.746s	user 0.011s	sys 0.000s
I20260709 12:24:14.209513 25761 rpcz_store.cc:276] 0709 12:24:13.185989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:13.186120 (+   131us) service_pool.cc:224] Handling call
0709 12:24:13.186407 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:13.186602 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:13.186624 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:13.187045 (+   421us) log.cc:844] Serialized 26 byte log entry
0709 12:24:13.279292 (+ 92247us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:13.279316 (+    24us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:13.279364 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:14.087396 (+808032us) spinlock_profiling.cc:243] Waited 8.64 ms on lock 0x7b4400022b4c. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db 00007f5d99708aaf 00007f5d996fc86e 00007f5d996fbbb6 00007f5d996fb7d8 00007f5d99705221 00007f5d997051d9 00007f5d99705169
0709 12:24:14.208544 (+121148us) raft_consensus.cc:1685] finished
0709 12:24:14.208573 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:14.208838 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19876096,"thread_start_us":91889,"threads_started":1,"wal-append.queue_time_us":92259}
I20260709 12:24:14.223771 25684 raft_consensus.cc:3060] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:14.239310 25679 raft_consensus.cc:2468] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 5.
I20260709 12:24:14.114006 28633 raft_consensus.cc:740] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:14.265729 28614 raft_consensus.cc:3055] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:14.266234 28614 raft_consensus.cc:740] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:14.266547 28659 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:14.143857 28675 raft_consensus.cc:2749] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:14.269089 25801 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:24:14.096359 28463 consensus_meta.cc:287] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.553s	user 0.008s	sys 0.001s
I20260709 12:24:14.047745 28670 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:24:14.281418 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:14.283527 25726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:14.107013 28544 consensus_queue.cc:1048] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:24:14.285768 25726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:14.286593 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:14.142627 25678 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 6.
I20260709 12:24:14.219497 28568 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:14.265295 28534 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:14.290177 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:14.292904 25757 raft_consensus.cc:3060] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:14.291723 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:14.296104 25726 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:14.298395 25761 raft_consensus.cc:1275] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:24:14.300661 25726 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:24:14.279392 28258 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.021s	sys 0.002s
I20260709 12:24:14.276353 28634 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:14.305733 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:14.160372 28592 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:14.312666 25754 raft_consensus.cc:1240] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:14.175100 28582 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:14.337694 28582 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:14.339694 28592 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:14.340464 28592 raft_consensus.cc:2804] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:14.281965 28463 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:14.340932 28592 raft_consensus.cc:697] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:14.342489 25757 raft_consensus.cc:2468] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 5.
I20260709 12:24:14.342363 28592 consensus_queue.cc:237] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:14.343317 25762 raft_consensus.cc:1240] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:14.325184 25685 raft_consensus.cc:1240] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:24:14.303490 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:14.327666 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:14.310652 28258 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.021s	sys 0.002s
I20260709 12:24:14.267247 28614 consensus_queue.cc:260] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:14.346453 28614 raft_consensus.cc:3060] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:14.346691 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
W20260709 12:24:14.313410 25569 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 5aae9f34f7154346afd482b3183ee180 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5cccf20a8bff46dba6601f241d172b8a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
W20260709 12:24:14.328382 25788 heartbeater.cc:646] Failed to heartbeat to 127.23.245.190:45099 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.23.245.190:45099 timed out after 15.000s (SENT)
I20260709 12:24:14.328482 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:14.348753 25828 raft_consensus.cc:2393] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 7: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:14.328418 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:14.349448 25829 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:14.350071 25828 raft_consensus.cc:1275] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:14.329197 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:14.329351 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:14.330593 25830 raft_consensus.cc:1275] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:24:14.352916 28369 consensus_queue.cc:1059] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:14.331351 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:14.354013 25833 raft_consensus.cc:3060] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:14.355075 25801 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:14.356302 28568 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:14.356494 28369 raft_consensus.cc:2804] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:14.357672 28369 raft_consensus.cc:697] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 5 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:14.358814 28613 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:14.358516 28369 consensus_queue.cc:237] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:14.359251 25829 raft_consensus.cc:2468] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 8.
I20260709 12:24:14.331413 28670 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.331866 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:14.361979 25801 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:24:14.363377 28655 consensus_meta.cc:287] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.673s	user 0.007s	sys 0.000s
I20260709 12:24:14.363232 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:14.332237 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:14.303901 28681 consensus_queue.cc:1059] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:24:14.369329 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:14.333362 28680 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:14.332839 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:14.371675 25760 raft_consensus.cc:2393] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 3: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:14.344794 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:14.330602 28484 raft_consensus.cc:2749] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:14.342806 28463 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:14.343358 25683 raft_consensus.cc:1240] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:24:14.282321 28669 raft_consensus.cc:2804] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:14.324699 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:14.332834 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:14.367553 26401 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:14.333931 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:14.370775 25758 raft_consensus.cc:2393] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 8: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:14.372388 25757 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 10.
I20260709 12:24:14.373936 25833 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 6.
W20260709 12:24:14.409368 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 711202us
I20260709 12:24:14.410279 25650 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:14.411618 25650 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:24:14.413389 25650 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:24:14.413268 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:14.417052 25754 raft_consensus.cc:1240] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:14.420290 28463 raft_consensus.cc:2804] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:24:14.420775 25758 raft_consensus.cc:1240] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:14.420993 28463 raft_consensus.cc:697] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 12 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:14.422326 28463 consensus_queue.cc:237] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:14.427968 25757 raft_consensus.cc:1275] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:24:14.431794 25650 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:14.432806 28590 raft_consensus.cc:2749] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:14.433910 25650 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
W20260709 12:24:14.374569 28645 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.000s	sys 0.017s
I20260709 12:24:14.374714 28373 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:14.405992 28669 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:14.362100 28670 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:14.425024 28650 raft_consensus.cc:3060] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:14.434679 28590 raft_consensus.cc:2804] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:14.424710 28255 raft_consensus.cc:2804] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:14.424724 28568 raft_consensus.cc:2804] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:14.404543 28483 consensus_queue.cc:1048] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
W20260709 12:24:14.437196 28645 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.001s	sys 0.029s
I20260709 12:24:14.372730 28655 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:14.440785 28669 raft_consensus.cc:3060] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:14.435482 28681 consensus_queue.cc:1048] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:24:14.482942 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:14.497694 26437 pending_rounds.cc:85] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89: Aborting all ops after (but not including) 5
I20260709 12:24:14.466849 25684 raft_consensus.cc:2468] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 6.
I20260709 12:24:14.375509 28680 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:14.498142 26437 pending_rounds.cc:107] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:24:14.498449 26437 raft_consensus.cc:2889] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:14.463991 28667 consensus_meta.cc:287] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.770s	user 0.012s	sys 0.000s
I20260709 12:24:14.497843 25830 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:14.470975 25836 raft_consensus.cc:1275] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:14.369210 28633 consensus_queue.cc:260] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:14.510712 26430 raft_consensus.cc:1275] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:14.512585 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:14.505020 25836 raft_consensus.cc:3055] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:14.513401 25836 raft_consensus.cc:740] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:14.458071 28568 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:14.513336 26436 raft_consensus.cc:2468] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 5.
I20260709 12:24:14.518348 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:14.519340 26433 raft_consensus.cc:2410] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 7 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:24:14.522137 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:14.449141 28373 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:14.518105 25836 consensus_queue.cc:260] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:14.542971 25836 raft_consensus.cc:3060] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:14.548368 25831 raft_consensus.cc:1275] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:24:14.552150 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:14.552947 25828 raft_consensus.cc:2393] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 7: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:14.557996 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:14.558724 28670 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:14.562014 28633 raft_consensus.cc:3060] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:14.566648 28373 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:14.568419 28686 log.cc:927] Time spent T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 12:24:14.571890 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:14.572958 26432 raft_consensus.cc:2468] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 6.
I20260709 12:24:14.469767 28255 raft_consensus.cc:697] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 5 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:14.574885 28255 consensus_queue.cc:237] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:14.576225 28684 raft_consensus.cc:2804] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:14.518362 28568 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:14.499044 28667 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:14.588246 25837 raft_consensus.cc:2393] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 9: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:14.552927 25836 raft_consensus.cc:1275] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:24:14.592360 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:14.580508 28680 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:14.596093 28680 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.596596 28680 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:14.558761 25831 raft_consensus.cc:2393] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 8: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:14.581992 25830 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 7.
W20260709 12:24:14.470844 28280 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.011s	sys 0.022s
I20260709 12:24:14.598819 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:14.601986 25828 raft_consensus.cc:3060] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:14.468500 28590 raft_consensus.cc:697] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 7 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:14.604233 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:14.606582 28481 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:14.609117 25759 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:14.610308 25686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 2038) took 1436 ms. Trace:
I20260709 12:24:14.610677 25686 rpcz_store.cc:276] 0709 12:24:13.174220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:13.192415 (+ 18195us) service_pool.cc:224] Handling call
0709 12:24:14.610125 (+1417710us) spinlock_profiling.cc:243] Waited 436 ms on lock 0x7b5400264dd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:14.610250 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1002119040}
I20260709 12:24:14.614632 28667 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:14.607653 28609 raft_consensus.cc:3055] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:14.621460 28534 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:14.623998 25754 raft_consensus.cc:1240] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 LEADER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:14.600062 28684 raft_consensus.cc:697] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 7 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
W20260709 12:24:14.616852 28280 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.011s	sys 0.022s
I20260709 12:24:14.633477 28655 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:14.635254 28650 raft_consensus.cc:2749] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:14.623405 28609 raft_consensus.cc:740] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:14.639482 28527 consensus_queue.cc:260] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:14.640038 28674 raft_consensus.cc:3060] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:14.655529 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:14.667948 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 367318us
I20260709 12:24:14.668134 25828 raft_consensus.cc:2468] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 6.
I20260709 12:24:14.669241 25759 raft_consensus.cc:2468] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 7.
W20260709 12:24:14.673353 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 377639us
I20260709 12:24:14.668902 25726 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:24:14.653878 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 290400us
I20260709 12:24:14.685672 25828 raft_consensus.cc:1275] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:14.689991 25828 raft_consensus.cc:1240] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:14.669064 28527 raft_consensus.cc:3060] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:14.710909 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:14.718786 28669 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:14.684307 28369 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:14.685716 25801 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
W20260709 12:24:14.725188 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 56383.2us
I20260709 12:24:14.736327 28637 raft_consensus.cc:2804] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:24:14.737370 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:14.740880 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:14.744727 28680 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:14.710209 28590 consensus_queue.cc:237] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:14.761034 25726 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:24:14.767992 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 82378.6us
I20260709 12:24:14.771473 25801 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:14.767251 28657 raft_consensus.cc:2749] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:14.767462 28684 consensus_queue.cc:237] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:14.776479 25801 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:14.779089 25831 raft_consensus.cc:2393] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 5: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:14.792376 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:14.792935 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:14.793656 25684 raft_consensus.cc:3060] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:14.804304 25684 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 3.
I20260709 12:24:14.806109 25726 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a
W20260709 12:24:14.875120 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 69229.6us
I20260709 12:24:14.812924 28592 consensus_queue.cc:1059] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:24:14.813221 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:14.813566 28662 consensus_queue.cc:1059] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 12:24:14.814203 28655 consensus_queue.cc:1048] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:14.790854 28594 raft_consensus.cc:2804] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:14.774765 28637 raft_consensus.cc:697] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
W20260709 12:24:14.818809 28628 consensus_meta.cc:287] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.852s	user 0.013s	sys 0.000s
I20260709 12:24:14.706770 28609 consensus_queue.cc:260] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:14.775002 28557 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:14.767371 28369 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:14.824390 28616 raft_consensus.cc:3055] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:14.815761 28482 raft_consensus.cc:3060] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:14.838498 28634 consensus_meta.cc:287] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.515s	user 0.011s	sys 0.000s
I20260709 12:24:14.840616 28699 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:14.845360 25759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53474 (request call id 2528) took 1018 ms. Trace:
I20260709 12:24:14.846608 28669 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:14.847249 28527 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.847801 28698 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.914028 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:14.847282 25683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40230 (request call id 1389) took 1104 ms. Trace:
I20260709 12:24:14.853585 28705 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.855396 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:14.918146 25830 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:14.915513 25683 rpcz_store.cc:276] 0709 12:24:13.743053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:13.745586 (+  2533us) service_pool.cc:224] Handling call
0709 12:24:13.958036 (+212450us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:14.375894 (+417858us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:14.847042 (+471148us) spinlock_profiling.cc:243] Waited 385 ms on lock 0x7b540029f9d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:14.847223 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":885593984}
I20260709 12:24:14.920223 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:14.857081 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:14.858597 25800 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:14.920995 25828 raft_consensus.cc:3060] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:14.921716 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 63190.9us
I20260709 12:24:14.925196 26434 raft_consensus.cc:1275] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:24:14.929123 25830 raft_consensus.cc:2468] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 6.
I20260709 12:24:14.827898 28568 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:14.864523 25801 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:14.870530 25832 raft_consensus.cc:2468] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 5.
I20260709 12:24:14.882259 25726 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:14.887167 28592 raft_consensus.cc:3055] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:14.887533 28594 raft_consensus.cc:697] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:14.888468 28697 consensus_queue.cc:1048] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:14.888525 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:14.968767 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:14.969484 25755 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 8.
I20260709 12:24:14.896818 25829 raft_consensus.cc:1240] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:14.899730 25759 rpcz_store.cc:276] 0709 12:24:13.827287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:13.827446 (+   159us) service_pool.cc:224] Handling call
0709 12:24:14.845006 (+1017560us) spinlock_profiling.cc:243] Waited 590 ms on lock 0x7b54001a72d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:14.845292 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1357492480}
I20260709 12:24:14.966517 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:14.970394 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:14.905655 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:14.971001 25683 raft_consensus.cc:2368] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 2. Current term is 3.
I20260709 12:24:14.971344 25678 raft_consensus.cc:2393] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 6: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:14.940366 28662 raft_consensus.cc:2749] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:14.972148 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:14.904313 25763 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48606 (request call id 703) took 1569 ms (client timeout 1616 ms). Trace:
I20260709 12:24:14.907721 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:14.912611 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:14.904268 25680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40230 (request call id 1404) took 1152 ms. Trace:
I20260709 12:24:14.904884 25760 raft_consensus.cc:2410] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 12:24:14.886330 28674 raft_consensus.cc:3055] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:24:14.856259 28657 consensus_queue.cc:1048] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:14.930055 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:14.931653 25828 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 3.
I20260709 12:24:14.918679 28689 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.933718 25677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40230 (request call id 1394) took 1189 ms. Trace:
W20260709 12:24:14.918537 28665 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 12:24:14.898018 28616 raft_consensus.cc:740] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:14.956907 25800 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:14.912240 28645 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:14.889708 28557 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:14.912773 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:14.972733 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:14.915408 28699 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:15.012967 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:15.212597 26437 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.013s	sys 0.025s
W20260709 12:24:15.157907 25583 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52974 (request call id 254) took 13921 ms (client timeout 15000 ms). Trace:
I20260709 12:24:15.178120 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:15.106750 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:15.425928 26439 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 7.
I20260709 12:24:15.105906 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:15.013444 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:15.401933 25677 rpcz_store.cc:276] 0709 12:24:13.744677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:13.744850 (+   173us) service_pool.cc:224] Handling call
0709 12:24:13.759030 (+ 14180us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:14.056286 (+297256us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:14.417479 (+361193us) log.cc:844] Serialized 14 byte log entry
0709 12:24:14.698296 (+280817us) log.cc:844] Serialized 14 byte log entry
0709 12:24:14.829563 (+131267us) spinlock_profiling.cc:243] Waited 2.99 ms on lock 0x7b180019bd60. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d96a743f3 00007f5d96a767c1 00007f5d96a76779 00007f5d96a76709 00007f5d96a766d1 00007f5d96a759cd 0000000000388634 0000000000388479 00007f5d96a5783a
0709 12:24:14.903503 (+ 73940us) spinlock_profiling.cc:243] Waited 2.29 ms on lock 0x7b180019bd60. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d969eec0a 00007f5da012e219 00007f5d96a76a40 00007f5d96a714e4 00007f5d96a71455 00007f5d99b59060 00007f5d99b6b716 00007f5d99b7c287 00007f5d99b7c208
0709 12:24:14.904728 (+  1225us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:14.904792 (+    64us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:14.904847 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:14.933433 (+ 28586us) spinlock_profiling.cc:243] Waited 297 ms on lock 0x7b5400263ed4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:14.933491 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:14.933650 (+   159us) inbound_call.cc:177] Queueing success response
0709 12:24:15.272547 (+338897us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b180019bd60. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d96a743f3 00007f5d96a767c1 00007f5d96a76779 00007f5d96a76709 00007f5d96a766d1 00007f5d96a759cd 0000000000388634 0000000000388479 00007f5d96a5783a
Metrics: {"mutex_wait_us":119373,"prepare.queue_time_us":527851,"prepare.run_cpu_time_us":122,"prepare.run_wall_time_us":123,"raft.queue_time_us":237091,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":6452,"spinlock_wait_cycles":757753600,"thread_start_us":625993,"threads_started":2,"wal-append.queue_time_us":509199}
W20260709 12:24:14.968811 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 86634.1us
I20260709 12:24:15.432112 25830 raft_consensus.cc:2468] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 4.
I20260709 12:24:15.022678 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:15.434435 25726 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
W20260709 12:24:15.399200 26437 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.900s	user 0.015s	sys 0.029s
W20260709 12:24:15.328747 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:15.058422 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:15.418807 25681 raft_consensus.cc:2410] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:24:15.400098 26438 raft_consensus.cc:3060] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:14.926607 28634 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:15.162125 26431 raft_consensus.cc:1240] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:14.973011 25678 raft_consensus.cc:2410] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
W20260709 12:24:15.106599 25758 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.017s	sys 0.021s
W20260709 12:24:15.177795 25757 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.022s	sys 0.022s
W20260709 12:24:15.162138 25836 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.035s	sys 0.033s
I20260709 12:24:14.974922 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:15.427034 26402 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:15.436169 25760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53460 (request call id 2130) took 1101 ms. Trace:
W20260709 12:24:15.126725 25835 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.010s	sys 0.023s
I20260709 12:24:15.437749 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:15.166309 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:15.438344 26433 raft_consensus.cc:1275] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:24:15.438849 25684 raft_consensus.cc:2410] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:24:15.309780 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:14.967257 28525 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
W20260709 12:24:15.530390 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 96060.1us
I20260709 12:24:15.012253 25680 rpcz_store.cc:276] 0709 12:24:13.751417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:14.026731 (+275314us) service_pool.cc:224] Handling call
0709 12:24:14.027128 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:14.057896 (+ 30768us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:24:14.374340 (+316444us) log.cc:844] Serialized 14 byte log entry
0709 12:24:14.698909 (+324569us) log.cc:844] Serialized 14 byte log entry
0709 12:24:14.847802 (+148893us) spinlock_profiling.cc:243] Waited 2.93 ms on lock 0x7b1800448480. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d96a74522 00007f5d96a767c1 00007f5d96a76779 00007f5d96a76709 00007f5d96a766d1 00007f5d96a759cd 0000000000388634 0000000000388479 00007f5d96a5783a
0709 12:24:14.903797 (+ 55995us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:14.903867 (+    70us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:14.903945 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:14.904030 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:14.904196 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":394809,"prepare.queue_time_us":518927,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":95,"raft.queue_time_us":239690,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":11546,"spinlock_wait_cycles":6742272,"thread_start_us":579566,"threads_started":2,"wal-append.queue_time_us":892269}
I20260709 12:24:15.532617 25726 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:24:15.533138 25832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44218 (request call id 1473) took 1206 ms. Trace:
W20260709 12:24:15.533918 25758 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.954s	user 0.025s	sys 0.033s
I20260709 12:24:15.533628 25832 rpcz_store.cc:276] 0709 12:24:14.327036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:14.332618 (+  5582us) service_pool.cc:224] Handling call
0709 12:24:15.532920 (+1200302us) spinlock_profiling.cc:243] Waited 440 ms on lock 0x7b5400247054. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:15.533063 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1012730752}
I20260709 12:24:15.457604 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:15.535780 25832 raft_consensus.cc:1240] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 4. Current term is 5. Ops: []
W20260709 12:24:15.400738 25763 rpcz_store.cc:269] 0709 12:24:13.334592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:13.362587 (+ 27995us) service_pool.cc:224] Handling call
0709 12:24:14.904138 (+1541551us) spinlock_profiling.cc:243] Waited 304 ms on lock 0x7b54001e6254. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:14.904259 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":700244224}
I20260709 12:24:15.530010 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:15.536618 25759 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:15.127658 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:15.538250 25835 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.017s	user 0.018s	sys 0.047s
W20260709 12:24:15.441108 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 581498us
I20260709 12:24:15.540503 26439 raft_consensus.cc:2393] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 6: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
W20260709 12:24:15.516495 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:15.544456 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:15.544881 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:15.539218 25760 rpcz_store.cc:276] 0709 12:24:14.334331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:14.372279 (+ 37948us) service_pool.cc:224] Handling call
0709 12:24:15.400868 (+1028589us) spinlock_profiling.cc:243] Waited 490 ms on lock 0x7b54003a70d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:15.436102 (+ 35234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1127923584}
I20260709 12:24:15.545849 25685 raft_consensus.cc:2393] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 6: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:15.548223 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:15.549062 25681 raft_consensus.cc:2468] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 6.
W20260709 12:24:15.440730 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 483915us
W20260709 12:24:15.553753 25836 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.924s	user 0.038s	sys 0.047s
I20260709 12:24:15.441438 25837 raft_consensus.cc:2393] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 6: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
W20260709 12:24:15.536073 25757 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.905s	user 0.022s	sys 0.038s
I20260709 12:24:15.535732 25828 raft_consensus.cc:2393] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 6: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:15.563880 25759 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 9.
W20260709 12:24:15.156710 28255 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.021s	sys 0.013s
I20260709 12:24:14.966459 28592 raft_consensus.cc:740] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:15.266969 28481 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:15.437935 28369 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:15.587771 25832 raft_consensus.cc:1240] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:15.601004 25831 raft_consensus.cc:1240] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:14.927008 28705 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:15.576893 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:15.377539 28682 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:15.570561 28665 raft_consensus.cc:2804] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:15.417984 28674 raft_consensus.cc:740] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
W20260709 12:24:15.441566 28644 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.802s	user 0.010s	sys 0.019s
I20260709 12:24:15.616856 26438 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 3.
I20260709 12:24:15.106436 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:14.918421 28698 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:15.546077 28544 raft_consensus.cc:2749] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:24:15.399513 25583 rpcz_store.cc:269] 0709 12:24:01.187161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:01.187434 (+   273us) service_pool.cc:224] Handling call
0709 12:24:15.107968 (+13920534us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:12.408245 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:12.456119 (+ 47874us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:12.456188 (+    69us) write_op.cc:435] Acquired schema lock
0709 12:24:12.456215 (+    27us) tablet.cc:662] Decoding operations
0709 12:24:12.457570 (+  1355us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:12.457670 (+   100us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:12.457710 (+    40us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:24:12.458851 (+  1141us) tablet.cc:701] Row locks acquired
0709 12:24:12.458911 (+    60us) write_op.cc:260] PREPARE: finished
0709 12:24:12.459148 (+   237us) write_op.cc:270] Start()
0709 12:24:12.459317 (+   169us) write_op.cc:276] Timestamp: P: 1783599852459051 usec, L: 0
0709 12:24:12.459345 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 12:24:12.548244 (+ 88899us) log.cc:844] Serialized 4014 byte log entry
0709 12:24:13.016787 (+468543us) op_driver.cc:464] REPLICATION: finished
0709 12:24:13.080122 (+ 63335us) write_op.cc:301] APPLY: starting
0709 12:24:13.080220 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:13.080470 (+   250us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:13.080631 (+   161us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:13.082028 (+  1397us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:13.082499 (+   471us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 12:24:13.082553 (+    54us) write_op.cc:312] APPLY: finished
0709 12:24:13.082972 (+   419us) log.cc:844] Serialized 77 byte log entry
0709 12:24:13.083152 (+   180us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:13.083304 (+   152us) write_op.cc:454] Released schema lock
0709 12:24:13.083359 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:13.093420 (+ 10061us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:13.107673 (+ 14253us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":411518,"reported_tablets":23,"child_traces":[["op",{"apply.queue_time_us":63081,"apply.run_cpu_time_us":3669,"apply.run_wall_time_us":3675,"num_ops":10,"prepare.queue_time_us":665962,"prepare.run_cpu_time_us":37789,"prepare.run_wall_time_us":251757,"raft.queue_time_us":272776,"raft.run_cpu_time_us":9601,"raft.run_wall_time_us":97468,"replication_time_us":557270,"thread_start_us":849830,"threads_started":4,"wal-append.queue_time_us":185138,"wal-append.run_cpu_time_us":36155,"wal-append.run_wall_time_us":1344267}]]}
I20260709 12:24:14.968858 28704 consensus_queue.cc:1059] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.619s
W20260709 12:24:15.628733 25754 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.966s	user 0.029s	sys 0.023s
W20260709 12:24:15.591140 28255 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.966s	user 0.022s	sys 0.041s
W20260709 12:24:15.592759 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 173876us
I20260709 12:24:15.586551 26434 raft_consensus.cc:2468] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 7.
I20260709 12:24:15.609686 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:24:15.610719 28590 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.836s	user 0.017s	sys 0.012s
W20260709 12:24:15.602165 28684 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.771s	user 0.020s	sys 0.023s
I20260709 12:24:15.632529 26402 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:14.920208 28527 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:15.619493 25761 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.932s	user 0.014s	sys 0.012s
W20260709 12:24:15.619786 25756 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.852s	user 0.017s	sys 0.012s
I20260709 12:24:15.530014 28645 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:15.571043 28525 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:15.601840 28677 raft_consensus.cc:2749] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:15.126924 28637 consensus_queue.cc:237] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:15.608053 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
W20260709 12:24:15.615792 28644 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.976s	user 0.012s	sys 0.025s
I20260709 12:24:15.232522 28594 consensus_queue.cc:237] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:15.579420 28634 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:15.612078 28665 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:15.595767 25682 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.928s	user 0.016s	sys 0.010s
I20260709 12:24:15.602701 28655 consensus_queue.cc:1048] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 12:24:15.440869 28689 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:15.605574 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:15.604617 28481 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:15.621615 28649 consensus_queue.cc:1059] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:24:15.614677 28682 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:15.618088 28616 consensus_queue.cc:260] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:15.636037 28684 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.020s	sys 0.023s
I20260709 12:24:15.661316 28483 raft_consensus.cc:2749] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:24:15.631368 28676 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.009s	sys 0.017s
W20260709 12:24:16.040067 28676 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.149s	user 0.021s	sys 0.030s
W20260709 12:24:15.633633 25754 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.976s	user 0.030s	sys 0.023s
I20260709 12:24:16.043339 28645 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:16.044034 25682 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.377s	user 0.032s	sys 0.018s
W20260709 12:24:15.669607 25833 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.857s	user 0.012s	sys 0.031s
I20260709 12:24:16.044376 25760 raft_consensus.cc:2468] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 6.
W20260709 12:24:16.044885 25833 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.232s	user 0.019s	sys 0.045s
W20260709 12:24:16.045082 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:16.045773 25756 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.288s	user 0.022s	sys 0.038s
W20260709 12:24:15.634657 26401 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.004s	sys 0.039s
W20260709 12:24:16.047201 26401 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.102s	user 0.015s	sys 0.051s
W20260709 12:24:16.047509 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 1.10271e+06us
I20260709 12:24:16.045975 26402 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
W20260709 12:24:15.764561 25834 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.004s	sys 0.024s
W20260709 12:24:16.049108 25834 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.886s	user 0.017s	sys 0.032s
W20260709 12:24:15.849207 25686 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.932s	user 0.017s	sys 0.026s
W20260709 12:24:16.050813 25686 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.134s	user 0.022s	sys 0.035s
W20260709 12:24:15.986351 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 435047us
I20260709 12:24:15.750154 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:16.046525 25761 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.359s	user 0.020s	sys 0.038s
I20260709 12:24:16.053813 25683 raft_consensus.cc:2393] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 6: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:16.054872 25755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53474 (request call id 2532) took 1213 ms. Trace:
I20260709 12:24:16.046329 25836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 2502) took 1533 ms. Trace:
I20260709 12:24:16.053556 25761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 2122) took 1749 ms. Trace:
I20260709 12:24:16.055583 25835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 2494) took 1574 ms. Trace:
I20260709 12:24:16.055531 25755 rpcz_store.cc:276] 0709 12:24:14.841971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:15.592653 (+750682us) service_pool.cc:224] Handling call
0709 12:24:16.054811 (+462158us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:16.007547 28717 log.cc:927] Time spent T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.390s	user 0.000s	sys 0.001s
I20260709 12:24:16.060250 25683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51578 (request call id 616) took 1149 ms. Trace:
I20260709 12:24:16.066545 25683 rpcz_store.cc:276] 0709 12:24:14.910963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:15.571513 (+660550us) service_pool.cc:224] Handling call
0709 12:24:15.749945 (+178432us) spinlock_profiling.cc:243] Waited 3.41 ms on lock 0x7b5800003698. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d96a3cb71 00007f5d96a3ca22 00007f5d9f9558d9 00007f5d9eaafee0 00007f5d9eb790ab 00007f5d9eb79131 00007f5d9eb270a0 00007f5d9eb26984 00007f5d980a16d4 00007f5d980a1662
0709 12:24:16.060167 (+310222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7844096}
W20260709 12:24:16.049037 28721 log.cc:927] Time spent T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 12:24:16.056653 25761 rpcz_store.cc:276] 0709 12:24:14.304237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:14.310353 (+  6116us) service_pool.cc:224] Handling call
0709 12:24:14.310803 (+   450us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:14.671176 (+360373us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:24:14.671223 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:14.671886 (+   663us) log.cc:844] Serialized 26 byte log entry
0709 12:24:16.053058 (+1381172us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:16.053102 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:16.053271 (+   169us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:16.053323 (+    52us) raft_consensus.cc:1685] finished
0709 12:24:16.053343 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:16.053495 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":48262,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"thread_start_us":1725331,"threads_started":2,"wal-append.queue_time_us":1350751}
I20260709 12:24:15.674975 26432 raft_consensus.cc:2393] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 7: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
W20260709 12:24:15.634600 28590 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.860s	user 0.017s	sys 0.012s
I20260709 12:24:15.667079 28544 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:16.048497 28670 raft_consensus.cc:2749] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:15.741506 28609 raft_consensus.cc:3060] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:16.054100 28665 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:24:15.738365 28711 log.cc:927] Time spent T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.460s	user 0.001s	sys 0.000s
W20260709 12:24:15.751089 28715 log.cc:927] Time spent T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 12:24:16.068840 28255 raft_consensus.cc:2749] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:16.073637 28706 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:15.985106 28557 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:16.131857 28557 consensus_queue.cc:1048] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:15.988655 28709 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:16.133118 28709 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:16.133590 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 1.28739e+06us
I20260709 12:24:16.135246 28650 consensus_queue.cc:1059] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:15.939221 28698 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:24:16.070365 25726 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.018s	sys 0.044s
I20260709 12:24:16.074226 28705 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:16.077306 26432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36518 (request call id 713) took 1020 ms. Trace:
I20260709 12:24:15.633320 28592 consensus_queue.cc:260] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:16.078112 28481 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:15.638036 28710 raft_consensus.cc:3055] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:16.080646 25761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 2536) took 1237 ms. Trace:
I20260709 12:24:16.076313 25763 raft_consensus.cc:2468] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 4.
I20260709 12:24:16.053785 28633 raft_consensus.cc:2804] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:16.048707 28680 raft_consensus.cc:2749] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:16.053380 28669 raft_consensus.cc:2749] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:15.933408 28568 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:16.058159 28628 raft_consensus.cc:2749] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:16.083576 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 530233us
I20260709 12:24:16.071568 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:16.086664 25801 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
W20260709 12:24:16.108141 28726 log.cc:927] Time spent T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:24:16.108888 28689 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:24:16.109071 28724 log.cc:927] Time spent T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
W20260709 12:24:16.109975 28727 log.cc:927] Time spent T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 12:24:16.110914 28728 log.cc:927] Time spent T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 12:24:16.113204 25757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48606 (request call id 719) took 1535 ms. Trace:
I20260709 12:24:16.113979 25760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53474 (request call id 2533) took 1271 ms. Trace:
I20260709 12:24:16.193703 25760 rpcz_store.cc:276] 0709 12:24:14.842248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:15.591927 (+749679us) service_pool.cc:224] Handling call
0709 12:24:16.113763 (+521836us) spinlock_profiling.cc:243] Waited 411 ms on lock 0x7b54001e5854. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:16.113901 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":946035072}
I20260709 12:24:16.122287 25834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 2496) took 1626 ms. Trace:
I20260709 12:24:16.122473 28735 raft_consensus.cc:2804] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:16.123250 28699 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:16.125924 28525 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:16.128981 28527 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:16.085335 28544 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:24:16.131712 28706 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:16.218495 28706 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:24:16.157896 25726 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.020s	sys 0.046s
I20260709 12:24:16.057353 25835 rpcz_store.cc:276] 0709 12:24:14.481319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:14.481428 (+   109us) service_pool.cc:224] Handling call
0709 12:24:14.496058 (+ 14630us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:14.496278 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:15.538863 (+1042585us) log.cc:844] Serialized 14 byte log entry
0709 12:24:16.055245 (+516382us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:16.055311 (+    66us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:16.055369 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:16.055428 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:16.055534 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5218,"prepare.queue_time_us":1138401,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"thread_start_us":1428692,"threads_started":2}
I20260709 12:24:16.157806 25761 rpcz_store.cc:276] 0709 12:24:14.842962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:16.079861 (+1236899us) service_pool.cc:224] Handling call
0709 12:24:16.080176 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:16.080344 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:16.080376 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:16.080414 (+    38us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:16.080441 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:16.080488 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:16.080593 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:16.220397 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 687822us
I20260709 12:24:15.722430 28674 consensus_queue.cc:260] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:16.220753 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:16.221449 28674 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:16.221943 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:16.222522 25761 raft_consensus.cc:2468] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 3.
I20260709 12:24:16.159847 26437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 790) took 1663 ms. Trace:
I20260709 12:24:16.137655 28734 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:16.164052 25682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40230 (request call id 1391) took 2415 ms. Trace:
I20260709 12:24:16.164268 28258 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:16.135782 28709 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:24:16.162470 28482 consensus_meta.cc:287] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 1.259s	user 0.009s	sys 0.005s
I20260709 12:24:16.093628 28616 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:16.137162 28725 log.cc:927] Time spent T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.213s	user 0.002s	sys 0.000s
I20260709 12:24:16.195293 25834 rpcz_store.cc:276] 0709 12:24:14.495715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:14.496458 (+   743us) service_pool.cc:224] Handling call
0709 12:24:14.496800 (+   342us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:14.947458 (+450658us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:14.947509 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:15.011301 (+ 63792us) log.cc:844] Serialized 52 byte log entry
0709 12:24:16.049768 (+1038467us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:16.049811 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:16.049876 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:16.122049 (+ 72173us) raft_consensus.cc:1685] finished
0709 12:24:16.122071 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:16.122229 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":115320,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104,"thread_start_us":1336905,"threads_started":2,"wal-append.queue_time_us":1064937}
I20260709 12:24:16.250537 25834 raft_consensus.cc:1275] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:24:16.248373 25800 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
W20260709 12:24:16.197847 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 111304us
W20260709 12:24:16.251255 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:16.251729 25801 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:16.200300 25762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53474 (request call id 2534) took 1357 ms. Trace:
I20260709 12:24:16.252645 25762 rpcz_store.cc:276] 0709 12:24:14.842496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:15.744732 (+902236us) service_pool.cc:224] Handling call
0709 12:24:16.200214 (+455482us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:16.210229 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:16.211222 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:16.253621 25830 raft_consensus.cc:2368] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 4. Current term is 5.
I20260709 12:24:16.211623 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:16.141358 28676 raft_consensus.cc:3055] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:16.157564 28710 raft_consensus.cc:740] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:16.215067 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:16.216631 28544 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:16.214987 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:16.225623 26437 rpcz_store.cc:276] 0709 12:24:14.496543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:14.497263 (+   720us) service_pool.cc:224] Handling call
0709 12:24:14.497529 (+   266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:14.498934 (+  1405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:14.498966 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:14.499380 (+   414us) log.cc:844] Serialized 26 byte log entry
0709 12:24:15.436334 (+936954us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:15.962131 (+525797us) log.cc:844] Serialized 14 byte log entry
0709 12:24:16.159496 (+197365us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:16.159570 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:16.159620 (+    50us) raft_consensus.cc:1685] finished
0709 12:24:16.159637 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:16.159776 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":702781,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":77165,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"thread_start_us":1492422,"threads_started":3,"wal-append.queue_time_us":1222821}
I20260709 12:24:16.056241 25836 rpcz_store.cc:276] 0709 12:24:14.512596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:14.593643 (+ 81047us) service_pool.cc:224] Handling call
0709 12:24:14.593985 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:14.594238 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:24:15.554330 (+960092us) log.cc:844] Serialized 14 byte log entry
0709 12:24:16.045838 (+491508us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:16.045883 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:16.045921 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:16.046038 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:16.046270 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6363,"prepare.queue_time_us":1160546,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":2410,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":9875,"thread_start_us":1415857,"threads_started":2}
W20260709 12:24:16.230211 25726 connection.cc:256] RPC call timeout handler was delayed by -1.2427414380003938s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1504s for a response
I20260709 12:24:16.136382 28651 consensus_queue.cc:1048] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.078s
I20260709 12:24:16.237304 25837 raft_consensus.cc:1240] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:16.238369 25682 rpcz_store.cc:276] 0709 12:24:13.743729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:13.746383 (+  2654us) service_pool.cc:224] Handling call
0709 12:24:14.269963 (+523580us) spinlock_profiling.cc:243] Waited 1.29 ms on lock 0x7b5800003698. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d96a3cb71 00007f5d96a3ca22 00007f5d9f9558d9 00007f5d9eaafee0 00007f5d9eb790ab 00007f5d9eb79131 00007f5d9eb3afc0 00007f5d9eb25929 00007f5d9eb253d2 00007f5d9809cbd4
0709 12:24:14.270241 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:14.270701 (+   460us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:24:14.667070 (+396369us) log.cc:844] Serialized 14 byte log entry
0709 12:24:16.158890 (+1491820us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:16.158946 (+    56us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:16.158994 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:16.159108 (+   114us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:16.159237 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":114530,"prepare.queue_time_us":303484,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":114928,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":28268,"spinlock_wait_cycles":7390720,"thread_start_us":1763562,"threads_started":2,"wal-append.queue_time_us":1257059}
I20260709 12:24:16.193550 25757 rpcz_store.cc:276] 0709 12:24:14.578265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:14.580420 (+  2155us) service_pool.cc:224] Handling call
0709 12:24:14.580808 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:14.581319 (+   511us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:14.581360 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:14.593822 (+ 12462us) log.cc:844] Serialized 26 byte log entry
0709 12:24:14.773618 (+179796us) spinlock_profiling.cc:243] Waited 3.88 ms on lock 0x7b4800002dd8. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9ea8aaa1 00007f5d9ea81b37 00007f5d9ea819ca 00007f5d9eb7926f 00007f5d9eb78f37 00007f5d9eb8d55c 00007f5d9eb8d508 00007f5d9eb8d488 00007f5d9eb8d443 00007f5d9eb8c6ec 00007f5d9dab6a96
0709 12:24:15.556139 (+782521us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:15.556195 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:15.556313 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:16.112826 (+556513us) raft_consensus.cc:1685] finished
0709 12:24:16.112854 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:16.113114 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13407,"raft.queue_time_us":1068,"raft.run_cpu_time_us":1311,"raft.run_wall_time_us":186362,"spinlock_wait_cycles":8912768,"thread_start_us":924874,"threads_started":1,"wal-append.queue_time_us":1019787}
I20260709 12:24:16.202093 28705 raft_consensus.cc:2749] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:16.167309 28698 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:16.192921 28255 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:16.272861 28698 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:16.272991 28255 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:16.274770 28698 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:16.167743 28481 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:16.279088 25686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40230 (request call id 1408) took 1486 ms. Trace:
I20260709 12:24:16.279428 28481 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:16.279670 25686 rpcz_store.cc:276] 0709 12:24:14.792987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:14.793127 (+   140us) service_pool.cc:224] Handling call
0709 12:24:14.793421 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:14.915846 (+122425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:14.915890 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:14.916494 (+   604us) log.cc:844] Serialized 26 byte log entry
0709 12:24:16.051682 (+1135188us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:16.051740 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:16.051829 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:16.278853 (+227024us) raft_consensus.cc:1685] finished
0709 12:24:16.278875 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:16.279010 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1291071,"raft.queue_time_us":129647,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":12322,"thread_start_us":1134769,"threads_started":1,"wal-append.queue_time_us":1280184}
I20260709 12:24:16.281841 28481 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:16.283196 28730 log.cc:927] Time spent T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.294s	user 0.000s	sys 0.001s
W20260709 12:24:16.287177 28719 log.cc:927] Time spent T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.343s	user 0.001s	sys 0.000s
I20260709 12:24:16.265776 28709 raft_consensus.cc:2804] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:16.288267 28709 raft_consensus.cc:697] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 9 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:16.289187 28709 consensus_queue.cc:237] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:16.241150 28734 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:16.295316 28734 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:16.300861 28741 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:16.301465 28741 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:16.257320 28676 raft_consensus.cc:740] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:16.305182 28676 consensus_queue.cc:260] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:16.306306 28676 raft_consensus.cc:3060] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:16.308055 28682 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:16.310405 28592 raft_consensus.cc:3060] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:16.241182 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:16.243841 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:16.312559 25835 raft_consensus.cc:2393] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 5: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:16.245033 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:16.210956 28689 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:16.313524 28689 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:16.315532 28689 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:16.161264 26432 rpcz_store.cc:276] 0709 12:24:15.057068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:15.106118 (+ 49050us) service_pool.cc:224] Handling call
0709 12:24:16.077238 (+971120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:16.249284 25754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48606 (request call id 723) took 1593 ms. Trace:
I20260709 12:24:16.254475 26430 raft_consensus.cc:2468] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 5.
I20260709 12:24:16.316442 25754 rpcz_store.cc:276] 0709 12:24:14.655965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:14.656390 (+   425us) service_pool.cc:224] Handling call
0709 12:24:14.656830 (+   440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:14.657061 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:14.657097 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:14.657626 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 12:24:16.041466 (+1383840us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:24:16.041511 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:16.041598 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:16.249011 (+207413us) raft_consensus.cc:1685] finished
0709 12:24:16.249034 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:16.249204 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1383501,"threads_started":1,"wal-append.queue_time_us":1321967}
I20260709 12:24:16.317489 26430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 794) took 1805 ms. Trace:
I20260709 12:24:16.266248 28699 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:16.317905 26430 rpcz_store.cc:276] 0709 12:24:14.511714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:14.521830 (+ 10116us) service_pool.cc:224] Handling call
0709 12:24:16.317335 (+1795505us) spinlock_profiling.cc:243] Waited 1.71 s on lock 0x7b5400600254. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:16.317438 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3939476224}
I20260709 12:24:16.318773 28699 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:16.319475 26436 raft_consensus.cc:1275] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:16.258345 26435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 791) took 1747 ms. Trace:
I20260709 12:24:16.240056 28735 raft_consensus.cc:697] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:16.321036 28699 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:16.267895 28706 raft_consensus.cc:2749] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:16.321204 28735 consensus_queue.cc:237] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:16.320984 28633 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:16.322444 28633 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:16.236040 28527 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:16.324183 28527 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:16.326187 28527 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:16.259161 25833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 2492) took 1780 ms. Trace:
I20260709 12:24:16.326715 25755 raft_consensus.cc:2468] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 4.
I20260709 12:24:16.326799 25833 rpcz_store.cc:276] 0709 12:24:14.478941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:14.479145 (+   204us) service_pool.cc:224] Handling call
0709 12:24:14.479710 (+   565us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:14.765854 (+286144us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:14.767111 (+  1257us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:14.774965 (+  7854us) log.cc:844] Serialized 26 byte log entry
0709 12:24:16.045268 (+1270303us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:16.045306 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:16.045406 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:16.258938 (+213532us) raft_consensus.cc:1685] finished
0709 12:24:16.258960 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:16.259103 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":115758,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":108,"thread_start_us":1517933,"threads_started":2,"wal-append.queue_time_us":1176741}
I20260709 12:24:16.260061 25832 raft_consensus.cc:2368] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 2. Current term is 3.
I20260709 12:24:16.260277 25801 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:16.328434 25830 raft_consensus.cc:1240] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 6. Current term is 7. Ops: []
W20260709 12:24:16.328976 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 68797.1us
I20260709 12:24:16.329972 25801 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
W20260709 12:24:16.330195 28716 log.cc:927] Time spent T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.347s	user 0.000s	sys 0.001s
I20260709 12:24:16.331522 25758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48606 (request call id 718) took 1753 ms. Trace:
I20260709 12:24:16.332113 28369 raft_consensus.cc:2749] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:24:16.333068 28729 log.cc:927] Time spent T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.409s	user 0.003s	sys 0.000s
I20260709 12:24:16.333307 28369 raft_consensus.cc:2749] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:16.331845 25758 rpcz_store.cc:276] 0709 12:24:14.577902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:14.578430 (+   528us) service_pool.cc:224] Handling call
0709 12:24:14.578828 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:14.579259 (+   431us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:14.579315 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:14.579976 (+   661us) log.cc:844] Serialized 26 byte log entry
0709 12:24:15.534898 (+954922us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:15.534938 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:15.535011 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:16.329681 (+794670us) spinlock_profiling.cc:243] Waited 6.23 ms on lock 0x7b4400022b4c. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db 00007f5d99708aaf 00007f5d996fc86e 00007f5d996fbbb6 00007f5d996fb7d8 00007f5d99705221 00007f5d997051d9 00007f5d99705169
0709 12:24:16.331263 (+  1582us) raft_consensus.cc:1685] finished
0709 12:24:16.331283 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:16.331468 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2607,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":7126,"spinlock_wait_cycles":14335360,"thread_start_us":954474,"threads_started":1,"wal-append.queue_time_us":1325526}
I20260709 12:24:16.336090 25832 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:24:16.266628 25800 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
W20260709 12:24:16.337221 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 70675.7us
I20260709 12:24:16.337392 26436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36518 (request call id 715) took 1279 ms. Trace:
I20260709 12:24:16.320528 26435 rpcz_store.cc:276] 0709 12:24:14.510839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:14.515876 (+  5037us) service_pool.cc:224] Handling call
0709 12:24:14.569727 (+ 53851us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:14.570250 (+   523us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:14.570290 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:14.571020 (+   730us) log.cc:844] Serialized 52 byte log entry
0709 12:24:14.856982 (+285962us) spinlock_profiling.cc:243] Waited 7.33 ms on lock 0x7b4800041dd8. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9ea8aaa1 00007f5d9ea81b37 00007f5d9ea819ca 00007f5d9eb7926f 00007f5d9eb78f37 00007f5d9eb8d55c 00007f5d9eb8d508 00007f5d9eb8d488 00007f5d9eb8d443 00007f5d9eb8c6ec 00007f5d9dab6a96
0709 12:24:14.930800 (+ 73818us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:14.930841 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:14.930906 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:16.258012 (+1327106us) raft_consensus.cc:1685] finished
0709 12:24:16.258038 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:16.258283 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10192,"raft.run_cpu_time_us":2451,"raft.run_wall_time_us":276768,"spinlock_wait_cycles":16861440,"thread_start_us":359366,"threads_started":1,"wal-append.queue_time_us":1035182}
I20260709 12:24:16.337760 26436 rpcz_store.cc:276] 0709 12:24:15.058151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:15.058265 (+   114us) service_pool.cc:224] Handling call
0709 12:24:16.319014 (+1260749us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:16.320031 (+  1017us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:16.337214 (+ 17183us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b5400600250. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b608ad 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:16.337338 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2898480896}
I20260709 12:24:16.268913 25756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 2123) took 1957 ms. Trace:
I20260709 12:24:16.338469 28713 raft_consensus.cc:2804] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:16.338908 28713 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:16.303848 28741 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:16.340011 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:16.340754 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:16.340999 25758 raft_consensus.cc:2410] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:24:16.276729 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:16.275030 28255 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:16.247829 28258 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:16.277592 28544 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:16.344175 28544 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:16.346390 28544 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:24:16.278144 25726 connection.cc:256] RPC call timeout handler was delayed by -1.0168414380004833s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1755s for a response
I20260709 12:24:16.347433 25726 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:16.348482 25726 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:24:16.349190 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:16.349974 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:16.350322 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:16.350817 28665 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:16.351586 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:16.352540 26437 raft_consensus.cc:1240] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 5 LEADER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:16.353559 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:16.353837 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:16.353960 28527 raft_consensus.cc:2749] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:16.278057 28710 consensus_queue.cc:260] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:16.354703 28527 raft_consensus.cc:2804] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:16.355224 28527 raft_consensus.cc:697] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:16.355687 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:16.356330 26432 raft_consensus.cc:2468] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 5.
I20260709 12:24:16.357195 28710 raft_consensus.cc:3060] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:16.357313 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:16.357836 26438 raft_consensus.cc:3060] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:16.358355 28691 raft_consensus.cc:3055] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:16.338768 25756 rpcz_store.cc:276] 0709 12:24:14.311938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:14.312108 (+   170us) service_pool.cc:224] Handling call
0709 12:24:14.312416 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:14.672708 (+360292us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:14.672753 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:14.696024 (+ 23271us) log.cc:844] Serialized 26 byte log entry
0709 12:24:16.046215 (+1350191us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:24:16.046255 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:16.046344 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:16.268692 (+222348us) raft_consensus.cc:1685] finished
0709 12:24:16.268713 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:16.268858 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":46925,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":85,"thread_start_us":1648325,"threads_started":2,"wal-append.queue_time_us":1213653}
I20260709 12:24:16.358306 26434 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 8.
I20260709 12:24:16.350836 26435 raft_consensus.cc:2393] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 3: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
W20260709 12:24:16.361753 25726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:16.362154 25726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:16.358856 28691 raft_consensus.cc:740] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:16.363364 25763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53460 (request call id 2136) took 1554 ms. Trace:
I20260709 12:24:16.363699 25763 rpcz_store.cc:276] 0709 12:24:14.809451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:15.576522 (+767071us) service_pool.cc:224] Handling call
0709 12:24:16.363221 (+786699us) spinlock_profiling.cc:243] Waited 469 ms on lock 0x7b54001da1d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:16.363317 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1079120128}
I20260709 12:24:16.367383 26438 raft_consensus.cc:2468] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 6.
I20260709 12:24:16.369256 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:16.369853 25830 raft_consensus.cc:2468] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 6.
I20260709 12:24:16.370401 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:16.371388 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:16.371675 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:16.372018 25836 raft_consensus.cc:2468] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 4.
I20260709 12:24:16.370831 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:16.373063 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:16.373385 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:16.373627 25836 raft_consensus.cc:2468] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 4.
I20260709 12:24:16.374977 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:16.374614 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 311430us
I20260709 12:24:16.371131 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:16.339437 28713 raft_consensus.cc:3060] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:16.377732 25800 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:16.375553 26436 raft_consensus.cc:2468] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 5.
W20260709 12:24:16.378774 25726 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.245.132:35611 timed out after 1.504s (SENT) [suppressed 40 similar messages]
I20260709 12:24:16.299594 25582 catalog_manager.cc:5697] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 3 to 4, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 4 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
W20260709 12:24:16.379351 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 317041us
I20260709 12:24:16.380038 26435 raft_consensus.cc:1240] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:16.374378 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:16.380905 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:16.382337 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:16.382903 25834 raft_consensus.cc:2468] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 7.
I20260709 12:24:16.380800 25835 raft_consensus.cc:2468] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 6.
I20260709 12:24:16.385023 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:16.383733 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 248875us
I20260709 12:24:16.389287 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:16.389428 25649 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:16.390153 25831 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 7.
I20260709 12:24:16.391000 25649 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:16.396551 25832 raft_consensus.cc:606] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Received request to transfer leadership to TS 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:16.397055 25832 raft_consensus.cc:614] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:16.374604 28258 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:16.376150 28699 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:16.400297 25801 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:16.409622 28743 consensus_queue.cc:1048] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:24:16.407852 26402 leader_election.cc:400] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237) with higher term. Message: Invalid argument: T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 4. Current term is 5.
W20260709 12:24:16.424196 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:16.418941 28651 consensus_queue.cc:1048] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 12:24:16.417132 28650 raft_consensus.cc:2804] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:16.440477 26402 leader_election.cc:403] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:24:16.360086 28369 consensus_queue.cc:1175] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a866ff967d964388a6f0dff7fd43df89" responder_term: 9 status { last_received { term: 8 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 8. Current term is 9. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:24:16.438508 25801 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:16.395481 28689 raft_consensus.cc:2804] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:16.388896 28670 raft_consensus.cc:2804] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:16.416863 25649 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:16.375947 28544 consensus_queue.cc:1059] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 12:24:16.445941 25801 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:16.442028 26402 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:16.443820 28650 raft_consensus.cc:697] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 7 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
W20260709 12:24:16.471984 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 55195.7us
I20260709 12:24:16.444025 28691 consensus_queue.cc:260] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:16.475026 25801 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:16.444244 28644 raft_consensus.cc:2749] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:16.449718 28676 raft_consensus.cc:2749] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:16.506378 25763 raft_consensus.cc:1240] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:16.508462 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:16.509176 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:16.510437 26402 leader_election.cc:400] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 election: Vote denied by peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237) with higher term. Message: Invalid argument: T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 2. Current term is 3.
I20260709 12:24:16.510773 26402 leader_election.cc:403] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:24:16.518994 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:16.520048 25757 raft_consensus.cc:2468] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 7.
I20260709 12:24:16.449726 28670 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:16.463704 28689 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:16.439978 28699 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:16.476076 28370 raft_consensus.cc:2749] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:16.473562 28616 raft_consensus.cc:2749] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237) with higher term. Message: Invalid argument: T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 4. Current term is 5.
I20260709 12:24:16.476716 28258 raft_consensus.cc:2804] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:16.571239 25760 raft_consensus.cc:1275] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:24:16.557212 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:16.577947 25755 raft_consensus.cc:1275] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:24:16.527699 25582 catalog_manager.cc:5697] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 1 to 2, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 2 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
W20260709 12:24:16.527704 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 143614us
I20260709 12:24:16.562471 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:16.526433 26432 raft_consensus.cc:1275] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 12:24:16.437896 28527 consensus_queue.cc:237] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:16.586103 25800 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:16.581156 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:16.588627 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:16.593736 25682 raft_consensus.cc:2468] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 4.
I20260709 12:24:16.523383 28674 raft_consensus.cc:2804] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:16.527295 28568 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:16.522740 25679 raft_consensus.cc:2468] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 6.
I20260709 12:24:16.478701 25801 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
W20260709 12:24:16.616544 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 137940us
W20260709 12:24:16.593911 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 215159us
I20260709 12:24:16.617393 25801 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:16.577730 28258 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:16.578680 28691 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:16.547605 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:16.645244 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:16.571305 28590 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:16.590210 26432 pending_rounds.cc:85] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89: Aborting all ops after (but not including) 6
I20260709 12:24:16.614246 25762 raft_consensus.cc:1240] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 LEADER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:16.591149 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 80818.8us
W20260709 12:24:16.611433 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 202363us
I20260709 12:24:16.658141 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:16.658311 26402 leader_election.cc:336] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 1.577s (SENT)
I20260709 12:24:16.658910 25683 raft_consensus.cc:2393] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 7: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:16.658814 26402 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:16.660151 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:16.531598 28689 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:16.527503 28645 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:16.661854 28645 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:16.543180 28750 consensus_queue.cc:1059] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 12:24:16.652256 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:16.665570 28645 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:16.652745 25679 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51578 (request call id 611) took 1739 ms (client timeout 2109 ms). Trace:
I20260709 12:24:16.645174 28568 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:16.666808 25679 rpcz_store.cc:269] 0709 12:24:14.909716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:15.278875 (+369159us) service_pool.cc:224] Handling call
0709 12:24:16.648748 (+1369873us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:16.667737 25685 raft_consensus.cc:2393] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 3: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:16.669307 28568 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:16.669592 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 250828us
I20260709 12:24:16.670444 25650 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
W20260709 12:24:16.670673 28754 log.cc:927] Time spent T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:24:16.652688 28704 raft_consensus.cc:2749] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:16.655030 28590 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:16.673772 28758 log.cc:927] Time spent T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:24:16.674041 28590 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:16.607522 28748 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:16.677368 28748 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:16.678386 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:16.679582 28748 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:16.680424 25569 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 5aae9f34f7154346afd482b3183ee180 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5cccf20a8bff46dba6601f241d172b8a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:24:16.608814 28674 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:16.646557 25726 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:16.680665 25759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 2529) took 1839 ms. Trace:
I20260709 12:24:16.684509 25759 rpcz_store.cc:276] 0709 12:24:14.841073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:15.811337 (+970264us) service_pool.cc:224] Handling call
0709 12:24:16.049829 (+238492us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:16.393811 (+343982us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:16.393855 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:16.394435 (+   580us) log.cc:844] Serialized 26 byte log entry
0709 12:24:16.587625 (+193190us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:16.587774 (+   149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:16.588051 (+   277us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:16.680448 (+ 92397us) raft_consensus.cc:1685] finished
0709 12:24:16.680465 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:16.680603 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":178690,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":2907,"thread_start_us":479097,"threads_started":2,"wal-append.queue_time_us":260103}
I20260709 12:24:16.686033 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:16.686328 25681 raft_consensus.cc:1240] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 7 LEADER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:16.526999 28670 raft_consensus.cc:3060] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:16.682934 25678 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 8.
I20260709 12:24:16.615713 28616 raft_consensus.cc:2749] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237) with higher term. Message: Invalid argument: T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 2. Current term is 3.
W20260709 12:24:16.686997 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 69706.9us
I20260709 12:24:16.684803 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:16.690119 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 104251us
I20260709 12:24:16.648948 28258 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:16.645771 28706 raft_consensus.cc:2749] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:16.690253 25801 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:16.693638 25650 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:16.690538 25683 raft_consensus.cc:2468] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 5.
I20260709 12:24:16.655436 26432 pending_rounds.cc:107] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 12:24:16.707867 25801 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:16.700363 25726 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:16.686728 28644 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:16.690830 28674 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:16.694181 28676 raft_consensus.cc:2804] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:16.690042 28705 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:16.697355 28637 raft_consensus.cc:2804] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:16.720438 25726 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:16.721349 25759 raft_consensus.cc:1275] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:24:16.689488 28665 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:16.699472 28255 raft_consensus.cc:2749] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:16.701012 28669 raft_consensus.cc:2804] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:16.699290 28568 raft_consensus.cc:2749] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:16.731594 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:16.731712 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:16.732592 28669 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:16.742110 28752 log.cc:927] Time spent T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
W20260709 12:24:16.742874 28755 log.cc:927] Time spent T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 12:24:16.743350 28665 raft_consensus.cc:2749] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:24:16.744797 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 51228.7us
I20260709 12:24:16.744477 28744 consensus_queue.cc:1048] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:16.712548 28662 raft_consensus.cc:2804] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:16.710040 28544 consensus_queue.cc:1048] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 12:24:16.647282 28650 consensus_queue.cc:237] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:16.749688 28628 raft_consensus.cc:2749] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:16.777980 28669 raft_consensus.cc:3060] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:16.700335 28594 consensus_queue.cc:1059] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:24:16.723152 28741 raft_consensus.cc:2749] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:16.746233 28699 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:16.727067 28739 consensus_queue.cc:1059] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.092s
I20260709 12:24:16.733949 28705 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:16.780339 28746 raft_consensus.cc:2804] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:16.724895 28644 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:16.773357 28637 raft_consensus.cc:697] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:16.795956 28590 consensus_queue.cc:1048] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:24:16.794320 28662 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:16.817924 28258 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:16.710772 26432 raft_consensus.cc:2889] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:16.832875 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:16.833545 26430 raft_consensus.cc:1275] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:24:16.834296 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:16.835184 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:16.860936 26437 raft_consensus.cc:2468] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 5.
W20260709 12:24:16.803030 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 65277.2us
I20260709 12:24:16.803337 28697 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:16.850086 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:16.860018 26431 raft_consensus.cc:2468] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 7.
I20260709 12:24:16.864111 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:16.865469 26433 raft_consensus.cc:2468] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 6.
I20260709 12:24:16.811344 28482 consensus_queue.cc:1048] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:24:16.846266 28746 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
W20260709 12:24:16.852769 28633 consensus_meta.cc:287] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.530s	user 0.007s	sys 0.004s
W20260709 12:24:16.871122 28756 log.cc:927] Time spent T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:24:16.871806 28644 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:24:16.872839 28767 log.cc:927] Time spent T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:24:16.868155 28676 raft_consensus.cc:697] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 6 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:16.857553 28662 raft_consensus.cc:3060] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:16.869922 28713 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:16.878724 28633 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:16.873193 28637 consensus_queue.cc:237] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:16.906065 28713 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:16.909983 28662 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:16.875558 28746 raft_consensus.cc:3060] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:16.870091 28697 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:16.929507 28697 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:16.935246 28676 consensus_queue.cc:237] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:16.935523 28705 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:16.946553 28746 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:16.948824 28746 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:16.790349 25650 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:16.773051 25677 raft_consensus.cc:2393] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 5: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
W20260709 12:24:16.985941 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 195472us
I20260709 12:24:16.756966 25679 raft_consensus.cc:1240] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:16.806727 25681 raft_consensus.cc:1275] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:16.990201 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:16.991230 25681 raft_consensus.cc:2468] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 3.
I20260709 12:24:16.818737 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:16.992076 25680 raft_consensus.cc:1240] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 12 LEADER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 11. Current term is 12. Ops: []
I20260709 12:24:16.846953 25763 raft_consensus.cc:1240] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 LEADER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:16.845013 25759 raft_consensus.cc:2393] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 6: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:16.999084 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:17.000336 25682 raft_consensus.cc:2393] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 5: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:17.000720 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:17.006006 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 298083us
I20260709 12:24:17.006378 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:17.007342 25801 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:24:17.012466 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 308939us
W20260709 12:24:17.019796 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:16.989904 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:17.023274 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:16.987455 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:16.994192 25680 raft_consensus.cc:1275] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:24:17.034693 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:17.036065 25680 raft_consensus.cc:2468] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 6.
I20260709 12:24:17.037212 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:17.047075 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:17.049952 26433 raft_consensus.cc:3055] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:17.050138 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:17.050539 26433 raft_consensus.cc:740] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:17.051357 26439 raft_consensus.cc:2468] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 8.
W20260709 12:24:17.052314 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:17.001669 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:17.007578 25681 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 7.
I20260709 12:24:17.054996 28258 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:17.056890 28373 raft_consensus.cc:2804] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:17.052664 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:17.057575 28463 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:17.058290 28568 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:17.052654 25801 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:17.072022 26433 consensus_queue.cc:260] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:17.072749 28691 consensus_queue.cc:1048] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:17.065845 28373 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:17.074240 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:17.074779 28373 raft_consensus.cc:3060] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:17.072384 28568 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:17.074268 26433 raft_consensus.cc:3060] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:17.087628 28689 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:17.090458 28689 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:17.075362 28691 consensus_queue.cc:1048] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:24:17.093317 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:17.094422 25681 raft_consensus.cc:2468] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 6.
I20260709 12:24:17.096355 25679 raft_consensus.cc:2468] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 7.
W20260709 12:24:17.097291 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:17.098218 25679 raft_consensus.cc:1275] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:17.097304 28774 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
W20260709 12:24:17.098214 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 45940.3us
I20260709 12:24:17.102454 28779 raft_consensus.cc:2804] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:17.107250 25677 raft_consensus.cc:2410] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:24:16.910000 28633 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:17.112092 28463 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:17.112860 28634 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:17.114547 28525 raft_consensus.cc:3055] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:17.112669 25681 raft_consensus.cc:1275] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:24:17.118103 28705 raft_consensus.cc:2804] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:17.118752 28705 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:17.119197 28705 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:17.119606 28662 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:17.122115 28735 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:17.123812 28735 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:17.127025 28735 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:17.127353 25801 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
W20260709 12:24:17.127808 28788 log.cc:927] Time spent T 00000000000000000000000000000000 P 496fd6924b624e77b03ccfd15653d47b: Append to log took a long time: real 0.171s	user 0.001s	sys 0.000s
I20260709 12:24:17.107252 28779 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:17.132993 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:17.131027 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 123106us
I20260709 12:24:17.134807 28779 raft_consensus.cc:3060] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:17.115103 28525 raft_consensus.cc:740] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:17.142604 25682 raft_consensus.cc:2393] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 7: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:17.146502 28774 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:17.149904 28774 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:17.150019 28682 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:17.150633 25763 raft_consensus.cc:1240] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 LEADER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:17.150980 28682 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:17.151669 28258 consensus_queue.cc:1048] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:17.152158 28775 raft_consensus.cc:2749] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:17.153512 28682 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:17.155218 25829 raft_consensus.cc:1240] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:17.108153 28609 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:17.159953 28609 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:16.934612 28669 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:17.163379 26438 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.782s	user 0.009s	sys 0.002s
I20260709 12:24:17.164433 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:17.167171 28525 consensus_queue.cc:260] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:17.168551 28525 raft_consensus.cc:3060] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:17.173683 25683 raft_consensus.cc:1240] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:17.156584 28633 consensus_queue.cc:1048] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:24:17.179301 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:24:17.163779 26438 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.782s	user 0.009s	sys 0.002s
I20260709 12:24:17.189059 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:17.189610 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:17.190536 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:17.191800 25761 raft_consensus.cc:1275] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:24:17.192305 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:17.193176 25757 raft_consensus.cc:3060] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:17.194715 26402 leader_election.cc:336] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 1.555s (SENT)
I20260709 12:24:17.160737 28568 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:17.198225 25832 raft_consensus.cc:1275] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:24:17.200021 25686 raft_consensus.cc:2468] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 8.
I20260709 12:24:17.201604 25763 raft_consensus.cc:1240] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:17.201884 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:17.202857 25831 raft_consensus.cc:1275] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:24:17.203306 25831 pending_rounds.cc:85] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a: Aborting all ops after (but not including) 5
I20260709 12:24:17.203648 25831 pending_rounds.cc:107] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:24:17.204023 25831 raft_consensus.cc:2889] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:17.204669 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:17.206642 25650 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:17.208863 25650 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:17.132627 28463 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:17.224021 25757 raft_consensus.cc:2468] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 4.
I20260709 12:24:17.232460 25834 raft_consensus.cc:1275] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:17.233762 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:17.235311 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:17.234031 28592 consensus_meta.cc:287] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.923s	user 0.013s	sys 0.005s
I20260709 12:24:17.236055 25830 raft_consensus.cc:2468] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 5.
I20260709 12:24:17.236065 25833 raft_consensus.cc:1240] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:24:17.240033 28775 consensus_queue.cc:1048] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:17.242043 28775 consensus_queue.cc:1059] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:17.242209 25800 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:17.243552 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:17.244092 25726 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:17.244499 25834 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 8.
W20260709 12:24:17.245102 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 103356us
I20260709 12:24:17.245283 28592 raft_consensus.cc:2804] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:17.245837 28592 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:17.246559 28592 raft_consensus.cc:3060] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:17.248494 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 54016.5us
W20260709 12:24:17.249392 26402 leader_election.cc:336] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 1.690s (SENT)
I20260709 12:24:17.249879 26402 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:17.250990 28750 raft_consensus.cc:2749] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:17.252482 28669 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:17.253695 28669 raft_consensus.cc:2804] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:17.254312 28669 raft_consensus.cc:697] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:17.185647 28373 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:17.256152 25758 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.013s	sys 0.021s
I20260709 12:24:17.256296 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:17.256750 28706 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:17.260594 26433 raft_consensus.cc:1275] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:24:17.263779 28706 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:17.265980 28463 raft_consensus.cc:2804] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:17.266413 28706 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:17.266353 25801 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
W20260709 12:24:17.267380 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 58781us
I20260709 12:24:17.271858 28258 consensus_queue.cc:1048] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:24:17.273895 28674 consensus_meta.cc:287] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.544s	user 0.005s	sys 0.008s
I20260709 12:24:17.274500 28674 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:17.274853 28689 consensus_queue.cc:1059] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:17.275144 25650 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:17.275875 28590 raft_consensus.cc:3055] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:17.276428 28590 raft_consensus.cc:740] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:17.276607 28689 raft_consensus.cc:2749] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:17.277575 28590 consensus_queue.cc:260] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:17.279398 28590 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:17.252643 26402 leader_election.cc:336] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 1.710s (SENT)
I20260709 12:24:17.281476 26402 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:17.282783 28750 raft_consensus.cc:2749] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:17.284600 26402 leader_election.cc:336] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 1.814s (SENT)
I20260709 12:24:17.285313 26402 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:17.267853 28706 raft_consensus.cc:2749] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:17.269573 28670 consensus_meta.cc:287] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.571s	user 0.018s	sys 0.000s
I20260709 12:24:17.270236 28463 raft_consensus.cc:697] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 6 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
W20260709 12:24:17.287272 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:17.288793 28463 consensus_queue.cc:237] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:17.291023 28609 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:17.292517 28370 raft_consensus.cc:3055] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:17.292876 25726 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:17.292703 28670 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:17.293901 25762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48606 (request call id 727) took 1040 ms. Trace:
I20260709 12:24:17.294102 25726 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:17.294342 25762 rpcz_store.cc:276] 0709 12:24:16.253423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:16.255765 (+  2342us) service_pool.cc:224] Handling call
0709 12:24:16.267799 (+ 12034us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:16.660700 (+392901us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:17.293479 (+632779us) spinlock_profiling.cc:243] Waited 346 ms on lock 0x7b54003a5cd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:17.293741 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":796278656}
I20260709 12:24:17.296110 25829 raft_consensus.cc:1240] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:17.299355 28633 raft_consensus.cc:2804] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:17.218422 28568 raft_consensus.cc:2804] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:17.312732 28568 raft_consensus.cc:697] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 7 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:17.293010 28370 raft_consensus.cc:740] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:17.309089 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:17.312597 28689 consensus_queue.cc:1059] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:17.314235 28370 consensus_queue.cc:260] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:17.314201 28568 consensus_queue.cc:237] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:24:17.315647 28745 raft_consensus.cc:3055] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:17.315742 28370 raft_consensus.cc:3060] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:17.316171 28745 raft_consensus.cc:740] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:17.299849 28633 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:17.316907 28633 raft_consensus.cc:3060] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:17.317356 28745 consensus_queue.cc:260] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:17.310487 28750 raft_consensus.cc:2749] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:17.329119 28745 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:17.331210 28742 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:17.333055 28742 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:17.335637 28742 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:17.328512 28735 raft_consensus.cc:2804] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:24:17.336473 28757 log.cc:927] Time spent T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.533s	user 0.004s	sys 0.003s
W20260709 12:24:17.341562 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:17.354368 25650 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:17.343679 28735 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:17.368052 28779 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:17.364938 28674 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:17.378724 28779 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:17.381671 25831 raft_consensus.cc:1240] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:17.382704 25757 raft_consensus.cc:1275] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:24:17.383093 25757 pending_rounds.cc:85] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 3
I20260709 12:24:17.383407 25757 pending_rounds.cc:107] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:24:17.383700 25757 raft_consensus.cc:2889] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:17.383888 28609 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:17.384577 28609 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:17.386912 28609 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:17.389026 28373 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:17.396616 28710 raft_consensus.cc:3055] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:17.397071 28710 raft_consensus.cc:740] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:17.398373 28680 consensus_queue.cc:1048] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:17.367223 28735 raft_consensus.cc:3060] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:17.409868 25726 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:17.345070 28669 consensus_queue.cc:237] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:17.426154 28373 raft_consensus.cc:2804] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:17.428619 28373 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:17.429126 28373 raft_consensus.cc:3060] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:17.430871 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 63792.5us
I20260709 12:24:17.431654 25726 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:17.432546 28525 raft_consensus.cc:2804] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:17.432745 25726 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:17.432965 28525 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:17.448230 28742 raft_consensus.cc:2804] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:17.448809 28742 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:17.448311 28525 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:17.447136 25649 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:17.372623 28657 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:17.449185 28742 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:17.470562 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 185988us
W20260709 12:24:17.472481 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 129766us
I20260709 12:24:17.433288 28634 raft_consensus.cc:2804] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:24:17.474982 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:17.478920 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 206585us
I20260709 12:24:17.398391 28710 consensus_queue.cc:260] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:17.442538 28705 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:17.476020 28634 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:17.496852 25726 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:17.498298 25726 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
W20260709 12:24:17.495483 26402 leader_election.cc:336] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 1.825s (SENT)
W20260709 12:24:17.495854 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 49065.8us
I20260709 12:24:17.508065 26402 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:17.495514 28634 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:17.505703 28750 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:17.519095 28369 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:17.519273 28709 raft_consensus.cc:3055] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:24:17.519749 28749 raft_consensus.cc:2804] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:17.519528 28544 consensus_queue.cc:1048] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:24:17.522977 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:17.505903 28682 raft_consensus.cc:2804] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:17.491871 28592 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:17.520260 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:17.545496 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:17.546356 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:17.487345 28657 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:17.549353 28557 raft_consensus.cc:2749] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:17.574002 25829 raft_consensus.cc:2410] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for term 8 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:24:17.528975 28749 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:17.574365 25726 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:17.573879 25834 raft_consensus.cc:2468] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 8.
I20260709 12:24:17.526402 28709 raft_consensus.cc:740] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:17.517694 28775 consensus_queue.cc:1059] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:24:17.531371 28682 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:17.580904 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:17.582273 28750 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:17.583175 28637 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:17.573433 28741 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:17.590924 28689 consensus_queue.cc:1048] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:24:17.592078 28797 log.cc:927] Time spent T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:24:17.596163 28691 consensus_queue.cc:1059] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:24:17.596864 28793 log.cc:927] Time spent T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:24:17.597036 28746 consensus_queue.cc:1048] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:17.597963 28637 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:17.534530 28369 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:17.599100 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 107262us
I20260709 12:24:17.600728 28592 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:17.604200 28742 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:24:17.607990 28650 raft_consensus.cc:2804] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:17.608812 28709 consensus_queue.cc:260] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:17.610523 28775 consensus_queue.cc:1243] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Peer f82778701b464892aab92a752ed7ffdc log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:24:17.577791 28749 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:17.587263 28682 raft_consensus.cc:3060] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:17.638924 25801 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
W20260709 12:24:17.642692 26402 leader_election.cc:336] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 1.980s (SENT)
I20260709 12:24:17.632550 28650 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:17.648806 26402 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:17.626014 28741 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:17.666409 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:17.667127 28662 raft_consensus.cc:2749] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:17.667639 28741 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:17.668159 28744 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:17.669051 28657 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:17.670622 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:17.671350 25759 raft_consensus.cc:2468] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 7.
I20260709 12:24:17.672891 25800 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:17.675406 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:17.676743 25759 raft_consensus.cc:2410] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:24:17.679736 28750 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:17.672932 28742 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:17.673049 28369 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:17.650579 28650 raft_consensus.cc:3060] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:17.653846 28705 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:17.663558 28709 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:17.697638 28670 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:17.690696 28735 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:17.700348 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 71439.3us
I20260709 12:24:17.702298 28735 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:17.685302 28609 raft_consensus.cc:2749] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:17.705767 28373 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:17.708333 25762 raft_consensus.cc:1240] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:17.708576 28774 consensus_queue.cc:1059] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:17.709729 28774 consensus_queue.cc:1048] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:17.675601 28637 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:17.709950 28369 raft_consensus.cc:3055] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:17.712157 28369 raft_consensus.cc:740] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:17.717828 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:24:17.681964 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 155766us
I20260709 12:24:17.685801 28657 raft_consensus.cc:2804] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:17.728012 25759 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 7.
I20260709 12:24:17.741680 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:17.742607 26433 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 12.
I20260709 12:24:17.713270 28369 consensus_queue.cc:260] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:17.719486 28373 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:17.753427 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 114527us
I20260709 12:24:17.726965 28657 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:17.752621 28525 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:17.756484 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:17.757251 26434 raft_consensus.cc:3060] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:17.758337 28525 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:17.759079 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:17.762070 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:17.762777 26431 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:17.725741 28557 consensus_queue.cc:1059] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:24:17.773744 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:17.755789 28657 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:17.770170 28682 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:17.770918 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:17.772264 25684 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
mode: GRACEFUL
new_leader_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:49108
I20260709 12:24:17.775444 25684 raft_consensus.cc:606] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 7 LEADER]: Received request to transfer leadership to TS 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:17.774454 26430 raft_consensus.cc:2468] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 4.
I20260709 12:24:17.778479 26431 raft_consensus.cc:2468] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 6.
W20260709 12:24:17.779186 28791 log.cc:927] Time spent T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.349s	user 0.000s	sys 0.002s
I20260709 12:24:17.781531 26432 raft_consensus.cc:1275] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:24:17.796635 26402 leader_election.cc:336] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 2.109s (SENT)
I20260709 12:24:17.797245 26402 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
W20260709 12:24:17.791584 28801 log.cc:927] Time spent T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
W20260709 12:24:17.789979 28802 log.cc:927] Time spent T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.086s	user 0.003s	sys 0.000s
I20260709 12:24:17.805625 28483 raft_consensus.cc:2749] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:24:17.808604 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 75134.5us
I20260709 12:24:17.809751 25684 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
mode: GRACEFUL
new_leader_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:49108
I20260709 12:24:17.783227 28710 raft_consensus.cc:3060] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:17.810515 25684 raft_consensus.cc:606] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Received request to transfer leadership to TS 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:24:17.816570 25684 raft_consensus.cc:614] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:17.825266 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:17.826155 26437 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:17.827443 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 52885.7us
W20260709 12:24:17.828212 26402 leader_election.cc:336] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 2.112s (SENT)
I20260709 12:24:17.832188 26401 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:17.854861 28680 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:17.857430 28680 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:17.858119 25759 raft_consensus.cc:1240] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:17.856901 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 244699us
I20260709 12:24:17.853544 28557 raft_consensus.cc:2804] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:24:17.870585 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 253785us
I20260709 12:24:17.849712 28749 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:17.865927 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:24:17.874073 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:17.861686 28680 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:17.873339 28557 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:17.877651 28744 raft_consensus.cc:2749] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:17.867424 28634 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:17.867949 28650 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:17.883211 28633 consensus_meta.cc:287] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.566s	user 0.011s	sys 0.002s
I20260709 12:24:17.903378 25726 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:17.900671 28557 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:17.922920 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 43858.7us
I20260709 12:24:17.926673 28682 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:17.924645 28258 consensus_queue.cc:1059] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:24:17.928114 28734 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:17.928937 28734 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:17.930537 28761 consensus_queue.cc:1059] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.061s
W20260709 12:24:17.932001 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:17.900355 28705 consensus_queue.cc:1048] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:24:17.938720 28650 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:17.953294 28749 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:24:17.966296 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 73844.3us
W20260709 12:24:17.976425 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 66055.7us
I20260709 12:24:17.979332 26402 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:17.981699 28258 consensus_queue.cc:1243] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer 6e673265293d4e9a937dc45150aeb1b8 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:24:17.982908 28700 consensus_queue.cc:1059] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:17.984300 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:17.985754 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:17.986411 25686 raft_consensus.cc:2468] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 5.
I20260709 12:24:17.987239 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:17.988015 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:17.988427 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:17.988513 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:17.989086 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:17.989660 25682 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:17.989956 25681 raft_consensus.cc:3055] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:17.990327 25681 raft_consensus.cc:740] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:17.990767 25678 raft_consensus.cc:1275] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:24:17.991209 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:17.992182 25683 raft_consensus.cc:1275] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:24:17.992303 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:17.992978 28781 raft_consensus.cc:2804] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:17.993451 28781 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:17.993834 28781 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:17.987287 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:17.998622 28816 raft_consensus.cc:2749] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:17.992992 25679 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:17.999543 28816 raft_consensus.cc:3055] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:18.000069 28816 raft_consensus.cc:740] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:18.001304 28816 consensus_queue.cc:260] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:18.002684 28816 raft_consensus.cc:3060] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:17.985935 28650 raft_consensus.cc:993] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc: : Instructing follower 6e673265293d4e9a937dc45150aeb1b8 to start an election
I20260709 12:24:18.004261 28650 raft_consensus.cc:1081] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 7 LEADER]: Signalling peer 6e673265293d4e9a937dc45150aeb1b8 to start an election
I20260709 12:24:18.005034 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:17.998700 25677 raft_consensus.cc:3060] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:17.989594 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:18.004189 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:18.006858 25686 raft_consensus.cc:2393] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 5: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:18.009228 28689 raft_consensus.cc:3055] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:18.009649 28689 raft_consensus.cc:740] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:18.010643 28689 consensus_queue.cc:260] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:18.011458 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:18.015434 25682 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 9.
I20260709 12:24:17.910441 28483 consensus_queue.cc:1059] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.106s
I20260709 12:24:18.016793 25679 raft_consensus.cc:2468] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 6.
I20260709 12:24:18.017307 28483 raft_consensus.cc:3055] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:18.017709 28483 raft_consensus.cc:740] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:18.017882 28369 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:17.984227 28700 consensus_queue.cc:1048] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:17.931722 28734 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:24:18.020706 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 45810.7us
I20260709 12:24:18.026072 25801 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
W20260709 12:24:18.033809 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:18.035028 25677 raft_consensus.cc:2468] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 4.
I20260709 12:24:18.035194 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:24:18.035943 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:17.991108 25681 consensus_queue.cc:260] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:18.043164 25681 raft_consensus.cc:3060] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:18.043401 28670 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:18.044159 28670 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:18.045076 28609 raft_consensus.cc:3055] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:18.045473 28609 raft_consensus.cc:740] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:18.046283 28609 consensus_queue.cc:260] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:18.046765 28670 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:18.047245 28609 raft_consensus.cc:3060] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:18.048348 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:18.052659 28705 raft_consensus.cc:2749] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:18.052881 25801 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:18.053884 28669 raft_consensus.cc:2804] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:24:18.054356 28669 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:18.054813 28669 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:18.060544 25801 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:18.062057 25801 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:18.062748 25681 raft_consensus.cc:1275] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 8. (term mismatch)
I20260709 12:24:18.024268 28689 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:18.074746 26434 raft_consensus.cc:2468] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 6.
I20260709 12:24:18.072569 25726 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:18.076691 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:18.063210 25681 pending_rounds.cc:85] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc: Aborting all ops after (but not including) 7
I20260709 12:24:18.081293 25761 raft_consensus.cc:2368] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for earlier term 8. Current term is 9.
I20260709 12:24:18.081449 25681 pending_rounds.cc:107] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc: Aborting uncommitted NO_OP operation due to leader change: 5.8
I20260709 12:24:18.081887 25681 raft_consensus.cc:2889] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:18.076756 28705 raft_consensus.cc:2804] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:18.085108 28705 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:18.085614 28705 raft_consensus.cc:3060] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:18.088182 28774 raft_consensus.cc:2804] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:18.088889 28634 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:17.922498 28633 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:18.093977 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 70351us
I20260709 12:24:18.098738 26437 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 9.
I20260709 12:24:18.111533 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:18.109771 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:18.113236 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:18.112059 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:18.116971 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:18.117874 28676 consensus_queue.cc:1048] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:24:18.113300 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:18.018873 28483 consensus_queue.cc:260] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:18.088904 28774 raft_consensus.cc:697] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 6 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:18.077097 28761 consensus_queue.cc:1048] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:24:18.141302 28483 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:18.143107 28557 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:18.111896 28634 raft_consensus.cc:2804] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:18.148325 25756 raft_consensus.cc:1275] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:24:18.129576 25726 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:18.151657 28815 consensus_queue.cc:1059] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:18.157810 25754 raft_consensus.cc:1240] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:18.168388 25801 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:24:18.169902 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 57883.8us
I20260709 12:24:18.149571 28634 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:18.177050 28634 raft_consensus.cc:3060] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:18.181386 28741 raft_consensus.cc:2804] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:18.190538 25726 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
W20260709 12:24:18.209525 28803 log.cc:927] Time spent T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.217s	user 0.000s	sys 0.003s
I20260709 12:24:18.215600 28742 raft_consensus.cc:2749] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:18.221446 28741 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:18.222223 28741 raft_consensus.cc:3060] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:18.225247 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:18.229826 25755 raft_consensus.cc:1275] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 3. (index mismatch)
W20260709 12:24:18.232872 25569 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet c87d777e7d64471f988b07272bf2441c with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica f82778701b464892aab92a752ed7ffdc is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
W20260709 12:24:18.235090 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:18.235751 25582 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41232 (request call id 388) took 19800 ms (client timeout 15000 ms). Trace:
W20260709 12:24:18.236162 25582 rpcz_store.cc:269] 0709 12:23:58.434392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:23:58.434542 (+   150us) service_pool.cc:224] Handling call
0709 12:24:18.234926 (+19800384us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:16.939864 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:16.947030 (+  7166us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:16.947068 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:24:16.947085 (+    17us) tablet.cc:662] Decoding operations
0709 12:24:16.947619 (+   534us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:16.947676 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:16.947700 (+    24us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:24:16.947974 (+   274us) tablet.cc:701] Row locks acquired
0709 12:24:16.947989 (+    15us) write_op.cc:260] PREPARE: finished
0709 12:24:16.948137 (+   148us) write_op.cc:270] Start()
0709 12:24:16.948244 (+   107us) write_op.cc:276] Timestamp: P: 1783599856948085 usec, L: 0
0709 12:24:16.948260 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 12:24:16.948925 (+   665us) log.cc:844] Serialized 989 byte log entry
0709 12:24:17.533483 (+584558us) op_driver.cc:464] REPLICATION: finished
0709 12:24:17.904488 (+371005us) write_op.cc:301] APPLY: starting
0709 12:24:17.924529 (+ 20041us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:17.926619 (+  2090us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:17.926759 (+   140us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:17.927215 (+   456us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:17.927525 (+   310us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:24:17.927575 (+    50us) write_op.cc:312] APPLY: finished
0709 12:24:17.927936 (+   361us) log.cc:844] Serialized 29 byte log entry
0709 12:24:17.928140 (+   204us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:17.928256 (+   116us) write_op.cc:454] Released schema lock
0709 12:24:17.928307 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:17.928736 (+   429us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:17.928763 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":18,"child_traces":[["op",{"apply.queue_time_us":299765,"apply.run_cpu_time_us":2683,"apply.run_wall_time_us":36344,"num_ops":2,"prepare.queue_time_us":264726,"prepare.run_cpu_time_us":6950,"prepare.run_wall_time_us":186954,"raft.queue_time_us":349563,"raft.run_cpu_time_us":11433,"raft.run_wall_time_us":252452,"replication_time_us":546373,"thread_start_us":602195,"threads_started":4,"wal-append.queue_time_us":7108}]]}
W20260709 12:24:18.239881 25649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:18.241448 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:18.242048 25681 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 8.
I20260709 12:24:18.242323 28657 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:18.242869 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:18.243531 25677 raft_consensus.cc:2468] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 6.
I20260709 12:24:18.245416 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:18.246068 25759 raft_consensus.cc:3060] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:18.248685 25762 raft_consensus.cc:1240] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:18.253263 25755 raft_consensus.cc:1240] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:24:18.254971 25761 raft_consensus.cc:1275] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:24:18.255406 25761 pending_rounds.cc:85] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 3
I20260709 12:24:18.255699 25761 pending_rounds.cc:107] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:24:18.260061 25761 raft_consensus.cc:2889] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:18.167897 28774 consensus_queue.cc:237] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:18.163105 28676 consensus_queue.cc:1059] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.108s
I20260709 12:24:18.277788 25759 raft_consensus.cc:2468] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 8.
I20260709 12:24:18.265507 25682 raft_consensus.cc:1240] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:24:18.266230 25677 raft_consensus.cc:1275] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:24:18.266871 25681 raft_consensus.cc:1275] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:24:18.279954 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:18.260581 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 97790us
W20260709 12:24:18.276180 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 102398us
I20260709 12:24:18.197067 28670 raft_consensus.cc:2804] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:18.286270 25686 raft_consensus.cc:2468] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 4.
I20260709 12:24:18.286908 25831 raft_consensus.cc:1275] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:24:18.287587 25684 raft_consensus.cc:1275] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 12:24:18.287865 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:18.288676 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:18.289271 25680 raft_consensus.cc:2468] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 8.
I20260709 12:24:18.290606 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:18.288012 25684 pending_rounds.cc:85] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc: Aborting all ops after (but not including) 5
I20260709 12:24:18.292430 25684 pending_rounds.cc:107] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:24:18.292712 25684 raft_consensus.cc:2889] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:18.292451 25834 raft_consensus.cc:3060] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:18.295230 25685 raft_consensus.cc:1240] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:18.297325 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:18.257838 28557 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:18.264429 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:18.307014 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:18.310459 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:18.308363 25828 raft_consensus.cc:2468] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 6.
I20260709 12:24:18.310447 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:18.313578 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 162635us
I20260709 12:24:18.312956 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:18.313921 25726 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:18.329769 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:18.330657 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
W20260709 12:24:18.341864 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 45505.4us
I20260709 12:24:18.341856 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:18.301489 28680 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:18.296742 28710 consensus_queue.cc:1048] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 12:24:18.308405 28670 raft_consensus.cc:697] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 8 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:18.348845 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:18.316663 28761 raft_consensus.cc:3055] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:18.351565 28761 raft_consensus.cc:740] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:18.351603 25649 leader_election.cc:400] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 election: Vote denied by peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267) with higher term. Message: Invalid argument: T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for earlier term 8. Current term is 9.
I20260709 12:24:18.352308 25649 leader_election.cc:403] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:24:18.352802 28761 consensus_queue.cc:260] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:18.354341 28745 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:18.354790 25649 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:18.355777 28258 consensus_queue.cc:1048] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:18.356437 28805 consensus_queue.cc:1059] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:18.357442 28805 consensus_queue.cc:1059] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:18.357522 28258 consensus_queue.cc:1048] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:18.358453 28805 raft_consensus.cc:2804] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:18.359064 28805 raft_consensus.cc:697] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 8 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:18.359824 28258 raft_consensus.cc:3055] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:18.360256 28258 raft_consensus.cc:740] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:18.360733 28761 raft_consensus.cc:3060] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:18.361291 28258 consensus_queue.cc:260] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:18.362552 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:18.363758 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:18.312918 28633 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:18.359153 28373 raft_consensus.cc:3055] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:18.362614 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:18.328299 28682 raft_consensus.cc:2804] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:18.368283 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:18.372210 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:18.374754 26433 raft_consensus.cc:2393] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 6: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:18.376341 25801 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:18.390678 25828 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:18.393978 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 48793.1us
I20260709 12:24:18.398586 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:18.399194 25830 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:18.400389 25761 raft_consensus.cc:1240] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:18.402702 26433 raft_consensus.cc:1275] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:24:18.405222 25686 raft_consensus.cc:1275] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:24:18.364776 28674 raft_consensus.cc:3055] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:18.391029 28682 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:18.370491 28373 raft_consensus.cc:740] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:18.372298 25759 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:53474
I20260709 12:24:18.418074 25759 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:18.418536 25759 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:18.397399 25584 catalog_manager.cc:5697] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 4 to 6, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 6 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:24:18.421940 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:18.423635 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:18.437672 28742 consensus_queue.cc:1048] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:18.437422 25584 catalog_manager.cc:5697] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 9 to 11, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 11 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:24:18.439687 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:18.440114 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:18.440558 25836 raft_consensus.cc:2393] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 5: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:18.440698 25837 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:18.415527 28680 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:18.441507 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:18.442212 25836 raft_consensus.cc:2393] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 11: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:18.443071 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:18.448201 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:18.412132 28258 raft_consensus.cc:3060] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:18.453995 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:18.415102 26402 connection.cc:256] RPC call timeout handler was delayed by -1.2774381740000536s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.26520000000000005s for a response
I20260709 12:24:18.448444 25833 raft_consensus.cc:2468] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 6.
I20260709 12:24:18.439440 25584 catalog_manager.cc:5697] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:18.408471 28657 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:18.412760 28779 raft_consensus.cc:2749] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:18.423704 28682 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:18.464902 26433 raft_consensus.cc:2468] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 7.
I20260709 12:24:18.416436 28674 raft_consensus.cc:740] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:18.464845 28805 consensus_queue.cc:237] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:18.486627 25726 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:24:18.488570 28674 consensus_queue.cc:260] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:18.492220 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:18.492377 25584 catalog_manager.cc:5697] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:18.493386 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:18.494225 28670 consensus_queue.cc:237] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:18.494052 25584 catalog_manager.cc:5697] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 2 to 6, leader changed from a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 6 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:18.495123 28749 raft_consensus.cc:2804] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:18.495522 28749 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:18.495944 28749 raft_consensus.cc:3060] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:18.495671 25584 catalog_manager.cc:5697] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc reported cstate change: config changed from index 4 to 6, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:24:18.494067 25836 raft_consensus.cc:2393] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 9: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:18.453445 28568 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:18.501410 25829 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 5.
I20260709 12:24:18.509615 25828 raft_consensus.cc:2468] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 8.
I20260709 12:24:18.513181 25763 raft_consensus.cc:1240] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:18.517385 25830 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 9.
I20260709 12:24:18.507694 25759 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:18.531790 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:18.532045 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:18.532123 26433 raft_consensus.cc:1240] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:18.537058 28741 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:18.541460 25830 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:18.549921 25759 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:18.467247 28634 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:18.545382 25584 catalog_manager.cc:5697] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 4 to 5, leader changed from a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 5 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:24:18.561049 26433 raft_consensus.cc:1240] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:24:18.562192 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:18.564006 25836 raft_consensus.cc:3060] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:18.565582 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:18.566542 26432 raft_consensus.cc:2393] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 9: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:18.509021 28742 consensus_queue.cc:1048] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:24:18.567795 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:18.534009 28734 consensus_queue.cc:1048] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:24:18.577571 28634 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:18.577768 28734 consensus_queue.cc:1243] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer f82778701b464892aab92a752ed7ffdc log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:24:18.578523 28373 consensus_queue.cc:260] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:18.509706 28804 consensus_queue.cc:1059] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:24:18.514523 28568 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:18.584411 25828 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 3.
W20260709 12:24:18.590106 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:18.558156 28680 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:18.592744 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 216537us
I20260709 12:24:18.599066 25801 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:18.593000 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:18.565593 28676 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:18.581765 25726 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:18.604230 25584 catalog_manager.cc:5697] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 2 to 4, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 4 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
W20260709 12:24:18.597731 28669 consensus_meta.cc:287] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.542s	user 0.017s	sys 0.000s
I20260709 12:24:18.609212 26437 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 3.
I20260709 12:24:18.612396 25830 raft_consensus.cc:2468] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 7.
I20260709 12:24:18.611529 25801 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:18.615078 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:18.619410 25828 raft_consensus.cc:1275] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:24:18.595330 28650 consensus_queue.cc:1059] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:24:18.607120 28710 raft_consensus.cc:2804] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:18.623080 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:18.629634 25830 raft_consensus.cc:1240] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:18.629813 26437 raft_consensus.cc:2468] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 7.
I20260709 12:24:18.632114 25834 raft_consensus.cc:2468] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 7.
I20260709 12:24:18.617231 28734 raft_consensus.cc:2804] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:18.636421 25584 catalog_manager.cc:5697] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:24:18.644994 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:18.645666 26437 raft_consensus.cc:3060] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:18.646521 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:18.636257 28781 consensus_meta.cc:287] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.642s	user 0.009s	sys 0.004s
I20260709 12:24:18.619695 28633 consensus_queue.cc:1048] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.025s
W20260709 12:24:18.653975 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 173224us
I20260709 12:24:18.654913 25801 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:18.636742 28680 raft_consensus.cc:2749] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:24:18.607981 28676 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:18.631546 28710 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:18.617450 28669 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:18.639860 28734 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:18.660494 25830 raft_consensus.cc:1240] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 6 LEADER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:18.660787 26432 raft_consensus.cc:1240] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 5. Current term is 6. Ops: [5.8-5.8]
W20260709 12:24:18.662199 28705 consensus_meta.cc:287] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.576s	user 0.009s	sys 0.000s
I20260709 12:24:18.662464 28369 consensus_queue.cc:1048] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:18.663530 28741 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:18.673435 26437 raft_consensus.cc:2468] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 7.
I20260709 12:24:18.664718 25584 catalog_manager.cc:5697] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:24:18.706362 25584 catalog_manager.cc:5697] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:24:18.707653 25649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:18.709537 28827 log.cc:927] Time spent T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:24:18.709692 28568 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:18.710659 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:18.711230 26437 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:24:18.711823 25685 raft_consensus.cc:1240] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:18.712308 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:18.712965 25680 raft_consensus.cc:2368] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 5. Current term is 6.
I20260709 12:24:18.713376 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:18.713476 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:18.713788 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:18.711252 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:18.714370 25680 raft_consensus.cc:2468] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 7.
I20260709 12:24:18.714435 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:18.715049 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
W20260709 12:24:18.716365 28821 log.cc:927] Time spent T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 12:24:18.720196 28373 raft_consensus.cc:3060] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:18.720604 28829 log.cc:927] Time spent T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:24:18.715646 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:18.712992 25686 raft_consensus.cc:1240] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:24:18.657241 28463 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:18.712818 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:18.667455 25837 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 8.
I20260709 12:24:18.694344 28779 raft_consensus.cc:2749] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:18.702747 28734 raft_consensus.cc:3060] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:18.731514 26402 leader_election.cc:336] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 2.491s (SENT)
I20260709 12:24:18.738014 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:18.742019 28370 raft_consensus.cc:3055] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:18.742451 28370 raft_consensus.cc:740] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:18.703472 28710 raft_consensus.cc:3060] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:18.708436 28705 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:18.646598 28742 consensus_queue.cc:1048] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 12:24:18.671224 25801 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
W20260709 12:24:18.758917 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 87824.7us
I20260709 12:24:18.737210 26437 raft_consensus.cc:2468] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 7.
I20260709 12:24:18.743297 28370 consensus_queue.cc:260] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:18.738838 25584 catalog_manager.cc:5697] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 1 to 4, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 4 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:24:18.726115 28634 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:18.656373 28781 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:18.731202 28609 consensus_meta.cc:287] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.684s	user 0.009s	sys 0.005s
I20260709 12:24:18.745911 28557 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:18.763095 25584 catalog_manager.cc:5697] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 2 to 4, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 4 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:24:18.760406 25801 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:18.764118 25763 raft_consensus.cc:1240] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:18.674180 28774 consensus_queue.cc:1048] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.085s
I20260709 12:24:18.765182 28557 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:18.767766 25801 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:24:18.768342 28828 log.cc:927] Time spent T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 12:24:18.769176 28369 raft_consensus.cc:2749] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:18.769634 28557 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:18.769820 28369 raft_consensus.cc:2804] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:18.770334 28369 raft_consensus.cc:697] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 9 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:18.771157 28369 consensus_queue.cc:237] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:18.773362 25757 raft_consensus.cc:2393] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 7: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:18.774298 28781 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:18.765826 28840 raft_consensus.cc:2749] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:18.775689 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 72387us
I20260709 12:24:18.775483 25584 catalog_manager.cc:5697] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 3 to 5, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 5 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } }
W20260709 12:24:18.776468 26402 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:18.778968 26402 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:18.779177 28824 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:18.779287 28700 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:18.779772 28824 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:18.779837 28700 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:18.780915 28705 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:18.781759 28824 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:18.776945 25584 catalog_manager.cc:5697] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 4 to 8, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 8 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:18.783589 28634 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:18.784595 25584 catalog_manager.cc:5697] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 2 to 6, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 6 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:18.785763 28634 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:18.786306 25679 raft_consensus.cc:1240] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:24:18.787793 28831 consensus_queue.cc:1048] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:18.792237 25684 raft_consensus.cc:1275] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:24:18.794814 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:18.795519 25678 raft_consensus.cc:2393] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 3: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:18.799443 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:18.803478 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:18.804417 26433 raft_consensus.cc:2410] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:24:18.805146 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:18.806272 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:18.801844 28370 raft_consensus.cc:3060] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:18.808772 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:18.802120 28750 consensus_queue.cc:1175] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f82778701b464892aab92a752ed7ffdc" responder_term: 4 status { last_received { term: 4 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 4 index: 5 } }
I20260709 12:24:18.805312 28826 raft_consensus.cc:2804] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:18.812718 28826 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:18.839320 28826 raft_consensus.cc:3060] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:18.811866 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:18.844568 26436 raft_consensus.cc:3060] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:18.845310 28674 raft_consensus.cc:3060] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:18.812927 28258 raft_consensus.cc:3055] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:18.848443 28258 raft_consensus.cc:740] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:18.849330 28258 consensus_queue.cc:260] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:18.850306 28258 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:18.813797 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:18.858667 28633 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:18.749848 28463 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:18.859275 28633 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:18.820892 28745 raft_consensus.cc:2749] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267) with higher term. Message: Invalid argument: T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for earlier term 8. Current term is 9.
I20260709 12:24:18.861238 28463 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:18.861290 28633 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:18.862003 25682 raft_consensus.cc:2393] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 6: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:18.862480 25759 raft_consensus.cc:1240] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:18.863227 28705 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:18.863463 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:18.864161 26433 raft_consensus.cc:2468] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 5.
I20260709 12:24:18.865309 26433 raft_consensus.cc:1275] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260709 12:24:18.866528 28822 log.cc:927] Time spent T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.324s	user 0.002s	sys 0.000s
I20260709 12:24:18.866837 25681 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 9.
W20260709 12:24:18.828984 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:18.823259 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:18.781759 28700 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:18.826537 26435 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 6 LEARNER]: Advancing to term 7
I20260709 12:24:18.822549 28682 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:18.881477 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 102590us
I20260709 12:24:18.832234 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:24:18.838292 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:18.833184 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:24:18.885402 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:18.885564 25760 raft_consensus.cc:2393] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 11: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:18.825681 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:24:18.806582 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 187874us
W20260709 12:24:18.809329 25650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:18.887686 25650 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:18.825977 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:18.888901 26439 raft_consensus.cc:3060] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:18.883066 28682 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:18.831025 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:18.833931 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:18.907634 25756 raft_consensus.cc:2468] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 4.
I20260709 12:24:18.830324 25836 raft_consensus.cc:2468] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 6.
I20260709 12:24:18.910125 25830 raft_consensus.cc:1240] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:24:18.912737 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:18.916652 26436 raft_consensus.cc:2468] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 5.
I20260709 12:24:18.916838 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:18.917851 25759 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 6.
I20260709 12:24:18.921182 25726 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:18.924990 25762 raft_consensus.cc:1240] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 7. Current term is 9. Ops: []
I20260709 12:24:18.868729 28831 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:18.812062 28825 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:18.931102 25726 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
W20260709 12:24:18.958648 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:18.958770 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 71168.4us
I20260709 12:24:18.889868 28662 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:18.957090 25726 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:18.863821 28705 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:18.968904 26434 raft_consensus.cc:2468] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 5.
W20260709 12:24:18.977200 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 102732us
I20260709 12:24:18.983348 26402 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:18.985606 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:18.971969 28761 consensus_meta.cc:287] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.611s	user 0.008s	sys 0.003s
I20260709 12:24:18.959820 28633 raft_consensus.cc:2804] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:18.961180 28370 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:19.004988 25650 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:19.005977 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:19.006889 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:19.007104 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:19.011214 25832 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:18.971195 28682 raft_consensus.cc:2749] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:18.981683 28741 raft_consensus.cc:2804] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:19.015715 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:18.980146 28840 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:18.958321 28781 consensus_queue.cc:1048] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:24:19.016376 25828 raft_consensus.cc:2468] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 5.
W20260709 12:24:19.034552 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 52391us
I20260709 12:24:18.959529 28742 consensus_queue.cc:1048] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:24:18.958148 28634 consensus_queue.cc:1059] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 12:24:19.044768 26434 raft_consensus.cc:1240] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:18.999320 28633 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:19.049633 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:19.051131 25836 raft_consensus.cc:2393] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 5: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
W20260709 12:24:19.061311 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:19.064697 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 59800.3us
I20260709 12:24:19.065858 25650 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:19.069615 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:19.070657 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:19.024164 28669 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:18.984654 28749 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:18.959977 28831 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:19.093493 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:19.047578 28650 raft_consensus.cc:2749] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:19.089236 25677 pending_rounds.cc:85] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc: Aborting all ops after (but not including) 5
I20260709 12:24:19.101927 25677 pending_rounds.cc:107] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:24:19.102247 25677 raft_consensus.cc:2889] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:18.978101 28662 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:19.094152 25686 raft_consensus.cc:3060] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:24:19.094643 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:19.107124 25680 raft_consensus.cc:3060] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:19.041069 28824 raft_consensus.cc:2749] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:19.085019 26435 raft_consensus.cc:1275] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 7 LEARNER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:24:19.098444 26401 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:19.041556 28741 raft_consensus.cc:697] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:18.971776 28825 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:19.103442 25649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:19.104287 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 112972us
W20260709 12:24:19.104588 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 142528us
I20260709 12:24:19.073427 28633 raft_consensus.cc:3060] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:19.072242 28676 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:19.093530 28709 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:19.093875 28670 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:19.118238 26436 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 6.
I20260709 12:24:19.119570 25836 raft_consensus.cc:1240] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 12. Current term is 13. Ops: []
I20260709 12:24:19.120666 25757 raft_consensus.cc:1240] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:19.047048 28804 consensus_queue.cc:1059] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 12:24:19.140677 25829 raft_consensus.cc:2468] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 7.
I20260709 12:24:19.016875 28370 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:19.148286 25801 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:24:19.161478 25686 raft_consensus.cc:2468] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 8.
W20260709 12:24:19.162950 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:19.163499 26430 raft_consensus.cc:3060] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:19.152957 25681 raft_consensus.cc:2468] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 5.
I20260709 12:24:19.040974 28840 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:19.165845 26402 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:19.169176 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:19.169925 25686 raft_consensus.cc:2393] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 7: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:19.140810 28815 raft_consensus.cc:2804] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:19.185003 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:19.078855 28841 consensus_queue.cc:1059] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 12:24:19.121912 28669 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:19.187212 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:19.239478 25686 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:19.236483 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:19.104347 28734 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:19.238308 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:19.214102 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:19.242194 25681 raft_consensus.cc:2468] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 5.
I20260709 12:24:19.186302 28850 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:19.262768 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 114613us
I20260709 12:24:19.265983 25801 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:19.187114 28815 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:19.186738 28742 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:19.268044 25686 raft_consensus.cc:2468] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 9.
I20260709 12:24:19.238992 28823 raft_consensus.cc:2749] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:19.274272 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:19.277261 25836 raft_consensus.cc:1240] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:24:19.278973 25830 raft_consensus.cc:2368] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for earlier term 8. Current term is 9.
W20260709 12:24:19.277892 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 110555us
I20260709 12:24:19.164359 28670 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:19.281240 25649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:19.279188 25801 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:19.284332 25756 raft_consensus.cc:1275] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:19.215659 28709 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:19.272159 28815 raft_consensus.cc:3060] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:19.270533 28774 raft_consensus.cc:2804] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:19.296487 25830 raft_consensus.cc:1240] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:24:19.300971 25801 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:19.277383 28650 raft_consensus.cc:2749] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:24:19.304131 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:19.304948 28842 log.cc:927] Time spent T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 12:24:19.304842 28858 consensus_queue.cc:1048] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:24:19.309995 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 166827us
I20260709 12:24:19.310395 25801 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:19.280378 28761 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:19.287837 28848 raft_consensus.cc:2749] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:19.261562 28669 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:19.291152 28705 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:19.320163 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:19.323031 25836 raft_consensus.cc:1240] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:24:19.277957 28742 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:19.330902 26432 raft_consensus.cc:1240] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:19.327442 26402 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:19.300194 28849 raft_consensus.cc:2749] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:19.312688 28851 raft_consensus.cc:2749] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:19.272392 28850 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:19.342867 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 52357.1us
I20260709 12:24:19.374737 25830 raft_consensus.cc:2468] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 5.
I20260709 12:24:19.376690 25836 raft_consensus.cc:1240] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 7. Current term is 8. Ops: []
W20260709 12:24:19.340597 28710 consensus_meta.cc:287] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.577s	user 0.007s	sys 0.002s
I20260709 12:24:19.354926 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:19.383719 26436 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:24:19.382560 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 60213.1us
I20260709 12:24:19.340574 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:19.368631 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:19.387264 26439 raft_consensus.cc:2468] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 8.
I20260709 12:24:19.321197 28823 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:19.323962 28369 raft_consensus.cc:2804] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:19.290521 28741 consensus_queue.cc:237] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:19.320098 28634 consensus_queue.cc:1048] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 12:24:19.316289 28774 raft_consensus.cc:697] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 6 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:19.334259 28689 raft_consensus.cc:3055] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:24:19.392385 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 65023.9us
I20260709 12:24:19.325399 28779 consensus_queue.cc:1048] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.063s
I20260709 12:24:19.396925 28369 raft_consensus.cc:697] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 5 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
W20260709 12:24:19.398590 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:19.348033 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 238342us
I20260709 12:24:19.402091 26436 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 13.
I20260709 12:24:19.407040 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:19.425485 25836 raft_consensus.cc:2393] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 5: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:19.411754 26402 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:19.393142 28859 raft_consensus.cc:3055] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:24:19.412590 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 110322us
I20260709 12:24:19.379850 28557 raft_consensus.cc:2749] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:24:19.401791 28838 log.cc:927] Time spent T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.236s	user 0.001s	sys 0.000s
I20260709 12:24:19.434302 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:19.434716 26402 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:19.436587 25680 raft_consensus.cc:2468] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 7.
I20260709 12:24:19.324788 28761 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:19.433344 25726 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:24:19.452700 25726 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:19.456560 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:19.460085 26435 raft_consensus.cc:2468] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 7.
I20260709 12:24:19.423441 28689 raft_consensus.cc:740] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:19.472347 26402 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:19.447737 28700 raft_consensus.cc:2804] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:24:19.473759 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 48768.5us
I20260709 12:24:19.432830 28859 raft_consensus.cc:740] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:19.475271 25836 raft_consensus.cc:1240] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:19.424146 28831 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:19.476367 25832 raft_consensus.cc:2468] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 9.
I20260709 12:24:19.399616 28710 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:19.438309 28825 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:19.393734 28866 consensus_queue.cc:1048] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 12:24:19.479648 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:19.451053 28824 raft_consensus.cc:2749] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:24:19.480830 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:19.482228 25650 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:19.482106 28557 raft_consensus.cc:2749] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:24:19.486303 28847 log.cc:927] Time spent T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
I20260709 12:24:19.458716 28370 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:19.480647 28700 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:19.537297 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 75004.4us
W20260709 12:24:19.513013 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:19.555352 26430 raft_consensus.cc:2468] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 6.
W20260709 12:24:19.576478 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:19.536103 28369 consensus_queue.cc:237] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:19.537369 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:19.534971 28859 consensus_queue.cc:260] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:24:19.481081 28709 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:19.482017 28734 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:19.532330 28844 log.cc:927] Time spent T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.293s	user 0.000s	sys 0.001s
W20260709 12:24:19.533548 28855 log.cc:927] Time spent T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
W20260709 12:24:19.534036 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 149025us
I20260709 12:24:19.709136 28815 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:19.709909 25801 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:19.520736 28463 raft_consensus.cc:2749] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:19.711283 28815 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:19.711536 25685 raft_consensus.cc:1275] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:19.536243 28689 consensus_queue.cc:260] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:19.686719 28824 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:19.622330 28876 log.cc:927] Time spent T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 12:24:19.629216 28826 consensus_meta.cc:287] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.789s	user 0.010s	sys 0.000s
W20260709 12:24:19.617460 28845 log.cc:927] Time spent T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.278s	user 0.001s	sys 0.001s
I20260709 12:24:19.433102 28823 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:19.626024 28258 consensus_meta.cc:287] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.775s	user 0.009s	sys 0.000s
I20260709 12:24:19.622548 28742 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:19.621480 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:19.521539 28840 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:19.579782 28670 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:19.693962 25834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41782 (request call id 669) took 1232 ms. Trace:
I20260709 12:24:19.699110 26402 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
W20260709 12:24:19.703008 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 220867us
I20260709 12:24:19.728976 28734 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
W20260709 12:24:19.758890 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:19.703572 25832 raft_consensus.cc:1240] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:19.706629 28850 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:19.706950 28859 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:19.766824 28873 log.cc:927] Time spent T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
I20260709 12:24:19.740931 28662 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:19.689750 28700 raft_consensus.cc:3060] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:19.730965 25801 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:19.579533 28774 consensus_queue.cc:237] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:19.519860 28864 consensus_queue.cc:1048] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.229s
W20260709 12:24:19.734848 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 281592us
I20260709 12:24:19.772291 25726 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:24:19.701187 28858 raft_consensus.cc:2804] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:19.716686 28709 raft_consensus.cc:2749] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:19.756227 28669 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:19.784118 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:19.763186 28877 raft_consensus.cc:2749] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:19.739233 28689 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:19.765941 25831 raft_consensus.cc:1240] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 7. Current term is 9. Ops: []
I20260709 12:24:19.767688 25684 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:19.772872 25678 raft_consensus.cc:1240] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:19.757956 25834 rpcz_store.cc:276] 0709 12:24:18.453133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:18.641770 (+188637us) service_pool.cc:224] Handling call
0709 12:24:18.642036 (+   266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:18.655520 (+ 13484us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:18.655562 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:18.661047 (+  5485us) log.cc:844] Serialized 26 byte log entry
0709 12:24:19.028121 (+367074us) spinlock_profiling.cc:243] Waited 29.5 ms on lock 0x7b18001950a0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d997094bc 00007f5d96a5748b 00007f5d9f8b19a9 00007f5d96a7369b 00007f5d96a7193f 00007f5d96a73c02 00007f5d996fb20b 00007f5d99700d23 00007f5d997010d1
0709 12:24:19.028325 (+   204us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:24:19.164097 (+135772us) log.cc:844] Serialized 14 byte log entry
0709 12:24:19.262646 (+ 98549us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:19.262725 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:19.589699 (+326974us) raft_consensus.cc:1685] finished
0709 12:24:19.685046 (+ 95347us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:19.685313 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":108379,"prepare.queue_time_us":269001,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"raft.queue_time_us":120537,"raft.run_cpu_time_us":330,"raft.run_wall_time_us":56559,"spinlock_wait_cycles":67754880,"thread_start_us":126567,"threads_started":2,"wal-append.queue_time_us":416905}
I20260709 12:24:19.774590 25650 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:19.729627 28867 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:19.735241 28824 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:19.783690 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:19.797194 25726 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:24:19.774636 28815 raft_consensus.cc:2749] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:19.782639 28804 consensus_queue.cc:1059] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:24:19.777669 28742 raft_consensus.cc:2764] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 12:24:19.774590 28863 consensus_queue.cc:1059] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.019s
W20260709 12:24:19.808283 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 93540us
I20260709 12:24:19.813184 25650 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:24:19.808952 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 109940us
I20260709 12:24:19.774133 28858 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:19.780941 28670 raft_consensus.cc:2749] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:19.809892 25726 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
W20260709 12:24:19.811976 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:19.814977 25834 raft_consensus.cc:1275] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:24:19.772909 28734 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:19.817799 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:19.768944 28826 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:19.824304 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:19.828939 25761 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 5.
I20260709 12:24:19.814095 28741 consensus_queue.cc:1048] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 12:24:19.833339 28804 raft_consensus.cc:3055] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:19.833851 28804 raft_consensus.cc:740] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:19.834759 28804 consensus_queue.cc:260] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:19.836094 28258 raft_consensus.cc:2804] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:19.836540 28258 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:19.836911 28258 raft_consensus.cc:3060] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:19.839985 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:19.842097 25761 raft_consensus.cc:2393] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 7: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:19.813114 28866 raft_consensus.cc:2749] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:19.854188 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:19.854506 26437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 775) took 1061 ms. Trace:
I20260709 12:24:19.855746 26436 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:24:19.866019 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 52926.5us
I20260709 12:24:19.866882 25650 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
W20260709 12:24:19.867383 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:19.855665 26437 rpcz_store.cc:276] 0709 12:24:18.790252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:18.790401 (+   149us) service_pool.cc:224] Handling call
0709 12:24:18.790711 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:18.805955 (+ 15244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:18.805984 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:18.816576 (+ 10592us) log.cc:844] Serialized 26 byte log entry
0709 12:24:18.981756 (+165180us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:18.982189 (+   433us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:18.982260 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:19.851057 (+868797us) raft_consensus.cc:1685] finished
0709 12:24:19.851095 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:19.851287 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14897,"raft.queue_time_us":15006,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":8680,"thread_start_us":164740,"threads_started":1,"wal-append.queue_time_us":324655}
I20260709 12:24:19.871737 26430 raft_consensus.cc:2468] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 6.
I20260709 12:24:19.813091 28886 raft_consensus.cc:2804] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:24:19.838760 28862 log.cc:927] Time spent T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 12:24:19.819607 28858 raft_consensus.cc:3060] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:19.841547 28742 raft_consensus.cc:2804] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:19.888226 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:19.885309 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:19.890447 25650 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:24:19.891091 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:19.891124 26430 raft_consensus.cc:2393] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 8: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:19.838599 28826 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:19.902621 25834 raft_consensus.cc:1275] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:24:19.881605 28633 consensus_meta.cc:287] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.716s	user 0.013s	sys 0.000s
I20260709 12:24:19.910167 28633 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:19.911752 25763 raft_consensus.cc:2393] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 5: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:19.908427 28742 raft_consensus.cc:697] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 7 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:19.912602 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:19.913228 26437 raft_consensus.cc:2468] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 6.
I20260709 12:24:19.913004 28742 consensus_queue.cc:237] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:19.908080 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:19.916249 26432 raft_consensus.cc:1275] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:24:19.916384 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:19.917078 26437 raft_consensus.cc:2393] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 5: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:19.916582 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:19.918084 25834 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 6.
I20260709 12:24:19.919625 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:19.925638 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:19.926069 28749 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:19.926494 28633 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:19.928592 28824 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:19.930105 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:19.930713 25761 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 6.
I20260709 12:24:19.932008 26401 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:19.933140 28824 raft_consensus.cc:2804] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:19.933508 28824 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:19.933808 28761 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:19.933877 28824 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:19.934669 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:19.918258 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:19.935259 26433 raft_consensus.cc:3060] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:19.937655 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:19.938400 26437 raft_consensus.cc:2393] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 7: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:19.942246 26436 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 11.
I20260709 12:24:19.945133 26402 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:19.945284 25684 raft_consensus.cc:2468] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 9.
W20260709 12:24:19.887821 28674 consensus_meta.cc:287] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 1.042s	user 0.010s	sys 0.003s
I20260709 12:24:19.879839 28804 raft_consensus.cc:3060] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:19.947685 26430 raft_consensus.cc:1240] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:24:19.947938 26438 raft_consensus.cc:2468] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 6.
I20260709 12:24:19.883106 28864 raft_consensus.cc:2749] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:19.949756 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:19.949767 26433 raft_consensus.cc:2468] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 8.
I20260709 12:24:19.955941 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:24:19.957698 25649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:19.940824 28873 log.cc:927] Time spent T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:24:20.010082 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:20.010624 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:20.011575 25837 raft_consensus.cc:2393] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 5: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:19.948735 26432 raft_consensus.cc:2468] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 5.
W20260709 12:24:19.960505 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 70133.2us
W20260709 12:24:19.971702 25649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:19.962706 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:19.995261 28826 raft_consensus.cc:2749] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:20.016315 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:19.997148 26436 raft_consensus.cc:2393] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 7: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
W20260709 12:24:20.001641 28870 log.cc:927] Time spent T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
I20260709 12:24:20.002256 28816 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.022205 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:19.895381 28710 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:20.010761 25832 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 11.
I20260709 12:24:19.996256 28839 raft_consensus.cc:3055] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:20.017656 26433 raft_consensus.cc:1275] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:24:20.035197 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 214824us
I20260709 12:24:20.021658 25678 raft_consensus.cc:2468] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 5.
I20260709 12:24:19.895136 28886 raft_consensus.cc:697] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:20.036037 25726 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:24:20.036772 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:20.027834 25833 raft_consensus.cc:2468] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 7.
I20260709 12:24:20.007124 25834 raft_consensus.cc:1240] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:20.038569 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:20.040885 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:20.020305 28689 raft_consensus.cc:2804] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:20.035470 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:20.075314 25835 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 7.
I20260709 12:24:20.040750 28682 raft_consensus.cc:2804] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:20.076303 28682 raft_consensus.cc:697] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
W20260709 12:24:20.046782 28868 log.cc:927] Time spent T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 12:24:20.046586 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:20.046800 28886 consensus_queue.cc:237] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:20.036307 28816 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:20.048147 25650 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:20.020504 28761 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.038947 25801 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:20.041415 25726 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:20.132493 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:20.132622 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 91269.3us
I20260709 12:24:20.054695 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:20.073266 25829 raft_consensus.cc:1240] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 6 LEADER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:24:20.083401 26437 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 11.
I20260709 12:24:20.123206 25757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 2174) took 1207 ms. Trace:
I20260709 12:24:20.032564 28674 consensus_queue.cc:1048] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:24:20.134475 25757 rpcz_store.cc:276] 0709 12:24:18.872160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:18.872764 (+   604us) service_pool.cc:224] Handling call
0709 12:24:18.894147 (+ 21383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:19.154818 (+260671us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:20.079134 (+924316us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b54001db0d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:20.079373 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":520392064}
W20260709 12:24:20.134660 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 101066us
I20260709 12:24:20.128844 25686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40230 (request call id 1451) took 1032 ms. Trace:
I20260709 12:24:20.032989 28670 consensus_queue.cc:1059] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.091s
I20260709 12:24:20.136106 25650 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:20.038539 28839 raft_consensus.cc:740] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
W20260709 12:24:20.136911 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 98040.4us
I20260709 12:24:20.133522 25726 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:20.135907 25686 rpcz_store.cc:276] 0709 12:24:19.096326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:19.272288 (+175962us) service_pool.cc:224] Handling call
0709 12:24:19.273970 (+  1682us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:19.299383 (+ 25413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:19.299428 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:19.307984 (+  8556us) log.cc:844] Serialized 26 byte log entry
0709 12:24:19.403314 (+ 95330us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:19.403354 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:19.403417 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:20.128566 (+725149us) raft_consensus.cc:1685] finished
0709 12:24:20.128587 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:20.128757 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15672,"raft.queue_time_us":110454,"raft.run_cpu_time_us":70,"raft.run_wall_time_us":70,"thread_start_us":76894,"threads_started":1,"wal-append.queue_time_us":446826}
I20260709 12:24:20.078526 28689 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:20.143567 25650 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
W20260709 12:24:20.145502 25649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:20.146659 25801 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:24:20.135255 28890 raft_consensus.cc:2804] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:20.154502 25801 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:20.155332 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:20.156324 26437 raft_consensus.cc:2468] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 5.
I20260709 12:24:20.154081 25650 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:20.140298 28674 raft_consensus.cc:2749] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:20.141485 28866 raft_consensus.cc:2804] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:20.162814 25828 raft_consensus.cc:1240] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 5 LEADER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:20.162072 25801 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:20.168932 25650 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:20.145499 28689 raft_consensus.cc:3060] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:20.141916 28823 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:20.175171 25650 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:20.152635 28710 raft_consensus.cc:2804] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:24:20.152521 28669 raft_consensus.cc:3055] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:20.181690 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:20.158701 25679 raft_consensus.cc:1275] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:24:20.179402 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:20.170194 28877 raft_consensus.cc:2804] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:20.184625 26436 raft_consensus.cc:1275] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:24:20.138672 28761 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:20.157672 28890 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:20.191048 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:20.148931 28864 raft_consensus.cc:2804] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:20.164261 28849 raft_consensus.cc:2804] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:20.135581 28682 consensus_queue.cc:237] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:24:20.192373 28877 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:20.192408 28860 consensus_queue.cc:1059] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:20.192458 28373 raft_consensus.cc:2804] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:20.195101 25757 raft_consensus.cc:1240] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:20.213179 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:20.190640 28853 consensus_queue.cc:1059] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:24:20.218170 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:20.163518 28670 consensus_queue.cc:1048] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:24:20.172022 28883 raft_consensus.cc:2804] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:20.200737 25763 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 6.
I20260709 12:24:20.173525 28369 raft_consensus.cc:2804] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:20.204392 25682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2084) took 1298 ms. Trace:
I20260709 12:24:20.212596 28373 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:20.176457 28258 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:20.218990 26433 raft_consensus.cc:2468] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 7.
I20260709 12:24:20.181074 28669 raft_consensus.cc:740] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:20.190152 28863 raft_consensus.cc:2804] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:20.218881 25757 raft_consensus.cc:2468] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 6.
I20260709 12:24:20.209053 28877 raft_consensus.cc:3060] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:20.224404 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:20.189355 28745 consensus_queue.cc:1048] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 12:24:20.201824 28890 raft_consensus.cc:3060] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:20.203047 28734 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:20.205523 28849 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:20.206606 28710 raft_consensus.cc:697] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 13 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:20.227864 25682 rpcz_store.cc:276] 0709 12:24:18.899866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:18.912043 (+ 12177us) service_pool.cc:224] Handling call
0709 12:24:18.912367 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:18.919363 (+  6996us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:18.919393 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:18.925646 (+  6253us) log.cc:844] Serialized 26 byte log entry
0709 12:24:19.456273 (+530627us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:19.686084 (+229811us) log.cc:844] Serialized 14 byte log entry
0709 12:24:19.712790 (+ 26706us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:19.712886 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:20.198004 (+485118us) raft_consensus.cc:1685] finished
0709 12:24:20.198032 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:20.198196 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38383,"prepare.queue_time_us":246325,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":36976,"raft.run_cpu_time_us":312,"raft.run_wall_time_us":61707,"thread_start_us":669857,"threads_started":2,"wal-append.queue_time_us":837366}
I20260709 12:24:20.217042 28864 raft_consensus.cc:697] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 7 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:20.227763 28369 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:20.295392 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:20.300699 25757 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 11.
I20260709 12:24:20.232051 28709 raft_consensus.cc:3055] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:20.231787 28809 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.304517 25800 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
W20260709 12:24:20.306401 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 124893us
I20260709 12:24:20.392273 25650 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:20.265125 28865 raft_consensus.cc:3055] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:20.236514 28373 raft_consensus.cc:3060] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:20.224779 28816 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:24:20.330389 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:20.389212 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 255679us
I20260709 12:24:20.203266 28839 consensus_queue.cc:260] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:20.277266 28883 raft_consensus.cc:697] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:20.404969 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
W20260709 12:24:20.404866 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 100448us
W20260709 12:24:20.427876 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:20.292604 28849 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:24:20.406939 25650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:20.428190 25726 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:20.292132 28863 raft_consensus.cc:697] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 5 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:20.299701 28840 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:20.305299 28369 raft_consensus.cc:3060] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:20.458426 28887 log.cc:927] Time spent T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.329s	user 0.000s	sys 0.001s
I20260709 12:24:20.409400 28662 raft_consensus.cc:2749] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:24:20.474325 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 46255.9us
I20260709 12:24:20.331645 28709 raft_consensus.cc:740] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:20.429039 28866 raft_consensus.cc:697] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 7 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:20.430776 28860 raft_consensus.cc:2804] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:20.482383 25726 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:20.404556 28823 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
W20260709 12:24:20.485603 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:20.427583 28865 raft_consensus.cc:740] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:20.467052 28839 raft_consensus.cc:3060] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:20.490105 25726 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
W20260709 12:24:20.485760 28891 log.cc:927] Time spent T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.341s	user 0.001s	sys 0.000s
I20260709 12:24:20.412196 28809 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:20.478045 28734 raft_consensus.cc:2804] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:24:20.534446 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 71262.5us
I20260709 12:24:20.512142 28823 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:20.537230 28823 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:20.460700 28669 consensus_queue.cc:260] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:20.489003 28840 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:20.501250 28864 consensus_queue.cc:237] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:20.537874 25682 raft_consensus.cc:1240] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 12:24:20.971427 25761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 2573) took 1015 ms. Trace:
W20260709 12:24:20.848270 25569 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 5aae9f34f7154346afd482b3183ee180 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5cccf20a8bff46dba6601f241d172b8a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:24:20.972391 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:20.972708 25569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 124517us
W20260709 12:24:20.934250 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:20.931425 25684 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40230 (request call id 1443) took 1882 ms (client timeout 1959 ms). Trace:
I20260709 12:24:20.744310 25829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 2520) took 1557 ms. Trace:
I20260709 12:24:20.614933 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:20.928450 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:20.742774 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:20.977541 26437 raft_consensus.cc:2468] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 8.
I20260709 12:24:20.973255 25682 raft_consensus.cc:2393] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 5: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:20.978637 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:20.979794 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:20.980054 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:20.692543 25800 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
W20260709 12:24:20.975538 25684 rpcz_store.cc:269] 0709 12:24:19.049109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:19.049292 (+   183us) service_pool.cc:224] Handling call
0709 12:24:20.931239 (+1881947us) spinlock_profiling.cc:243] Waited 715 ms on lock 0x7b54003d9ad4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:20.931346 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1644615552}
I20260709 12:24:20.980940 25757 raft_consensus.cc:2393] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 7: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:20.976426 25829 rpcz_store.cc:276] 0709 12:24:19.186984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:19.241965 (+ 54981us) service_pool.cc:224] Handling call
0709 12:24:19.269030 (+ 27065us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:20.134136 (+865106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:20.743947 (+609811us) spinlock_profiling.cc:243] Waited 804 ms on lock 0x7b5400116a54. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:20.744237 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1848616704}
W20260709 12:24:20.679545 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:20.930801 25685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2092) took 1549 ms. Trace:
I20260709 12:24:20.804497 25833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44202 (request call id 2519) took 1604 ms. Trace:
I20260709 12:24:20.615424 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:20.984550 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:20.985847 26435 raft_consensus.cc:2376] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 5. Re-sending same reply.
I20260709 12:24:20.986006 25682 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 9.
I20260709 12:24:20.988251 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:20.983474 25833 rpcz_store.cc:276] 0709 12:24:19.148710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:19.148886 (+   176us) service_pool.cc:224] Handling call
0709 12:24:20.752860 (+1603974us) spinlock_profiling.cc:243] Waited 728 ms on lock 0x7b54001b1554. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:20.753005 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1673904896}
W20260709 12:24:21.008159 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:20.972097 25761 rpcz_store.cc:276] 0709 12:24:19.955627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:19.955999 (+   372us) service_pool.cc:224] Handling call
0709 12:24:19.956279 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:19.956479 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:24:20.163979 (+207500us) log.cc:844] Serialized 14 byte log entry
0709 12:24:20.971006 (+807027us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:20.971082 (+    76us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:20.971132 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:20.971220 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:20.971355 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13209,"prepare.queue_time_us":432616,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":95026,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":11664,"thread_start_us":957790,"threads_started":3}
W20260709 12:24:20.741721 28906 log.cc:927] Time spent T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 12:24:20.732546 28824 consensus_meta.cc:287] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.798s	user 0.005s	sys 0.005s
W20260709 12:24:20.852449 28889 log.cc:927] Time spent T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.463s	user 0.001s	sys 0.000s
I20260709 12:24:20.875263 28674 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.041977 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:21.042363 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
W20260709 12:24:20.927045 28884 log.cc:927] Time spent T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.965s	user 0.006s	sys 0.005s
W20260709 12:24:20.782965 28858 consensus_meta.cc:287] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.882s	user 0.008s	sys 0.002s
W20260709 12:24:20.970270 28804 consensus_meta.cc:287] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 1.005s	user 0.009s	sys 0.000s
I20260709 12:24:20.533957 28734 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:21.079454 28921 consensus_queue.cc:1059] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:24:21.080148 28734 raft_consensus.cc:3060] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:21.081116 28909 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.081619 28909 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:21.084013 28895 log.cc:927] Time spent T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.541s	user 0.000s	sys 0.001s
W20260709 12:24:21.085543 28867 consensus_meta.cc:287] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 1.271s	user 0.007s	sys 0.004s
I20260709 12:24:21.086170 28867 raft_consensus.cc:2749] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:21.086901 25762 raft_consensus.cc:1240] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:20.603659 28883 consensus_queue.cc:237] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:20.611168 28710 consensus_queue.cc:237] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:20.932560 28905 log.cc:927] Time spent T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:24:20.917479 28912 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.749552 28816 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:20.983206 25685 rpcz_store.cc:276] 0709 12:24:19.381583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:19.712253 (+330670us) service_pool.cc:224] Handling call
0709 12:24:19.732587 (+ 20334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:19.813668 (+ 81081us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:19.823613 (+  9945us) log.cc:844] Serialized 14 byte log entry
0709 12:24:19.888218 (+ 64605us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:19.888287 (+    69us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:19.888345 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:20.929589 (+1041244us) spinlock_profiling.cc:243] Waited 5.66 ms on lock 0x7b18003aabc0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d96a422a6 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419
0709 12:24:20.930469 (+   880us) spinlock_profiling.cc:243] Waited 80.9 ms on lock 0x7b54002481d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:20.930525 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:20.930729 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34856,"prepare.queue_time_us":10240,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":2925,"raft.queue_time_us":83,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":36421,"spinlock_wait_cycles":198981760,"thread_start_us":64135,"threads_started":1,"wal-append.queue_time_us":224258}
I20260709 12:24:21.031266 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:21.088143 25680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2087) took 1708 ms. Trace:
W20260709 12:24:21.219550 25650 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.000s	sys 0.015s
I20260709 12:24:21.253625 25761 raft_consensus.cc:2468] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 8.
W20260709 12:24:21.253295 25726 leader_election.cc:336] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Timed out: RequestConsensusVote RPC to 127.23.245.132:35611 timed out after 1.504s (SENT)
I20260709 12:24:21.043201 25684 raft_consensus.cc:3060] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:20.543087 28634 raft_consensus.cc:2804] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:20.836647 28662 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.042645 25760 raft_consensus.cc:2468] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 6.
I20260709 12:24:20.981469 28911 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:21.074285 28815 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:20.715979 28866 consensus_queue.cc:237] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:21.292145 28463 raft_consensus.cc:3055] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:24:21.292567 28463 raft_consensus.cc:740] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:21.293426 28463 consensus_queue.cc:260] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:20.716787 28709 consensus_queue.cc:260] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:21.294968 28709 raft_consensus.cc:3060] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:21.302901 28893 log.cc:927] Time spent T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.646s	user 0.000s	sys 0.001s
I20260709 12:24:21.306273 28850 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.085443 28809 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:21.308256 28809 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.308837 28809 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:24:21.311468 28809 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:20.554039 28742 raft_consensus.cc:2804] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:21.312387 28742 raft_consensus.cc:697] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:21.314102 25828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 2531) took 1577 ms. Trace:
I20260709 12:24:21.012323 28258 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:21.314502 25828 rpcz_store.cc:276] 0709 12:24:19.736825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:19.736975 (+   150us) service_pool.cc:224] Handling call
0709 12:24:19.755955 (+ 18980us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:20.168115 (+412160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.313874 (+1145759us) spinlock_profiling.cc:243] Waited 407 ms on lock 0x7b5400359654. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:21.314045 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":935207680}
I20260709 12:24:21.307025 28850 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:21.319792 28850 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:21.320153 28670 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:21.036553 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:24:21.256551 25650 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.000s	sys 0.018s
I20260709 12:24:21.320711 28670 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:21.321214 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 663687us
I20260709 12:24:21.322476 25650 leader_election.cc:400] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 election: Vote denied by peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237) with higher term. Message: Invalid argument: T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for earlier term 8. Current term is 9.
I20260709 12:24:21.322657 28670 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:21.323168 28670 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.326259 25650 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:24:21.266543 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 574084us
I20260709 12:24:21.328648 25800 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:21.330044 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:21.329932 25800 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:21.254776 25680 rpcz_store.cc:276] 0709 12:24:19.380085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:19.705268 (+325183us) service_pool.cc:224] Handling call
0709 12:24:19.733725 (+ 28457us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:19.737138 (+  3413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:19.737178 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:19.739261 (+  2083us) log.cc:844] Serialized 26 byte log entry
0709 12:24:20.095720 (+356459us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:20.142430 (+ 46710us) log.cc:844] Serialized 14 byte log entry
0709 12:24:20.158232 (+ 15802us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:20.158322 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:21.087801 (+929479us) raft_consensus.cc:1685] finished
0709 12:24:21.087833 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:21.088051 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51281,"prepare.queue_time_us":48850,"prepare.run_wall_time_us":1911,"raft.queue_time_us":28927,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":18395,"spinlock_wait_cycles":6341504,"thread_start_us":320494,"threads_started":1,"wal-append.queue_time_us":469572}
I20260709 12:24:21.331728 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:21.278231 28840 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:20.756857 28863 consensus_queue.cc:237] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:21.332875 28840 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:21.333348 28840 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:21.334741 28568 raft_consensus.cc:3055] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:24:21.158768 28906 log.cc:927] Time spent T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:24:21.335148 28568 raft_consensus.cc:740] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
W20260709 12:24:21.213862 28890 consensus_meta.cc:287] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.919s	user 0.009s	sys 0.000s
I20260709 12:24:21.335319 28840 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:21.335682 28890 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:21.336113 28258 consensus_queue.cc:1059] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:21.335969 28568 consensus_queue.cc:260] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:21.336925 28258 consensus_queue.cc:1059] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:21.337570 28258 consensus_queue.cc:1243] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer 5cccf20a8bff46dba6601f241d172b8a log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:24:21.337733 28890 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:21.276257 28912 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:21.338069 28258 raft_consensus.cc:2749] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:21.335867 28840 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.339803 28912 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:21.092455 28917 raft_consensus.cc:2749] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:21.280644 25677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2095) took 1266 ms. Trace:
I20260709 12:24:21.340641 28917 raft_consensus.cc:2749] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:21.341418 28917 raft_consensus.cc:2804] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:21.340427 25677 rpcz_store.cc:276] 0709 12:24:20.014413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.014536 (+   123us) service_pool.cc:224] Handling call
0709 12:24:20.032866 (+ 18330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:20.126654 (+ 93788us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:20.126701 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:20.139353 (+ 12652us) log.cc:844] Serialized 26 byte log entry
0709 12:24:20.470956 (+331603us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:20.470998 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:20.471063 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:21.280421 (+809358us) raft_consensus.cc:1685] finished
0709 12:24:21.280443 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:21.280571 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20564,"raft.queue_time_us":73049,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":4913,"thread_start_us":305295,"threads_started":1,"wal-append.queue_time_us":498468}
I20260709 12:24:21.341605 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:21.342202 25680 raft_consensus.cc:3060] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:21.342391 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:21.342749 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:21.343430 25678 raft_consensus.cc:2393] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 7: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:21.343626 26436 raft_consensus.cc:3060] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:21.345855 28761 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:21.092000 28858 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:21.286348 28373 consensus_meta.cc:287] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.810s	user 0.008s	sys 0.001s
I20260709 12:24:21.348168 28373 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:21.348713 28858 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:21.348975 25680 raft_consensus.cc:2468] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 5.
I20260709 12:24:21.313498 28742 consensus_queue.cc:237] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:21.205339 25686 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.018s	sys 0.056s
W20260709 12:24:21.269280 28877 consensus_meta.cc:287] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.987s	user 0.011s	sys 0.001s
I20260709 12:24:21.341771 28917 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:21.280158 28880 log.cc:927] Time spent T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 1.145s	user 0.011s	sys 0.008s
I20260709 12:24:21.339708 28840 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:21.306494 26434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36518 (request call id 734) took 1484 ms. Trace:
I20260709 12:24:21.268642 28634 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
W20260709 12:24:21.219336 28741 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.008s	sys 0.048s
I20260709 12:24:21.065766 28674 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:21.287099 28911 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:21.078889 28839 consensus_meta.cc:287] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.561s	user 0.005s	sys 0.002s
W20260709 12:24:21.281025 28849 consensus_meta.cc:287] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.804s	user 0.009s	sys 0.001s
I20260709 12:24:21.372795 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:21.440328 25678 raft_consensus.cc:2410] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:24:21.343430 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
W20260709 12:24:21.376693 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:21.158464 28689 consensus_meta.cc:287] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.977s	user 0.012s	sys 0.000s
I20260709 12:24:21.337167 28568 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:21.042766 28824 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:21.151155 28867 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:21.416271 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:21.323554 28670 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:21.417650 25754 raft_consensus.cc:1240] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:21.419926 26436 raft_consensus.cc:2468] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 7.
I20260709 12:24:21.403959 28258 consensus_queue.cc:1048] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:24:21.408299 28917 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:21.408367 28912 raft_consensus.cc:3055] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:21.349772 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:21.502730 26435 raft_consensus.cc:2393] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 5: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
W20260709 12:24:21.425591 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 172318us
I20260709 12:24:21.425678 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:21.422502 26434 rpcz_store.cc:276] 0709 12:24:19.822121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:19.822357 (+   236us) service_pool.cc:224] Handling call
0709 12:24:19.822633 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:19.840500 (+ 17867us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:24:19.840530 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:19.895583 (+ 55053us) log.cc:844] Serialized 26 byte log entry
0709 12:24:20.233890 (+338307us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:20.233943 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:20.234763 (+   820us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:21.302356 (+1067593us) spinlock_profiling.cc:243] Waited 57 ms on lock 0x7b4400022b4c. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db 00007f5d99708aaf 00007f5d996fc86e 00007f5d996fbbb6 00007f5d996fb7d8 00007f5d99705221 00007f5d997051d9 00007f5d99705169
0709 12:24:21.306195 (+  3839us) raft_consensus.cc:1685] finished
0709 12:24:21.306224 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:21.306435 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1906,"raft.queue_time_us":116,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":23668,"spinlock_wait_cycles":131049216,"thread_start_us":324717,"threads_started":1,"wal-append.queue_time_us":604203}
W20260709 12:24:21.087172 28700 consensus_meta.cc:287] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 1.306s	user 0.012s	sys 0.000s
W20260709 12:24:21.429404 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 228061us
I20260709 12:24:21.432170 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:21.431779 25684 raft_consensus.cc:2468] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 7.
I20260709 12:24:21.390235 28908 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:21.411419 28809 raft_consensus.cc:3055] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:24:21.473834 28825 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:21.428894 28741 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.008s	sys 0.051s
W20260709 12:24:21.430161 28924 log.cc:927] Time spent T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:24:21.270699 28816 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:21.351974 28662 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:21.429651 28634 raft_consensus.cc:3060] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:21.483450 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:21.437340 28909 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:21.484158 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:21.485761 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:21.429126 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:21.391443 28815 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:21.529798 28815 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:24:21.530036 25649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:21.417737 28877 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:21.532681 28877 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:21.430356 28860 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.887s	user 0.031s	sys 0.018s
W20260709 12:24:21.504025 25726 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.245.132:35611 timed out after 1.553s (SENT) [suppressed 11 similar messages]
I20260709 12:24:21.509320 26430 raft_consensus.cc:2393] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 8: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:21.511119 26401 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:21.507506 28908 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:21.484230 28890 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.489768 28633 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.516636 26402 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
W20260709 12:24:21.535292 28860 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.002s	user 0.031s	sys 0.018s
I20260709 12:24:21.514941 26436 raft_consensus.cc:1240] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 7. Current term is 8. Ops: [5.7-7.8]
I20260709 12:24:21.518589 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:21.537946 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:21.547765 25678 raft_consensus.cc:1275] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:24:21.490586 28867 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:21.556739 26434 raft_consensus.cc:1240] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 12:24:21.508134 28745 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.510708 28809 raft_consensus.cc:740] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:21.480255 28689 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:21.595901 26435 raft_consensus.cc:1275] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:21.505795 28912 raft_consensus.cc:740] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:21.618224 25678 pending_rounds.cc:85] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc: Aborting all ops after (but not including) 4
W20260709 12:24:21.550343 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:21.618789 25755 raft_consensus.cc:2393] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 5: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:21.481112 28849 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:21.557972 28815 raft_consensus.cc:2804] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:21.510728 28700 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:21.508517 28927 consensus_queue.cc:1048] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.133s
I20260709 12:24:21.675071 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:21.571027 28860 raft_consensus.cc:697] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 6 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:21.517797 28825 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:21.695986 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 364416us
W20260709 12:24:21.662026 25650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:21.584131 28877 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.570691 28859 raft_consensus.cc:2749] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:21.682762 26434 raft_consensus.cc:2393] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 5: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
W20260709 12:24:21.682332 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 178080us
I20260709 12:24:21.719141 26439 raft_consensus.cc:2368] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 7. Current term is 8.
W20260709 12:24:21.719468 25801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:21.700910 25800 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:21.722740 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:21.723568 25828 raft_consensus.cc:2468] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 7.
I20260709 12:24:21.727164 25677 raft_consensus.cc:1275] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:24:21.727658 25677 pending_rounds.cc:85] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc: Aborting all ops after (but not including) 6
I20260709 12:24:21.727964 25677 pending_rounds.cc:107] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:24:21.728269 25677 raft_consensus.cc:2889] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:21.679343 25678 pending_rounds.cc:107] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:24:21.594775 28909 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:21.674939 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:21.698020 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:21.679152 28815 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:21.701248 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:21.708060 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:21.743763 25833 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 8.
I20260709 12:24:21.729838 25800 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:21.730517 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:21.740890 25836 raft_consensus.cc:3060] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:21.700304 25684 raft_consensus.cc:1240] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:21.744843 26435 raft_consensus.cc:3060] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:21.729790 25726 leader_election.cc:336] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Timed out: RequestConsensusVote RPC to 127.23.245.132:35611 timed out after 1.858s (SENT)
W20260709 12:24:21.746809 25726 connection.cc:256] RPC call timeout handler was delayed by -1.1498379670001668s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24980000000000002s for a response
I20260709 12:24:21.741323 25681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40230 (request call id 1449) took 2645 ms. Trace:
I20260709 12:24:21.611086 28633 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:21.738824 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:21.742306 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:21.749480 26434 raft_consensus.cc:3060] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:21.721755 28657 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.738914 28918 raft_consensus.cc:2804] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:21.751219 28863 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.751176 28657 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:21.751873 28863 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:21.753036 28860 consensus_queue.cc:237] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:21.693531 28709 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.619611 28890 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:21.747601 25726 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:21.755508 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:21.800344 25677 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 5.
I20260709 12:24:21.752249 28923 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:21.722267 28877 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:21.757500 28947 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.758293 28662 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:24:21.759078 28929 log.cc:927] Time spent T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 12:24:21.825060 28670 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:21.759382 28911 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:21.759626 28864 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:21.833925 28864 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:21.759891 28925 log.cc:927] Time spent T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
W20260709 12:24:21.760807 28926 log.cc:927] Time spent T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:24:21.761181 28946 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:21.840941 28946 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:21.843269 28946 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:21.844067 25686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40230 (request call id 1453) took 1307 ms. Trace:
I20260709 12:24:21.844450 25686 rpcz_store.cc:276] 0709 12:24:20.536503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.536706 (+   203us) service_pool.cc:224] Handling call
0709 12:24:20.537235 (+   529us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:20.550745 (+ 13510us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:20.550792 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:20.557960 (+  7168us) log.cc:844] Serialized 26 byte log entry
0709 12:24:21.389144 (+831184us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:21.389188 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.389265 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:21.843834 (+454569us) raft_consensus.cc:1685] finished
0709 12:24:21.843854 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:21.844005 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13049,"raft.queue_time_us":354523,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":4608,"thread_start_us":692009,"threads_started":1,"wal-append.queue_time_us":851930}
W20260709 12:24:21.763211 28914 log.cc:927] Time spent T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.334s	user 0.000s	sys 0.001s
I20260709 12:24:21.764293 28674 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:24:21.758318 28928 log.cc:927] Time spent T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.239s	user 0.000s	sys 0.001s
I20260709 12:24:21.765540 26437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36518 (request call id 753) took 1144 ms. Trace:
I20260709 12:24:21.846530 26437 rpcz_store.cc:276] 0709 12:24:20.621225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.026364 (+405139us) service_pool.cc:224] Handling call
0709 12:24:21.026875 (+   511us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:21.027370 (+   495us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:21.027415 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:21.053520 (+ 26105us) log.cc:844] Serialized 26 byte log entry
0709 12:24:21.430030 (+376510us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:21.430071 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.430144 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:21.765352 (+335208us) raft_consensus.cc:1685] finished
0709 12:24:21.765369 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:21.765486 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15897,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":2453,"thread_start_us":376055,"threads_started":1,"wal-append.queue_time_us":591727}
I20260709 12:24:21.848526 26437 raft_consensus.cc:1240] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 4. Current term is 5. Ops: []
W20260709 12:24:21.849018 26430 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36508 (request call id 787) took 1833 ms (client timeout 2420 ms). Trace:
W20260709 12:24:21.849462 26430 rpcz_store.cc:269] 0709 12:24:20.016230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.021873 (+  5643us) service_pool.cc:224] Handling call
0709 12:24:21.848841 (+1826968us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b5400746154. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:21.848963 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3404005248}
I20260709 12:24:21.766285 28921 consensus_queue.cc:1048] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:21.769232 28849 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:21.724939 28710 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:21.767956 28853 raft_consensus.cc:2749] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:21.769662 28918 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:21.851186 28710 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:21.851626 28918 raft_consensus.cc:3060] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:21.851909 28858 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:21.852700 25754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 2575) took 1895 ms. Trace:
I20260709 12:24:21.852463 28858 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:21.853047 25754 rpcz_store.cc:276] 0709 12:24:19.957381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:19.959998 (+  2617us) service_pool.cc:224] Handling call
0709 12:24:20.000731 (+ 40733us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:21.490274 (+1489543us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.852479 (+362205us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b5400396cd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:21.852641 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3108548992}
I20260709 12:24:21.853571 28710 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:21.854655 28858 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:21.770342 28922 log.cc:927] Time spent T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.345s	user 0.000s	sys 0.000s
I20260709 12:24:21.753690 28657 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:21.754117 28886 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.855824 26433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36508 (request call id 792) took 1777 ms. Trace:
I20260709 12:24:21.769574 25757 raft_consensus.cc:1275] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:24:21.769284 28824 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:24:21.856881 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:21.856379 28886 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:21.857687 26401 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:21.858062 25684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40230 (request call id 1456) took 1280 ms. Trace:
I20260709 12:24:21.858474 28824 raft_consensus.cc:2804] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:21.858409 25684 rpcz_store.cc:276] 0709 12:24:20.577298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.510729 (+933431us) service_pool.cc:224] Handling call
0709 12:24:21.511048 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:21.745077 (+234029us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.857866 (+112789us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b54002648d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:21.858010 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":434686720}
I20260709 12:24:21.858989 28824 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:21.774729 28927 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:21.775624 28373 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:21.778963 28669 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:21.779596 28734 consensus_meta.cc:287] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.699s	user 0.008s	sys 0.002s
I20260709 12:24:21.645601 28745 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:21.782567 26431 raft_consensus.cc:1240] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 12:24:21.784133 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:21.741518 25678 raft_consensus.cc:2889] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:21.796717 26439 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36518 (request call id 736) took 1907 ms (client timeout 1858 ms). Trace:
I20260709 12:24:21.724609 28774 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.806854 26435 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 4.
I20260709 12:24:21.748018 25681 rpcz_store.cc:276] 0709 12:24:19.077560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:19.252831 (+175271us) service_pool.cc:224] Handling call
0709 12:24:19.272986 (+ 20155us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:19.336831 (+ 63845us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:20.638181 (+1301350us) spinlock_profiling.cc:243] Waited 82.1 ms on lock 0x7b180039ece0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d997094bc 00007f5d96a5748b 00007f5d9f8b19a9 00007f5d96a7369b 00007f5d96a7193f 00007f5d96a71455 00007f5d9d5593c7 00007f5d99b6b9a7 00007f5d99b7b0bf
0709 12:24:20.638347 (+   166us) log.cc:844] Serialized 14 byte log entry
0709 12:24:21.066418 (+428071us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:21.265841 (+199423us) log.cc:844] Serialized 52 byte log entry
0709 12:24:21.266066 (+   225us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:21.521808 (+255742us) log.cc:844] Serialized 14 byte log entry
0709 12:24:21.559374 (+ 37566us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.559490 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:21.721957 (+162467us) raft_consensus.cc:1685] finished
0709 12:24:21.721990 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:21.722167 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":88399,"prepare.queue_time_us":182123,"prepare.run_cpu_time_us":12368,"prepare.run_wall_time_us":32086,"raft.queue_time_us":674671,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":12761,"spinlock_wait_cycles":188862720,"thread_start_us":866508,"threads_started":5,"wal-append.queue_time_us":422055}
I20260709 12:24:21.750365 28815 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:21.749864 28804 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:21.814689 25836 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 4.
I20260709 12:24:21.817307 28634 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:21.810832 28809 consensus_queue.cc:260] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:21.822010 28700 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:21.823304 28825 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:21.823719 28877 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:21.824097 28947 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:21.824482 28689 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:21.832944 28942 log.cc:927] Time spent T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:24:21.748948 28909 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:21.849771 25683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2099) took 1688 ms. Trace:
I20260709 12:24:21.850157 28865 consensus_queue.cc:260] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:21.753891 28904 log.cc:927] Time spent T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.330s	user 0.000s	sys 0.001s
I20260709 12:24:21.772991 28761 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:21.944095 25683 rpcz_store.cc:276] 0709 12:24:20.161727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.161864 (+   137us) service_pool.cc:224] Handling call
0709 12:24:20.168635 (+  6771us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:20.174108 (+  5473us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:20.174152 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:20.200682 (+ 26530us) log.cc:844] Serialized 26 byte log entry
0709 12:24:20.626208 (+425526us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:20.626268 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:20.626366 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:21.849556 (+1223190us) raft_consensus.cc:1685] finished
0709 12:24:21.849578 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:21.849711 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12110,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":3587,"thread_start_us":395741,"threads_started":1,"wal-append.queue_time_us":1038220}
I20260709 12:24:21.946534 28908 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:21.861223 25760 raft_consensus.cc:3060] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:21.832490 26434 raft_consensus.cc:2468] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 6.
I20260709 12:24:21.867107 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:21.856266 26433 rpcz_store.cc:276] 0709 12:24:20.078466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.132233 (+ 53767us) service_pool.cc:224] Handling call
0709 12:24:21.855660 (+1723427us) spinlock_profiling.cc:243] Waited 85.8 ms on lock 0x7b540060fc54. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:21.855768 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":197282048}
I20260709 12:24:21.752269 28840 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:21.872597 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:24:21.875589 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 166075us
I20260709 12:24:21.954098 25763 raft_consensus.cc:2468] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 7.
W20260709 12:24:21.876272 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 156068us
W20260709 12:24:21.877755 26439 rpcz_store.cc:269] 0709 12:24:19.873777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:19.873892 (+   115us) service_pool.cc:224] Handling call
0709 12:24:21.780656 (+1906764us) spinlock_profiling.cc:243] Waited 1.83 s on lock 0x7b54002e9854. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:21.780826 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4206408576}
I20260709 12:24:21.954694 25650 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
W20260709 12:24:21.879033 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 362470us
I20260709 12:24:21.955657 26402 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:24:21.825976 28369 consensus_meta.cc:287] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 1.334s	user 0.012s	sys 0.000s
I20260709 12:24:21.956528 28369 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:21.958981 28369 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:21.960242 25832 raft_consensus.cc:2393] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 6: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:21.961350 28957 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.881778 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:21.962107 28957 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:21.883033 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:21.810233 28936 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:21.859444 28824 raft_consensus.cc:3060] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:21.849071 28816 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:21.859503 28903 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:21.811194 28923 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:21.804628 28709 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:21.878257 28741 raft_consensus.cc:2804] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:21.859299 28886 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:21.877774 28682 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:21.943708 28909 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:21.944427 28865 raft_consensus.cc:3060] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:21.883664 28734 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:21.973932 26438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 788) took 1957 ms. Trace:
W20260709 12:24:22.001250 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:21.976089 26401 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:21.826979 28912 consensus_queue.cc:260] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:21.954756 26432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 822) took 1207 ms. Trace:
I20260709 12:24:21.878628 28927 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:21.914541 28774 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:21.977931 25763 raft_consensus.cc:1240] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:21.974277 28947 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:22.000800 26438 rpcz_store.cc:276] 0709 12:24:20.016561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.025516 (+  8955us) service_pool.cc:224] Handling call
0709 12:24:20.025771 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:20.039514 (+ 13743us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:20.228395 (+188881us) log.cc:844] Serialized 14 byte log entry
0709 12:24:20.489831 (+261436us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:20.489895 (+    64us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:20.489951 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.973175 (+1483224us) spinlock_profiling.cc:243] Waited 2.06 ms on lock 0x7b180015a7e0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d96a422a6 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419
0709 12:24:21.973709 (+   534us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b5400604fd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:21.973756 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:21.973874 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":357881,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":142,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":19686,"spinlock_wait_cycles":35864320,"thread_start_us":438008,"threads_started":2,"wal-append.queue_time_us":1024757}
W20260709 12:24:21.996551 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 266773us
I20260709 12:24:22.031754 25680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51578 (request call id 634) took 1375 ms. Trace:
I20260709 12:24:21.979249 28258 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.965042 26431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36518 (request call id 741) took 2050 ms. Trace:
I20260709 12:24:21.987848 26402 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:22.083714 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:24:22.076097 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 81924.7us
I20260709 12:24:22.052728 25760 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 7.
I20260709 12:24:22.085428 28258 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:21.963666 25754 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:24:21.979154 25650 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:24:22.088382 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 109312us
I20260709 12:24:22.050324 25762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 2576) took 2092 ms. Trace:
I20260709 12:24:21.976271 25756 raft_consensus.cc:1240] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:21.929014 28804 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:22.083967 26431 rpcz_store.cc:276] 0709 12:24:19.914934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:19.915062 (+   128us) service_pool.cc:224] Handling call
0709 12:24:21.782267 (+1867205us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:21.877262 (+ 94995us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.964855 (+ 87593us) spinlock_profiling.cc:243] Waited 1.87 s on lock 0x7b54002e9850. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b608ad 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:21.964991 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4293399936}
I20260709 12:24:22.083441 26432 rpcz_store.cc:276] 0709 12:24:20.747748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.300842 (+553094us) service_pool.cc:224] Handling call
0709 12:24:21.301155 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:21.484098 (+182943us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:24:21.484165 (+    67us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:21.484786 (+   621us) log.cc:844] Serialized 26 byte log entry
0709 12:24:21.722312 (+237526us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:21.722344 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:21.730405 (+  8061us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:21.954451 (+224046us) raft_consensus.cc:1685] finished
0709 12:24:21.954480 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:21.954676 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":115988,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":9580,"thread_start_us":366762,"threads_started":2,"wal-append.queue_time_us":440731}
I20260709 12:24:22.089869 25762 rpcz_store.cc:276] 0709 12:24:19.957672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:19.960076 (+  2404us) service_pool.cc:224] Handling call
0709 12:24:19.996481 (+ 36405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:21.252906 (+1256425us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:22.050072 (+797166us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54001e6754. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:22.050263 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2507237632}
I20260709 12:24:22.082522 25680 rpcz_store.cc:276] 0709 12:24:20.656117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.331393 (+675276us) service_pool.cc:224] Handling call
0709 12:24:22.031523 (+700130us) spinlock_profiling.cc:243] Waited 9.76 ms on lock 0x7b54002cf6d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:22.031662 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22455680}
W20260709 12:24:22.098836 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 111084us
I20260709 12:24:22.099720 26402 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:22.099792 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:22.100591 25758 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 5.
I20260709 12:24:22.101059 26402 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:22.101634 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:22.103072 28816 raft_consensus.cc:2749] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:22.102978 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:22.103806 28816 raft_consensus.cc:2749] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:21.968204 28903 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:22.105759 26402 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:22.107301 28903 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:21.967749 28634 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:21.979120 28689 raft_consensus.cc:2749] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:21.963727 28936 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:22.109723 28816 raft_consensus.cc:2804] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:22.110196 28816 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:22.110584 28816 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:22.111454 28936 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:21.977783 28809 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:22.112957 28853 consensus_queue.cc:1048] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:21.969678 28709 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:21.993315 28946 raft_consensus.cc:2804] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:22.114964 28946 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:22.115404 28946 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:21.964125 28937 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:22.116207 28937 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:21.995714 28849 consensus_queue.cc:1048] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.117s
I20260709 12:24:22.117839 28849 consensus_queue.cc:1243] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer f82778701b464892aab92a752ed7ffdc log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:24:22.118530 28937 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:22.118969 28674 consensus_queue.cc:1048] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:22.108757 26402 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:22.122192 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:22.122968 25678 raft_consensus.cc:2393] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 4: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:21.970311 28923 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:22.124969 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:22.125239 28890 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:22.125038 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:22.125696 25683 raft_consensus.cc:2468] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 7.
I20260709 12:24:22.126097 28761 raft_consensus.cc:2749] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:22.126338 25678 raft_consensus.cc:2410] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:22.132723 28957 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:24:22.079871 28917 consensus_meta.cc:287] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.559s	user 0.009s	sys 0.001s
W20260709 12:24:22.119145 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 143116us
I20260709 12:24:22.133435 28258 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:22.126844 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:22.128173 28937 raft_consensus.cc:2749] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:22.128710 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:22.089880 25650 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:21.969990 28741 raft_consensus.cc:697] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:22.140120 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:22.140998 25761 raft_consensus.cc:2468] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 6.
I20260709 12:24:22.130446 28927 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:22.131385 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:21.963415 28463 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:22.134748 25829 raft_consensus.cc:2468] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 7.
I20260709 12:24:22.107528 28960 raft_consensus.cc:2749] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:22.136765 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:21.965953 28633 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:22.138864 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:21.976493 28825 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:22.178301 25801 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:24:22.141688 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 394146us
I20260709 12:24:22.143029 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:22.143308 26401 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:22.131467 28816 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:22.179630 25726 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:24:22.152153 25686 pending_rounds.cc:85] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc: Aborting all ops after (but not including) 7
I20260709 12:24:22.180320 25686 pending_rounds.cc:107] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:24:22.128924 28774 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:22.135288 28943 raft_consensus.cc:2804] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:21.991470 28840 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:22.150838 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:22.104353 28950 raft_consensus.cc:2749] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:21.974797 28867 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:21.991884 28864 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:22.158073 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:22.151522 28700 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:22.187873 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:22.162884 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:22.175957 25759 raft_consensus.cc:2410] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:22.177335 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:22.189558 25758 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:22.189857 26432 raft_consensus.cc:2368] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 7. Current term is 8.
I20260709 12:24:22.179817 25761 raft_consensus.cc:2410] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:24:22.180611 25686 raft_consensus.cc:2889] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:21.970587 28682 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:21.979629 28824 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:22.182780 28258 raft_consensus.cc:2804] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:22.182935 25726 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:24:22.150995 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:22.195254 28258 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:22.185675 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:22.195847 28258 raft_consensus.cc:3060] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:22.186021 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:22.133574 28917 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:22.123476 28918 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:22.201807 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:24:22.182210 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 92435.6us
I20260709 12:24:22.191634 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:22.193393 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:22.193701 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:22.196537 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:22.182456 28937 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:22.208444 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:22.154712 28936 consensus_queue.cc:1059] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:24:22.181207 28947 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:22.215016 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:22.181049 28761 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:22.306882 25832 raft_consensus.cc:2393] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 8: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:22.208366 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:22.208889 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:22.204402 28674 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:22.202564 25726 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:22.211889 28964 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:22.359169 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:22.212155 28967 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:22.360605 26436 raft_consensus.cc:1275] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:24:22.251232 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 48341.5us
I20260709 12:24:22.403381 25650 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:24:22.293768 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:22.269064 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:22.405177 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 202686us
I20260709 12:24:22.405551 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:22.269335 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:22.305328 25828 raft_consensus.cc:2393] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 8: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:22.200958 28710 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:22.207899 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:22.407682 25684 raft_consensus.cc:2468] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 7.
I20260709 12:24:22.196974 28864 consensus_queue.cc:1059] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.112s
I20260709 12:24:22.187947 25679 raft_consensus.cc:1275] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:22.307294 25763 raft_consensus.cc:2393] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 7: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:22.411409 28682 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:22.411736 25834 raft_consensus.cc:1240] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 12:24:22.311033 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:22.413103 28963 log.cc:927] Time spent T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:24:22.308667 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:22.185253 28825 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:22.204957 28960 raft_consensus.cc:2804] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:22.187263 28840 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:22.204757 28943 raft_consensus.cc:697] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 6 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:22.208031 28850 raft_consensus.cc:2804] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:24:22.260399 28914 log.cc:927] Time spent T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:24:22.207862 28867 raft_consensus.cc:2804] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:22.396317 26439 raft_consensus.cc:1275] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:22.416285 28921 raft_consensus.cc:2804] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:22.405704 26433 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 5.
I20260709 12:24:22.193029 28633 raft_consensus.cc:2804] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:22.406260 25761 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:22.406718 25650 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:22.251791 28865 consensus_queue.cc:1048] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.159s
I20260709 12:24:22.410801 28948 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:22.410689 28710 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:22.209419 25759 raft_consensus.cc:2393] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 7: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:22.422659 28960 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:22.420706 25754 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 8.
I20260709 12:24:22.352545 28774 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:22.199426 28700 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:22.423759 25726 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:22.352135 28816 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:22.303828 28947 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:22.439134 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:22.439302 28258 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:22.625633 26434 raft_consensus.cc:2393] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 4: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:22.255827 28815 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:22.251111 28937 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:22.413707 28911 raft_consensus.cc:2804] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:22.213244 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:22.586979 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:22.590982 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:22.639526 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:22.640151 26433 raft_consensus.cc:2410] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:24:22.590513 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 339063us
I20260709 12:24:22.640456 26439 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:22.438835 28839 consensus_queue.cc:1059] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.191s
I20260709 12:24:22.513701 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:22.605105 28734 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:24:22.414266 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:22.349105 28761 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:22.443964 28850 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:22.608850 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 343402us
I20260709 12:24:22.606428 26401 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:22.357867 28741 consensus_queue.cc:237] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:22.514884 28921 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:22.635377 25837 raft_consensus.cc:1275] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:24:22.605288 28959 raft_consensus.cc:2804] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:22.397347 28674 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:22.599335 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 192676us
I20260709 12:24:22.644721 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:22.639518 25762 raft_consensus.cc:2468] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 5.
I20260709 12:24:22.418632 28964 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:22.651273 26438 raft_consensus.cc:1240] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:22.661139 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:22.688774 26434 raft_consensus.cc:2393] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 6: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:22.622622 28867 raft_consensus.cc:697] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:22.682317 25801 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:22.610112 28960 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:22.662918 26439 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 12.
I20260709 12:24:22.410727 28967 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:22.675092 25800 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
W20260709 12:24:22.683872 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 77528.5us
I20260709 12:24:22.707687 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:22.708452 25759 raft_consensus.cc:3060] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Advancing to term 8
W20260709 12:24:22.672313 28965 log.cc:927] Time spent T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.264s	user 0.001s	sys 0.000s
I20260709 12:24:22.604460 28948 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:22.623937 28774 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:22.655274 28804 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:22.721329 25834 raft_consensus.cc:2468] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 8.
I20260709 12:24:22.660454 28633 raft_consensus.cc:697] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:22.671561 28850 raft_consensus.cc:3060] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:22.731339 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:22.747473 26439 raft_consensus.cc:2468] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 5.
I20260709 12:24:22.688105 28921 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:22.749728 28674 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:22.747474 28804 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:22.750672 28804 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:22.755883 28948 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:22.756749 28849 raft_consensus.cc:2804] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:22.757155 28849 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:22.713198 28953 log.cc:927] Time spent T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.500s	user 0.001s	sys 0.000s
I20260709 12:24:22.763365 25761 raft_consensus.cc:2468] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 8.
I20260709 12:24:22.711539 28734 raft_consensus.cc:2804] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:22.757869 25831 raft_consensus.cc:2468] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 7.
W20260709 12:24:22.769649 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 94638us
I20260709 12:24:22.792104 25800 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:24:22.792526 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 106074us
I20260709 12:24:22.793898 26439 raft_consensus.cc:1275] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:24:22.805506 25759 raft_consensus.cc:2468] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 8.
I20260709 12:24:22.806859 28710 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:24:22.807585 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 62833.9us
I20260709 12:24:22.809911 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:22.810477 26439 raft_consensus.cc:3060] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:22.757480 28849 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:22.814263 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:22.815591 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:22.768370 28824 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:22.819259 25800 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:22.821578 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:22.823066 25800 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:22.824734 25800 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:22.826072 26430 raft_consensus.cc:1275] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:24:22.796870 28917 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:22.811625 28918 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:22.687819 28943 consensus_queue.cc:237] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:22.871521 25758 consensus_meta.cc:287] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.679s	user 0.007s	sys 0.003s
I20260709 12:24:22.878880 25758 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 12.
I20260709 12:24:22.878189 26439 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 7.
I20260709 12:24:22.881800 28967 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:22.883901 28761 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349)
I20260709 12:24:22.854604 28867 consensus_queue.cc:237] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:22.884999 28937 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:22.886677 28700 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:22.863554 28970 raft_consensus.cc:2804] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:22.816627 28734 raft_consensus.cc:697] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 7 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
W20260709 12:24:22.911089 28809 consensus_meta.cc:287] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.798s	user 0.010s	sys 0.000s
I20260709 12:24:22.913223 25680 raft_consensus.cc:2410] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:24:22.855206 28710 raft_consensus.cc:2804] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:24:22.926431 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:22.918476 28805 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:22.930240 28980 raft_consensus.cc:3060] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:22.938745 28805 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:22.863552 28976 raft_consensus.cc:2749] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:22.895183 28825 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:22.892375 28970 raft_consensus.cc:697] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 8 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:22.943372 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:22.944228 26439 raft_consensus.cc:2468] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 5.
I20260709 12:24:22.940521 26401 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:22.946867 26401 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:22.930804 28710 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:22.958875 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:22.930225 28989 raft_consensus.cc:2749] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:22.950835 28815 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:24:22.971040 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 277582us
I20260709 12:24:22.909243 28633 consensus_queue.cc:237] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:22.957365 28710 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:22.957340 28825 raft_consensus.cc:2804] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:22.918681 28734 consensus_queue.cc:237] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:22.975040 28700 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.016928 28972 raft_consensus.cc:2804] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:24:23.022917 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 340663us
W20260709 12:24:23.029778 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:23.032083 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:23.007512 28825 raft_consensus.cc:697] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 8 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:23.037544 25800 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:23.038695 25800 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:23.032826 25755 raft_consensus.cc:2393] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 6: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:23.033336 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:23.041047 25754 raft_consensus.cc:2393] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 8: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:23.046378 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:23.047906 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:23.021489 28987 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:23.064846 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:23.065872 26433 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66"
dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
mode: GRACEFUL
new_leader_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:35548
I20260709 12:24:23.066187 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:23.066468 26433 raft_consensus.cc:606] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Received request to transfer leadership to TS 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:23.066809 26433 raft_consensus.cc:614] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:23.067237 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:23.067569 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:23.034659 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:23.035401 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:23.059159 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:23.059572 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:23.063519 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:23.079545 25833 raft_consensus.cc:2468] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 6.
I20260709 12:24:23.033994 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:23.080849 25757 raft_consensus.cc:2393] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 8: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:23.033595 25801 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:23.067843 26437 raft_consensus.cc:2468] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 5.
I20260709 12:24:23.025985 28964 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:23.086498 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:23.091005 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:23.093207 26439 raft_consensus.cc:2468] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 7.
I20260709 12:24:23.036687 28972 raft_consensus.cc:697] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 8 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:23.102640 26402 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:23.095291 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:23.084599 28917 raft_consensus.cc:2804] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:24:23.083281 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 49767.1us
I20260709 12:24:23.087474 28976 raft_consensus.cc:2804] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:24:23.022534 28700 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:23.106998 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 682908us
I20260709 12:24:23.107419 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:23.109557 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:23.091255 28947 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:24:23.098806 28978 log.cc:927] Time spent T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.254s	user 0.000s	sys 0.001s
W20260709 12:24:23.098979 28979 log.cc:927] Time spent T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 12:24:23.111063 25801 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:23.097098 28927 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:23.143162 25726 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:23.149370 28682 consensus_queue.cc:1048] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:23.149917 28927 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:23.150666 28669 consensus_meta.cc:287] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 1.274s	user 0.011s	sys 0.000s
W20260709 12:24:23.157449 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 46543.3us
I20260709 12:24:23.159246 28927 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:23.109411 28948 raft_consensus.cc:2749] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:23.159085 28955 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.190364 25801 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
W20260709 12:24:23.382588 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 192309us
I20260709 12:24:23.383656 25801 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:23.110363 28917 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:23.111711 28992 raft_consensus.cc:2804] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:23.104311 29001 raft_consensus.cc:2749] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:23.027320 28970 consensus_queue.cc:237] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:23.086493 28987 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:23.369387 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:23.368872 28947 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.159880 28682 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:23.164186 28669 raft_consensus.cc:2749] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:23.146920 28976 raft_consensus.cc:697] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 12 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:23.114492 28918 consensus_queue.cc:1048] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.259s
I20260709 12:24:23.463742 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:23.465077 28990 log.cc:927] Time spent T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.363s	user 0.000s	sys 0.000s
W20260709 12:24:23.465636 28946 consensus_meta.cc:287] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 1.350s	user 0.007s	sys 0.003s
I20260709 12:24:23.340232 28674 consensus_queue.cc:1048] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.117s
W20260709 12:24:23.465502 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 322407us
I20260709 12:24:23.433068 28917 raft_consensus.cc:3060] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:23.146771 28981 consensus_queue.cc:1059] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.300s
I20260709 12:24:23.290573 28850 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:23.399317 28989 raft_consensus.cc:2749] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:23.494561 25830 raft_consensus.cc:2468] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 5.
I20260709 12:24:23.446867 28927 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:23.425100 28992 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:23.291348 28825 consensus_queue.cc:237] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:23.578707 28669 raft_consensus.cc:3060] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:23.583873 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:23.580956 25726 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a
W20260709 12:24:23.594053 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 210496us
I20260709 12:24:23.600623 25726 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:23.601997 25726 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:23.475838 28947 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:23.605099 28947 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:23.610898 25801 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
W20260709 12:24:23.593833 28979 log.cc:927] Time spent T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:24:23.620522 25801 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:23.584609 29006 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:23.596132 28998 log.cc:927] Time spent T 00000000000000000000000000000000 P 496fd6924b624e77b03ccfd15653d47b: Append to log took a long time: real 0.215s	user 0.000s	sys 0.005s
I20260709 12:24:23.584218 29008 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:23.396234 28955 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:23.589771 28992 raft_consensus.cc:3060] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:23.572783 28946 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:23.645560 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:23.647099 25801 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:23.625257 28867 raft_consensus.cc:2749] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:23.554344 28972 consensus_queue.cc:237] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:23.589901 28927 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:23.682212 25686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2114) took 1532 ms. Trace:
I20260709 12:24:23.685564 25686 rpcz_store.cc:276] 0709 12:24:22.150089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.151609 (+  1520us) service_pool.cc:224] Handling call
0709 12:24:22.151955 (+   346us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:22.302018 (+150063us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:22.302060 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:22.302753 (+   693us) log.cc:844] Serialized 52 byte log entry
0709 12:24:22.636643 (+333890us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:22.662144 (+ 25501us) log.cc:844] Serialized 14 byte log entry
0709 12:24:22.683400 (+ 21256us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:22.683491 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:23.681973 (+998482us) raft_consensus.cc:1685] finished
0709 12:24:23.681992 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:23.682143 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15385,"prepare.queue_time_us":23266,"prepare.run_wall_time_us":45,"raft.queue_time_us":73972,"raft.run_cpu_time_us":331,"raft.run_wall_time_us":75798,"spinlock_wait_cycles":35341568,"thread_start_us":205742,"threads_started":1,"wal-append.queue_time_us":410609}
I20260709 12:24:23.622859 28989 raft_consensus.cc:2749] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:23.653891 25830 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 6.
I20260709 12:24:23.684679 26430 raft_consensus.cc:1240] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:24:23.644794 28966 raft_consensus.cc:2749] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:23.623329 28981 raft_consensus.cc:2804] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:23.692909 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:23.693495 25684 raft_consensus.cc:3060] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:23.691888 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:23.695384 25686 raft_consensus.cc:2393] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 8: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:23.651845 28993 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.687237 25801 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:23.628408 28987 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:23.669723 28700 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:23.621232 28709 consensus_queue.cc:1048] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.074s
I20260709 12:24:23.670753 28809 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:23.703089 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:23.700067 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:23.707350 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:23.698465 25801 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:23.700774 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:23.655853 28947 raft_consensus.cc:2749] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:23.709350 25684 raft_consensus.cc:2410] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 12:24:23.709227 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 107304us
I20260709 12:24:23.711232 25686 raft_consensus.cc:2468] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 4.
W20260709 12:24:23.697470 28849 consensus_meta.cc:287] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.871s	user 0.008s	sys 0.003s
I20260709 12:24:23.690913 29012 raft_consensus.cc:2749] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:23.687886 28970 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:23.714208 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:23.717504 25726 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:24:23.718144 25677 raft_consensus.cc:2468] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 6.
I20260709 12:24:23.718369 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:23.719314 25681 raft_consensus.cc:2468] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 5.
I20260709 12:24:23.719486 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:23.645963 29006 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:23.724965 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:23.701457 28981 raft_consensus.cc:697] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:23.702000 28918 raft_consensus.cc:2804] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:23.710175 28987 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.728124 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:23.730986 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:23.732420 25726 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:23.736796 25684 raft_consensus.cc:2376] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 5. Re-sending same reply.
I20260709 12:24:23.653391 29008 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:23.738955 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:23.722719 28674 raft_consensus.cc:2804] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:23.739473 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:23.734390 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:23.716776 28849 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:23.733979 25830 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:24:23.742605 25677 raft_consensus.cc:2410] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 9 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:24:23.738036 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
W20260709 12:24:23.731716 29004 log.cc:927] Time spent T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 12:24:23.744050 28674 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:23.655197 28976 consensus_queue.cc:237] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:23.724932 28863 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:23.747604 25681 raft_consensus.cc:2393] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 7: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:23.748898 28946 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:23.740375 28966 raft_consensus.cc:2749] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:23.713742 28809 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:23.732477 28867 raft_consensus.cc:2804] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:23.733462 28918 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:23.732465 29015 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.761814 28966 consensus_queue.cc:1059] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:23.763200 28734 raft_consensus.cc:3055] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:23.763588 28734 raft_consensus.cc:740] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:23.764209 25679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2101) took 2344 ms. Trace:
I20260709 12:24:23.764613 25679 rpcz_store.cc:276] 0709 12:24:21.420197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.527673 (+107476us) service_pool.cc:224] Handling call
0709 12:24:21.534570 (+  6897us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:22.411448 (+876878us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:23.763865 (+1352417us) spinlock_profiling.cc:243] Waited 600 ms on lock 0x7b54000b13d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:23.764137 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1380320000}
I20260709 12:24:23.766817 28258 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:23.768816 28955 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:23.769197 28849 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:23.734611 28967 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:23.769892 25830 raft_consensus.cc:606] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Received request to transfer leadership to TS 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:23.770349 25830 raft_consensus.cc:614] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:23.770046 28967 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:23.770854 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:23.771699 25757 raft_consensus.cc:2410] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 9 because replica has last-logged OpId of term: 7 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:24:23.771646 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:23.772445 25759 raft_consensus.cc:2468] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 8.
I20260709 12:24:23.773162 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:23.742666 28949 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.759795 25726 leader_election.cc:400] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Vote denied by peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611) with higher term. Message: Invalid argument: T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 7. Current term is 8.
I20260709 12:24:23.775518 25726 leader_election.cc:403] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:23.773964 28949 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:23.775519 25800 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:23.778879 28949 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:23.780320 28853 raft_consensus.cc:2804] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:23.780714 28853 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:23.781042 28853 raft_consensus.cc:3060] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:23.788378 28966 raft_consensus.cc:2749] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611) with higher term. Message: Invalid argument: T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 7. Current term is 8.
I20260709 12:24:23.788643 29006 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:23.727387 28970 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:23.753724 28999 log.cc:927] Time spent T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
I20260709 12:24:23.791172 26433 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5"
dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
mode: GRACEFUL
new_leader_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:35548
I20260709 12:24:23.747629 28987 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:23.795109 28850 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:24:23.854398 28710 consensus_meta.cc:287] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.846s	user 0.007s	sys 0.003s
I20260709 12:24:23.824657 28709 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:23.855012 28710 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:23.855273 28709 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:23.837394 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:24:23.837496 25832 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41782 (request call id 679) took 1652 ms (client timeout 1582 ms). Trace:
I20260709 12:24:23.756044 28674 raft_consensus.cc:3060] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:23.710356 28993 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:23.862555 28809 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:23.808482 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
W20260709 12:24:23.857954 25832 rpcz_store.cc:269] 0709 12:24:22.184921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.185753 (+   832us) service_pool.cc:224] Handling call
0709 12:24:23.837293 (+1651540us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b5400109d54. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:23.837424 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":253418880}
I20260709 12:24:23.774467 28918 raft_consensus.cc:3060] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:23.864046 25830 raft_consensus.cc:3060] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:23.864521 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:23.866046 28774 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:23.849004 28734 consensus_queue.cc:260] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:23.867318 28734 raft_consensus.cc:3060] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:23.871853 28917 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:23.875363 28917 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:23.876302 28669 raft_consensus.cc:2749] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:23.878988 28710 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:23.881553 28921 consensus_meta.cc:287] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 1.133s	user 0.009s	sys 0.002s
I20260709 12:24:23.876783 28709 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:23.775827 28867 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
W20260709 12:24:23.864655 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 135566us
W20260709 12:24:23.832511 28463 consensus_meta.cc:287] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 1.671s	user 0.007s	sys 0.007s
I20260709 12:24:23.888890 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:23.890481 25650 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
W20260709 12:24:23.863523 28980 consensus_meta.cc:287] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.925s	user 0.010s	sys 0.000s
I20260709 12:24:23.895905 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:23.894393 25650 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:23.898926 26402 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:23.900151 26402 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:24:23.903004 25650 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:23.906244 26402 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:24:23.909072 26402 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:23.915380 26402 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:23.892969 28867 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:23.908318 28955 raft_consensus.cc:2804] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:23.916297 28927 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:23.918083 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:23.829952 29008 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:23.916651 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:23.919380 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:23.919589 26437 raft_consensus.cc:2368] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 11. Current term is 12.
I20260709 12:24:23.922713 26402 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:24:23.925514 25726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:23.926002 25726 connection.cc:256] RPC call timeout handler was delayed by -1.6769024889999855s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1764s for a response
W20260709 12:24:23.926363 25726 connection.cc:256] RPC call timeout handler was delayed by -1.5095024889997148s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.195s for a response
W20260709 12:24:23.926678 25726 connection.cc:256] RPC call timeout handler was delayed by -1.2926024889998189s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2191s for a response
I20260709 12:24:23.927528 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:23.927750 29016 raft_consensus.cc:2804] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:23.928148 26437 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:23.929488 25830 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 7.
I20260709 12:24:23.930365 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:23.931447 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:23.932394 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:23.933002 26402 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:23.913034 28700 raft_consensus.cc:2749] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:23.916616 28955 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:23.935806 29018 raft_consensus.cc:2804] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:23.916988 28463 raft_consensus.cc:2749] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:23.936264 29018 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:23.936873 29018 raft_consensus.cc:3060] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:23.936178 28955 raft_consensus.cc:3060] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:23.895321 28863 raft_consensus.cc:2749] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:23.936162 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:23.882031 28921 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:24:23.942015 26437 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 6.
I20260709 12:24:23.790393 29015 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:23.944766 26433 raft_consensus.cc:606] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 8 LEADER]: Received request to transfer leadership to TS 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:23.908138 28824 raft_consensus.cc:2749] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:23.917039 28946 raft_consensus.cc:2804] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:23.908725 28809 consensus_queue.cc:1048] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:24:23.948277 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:23.948648 29021 raft_consensus.cc:2749] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:23.945598 25830 raft_consensus.cc:2393] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 8: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:23.856274 28981 consensus_queue.cc:237] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:23.949591 25681 raft_consensus.cc:2393] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 8: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:23.913484 28988 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.917524 28980 raft_consensus.cc:2749] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:23.942763 25726 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:23.955319 25650 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:23.835774 28992 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:23.958840 28867 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:23.959717 28863 raft_consensus.cc:2804] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:23.960326 28863 raft_consensus.cc:697] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 7 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:23.960732 28992 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:23.955461 25832 raft_consensus.cc:2468] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 7.
I20260709 12:24:23.952569 28946 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:23.955319 25726 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:24:23.950637 28682 raft_consensus.cc:2749] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:23.963992 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:23.972705 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:23.973485 25832 raft_consensus.cc:3060] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:23.976459 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:23.980225 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:23.963508 28946 raft_consensus.cc:3060] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:23.983525 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:23.983238 29020 consensus_queue.cc:1048] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:24:23.988425 25832 raft_consensus.cc:2468] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 6.
I20260709 12:24:23.989578 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:23.987093 29020 raft_consensus.cc:2804] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:23.990737 28987 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:23.991372 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:23.992400 26436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 804) took 1588 ms. Trace:
I20260709 12:24:23.978847 28682 raft_consensus.cc:2749] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:23.999588 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:23.982005 28960 consensus_meta.cc:287] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 1.237s	user 0.005s	sys 0.006s
I20260709 12:24:24.000461 26437 raft_consensus.cc:2468] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 6.
I20260709 12:24:23.998536 26436 rpcz_store.cc:276] 0709 12:24:22.404297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.406799 (+  2502us) service_pool.cc:224] Handling call
0709 12:24:22.428481 (+ 21682us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:22.654906 (+226425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:22.654936 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:22.654977 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:22.655008 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:23.992069 (+1337061us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b54007d5ad4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:23.992129 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:23.992347 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":520156032}
I20260709 12:24:23.990285 25832 raft_consensus.cc:3060] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:24.002604 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:24.003304 26436 raft_consensus.cc:2376] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 7. Re-sending same reply.
I20260709 12:24:24.005918 28970 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:24.007599 28867 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:24.015828 25832 raft_consensus.cc:2468] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 8.
I20260709 12:24:24.016856 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:24.008879 28969 log.cc:927] Time spent T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 1.077s	user 0.009s	sys 0.036s
I20260709 12:24:24.017774 25832 raft_consensus.cc:2393] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 6: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:24.025763 25837 raft_consensus.cc:2468] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 7.
I20260709 12:24:24.026445 28921 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:24.027375 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:23.961329 28863 consensus_queue.cc:237] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:24.028457 25837 raft_consensus.cc:2393] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 8: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:24.029476 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:24.030179 25837 raft_consensus.cc:2468] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 9.
I20260709 12:24:24.032760 25650 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:24.033519 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:24.034643 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:24.035485 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:24.036397 25832 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:24.013178 29020 raft_consensus.cc:697] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:24.038646 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:24.015866 28970 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:24.013038 28853 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:24.034549 28921 raft_consensus.cc:2804] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:23.962468 28988 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:24.014083 28674 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:24.056692 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:24.058442 26436 raft_consensus.cc:2393] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 6: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:24.059613 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:23.978842 29018 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:24.061338 25830 raft_consensus.cc:2368] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for earlier term 8. Current term is 9.
I20260709 12:24:24.032213 29015 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:24.012324 28960 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:24.046598 28860 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:24.065109 25677 raft_consensus.cc:2410] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 14 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 12:24:24.054066 28921 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:24.053766 29008 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:24.053999 28463 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:24.077044 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:24.078037 26436 raft_consensus.cc:3060] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:24.081727 26437 raft_consensus.cc:2393] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 7: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:24.054446 28970 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:24.084369 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 151449us
I20260709 12:24:24.063922 29016 raft_consensus.cc:697] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 5 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:24.068967 28921 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:24.090690 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:24.091389 25837 raft_consensus.cc:2410] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:24:24.095165 25832 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 9.
I20260709 12:24:24.099812 28918 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:24.104796 29016 consensus_queue.cc:237] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:24.076828 28463 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:24.105646 28973 log.cc:927] Time spent T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 1.469s	user 0.008s	sys 0.008s
W20260709 12:24:24.106969 25828 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41782 (request call id 683) took 1920 ms (client timeout 1893 ms). Trace:
I20260709 12:24:24.095824 26436 raft_consensus.cc:2468] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 6.
W20260709 12:24:24.154466 25828 rpcz_store.cc:269] 0709 12:24:22.186209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.186745 (+   536us) service_pool.cc:224] Handling call
0709 12:24:24.106651 (+1919906us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b54003c5354. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:24.106893 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":233493888}
I20260709 12:24:24.080235 29008 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:24.070336 28860 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:24.080942 29020 consensus_queue.cc:237] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:24.164119 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 84713.6us
W20260709 12:24:24.164657 28911 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.477s	user 0.008s	sys 0.020s
W20260709 12:24:24.187381 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 120526us
I20260709 12:24:24.192378 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:24.192586 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:24.193100 25828 raft_consensus.cc:2468] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 5.
I20260709 12:24:24.193267 25837 raft_consensus.cc:2468] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 8.
I20260709 12:24:24.193847 25801 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:24.198733 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:24.199625 26436 raft_consensus.cc:2393] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 7: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
W20260709 12:24:24.187559 29024 log.cc:927] Time spent T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:24:24.201884 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:24.153954 29027 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:24.195956 28911 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.513s	user 0.008s	sys 0.020s
I20260709 12:24:24.205922 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:24.181133 28992 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:24.209054 28992 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:24.211903 28992 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:24:24.218078 25760 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53474 (request call id 2584) took 2581 ms (client timeout 1864 ms). Trace:
I20260709 12:24:24.218827 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:24.207541 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 252270us
W20260709 12:24:24.218721 25760 rpcz_store.cc:269] 0709 12:24:21.625824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.625952 (+   128us) service_pool.cc:224] Handling call
0709 12:24:24.206575 (+2580623us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b54001e6254. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:24.206675 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":279741696}
I20260709 12:24:24.200343 28964 raft_consensus.cc:2804] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:24.225194 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:24.225417 29026 log.cc:927] Time spent T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 12:24:24.226334 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:24.227090 25828 raft_consensus.cc:2393] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 6: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:24.228327 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:24.229067 25828 raft_consensus.cc:2393] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 7: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:24.230106 25828 raft_consensus.cc:1240] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:24:24.231236 25828 raft_consensus.cc:1240] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:24.232191 25828 raft_consensus.cc:1240] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:24.233646 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:24.239148 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:24.239828 25837 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 9.
I20260709 12:24:24.214025 28853 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:24.207756 28911 raft_consensus.cc:697] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 7 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:24.246788 25828 raft_consensus.cc:1240] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 10. Current term is 11. Ops: [10.6-10.6]
W20260709 12:24:24.249567 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:24.240226 28964 raft_consensus.cc:697] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 6 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:24.254308 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:24.213176 29027 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:24.264384 25828 raft_consensus.cc:1240] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:24.351305 25837 raft_consensus.cc:1240] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:24.350960 28992 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:24.353317 28992 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:24.361368 28960 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:24.248167 29018 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349)
I20260709 12:24:24.373813 25756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48606 (request call id 775) took 3386 ms. Trace:
I20260709 12:24:24.374958 26435 raft_consensus.cc:1240] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:24.374310 25756 rpcz_store.cc:276] 0709 12:24:20.982179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.982312 (+   133us) service_pool.cc:224] Handling call
0709 12:24:20.982591 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:22.094244 (+1111653us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:24.368420 (+2274176us) spinlock_profiling.cc:243] Waited 993 ms on lock 0x7b54001dbad4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:24.368595 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2284811520}
I20260709 12:24:24.252794 28970 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:24.385301 28860 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:24.385107 28946 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:24.387370 28946 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:24.388622 25837 raft_consensus.cc:1275] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:24.391335 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:24.394245 25650 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:24.395406 25650 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:24.387514 28804 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:24.402093 25650 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:24.404351 25650 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:24.406308 25650 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:24:24.377350 29029 log.cc:927] Time spent T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.144s	user 0.000s	sys 0.006s
I20260709 12:24:24.409894 28863 raft_consensus.cc:2804] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:24.411475 28863 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:24.362114 28992 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:24.414425 28927 consensus_queue.cc:1059] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:24.414889 28992 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:24.415585 28927 raft_consensus.cc:3055] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:24.415452 28992 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:24.416167 28927 raft_consensus.cc:740] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:24.417610 29023 consensus_queue.cc:1059] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 12:24:24.410645 28804 raft_consensus.cc:2804] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:24.412014 28863 raft_consensus.cc:3060] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:24.424960 28463 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:24.412711 28918 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:24.407574 29015 raft_consensus.cc:2749] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:24.419348 28911 consensus_queue.cc:237] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:24.423130 28804 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:24.475960 25650 leader_election.cc:400] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Vote denied by peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237) with higher term. Message: Invalid argument: T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for earlier term 8. Current term is 9.
I20260709 12:24:24.476536 25650 leader_election.cc:403] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:24.432644 28964 consensus_queue.cc:237] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:24.417269 28927 consensus_queue.cc:260] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:24.490370 28927 raft_consensus.cc:3060] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:24.436028 28955 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:24.413071 28943 raft_consensus.cc:2804] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:24.437119 28992 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:24.437284 28909 raft_consensus.cc:3055] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:24.495713 28909 raft_consensus.cc:740] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:24.495535 28863 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:24.497869 28863 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:24.498720 28863 raft_consensus.cc:3060] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:24:24.438508 25685 raft_consensus.cc:1240] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 6 LEADER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:24.435896 25682 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51578 (request call id 632) took 3780 ms (client timeout 1740 ms). Trace:
W20260709 12:24:24.500092 25682 rpcz_store.cc:269] 0709 12:24:20.655539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.987977 (+332438us) service_pool.cc:224] Handling call
0709 12:24:24.435581 (+3447604us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54002a53d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:24.435773 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2736609664}
I20260709 12:24:24.441771 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:24.502818 28805 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:24.503018 25830 raft_consensus.cc:1275] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:24:24.442472 28967 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:24:24.445652 25829 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44202 (request call id 2540) took 2738 ms (client timeout 1798 ms). Trace:
I20260709 12:24:24.445748 25837 raft_consensus.cc:1240] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 7. Current term is 8. Ops: []
W20260709 12:24:24.504185 25829 rpcz_store.cc:269] 0709 12:24:21.707303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.707433 (+   130us) service_pool.cc:224] Handling call
0709 12:24:24.445437 (+2738004us) spinlock_profiling.cc:243] Waited 386 ms on lock 0x7b540010ac54. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:24.445549 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":886821120}
I20260709 12:24:24.505069 25650 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:24.408898 28860 raft_consensus.cc:2804] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:24:24.450233 29005 log.cc:927] Time spent T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.856s	user 0.006s	sys 0.002s
I20260709 12:24:24.451879 28745 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:24.452351 29027 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:24.477876 28804 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:24.508214 29008 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:24.508759 28883 raft_consensus.cc:3055] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:24.512701 25684 raft_consensus.cc:2393] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 6: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:24.509253 28860 raft_consensus.cc:697] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 9 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:24.493966 28943 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:24.510262 28805 raft_consensus.cc:2749] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:24:24.563884 26402 leader_election.cc:336] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Timed out: RequestConsensusVote RPC to 127.23.245.131:36237 timed out after 1.556s (SENT)
I20260709 12:24:24.580616 26402 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:24.496901 28909 consensus_queue.cc:260] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:24.515007 28883 raft_consensus.cc:740] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:24.520151 28943 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:24.598582 25726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:24.586787 29027 raft_consensus.cc:2749] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:24.600513 28909 raft_consensus.cc:3060] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:24.594435 28633 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:24.604032 28860 consensus_queue.cc:237] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
W20260709 12:24:24.626789 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:24.669281 28921 consensus_meta.cc:287] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.577s	user 0.007s	sys 0.003s
I20260709 12:24:24.639845 28633 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:24.683712 28633 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:24.692209 26402 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:24:24.693910 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:24.694945 28805 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:24.707461 26438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 798) took 2422 ms. Trace:
I20260709 12:24:24.710134 26438 rpcz_store.cc:276] 0709 12:24:22.267254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.267399 (+   145us) service_pool.cc:224] Handling call
0709 12:24:22.358653 (+ 91254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:22.688081 (+329428us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:24.688937 (+2000856us) spinlock_profiling.cc:243] Waited 292 ms on lock 0x7b540078df54. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:24.689162 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":672544512}
I20260709 12:24:24.721325 28805 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:24.610324 28883 consensus_queue.cc:260] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:24.711558 28937 raft_consensus.cc:2804] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:24.695611 28921 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:24.816497 28937 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:24.864670 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:24.840873 28883 raft_consensus.cc:3060] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:24.867230 28937 raft_consensus.cc:3060] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:24.937788 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:24.971733 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:24.974308 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:24.975688 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
W20260709 12:24:24.977118 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 284968us
I20260709 12:24:24.978072 26402 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:24:25.014915 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:25.022512 28805 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:24.921638 28863 raft_consensus.cc:2749] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237) with higher term. Message: Invalid argument: T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for earlier term 8. Current term is 9.
I20260709 12:24:24.920125 28943 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:24.997000 28921 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:25.023293 28633 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
W20260709 12:24:25.095100 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 117113us
I20260709 12:24:25.126832 26402 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:25.080446 28955 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:25.140141 28815 raft_consensus.cc:2749] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:25.140641 26432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 796) took 2874 ms. Trace:
I20260709 12:24:25.141038 26432 rpcz_store.cc:276] 0709 12:24:22.266280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.266435 (+   155us) service_pool.cc:224] Handling call
0709 12:24:22.266772 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:22.699157 (+432385us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:24:22.818161 (+119004us) log.cc:844] Serialized 14 byte log entry
0709 12:24:23.172799 (+354638us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:23.172876 (+    77us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:23.172940 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:25.140408 (+1967468us) spinlock_profiling.cc:243] Waited 432 ms on lock 0x7b540078f854. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:25.140454 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:25.140580 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":327156,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":146731,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":35197,"spinlock_wait_cycles":993869568,"thread_start_us":399353,"threads_started":2,"wal-append.queue_time_us":642282,"wal-append.run_cpu_time_us":2130,"wal-append.run_wall_time_us":1342071}
W20260709 12:24:25.144408 25835 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41782 (request call id 692) took 2083 ms (client timeout 1556 ms). Trace:
W20260709 12:24:25.147565 25835 rpcz_store.cc:269] 0709 12:24:23.061252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:23.061998 (+   746us) service_pool.cc:224] Handling call
0709 12:24:25.144200 (+2082202us) spinlock_profiling.cc:243] Waited 954 ms on lock 0x7b54001f3954. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:25.144334 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2193791232}
I20260709 12:24:25.124879 28992 raft_consensus.cc:2749] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:25.072532 28633 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:25.254093 28964 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.013s	sys 0.032s
W20260709 12:24:25.254573 28964 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.013s	sys 0.032s
W20260709 12:24:25.256116 25726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:25.257187 25726 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89
W20260709 12:24:25.263329 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:25.267808 26434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 821) took 1486 ms. Trace:
I20260709 12:24:25.268285 26434 rpcz_store.cc:276] 0709 12:24:23.781851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:23.784627 (+  2776us) service_pool.cc:224] Handling call
0709 12:24:23.794087 (+  9460us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:23.865211 (+ 71124us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:23.865259 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:23.894097 (+ 28838us) log.cc:844] Serialized 26 byte log entry
0709 12:24:24.079373 (+185276us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:24:24.079412 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:25.267349 (+1187937us) spinlock_profiling.cc:243] Waited 70.2 ms on lock 0x7b54004745d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:25.267407 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:25.267457 (+    50us) raft_consensus.cc:1685] finished
0709 12:24:25.267473 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:25.267739 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1244,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":76,"spinlock_wait_cycles":161444224,"thread_start_us":138063,"threads_started":1,"wal-append.queue_time_us":264490}
I20260709 12:24:25.282063 25726 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
W20260709 12:24:25.287024 28974 log.cc:927] Time spent T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 2.528s	user 0.018s	sys 0.013s
I20260709 12:24:25.291277 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:25.292541 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:25.293192 25763 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:25.294912 25678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2112) took 3145 ms. Trace:
I20260709 12:24:25.299983 25757 raft_consensus.cc:1240] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:25.295384 25678 rpcz_store.cc:276] 0709 12:24:22.149225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.150274 (+  1049us) service_pool.cc:224] Handling call
0709 12:24:22.150665 (+   391us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:22.183279 (+ 32614us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:22.183309 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:22.183810 (+   501us) log.cc:844] Serialized 26 byte log entry
0709 12:24:22.419020 (+235210us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:22.419111 (+    91us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:22.419196 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:23.082974 (+663778us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b4400022b4c. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db 00007f5d99708aaf 00007f5d996fc86e 00007f5d996fbbb6 00007f5d996fb7d8 00007f5d99705221 00007f5d997051d9 00007f5d99705169
0709 12:24:25.286749 (+2203775us) spinlock_profiling.cc:243] Waited 5.09 ms on lock 0x7b24001829d8. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d968fa9c4 00007f5d968f8acb 00007f5d96ab3dc9 00007f5d96ab3a55 00007f5d96ab309d 00007f5d996e510e 00007f5d996fc88c 00007f5d996fbbb6 00007f5d996fb7d8 00007f5d99705221
0709 12:24:25.294651 (+  7902us) raft_consensus.cc:1685] finished
0709 12:24:25.294689 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:25.294842 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78251,"raft.queue_time_us":33635,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":13547,"spinlock_wait_cycles":38870528,"thread_start_us":168066,"threads_started":1,"wal-append.queue_time_us":460102}
I20260709 12:24:25.302127 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:25.303545 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:25.304170 25760 raft_consensus.cc:2468] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 6.
W20260709 12:24:25.305495 28839 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.634s	user 0.017s	sys 0.028s
I20260709 12:24:25.306735 25760 raft_consensus.cc:1275] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:24:25.310469 29056 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.311240 29054 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:25.311723 28993 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:25.313632 26431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 820) took 1584 ms. Trace:
I20260709 12:24:25.316037 28825 raft_consensus.cc:2749] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:25.317332 28633 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:25.317814 28943 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:25.321355 25763 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 6.
I20260709 12:24:25.322872 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:25.305903 28839 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.645s	user 0.017s	sys 0.029s
I20260709 12:24:25.347260 28957 raft_consensus.cc:3055] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:25.347788 28957 raft_consensus.cc:740] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:25.348785 28957 consensus_queue.cc:260] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:25.349517 26436 raft_consensus.cc:1240] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:25.349751 29052 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.350005 28957 raft_consensus.cc:3060] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:25.350286 29052 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:25.352387 25835 raft_consensus.cc:2468] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 5.
W20260709 12:24:25.352789 28997 log.cc:927] Time spent T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 1.957s	user 0.011s	sys 0.008s
I20260709 12:24:25.337275 29056 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:25.337112 29054 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:25.359437 28918 consensus_queue.cc:1059] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:25.363168 29055 raft_consensus.cc:3055] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:25.363634 29055 raft_consensus.cc:740] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
W20260709 12:24:25.335103 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 208006us
I20260709 12:24:25.333433 26431 rpcz_store.cc:276] 0709 12:24:23.729517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:23.729633 (+   116us) service_pool.cc:224] Handling call
0709 12:24:23.740625 (+ 10992us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:23.740986 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:23.741019 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:25.149833 (+1408814us) spinlock_profiling.cc:243] Waited 1.67 ms on lock 0x7b2c000d5dd8. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9845aa11 00007f5d9846a372 00007f5d99b9ca01 00007f5d99b6143a 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2
0709 12:24:25.152023 (+  2190us) log.cc:844] Serialized 26 byte log entry
0709 12:24:25.309817 (+157794us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:25.309867 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:25.309952 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:25.313369 (+  3417us) raft_consensus.cc:1685] finished
0709 12:24:25.313388 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:25.313573 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":87,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":4351,"spinlock_wait_cycles":3845888,"thread_start_us":46240,"threads_started":1,"wal-append.queue_time_us":55702}
W20260709 12:24:25.335471 28927 consensus_meta.cc:287] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.845s	user 0.009s	sys 0.003s
I20260709 12:24:25.351389 28937 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:25.372124 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:25.372367 28937 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:25.340169 28633 raft_consensus.cc:2804] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:24:25.375972 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 94010.7us
I20260709 12:24:25.378958 25726 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:25.381016 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:25.384016 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 44182.9us
I20260709 12:24:25.374615 28839 raft_consensus.cc:2804] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:25.386656 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:25.386876 25800 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:25.387826 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:25.388408 25682 raft_consensus.cc:2468] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 6.
I20260709 12:24:25.387259 25678 raft_consensus.cc:2468] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 6.
I20260709 12:24:25.392271 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:25.393082 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:25.394536 25678 raft_consensus.cc:3055] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:25.394982 25678 raft_consensus.cc:740] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:25.395426 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:25.396252 25686 raft_consensus.cc:3060] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:25.369913 28741 consensus_queue.cc:1048] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 12:24:25.393685 25682 raft_consensus.cc:2468] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 7.
I20260709 12:24:25.400409 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:25.395805 25678 consensus_queue.cc:260] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:25.402844 25678 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:25.386087 28964 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.368806 29055 consensus_queue.cc:260] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:25.390085 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:25.418543 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:25.418421 25679 raft_consensus.cc:3060] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:25.420965 29061 raft_consensus.cc:2804] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:25.421409 29061 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:25.421762 29061 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:25.424201 29055 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:25.402249 29052 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:25.430562 29052 raft_consensus.cc:2804] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:25.431069 29052 raft_consensus.cc:697] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:25.403733 28966 consensus_queue.cc:1059] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:24:25.434671 25679 raft_consensus.cc:2468] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 7.
W20260709 12:24:25.434860 28804 consensus_meta.cc:287] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.916s	user 0.012s	sys 0.000s
I20260709 12:24:25.435312 28804 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:25.418665 28964 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:25.437383 28804 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:25.437565 28964 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:25.438625 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:25.439510 25679 raft_consensus.cc:2410] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:24:25.440652 25679 raft_consensus.cc:1275] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:24:25.444818 25686 raft_consensus.cc:2468] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 5.
W20260709 12:24:25.452860 28883 consensus_meta.cc:287] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.581s	user 0.008s	sys 0.003s
I20260709 12:24:25.413349 29062 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:25.454006 29062 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:25.464322 29062 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:25.468012 29052 consensus_queue.cc:237] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:25.470256 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:25.472821 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:25.478312 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 91554us
I20260709 12:24:25.479763 29062 consensus_queue.cc:1048] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:25.481477 25800 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:25.482187 29062 raft_consensus.cc:2804] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:25.482708 29062 raft_consensus.cc:697] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 6 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:25.483660 29062 consensus_queue.cc:237] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:25.489264 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:25.489780 29061 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:25.492708 28839 raft_consensus.cc:697] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
W20260709 12:24:25.493518 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 114639us
W20260709 12:24:25.496717 25680 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 2106) took 3375 ms (client timeout 3328 ms). Trace:
W20260709 12:24:25.497804 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:25.492237 29061 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:25.500662 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:25.501904 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:25.502658 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
W20260709 12:24:25.508512 25680 rpcz_store.cc:269] 0709 12:24:22.121168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.150730 (+ 29562us) service_pool.cc:224] Handling call
0709 12:24:25.496454 (+3345724us) spinlock_profiling.cc:243] Waited 717 ms on lock 0x7b5400203854. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:25.496628 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1648756480}
W20260709 12:24:25.509552 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:25.508731 25726 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:25.516598 25833 raft_consensus.cc:3060] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:25.493196 28633 raft_consensus.cc:697] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:25.522863 28633 consensus_queue.cc:237] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:25.525161 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:25.526633 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:25.533923 25833 raft_consensus.cc:2468] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 7.
I20260709 12:24:25.535537 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:25.536365 25833 raft_consensus.cc:2468] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 6.
I20260709 12:24:25.537386 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:25.538151 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:25.538204 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:25.539414 25832 raft_consensus.cc:2393] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 8: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:25.539471 25829 raft_consensus.cc:2393] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 6: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:25.543655 29067 raft_consensus.cc:2804] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:25.545492 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:25.546149 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:25.549283 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:25.549970 25756 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:25.551378 25837 raft_consensus.cc:1275] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:25.546900 25835 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 4.
I20260709 12:24:25.553735 25834 raft_consensus.cc:1240] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 6. Current term is 7. Ops: []
W20260709 12:24:25.534538 28959 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.767s	user 0.024s	sys 0.068s
W20260709 12:24:25.555449 28959 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.812s	user 0.024s	sys 0.068s
I20260709 12:24:25.557159 29067 raft_consensus.cc:697] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 7 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:25.665648 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:25.665886 28959 raft_consensus.cc:697] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 4 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:25.666464 26434 raft_consensus.cc:2393] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 6: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:25.665943 29067 consensus_queue.cc:237] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:25.666941 28959 consensus_queue.cc:237] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:25.659510 28903 raft_consensus.cc:3055] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:25.557201 29066 consensus_queue.cc:1059] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:24:25.659808 25828 raft_consensus.cc:1240] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 7. Current term is 8. Ops: []
W20260709 12:24:25.672464 26437 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36518 (request call id 763) took 1811 ms (client timeout 2067 ms). Trace:
W20260709 12:24:25.672897 26437 rpcz_store.cc:269] 0709 12:24:23.860737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:24.015363 (+154626us) service_pool.cc:224] Handling call
0709 12:24:25.672217 (+1656854us) spinlock_profiling.cc:243] Waited 45.3 ms on lock 0x7b5400373f54. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:25.672389 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":104167296}
I20260709 12:24:25.568239 29068 consensus_queue.cc:1048] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:25.663807 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:25.674778 26436 raft_consensus.cc:3060] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:25.675015 25828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 2558) took 1760 ms. Trace:
W20260709 12:24:25.675370 25681 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51578 (request call id 655) took 1759 ms (client timeout 1647 ms). Trace:
I20260709 12:24:25.662475 26431 raft_consensus.cc:1240] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 4. Current term is 5. Ops: []
W20260709 12:24:25.664466 25683 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 2110) took 3536 ms (client timeout 1944 ms). Trace:
I20260709 12:24:25.676460 28840 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:24:25.690114 25831 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41782 (request call id 689) took 3476 ms (client timeout 2165 ms). Trace:
I20260709 12:24:25.692374 25685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40230 (request call id 1458) took 4718 ms. Trace:
W20260709 12:24:25.680162 25683 rpcz_store.cc:269] 0709 12:24:22.128340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.128478 (+   138us) service_pool.cc:224] Handling call
0709 12:24:25.664256 (+3535778us) spinlock_profiling.cc:243] Waited 2.09 s on lock 0x7b5400159354. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:25.664397 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4800071424}
I20260709 12:24:25.692974 25685 rpcz_store.cc:276] 0709 12:24:20.974323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.536736 (+562413us) service_pool.cc:224] Handling call
0709 12:24:24.438269 (+2901533us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:24.499717 (+ 61448us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:25.692132 (+1192415us) spinlock_profiling.cc:243] Waited 2.85 s on lock 0x7b54002a53d0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b608ad 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:25.692295 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6566274816}
I20260709 12:24:25.680482 28988 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:25.590955 28912 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:25.681450 26433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:35548 (request call id 5) took 1890 ms. Trace:
W20260709 12:24:25.690404 29038 log.cc:927] Time spent T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 1.023s	user 0.010s	sys 0.000s
I20260709 12:24:25.700169 26433 rpcz_store.cc:276] 0709 12:24:23.790595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:23.791035 (+   440us) service_pool.cc:224] Handling call
0709 12:24:25.681277 (+1890242us) spinlock_profiling.cc:243] Waited 64.9 ms on lock 0x7b540060fc54. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b5b853 00007f5d9eb2960a 00007f5d980af7d4 00007f5d980af762 00007f5d980af691 00007f5d980af60c 00007f5d980ae8c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:25.681362 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":149235072}
W20260709 12:24:25.675947 25681 rpcz_store.cc:269] 0709 12:24:23.915903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:23.916082 (+   179us) service_pool.cc:224] Handling call
0709 12:24:25.584960 (+1668878us) spinlock_profiling.cc:243] Waited 9 ms on lock 0x7b54002648d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:25.675306 (+ 90346us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20699008}
I20260709 12:24:25.702389 29054 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:25.692251 25831 rpcz_store.cc:269] 0709 12:24:22.213414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.215404 (+  1990us) service_pool.cc:224] Handling call
0709 12:24:25.602421 (+3387017us) spinlock_profiling.cc:243] Waited 337 ms on lock 0x7b54001b1554. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:25.690038 (+ 87617us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":775909248}
W20260709 12:24:25.671476 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 145826us
I20260709 12:24:25.677847 28824 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:25.684510 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 127445us
I20260709 12:24:25.556380 29059 consensus_queue.cc:1059] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:24:25.685039 29020 raft_consensus.cc:3055] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:25.697082 28674 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:25.685238 28911 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:25.685479 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:25.681356 29056 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:25.675418 25828 rpcz_store.cc:276] 0709 12:24:23.914503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:24.393264 (+478761us) service_pool.cc:224] Handling call
0709 12:24:25.659611 (+1266347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:25.672841 (+ 13230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:25.674824 (+  1983us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54001b1550. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b608ad 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:25.674957 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2874522368}
I20260709 12:24:25.714876 28911 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:25.687657 26436 raft_consensus.cc:2468] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 8.
W20260709 12:24:25.684592 25684 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51578 (request call id 656) took 1768 ms (client timeout 1669 ms). Trace:
W20260709 12:24:25.691406 28995 log.cc:927] Time spent T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 2.589s	user 0.005s	sys 0.016s
W20260709 12:24:25.716059 25684 rpcz_store.cc:269] 0709 12:24:23.917725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:23.917841 (+   116us) service_pool.cc:224] Handling call
0709 12:24:25.684379 (+1766538us) spinlock_profiling.cc:243] Waited 594 ms on lock 0x7b54002481d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:25.684521 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1365538176}
W20260709 12:24:25.717065 25649 connection.cc:256] RPC call timeout handler was delayed by -2.3708314610003072s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1864s for a response
I20260709 12:24:25.717294 28911 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:25.699515 29000 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.080s	user 0.010s	sys 0.008s
I20260709 12:24:25.552897 28890 consensus_queue.cc:1059] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:24:25.592823 28839 consensus_queue.cc:237] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:25.704602 25726 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:25.684655 29052 consensus_queue.cc:1048] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:24:25.704663 28824 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:25.708287 25756 raft_consensus.cc:2468] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 7.
I20260709 12:24:25.711504 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:25.869475 25762 raft_consensus.cc:1275] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:24:25.712304 25801 connection.cc:256] RPC call timeout handler was delayed by -1.122008181000183s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1603s for a response
I20260709 12:24:25.676972 28903 raft_consensus.cc:740] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:25.709494 29020 raft_consensus.cc:740] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
W20260709 12:24:25.659494 29071 log.cc:927] Time spent T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.092s	user 0.000s	sys 0.005s
I20260709 12:24:25.713405 28859 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.713661 26433 raft_consensus.cc:1275] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:24:25.713955 29002 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
W20260709 12:24:25.714272 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:25.713888 28988 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.757316 25836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44218 (request call id 1522) took 3288 ms. Trace:
I20260709 12:24:25.781495 25684 raft_consensus.cc:1240] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 9 LEADER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:25.782903 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:25.783695 25761 raft_consensus.cc:1240] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 LEADER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:25.784590 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:25.786260 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:25.788100 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:25.779165 29046 log.cc:927] Time spent T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.521s	user 0.002s	sys 0.000s
I20260709 12:24:25.843715 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:25.845027 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:25.860162 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:26.025914 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:25.861826 26430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 813) took 2994 ms. Trace:
I20260709 12:24:26.026530 25677 raft_consensus.cc:2468] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 4.
I20260709 12:24:26.026798 26430 rpcz_store.cc:276] 0709 12:24:22.867710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.867861 (+   151us) service_pool.cc:224] Handling call
0709 12:24:22.868233 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:23.688920 (+820687us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:25.791944 (+2103024us) spinlock_profiling.cc:243] Waited 816 ms on lock 0x7b5400333954. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:25.861766 (+ 69822us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1876978048}
I20260709 12:24:25.703790 28849 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:25.711313 26402 leader_election.cc:336] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 1.647s (SENT)
I20260709 12:24:26.031414 26402 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:26.031580 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:26.031893 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:25.718391 28825 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.862898 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:26.034147 25678 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 9.
W20260709 12:24:25.786784 26401 connection.cc:256] RPC call timeout handler was delayed by -1.136976451999999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1956s for a response
I20260709 12:24:25.862905 25685 raft_consensus.cc:1275] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:24:25.863864 25758 raft_consensus.cc:1275] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:24:26.037263 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:26.038034 25758 raft_consensus.cc:2468] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 8.
I20260709 12:24:26.039062 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:24:25.861621 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 153494us
W20260709 12:24:25.864812 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 160285us
W20260709 12:24:26.040759 25650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:25.866274 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:25.705288 29054 consensus_queue.cc:1059] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.148s
I20260709 12:24:25.866423 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:25.867789 25755 raft_consensus.cc:1240] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:24:26.046134 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
W20260709 12:24:25.870641 25801 connection.cc:256] RPC call timeout handler was delayed by -1.0032081810004456s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17350000000000002s for a response
I20260709 12:24:26.047276 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:24:25.863227 29000 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.244s	user 0.010s	sys 0.018s
I20260709 12:24:25.874220 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:26.055435 25759 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 8.
W20260709 12:24:25.875653 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:25.860472 28987 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.880761 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:25.866158 28943 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.013738 28911 raft_consensus.cc:3055] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:25.871685 29059 raft_consensus.cc:2804] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:25.967053 29002 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:25.867034 28927 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:25.987174 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:25.881513 28662 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.085747 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:25.966595 28824 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:24:25.972226 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:26.085405 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
W20260709 12:24:26.087003 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:25.865644 28864 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.880968 25800 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:26.087908 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:24:26.006795 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:26.066879 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:25.862089 28967 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.063792 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:26.024221 26431 raft_consensus.cc:2468] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 6.
I20260709 12:24:26.024976 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:26.022274 25836 rpcz_store.cc:276] 0709 12:24:22.421835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.422050 (+   215us) service_pool.cc:224] Handling call
0709 12:24:22.422472 (+   422us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:22.776456 (+353984us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:22.776497 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:22.791378 (+ 14881us) log.cc:844] Serialized 52 byte log entry
0709 12:24:23.020571 (+229193us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:23.020610 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:25.352162 (+2331552us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b4400022b4c. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db 00007f5d99708aaf 00007f5d996fc86e 00007f5d996fbbb6 00007f5d996fb7d8 00007f5d99705221 00007f5d997051d9 00007f5d99705169
0709 12:24:25.709767 (+357605us) spinlock_profiling.cc:243] Waited 321 ms on lock 0x7b5400117454. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:25.709827 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:25.709871 (+    44us) raft_consensus.cc:1685] finished
0709 12:24:25.709885 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:25.710023 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13786,"raft.queue_time_us":14581,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":22136,"spinlock_wait_cycles":766562560,"thread_start_us":162311,"threads_started":1,"wal-append.queue_time_us":289630}
W20260709 12:24:26.026031 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:26.032581 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 321307us
W20260709 12:24:26.095814 26402 leader_election.cc:336] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 1.669s (SENT)
I20260709 12:24:26.096274 26402 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:26.035684 26401 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:26.035260 28936 raft_consensus.cc:2749] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:26.015672 28859 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:25.870489 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:26.108181 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:26.109295 26402 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:26.109566 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:26.110872 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:26.048552 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:26.056859 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:26.057835 25650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:26.112305 25684 raft_consensus.cc:2468] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 5.
I20260709 12:24:26.085507 25835 raft_consensus.cc:1275] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:26.086018 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:25.969677 28996 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.075964 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:26.105327 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:26.092242 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:26.115458 25679 raft_consensus.cc:2393] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 8: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:26.115629 25649 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:24:26.116113 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:26.093077 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:26.005013 29020 consensus_queue.cc:260] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:24:26.044806 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:26.061297 28911 raft_consensus.cc:740] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
W20260709 12:24:26.103426 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 67827us
I20260709 12:24:26.128235 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:26.046736 28825 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:26.105849 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:26.128898 25684 raft_consensus.cc:2468] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 9.
I20260709 12:24:26.105803 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:26.129218 25836 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:26.130395 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:26.115643 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:26.129937 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:26.132795 25679 raft_consensus.cc:2468] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 9.
W20260709 12:24:26.133176 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:26.110183 26402 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:26.038712 28849 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:26.118141 25837 raft_consensus.cc:1275] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:24:26.119128 25832 raft_consensus.cc:1240] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 7. Current term is 8. Ops: [7.3-7.3]
I20260709 12:24:26.057016 28949 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:26.119824 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:26.136541 25828 raft_consensus.cc:3060] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:26.092232 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 211385us
I20260709 12:24:26.124799 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:26.124919 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:26.103117 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:26.126155 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:26.086856 29059 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:26.105518 28824 raft_consensus.cc:2749] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:26.130275 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:26.115576 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:26.155483 25763 raft_consensus.cc:2468] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 8.
I20260709 12:24:26.094985 29052 raft_consensus.cc:3055] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:26.031176 28988 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:26.142437 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:26.102809 28662 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:26.106495 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:26.145056 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:26.153340 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:26.114874 29021 raft_consensus.cc:2749] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:26.106381 28864 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:26.171104 29021 raft_consensus.cc:2804] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:26.171586 29021 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:26.171968 29021 raft_consensus.cc:3060] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:26.172339 25756 raft_consensus.cc:1240] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:26.173228 28864 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:26.173336 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:26.141054 25677 raft_consensus.cc:3060] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:26.173988 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:26.153097 29059 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:26.174619 25834 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 11.
I20260709 12:24:26.155570 25833 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:26.155797 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:26.176108 25757 raft_consensus.cc:2468] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 5.
I20260709 12:24:26.176352 25683 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 5.
I20260709 12:24:26.120191 28957 raft_consensus.cc:2804] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:26.161346 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:26.087460 28987 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:26.170352 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:26.129215 28996 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:26.171192 25758 raft_consensus.cc:1240] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 7 LEADER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:26.161038 28949 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:26.093693 28943 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:26.134552 28840 raft_consensus.cc:2804] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:26.170069 28689 raft_consensus.cc:2749] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:26.107602 28967 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:26.169723 28849 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:26.165344 25680 raft_consensus.cc:2468] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 8.
I20260709 12:24:26.161550 29052 raft_consensus.cc:740] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:26.178989 25830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44218 (request call id 1545) took 1953 ms. Trace:
I20260709 12:24:26.181627 25836 raft_consensus.cc:2468] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 9.
I20260709 12:24:26.185359 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:26.103631 28927 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:26.193925 25833 raft_consensus.cc:2468] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 10.
I20260709 12:24:26.214773 25828 raft_consensus.cc:2468] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 6.
I20260709 12:24:26.214773 25677 raft_consensus.cc:2468] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 6.
I20260709 12:24:26.233570 25686 raft_consensus.cc:2468] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 8.
I20260709 12:24:26.169463 28859 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:26.238075 25837 raft_consensus.cc:2468] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 8.
I20260709 12:24:26.153311 28839 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:26.231766 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 182542us
I20260709 12:24:26.170137 28825 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:26.178171 25679 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:26.259626 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 123747us
I20260709 12:24:26.143723 28936 consensus_queue.cc:1059] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.092s
I20260709 12:24:26.094722 28903 consensus_queue.cc:260] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:26.371909 25681 raft_consensus.cc:2468] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 7.
I20260709 12:24:26.388181 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:26.408243 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 292688us
I20260709 12:24:26.408712 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:26.410745 25836 raft_consensus.cc:1240] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 6. Current term is 7. Ops: [5.6-6.7]
I20260709 12:24:26.410840 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:26.411154 25684 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 11.
I20260709 12:24:26.412362 25649 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:26.410166 25834 raft_consensus.cc:1240] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:26.412716 25682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51578 (request call id 667) took 1012 ms. Trace:
I20260709 12:24:26.410458 25833 raft_consensus.cc:1240] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:26.413092 25682 rpcz_store.cc:276] 0709 12:24:25.400049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:25.400191 (+   142us) service_pool.cc:224] Handling call
0709 12:24:26.412531 (+1012340us) spinlock_profiling.cc:243] Waited 632 ms on lock 0x7b54002dee54. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:26.412661 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1453926784}
W20260709 12:24:26.402871 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 292731us
I20260709 12:24:26.414116 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:26.409543 25828 raft_consensus.cc:1240] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 6 LEADER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:26.415198 26401 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:26.414724 25682 raft_consensus.cc:2468] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 5.
I20260709 12:24:26.417748 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:26.418215 25649 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:24:26.419093 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 234165us
I20260709 12:24:26.420244 25836 raft_consensus.cc:1275] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:24:26.420617 25836 pending_rounds.cc:85] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a: Aborting all ops after (but not including) 5
I20260709 12:24:26.420852 25836 pending_rounds.cc:107] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:24:26.421080 25836 raft_consensus.cc:2889] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:26.414577 26402 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:24:26.399677 29046 log.cc:927] Time spent T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 12:24:26.181557 28957 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:26.429466 25649 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:26.424819 26401 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:24:26.425587 26402 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:26.430476 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:26.260828 25830 rpcz_store.cc:276] 0709 12:24:24.225752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:24.510661 (+284909us) service_pool.cc:224] Handling call
0709 12:24:24.511094 (+   433us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:24.511526 (+   432us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:24.511563 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:24.523784 (+ 12221us) log.cc:844] Serialized 52 byte log entry
0709 12:24:24.722017 (+198233us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:25.258151 (+536134us) log.cc:844] Serialized 14 byte log entry
0709 12:24:25.260926 (+  2775us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:25.261032 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:25.703226 (+442194us) spinlock_profiling.cc:243] Waited 1.02 ms on lock 0x7b4400022b4c. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db 00007f5d99708aaf 00007f5d996fc86e 00007f5d996fbbb6 00007f5d996fb7d8 00007f5d99705221 00007f5d997051d9 00007f5d99705169
0709 12:24:26.166865 (+463639us) raft_consensus.cc:1685] finished
0709 12:24:26.178746 (+ 11881us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:26.178919 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":120444,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":79,"raft.queue_time_us":39223,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":9127,"spinlock_wait_cycles":2342784,"thread_start_us":537812,"threads_started":2,"wal-append.queue_time_us":542791}
I20260709 12:24:26.432567 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:26.433557 25682 raft_consensus.cc:2393] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 10: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:26.409368 28741 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.365553 28949 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:26.430693 28957 raft_consensus.cc:3060] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:26.437829 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:26.457320 29086 raft_consensus.cc:2749] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:26.468071 25684 raft_consensus.cc:2410] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:24:26.468695 29086 raft_consensus.cc:2804] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:26.429044 29070 raft_consensus.cc:3060] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:26.469132 29086 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:26.469537 29086 raft_consensus.cc:3060] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:26.429540 28825 consensus_queue.cc:1048] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:24:26.471218 28825 raft_consensus.cc:2804] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:26.471828 28825 raft_consensus.cc:697] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 7 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:26.456110 28959 raft_consensus.cc:2749] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:26.473218 28930 consensus_queue.cc:1048] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:24:26.433759 25649 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:26.425997 28839 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:26.475159 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:26.475714 28959 raft_consensus.cc:2804] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:26.475975 25682 raft_consensus.cc:2410] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:24:26.476171 28959 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.476619 28959 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:26.423492 29052 consensus_queue.cc:260] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:26.439481 28936 raft_consensus.cc:2804] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:26.437225 25679 raft_consensus.cc:2468] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 8.
I20260709 12:24:26.472990 28825 consensus_queue.cc:237] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:26.473507 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:26.488656 25678 raft_consensus.cc:2393] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 10: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:26.455459 25680 raft_consensus.cc:2468] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 9.
W20260709 12:24:26.477406 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 43709.8us
I20260709 12:24:26.489877 25680 raft_consensus.cc:1240] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:26.490377 25828 raft_consensus.cc:1240] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:24:26.469388 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:26.444890 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:26.495836 25755 raft_consensus.cc:2468] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 8.
I20260709 12:24:26.467487 28741 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:26.464808 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:26.498518 25683 raft_consensus.cc:2410] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:24:26.466130 29021 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:26.457142 28987 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:26.430373 28859 raft_consensus.cc:2749] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:26.491564 25649 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:26.438563 28662 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:26.438236 29082 consensus_queue.cc:1059] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:24:26.486212 28936 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.449348 28988 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:26.486487 29015 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.493872 25684 raft_consensus.cc:1240] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:26.518833 25684 raft_consensus.cc:1240] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:26.458753 28967 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:26.435119 28943 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:26.503257 25680 raft_consensus.cc:1240] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 12:24:26.520203 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:26.495398 29052 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:26.517468 28936 raft_consensus.cc:3060] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:26.251493 28911 consensus_queue.cc:260] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:26.516346 25683 raft_consensus.cc:1240] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:26.525779 25649 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:24:26.528757 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 82549.1us
I20260709 12:24:26.529659 26402 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:26.530563 25684 raft_consensus.cc:1275] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:24:26.529929 25649 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:26.531220 25683 raft_consensus.cc:1275] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:24:26.532222 25680 raft_consensus.cc:1240] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:26.533731 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:26.533869 25800 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:26.534915 28911 raft_consensus.cc:3060] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:26.530699 28859 raft_consensus.cc:2764] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:24:26.535665 28943 raft_consensus.cc:2804] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:26.563728 28943 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.536211 28741 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:26.536870 29068 raft_consensus.cc:3055] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:26.537307 29059 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:26.498394 28957 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:26.572836 25762 raft_consensus.cc:1240] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:26.574985 25677 raft_consensus.cc:1240] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:26.576769 25677 raft_consensus.cc:1275] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 12. (term mismatch)
I20260709 12:24:26.577198 25677 pending_rounds.cc:85] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc: Aborting all ops after (but not including) 11
I20260709 12:24:26.577523 25677 pending_rounds.cc:107] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 12:24:26.577881 25677 raft_consensus.cc:2889] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:26.539003 29086 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:26.545853 29021 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:26.548207 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:26.527200 28988 raft_consensus.cc:2749] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:26.439616 25801 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:26.551698 28927 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:26.552240 28839 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:26.525220 29015 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:26.505818 29085 consensus_queue.cc:1048] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:24:26.553685 28824 raft_consensus.cc:3055] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:24:26.492805 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 380323us
I20260709 12:24:26.553977 25683 raft_consensus.cc:1240] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 4. Current term is 5. Ops: []
W20260709 12:24:26.554070 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:26.555527 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:26.600205 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:26.600728 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:26.585309 29062 raft_consensus.cc:2804] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:26.559260 29093 raft_consensus.cc:2804] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:26.562099 29020 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:26.562229 26402 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
W20260709 12:24:26.583390 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:26.564133 28943 raft_consensus.cc:3060] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:26.592731 25758 raft_consensus.cc:2393] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 6: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:26.593252 25677 raft_consensus.cc:1240] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:26.593570 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 154022us
I20260709 12:24:26.595160 25833 raft_consensus.cc:1240] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:24:26.546100 29070 raft_consensus.cc:2749] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:26.617522 25677 raft_consensus.cc:1240] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:26.573424 29068 raft_consensus.cc:740] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
W20260709 12:24:26.618002 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:26.601934 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:26.618826 25757 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 11.
I20260709 12:24:26.620193 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:26.621654 25677 raft_consensus.cc:1275] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:24:26.623083 25677 raft_consensus.cc:1275] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:24:26.624506 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 62343.7us
I20260709 12:24:26.625778 26402 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:26.627637 26402 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:26.598409 28824 raft_consensus.cc:740] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:26.652918 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:26.653805 25833 raft_consensus.cc:2393] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 6: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:26.608891 29090 raft_consensus.cc:2804] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:26.658607 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:26.659224 25758 raft_consensus.cc:2468] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 8.
I20260709 12:24:26.655779 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:26.608769 29062 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.655421 25801 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:26.663092 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:26.665832 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:26.660459 25649 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:26.666675 25833 raft_consensus.cc:2468] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 7.
I20260709 12:24:26.666548 25682 raft_consensus.cc:1240] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:26.612528 28948 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:26.675843 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 251051us
I20260709 12:24:26.683374 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:26.683320 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:26.671115 25801 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 1.563s (SENT) [suppressed 17 similar messages]
W20260709 12:24:26.660923 29072 log.cc:927] Time spent T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:24:26.685796 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:26.687085 25837 raft_consensus.cc:1275] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:24:26.620337 29093 raft_consensus.cc:697] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 5 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:26.689911 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:26.631629 28967 raft_consensus.cc:2749] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:26.694046 26431 raft_consensus.cc:1240] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:26.613878 28859 consensus_queue.cc:1048] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
W20260709 12:24:26.698652 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:26.612711 28840 raft_consensus.cc:697] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 7 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:26.612835 28988 consensus_queue.cc:1059] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 12:24:26.685480 28927 raft_consensus.cc:2804] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:24:26.695729 25726 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.003s	sys 0.012s
I20260709 12:24:26.663077 29021 raft_consensus.cc:2749] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:26.667245 29062 raft_consensus.cc:3060] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:26.706876 26438 raft_consensus.cc:1240] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:26.707862 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:26.709139 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:26.709810 26438 raft_consensus.cc:2393] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 7: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:26.710932 26436 raft_consensus.cc:2468] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 7.
I20260709 12:24:26.697055 26432 raft_consensus.cc:1275] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:26.700726 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:26.686872 28949 raft_consensus.cc:2804] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:24:26.704965 25726 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.004s	sys 0.012s
I20260709 12:24:26.689364 29090 raft_consensus.cc:697] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 8 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:26.706148 26435 raft_consensus.cc:1240] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 8 LEADER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:26.706766 29021 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.663188 28657 consensus_queue.cc:1048] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 12:24:26.687856 28957 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:26.713131 25837 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 11.
I20260709 12:24:26.726931 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:26.701654 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:26.713485 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:26.715309 26434 raft_consensus.cc:1240] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 7 LEADER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:26.727836 25683 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 13.
I20260709 12:24:26.727841 26432 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 8.
I20260709 12:24:26.701879 29085 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.661414 28804 consensus_queue.cc:1048] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
W20260709 12:24:26.718195 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 571504us
I20260709 12:24:26.700371 29096 raft_consensus.cc:2804] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:26.730329 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:26.732909 25726 leader_election.cc:336] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Timed out: RequestConsensusVote RPC to 127.23.245.132:35611 timed out after 1.553s (SENT)
W20260709 12:24:26.701092 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 73531.5us
I20260709 12:24:26.729080 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:26.732960 26435 raft_consensus.cc:2468] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 8.
I20260709 12:24:26.712455 28927 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.684058 28959 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:26.739501 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:26.740464 26439 raft_consensus.cc:2393] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 8: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:26.717700 28949 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:26.733474 25726 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:26.737057 26402 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
W20260709 12:24:26.713366 25650 leader_election.cc:336] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Timed out: RequestConsensusVote RPC to 127.23.245.132:35611 timed out after 1.564s (SENT)
I20260709 12:24:26.686545 29092 consensus_queue.cc:1059] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 12:24:26.738039 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:26.737690 25683 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:26.691869 28948 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:26.711647 28824 consensus_queue.cc:260] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:26.759177 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:26.767969 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:26.761883 25650 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:26.764299 26402 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:26.732777 28988 raft_consensus.cc:3055] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:26.724273 28825 consensus_queue.cc:1059] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:24:26.738600 28927 raft_consensus.cc:3060] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:26.726445 29021 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:26.758934 29096 raft_consensus.cc:697] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 7 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:26.700004 29068 consensus_queue.cc:260] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:26.762236 29059 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:26.779850 25726 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:24:26.765043 28949 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:26.766331 28839 raft_consensus.cc:2749] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:24:26.766461 28957 raft_consensus.cc:2804] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:26.781174 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:26.784186 25726 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
W20260709 12:24:26.788868 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 75526.3us
I20260709 12:24:26.775738 28988 raft_consensus.cc:740] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:26.806802 29062 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:26.807216 28988 consensus_queue.cc:260] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:26.808332 28825 raft_consensus.cc:2749] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:26.808455 28988 raft_consensus.cc:3060] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:26.811120 29015 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:26.780040 29090 consensus_queue.cc:237] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:26.812688 28948 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:26.813481 29096 consensus_queue.cc:237] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:26.814726 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:26.778687 28840 consensus_queue.cc:237] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:26.790642 26439 raft_consensus.cc:2393] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 10: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:26.778606 29086 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:26.815855 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:26.788442 28987 raft_consensus.cc:2749] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:26.802035 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:26.848683 25756 raft_consensus.cc:2410] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:24:26.802793 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:26.787874 28957 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:26.791222 29068 raft_consensus.cc:3060] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:26.788636 28824 raft_consensus.cc:3060] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:26.736490 29085 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:26.823007 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:26.795066 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:26.870183 26434 raft_consensus.cc:2468] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 7.
W20260709 12:24:26.834041 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 49912.6us
I20260709 12:24:26.871860 25726 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:26.874735 25726 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:26.876485 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:26.845340 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 54375.2us
I20260709 12:24:26.784197 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:26.864423 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:26.878149 26435 raft_consensus.cc:2393] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 7: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:26.865536 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:26.786509 28890 raft_consensus.cc:2804] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:26.880944 25837 raft_consensus.cc:1275] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:24:26.905140 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:26.881963 25650 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:26.821010 29104 raft_consensus.cc:3055] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:26.819621 28839 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.820672 29021 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:26.819103 28662 raft_consensus.cc:3055] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:26.904413 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:26.920526 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:26.920928 26431 raft_consensus.cc:2468] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 7.
I20260709 12:24:26.921223 25833 raft_consensus.cc:2468] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 8.
I20260709 12:24:26.884558 26430 raft_consensus.cc:2393] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 6: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:26.818470 29059 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.817813 29002 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:26.914875 26435 raft_consensus.cc:1275] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:24:26.864974 28957 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:26.863500 29067 raft_consensus.cc:2749] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:26.915992 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:26.733945 29093 consensus_queue.cc:237] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:26.923933 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:26.915285 28968 raft_consensus.cc:2804] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:26.907670 29056 raft_consensus.cc:2804] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:24:26.963413 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 292323us
I20260709 12:24:26.968036 26435 raft_consensus.cc:1275] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:26.907948 28890 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:26.920109 28657 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.918504 29104 raft_consensus.cc:740] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
W20260709 12:24:26.970209 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 88339.9us
I20260709 12:24:26.981482 26431 raft_consensus.cc:1275] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:24:26.982375 26435 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 7 LEARNER]: Advancing to term 9
I20260709 12:24:26.986403 25650 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:26.991643 28657 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:26.964159 28839 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:26.993310 25683 raft_consensus.cc:1275] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:24:26.995651 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:26.996906 25762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48606 (request call id 800) took 1125 ms. Trace:
I20260709 12:24:27.028344 25762 rpcz_store.cc:276] 0709 12:24:25.871817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:25.871988 (+   171us) service_pool.cc:224] Handling call
0709 12:24:25.872262 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:26.583756 (+711494us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:26.996629 (+412873us) spinlock_profiling.cc:243] Waited 700 ms on lock 0x7b54001a77d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:26.996837 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1610766720}
I20260709 12:24:26.961700 28682 consensus_queue.cc:1059] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.079s
I20260709 12:24:26.962016 28662 raft_consensus.cc:740] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
W20260709 12:24:27.007604 29094 log.cc:927] Time spent T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.244s	user 0.001s	sys 0.000s
I20260709 12:24:27.008319 28903 raft_consensus.cc:3060] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:26.983955 28890 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:27.009228 28959 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:27.013110 25682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40230 (request call id 1473) took 1047 ms. Trace:
I20260709 12:24:27.065456 25682 rpcz_store.cc:276] 0709 12:24:25.965959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:26.476699 (+510740us) service_pool.cc:224] Handling call
0709 12:24:26.476965 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:26.681236 (+204271us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:27.012808 (+331572us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b54002cfbd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:27.013036 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":428801920}
I20260709 12:24:27.015080 26436 raft_consensus.cc:1240] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 8. Current term is 9. Ops: []
W20260709 12:24:27.016521 29105 log.cc:927] Time spent T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:24:27.035567 25756 raft_consensus.cc:1275] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:24:27.074404 26435 raft_consensus.cc:1275] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 9 LEARNER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:24:27.036840 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:27.075454 25757 raft_consensus.cc:2410] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:24:26.964149 28633 consensus_queue.cc:1048] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 12:24:27.037504 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:27.078914 25762 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:26.918699 28741 consensus_queue.cc:1059] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 12:24:27.045574 25833 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:24:27.080191 25833 raft_consensus.cc:606] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Received request to transfer leadership to TS 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:27.080641 25833 raft_consensus.cc:614] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:27.042613 29002 raft_consensus.cc:2749] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:27.046696 25650 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:26.969672 28968 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.982000 29056 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:27.050597 26431 raft_consensus.cc:1275] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:24:27.054368 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:27.096647 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:27.097018 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:27.055953 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:27.100972 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:26.981256 28804 raft_consensus.cc:2749] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:27.009009 29085 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:26.927778 28936 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:26.964356 29054 consensus_queue.cc:1048] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 12:24:27.061322 29092 consensus_queue.cc:1048] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:27.061672 28849 raft_consensus.cc:3055] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:27.056516 28987 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:26.967554 28966 consensus_queue.cc:1059] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 12:24:27.137718 25756 raft_consensus.cc:1275] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:24:27.067991 25801 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:26.967945 29035 consensus_queue.cc:1059] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 12:24:27.078215 25679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40230 (request call id 1474) took 1112 ms. Trace:
I20260709 12:24:27.068140 28927 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:26.966886 29059 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:27.082226 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 318013us
I20260709 12:24:27.082551 25650 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:27.091076 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:27.149286 26439 raft_consensus.cc:2393] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 7: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:27.092693 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:27.102778 25757 raft_consensus.cc:1275] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:24:27.107808 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 144892us
I20260709 12:24:27.110203 29089 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.041910 29067 consensus_queue.cc:1048] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 12:24:27.122527 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:27.153057 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 70589us
I20260709 12:24:27.153206 26436 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 8.
I20260709 12:24:27.077839 28864 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.092011 29015 raft_consensus.cc:2749] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:27.094836 28968 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:27.128269 28849 raft_consensus.cc:740] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:27.092238 29021 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.099800 29056 raft_consensus.cc:3060] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:27.141124 25679 rpcz_store.cc:276] 0709 12:24:25.966233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:26.486659 (+520426us) service_pool.cc:224] Handling call
0709 12:24:26.486914 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:26.487100 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:24:26.672276 (+185176us) log.cc:844] Serialized 14 byte log entry
0709 12:24:27.064965 (+392689us) spinlock_profiling.cc:243] Waited 1.62 ms on lock 0x7b180002cce0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d997094bc 00007f5d96a5748b 00007f5d9f8b19a9 00007f5d96a7369b 00007f5d96a7193f 00007f5d96a73c02 00007f5d996fb20b 00007f5d99700d23 00007f5d9970123a
0709 12:24:27.077912 (+ 12947us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:27.077965 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:27.078006 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:27.078069 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:27.078163 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38696,"prepare.queue_time_us":234041,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":15905,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":15567,"spinlock_wait_cycles":8203904,"thread_start_us":227341,"threads_started":2,"wal-append.queue_time_us":89733}
I20260709 12:24:27.048219 28825 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:27.143639 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 75721.6us
I20260709 12:24:27.144860 26432 raft_consensus.cc:2393] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 8: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:27.130278 29085 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.079468 28943 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:27.128428 29062 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:27.154018 25650 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:27.155961 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:27.193607 26431 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:27.103271 29086 consensus_queue.cc:1059] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:24:27.150646 28741 raft_consensus.cc:3055] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:27.162540 28804 raft_consensus.cc:2749] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:24:27.198195 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 44237us
I20260709 12:24:27.198956 25650 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:27.164338 28966 raft_consensus.cc:3055] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:27.189100 25801 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:27.200058 25650 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:27.186784 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:27.205976 26437 raft_consensus.cc:2468] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 8.
I20260709 12:24:27.139750 28987 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:27.171875 29001 raft_consensus.cc:2749] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:24:27.208189 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:27.122143 29104 consensus_queue.cc:260] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:27.261477 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 61490.3us
I20260709 12:24:27.263762 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:27.167455 29075 consensus_queue.cc:1048] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:24:27.163339 29089 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:27.206316 28912 raft_consensus.cc:2804] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:27.197671 28741 raft_consensus.cc:740] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:27.199870 28948 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:27.274227 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:27.277390 28987 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:27.278615 29059 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:27.166474 28864 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:27.209892 29002 raft_consensus.cc:2804] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:27.212392 29062 raft_consensus.cc:2804] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:27.205106 28966 raft_consensus.cc:740] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:27.209844 25801 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:27.206771 29085 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:27.307029 26431 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 9.
I20260709 12:24:27.188081 29021 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:27.309332 26433 raft_consensus.cc:2468] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 8.
I20260709 12:24:27.265635 28804 raft_consensus.cc:2804] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:27.263855 29082 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
W20260709 12:24:27.308452 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 159164us
I20260709 12:24:27.271785 28849 consensus_queue.cc:260] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:27.297508 29114 log.cc:927] Time spent T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.254s	user 0.000s	sys 0.001s
I20260709 12:24:27.337097 28849 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:27.194164 28825 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:27.337826 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:27.338790 28864 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:27.339506 28825 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:24:27.339687 29119 log.cc:927] Time spent T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:24:27.309888 28996 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:27.337131 26402 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:27.341089 28911 raft_consensus.cc:3055] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:27.341509 28911 raft_consensus.cc:740] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:27.342015 29002 raft_consensus.cc:697] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 10 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:27.342317 28911 consensus_queue.cc:260] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:27.343340 28824 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.336843 29082 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:27.329909 28839 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:27.343791 28682 raft_consensus.cc:3055] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:27.343978 28804 raft_consensus.cc:697] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 9 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:27.344352 28682 raft_consensus.cc:740] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:27.344937 28804 consensus_queue.cc:237] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:27.345387 29021 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:27.345520 29082 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:27.345981 29021 raft_consensus.cc:2749] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:27.347105 29021 consensus_queue.cc:1048] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:27.327062 28912 raft_consensus.cc:697] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 6 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:27.324476 28948 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:27.348759 28912 consensus_queue.cc:237] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:27.350248 28948 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:27.327261 29062 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:27.351806 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:27.352065 29062 raft_consensus.cc:3060] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:27.352221 26437 raft_consensus.cc:1275] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:24:27.333025 28927 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:27.334759 28943 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:27.353425 26402 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
W20260709 12:24:27.353792 28949 consensus_meta.cc:287] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.563s	user 0.009s	sys 0.000s
I20260709 12:24:27.354164 28949 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:27.355389 26435 raft_consensus.cc:1240] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 12:24:27.341944 28890 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:27.149940 28662 consensus_queue.cc:260] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:27.357335 28662 raft_consensus.cc:3060] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:27.358294 28890 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:27.358557 29107 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.359107 29107 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:27.330565 29092 raft_consensus.cc:2749] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:27.360085 29124 raft_consensus.cc:2804] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:24:27.360553 29124 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:27.360917 29124 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:27.362073 26434 raft_consensus.cc:1240] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 12:24:27.341521 28966 consensus_queue.cc:260] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:27.365494 28966 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:27.366855 29089 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:27.354465 28657 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:27.368330 29020 consensus_meta.cc:287] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.755s	user 0.010s	sys 0.000s
I20260709 12:24:27.343001 29002 consensus_queue.cc:237] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:27.370505 28988 consensus_meta.cc:287] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.562s	user 0.006s	sys 0.003s
I20260709 12:24:27.345125 28682 consensus_queue.cc:260] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:27.372565 28682 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:27.356503 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:27.376619 26436 raft_consensus.cc:2393] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 9: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
W20260709 12:24:27.377365 29106 log.cc:927] Time spent T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.411s	user 0.001s	sys 0.000s
I20260709 12:24:27.381134 28957 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:27.382123 28741 consensus_queue.cc:260] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:27.360942 28936 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:27.384935 28741 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:27.388481 26430 raft_consensus.cc:1240] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:27.389628 29124 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:27.330958 29104 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:27.343869 28824 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:27.391743 29124 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:27.393600 28824 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:27.368359 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:27.383162 29120 log.cc:927] Time spent T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:24:27.396016 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:27.409456 28949 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:27.343339 28911 raft_consensus.cc:3060] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:27.391603 29056 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:27.372879 29085 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:27.457157 25582 catalog_manager.cc:5697] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 1 to 3, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 3 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:27.291340 25650 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:24:27.465360 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 173974us
I20260709 12:24:27.466877 25650 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:27.469316 25650 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:27.473165 25650 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:24:27.308933 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 150344us
I20260709 12:24:27.523994 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:27.525063 25836 raft_consensus.cc:2468] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 9.
I20260709 12:24:27.525179 25726 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:24:27.478389 25754 raft_consensus.cc:2410] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
W20260709 12:24:27.478417 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:27.528954 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:27.529695 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:27.530707 25754 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53474 (request call id 2608) took 1559 ms (client timeout 1809 ms). Trace:
I20260709 12:24:27.482435 25760 raft_consensus.cc:2410] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:24:27.319629 25763 raft_consensus.cc:3060] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:27.532804 25761 raft_consensus.cc:1275] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:24:27.533733 25760 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48606 (request call id 804) took 1531 ms (client timeout 1715 ms). Trace:
I20260709 12:24:27.534513 25761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 2614) took 1528 ms. Trace:
W20260709 12:24:27.534233 25760 rpcz_store.cc:269] 0709 12:24:26.002001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:26.024703 (+ 22702us) service_pool.cc:224] Handling call
0709 12:24:27.533431 (+1508728us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54000988d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:27.533665 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3189349760}
I20260709 12:24:27.535038 25761 rpcz_store.cc:276] 0709 12:24:26.006020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:26.154267 (+148247us) service_pool.cc:224] Handling call
0709 12:24:27.532096 (+1377829us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:27.533266 (+  1170us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:27.534286 (+  1020us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b54003a70d0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b608ad 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:27.534417 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3167614848}
W20260709 12:24:27.325735 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 115956us
I20260709 12:24:27.536257 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:27.537319 25760 raft_consensus.cc:2468] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 9.
I20260709 12:24:27.537360 25801 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:27.538655 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:27.537860 25582 catalog_manager.cc:5697] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 3 to 6, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 6 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:27.539485 25760 raft_consensus.cc:2468] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 7.
W20260709 12:24:27.504021 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:27.508283 25757 raft_consensus.cc:1275] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:27.540692 25755 raft_consensus.cc:1275] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 4. (term mismatch)
I20260709 12:24:27.541129 25755 pending_rounds.cc:85] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 3
I20260709 12:24:27.541563 25755 pending_rounds.cc:107] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 3.4
I20260709 12:24:27.540971 25582 catalog_manager.cc:5697] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 7 to 8, leader changed from a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 8 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:24:27.541849 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:27.516180 25837 raft_consensus.cc:1240] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:27.541851 25755 raft_consensus.cc:2889] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:27.542753 25757 raft_consensus.cc:2393] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 6: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:27.518702 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:27.509747 25756 raft_consensus.cc:3055] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:27.520550 25833 raft_consensus.cc:1275] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:27.544107 25756 raft_consensus.cc:740] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:27.521279 25828 raft_consensus.cc:3055] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:27.544462 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:27.544839 25828 raft_consensus.cc:740] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:27.545460 25755 raft_consensus.cc:2468] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 8.
I20260709 12:24:27.545696 25756 consensus_queue.cc:260] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:27.546217 25828 consensus_queue.cc:260] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:27.519650 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:27.522374 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:27.547824 25829 raft_consensus.cc:2468] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 7.
W20260709 12:24:27.532418 25569 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet c87d777e7d64471f988b07272bf2441c with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
W20260709 12:24:27.491317 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:27.547873 25828 raft_consensus.cc:3060] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:27.522855 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:27.510691 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:24:27.549897 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:27.543733 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:27.550293 25759 raft_consensus.cc:2468] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 9.
I20260709 12:24:27.551291 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:27.551455 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:27.552248 25759 raft_consensus.cc:3060] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:27.553202 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:24:27.541985 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:27.517647 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:27.521624 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:27.547560 25756 raft_consensus.cc:3060] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:27.557051 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:27.531201 25754 rpcz_store.cc:269] 0709 12:24:25.971390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:26.044537 (+ 73147us) service_pool.cc:224] Handling call
0709 12:24:27.530400 (+1485863us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54003a70d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:27.530581 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3109091584}
I20260709 12:24:27.546730 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:27.561028 25755 raft_consensus.cc:3060] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:27.560525 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:27.563874 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:27.560400 25761 raft_consensus.cc:1275] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:24:27.564206 25754 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 6.
W20260709 12:24:27.534178 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 61206.9us
I20260709 12:24:27.567721 25801 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:27.568284 25763 raft_consensus.cc:2468] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 9.
I20260709 12:24:27.570580 25759 raft_consensus.cc:2468] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 6.
I20260709 12:24:27.567205 25726 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:24:27.573913 25726 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
W20260709 12:24:27.575232 25800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:27.570694 25801 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
W20260709 12:24:27.577353 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:27.577776 25801 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:27.576674 25582 catalog_manager.cc:5697] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:24:27.579672 25828 raft_consensus.cc:1275] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:24:27.608615 28966 raft_consensus.cc:2749] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:27.615011 28657 raft_consensus.cc:2749] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:27.615226 28968 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:27.585603 25757 raft_consensus.cc:3055] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:27.588912 26402 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:27.618419 28968 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:27.591696 28804 raft_consensus.cc:2749] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:27.592520 28633 raft_consensus.cc:2804] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:27.592707 28864 raft_consensus.cc:2749] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:27.593775 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:27.594008 28840 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.595036 28662 raft_consensus.cc:2804] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:27.595134 28903 raft_consensus.cc:2804] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:27.596283 28988 raft_consensus.cc:2804] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:27.596822 28912 consensus_queue.cc:1048] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:27.597472 28927 consensus_queue.cc:1048] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:27.598914 28943 raft_consensus.cc:2804] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:27.627481 28633 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:27.599867 28948 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:27.600615 28949 raft_consensus.cc:2749] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:27.600430 28996 consensus_queue.cc:1048] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:27.657426 29021 consensus_queue.cc:1048] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:24:27.658177 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 55968.4us
I20260709 12:24:27.654610 28633 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:27.668241 25762 consensus_meta.cc:287] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.587s	user 0.005s	sys 0.014s
I20260709 12:24:27.668833 25762 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 9.
I20260709 12:24:27.672287 28959 consensus_queue.cc:1048] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:27.621027 26402 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:24:27.673818 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 52932.8us
I20260709 12:24:27.675025 29116 raft_consensus.cc:2804] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:27.589800 26431 raft_consensus.cc:2468] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 8.
I20260709 12:24:27.626113 28824 raft_consensus.cc:2804] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:27.677109 28824 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:27.677407 25755 raft_consensus.cc:2468] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 9.
I20260709 12:24:27.677572 28824 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:27.678092 29111 raft_consensus.cc:3055] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:27.678534 29111 raft_consensus.cc:740] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:27.626559 25757 raft_consensus.cc:740] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:27.680280 29130 consensus_queue.cc:1048] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:27.680843 25757 consensus_queue.cc:260] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:27.682098 25757 raft_consensus.cc:3060] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:27.643709 28903 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:27.682710 28903 raft_consensus.cc:3060] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:27.683104 29093 consensus_queue.cc:1048] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:24:27.628328 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 48618.1us
I20260709 12:24:27.638533 25759 raft_consensus.cc:2468] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 9.
I20260709 12:24:27.575748 25726 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:27.644030 28988 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:27.685837 28988 raft_consensus.cc:3060] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:27.686255 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 110758us
I20260709 12:24:27.686889 29001 consensus_queue.cc:1048] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:24:27.654760 28943 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:27.688406 25726 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:27.579435 25582 catalog_manager.cc:5697] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } }
I20260709 12:24:27.647622 25756 raft_consensus.cc:1275] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
W20260709 12:24:27.644647 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:27.643472 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 77452.1us
I20260709 12:24:27.652261 28840 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:27.653955 28662 raft_consensus.cc:697] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 9 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:27.603299 28957 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:27.688488 28943 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:27.704784 28662 consensus_queue.cc:237] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:27.708199 28949 consensus_queue.cc:1048] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:24:27.709718 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:27.675540 29116 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:27.649500 29107 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:27.675567 26402 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:27.689405 25756 pending_rounds.cc:85] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 6
W20260709 12:24:27.700523 25584 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41224 (request call id 334) took 16403 ms (client timeout 15000 ms). Trace:
I20260709 12:24:27.702674 29092 consensus_queue.cc:1059] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:27.682114 29130 consensus_queue.cc:1048] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:24:27.713963 25831 raft_consensus.cc:2410] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:24:27.715641 25756 pending_rounds.cc:107] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:24:27.718349 25756 raft_consensus.cc:2889] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:27.714018 25800 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:27.721664 25650 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:27.716881 25582 catalog_manager.cc:5697] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:24:27.715613 29116 raft_consensus.cc:3060] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:27.715194 28966 raft_consensus.cc:2749] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:27.729117 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:27.729176 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 152255us
I20260709 12:24:27.728569 28849 raft_consensus.cc:2804] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:27.730571 29020 raft_consensus.cc:2749] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:27.732158 25677 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
mode: GRACEFUL
new_leader_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:49108
I20260709 12:24:27.729266 28957 raft_consensus.cc:2749] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:27.736380 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:27.734400 25582 catalog_manager.cc:5697] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 6 to 8, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 8 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:27.738303 25582 catalog_manager.cc:5697] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 4 to 5, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 5 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:27.733240 28849 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
W20260709 12:24:27.740146 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 64684.8us
I20260709 12:24:27.740398 28849 raft_consensus.cc:3060] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:27.679653 29111 consensus_queue.cc:260] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:27.754364 25757 raft_consensus.cc:1275] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:24:27.743996 25582 catalog_manager.cc:5697] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:27.751318 25677 raft_consensus.cc:606] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Received request to transfer leadership to TS 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:27.760509 25677 raft_consensus.cc:614] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:27.766264 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:27.767123 25759 raft_consensus.cc:2468] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 6.
I20260709 12:24:27.754904 25757 pending_rounds.cc:85] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 6
I20260709 12:24:27.772153 25800 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:27.772161 25582 catalog_manager.cc:5697] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 3 to 6, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 6 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:27.773193 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:27.773830 25763 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 4.
W20260709 12:24:27.773938 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:27.774302 25582 catalog_manager.cc:5697] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 8 to 9, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 9 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } }
I20260709 12:24:27.776857 25755 raft_consensus.cc:1240] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
W20260709 12:24:27.786002 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 125510us
I20260709 12:24:27.789419 25757 pending_rounds.cc:107] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:24:27.789876 25757 raft_consensus.cc:2889] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:27.734869 28949 consensus_queue.cc:1048] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:24:27.765853 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:24:27.791193 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 73315.8us
I20260709 12:24:27.789041 29092 raft_consensus.cc:2804] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:27.793639 29092 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:27.794060 29092 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:27.794283 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:27.801692 26402 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:27.795416 26401 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:27.806891 25800 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
W20260709 12:24:27.807773 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 94234.3us
I20260709 12:24:27.804572 25649 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:24:27.715723 25584 rpcz_store.cc:269] 0709 12:24:11.285504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.285702 (+   198us) service_pool.cc:224] Handling call
0709 12:24:27.689054 (+16403352us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:19.879690 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:19.912626 (+ 32936us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:19.912685 (+    59us) write_op.cc:435] Acquired schema lock
0709 12:24:19.912703 (+    18us) tablet.cc:662] Decoding operations
0709 12:24:19.914099 (+  1396us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:19.914176 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:19.914200 (+    24us) tablet.cc:685] Acquiring locks for 16 operations
0709 12:24:19.915454 (+  1254us) tablet.cc:701] Row locks acquired
0709 12:24:19.915512 (+    58us) write_op.cc:260] PREPARE: finished
0709 12:24:19.915675 (+   163us) write_op.cc:270] Start()
0709 12:24:19.915824 (+   149us) write_op.cc:276] Timestamp: P: 1783599859915601 usec, L: 0
0709 12:24:19.915844 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:24:20.142981 (+227137us) log.cc:844] Serialized 6484 byte log entry
0709 12:24:21.763549 (+1620568us) op_driver.cc:464] REPLICATION: finished
0709 12:24:22.187975 (+424426us) write_op.cc:301] APPLY: starting
0709 12:24:22.195127 (+  7152us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:22.414010 (+218883us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:22.429815 (+ 15805us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:22.757166 (+327351us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:22.757431 (+   265us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 12:24:22.757474 (+    43us) write_op.cc:312] APPLY: finished
0709 12:24:22.891964 (+134490us) log.cc:844] Serialized 113 byte log entry
0709 12:24:23.083654 (+191690us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:23.094804 (+ 11150us) write_op.cc:454] Released schema lock
0709 12:24:23.100066 (+  5262us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:23.292347 (+192281us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:23.338155 (+ 45808us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":356,"reported_tablets":31,"child_traces":[["op",{"apply.queue_time_us":398521,"apply.run_cpu_time_us":34055,"apply.run_wall_time_us":967257,"num_ops":16,"prepare.queue_time_us":515996,"prepare.run_cpu_time_us":55175,"prepare.run_wall_time_us":653940,"raft.queue_time_us":497852,"raft.run_cpu_time_us":20858,"raft.run_wall_time_us":307684,"replication_time_us":1824872,"thread_start_us":1183929,"threads_started":5,"wal-append.queue_time_us":1195722,"wal-append.run_cpu_time_us":41646,"wal-append.run_wall_time_us":2974227}]]}
I20260709 12:24:27.819543 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:27.817656 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:24:27.827382 26401 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:24:27.831092 29117 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.831740 29117 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:27.832881 28657 raft_consensus.cc:3055] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:27.833055 29136 raft_consensus.cc:2804] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:27.833411 28657 raft_consensus.cc:740] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:27.833748 29136 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:27.834232 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:27.821106 29056 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:27.834784 29117 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:27.826416 29070 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.821918 28849 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:27.835723 29070 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:27.834789 28657 consensus_queue.cc:260] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:27.838595 29070 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:27.839485 28657 raft_consensus.cc:3060] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:27.840258 25582 catalog_manager.cc:5697] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 4 to 5, leader changed from a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 5 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:27.842275 25582 catalog_manager.cc:5697] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 2 to 6, leader changed from a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 6 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:27.844296 29055 raft_consensus.cc:2804] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:27.844988 29130 raft_consensus.cc:2804] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:27.819402 28948 raft_consensus.cc:2749] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:27.845389 29130 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:27.845795 29130 raft_consensus.cc:3060] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:27.846074 28987 raft_consensus.cc:2804] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:27.847306 28987 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:27.847939 28987 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:27.852595 25649 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:27.848553 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:27.834275 29136 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:27.859526 25757 raft_consensus.cc:1240] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:27.861224 25756 raft_consensus.cc:1275] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:24:27.862763 26438 raft_consensus.cc:1240] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:24:27.854229 25726 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:27.877229 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:27.878368 26433 raft_consensus.cc:2393] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 7: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:27.880615 28967 raft_consensus.cc:2804] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:27.848532 29111 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:27.880995 26434 raft_consensus.cc:1275] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:27.883194 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:27.846822 28849 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:27.881301 28957 consensus_queue.cc:1048] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 12:24:27.895321 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:27.881088 28967 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:27.889673 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 73013.3us
I20260709 12:24:27.846637 28824 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:27.853719 29055 raft_consensus.cc:697] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 9 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:27.905258 25582 catalog_manager.cc:5697] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 3 to 6, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 6 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:24:27.910244 25582 catalog_manager.cc:5697] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 4 to 5, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 5 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } }
I20260709 12:24:27.902201 28967 raft_consensus.cc:3060] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:27.918171 26432 raft_consensus.cc:2393] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 10: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:27.920396 28741 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:27.921239 28911 consensus_meta.cc:287] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.503s	user 0.009s	sys 0.003s
I20260709 12:24:27.920806 25582 catalog_manager.cc:5697] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:24:27.912664 28927 raft_consensus.cc:2804] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:27.922163 28927 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:27.922564 28927 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:27.922500 25582 catalog_manager.cc:5697] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 4 to 9, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 9 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
W20260709 12:24:27.924612 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 108460us
I20260709 12:24:27.887779 28662 consensus_queue.cc:1048] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:24:27.917126 28959 consensus_queue.cc:1048] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:27.896872 28633 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:27.927776 29142 log.cc:927] Time spent T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
W20260709 12:24:27.934957 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 113091us
I20260709 12:24:27.931331 25582 catalog_manager.cc:5697] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 3 to 7, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 7 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:24:27.940593 29092 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:27.912732 28949 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
W20260709 12:24:27.942559 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:27.947271 25582 catalog_manager.cc:5697] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } }
I20260709 12:24:27.932344 28957 consensus_queue.cc:1059] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:24:27.952047 25582 catalog_manager.cc:5697] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 4 to 7, leader changed from a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 7 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:27.930256 28959 consensus_queue.cc:1243] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer 6e673265293d4e9a937dc45150aeb1b8 log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 12:24:27.954953 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:27.932410 28840 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:27.954046 25755 raft_consensus.cc:1240] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:24:27.955160 29107 consensus_queue.cc:1048] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:24:27.962970 29136 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:27.964614 28957 raft_consensus.cc:3055] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:27.967391 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:27.967751 28840 consensus_queue.cc:1059] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:27.968920 29089 consensus_queue.cc:1048] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:27.932257 29055 consensus_queue.cc:237] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:27.970960 25801 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:24:27.972055 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:27.972306 29130 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:27.973794 25835 raft_consensus.cc:1275] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:24:27.975188 25832 raft_consensus.cc:1240] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:27.975929 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:27.986547 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:27.973811 28824 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:27.988971 28948 raft_consensus.cc:2804] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:27.986750 25582 catalog_manager.cc:5697] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:24:27.978482 28957 raft_consensus.cc:740] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:27.989470 28948 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:27.951493 28943 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:27.996824 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:27.997473 25828 raft_consensus.cc:2468] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 8.
W20260709 12:24:27.998673 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:27.998862 28911 consensus_queue.cc:1048] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:28.000242 29136 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:27.998872 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 64134.2us
I20260709 12:24:27.967409 28903 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:28.006002 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:28.009153 25755 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:28.006503 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:28.007022 29107 consensus_queue.cc:1059] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:27.994202 28948 raft_consensus.cc:3060] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:28.010394 29062 consensus_meta.cc:287] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.584s	user 0.012s	sys 0.000s
W20260709 12:24:28.013206 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:28.020543 29062 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:28.021440 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:28.021011 26438 raft_consensus.cc:3060] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:24:28.022855 29062 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:27.990486 28957 consensus_queue.cc:260] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:28.024551 29086 raft_consensus.cc:3055] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:28.024956 29086 raft_consensus.cc:740] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:28.025023 28957 raft_consensus.cc:3060] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:28.026121 29086 consensus_queue.cc:260] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:28.027388 29086 raft_consensus.cc:3060] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:28.032159 28927 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:28.034633 28927 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:28.037037 29116 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:28.038560 26436 raft_consensus.cc:2393] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 8: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:27.979209 28949 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:28.040439 29104 consensus_meta.cc:287] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.649s	user 0.002s	sys 0.012s
W20260709 12:24:28.041908 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:28.041960 28949 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:28.044040 25755 raft_consensus.cc:2468] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 10.
I20260709 12:24:28.043418 28633 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:28.049510 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:28.049381 28988 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:28.050505 25726 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:28.051828 29092 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:28.052057 28988 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:28.052423 28987 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:28.056984 28987 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:28.049593 26401 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:28.064661 29117 raft_consensus.cc:3060] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:28.066322 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:28.067291 25829 raft_consensus.cc:1275] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:28.048924 28741 raft_consensus.cc:2749] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:28.069067 25800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:28.072538 26438 raft_consensus.cc:2468] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 9.
I20260709 12:24:28.073581 25832 raft_consensus.cc:2393] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 10: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:28.070169 25649 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:28.080386 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:28.081292 25759 raft_consensus.cc:3060] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:28.085780 25831 raft_consensus.cc:1240] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 9 LEADER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:24:28.088934 28633 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.089254 26434 raft_consensus.cc:1240] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 9 LEARNER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:28.089569 28633 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:28.091288 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 74307.3us
I20260709 12:24:28.097020 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:28.102998 28987 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:28.104971 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:28.077714 29107 raft_consensus.cc:2804] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:28.107715 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:28.073865 28988 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:28.113693 26431 raft_consensus.cc:1240] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:28.116477 26433 raft_consensus.cc:1240] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:28.077534 28824 consensus_queue.cc:1048] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:24:28.121429 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:28.123929 25757 raft_consensus.cc:2393] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 10: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:28.119264 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:28.077363 29021 consensus_queue.cc:1059] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 12:24:28.123807 26430 raft_consensus.cc:2468] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 6.
W20260709 12:24:28.122291 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 133720us
W20260709 12:24:28.125667 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:28.138180 25759 raft_consensus.cc:2468] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 7.
I20260709 12:24:28.141474 26438 raft_consensus.cc:2468] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 6.
W20260709 12:24:28.145383 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:28.145598 25649 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:28.120993 28927 raft_consensus.cc:2804] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:28.143314 25832 raft_consensus.cc:2468] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 6.
W20260709 12:24:28.149379 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:28.113128 29055 consensus_queue.cc:1059] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
W20260709 12:24:28.154676 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 64287.6us
I20260709 12:24:28.132673 29107 raft_consensus.cc:697] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 10 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
W20260709 12:24:28.160341 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 49801.3us
I20260709 12:24:28.158601 25800 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:28.116750 28949 consensus_queue.cc:1048] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:24:28.163830 25801 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:28.172576 25649 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:28.174605 25833 raft_consensus.cc:1275] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:24:28.176470 25829 raft_consensus.cc:1240] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:24:28.180545 29130 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:28.134804 28988 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:28.183493 25837 raft_consensus.cc:1275] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:24:28.180685 25830 raft_consensus.cc:1240] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 5. Current term is 7. Ops: []
I20260709 12:24:28.184633 26432 raft_consensus.cc:2410] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:24:28.186852 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:28.143738 28987 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:28.159560 29136 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.174338 28927 raft_consensus.cc:697] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 6 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
W20260709 12:24:28.196650 29139 log.cc:927] Time spent T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
I20260709 12:24:28.196914 29136 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:28.196121 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:28.198586 25829 raft_consensus.cc:2468] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 8.
I20260709 12:24:28.201933 25833 raft_consensus.cc:1275] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:24:28.202066 25832 raft_consensus.cc:1275] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:24:28.148296 28948 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:28.197443 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:28.183974 28912 raft_consensus.cc:2804] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:28.206900 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:28.207202 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:28.206668 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:28.212381 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:28.205334 25758 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 4.
I20260709 12:24:28.213506 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:28.206897 29070 raft_consensus.cc:2804] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:28.214799 25677 raft_consensus.cc:2410] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:24:28.214730 29070 raft_consensus.cc:697] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 9 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:28.216538 26430 raft_consensus.cc:2393] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 9: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:28.208237 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:28.198897 29111 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:28.203091 29001 raft_consensus.cc:2804] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:28.233448 29070 consensus_queue.cc:237] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:28.234754 25758 raft_consensus.cc:1240] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 6. Current term is 7. Ops: []
W20260709 12:24:28.235332 29144 log.cc:927] Time spent T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 12:24:28.234704 29145 log.cc:927] Time spent T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 12:24:28.236552 29148 log.cc:927] Time spent T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:24:28.212190 28943 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:28.212366 28633 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:28.244258 29136 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:28.219329 29055 raft_consensus.cc:2804] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:28.251027 26431 raft_consensus.cc:2393] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 9: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:28.253361 25830 raft_consensus.cc:1240] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:28.252660 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:24:28.258399 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:28.248471 25837 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:28.220678 29130 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:28.237941 28988 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:28.262639 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:28.264572 26438 raft_consensus.cc:1275] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:24:28.245103 29086 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:28.197515 28927 consensus_queue.cc:237] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:28.268745 28912 raft_consensus.cc:697] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 9 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:28.276515 28912 consensus_queue.cc:237] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:28.278142 29146 log.cc:927] Time spent T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:24:28.279850 29130 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:28.280514 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:28.250018 29001 raft_consensus.cc:697] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 7 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:28.247529 28903 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:28.284598 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 129189us
I20260709 12:24:28.223436 29111 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:28.262440 29055 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:28.266062 29136 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:28.303984 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:28.219779 28967 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:28.247262 29128 consensus_queue.cc:1048] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:24:28.313753 25801 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:28.313931 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:28.310797 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:28.314613 25761 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:28.314468 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:28.318017 25763 raft_consensus.cc:1275] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:24:28.313320 25754 pending_rounds.cc:85] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 5
I20260709 12:24:28.320564 25754 pending_rounds.cc:107] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:24:28.320901 25754 raft_consensus.cc:2889] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:28.305899 29055 raft_consensus.cc:3060] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:28.326066 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:28.334079 25760 raft_consensus.cc:2410] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:24:28.297528 29086 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:28.317615 29130 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:28.337232 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:28.337395 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:28.341351 25682 raft_consensus.cc:1275] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:24:28.341681 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:28.341984 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:28.342890 25683 raft_consensus.cc:2468] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 7.
I20260709 12:24:28.343089 25760 raft_consensus.cc:3055] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:28.343499 25760 raft_consensus.cc:740] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:28.344347 25760 consensus_queue.cc:260] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:28.345343 25760 raft_consensus.cc:3060] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:28.341284 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:28.329692 28662 raft_consensus.cc:2749] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:28.358351 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:28.359025 25763 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:28.281934 29001 consensus_queue.cc:237] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:28.360374 25678 raft_consensus.cc:3060] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:28.366541 29085 raft_consensus.cc:3055] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:28.367002 29085 raft_consensus.cc:740] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:28.370723 25683 raft_consensus.cc:1240] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 12:24:28.272441 29107 consensus_queue.cc:237] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:28.318953 29136 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:28.389752 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:28.391227 25760 raft_consensus.cc:1275] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
W20260709 12:24:28.392365 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:28.392549 25760 pending_rounds.cc:85] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 4
I20260709 12:24:28.392894 25760 pending_rounds.cc:107] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:24:28.393194 25760 raft_consensus.cc:2889] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:28.400583 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 93696us
I20260709 12:24:28.405375 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:28.415899 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:28.425803 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:28.426740 25755 raft_consensus.cc:2393] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 12: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:28.427376 25677 raft_consensus.cc:3060] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:28.429082 25683 raft_consensus.cc:2468] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 5.
I20260709 12:24:28.429373 25682 raft_consensus.cc:1240] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 6 LEADER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 12:24:28.429857 25830 raft_consensus.cc:1275] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:28.403307 28987 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:28.430590 25679 raft_consensus.cc:1240] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:28.432838 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:28.437356 25761 raft_consensus.cc:2468] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 9.
I20260709 12:24:28.416855 28948 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:28.448776 25763 raft_consensus.cc:2410] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:24:28.453613 25678 raft_consensus.cc:2468] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 7.
I20260709 12:24:28.472010 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:28.389731 29085 consensus_queue.cc:260] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:28.475862 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:28.472855 28987 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.472481 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:28.483532 26430 raft_consensus.cc:2468] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 6.
I20260709 12:24:28.481518 25681 raft_consensus.cc:2468] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 4.
I20260709 12:24:28.430799 29154 consensus_queue.cc:1048] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:24:28.460723 28633 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:28.487358 25679 raft_consensus.cc:2376] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 6. Re-sending same reply.
I20260709 12:24:28.491161 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:28.496331 25681 raft_consensus.cc:1240] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 7. Current term is 8. Ops: []
W20260709 12:24:28.498104 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 83332.6us
I20260709 12:24:28.482903 29111 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:28.503643 25682 raft_consensus.cc:2410] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 12:24:28.516077 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:28.491683 29128 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:28.455070 28662 consensus_queue.cc:1048] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
W20260709 12:24:28.521677 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:28.502401 29085 raft_consensus.cc:3060] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:28.524390 29086 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:28.528268 29128 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:28.492933 28987 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:28.519186 28903 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.518333 29082 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.519786 28840 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:28.562798 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:28.522444 28633 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:28.561303 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:28.560259 25681 raft_consensus.cc:1275] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:24:28.562602 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:28.563870 25678 raft_consensus.cc:2393] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 9: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
W20260709 12:24:28.564640 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:28.561847 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:28.566282 25677 raft_consensus.cc:2468] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 7.
I20260709 12:24:28.570048 28903 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:28.570926 28987 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:28.571372 28633 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:28.572399 29157 log.cc:927] Time spent T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:24:28.572546 28903 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:28.574958 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:28.575030 29116 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:28.575187 25650 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
W20260709 12:24:28.576577 29161 log.cc:927] Time spent T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 12:24:28.577097 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:28.577283 29128 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:28.577821 25683 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:28.578053 28967 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:28.579015 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:28.579726 25833 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:28.580266 28849 raft_consensus.cc:3055] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:28.580781 28849 raft_consensus.cc:740] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
W20260709 12:24:28.582170 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:28.589365 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:28.552217 29086 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:28.590067 26430 raft_consensus.cc:3060] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:28.591571 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:28.593508 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:28.624760 25679 raft_consensus.cc:3060] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:28.625092 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 57393.1us
I20260709 12:24:28.626082 25683 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 14.
I20260709 12:24:28.626344 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:28.593564 25726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:28.567225 28957 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.567408 29136 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:28.626426 25801 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:28.630045 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:28.592746 28959 raft_consensus.cc:2749] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:28.637274 25830 raft_consensus.cc:2393] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 8: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
W20260709 12:24:28.635963 29117 consensus_meta.cc:287] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.559s	user 0.007s	sys 0.003s
I20260709 12:24:28.641855 25837 raft_consensus.cc:2468] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 6.
I20260709 12:24:28.641855 26430 raft_consensus.cc:2468] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 9.
I20260709 12:24:28.644754 25801 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:28.584257 28840 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:28.627171 28903 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.648154 29167 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.648329 26432 raft_consensus.cc:1240] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:28.648439 29147 raft_consensus.cc:3060] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:28.640516 29086 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:28.645419 29117 raft_consensus.cc:2749] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:24:28.652693 29166 log.cc:927] Time spent T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:24:28.581871 29082 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:28.687107 25754 raft_consensus.cc:1240] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:28.671962 25681 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 6.
W20260709 12:24:28.679811 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:28.679956 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:28.690614 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:28.686527 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:28.681792 25757 raft_consensus.cc:1240] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:28.679252 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:28.695896 29086 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:28.677527 29167 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:28.701910 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 126815us
I20260709 12:24:28.704175 25762 raft_consensus.cc:1240] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:28.677204 28903 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:28.705425 25686 raft_consensus.cc:1240] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 6 LEADER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:24:28.706353 28903 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:28.678175 28657 raft_consensus.cc:2764] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 12:24:28.708489 29151 log.cc:927] Time spent T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.521s	user 0.003s	sys 0.000s
I20260709 12:24:28.713541 25833 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 12.
I20260709 12:24:28.635701 28957 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:28.710543 25650 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
W20260709 12:24:28.718320 29149 log.cc:927] Time spent T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.555s	user 0.003s	sys 0.000s
I20260709 12:24:28.720078 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:28.720821 25757 raft_consensus.cc:1275] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:24:28.721120 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:28.721664 25835 raft_consensus.cc:2468] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 6.
I20260709 12:24:28.722399 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:28.722668 26402 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:28.723809 29086 raft_consensus.cc:2749] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:24:28.727700 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:28.732224 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 87533us
I20260709 12:24:28.735536 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:28.736526 26438 raft_consensus.cc:2393] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 5: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:28.737536 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:28.741722 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:28.741602 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:28.744755 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:28.716436 29136 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.761443 26431 raft_consensus.cc:1240] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:24:28.636580 28849 consensus_queue.cc:260] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:28.752429 26402 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:28.753208 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:28.751040 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:28.749264 25679 raft_consensus.cc:2468] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 8.
I20260709 12:24:28.763199 26402 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:28.764505 25677 raft_consensus.cc:1240] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 12:24:28.768289 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 57828.1us
I20260709 12:24:28.749926 28959 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.804215 29055 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:28.804544 28959 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:28.806500 28959 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:28.807096 29136 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:28.809235 29136 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:28.768366 29127 raft_consensus.cc:2804] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:28.810047 29127 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:28.810410 29127 raft_consensus.cc:3060] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:28.814035 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:28.816747 28957 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:28.820272 25681 raft_consensus.cc:1240] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:28.820647 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:28.821229 25680 raft_consensus.cc:3060] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:28.821612 25650 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:28.824116 28849 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:28.824321 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:28.825230 25678 raft_consensus.cc:2393] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 12: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:28.825944 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:28.826668 25678 raft_consensus.cc:2410] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:24:28.827332 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:28.828491 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:28.829272 25684 raft_consensus.cc:2468] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 6.
I20260709 12:24:28.829998 25680 raft_consensus.cc:2468] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 9.
I20260709 12:24:28.830703 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:28.830945 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:28.831401 25685 raft_consensus.cc:2368] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 8. Current term is 9.
I20260709 12:24:28.831485 25680 raft_consensus.cc:2376] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 9. Re-sending same reply.
I20260709 12:24:28.832361 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:28.833252 25685 raft_consensus.cc:2368] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 8. Current term is 9.
I20260709 12:24:28.750510 28912 raft_consensus.cc:2749] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:28.836056 26437 raft_consensus.cc:1275] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:24:28.836575 26437 pending_rounds.cc:85] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89: Aborting all ops after (but not including) 7
I20260709 12:24:28.836846 26437 pending_rounds.cc:107] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:24:28.837107 26437 raft_consensus.cc:2889] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:28.752207 29117 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.842851 25726 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:28.851877 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:28.852862 25679 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:28.830080 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:28.866446 25678 raft_consensus.cc:2393] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 8: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:28.892865 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:28.895262 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:28.898594 26434 raft_consensus.cc:3060] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:28.768067 29128 raft_consensus.cc:2749] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:28.904728 26438 raft_consensus.cc:1240] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:28.840255 29117 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:28.910423 25679 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 10.
W20260709 12:24:28.915160 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 150622us
I20260709 12:24:28.917470 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:28.891490 28903 raft_consensus.cc:2749] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:28.892817 29167 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:28.906205 29162 log.cc:927] Time spent T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:24:28.922271 25684 raft_consensus.cc:2393] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 6: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
W20260709 12:24:28.951757 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:28.958087 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 134265us
I20260709 12:24:28.966164 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:28.971727 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 55846.4us
I20260709 12:24:28.974047 25801 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
W20260709 12:24:28.984620 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 88935.8us
I20260709 12:24:28.996145 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:29.005934 25684 raft_consensus.cc:2410] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 12:24:29.007652 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:29.008749 25679 raft_consensus.cc:2393] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 12: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
W20260709 12:24:29.016191 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:29.003228 29147 raft_consensus.cc:2749] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:29.026068 26434 raft_consensus.cc:2468] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 8.
I20260709 12:24:29.022231 29062 raft_consensus.cc:3055] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:24:29.031683 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 50811.3us
I20260709 12:24:29.029531 29062 raft_consensus.cc:740] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:29.033401 29062 consensus_queue.cc:260] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:29.034581 29062 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:29.036550 29173 log.cc:927] Time spent T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 12:24:29.030800 29179 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.039327 29179 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:28.841920 28949 consensus_queue.cc:1175] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6e673265293d4e9a937dc45150aeb1b8" responder_term: 7 status { last_received { term: 6 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 6. Current term is 7. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:24:29.041512 29179 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:24:29.044399 29171 log.cc:927] Time spent T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 12:24:29.053222 26432 raft_consensus.cc:2468] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 10.
I20260709 12:24:29.053222 25681 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 6.
I20260709 12:24:29.028497 29154 raft_consensus.cc:2749] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:29.066347 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:29.090760 28633 consensus_queue.cc:1048] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:29.091563 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:29.099110 25684 raft_consensus.cc:1240] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:24:29.061928 29127 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:29.106354 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 138332us
I20260709 12:24:29.108270 25726 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:29.108984 25650 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:29.077888 29136 consensus_queue.cc:1048] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:24:29.089470 28959 consensus_queue.cc:1048] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:24:29.116108 28988 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:29.115962 29184 consensus_queue.cc:1059] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:24:29.118150 29179 consensus_queue.cc:1048] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:29.121906 25681 raft_consensus.cc:1240] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:29.115540 25801 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:29.122857 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:29.125236 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:29.126076 29177 log.cc:927] Time spent T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 12:24:29.128067 29107 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.128192 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:29.112697 28633 raft_consensus.cc:2764] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:24:29.100778 29135 consensus_queue.cc:1048] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:24:29.128656 29107 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:29.129781 29179 raft_consensus.cc:2749] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:29.132207 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:29.104025 29117 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:29.128816 25679 raft_consensus.cc:3060] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:29.133502 25830 raft_consensus.cc:2468] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 8.
I20260709 12:24:29.139704 25686 raft_consensus.cc:1275] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:24:29.141119 25679 raft_consensus.cc:2468] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 7.
I20260709 12:24:29.142606 25685 raft_consensus.cc:1275] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 12:24:29.142921 25685 pending_rounds.cc:85] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc: Aborting all ops after (but not including) 8
I20260709 12:24:29.143117 25685 pending_rounds.cc:107] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 12:24:29.143302 25685 raft_consensus.cc:2889] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:29.144176 25677 raft_consensus.cc:1275] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:29.151872 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:29.154474 28988 raft_consensus.cc:2749] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:29.163262 29127 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:29.168883 25801 leader_election.cc:400] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 election: Vote denied by peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) with higher term. Message: Invalid argument: T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 8. Current term is 9.
I20260709 12:24:29.169517 25801 leader_election.cc:403] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:24:29.170722 29189 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:29.172401 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 70597.1us
W20260709 12:24:29.172763 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:29.173382 29136 consensus_queue.cc:1059] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:29.174347 29135 consensus_queue.cc:1048] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:29.174849 29136 raft_consensus.cc:3055] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:29.175207 29136 raft_consensus.cc:740] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:29.176028 29136 consensus_queue.cc:260] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:29.176381 29135 consensus_queue.cc:1048] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:29.177243 29136 raft_consensus.cc:3060] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:29.178102 25650 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:29.178828 29135 raft_consensus.cc:2749] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:29.180874 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:29.181421 26430 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 10.
I20260709 12:24:29.183525 28959 consensus_queue.cc:1059] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:29.184826 29135 raft_consensus.cc:3055] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:29.185331 29135 raft_consensus.cc:740] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:29.186406 29135 consensus_queue.cc:260] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:29.173843 25801 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:29.188807 28657 raft_consensus.cc:2749] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:29.188997 25801 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:29.189867 28657 raft_consensus.cc:2749] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:29.190351 25801 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:29.197398 26432 raft_consensus.cc:1275] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:24:29.202769 26433 raft_consensus.cc:1240] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 13. Current term is 14. Ops: []
I20260709 12:24:29.193246 25649 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:29.206970 26430 raft_consensus.cc:1275] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:24:29.209946 28987 raft_consensus.cc:2804] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:29.204526 28959 consensus_queue.cc:1048] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 12:24:29.209734 29117 consensus_queue.cc:1048] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
W20260709 12:24:29.220021 25569 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 5aae9f34f7154346afd482b3183ee180 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5cccf20a8bff46dba6601f241d172b8a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:24:29.221333 28633 consensus_queue.cc:1048] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:29.222571 28657 raft_consensus.cc:2749] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:29.223670 29172 log.cc:927] Time spent T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.373s	user 0.003s	sys 0.000s
W20260709 12:24:29.228065 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 50046.3us
I20260709 12:24:29.230475 29082 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:29.231420 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:29.257365 29092 raft_consensus.cc:3055] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:29.257830 29092 raft_consensus.cc:740] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:29.258734 29189 raft_consensus.cc:2749] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) with higher term. Message: Invalid argument: T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 8. Current term is 9.
I20260709 12:24:29.258641 29092 consensus_queue.cc:260] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:29.268781 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 46415.6us
I20260709 12:24:29.270961 29117 consensus_queue.cc:1048] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:29.272305 28912 raft_consensus.cc:2804] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:29.273772 25726 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:29.273959 28912 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:29.274430 28912 raft_consensus.cc:3060] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:29.275789 25650 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:29.277386 25650 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:29.278363 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:29.279510 28662 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:29.280043 28662 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:29.280072 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:29.284232 29092 raft_consensus.cc:3060] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:29.286983 28988 raft_consensus.cc:2749] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:29.287760 28988 raft_consensus.cc:2804] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:29.288130 28988 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:29.288477 28988 raft_consensus.cc:3060] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:29.289103 25758 raft_consensus.cc:1275] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:24:29.289357 29135 raft_consensus.cc:3060] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:29.290167 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:24:29.292073 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:29.293157 29116 consensus_queue.cc:1048] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:29.296864 25828 raft_consensus.cc:1275] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:24:29.299008 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:29.301662 28840 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:29.306488 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:29.309751 29107 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:29.314172 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:29.282011 28662 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:29.318856 29117 raft_consensus.cc:2804] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:29.313201 29055 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:29.319635 29117 raft_consensus.cc:697] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:29.320894 29117 consensus_queue.cc:237] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:29.322337 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:29.324875 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:29.326388 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:24:29.331025 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 57334.4us
I20260709 12:24:29.332204 25726 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:29.333097 28633 raft_consensus.cc:2804] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:24:29.333756 28633 raft_consensus.cc:697] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:29.334833 28633 consensus_queue.cc:237] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:29.338533 29189 consensus_queue.cc:1048] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:24:29.338979 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 56164.7us
I20260709 12:24:29.340198 25650 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:29.341089 29136 raft_consensus.cc:2749] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:24:29.342327 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 152094us
I20260709 12:24:29.343230 25801 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
W20260709 12:24:29.343457 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:29.344587 25801 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:29.346405 26402 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:29.347486 29107 raft_consensus.cc:2749] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:29.348585 25757 raft_consensus.cc:1275] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:29.353299 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:29.353842 26402 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:29.358597 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:29.359412 25830 raft_consensus.cc:2468] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 7.
I20260709 12:24:29.370255 25828 raft_consensus.cc:2468] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 6.
I20260709 12:24:29.377693 26402 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:29.390823 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:29.391846 25759 raft_consensus.cc:2393] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 10: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:29.394038 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:29.397514 25759 raft_consensus.cc:1275] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:24:29.384299 28741 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:29.400712 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 60641.9us
I20260709 12:24:29.400529 28741 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:29.380545 29055 raft_consensus.cc:2749] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:29.403133 28741 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:29.404321 25758 raft_consensus.cc:1275] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:24:29.404737 25758 pending_rounds.cc:85] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 5
I20260709 12:24:29.405061 25758 pending_rounds.cc:107] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:24:29.405438 25758 raft_consensus.cc:2889] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:29.404361 25755 raft_consensus.cc:1275] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:24:29.406860 26402 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:29.382328 29116 raft_consensus.cc:2804] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:29.409273 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:29.409492 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:24:29.409279 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 201534us
W20260709 12:24:29.411319 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 66831.2us
I20260709 12:24:29.412621 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:29.414964 25760 raft_consensus.cc:2393] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 7: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:29.383109 28662 raft_consensus.cc:2749] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:29.377632 28987 raft_consensus.cc:697] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 9 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:29.388454 29092 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.419504 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:29.423601 25683 raft_consensus.cc:2393] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 8: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:29.395190 28911 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.395252 28957 raft_consensus.cc:2804] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:29.439764 25756 raft_consensus.cc:2393] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 9: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:29.384615 29127 consensus_queue.cc:1048] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:24:29.452775 25650 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:29.435253 29107 raft_consensus.cc:2804] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:29.435550 29116 raft_consensus.cc:697] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 8 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:29.441321 28957 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:29.454713 25726 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:24:29.416522 29179 consensus_queue.cc:1048] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:24:29.473776 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:29.410405 29136 consensus_queue.cc:1059] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 12:24:29.466943 29184 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.488197 29184 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:29.492184 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:29.495774 25763 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 10.
I20260709 12:24:29.442117 28911 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:29.442625 28903 consensus_queue.cc:1048] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 12:24:29.445969 29092 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:29.504351 29092 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:29.504602 29198 raft_consensus.cc:2804] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:29.505210 29198 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:29.505611 29198 raft_consensus.cc:3060] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:29.505281 29116 consensus_queue.cc:237] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:29.506045 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:29.480825 28957 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:29.501358 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 49277.1us
I20260709 12:24:29.514138 25801 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:29.502321 28911 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:24:29.517211 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 97920.6us
I20260709 12:24:29.492213 28633 raft_consensus.cc:2804] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:29.492228 29184 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:24:29.521787 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 79335.2us
I20260709 12:24:29.526495 25800 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
W20260709 12:24:29.526605 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 73919.2us
W20260709 12:24:29.528280 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 121463us
I20260709 12:24:29.504701 29136 raft_consensus.cc:3055] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:29.498556 28987 consensus_queue.cc:237] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:29.555526 25726 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:24:29.522280 28633 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:29.514678 28912 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:29.527686 29179 raft_consensus.cc:2749] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:29.533797 28657 raft_consensus.cc:2804] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:29.535777 29136 raft_consensus.cc:740] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:29.540934 29107 raft_consensus.cc:697] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 6 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:29.580066 25801 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:29.533812 29184 consensus_queue.cc:1059] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 12:24:29.568149 28633 raft_consensus.cc:3060] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:29.527279 28988 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:29.601477 25801 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:29.581287 28657 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:29.582187 29117 raft_consensus.cc:2804] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:29.619185 29184 raft_consensus.cc:3055] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:24:29.625300 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 83513.4us
I20260709 12:24:29.591802 28840 raft_consensus.cc:3060] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:29.580262 28662 consensus_queue.cc:1048] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:24:29.579573 29196 consensus_queue.cc:1048] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 12:24:29.642601 25801 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:24:29.609143 29055 consensus_queue.cc:1048] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.011s
W20260709 12:24:29.644515 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:29.621253 28657 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:29.645989 25801 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:29.575016 29209 consensus_queue.cc:1048] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 12:24:29.647815 25801 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:24:29.621109 29117 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:29.600682 28949 consensus_queue.cc:1048] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:24:29.623782 29184 raft_consensus.cc:740] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:29.575215 29210 consensus_queue.cc:1048] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
W20260709 12:24:29.662281 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:29.638434 29179 raft_consensus.cc:3060] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:29.635154 28948 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:29.659382 29117 raft_consensus.cc:3060] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:29.701874 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 75711.9us
I20260709 12:24:29.773571 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:29.670382 28948 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:29.765106 29092 raft_consensus.cc:2804] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:29.664033 29136 consensus_queue.cc:260] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:29.772331 28849 raft_consensus.cc:2804] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:29.772295 29216 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.777621 28967 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.771775 28911 consensus_queue.cc:1059] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:24:29.780494 28903 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.801249 25763 raft_consensus.cc:1275] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:24:29.701820 29107 consensus_queue.cc:237] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:29.787128 29196 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.782303 28662 raft_consensus.cc:2804] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:29.798175 29092 raft_consensus.cc:697] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 8 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:29.797501 29198 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:29.782060 29184 consensus_queue.cc:260] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:29.841153 25830 raft_consensus.cc:1275] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:29.841396 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:29.842185 25836 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:29.805184 28849 raft_consensus.cc:697] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 10 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:29.856289 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:29.856551 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:29.859829 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:29.822659 28662 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:29.810578 28912 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:29.862983 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:24:29.863795 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 216071us
I20260709 12:24:29.866941 29229 consensus_queue.cc:1048] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:29.868072 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:29.868330 29055 consensus_queue.cc:1048] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:29.868873 25678 raft_consensus.cc:2468] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 6.
I20260709 12:24:29.877908 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:29.878805 25678 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 10.
W20260709 12:24:29.879241 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 98889.1us
I20260709 12:24:29.881860 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:29.891253 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:29.896942 29055 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:29.897790 29055 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:29.901449 29055 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:29.903072 25834 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25bd5658646b41608d707d196c6e0585"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:24:29.830992 28988 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:29.908634 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 109122us
I20260709 12:24:29.908998 29234 raft_consensus.cc:3055] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:29.910400 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:29.910658 25726 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:24:29.912618 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:29.917322 26434 raft_consensus.cc:2393] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 9: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
W20260709 12:24:29.859529 29222 log.cc:927] Time spent T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 12:24:29.800307 29216 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:29.805130 28903 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:29.917805 25726 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:29.920277 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:29.961838 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:29.930421 25830 raft_consensus.cc:2468] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 9.
I20260709 12:24:29.820812 29196 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:29.858536 29210 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.964680 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:29.970045 26434 raft_consensus.cc:1275] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:24:29.970758 25831 raft_consensus.cc:2393] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 12: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:29.937618 28912 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.822992 28967 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:29.964818 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:29.906247 28662 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:30.005847 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:29.825143 28911 consensus_queue.cc:1059] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.091s
W20260709 12:24:29.983902 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 79508.9us
I20260709 12:24:30.005352 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:29.916318 29184 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:29.916702 29234 raft_consensus.cc:740] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
W20260709 12:24:30.011449 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 93717.2us
W20260709 12:24:30.004488 29219 log.cc:927] Time spent T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.227s	user 0.000s	sys 0.001s
W20260709 12:24:30.015684 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 134013us
I20260709 12:24:30.081892 26431 raft_consensus.cc:2393] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 7: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:30.015799 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:30.081950 25726 leader_election.cc:400] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 election: Vote denied by peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) with higher term. Message: Invalid argument: T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 8. Current term is 9.
I20260709 12:24:30.087908 25830 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 10.
I20260709 12:24:30.088196 25726 leader_election.cc:403] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:24:30.091441 26436 raft_consensus.cc:3060] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:30.084950 25801 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:29.973071 29228 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:30.004488 28948 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:30.074625 29218 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.115389 29218 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:30.118352 29135 consensus_queue.cc:1048] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:30.119779 29135 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:30.120352 29135 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:30.122887 29135 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:30.126652 26431 raft_consensus.cc:1240] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:24:30.015391 29231 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.135887 25830 raft_consensus.cc:1240] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:30.089644 29233 raft_consensus.cc:2764] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:24:30.130169 29055 raft_consensus.cc:2749] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:30.091063 28912 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:30.169787 28903 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:30.170161 28967 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:30.171465 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:30.172322 29225 log.cc:927] Time spent T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.315s	user 0.001s	sys 0.000s
I20260709 12:24:30.174708 29216 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:24:30.175448 28657 consensus_meta.cc:287] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.512s	user 0.006s	sys 0.001s
I20260709 12:24:30.179167 29233 raft_consensus.cc:2749] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) with higher term. Message: Invalid argument: T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 8. Current term is 9.
I20260709 12:24:30.087387 29210 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:30.180961 29196 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:30.181627 29230 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.141660 29246 raft_consensus.cc:2804] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:30.136325 29092 consensus_queue.cc:237] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:30.193889 26436 raft_consensus.cc:2468] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 9.
I20260709 12:24:30.141448 29228 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:30.204584 25800 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.002s	sys 0.011s
I20260709 12:24:30.188028 25836 raft_consensus.cc:2468] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 9.
W20260709 12:24:30.207454 25800 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.002s	sys 0.011s
W20260709 12:24:30.207798 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 581131us
I20260709 12:24:30.209041 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:30.143090 28849 consensus_queue.cc:237] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:30.142143 29231 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:30.207131 28633 consensus_meta.cc:287] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.598s	user 0.006s	sys 0.005s
W20260709 12:24:30.218102 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 150951us
W20260709 12:24:30.216697 28840 consensus_meta.cc:287] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.578s	user 0.010s	sys 0.000s
W20260709 12:24:30.219177 29224 log.cc:927] Time spent T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.370s	user 0.001s	sys 0.000s
I20260709 12:24:30.200498 28657 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:30.215869 29198 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:30.218616 29246 raft_consensus.cc:697] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:30.280360 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:30.284296 25830 raft_consensus.cc:2468] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 6.
I20260709 12:24:30.287276 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:30.261261 28949 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:30.269311 28840 raft_consensus.cc:2749] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:30.303047 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 221224us
I20260709 12:24:30.197010 29234 consensus_queue.cc:260] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:30.297049 29226 log.cc:927] Time spent T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.281s	user 0.000s	sys 0.001s
I20260709 12:24:30.210444 29230 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:30.306645 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:30.256889 28633 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:30.304203 28957 consensus_meta.cc:287] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.779s	user 0.012s	sys 0.000s
W20260709 12:24:30.354911 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 48743.7us
I20260709 12:24:30.444981 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:30.445725 25760 raft_consensus.cc:2468] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 6.
I20260709 12:24:30.469311 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:30.457967 26401 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:30.397686 29210 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:30.313768 28949 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
W20260709 12:24:30.510187 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 52344.5us
I20260709 12:24:30.394619 28957 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:30.566121 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 172412us
W20260709 12:24:30.565676 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 483802us
I20260709 12:24:30.569868 25726 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:24:30.570943 25650 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:30.512425 28912 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:30.607335 25760 raft_consensus.cc:3055] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:30.607652 25760 raft_consensus.cc:740] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:30.608659 25760 consensus_queue.cc:260] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:30.617563 25760 raft_consensus.cc:3060] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:30.534554 29236 raft_consensus.cc:2804] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:30.686441 29236 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:30.686978 29236 raft_consensus.cc:3060] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:30.688665 25755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 2652) took 1260 ms. Trace:
I20260709 12:24:30.573014 29198 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.689054 25755 rpcz_store.cc:276] 0709 12:24:29.428552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.428718 (+   166us) service_pool.cc:224] Handling call
0709 12:24:29.429054 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:29.507432 (+ 78378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:29.507466 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:29.508001 (+   535us) log.cc:844] Serialized 26 byte log entry
0709 12:24:29.561662 (+ 53661us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:29.561703 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.688291 (+1126588us) spinlock_profiling.cc:243] Waited 78 ms on lock 0x7b54001dc9d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:30.688334 (+    43us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:30.688378 (+    44us) raft_consensus.cc:1685] finished
0709 12:24:30.688391 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:30.688605 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1936,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":75,"spinlock_wait_cycles":179416448,"thread_start_us":52984,"threads_started":1,"wal-append.queue_time_us":140575}
I20260709 12:24:30.690263 29198 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:30.692624 29198 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:30.620576 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:30.695534 25678 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:30.534778 29250 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:30.634366 29136 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:30.645042 29256 raft_consensus.cc:2804] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:24:30.646410 29249 log.cc:927] Time spent T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.257s	user 0.000s	sys 0.001s
I20260709 12:24:30.714445 25763 raft_consensus.cc:1275] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:24:30.714861 25763 pending_rounds.cc:85] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 3
I20260709 12:24:30.714556 28911 consensus_queue.cc:1059] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:30.715113 25763 pending_rounds.cc:107] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:24:30.715420 25763 raft_consensus.cc:2889] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:30.716204 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:30.716310 28741 raft_consensus.cc:3055] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:24:30.716630 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:30.716746 28741 raft_consensus.cc:740] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:30.717602 28741 consensus_queue.cc:260] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:30.649900 29217 log.cc:927] Time spent T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.881s	user 0.003s	sys 0.000s
W20260709 12:24:30.648538 29238 log.cc:927] Time spent T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.222s	user 0.000s	sys 0.000s
I20260709 12:24:30.720028 29223 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:30.720278 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:30.651489 28949 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:30.720597 29223 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:30.721413 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:30.722918 29223 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:30.651933 29239 consensus_queue.cc:1048] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:24:30.565826 29246 consensus_queue.cc:237] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:30.725348 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:30.725970 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:30.726424 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:30.726543 25759 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:53452
I20260709 12:24:30.727128 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:30.728444 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:30.729117 25757 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:24:30.730345 29179 consensus_meta.cc:287] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 1.032s	user 0.012s	sys 0.000s
I20260709 12:24:30.730765 29179 raft_consensus.cc:2749] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:30.731531 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:30.732491 25761 raft_consensus.cc:1240] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:30.669107 29117 consensus_meta.cc:287] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.907s	user 0.010s	sys 0.000s
I20260709 12:24:30.672013 25801 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:30.674400 29218 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:30.675773 28633 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:30.678891 28957 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:30.680795 29230 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:24:30.686045 28662 consensus_meta.cc:287] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.588s	user 0.006s	sys 0.002s
I20260709 12:24:30.567497 28657 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:30.607087 29184 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:30.709113 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 91935.3us
I20260709 12:24:30.572003 29214 raft_consensus.cc:2804] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:30.713438 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:30.712167 29250 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:30.718006 29220 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:30.726526 25754 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:30.664939 29231 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:30.665512 29228 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:30.727316 25759 raft_consensus.cc:606] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Received request to transfer leadership
I20260709 12:24:30.669517 29243 consensus_queue.cc:1048] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 12:24:30.779441 29220 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:30.786535 29220 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:30.737674 25828 raft_consensus.cc:2468] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 8.
I20260709 12:24:30.727522 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:30.788029 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:30.789158 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:30.568604 29210 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:30.790285 29262 log.cc:927] Time spent T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.065s	user 0.003s	sys 0.000s
I20260709 12:24:30.790617 29210 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:30.747251 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 75357.2us
I20260709 12:24:30.750825 25757 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 11.
W20260709 12:24:30.764566 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:30.777184 29267 consensus_queue.cc:1059] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:24:30.778848 29250 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:30.780638 29234 raft_consensus.cc:3060] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:30.780730 29248 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.784649 25759 raft_consensus.cc:614] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:24:30.707670 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 97675.3us
I20260709 12:24:30.808254 25650 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:30.808933 25754 raft_consensus.cc:2468] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 8.
I20260709 12:24:30.810710 28741 raft_consensus.cc:3060] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:30.811430 29248 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:30.801689 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:30.814502 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:30.810711 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:30.793205 25801 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:30.829134 25754 raft_consensus.cc:2468] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 7.
I20260709 12:24:30.830359 25801 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:30.803490 25800 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:30.760905 29179 raft_consensus.cc:2749] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:30.810804 29267 raft_consensus.cc:3055] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:30.790344 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:30.815299 25757 raft_consensus.cc:2393] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 11: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:30.816641 25650 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:24:30.801213 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:30.768748 29214 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:30.827308 25760 raft_consensus.cc:1275] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 12:24:30.852171 25678 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 11.
W20260709 12:24:30.847563 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 44117.3us
I20260709 12:24:30.883072 25760 pending_rounds.cc:85] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 8
I20260709 12:24:30.883833 25760 pending_rounds.cc:107] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 12:24:30.884514 25760 raft_consensus.cc:2889] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:30.813560 29227 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.892115 25649 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:30.773213 29184 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:30.746634 29117 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:30.834544 28912 raft_consensus.cc:2804] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:30.900802 25828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44202 (request call id 2601) took 1070 ms. Trace:
I20260709 12:24:30.844513 28657 raft_consensus.cc:2804] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:30.846520 26401 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:30.887247 28840 raft_consensus.cc:2749] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:30.814756 29228 consensus_queue.cc:1048] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.074s
I20260709 12:24:30.840961 29267 raft_consensus.cc:740] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:30.765507 28662 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:30.913589 28912 raft_consensus.cc:697] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 9 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:30.911067 25828 rpcz_store.cc:276] 0709 12:24:29.834007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.834187 (+   180us) service_pool.cc:224] Handling call
0709 12:24:30.890892 (+1056705us) spinlock_profiling.cc:243] Waited 874 ms on lock 0x7b5400116054. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:30.891026 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2010386304}
W20260709 12:24:30.921249 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 74859.5us
I20260709 12:24:30.886479 29214 raft_consensus.cc:3060] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:30.887354 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 70836.1us
I20260709 12:24:30.983808 25650 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:24:30.909272 29262 log.cc:927] Time spent T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:24:30.956303 25649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:30.977810 25761 raft_consensus.cc:1240] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:30.901973 29198 raft_consensus.cc:2804] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:30.886633 29001 raft_consensus.cc:2804] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:30.985410 25650 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:30.898289 29260 raft_consensus.cc:2749] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:24:30.921924 29264 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.000850 25834 raft_consensus.cc:606] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 10 LEADER]: Received request to transfer leadership to TS 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:30.921286 29189 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:30.955727 29220 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:31.110661 26402 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.004s	sys 0.021s
W20260709 12:24:31.111285 26402 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.005s	sys 0.021s
I20260709 12:24:30.920636 28657 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:30.986598 29179 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.007305 25650 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:24:30.992255 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 218201us
I20260709 12:24:30.980558 29055 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:31.111620 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 542720us
I20260709 12:24:30.973201 29243 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.897331 29227 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:30.972193 29257 raft_consensus.cc:2804] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:30.992722 29198 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:31.158808 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:31.158804 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:31.045047 29248 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:31.216382 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:31.217621 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:31.218689 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:31.219385 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:31.219713 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:31.113454 28849 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.980845 28987 consensus_queue.cc:1048] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.162s
I20260709 12:24:31.127545 28657 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:31.219434 25830 raft_consensus.cc:2468] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 8.
I20260709 12:24:31.243906 25836 raft_consensus.cc:1275] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:24:31.282505 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:31.222359 25828 raft_consensus.cc:2393] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 9: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
W20260709 12:24:31.186663 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:31.188709 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 181594us
I20260709 12:24:31.226198 26402 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:31.227284 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:30.993934 28957 consensus_queue.cc:1048] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.222s
I20260709 12:24:31.230603 25680 raft_consensus.cc:2393] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 11: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:31.101218 28988 raft_consensus.cc:2749] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:31.231751 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:31.102396 29001 raft_consensus.cc:697] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 11 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:30.982364 29236 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:31.123078 29220 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:31.324678 25650 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:31.212502 29256 raft_consensus.cc:697] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:31.224435 29198 raft_consensus.cc:3060] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:31.221274 29257 raft_consensus.cc:697] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 8 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:31.102638 29264 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:31.124600 29189 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:31.236089 29248 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
W20260709 12:24:31.421927 28633 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.006s	sys 0.045s
W20260709 12:24:31.435566 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 110893us
I20260709 12:24:31.462942 25650 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:31.165066 29179 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:31.215026 29055 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:31.437083 25756 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.025s	sys 0.031s
I20260709 12:24:31.407441 29239 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:31.465106 25756 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.025s	sys 0.032s
I20260709 12:24:31.446288 25837 raft_consensus.cc:1240] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:24:31.399592 29250 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.448653 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:31.460107 25830 raft_consensus.cc:1240] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 7. Current term is 8. Ops: [6.4-7.5]
I20260709 12:24:31.470487 25828 raft_consensus.cc:2468] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 6.
W20260709 12:24:31.431133 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 534412us
I20260709 12:24:31.240725 28849 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:31.176914 29243 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:31.474457 25832 raft_consensus.cc:1240] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 12:24:31.478281 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:31.478931 25833 raft_consensus.cc:2468] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 10.
I20260709 12:24:31.473716 25801 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:31.445322 28988 raft_consensus.cc:2804] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:31.481772 28988 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:31.482193 28988 raft_consensus.cc:3060] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:31.482399 26439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 883) took 1111 ms. Trace:
I20260709 12:24:31.444550 29092 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.500157 29092 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:31.501438 29236 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:31.502244 29092 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:31.502456 29269 log.cc:927] Time spent T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.571s	user 0.001s	sys 0.000s
I20260709 12:24:31.452410 29128 raft_consensus.cc:2749] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:31.515815 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:31.516518 25828 raft_consensus.cc:2468] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 9.
W20260709 12:24:31.462787 28633 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.006s	sys 0.045s
I20260709 12:24:31.488356 25801 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:31.474963 29239 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:31.494006 28849 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:31.494783 29244 raft_consensus.cc:2749] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:31.535544 29240 raft_consensus.cc:2749] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:31.536504 29055 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:24:31.537103 29253 log.cc:927] Time spent T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.822s	user 0.003s	sys 0.008s
I20260709 12:24:31.538070 29288 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:31.537840 29257 consensus_queue.cc:237] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:31.538671 29288 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:31.540524 26438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 884) took 1431 ms. Trace:
I20260709 12:24:31.541100 26438 rpcz_store.cc:276] 0709 12:24:30.109578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.119170 (+  9592us) service_pool.cc:224] Handling call
0709 12:24:30.119583 (+   413us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:24:30.120092 (+   509us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:30.120141 (+    49us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:24:30.120935 (+   794us) log.cc:844] Serialized 78 byte log entry
0709 12:24:30.444487 (+323552us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:30.444525 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.444598 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:31.503514 (+1058916us) spinlock_profiling.cc:243] Waited 53.6 ms on lock 0x7b4400022b4c. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db 00007f5d99708aaf 00007f5d996fc86e 00007f5d996fbbb6 00007f5d996fb7d8 00007f5d99705221 00007f5d997051d9 00007f5d99705169
0709 12:24:31.540008 (+ 36494us) raft_consensus.cc:1685] finished
0709 12:24:31.540039 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:31.540403 (+   364us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":60231,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":107,"spinlock_wait_cycles":123169152,"thread_start_us":323138,"threads_started":1,"wal-append.queue_time_us":594045}
I20260709 12:24:31.543823 26432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 881) took 1538 ms. Trace:
I20260709 12:24:31.544528 26432 rpcz_store.cc:276] 0709 12:24:30.005556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.005701 (+   145us) service_pool.cc:224] Handling call
0709 12:24:30.065810 (+ 60109us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:30.395077 (+329267us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:30.395117 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:30.605470 (+210353us) log.cc:844] Serialized 26 byte log entry
0709 12:24:31.102673 (+497203us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:31.122406 (+ 19733us) log.cc:844] Serialized 14 byte log entry
0709 12:24:31.124098 (+  1692us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.124165 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:31.543614 (+419449us) raft_consensus.cc:1685] finished
0709 12:24:31.543635 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:31.543763 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24138,"prepare.queue_time_us":11554,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":50479,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":25372,"thread_start_us":744417,"threads_started":2,"wal-append.queue_time_us":933226}
I20260709 12:24:31.546981 26433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 872) took 1635 ms. Trace:
I20260709 12:24:31.547361 26433 rpcz_store.cc:276] 0709 12:24:29.911236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.919979 (+  8743us) service_pool.cc:224] Handling call
0709 12:24:29.972367 (+ 52388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:30.104073 (+131706us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:30.104101 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:30.694199 (+590098us) spinlock_profiling.cc:243] Waited 3.16 ms on lock 0x7b2c000d5dd8. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9845aa11 00007f5d9846a372 00007f5d99b9ca01 00007f5d99b6143a 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2
0709 12:24:30.694601 (+   402us) log.cc:844] Serialized 26 byte log entry
0709 12:24:30.958479 (+263878us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:30.958515 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.958581 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:31.546638 (+588057us) raft_consensus.cc:1685] finished
0709 12:24:31.546695 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:31.546928 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79318,"raft.queue_time_us":181403,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":3804,"spinlock_wait_cycles":7273344,"thread_start_us":263520,"threads_started":1,"wal-append.queue_time_us":536684}
I20260709 12:24:31.463593 29248 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:31.494402 29001 consensus_queue.cc:237] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:31.552227 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:31.552884 25832 raft_consensus.cc:2468] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 7.
I20260709 12:24:31.496179 29117 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:24:31.496373 29259 log.cc:927] Time spent T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.519s	user 0.000s	sys 0.001s
I20260709 12:24:31.228451 29267 consensus_queue.cc:260] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:31.555075 29220 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:31.555809 28662 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:31.556483 26435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 882) took 1544 ms. Trace:
I20260709 12:24:31.556842 26435 rpcz_store.cc:276] 0709 12:24:30.012295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.012430 (+   135us) service_pool.cc:224] Handling call
0709 12:24:30.084578 (+ 72148us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:30.158470 (+ 73892us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:30.158516 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:30.170775 (+ 12259us) log.cc:844] Serialized 26 byte log entry
0709 12:24:30.358274 (+187499us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:30.358317 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.358389 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:30.661796 (+303407us) spinlock_profiling.cc:243] Waited 2.36 ms on lock 0x7b4800041dd8. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9ea8aaa1 00007f5d9ea81b37 00007f5d9ea819ca 00007f5d9eb7926f 00007f5d9eb78f37 00007f5d9eb8d55c 00007f5d9eb8d508 00007f5d9eb8d488 00007f5d9eb8d443 00007f5d9eb8c6ec 00007f5d9dab6a96
0709 12:24:31.556113 (+894317us) raft_consensus.cc:1685] finished
0709 12:24:31.556138 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:31.556327 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66498,"raft.queue_time_us":52866,"raft.run_cpu_time_us":2647,"raft.run_wall_time_us":477173,"spinlock_wait_cycles":5427072,"thread_start_us":187068,"threads_started":1,"wal-append.queue_time_us":647294}
W20260709 12:24:31.513566 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 300552us
I20260709 12:24:31.450687 29210 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:31.421582 28912 consensus_queue.cc:237] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:31.561173 25833 raft_consensus.cc:1275] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 12:24:31.526440 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:31.562572 26402 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:31.563865 26402 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:31.564002 29179 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:31.564833 28957 consensus_queue.cc:1059] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:31.482784 26439 rpcz_store.cc:276] 0709 12:24:30.066147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.154000 (+ 87853us) service_pool.cc:224] Handling call
0709 12:24:30.169508 (+ 15508us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:30.182117 (+ 12609us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:30.182151 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:30.182694 (+   543us) log.cc:844] Serialized 52 byte log entry
0709 12:24:30.359583 (+176889us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:30.613971 (+254388us) log.cc:844] Serialized 14 byte log entry
0709 12:24:30.614321 (+   350us) log.cc:844] Serialized 14 byte log entry
0709 12:24:30.616820 (+  2499us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.616926 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:30.789571 (+172645us) spinlock_profiling.cc:243] Waited 44.2 ms on lock 0x7b4400022b4c. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db 00007f5d99708aaf 00007f5d996fc86e 00007f5d996fbbb6 00007f5d996fb7d8 00007f5d99705221 00007f5d997051d9 00007f5d99705169
0709 12:24:31.177324 (+387753us) raft_consensus.cc:1685] finished
0709 12:24:31.177350 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:31.177501 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":131469,"prepare.queue_time_us":819986,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":37444,"raft.queue_time_us":24112,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":2464,"spinlock_wait_cycles":297072128,"thread_start_us":392859,"threads_started":2,"wal-append.queue_time_us":541795}
I20260709 12:24:31.565503 28957 consensus_queue.cc:1243] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer f82778701b464892aab92a752ed7ffdc log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:24:31.565939 29239 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:24:31.566310 29136 consensus_meta.cc:287] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.832s	user 0.011s	sys 0.000s
I20260709 12:24:31.518677 29184 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:31.566728 29230 raft_consensus.cc:2749] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:31.567422 29230 raft_consensus.cc:2749] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:31.568090 29231 raft_consensus.cc:3055] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:31.568482 29231 raft_consensus.cc:740] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:31.497155 29243 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:31.581662 29235 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.000s	sys 0.058s
I20260709 12:24:31.582887 29227 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:31.584142 29234 consensus_meta.cc:287] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.765s	user 0.009s	sys 0.003s
I20260709 12:24:31.585551 29189 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:31.586145 29268 raft_consensus.cc:2749] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:31.478170 29250 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:31.588546 29250 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:31.589679 29274 log.cc:927] Time spent T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:24:31.484213 29245 raft_consensus.cc:2764] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
W20260709 12:24:31.590750 29266 log.cc:927] Time spent T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.610s	user 0.001s	sys 0.000s
I20260709 12:24:31.591317 29283 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
W20260709 12:24:31.592046 28741 consensus_meta.cc:287] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.781s	user 0.002s	sys 0.009s
I20260709 12:24:31.591883 29283 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:31.593974 29283 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:31.566027 28957 consensus_queue.cc:1048] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:31.554555 29256 consensus_queue.cc:237] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:31.569011 29135 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.600180 29135 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:31.592289 29198 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:31.597846 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
W20260709 12:24:31.598230 25632 auto_rebalancer.cc:893] Removing replace marker failed: Replica 6e673265293d4e9a937dc45150aeb1b8 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
W20260709 12:24:31.604043 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:31.630618 25632 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 12:24:31.631067 25632 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 12:24:31.594484 28657 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:31.635658 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 71865.1us
W20260709 12:24:31.636058 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:31.638227 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:31.639410 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:31.640233 25759 raft_consensus.cc:2410] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:31.597440 28988 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:31.642400 25763 raft_consensus.cc:2393] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 8: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:31.643297 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:31.643947 28988 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:31.644898 25685 raft_consensus.cc:2368] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 7. Current term is 8.
I20260709 12:24:31.646178 29198 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:31.649159 29291 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.675704 29291 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:31.649691 28741 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:31.678817 28741 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:31.679595 25684 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.222s	user 0.024s	sys 0.021s
W20260709 12:24:31.679986 25684 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.223s	user 0.024s	sys 0.021s
I20260709 12:24:31.681106 28741 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:31.681618 29258 log.cc:927] Time spent T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.968s	user 0.002s	sys 0.002s
I20260709 12:24:31.681777 29260 raft_consensus.cc:2749] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:31.683353 28657 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:31.684259 25829 raft_consensus.cc:1240] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:31.685786 29288 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:31.689473 25684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2178) took 1800 ms. Trace:
I20260709 12:24:31.690062 25684 rpcz_store.cc:276] 0709 12:24:29.887953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.888126 (+   173us) service_pool.cc:224] Handling call
0709 12:24:29.888489 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:30.068034 (+179545us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:30.068094 (+    60us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:30.089532 (+ 21438us) log.cc:844] Serialized 26 byte log entry
0709 12:24:30.313672 (+224140us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:31.680316 (+1366644us) log.cc:844] Serialized 14 byte log entry
0709 12:24:31.680563 (+   247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.680639 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:31.680889 (+   250us) spinlock_profiling.cc:243] Waited 55.4 ms on lock 0x7b4400022b4c. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db 00007f5d99708aaf 00007f5d996fc86e 00007f5d996fbbb6 00007f5d996fb7d8 00007f5d99705221 00007f5d997051d9 00007f5d99705169
0709 12:24:31.687580 (+  6691us) raft_consensus.cc:1685] finished
0709 12:24:31.687696 (+   116us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:31.687827 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32993,"prepare.queue_time_us":157367,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":1370,"raft.queue_time_us":201545,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":16492,"spinlock_wait_cycles":127384320,"thread_start_us":1540503,"threads_started":3,"wal-append.queue_time_us":582411}
I20260709 12:24:31.687811 29216 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:31.697490 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 231180us
I20260709 12:24:31.699868 25650 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:31.695191 29248 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:31.688172 26402 connection.cc:256] RPC call timeout handler was delayed by -1.3910314790000484s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1765s for a response
W20260709 12:24:31.701869 26402 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 1.567s (SENT) [suppressed 25 similar messages]
I20260709 12:24:31.702252 29198 raft_consensus.cc:2804] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:31.703202 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:31.708161 29233 raft_consensus.cc:3055] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:31.710214 29198 raft_consensus.cc:697] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 8 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:31.710433 25684 raft_consensus.cc:2468] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 5.
I20260709 12:24:31.711239 29198 consensus_queue.cc:237] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:31.699052 29216 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:31.713925 29216 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:24:31.714527 29255 log.cc:927] Time spent T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 1.000s	user 0.001s	sys 0.001s
I20260709 12:24:31.710215 29233 raft_consensus.cc:740] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:31.715984 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:31.716523 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:31.717193 25684 raft_consensus.cc:2468] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 6.
I20260709 12:24:31.717303 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:31.717052 29233 consensus_queue.cc:260] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:31.718112 29233 raft_consensus.cc:3060] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:31.718487 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:31.719254 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:31.719591 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:31.719960 25684 raft_consensus.cc:2368] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 6. Current term is 7.
I20260709 12:24:31.720206 25685 raft_consensus.cc:2376] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 7. Re-sending same reply.
I20260709 12:24:31.687305 29231 consensus_queue.cc:260] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:31.729635 29231 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:31.734145 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:31.735397 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:31.735483 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:31.736061 25832 raft_consensus.cc:3060] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:31.736652 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:31.740254 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:31.741091 25830 raft_consensus.cc:2410] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:24:31.741341 29135 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:31.743288 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:31.744551 25837 raft_consensus.cc:1240] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:31.749434 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:31.750715 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:31.755483 25763 raft_consensus.cc:3060] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:31.758472 29295 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:31.759114 29295 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:31.761341 29295 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:31.750983 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:31.763453 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:24:31.765017 29263 log.cc:927] Time spent T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 1.051s	user 0.003s	sys 0.024s
I20260709 12:24:31.765372 25837 raft_consensus.cc:1275] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 12:24:31.766315 25683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2177) took 1879 ms. Trace:
I20260709 12:24:31.751865 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:31.766692 25683 rpcz_store.cc:276] 0709 12:24:29.886578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.886762 (+   184us) service_pool.cc:224] Handling call
0709 12:24:29.887173 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:30.090880 (+203707us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:24:30.090912 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:30.145418 (+ 54506us) log.cc:844] Serialized 26 byte log entry
0709 12:24:30.567063 (+421645us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:30.567101 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.567171 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:31.759502 (+1192331us) spinlock_profiling.cc:243] Waited 54.7 ms on lock 0x7b4400022b4c. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db 00007f5d99708aaf 00007f5d996fc86e 00007f5d996fbbb6 00007f5d996fb7d8 00007f5d99705221 00007f5d997051d9 00007f5d99705169
0709 12:24:31.766024 (+  6522us) raft_consensus.cc:1685] finished
0709 12:24:31.766045 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:31.766256 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35034,"raft.queue_time_us":179073,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":15721,"spinlock_wait_cycles":125891328,"thread_start_us":547445,"threads_started":2,"wal-append.queue_time_us":553000}
I20260709 12:24:31.768440 29127 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.768580 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:31.768728 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:31.769119 25683 raft_consensus.cc:2376] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 8. Re-sending same reply.
I20260709 12:24:31.768929 29127 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:31.769824 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:31.769951 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:31.770491 25678 raft_consensus.cc:2368] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 6. Current term is 7.
I20260709 12:24:31.770839 29127 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:31.770995 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:31.771224 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:31.773551 29291 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:24:31.774963 25650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:31.777262 25650 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:31.777977 29244 raft_consensus.cc:2749] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:31.778431 25650 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:31.779688 29267 raft_consensus.cc:3060] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:31.780191 29260 raft_consensus.cc:2749] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:31.779749 25650 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:31.781829 25834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:60480 (request call id 28) took 1879 ms. Trace:
I20260709 12:24:31.781946 29305 raft_consensus.cc:2749] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:31.782229 25834 rpcz_store.cc:276] 0709 12:24:29.902740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.902890 (+   150us) service_pool.cc:224] Handling call
0709 12:24:31.781679 (+1878789us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b5400116554. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b5b853 00007f5d9eb2960a 00007f5d980af7d4 00007f5d980af762 00007f5d980af691 00007f5d980af60c 00007f5d980ae8c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:31.781749 (+    70us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2522872448}
I20260709 12:24:31.782644 29305 consensus_queue.cc:1048] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:31.784539 25650 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:31.784997 25677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2179) took 1895 ms. Trace:
I20260709 12:24:31.785691 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:31.786238 26437 raft_consensus.cc:3060] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:31.787078 29305 consensus_queue.cc:1059] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:31.786609 29260 raft_consensus.cc:2749] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:31.788036 28987 raft_consensus.cc:3055] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:31.788388 28987 raft_consensus.cc:740] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:31.789346 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:31.789259 28987 consensus_queue.cc:260] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:31.790612 28987 raft_consensus.cc:3060] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:31.790731 25680 raft_consensus.cc:1240] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:31.752259 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:31.789377 29250 raft_consensus.cc:1064] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc: attempting to promote NON_VOTER a866ff967d964388a6f0dff7fd43df89 to VOTER
I20260709 12:24:31.750507 25761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 2287) took 1026 ms. Trace:
W20260709 12:24:31.793551 29270 log.cc:927] Time spent T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.678s	user 0.001s	sys 0.000s
I20260709 12:24:31.793812 25761 rpcz_store.cc:276] 0709 12:24:30.724375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.733935 (+  9560us) service_pool.cc:224] Handling call
0709 12:24:30.734289 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:30.989221 (+254932us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.750302 (+761081us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x7b54003976d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:31.750452 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":559461632}
I20260709 12:24:31.795327 29250 consensus_queue.cc:237] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:31.785389 25677 rpcz_store.cc:276] 0709 12:24:29.889417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.889582 (+   165us) service_pool.cc:224] Handling call
0709 12:24:29.889957 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:30.201460 (+311503us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:24:30.209922 (+  8462us) log.cc:844] Serialized 14 byte log entry
0709 12:24:30.673357 (+463435us) spinlock_profiling.cc:243] Waited 1.61 ms on lock 0x7b180029a640. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d96a56e07 00007f5d9f8b19a9 00007f5d96a7369b 00007f5d96a7193f 00007f5d96a73c02 00007f5d996fb20b 00007f5d99700d23 00007f5d9970123a 00007f5d99b6ba2a
0709 12:24:31.043751 (+370394us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:31.102666 (+ 58915us) log.cc:844] Serialized 26 byte log entry
0709 12:24:31.102821 (+   155us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:31.102852 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.784720 (+681868us) spinlock_profiling.cc:243] Waited 308 ms on lock 0x7b54002652d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:31.784768 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:31.784809 (+    41us) raft_consensus.cc:1685] finished
0709 12:24:31.784822 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:31.784947 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83195,"prepare.queue_time_us":8247,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":3040,"raft.queue_time_us":98843,"raft.run_cpu_time_us":384,"raft.run_wall_time_us":24729,"spinlock_wait_cycles":712333952,"thread_start_us":329906,"threads_started":1,"wal-append.queue_time_us":1331012}
I20260709 12:24:31.797441 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:31.799842 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:31.800732 25684 raft_consensus.cc:2393] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 8: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:31.801270 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:31.801570 29242 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:31.801992 25679 raft_consensus.cc:2376] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 7. Re-sending same reply.
I20260709 12:24:31.802178 29242 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:31.795370 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:31.806619 25650 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:31.807258 29264 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:31.807407 28988 raft_consensus.cc:2749] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:31.807811 25650 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:31.811085 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:31.812160 25683 raft_consensus.cc:2410] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:24:31.752168 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:31.815896 25685 raft_consensus.cc:2410] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:24:31.775252 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 44920.7us
I20260709 12:24:31.818022 26437 raft_consensus.cc:2468] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 8.
I20260709 12:24:31.820883 25681 raft_consensus.cc:2468] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 9.
I20260709 12:24:31.750494 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:24:31.833266 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 131394us
W20260709 12:24:31.834079 26402 connection.cc:256] RPC call timeout handler was delayed by -1.2884314789998825s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1879s for a response
W20260709 12:24:31.834515 26402 connection.cc:256] RPC call timeout handler was delayed by -1.2410511940001925s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1503s for a response
W20260709 12:24:31.834918 26402 connection.cc:256] RPC call timeout handler was delayed by -1.2343902030002027s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1877s for a response
W20260709 12:24:31.835297 26402 connection.cc:256] RPC call timeout handler was delayed by -1.2068511940001372s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15410000000000001s for a response
I20260709 12:24:31.836387 25678 raft_consensus.cc:2410] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 12:24:31.839186 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:31.835695 26402 connection.cc:256] RPC call timeout handler was delayed by -1.1858314789997166s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19930000000000003s for a response
W20260709 12:24:31.854672 26402 connection.cc:256] RPC call timeout handler was delayed by -1.1757357850001426s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1504s for a response
W20260709 12:24:31.855396 26402 connection.cc:256] RPC call timeout handler was delayed by -1.097568137000053s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15780000000000002s for a response
I20260709 12:24:31.856942 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:31.824419 25756 raft_consensus.cc:2468] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 9.
I20260709 12:24:31.869071 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:31.869746 25763 raft_consensus.cc:2468] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 8.
I20260709 12:24:31.870654 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:31.870961 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:31.811650 25686 raft_consensus.cc:2376] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 14. Re-sending same reply.
I20260709 12:24:31.871577 25763 raft_consensus.cc:2468] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 9.
W20260709 12:24:31.871955 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 53699us
I20260709 12:24:31.873705 25832 raft_consensus.cc:2468] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 7.
I20260709 12:24:31.882807 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:31.913791 25649 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:31.914988 25649 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:31.917801 26434 raft_consensus.cc:1275] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:24:31.920297 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:31.921343 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:31.921481 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:31.922125 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:31.922304 26432 raft_consensus.cc:1240] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:31.922669 26436 raft_consensus.cc:3060] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:31.923712 26439 raft_consensus.cc:1240] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:31.924160 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:31.924716 25833 raft_consensus.cc:3060] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:31.925768 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:31.926338 25829 raft_consensus.cc:2468] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 6.
I20260709 12:24:31.933255 26438 raft_consensus.cc:1275] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:24:31.935325 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:31.938342 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:31.941527 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:31.942356 25754 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.961s	user 0.008s	sys 0.010s
W20260709 12:24:31.942873 25754 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.961s	user 0.008s	sys 0.010s
I20260709 12:24:31.943492 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:31.943768 25758 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.940s	user 0.005s	sys 0.016s
I20260709 12:24:31.945223 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:31.945596 25758 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.956s	user 0.005s	sys 0.017s
I20260709 12:24:31.946707 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:31.943295 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:31.948042 25650 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:31.948513 26431 raft_consensus.cc:3060] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:31.869374 29228 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.866640 29291 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.957865 25677 raft_consensus.cc:1275] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:24:31.959004 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:31.959651 25829 raft_consensus.cc:2468] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 7.
W20260709 12:24:31.955518 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 467207us
I20260709 12:24:31.957789 25832 raft_consensus.cc:1240] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 8 LEADER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:31.962201 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:31.962433 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:31.957928 25757 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.856s	user 0.010s	sys 0.013s
I20260709 12:24:31.962803 25680 raft_consensus.cc:3060] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:31.963011 25757 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.861s	user 0.010s	sys 0.013s
W20260709 12:24:31.966917 26402 leader_election.cc:336] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 1.503s (SENT)
I20260709 12:24:31.967375 26402 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:31.968545 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:31.971518 25801 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:24:31.977432 25582 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41232 (request call id 389) took 12700 ms (client timeout 15000 ms). Trace:
I20260709 12:24:31.980784 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:31.944593 29196 raft_consensus.cc:2804] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:31.948022 28959 raft_consensus.cc:2804] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:31.983862 25650 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:31.968607 26434 raft_consensus.cc:2468] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 9.
W20260709 12:24:32.001822 26430 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.841s	user 0.003s	sys 0.021s
W20260709 12:24:32.002239 26430 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.842s	user 0.004s	sys 0.021s
W20260709 12:24:31.963763 29246 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.236s	user 0.022s	sys 0.006s
I20260709 12:24:31.944056 28988 raft_consensus.cc:2749] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:31.975591 26436 raft_consensus.cc:2468] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 7.
I20260709 12:24:31.987754 25801 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
W20260709 12:24:31.988411 25726 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.741s	user 0.005s	sys 0.024s
I20260709 12:24:32.019420 29127 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.964002 29228 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:31.988626 29196 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:32.049759 25760 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.132s	user 0.009s	sys 0.030s
I20260709 12:24:32.029191 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:31.967334 29291 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:31.978047 25582 rpcz_store.cc:269] 0709 12:24:19.276922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:19.284132 (+  7210us) service_pool.cc:224] Handling call
0709 12:24:31.977347 (+12693215us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:28.452036 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:28.621278 (+169242us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:28.621342 (+    64us) write_op.cc:435] Acquired schema lock
0709 12:24:28.621367 (+    25us) tablet.cc:662] Decoding operations
0709 12:24:28.623318 (+  1951us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:28.623417 (+    99us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:28.623460 (+    43us) tablet.cc:685] Acquiring locks for 21 operations
0709 12:24:28.839419 (+215959us) tablet.cc:701] Row locks acquired
0709 12:24:28.839482 (+    63us) write_op.cc:260] PREPARE: finished
0709 12:24:28.839716 (+   234us) write_op.cc:270] Start()
0709 12:24:28.839890 (+   174us) write_op.cc:276] Timestamp: P: 1783599868839635 usec, L: 0
0709 12:24:28.839940 (+    50us) op_driver.cc:348] REPLICATION: starting
0709 12:24:28.913997 (+ 74057us) log.cc:844] Serialized 8359 byte log entry
0709 12:24:29.211464 (+297467us) op_driver.cc:464] REPLICATION: finished
0709 12:24:29.488976 (+277512us) write_op.cc:301] APPLY: starting
0709 12:24:29.489095 (+   119us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:29.489649 (+   554us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:29.489803 (+   154us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:29.582244 (+ 92441us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:29.618148 (+ 35904us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=21
0709 12:24:29.618204 (+    56us) write_op.cc:312] APPLY: finished
0709 12:24:29.618728 (+   524us) log.cc:844] Serialized 145 byte log entry
0709 12:24:29.618934 (+   206us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:29.619152 (+   218us) write_op.cc:454] Released schema lock
0709 12:24:29.619231 (+    79us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:29.619667 (+   436us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:29.619701 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":824729,"reported_tablets":42,"spinlock_wait_cycles":2304,"child_traces":[["op",{"apply.queue_time_us":277193,"apply.run_cpu_time_us":6306,"apply.run_wall_time_us":130669,"num_ops":21,"prepare.queue_time_us":136088,"prepare.run_cpu_time_us":44179,"prepare.run_wall_time_us":680801,"raft.queue_time_us":64426,"raft.run_cpu_time_us":12161,"raft.run_wall_time_us":206624,"replication_time_us":371321,"thread_start_us":434746,"threads_started":4,"wal-append.queue_time_us":200871,"wal-append.run_cpu_time_us":11084,"wal-append.run_wall_time_us":1514833}]]}
I20260709 12:24:32.002627 29092 raft_consensus.cc:2804] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:32.042321 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:24:31.977408 28903 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.754s	user 0.005s	sys 0.020s
W20260709 12:24:32.059731 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 50936.2us
I20260709 12:24:32.019420 29251 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
W20260709 12:24:32.009552 25649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:31.990176 29215 raft_consensus.cc:2749] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:24:32.056896 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 96900.6us
I20260709 12:24:31.989255 29242 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:32.020866 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:31.964110 29260 consensus_queue.cc:1048] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 12:24:32.060753 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:32.069669 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:32.009332 25685 raft_consensus.cc:1240] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 8. Current term is 9. Ops: []
W20260709 12:24:32.372152 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:32.086723 25833 raft_consensus.cc:2468] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 7.
W20260709 12:24:32.385788 25726 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.138s	user 0.025s	sys 0.044s
I20260709 12:24:32.385392 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:32.386361 25726 connection.cc:256] RPC call timeout handler was delayed by -1.5411511930001325s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17200000000000001s for a response
I20260709 12:24:32.387573 25650 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:24:32.387975 25726 connection.cc:256] RPC call timeout handler was delayed by -1.5339511930001208s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1728s for a response
W20260709 12:24:32.388535 25726 connection.cc:256] RPC call timeout handler was delayed by -1.4421511929999724s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18300000000000002s for a response
I20260709 12:24:32.099954 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:32.387497 25761 raft_consensus.cc:2468] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 6.
W20260709 12:24:32.389144 25726 connection.cc:256] RPC call timeout handler was delayed by -1.4376511929999651s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1835s for a response
W20260709 12:24:32.389642 25726 connection.cc:256] RPC call timeout handler was delayed by -1.4214511929999389s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18530000000000002s for a response
I20260709 12:24:32.173064 25680 raft_consensus.cc:2468] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 6.
W20260709 12:24:32.076777 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:32.386705 25760 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.469s	user 0.030s	sys 0.043s
W20260709 12:24:32.392796 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:32.393157 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:32.395330 26402 leader_election.cc:336] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 1.504s (SENT)
I20260709 12:24:32.395746 26402 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:32.232103 25758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 2661) took 1521 ms. Trace:
W20260709 12:24:32.391592 25726 connection.cc:256] RPC call timeout handler was delayed by -1.3260511929997847s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19590000000000002s for a response
W20260709 12:24:32.193809 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:32.398273 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:32.399550 25755 raft_consensus.cc:2393] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 6: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:32.400449 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:32.386683 26435 raft_consensus.cc:2468] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 8.
I20260709 12:24:32.396739 25758 rpcz_store.cc:276] 0709 12:24:30.710920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.711054 (+   134us) service_pool.cc:224] Handling call
0709 12:24:30.711349 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:30.711566 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:30.989839 (+278273us) log.cc:844] Serialized 14 byte log entry
0709 12:24:32.183072 (+1193233us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b18003e6020. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d969eec0a 00007f5da012e219 00007f5d96a76a40 00007f5d96a714e4 00007f5d96a71455 00007f5d9d5593c7 00007f5d99b6b9a7 00007f5d99b7b0bf 00007f5d99b7b038
0709 12:24:32.183415 (+   343us) log.cc:844] Serialized 14 byte log entry
0709 12:24:32.231624 (+ 48209us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:32.231695 (+    71us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:32.231759 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.231854 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:32.232027 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72696,"prepare.queue_time_us":1125598,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":48189,"raft.run_cpu_time_us":310,"raft.run_wall_time_us":25689,"spinlock_wait_cycles":35358464,"thread_start_us":1233845,"threads_started":2}
I20260709 12:24:32.424486 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:32.388959 25650 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:32.427475 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:32.428117 25833 raft_consensus.cc:2468] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 6.
I20260709 12:24:32.027166 28967 raft_consensus.cc:2749] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:32.042860 28912 raft_consensus.cc:2804] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:32.425658 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:32.055553 29295 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:32.071518 29214 consensus_meta.cc:287] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 1.067s	user 0.011s	sys 0.000s
I20260709 12:24:32.437534 25726 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
W20260709 12:24:32.437667 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 48765.6us
W20260709 12:24:32.440155 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 131928us
W20260709 12:24:32.400561 28903 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.185s	user 0.017s	sys 0.049s
W20260709 12:24:32.383428 29318 log.cc:927] Time spent T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.420s	user 0.001s	sys 0.000s
I20260709 12:24:32.447113 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:32.525058 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:32.525707 26435 raft_consensus.cc:2468] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 7.
W20260709 12:24:32.451561 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:32.450639 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:32.380935 25581 catalog_manager.cc:5697] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:32.469559 26430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 877) took 1751 ms. Trace:
I20260709 12:24:32.532768 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
W20260709 12:24:32.445958 25754 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.013s	sys 0.008s
W20260709 12:24:32.400377 29246 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.673s	user 0.023s	sys 0.039s
I20260709 12:24:32.534857 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:32.043084 28959 raft_consensus.cc:697] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 8 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:32.520355 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
W20260709 12:24:32.520494 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 83065.8us
W20260709 12:24:32.469297 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 481602us
I20260709 12:24:32.543040 25833 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:32.402417 29260 consensus_queue.cc:1243] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer 5cccf20a8bff46dba6601f241d172b8a log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:24:32.400552 29196 raft_consensus.cc:3060] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:32.463536 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 68225.1us
W20260709 12:24:32.534222 25754 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.013s	sys 0.008s
I20260709 12:24:32.530555 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:32.532567 26430 rpcz_store.cc:276] 0709 12:24:30.717695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.720528 (+  2833us) service_pool.cc:224] Handling call
0709 12:24:30.720791 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:30.735234 (+ 14443us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:24:31.160182 (+424948us) log.cc:844] Serialized 14 byte log entry
0709 12:24:32.002674 (+842492us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:32.002731 (+    57us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:32.002776 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.469290 (+466514us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b540060fc54. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:32.469334 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:32.469490 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":557,"prepare.queue_time_us":177875,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":5026,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":16773,"spinlock_wait_cycles":30375680,"thread_start_us":1243304,"threads_started":2,"wal-append.queue_time_us":1132324}
I20260709 12:24:32.543670 25726 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:32.401422 29235 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.550652 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:32.561431 25837 raft_consensus.cc:2393] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 7: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:32.563575 25754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 2290) took 1838 ms. Trace:
I20260709 12:24:32.564008 25754 rpcz_store.cc:276] 0709 12:24:30.725225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.841022 (+115797us) service_pool.cc:224] Handling call
0709 12:24:30.908919 (+ 67897us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:30.909116 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:24:31.943338 (+1034222us) log.cc:844] Serialized 14 byte log entry
0709 12:24:32.563272 (+619934us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:32.563320 (+    48us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:32.563359 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.563419 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:32.563523 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21412,"prepare.queue_time_us":685300,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"thread_start_us":1573446,"threads_started":2}
W20260709 12:24:32.570559 26402 leader_election.cc:336] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 1.541s (SENT)
I20260709 12:24:32.570978 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:32.571044 26402 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:32.425320 29117 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
W20260709 12:24:32.575541 25649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:32.448590 29257 raft_consensus.cc:2749] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:32.446455 28633 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.583269 25650 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:24:32.541925 29289 log.cc:927] Time spent T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 12:24:32.599195 25800 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:32.466135 29242 raft_consensus.cc:2804] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:32.591679 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:32.627610 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 44412.5us
I20260709 12:24:32.594105 26435 raft_consensus.cc:1240] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 6. Current term is 7. Ops: []
W20260709 12:24:32.596380 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 52813.2us
I20260709 12:24:32.629086 25726 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
W20260709 12:24:32.629236 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 74161.9us
I20260709 12:24:32.535495 29214 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:32.524614 29268 raft_consensus.cc:2749] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:32.612306 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:32.612736 25581 catalog_manager.cc:5697] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:32.424486 29251 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:32.527266 29092 raft_consensus.cc:697] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 9 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:32.620805 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:32.620110 25834 raft_consensus.cc:1275] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:24:32.541515 28912 raft_consensus.cc:697] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 7 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:32.620163 26439 raft_consensus.cc:2468] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 7.
W20260709 12:24:32.629823 26402 leader_election.cc:336] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 1.578s (SENT)
I20260709 12:24:32.680645 26402 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:32.630445 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:32.560571 29256 raft_consensus.cc:2749] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:32.644819 25833 raft_consensus.cc:2468] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 8.
I20260709 12:24:32.578527 29246 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:32.431447 29127 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:32.519191 29295 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:32.593364 28988 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:32.593186 29116 raft_consensus.cc:2749] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:32.593146 29135 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:32.703083 25682 raft_consensus.cc:2393] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 9: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:32.679505 29082 raft_consensus.cc:2804] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:24:32.747611 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 117802us
W20260709 12:24:32.748478 26402 leader_election.cc:336] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 1.687s (SENT)
I20260709 12:24:32.749065 26402 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:32.592686 29235 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:32.661478 29239 raft_consensus.cc:2804] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:32.614080 29245 consensus_queue.cc:1059] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.086s
I20260709 12:24:32.627282 29242 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:32.623711 29089 consensus_queue.cc:1059] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.081s
I20260709 12:24:32.707155 25763 raft_consensus.cc:3060] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:32.764827 26431 consensus_meta.cc:287] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.811s	user 0.010s	sys 0.001s
I20260709 12:24:32.812001 26431 raft_consensus.cc:2468] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 9.
I20260709 12:24:32.812528 26431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 887) took 1027 ms. Trace:
I20260709 12:24:32.723147 28967 raft_consensus.cc:2749] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:24:32.812847 26431 rpcz_store.cc:276] 0709 12:24:31.785319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.873824 (+ 88505us) service_pool.cc:224] Handling call
0709 12:24:32.812473 (+938649us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:32.765504 25834 raft_consensus.cc:1240] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:32.747068 29082 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:32.633821 28633 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:32.723294 29326 log.cc:927] Time spent T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 12:24:32.625106 29117 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:32.746435 29256 raft_consensus.cc:2749] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:32.836553 25761 raft_consensus.cc:1275] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 7 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 12:24:32.749135 25581 catalog_manager.cc:5697] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 2 to 6, leader changed from a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 6 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:32.834713 25650 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:24:32.952387 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 117824us
W20260709 12:24:32.870280 29311 log.cc:927] Time spent T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.444s	user 0.000s	sys 0.001s
W20260709 12:24:32.871668 29267 consensus_meta.cc:287] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 1.091s	user 0.009s	sys 0.000s
W20260709 12:24:32.872359 29328 log.cc:927] Time spent T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.337s	user 0.000s	sys 0.001s
W20260709 12:24:32.873155 29332 log.cc:927] Time spent T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 12:24:32.808812 29242 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:32.796569 29257 raft_consensus.cc:2749] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:32.723721 28959 consensus_queue.cc:237] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:32.894553 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 146096us
I20260709 12:24:32.944931 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:33.091778 26402 leader_election.cc:336] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 1.722s (SENT)
I20260709 12:24:32.945164 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:33.092360 26402 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
W20260709 12:24:32.855726 29233 consensus_meta.cc:287] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 1.137s	user 0.012s	sys 0.000s
I20260709 12:24:32.711706 29246 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:32.723058 28988 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:32.856487 29082 raft_consensus.cc:3060] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:32.858081 29245 consensus_queue.cc:1243] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer 5cccf20a8bff46dba6601f241d172b8a log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:24:33.121093 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:33.132552 26432 raft_consensus.cc:2468] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 6.
W20260709 12:24:33.026203 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 72502.9us
W20260709 12:24:32.955989 25831 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.936s	user 0.042s	sys 0.103s
W20260709 12:24:33.134899 25831 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.115s	user 0.054s	sys 0.119s
I20260709 12:24:33.030699 26401 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:32.760708 29135 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:33.037719 25763 raft_consensus.cc:1275] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:24:33.040010 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:24:33.041208 25759 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.943s	user 0.080s	sys 0.113s
I20260709 12:24:33.141968 25763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 2302) took 1093 ms. Trace:
W20260709 12:24:33.142158 25759 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.057s	user 0.080s	sys 0.113s
I20260709 12:24:32.857237 29239 raft_consensus.cc:697] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 7 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:33.149395 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:33.150272 26436 raft_consensus.cc:2468] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 7.
I20260709 12:24:33.094247 25581 catalog_manager.cc:5697] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 8 to 10, leader changed from a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 10 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:33.112020 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:33.114688 25762 raft_consensus.cc:2410] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 12:24:33.118918 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 489880us
W20260709 12:24:32.958825 29319 log.cc:927] Time spent T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
W20260709 12:24:33.087157 29315 log.cc:927] Time spent T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.685s	user 0.001s	sys 0.001s
I20260709 12:24:33.135129 25650 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
W20260709 12:24:33.126981 29313 log.cc:927] Time spent T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.297s	user 0.000s	sys 0.000s
I20260709 12:24:33.142089 26437 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:24:32.918853 29329 log.cc:927] Time spent T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.596s	user 0.001s	sys 0.000s
I20260709 12:24:33.142536 25763 rpcz_store.cc:276] 0709 12:24:32.048688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.664029 (+615341us) service_pool.cc:224] Handling call
0709 12:24:32.707056 (+ 43027us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:33.141676 (+434620us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.141911 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:33.155885 25726 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:33.043253 29215 raft_consensus.cc:2804] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:33.060359 29260 consensus_queue.cc:1048] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.102s
I20260709 12:24:33.178881 25650 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:33.183292 25830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 2620) took 1429 ms. Trace:
I20260709 12:24:33.140842 28903 raft_consensus.cc:2749] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:33.114621 29291 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:33.192875 25756 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.013s	sys 0.043s
W20260709 12:24:33.217304 25756 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.013s	sys 0.043s
I20260709 12:24:33.192931 25680 raft_consensus.cc:2468] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 6.
W20260709 12:24:33.218444 25679 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.023s	sys 0.038s
W20260709 12:24:33.218767 25679 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.023s	sys 0.038s
I20260709 12:24:33.173159 28967 raft_consensus.cc:2749] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:33.163379 29233 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:33.191087 29267 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:33.191459 28657 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:33.226900 28657 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:33.229410 28657 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:33.237838 25755 raft_consensus.cc:1240] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:33.239078 25755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 2303) took 1170 ms. Trace:
I20260709 12:24:33.217876 29215 raft_consensus.cc:697] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 8 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:33.241312 29215 consensus_queue.cc:237] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:33.244597 29333 log.cc:927] Time spent T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.349s	user 0.000s	sys 0.000s
I20260709 12:24:33.043697 28912 consensus_queue.cc:237] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:33.246866 29307 log.cc:927] Time spent T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.188s	user 0.002s	sys 0.000s
I20260709 12:24:33.249341 29135 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:33.250068 29135 raft_consensus.cc:2749] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:33.249867 29239 consensus_queue.cc:237] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:33.251116 29328 log.cc:927] Time spent T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 12:24:33.252187 29231 consensus_meta.cc:287] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 1.522s	user 0.008s	sys 0.004s
I20260709 12:24:33.206990 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:33.253229 25763 raft_consensus.cc:2410] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:24:33.254544 25763 raft_consensus.cc:1275] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:24:33.257104 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 101326us
W20260709 12:24:33.185993 25681 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.015s	sys 0.009s
I20260709 12:24:33.205018 25830 rpcz_store.cc:276] 0709 12:24:31.734851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.741592 (+  6741us) service_pool.cc:224] Handling call
0709 12:24:31.741857 (+   265us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:31.742159 (+   302us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:31.742203 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:31.742642 (+   439us) log.cc:844] Serialized 26 byte log entry
0709 12:24:32.042703 (+300061us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:32.042752 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.042845 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:33.163772 (+1120927us) raft_consensus.cc:1685] finished
0709 12:24:33.163805 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:33.164060 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2799,"raft.run_cpu_time_us":51,"raft.run_wall_time_us":50,"thread_start_us":299711,"threads_started":1,"wal-append.queue_time_us":694182}
I20260709 12:24:33.151551 29189 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:33.258548 25681 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.015s	sys 0.009s
I20260709 12:24:32.919279 29092 consensus_queue.cc:237] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:33.213543 25757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 2662) took 2468 ms. Trace:
W20260709 12:24:33.214133 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 122410us
I20260709 12:24:33.216560 26438 raft_consensus.cc:1275] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:33.226689 29267 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:33.118033 29256 consensus_queue.cc:1048] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.097s
I20260709 12:24:33.143734 29210 consensus_queue.cc:1059] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 12:24:33.273558 26437 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 11.
I20260709 12:24:33.239715 25755 rpcz_store.cc:276] 0709 12:24:32.068512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.237334 (+1168822us) service_pool.cc:224] Handling call
0709 12:24:33.237647 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:33.238541 (+   894us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.238972 (+   431us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:33.260316 25757 rpcz_store.cc:276] 0709 12:24:30.744834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.843470 (+ 98636us) service_pool.cc:224] Handling call
0709 12:24:30.843897 (+   427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:30.930047 (+ 86150us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:30.955305 (+ 25258us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:30.955882 (+   577us) log.cc:844] Serialized 26 byte log entry
0709 12:24:31.963400 (+1007518us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:31.963438 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.963503 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:33.213274 (+1249771us) raft_consensus.cc:1685] finished
0709 12:24:33.213302 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:33.213468 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36948,"raft.queue_time_us":572161,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":30448,"thread_start_us":861667,"threads_started":1,"wal-append.queue_time_us":1120371}
I20260709 12:24:33.278599 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:33.211386 29257 raft_consensus.cc:2804] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:33.285741 25830 raft_consensus.cc:1275] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:24:33.206545 25650 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:33.291363 25836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44218 (request call id 1576) took 2045 ms. Trace:
W20260709 12:24:33.249349 29337 log.cc:927] Time spent T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
W20260709 12:24:33.293721 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:33.302640 25830 raft_consensus.cc:1275] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:24:33.304481 25830 raft_consensus.cc:1275] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 12:24:33.296838 25836 rpcz_store.cc:276] 0709 12:24:31.246267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.246510 (+   243us) service_pool.cc:224] Handling call
0709 12:24:31.416995 (+170485us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:31.526465 (+109470us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:31.526508 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:31.553887 (+ 27379us) log.cc:844] Serialized 26 byte log entry
0709 12:24:31.921666 (+367779us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:31.921723 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.576089 (+654366us) spinlock_profiling.cc:243] Waited 96.8 ms on lock 0x7b5400118d54. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:32.576150 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:33.256204 (+680054us) raft_consensus.cc:1685] finished
0709 12:24:33.256226 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:33.291271 (+ 35045us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21134,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":89,"spinlock_wait_cycles":222717696,"thread_start_us":367391,"threads_started":1,"wal-append.queue_time_us":1149794}
W20260709 12:24:33.281284 29244 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.000s	sys 0.009s
W20260709 12:24:33.304936 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 98494.4us
I20260709 12:24:33.269196 29245 raft_consensus.cc:2749] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:33.261215 29214 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:33.304551 29257 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:33.334491 25581 catalog_manager.cc:5697] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
W20260709 12:24:33.336860 26435 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.007s	sys 0.036s
W20260709 12:24:33.332113 29244 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.001s	sys 0.009s
I20260709 12:24:33.306531 29135 raft_consensus.cc:2749] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:33.345625 25760 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.007s	sys 0.038s
W20260709 12:24:33.349382 25760 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.008s	sys 0.038s
I20260709 12:24:33.350210 25760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48606 (request call id 864) took 2503 ms. Trace:
I20260709 12:24:33.350540 25650 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:33.350800 25760 rpcz_store.cc:276] 0709 12:24:30.847263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.894471 (+ 47208us) service_pool.cc:224] Handling call
0709 12:24:30.894769 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:30.894977 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:24:32.392485 (+1497508us) log.cc:844] Serialized 14 byte log entry
0709 12:24:33.349748 (+957263us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:33.349822 (+    74us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:24:33.349883 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.349992 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:33.350145 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78877,"prepare.queue_time_us":634580,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":49,"raft.queue_time_us":441574,"raft.run_wall_time_us":20321,"spinlock_wait_cycles":17472896,"thread_start_us":2431995,"threads_started":3,"wal-append.queue_time_us":877028}
W20260709 12:24:33.344069 26435 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.007s	sys 0.036s
I20260709 12:24:33.346869 25828 raft_consensus.cc:2468] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 6.
W20260709 12:24:33.355587 25728 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.017s	sys 0.029s
W20260709 12:24:33.356092 25728 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.017s	sys 0.029s
I20260709 12:24:33.347266 29184 consensus_queue.cc:1048] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
W20260709 12:24:33.364183 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:33.368916 25678 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.271s	user 0.051s	sys 0.048s
W20260709 12:24:33.369356 25678 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.271s	user 0.051s	sys 0.048s
I20260709 12:24:33.281173 29233 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:33.286362 29189 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:33.335841 29251 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:33.351347 26430 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.001s	sys 0.008s
W20260709 12:24:33.394734 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 44266.4us
W20260709 12:24:33.430507 26430 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.001s	sys 0.010s
W20260709 12:24:33.426400 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:33.429997 25760 raft_consensus.cc:1275] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 12:24:33.431818 25760 pending_rounds.cc:85] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 3
I20260709 12:24:33.432148 25760 pending_rounds.cc:107] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:24:33.432490 25760 raft_consensus.cc:2889] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:33.346225 29257 raft_consensus.cc:3060] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:33.343892 29295 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:24:33.445665 25677 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.012s	sys 0.008s
W20260709 12:24:33.472470 25677 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.013s	sys 0.008s
W20260709 12:24:33.446311 25651 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.138s	user 0.000s	sys 0.021s
I20260709 12:24:33.368049 29268 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:33.351575 29179 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:33.471487 25681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51578 (request call id 709) took 1534 ms. Trace:
I20260709 12:24:33.350036 29252 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:33.424950 29243 raft_consensus.cc:2804] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:24:33.474140 25651 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.166s	user 0.000s	sys 0.021s
I20260709 12:24:33.371590 29235 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:33.425124 29214 raft_consensus.cc:2804] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:33.487124 29179 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:33.487692 29267 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:33.488698 29346 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:33.488883 28988 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:33.367314 29089 consensus_queue.cc:1048] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.119s
I20260709 12:24:33.489849 29117 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:33.490702 29339 log.cc:927] Time spent T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
W20260709 12:24:33.491282 28987 consensus_meta.cc:287] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 1.700s	user 0.013s	sys 0.000s
I20260709 12:24:33.492862 29136 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:33.492974 25759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 2677) took 1548 ms. Trace:
W20260709 12:24:33.522665 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 262011us
I20260709 12:24:33.453779 28903 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:33.432976 28633 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:33.481381 25681 rpcz_store.cc:276] 0709 12:24:31.937264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.937405 (+   141us) service_pool.cc:224] Handling call
0709 12:24:31.937755 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:31.947888 (+ 10133us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:31.947948 (+    60us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:31.966962 (+ 19014us) log.cc:844] Serialized 26 byte log entry
0709 12:24:32.519172 (+552210us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:24:33.248662 (+729490us) spinlock_profiling.cc:243] Waited 73.8 ms on lock 0x7b4400022b4c. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db 00007f5d99708aaf 00007f5d996fc86e 00007f5d996fbbb6 00007f5d996fb7d8 00007f5d99705221 00007f5d997051d9 00007f5d99705169
0709 12:24:33.259377 (+ 10715us) log.cc:844] Serialized 14 byte log entry
0709 12:24:33.259664 (+   287us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.259825 (+   161us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:33.429601 (+169776us) raft_consensus.cc:1685] finished
0709 12:24:33.452981 (+ 23380us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:33.471422 (+ 18441us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":92696,"prepare.queue_time_us":355482,"prepare.run_cpu_time_us":5588,"prepare.run_wall_time_us":72810,"raft.queue_time_us":31539,"raft.run_cpu_time_us":338,"raft.run_wall_time_us":43398,"spinlock_wait_cycles":169741568,"thread_start_us":1087301,"threads_started":2,"wal-append.queue_time_us":802683}
I20260709 12:24:33.508882 29256 consensus_queue.cc:1059] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:33.474252 29135 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:33.471349 29244 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:33.478185 29127 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:33.453555 29260 consensus_queue.cc:1059] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
W20260709 12:24:33.521324 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 264771us
W20260709 12:24:33.499361 25652 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.085s	user 0.010s	sys 0.013s
I20260709 12:24:33.492746 29082 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:33.530176 29323 log.cc:927] Time spent T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.227s	user 0.000s	sys 0.000s
I20260709 12:24:33.523964 25759 rpcz_store.cc:276] 0709 12:24:31.944723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.944872 (+   149us) service_pool.cc:224] Handling call
0709 12:24:31.945147 (+   275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:31.945479 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:24:31.966534 (+ 21055us) log.cc:844] Serialized 14 byte log entry
0709 12:24:33.142868 (+1176334us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:33.149335 (+  6467us) log.cc:844] Serialized 26 byte log entry
0709 12:24:33.149496 (+   161us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:33.149529 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.149595 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:33.492781 (+343186us) raft_consensus.cc:1685] finished
0709 12:24:33.492800 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:33.492919 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":376884,"prepare.run_cpu_time_us":816,"prepare.run_wall_time_us":2973,"raft.queue_time_us":290155,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":10574,"spinlock_wait_cycles":25183488,"thread_start_us":1132286,"threads_started":1,"wal-append.queue_time_us":1425046}
I20260709 12:24:33.507601 29214 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:33.526453 26402 leader_election.cc:336] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 1.815s (SENT)
I20260709 12:24:33.497941 29268 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:33.552420 26402 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
W20260709 12:24:33.540001 25652 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.141s	user 0.011s	sys 0.014s
I20260709 12:24:33.529245 29209 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:33.532958 28987 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:33.555908 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:33.555774 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:33.558422 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
W20260709 12:24:33.555856 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 525184us
I20260709 12:24:33.530880 29235 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:33.531374 29189 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:33.502020 29252 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:33.571853 25832 raft_consensus.cc:2393] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 8: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:33.588943 25832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41782 (request call id 776) took 1281 ms. Trace:
I20260709 12:24:33.589879 25678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40230 (request call id 1517) took 1661 ms. Trace:
I20260709 12:24:33.589447 25832 rpcz_store.cc:276] 0709 12:24:32.307997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.573308 (+265311us) service_pool.cc:224] Handling call
0709 12:24:33.588690 (+1015382us) spinlock_profiling.cc:243] Waited 902 ms on lock 0x7b54004213d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:33.588867 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2075096832}
I20260709 12:24:33.590253 25678 rpcz_store.cc:276] 0709 12:24:31.928330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.928585 (+   255us) service_pool.cc:224] Handling call
0709 12:24:31.928950 (+   365us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:32.007820 (+ 78870us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:32.007850 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:32.019643 (+ 11793us) log.cc:844] Serialized 52 byte log entry
0709 12:24:33.369857 (+1350214us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:33.369910 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.370000 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:33.589673 (+219673us) raft_consensus.cc:1685] finished
0709 12:24:33.589694 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:33.589825 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":96038,"raft.queue_time_us":65348,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":15429,"thread_start_us":1271728,"threads_started":1,"wal-append.queue_time_us":1532523}
W20260709 12:24:33.573599 29330 log.cc:927] Time spent T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 12:24:33.591830 28987 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:33.592398 25682 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40230 (request call id 1512) took 2432 ms (client timeout 1923 ms). Trace:
I20260709 12:24:33.592974 29082 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:33.592906 25682 rpcz_store.cc:269] 0709 12:24:31.159760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.160156 (+   396us) service_pool.cc:224] Handling call
0709 12:24:33.592124 (+2431968us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b5400233554. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:33.592297 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3401144192}
I20260709 12:24:33.593958 28987 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:33.594120 29210 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:33.594336 29231 raft_consensus.cc:2749] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:33.594475 28987 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:33.594635 29210 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:33.595089 29231 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:33.594990 28987 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:33.595942 25761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 2679) took 1643 ms. Trace:
I20260709 12:24:33.536509 29135 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:33.596321 25761 rpcz_store.cc:276] 0709 12:24:31.952502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.447430 (+494928us) service_pool.cc:224] Handling call
0709 12:24:32.447722 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:32.950274 (+502552us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.595691 (+645417us) spinlock_profiling.cc:243] Waited 388 ms on lock 0x7b54001a72d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:33.595855 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":893097344}
W20260709 12:24:33.579885 29322 log.cc:927] Time spent T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
W20260709 12:24:33.580119 29334 log.cc:927] Time spent T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.351s	user 0.002s	sys 0.000s
I20260709 12:24:33.582738 29228 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:33.582978 29242 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:33.584928 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:33.585187 28633 raft_consensus.cc:3055] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:33.579886 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:33.619741 25837 raft_consensus.cc:2468] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 8.
I20260709 12:24:33.621357 29243 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:33.621984 29243 raft_consensus.cc:3060] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:33.591014 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:33.595606 29231 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:33.531610 29136 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:33.573288 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:33.549517 29267 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:33.587620 29246 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:33.554657 29260 consensus_queue.cc:1243] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer a866ff967d964388a6f0dff7fd43df89 log is divergent from this leader: its last log entry 5.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:24:33.631948 29210 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:33.633107 29179 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:33.634238 29312 log.cc:927] Time spent T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.605s	user 0.000s	sys 0.001s
I20260709 12:24:33.536279 29244 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:33.635910 29327 log.cc:927] Time spent T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.296s	user 0.001s	sys 0.001s
I20260709 12:24:33.636950 29244 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:33.611547 29250 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:33.612206 29233 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:33.609529 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 49822.1us
I20260709 12:24:33.553783 29214 raft_consensus.cc:3060] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:33.521464 29346 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:33.614593 25836 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 7.
W20260709 12:24:33.617933 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 91521.3us
I20260709 12:24:33.625656 25830 raft_consensus.cc:2468] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 7.
W20260709 12:24:33.662905 26402 leader_election.cc:336] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 1.828s (SENT)
I20260709 12:24:33.626395 25832 raft_consensus.cc:2468] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 8.
I20260709 12:24:33.663307 26402 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:33.629359 29267 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:33.597244 29209 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:33.631002 29136 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:33.682441 25831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 2628) took 1770 ms. Trace:
W20260709 12:24:33.640025 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 455855us
I20260709 12:24:33.619421 28633 raft_consensus.cc:740] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:33.666523 29127 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:33.600797 29235 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:33.674490 29116 raft_consensus.cc:2749] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:33.676513 29267 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:33.697552 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:33.700870 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:33.660324 28988 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:33.682853 25831 rpcz_store.cc:276] 0709 12:24:31.912458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.918825 (+  6367us) service_pool.cc:224] Handling call
0709 12:24:31.939177 (+ 20352us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:31.939637 (+   460us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:31.939677 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:31.966797 (+ 27120us) log.cc:844] Serialized 52 byte log entry
0709 12:24:33.135421 (+1168624us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:33.663740 (+528319us) log.cc:844] Serialized 14 byte log entry
0709 12:24:33.682141 (+ 18401us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.682213 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:33.682253 (+    40us) raft_consensus.cc:1685] finished
0709 12:24:33.682265 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:33.682390 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22494,"raft.queue_time_us":3119,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":10606,"thread_start_us":1583617,"threads_started":2,"wal-append.queue_time_us":1343724}
I20260709 12:24:33.707466 26431 raft_consensus.cc:2468] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 6.
I20260709 12:24:33.708608 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:33.709331 26431 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 14.
I20260709 12:24:33.710325 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:33.710937 26431 raft_consensus.cc:3060] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:33.707660 25761 raft_consensus.cc:2410] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:24:33.712143 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:33.713191 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:33.713693 26432 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 5.
I20260709 12:24:33.718900 29235 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:33.646718 29250 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:33.734748 29196 consensus_meta.cc:287] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 1.137s	user 0.012s	sys 0.000s
I20260709 12:24:33.744874 25679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51578 (request call id 710) took 1807 ms. Trace:
I20260709 12:24:33.746696 26431 raft_consensus.cc:2468] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 8.
I20260709 12:24:33.732492 29135 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:33.720175 29127 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:33.725260 28988 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:33.745383 25679 rpcz_store.cc:276] 0709 12:24:31.937639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.938081 (+   442us) service_pool.cc:224] Handling call
0709 12:24:31.938427 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:31.938665 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:31.938704 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:31.953969 (+ 15265us) log.cc:844] Serialized 26 byte log entry
0709 12:24:32.316545 (+362576us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:33.223823 (+907278us) log.cc:844] Serialized 14 byte log entry
0709 12:24:33.228548 (+  4725us) spinlock_profiling.cc:243] Waited 18.3 ms on lock 0x7b18000b8ae0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d96a743f3 00007f5d96a767c1 00007f5d96a76779 00007f5d96a76709 00007f5d96a766d1 00007f5d96a759cd 0000000000388634 0000000000388479 00007f5d96a5783a
0709 12:24:33.579570 (+351022us) spinlock_profiling.cc:243] Waited 5.17 ms on lock 0x7b4400022b4c. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db 00007f5d99708aaf 00007f5d996fc86e 00007f5d996fbbb6 00007f5d996fb7d8 00007f5d99705221 00007f5d997051d9 00007f5d99705169
0709 12:24:33.647988 (+ 68418us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.648098 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:33.744641 (+ 96543us) raft_consensus.cc:1685] finished
0709 12:24:33.744666 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:33.744817 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72027,"prepare.queue_time_us":154630,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":26879,"raft.run_cpu_time_us":54,"raft.run_wall_time_us":54,"spinlock_wait_cycles":54019328,"thread_start_us":1485325,"threads_started":3,"wal-append.queue_time_us":609126}
W20260709 12:24:33.742882 29320 log.cc:927] Time spent T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 1.201s	user 0.003s	sys 0.000s
W20260709 12:24:33.765036 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:33.823432 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:33.750712 28987 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:33.843039 25801 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:33.843734 26402 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:33.844815 25801 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
W20260709 12:24:33.848766 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:33.852195 25801 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:24:33.854876 29357 log.cc:927] Time spent T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 12:24:33.858692 29179 raft_consensus.cc:2749] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:33.859851 29360 raft_consensus.cc:2804] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:33.860440 29360 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:33.860859 29360 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:33.861373 29242 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:33.862963 29250 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:33.751602 29196 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:33.866679 29296 consensus_queue.cc:1048] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 12:24:33.894641 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:33.865181 25801 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:33.895308 25757 raft_consensus.cc:2368] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 7. Current term is 8.
I20260709 12:24:33.895902 25801 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:33.896521 26401 leader_election.cc:400] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267) with higher term. Message: Invalid argument: T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 7. Current term is 8.
I20260709 12:24:33.896827 26401 leader_election.cc:403] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:33.873023 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:33.737950 28633 consensus_queue.cc:260] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:33.897965 26433 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.010s	user 0.015s	sys 0.044s
W20260709 12:24:33.873492 29325 log.cc:927] Time spent T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.746s	user 0.000s	sys 0.002s
I20260709 12:24:33.874691 29360 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:33.875505 29252 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:33.876219 29198 raft_consensus.cc:3055] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:24:33.877372 25828 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44218 (request call id 1585) took 2357 ms (client timeout 1570 ms). Trace:
I20260709 12:24:33.921737 25683 raft_consensus.cc:2393] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 10: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
W20260709 12:24:33.921633 25828 rpcz_store.cc:269] 0709 12:24:31.519948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.531578 (+ 11630us) service_pool.cc:224] Handling call
0709 12:24:33.877172 (+2345594us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b5400117954. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:33.877280 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3316782336}
I20260709 12:24:33.885845 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:33.925107 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:33.925839 25755 raft_consensus.cc:2468] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 6.
I20260709 12:24:33.886544 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:33.888849 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:33.889761 29268 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:33.890376 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:33.927222 25760 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 4.
I20260709 12:24:33.892923 29127 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:24:33.893589 29349 log.cc:927] Time spent T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:24:33.879076 29214 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:33.898305 26433 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.011s	user 0.015s	sys 0.044s
I20260709 12:24:33.896981 25801 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:33.898684 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:33.849112 29135 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:33.930639 29214 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:33.931288 25801 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:33.931073 29135 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:33.931695 28949 raft_consensus.cc:2804] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:24:33.932152 28949 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:33.932646 28949 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:33.933701 29135 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:33.866902 29346 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:33.927388 25763 raft_consensus.cc:3060] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:24:33.921343 29198 raft_consensus.cc:740] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:33.937429 29198 consensus_queue.cc:260] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:33.931406 25756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48606 (request call id 866) took 2064 ms. Trace:
I20260709 12:24:33.938838 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:33.939399 25757 raft_consensus.cc:3060] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:33.938794 25756 rpcz_store.cc:276] 0709 12:24:31.867090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.867289 (+   199us) service_pool.cc:224] Handling call
0709 12:24:31.867707 (+   418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:33.217761 (+1350054us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:33.217800 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:33.218302 (+   502us) log.cc:844] Serialized 26 byte log entry
0709 12:24:33.671926 (+453624us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:33.671967 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.891379 (+219412us) spinlock_profiling.cc:243] Waited 656 ms on lock 0x7b54003971d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:33.891443 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:33.931126 (+ 39683us) raft_consensus.cc:1685] finished
0709 12:24:33.931146 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:33.931351 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":27995,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":29229,"spinlock_wait_cycles":1508300032,"thread_start_us":1048422,"threads_started":2,"wal-append.queue_time_us":646465}
I20260709 12:24:33.941375 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:33.941571 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:33.942430 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:33.942910 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:33.944466 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:33.944636 29268 raft_consensus.cc:2804] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:33.945170 29268 raft_consensus.cc:697] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 8 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:33.945993 29268 consensus_queue.cc:237] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:33.946489 25800 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:33.948601 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:33.903574 29089 raft_consensus.cc:2804] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:33.952510 25763 raft_consensus.cc:2468] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 8.
I20260709 12:24:33.900630 28657 raft_consensus.cc:2749] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:33.963267 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:33.964710 25678 raft_consensus.cc:1240] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:33.966141 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:33.950347 25800 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:33.943610 25760 raft_consensus.cc:2468] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 7.
I20260709 12:24:33.949285 25755 raft_consensus.cc:2468] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 9.
I20260709 12:24:33.968832 25755 raft_consensus.cc:1275] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:24:33.970388 25755 raft_consensus.cc:1275] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:24:33.970763 25755 pending_rounds.cc:85] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 4
I20260709 12:24:33.971037 25755 pending_rounds.cc:107] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:24:33.971310 25755 raft_consensus.cc:2889] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:33.954623 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:24:33.954813 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:33.955435 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:33.959312 25834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41782 (request call id 774) took 1844 ms. Trace:
I20260709 12:24:33.947947 29189 raft_consensus.cc:2804] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:33.974867 26431 raft_consensus.cc:2410] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 12:24:33.923193 29231 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:33.977077 25757 raft_consensus.cc:2410] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:24:33.982139 25682 raft_consensus.cc:1240] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 8 LEADER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:33.984110 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:33.951484 28633 raft_consensus.cc:3060] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:33.990438 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:33.991295 25678 raft_consensus.cc:2468] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 7.
I20260709 12:24:33.992471 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:33.993125 25678 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:33.994801 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:33.995213 25684 raft_consensus.cc:1240] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 7. Current term is 9. Ops: [7.8-7.8]
I20260709 12:24:33.996639 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:33.911825 29243 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:33.988130 25835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 2618) took 2241 ms. Trace:
I20260709 12:24:33.921357 29210 consensus_queue.cc:1048] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 12:24:34.005944 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:34.006248 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 55989.9us
I20260709 12:24:34.006574 25682 raft_consensus.cc:2468] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 7.
I20260709 12:24:33.963068 29179 raft_consensus.cc:2749] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:33.958746 29089 raft_consensus.cc:697] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 11 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:33.952814 29260 consensus_queue.cc:1048] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:24:33.962570 29245 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:33.974606 25834 rpcz_store.cc:276] 0709 12:24:32.115443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.854694 (+739251us) service_pool.cc:224] Handling call
0709 12:24:32.854999 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:32.876805 (+ 21806us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:32.876840 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:32.917751 (+ 40911us) log.cc:844] Serialized 26 byte log entry
0709 12:24:33.521713 (+603962us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:24:33.958748 (+437035us) log.cc:844] Serialized 14 byte log entry
0709 12:24:33.958990 (+   242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.959102 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:33.959138 (+    36us) raft_consensus.cc:1685] finished
0709 12:24:33.959150 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:33.959259 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21388,"prepare.queue_time_us":383695,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":37021,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":25888,"thread_start_us":886988,"threads_started":2,"wal-append.queue_time_us":632399}
I20260709 12:24:34.021507 25800 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:33.976234 29355 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:34.022667 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:33.982012 29189 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:34.023880 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:34.029897 25682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
mode: GRACEFUL
new_leader_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:49108
I20260709 12:24:34.033870 25682 raft_consensus.cc:606] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Received request to transfer leadership to TS 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:24:34.030668 26431 raft_consensus.cc:2468] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 7.
I20260709 12:24:34.034258 25682 raft_consensus.cc:614] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:34.024652 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:34.003557 25835 rpcz_store.cc:276] 0709 12:24:31.734272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.737465 (+  3193us) service_pool.cc:224] Handling call
0709 12:24:31.737754 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:31.738071 (+   317us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:31.738099 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:31.738509 (+   410us) log.cc:844] Serialized 26 byte log entry
0709 12:24:32.020480 (+281971us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:32.020542 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.021562 (+  1020us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:33.872819 (+1851257us) spinlock_profiling.cc:243] Waited 32.7 ms on lock 0x7b4400022b4c. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db 00007f5d99708aaf 00007f5d996fc86e 00007f5d996fbbb6 00007f5d996fb7d8 00007f5d99705221 00007f5d997051d9 00007f5d99705169
0709 12:24:33.963680 (+ 90861us) raft_consensus.cc:1685] finished
0709 12:24:33.963698 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:33.976110 (+ 12412us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6703,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":76,"spinlock_wait_cycles":75116800,"thread_start_us":281296,"threads_started":1,"wal-append.queue_time_us":1157941}
I20260709 12:24:34.021507 29296 raft_consensus.cc:2804] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:24:34.027227 29239 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.010s	sys 0.009s
W20260709 12:24:34.069754 29239 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.010s	sys 0.010s
I20260709 12:24:34.070405 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:34.071039 25682 raft_consensus.cc:2468] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 5.
I20260709 12:24:34.067320 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:34.074458 25684 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:34.038041 29257 consensus_meta.cc:287] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.561s	user 0.006s	sys 0.005s
I20260709 12:24:34.075614 25681 raft_consensus.cc:1275] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:24:34.077178 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:34.077862 26431 raft_consensus.cc:2393] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 11: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:34.079304 25681 raft_consensus.cc:1275] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:24:34.043092 29362 raft_consensus.cc:2804] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:34.042012 29189 raft_consensus.cc:3060] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:34.074079 28903 consensus_meta.cc:287] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.543s	user 0.011s	sys 0.000s
I20260709 12:24:34.068396 29296 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:34.042872 29245 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:34.120733 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:34.125938 26431 raft_consensus.cc:2468] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 9.
I20260709 12:24:34.126127 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:34.102998 29362 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:34.130656 26439 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 896) took 2139 ms (client timeout 1748 ms). Trace:
W20260709 12:24:34.130759 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 283012us
I20260709 12:24:34.132515 25754 raft_consensus.cc:1240] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:34.111497 25678 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 11.
W20260709 12:24:34.132997 26439 rpcz_store.cc:269] 0709 12:24:31.985715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.001398 (+ 15683us) service_pool.cc:224] Handling call
0709 12:24:34.123452 (+2122054us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b5400711454. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:34.123620 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":481891712}
I20260709 12:24:34.134045 25650 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:34.042583 29355 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:34.111968 28903 raft_consensus.cc:2749] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:34.117321 29296 raft_consensus.cc:3060] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:34.152159 25679 raft_consensus.cc:3060] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:34.082916 29257 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:34.135363 29362 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:34.152179 29210 raft_consensus.cc:2804] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:34.174021 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:34.172473 25679 raft_consensus.cc:2468] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 5.
I20260709 12:24:34.174789 25678 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 14.
I20260709 12:24:34.175968 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:34.176990 25678 raft_consensus.cc:2410] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 13 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
W20260709 12:24:34.179105 25762 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53474 (request call id 2674) took 2432 ms (client timeout 2838 ms). Trace:
I20260709 12:24:34.181572 26436 raft_consensus.cc:1240] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:34.183637 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:34.184233 25758 raft_consensus.cc:3060] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:34.184916 25801 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:34.186856 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:34.187397 25763 raft_consensus.cc:3060] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:34.179507 25762 rpcz_store.cc:269] 0709 12:24:31.747045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.763213 (+ 16168us) service_pool.cc:224] Handling call
0709 12:24:34.174682 (+2411469us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b5400041fd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:34.179045 (+  4363us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3103972608}
I20260709 12:24:34.193192 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:34.194082 25678 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 10.
I20260709 12:24:34.195143 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:34.199127 25678 raft_consensus.cc:2468] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 6.
I20260709 12:24:34.199182 25801 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:34.200431 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:34.204944 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:34.205672 25678 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 5.
I20260709 12:24:34.206638 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:34.209712 29317 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:34.210247 29317 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:34.212270 29368 log.cc:927] Time spent T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
W20260709 12:24:34.215258 29382 log.cc:927] Time spent T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 12:24:34.216236 29379 log.cc:927] Time spent T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:24:34.217166 29257 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:34.218004 29316 raft_consensus.cc:3055] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:34.218415 29316 raft_consensus.cc:740] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
W20260709 12:24:34.219489 25680 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51578 (request call id 711) took 1637 ms (client timeout 1567 ms). Trace:
W20260709 12:24:34.219889 25680 rpcz_store.cc:269] 0709 12:24:32.582324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.591332 (+  9008us) service_pool.cc:224] Handling call
0709 12:24:34.219285 (+1627953us) spinlock_profiling.cc:243] Waited 565 ms on lock 0x7b54002a58d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:34.219404 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1298698496}
I20260709 12:24:34.224934 25650 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:34.229389 29209 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:34.233276 25677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40230 (request call id 1522) took 2291 ms. Trace:
I20260709 12:24:34.234812 25801 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:34.233793 25677 rpcz_store.cc:276] 0709 12:24:31.941625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.983876 (+ 42251us) service_pool.cc:224] Handling call
0709 12:24:32.007952 (+ 24076us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:32.462860 (+454908us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:32.878408 (+415548us) log.cc:844] Serialized 14 byte log entry
0709 12:24:33.476088 (+597680us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:33.476142 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:33.476180 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.232950 (+756770us) spinlock_profiling.cc:243] Waited 455 ms on lock 0x7b5400159d54. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:34.233016 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:34.233173 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90756,"prepare.queue_time_us":314716,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":9744,"raft.queue_time_us":22856,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":112,"spinlock_wait_cycles":1045460352,"thread_start_us":879359,"threads_started":2,"wal-append.queue_time_us":742562}
I20260709 12:24:34.235889 25801 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:34.238505 25763 raft_consensus.cc:2468] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 10.
I20260709 12:24:34.240255 28657 raft_consensus.cc:2749] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:34.240862 29092 raft_consensus.cc:2749] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:34.241600 29229 raft_consensus.cc:2804] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:34.241977 29229 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:34.242332 29229 raft_consensus.cc:3060] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:34.237927 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 49153.7us
I20260709 12:24:34.242863 29355 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:34.134876 29089 consensus_queue.cc:237] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:34.160778 29082 consensus_queue.cc:1059] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:24:34.201579 28840 raft_consensus.cc:2804] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:34.196659 29360 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:34.186954 29210 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
W20260709 12:24:34.249215 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 352790us
W20260709 12:24:34.269214 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 44396.7us
I20260709 12:24:34.168502 28949 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:34.251520 26433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 904) took 1484 ms. Trace:
I20260709 12:24:34.256286 25684 raft_consensus.cc:2468] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 7.
I20260709 12:24:34.274495 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:34.275147 25759 raft_consensus.cc:2468] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 9.
I20260709 12:24:34.276603 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:34.277225 26432 raft_consensus.cc:3060] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:34.278262 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:34.257612 25758 raft_consensus.cc:2410] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:24:34.278895 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
W20260709 12:24:34.247177 29369 log.cc:927] Time spent T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.245s	user 0.000s	sys 0.001s
I20260709 12:24:34.266086 25649 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:34.271121 26433 rpcz_store.cc:276] 0709 12:24:32.766810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.767050 (+   240us) service_pool.cc:224] Handling call
0709 12:24:32.802702 (+ 35652us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:32.802967 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:33.929788 (+1126821us) log.cc:844] Serialized 14 byte log entry
0709 12:24:34.251228 (+321440us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:34.251276 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:34.251316 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.251382 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:34.251473 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":130649,"prepare.queue_time_us":830751,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":131430,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":3085,"thread_start_us":1232622,"threads_started":2,"wal-append.queue_time_us":244165}
I20260709 12:24:34.267122 29317 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:34.258935 25726 leader_election.cc:400] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 election: Vote denied by peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) with higher term. Message: Invalid argument: T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 7. Current term is 8.
I20260709 12:24:34.273176 29210 raft_consensus.cc:3060] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:34.247059 29198 raft_consensus.cc:3060] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:34.249606 28967 raft_consensus.cc:3060] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:24:34.285218 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:34.285290 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:34.285840 26401 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:34.249044 29358 raft_consensus.cc:2749] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:34.247077 29245 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:34.290845 25726 leader_election.cc:403] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 12:24:34.323381 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 64640.1us
I20260709 12:24:34.257113 28840 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:34.292567 25650 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:34.293161 26432 raft_consensus.cc:2468] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 9.
I20260709 12:24:34.277863 29305 consensus_queue.cc:1048] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:24:34.303079 26433 raft_consensus.cc:1275] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:24:34.305751 26437 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:34.312124 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:34.282147 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:34.286625 29243 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:34.326864 25649 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:34.281173 29228 consensus_queue.cc:1048] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:24:34.281654 29260 raft_consensus.cc:2749] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:34.329820 26438 raft_consensus.cc:1240] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:24:34.329675 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:34.330302 25650 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:34.388608 26432 raft_consensus.cc:2376] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 9. Re-sending same reply.
I20260709 12:24:34.330802 29308 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
W20260709 12:24:34.384171 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 59827.5us
I20260709 12:24:34.391631 26435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 903) took 1703 ms. Trace:
I20260709 12:24:34.334120 26434 raft_consensus.cc:1275] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 9 LEARNER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:24:34.384280 26430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 902) took 1763 ms. Trace:
I20260709 12:24:34.387719 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:34.393364 26433 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 5.
I20260709 12:24:34.389475 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:34.394349 26435 rpcz_store.cc:276] 0709 12:24:32.696592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.700643 (+  4051us) service_pool.cc:224] Handling call
0709 12:24:32.750009 (+ 49366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:32.750277 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:33.355333 (+605056us) log.cc:844] Serialized 14 byte log entry
0709 12:24:33.819698 (+464365us) log.cc:844] Serialized 14 byte log entry
0709 12:24:34.241841 (+422143us) spinlock_profiling.cc:243] Waited 3.43 ms on lock 0x7b18003aefa0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d969eec0a 00007f5da012e219 00007f5d96a76a40 00007f5d96a714e4 00007f5d96a71455 00007f5d99b59060 00007f5d99b6b716 00007f5d99b7c287 00007f5d99b7c208
0709 12:24:34.242254 (+   413us) log.cc:844] Serialized 14 byte log entry
0709 12:24:34.332381 (+ 90127us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:34.332439 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:34.332491 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.333595 (+  1104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:34.391555 (+ 57960us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":457594,"prepare.queue_time_us":873288,"prepare.run_cpu_time_us":135,"prepare.run_wall_time_us":138,"raft.queue_time_us":498521,"raft.run_cpu_time_us":332,"raft.run_wall_time_us":27346,"spinlock_wait_cycles":7886720,"thread_start_us":1052077,"threads_started":3,"wal-append.queue_time_us":646331}
W20260709 12:24:34.397686 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:34.392319 25726 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:34.394258 26430 rpcz_store.cc:276] 0709 12:24:32.621408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.621594 (+   186us) service_pool.cc:224] Handling call
0709 12:24:32.670022 (+ 48428us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:24:32.670440 (+   418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:32.670472 (+    32us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:24:32.671163 (+   691us) log.cc:844] Serialized 78 byte log entry
0709 12:24:33.431149 (+759986us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:33.817695 (+386546us) log.cc:844] Serialized 14 byte log entry
0709 12:24:33.838904 (+ 21209us) log.cc:844] Serialized 14 byte log entry
0709 12:24:34.383905 (+545001us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.384009 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:34.384048 (+    39us) raft_consensus.cc:1685] finished
0709 12:24:34.384059 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:34.384225 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":415900,"prepare.queue_time_us":230908,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":891,"raft.queue_time_us":850175,"raft.run_cpu_time_us":339,"raft.run_wall_time_us":16796,"thread_start_us":1140828,"threads_started":3,"wal-append.queue_time_us":839844}
I20260709 12:24:34.327299 28959 raft_consensus.cc:2804] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:34.303231 29317 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
W20260709 12:24:34.400547 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 73770.4us
W20260709 12:24:34.401223 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 71010.8us
I20260709 12:24:34.411618 25835 pending_rounds.cc:85] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a: Aborting all ops after (but not including) 2
I20260709 12:24:34.455154 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:34.457140 25835 pending_rounds.cc:107] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 12:24:34.457576 25835 raft_consensus.cc:2889] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:34.457899 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:34.458581 26439 raft_consensus.cc:2468] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 7.
I20260709 12:24:34.411738 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:34.332039 29346 raft_consensus.cc:2749] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) with higher term. Message: Invalid argument: T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 7. Current term is 8.
I20260709 12:24:34.459934 25834 raft_consensus.cc:3060] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:34.401921 29231 raft_consensus.cc:2804] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:34.332326 28840 raft_consensus.cc:3060] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:34.390194 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 546467us
I20260709 12:24:34.480640 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:34.322252 29268 consensus_queue.cc:1048] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.139s
I20260709 12:24:34.489518 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:34.489883 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:34.481077 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:34.399562 29243 raft_consensus.cc:2749] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:34.409490 29235 raft_consensus.cc:2804] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:34.409376 29245 raft_consensus.cc:2804] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:34.498808 25832 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 10.
I20260709 12:24:34.499457 26437 raft_consensus.cc:2468] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 8.
I20260709 12:24:34.521835 26437 raft_consensus.cc:1275] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:24:34.413332 28959 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:34.528647 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:34.529482 25828 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 12.
I20260709 12:24:34.462740 29252 consensus_queue.cc:1059] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:24:34.503204 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:34.301846 29377 consensus_queue.cc:1048] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.190s
I20260709 12:24:34.504733 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:34.533274 25833 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:34.505729 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:34.509858 29354 raft_consensus.cc:3055] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:34.491184 29231 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:34.538255 25837 raft_consensus.cc:2393] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 15: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
W20260709 12:24:34.514408 29386 log.cc:927] Time spent T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
W20260709 12:24:34.466547 29338 log.cc:927] Time spent T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:24:34.412706 29257 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:34.391570 29242 consensus_queue.cc:1048] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.108s
I20260709 12:24:34.534106 28959 raft_consensus.cc:3060] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:34.500890 26402 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:34.551011 25836 raft_consensus.cc:1240] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 8 LEADER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:34.410547 29355 consensus_queue.cc:1048] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.117s
I20260709 12:24:34.561513 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:34.565215 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 166286us
I20260709 12:24:34.586236 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:34.535666 29245 raft_consensus.cc:697] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 10 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:34.410945 29367 consensus_queue.cc:1048] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.140s
I20260709 12:24:34.550874 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:34.531102 29235 raft_consensus.cc:697] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:34.602531 29235 consensus_queue.cc:237] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:34.586753 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 85933.1us
I20260709 12:24:34.605937 26402 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:34.402647 29308 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:24:34.485666 29317 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:34.588838 29127 raft_consensus.cc:2749] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:34.555222 29231 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:34.537611 29354 raft_consensus.cc:740] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
W20260709 12:24:34.598398 29404 log.cc:927] Time spent T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:24:34.601147 29196 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:34.610592 25833 raft_consensus.cc:2468] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 8.
I20260709 12:24:34.612982 26402 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:34.608613 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:34.616194 29401 raft_consensus.cc:2749] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:34.588025 29257 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:34.616549 29340 consensus_queue.cc:1059] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:24:34.592139 29403 log.cc:927] Time spent T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.198s	user 0.002s	sys 0.000s
I20260709 12:24:34.640579 28949 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:34.617452 29400 consensus_queue.cc:1059] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:34.667781 25758 raft_consensus.cc:1240] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:34.639596 29082 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:34.691182 29346 raft_consensus.cc:3055] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:34.691833 29346 raft_consensus.cc:740] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:34.692914 29346 consensus_queue.cc:260] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:34.694242 29346 raft_consensus.cc:3060] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:34.655661 25834 raft_consensus.cc:2468] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 9.
I20260709 12:24:34.714378 26437 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e"
dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
mode: GRACEFUL
new_leader_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:35548
I20260709 12:24:34.715328 26437 raft_consensus.cc:606] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Received request to transfer leadership to TS 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:24:34.715839 26437 raft_consensus.cc:614] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:34.649923 29360 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:34.725431 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 112509us
W20260709 12:24:34.726758 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 448791us
I20260709 12:24:34.754791 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:34.802194 26433 raft_consensus.cc:1275] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:24:34.810739 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 84238us
W20260709 12:24:34.814060 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:34.815951 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:34.823709 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:34.824668 26437 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:34.610142 29296 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:34.839690 29189 consensus_meta.cc:287] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.727s	user 0.008s	sys 0.004s
I20260709 12:24:34.719261 29245 consensus_queue.cc:237] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:34.862627 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 51101.9us
I20260709 12:24:34.884070 26437 raft_consensus.cc:2468] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 7.
W20260709 12:24:34.870589 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:34.970903 26402 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:24:34.965833 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:34.971946 26433 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:24:34.976708 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.004434 25801 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:35.005825 25834 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:24:34.811967 29401 raft_consensus.cc:2749] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:24:34.870033 29404 log.cc:927] Time spent T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
W20260709 12:24:35.056468 29209 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.006s	sys 0.018s
W20260709 12:24:35.058701 26439 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.014s	sys 0.032s
W20260709 12:24:35.077739 26439 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.014s	sys 0.032s
W20260709 12:24:35.059789 25650 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.004s	sys 0.024s
W20260709 12:24:35.058911 28657 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.010s	sys 0.007s
W20260709 12:24:35.062074 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 471852us
W20260709 12:24:35.064399 25649 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.083s	sys 0.130s
I20260709 12:24:35.070490 25831 raft_consensus.cc:2393] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 6: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:34.720588 28949 consensus_queue.cc:1059] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.247s
W20260709 12:24:35.181325 25649 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.084s	sys 0.130s
W20260709 12:24:35.078975 25650 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.004s	sys 0.024s
I20260709 12:24:34.720933 29082 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:35.184679 25834 raft_consensus.cc:606] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Received request to transfer leadership to TS 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:35.184912 25726 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:35.185261 25834 raft_consensus.cc:614] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:24:35.182209 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 724040us
W20260709 12:24:35.181722 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 724208us
I20260709 12:24:35.188580 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:35.189193 25757 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 4.
I20260709 12:24:34.648651 29354 consensus_queue.cc:260] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:35.191294 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:35.198196 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:35.199126 25757 raft_consensus.cc:2410] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
W20260709 12:24:35.202210 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 532517us
W20260709 12:24:35.165823 29390 log.cc:927] Time spent T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.297s	user 0.001s	sys 0.000s
I20260709 12:24:34.834764 29360 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:35.211665 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:35.171459 29209 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.007s	sys 0.018s
W20260709 12:24:35.180126 28657 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.011s	sys 0.007s
W20260709 12:24:35.191959 25755 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.009s	sys 0.000s
I20260709 12:24:35.221697 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:35.237421 25761 raft_consensus.cc:2393] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 5: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:34.978696 29189 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:35.227767 25757 raft_consensus.cc:1275] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:24:35.238106 25755 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.010s	sys 0.000s
I20260709 12:24:35.246047 25680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2199) took 1198 ms. Trace:
I20260709 12:24:35.246567 25680 rpcz_store.cc:276] 0709 12:24:34.047251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.220722 (+173471us) service_pool.cc:224] Handling call
0709 12:24:34.221037 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:34.221242 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:24:34.565803 (+344561us) log.cc:844] Serialized 14 byte log entry
0709 12:24:35.245653 (+679850us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:35.245711 (+    58us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:24:35.245769 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:35.245854 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:35.245979 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20105,"prepare.queue_time_us":97246,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"thread_start_us":1003555,"threads_started":3}
I20260709 12:24:35.252285 25837 raft_consensus.cc:3060] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:35.265591 25837 raft_consensus.cc:2468] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 7.
I20260709 12:24:35.225539 29354 raft_consensus.cc:3060] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:35.270846 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:35.225040 29244 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.003s	sys 0.007s
W20260709 12:24:35.283300 25682 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.745s	user 0.024s	sys 0.028s
W20260709 12:24:35.286908 25682 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.024s	sys 0.028s
I20260709 12:24:35.288254 25682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2197) took 1241 ms. Trace:
I20260709 12:24:35.296716 25682 rpcz_store.cc:276] 0709 12:24:34.046692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.081076 (+ 34384us) service_pool.cc:224] Handling call
0709 12:24:34.081533 (+   457us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:34.081771 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:24:34.293181 (+211410us) log.cc:844] Serialized 14 byte log entry
0709 12:24:34.534598 (+241417us) log.cc:844] Serialized 14 byte log entry
0709 12:24:35.287515 (+752917us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:35.287725 (+   210us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:35.287785 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:35.288032 (+   247us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:35.288185 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28475,"prepare.queue_time_us":236535,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":8299,"raft.queue_time_us":549316,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":73389,"thread_start_us":1150186,"threads_started":4,"wal-append.queue_time_us":188484}
W20260709 12:24:35.286746 29244 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.004s	sys 0.009s
I20260709 12:24:35.267498 28657 raft_consensus.cc:2749] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:35.268419 29401 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:35.353360 26438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 914) took 1080 ms. Trace:
I20260709 12:24:35.298384 29427 raft_consensus.cc:2804] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:35.369011 29082 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:24:35.370151 29417 log.cc:927] Time spent T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:24:35.370290 29316 consensus_queue.cc:260] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:35.444548 29316 raft_consensus.cc:3060] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:35.446089 28959 consensus_meta.cc:287] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.853s	user 0.010s	sys 0.000s
I20260709 12:24:35.446622 28959 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:35.352238 29308 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:35.448697 29308 consensus_queue.cc:1059] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:35.449597 29308 consensus_queue.cc:1243] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer f82778701b464892aab92a752ed7ffdc log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:24:35.450174 29308 raft_consensus.cc:2804] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:35.450559 29308 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:35.450947 29308 raft_consensus.cc:3060] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:35.453845 29362 consensus_meta.cc:287] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 1.273s	user 0.009s	sys 0.000s
I20260709 12:24:35.454380 29362 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:35.459470 29229 consensus_meta.cc:287] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 1.217s	user 0.006s	sys 0.003s
W20260709 12:24:35.371954 29399 log.cc:927] Time spent T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.397s	user 0.001s	sys 0.000s
I20260709 12:24:35.378126 28988 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:35.470963 29229 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:35.386772 29189 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:35.490097 29340 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:35.490864 29340 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:35.390444 28633 consensus_meta.cc:287] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 1.392s	user 0.007s	sys 0.003s
W20260709 12:24:35.390893 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:35.492947 25685 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51578 (request call id 712) took 2910 ms (client timeout 2148 ms). Trace:
W20260709 12:24:35.493163 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:35.493338 25685 rpcz_store.cc:269] 0709 12:24:32.582648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.582766 (+   118us) service_pool.cc:224] Handling call
0709 12:24:35.492748 (+2909982us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b54002661d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:35.492883 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3536063872}
I20260709 12:24:35.493994 29340 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:35.495003 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:35.495345 26434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 905) took 2664 ms. Trace:
I20260709 12:24:35.393664 29415 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:35.495720 25679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40230 (request call id 1524) took 1537 ms. Trace:
I20260709 12:24:35.469698 29317 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:35.496179 29415 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:35.494679 29340 raft_consensus.cc:3055] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:35.496968 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:35.497347 29340 raft_consensus.cc:740] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:35.497552 25759 raft_consensus.cc:3060] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:24:35.497901 26436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 895) took 1813 ms. Trace:
I20260709 12:24:35.498476 29415 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:35.498272 26436 rpcz_store.cc:276] 0709 12:24:33.684948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.685077 (+   129us) service_pool.cc:224] Handling call
0709 12:24:33.692698 (+  7621us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:34.181966 (+489268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:35.497695 (+1315729us) spinlock_profiling.cc:243] Waited 489 ms on lock 0x7b5400316ad4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:35.497845 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1123841280}
I20260709 12:24:35.499357 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:35.499909 25761 raft_consensus.cc:2468] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 7.
I20260709 12:24:35.500149 25684 raft_consensus.cc:1240] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:35.498335 29340 consensus_queue.cc:260] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:35.501313 25684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2207) took 1330 ms. Trace:
I20260709 12:24:35.501355 29340 raft_consensus.cc:3060] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:35.502118 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:24:35.347628 29390 log.cc:927] Time spent T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:24:35.503901 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:35.431088 26438 rpcz_store.cc:276] 0709 12:24:34.273390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.275875 (+  2485us) service_pool.cc:224] Handling call
0709 12:24:34.276226 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:34.393395 (+117169us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:35.353085 (+959690us) spinlock_profiling.cc:243] Waited 53.4 ms on lock 0x7b5400630e54. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:35.353296 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":122756864}
I20260709 12:24:35.501780 25684 rpcz_store.cc:276] 0709 12:24:34.170849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.273538 (+102689us) service_pool.cc:224] Handling call
0709 12:24:35.499989 (+1226451us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:35.500588 (+   599us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:35.501149 (+   561us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54000b22d0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b608ad 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:35.501257 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2819899264}
I20260709 12:24:35.495741 26434 rpcz_store.cc:276] 0709 12:24:32.830897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.854352 (+ 23455us) service_pool.cc:224] Handling call
0709 12:24:34.333719 (+1479367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:34.392805 (+ 59086us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:35.495146 (+1102341us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b54007cabd0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b608ad 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:35.495265 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3401416960}
I20260709 12:24:35.506206 25754 raft_consensus.cc:1275] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 12:24:35.506517 25754 pending_rounds.cc:85] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 8
I20260709 12:24:35.506731 25754 pending_rounds.cc:107] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:24:35.506948 25754 raft_consensus.cc:2889] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:35.506989 25800 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
W20260709 12:24:35.383841 29210 consensus_meta.cc:287] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 1.061s	user 0.007s	sys 0.003s
I20260709 12:24:35.429785 29358 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:35.461687 29198 consensus_meta.cc:287] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 1.153s	user 0.009s	sys 0.000s
I20260709 12:24:35.465803 28959 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:35.468737 29360 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:24:35.371129 29423 log.cc:927] Time spent T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:24:35.436342 29427 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:35.472067 29252 consensus_queue.cc:1048] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:24:35.477862 28840 consensus_meta.cc:287] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.973s	user 0.009s	sys 0.001s
I20260709 12:24:35.385208 29296 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:35.495630 25758 raft_consensus.cc:2468] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 9.
I20260709 12:24:35.496130 25679 rpcz_store.cc:276] 0709 12:24:33.958773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.962969 (+  4196us) service_pool.cc:224] Handling call
0709 12:24:35.495556 (+1532587us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b54000b22d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:35.495659 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":432568192}
I20260709 12:24:35.501499 25757 raft_consensus.cc:1275] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:35.550187 29409 raft_consensus.cc:3055] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:35.550433 25800 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:35.550668 29409 raft_consensus.cc:740] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:35.551484 29409 consensus_queue.cc:260] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:35.552450 29360 raft_consensus.cc:2804] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:35.552739 29409 raft_consensus.cc:3060] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:35.552882 29360 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:35.553308 29360 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:35.542476 29427 raft_consensus.cc:3060] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:35.514031 25686 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.902s	user 0.010s	sys 0.007s
W20260709 12:24:35.556775 25686 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.945s	user 0.010s	sys 0.007s
I20260709 12:24:35.557631 25686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40230 (request call id 1529) took 1597 ms. Trace:
I20260709 12:24:35.525653 25759 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 6.
W20260709 12:24:35.527153 26433 consensus_meta.cc:287] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.555s	user 0.007s	sys 0.003s
I20260709 12:24:35.529757 25677 raft_consensus.cc:1275] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:35.560957 26433 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 15.
W20260709 12:24:35.561895 25803 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.005s	sys 0.014s
W20260709 12:24:35.562316 25803 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.005s	sys 0.014s
W20260709 12:24:35.516178 25835 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.951s	user 0.035s	sys 0.051s
W20260709 12:24:35.562937 25835 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.998s	user 0.035s	sys 0.051s
I20260709 12:24:35.507540 29425 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:35.564867 26404 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.008s	sys 0.009s
W20260709 12:24:35.566020 26404 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.008s	sys 0.009s
I20260709 12:24:35.530570 29179 raft_consensus.cc:2804] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:35.556398 28840 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:35.530149 29210 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:35.573945 29346 consensus_meta.cc:287] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.879s	user 0.013s	sys 0.000s
W20260709 12:24:35.570287 29231 consensus_meta.cc:287] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.921s	user 0.011s	sys 0.000s
I20260709 12:24:35.576037 29425 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:35.568863 29260 raft_consensus.cc:2804] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:35.558066 25686 rpcz_store.cc:276] 0709 12:24:33.960381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.960489 (+   108us) service_pool.cc:224] Handling call
0709 12:24:33.981572 (+ 21083us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:34.029942 (+ 48370us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:24:34.172016 (+142074us) log.cc:844] Serialized 14 byte log entry
0709 12:24:34.598345 (+426329us) spinlock_profiling.cc:243] Waited 2.48 ms on lock 0x7b1800322ba0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d997094bc 00007f5d96a5748b 00007f5d9f8b19a9 00007f5d96a7369b 00007f5d96a7193f 00007f5d96a73c02 00007f5d996fb20b 00007f5d99700d23 00007f5d9970123a
0709 12:24:34.611803 (+ 13458us) log.cc:844] Serialized 14 byte log entry
0709 12:24:35.388382 (+776579us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b1800322ba0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d969eec0a 00007f5da012e219 00007f5d9da3558f 00007f5d96a74571 00007f5d96a767c1 00007f5d96a76779 00007f5d96a76709 00007f5d96a766d1 00007f5d96a759cd
0709 12:24:35.557238 (+168856us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:35.557302 (+    64us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:35.557352 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:35.557432 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:35.557565 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":219502,"prepare.queue_time_us":267964,"prepare.run_cpu_time_us":118,"prepare.run_wall_time_us":5193,"raft.queue_time_us":1232025,"raft.run_cpu_time_us":526,"raft.run_wall_time_us":53675,"spinlock_wait_cycles":32340224,"thread_start_us":1154054,"threads_started":3,"wal-append.queue_time_us":455957}
W20260709 12:24:35.580307 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 361370us
W20260709 12:24:35.577144 25683 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40230 (request call id 1523) took 3635 ms (client timeout 2464 ms). Trace:
W20260709 12:24:35.596474 25683 rpcz_store.cc:269] 0709 12:24:31.941898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.946348 (+  4450us) service_pool.cc:224] Handling call
0709 12:24:35.576896 (+3630548us) spinlock_profiling.cc:243] Waited 1.94 s on lock 0x7b54000b40d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:35.577062 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4469348608}
I20260709 12:24:35.596701 25650 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:35.598470 25678 raft_consensus.cc:1240] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 6. Current term is 7. Ops: []
W20260709 12:24:35.593999 25801 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.002s	sys 0.021s
I20260709 12:24:35.599500 25650 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:24:35.599171 25801 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.002s	sys 0.021s
W20260709 12:24:35.601046 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 596699us
I20260709 12:24:35.578675 29179 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:35.607060 29179 raft_consensus.cc:3060] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:35.608788 29296 consensus_queue.cc:1048] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:35.611479 29344 consensus_queue.cc:1048] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:24:35.613075 29344 consensus_queue.cc:1048] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:35.614549 29421 consensus_queue.cc:1048] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:35.615989 29421 raft_consensus.cc:2804] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:35.616057 29362 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:35.616523 29421 raft_consensus.cc:697] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 9 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:35.617159 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:35.617491 29421 consensus_queue.cc:237] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:35.532258 29358 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:35.620767 25650 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:35.440821 29401 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:35.600703 29214 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.923s	user 0.024s	sys 0.068s
I20260709 12:24:35.625727 25650 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:35.602520 29381 raft_consensus.cc:2804] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:35.630192 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:35.632042 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:35.626652 25801 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:24:35.624265 28967 consensus_meta.cc:287] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 1.302s	user 0.007s	sys 0.010s
W20260709 12:24:35.640038 25650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.641441 26433 raft_consensus.cc:3060] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:35.630141 29214 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.953s	user 0.024s	sys 0.068s
I20260709 12:24:35.597268 29231 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:35.642911 25801 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:35.653163 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:24:35.653718 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.660436 26436 raft_consensus.cc:3060] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:35.653203 29267 consensus_queue.cc:1059] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:24:35.661183 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:35.661924 25758 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 7.
I20260709 12:24:35.633378 29439 raft_consensus.cc:2804] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:24:35.658658 29413 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.938s	user 0.021s	sys 0.016s
I20260709 12:24:35.633117 28959 raft_consensus.cc:2804] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:35.666327 26433 raft_consensus.cc:2468] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 10.
I20260709 12:24:35.666384 26434 raft_consensus.cc:1275] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:24:35.679621 29344 raft_consensus.cc:2804] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:24:35.707866 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:35.668327 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:35.669781 26436 raft_consensus.cc:2468] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 8.
I20260709 12:24:35.625164 29257 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:35.678395 25650 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:35.644757 29092 raft_consensus.cc:2804] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:35.684350 29229 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:35.658185 28967 raft_consensus.cc:2749] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267) with higher term. Message: Invalid argument: T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 7. Current term is 8.
I20260709 12:24:35.632625 29354 consensus_queue.cc:1048] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:24:35.694675 26432 raft_consensus.cc:2393] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 10: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:35.659293 29381 raft_consensus.cc:697] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 9 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:35.723978 29381 consensus_queue.cc:237] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:35.703068 25829 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41782 (request call id 761) took 3659 ms (client timeout 1847 ms). Trace:
W20260709 12:24:35.725905 25829 rpcz_store.cc:269] 0709 12:24:32.044144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.044301 (+   157us) service_pool.cc:224] Handling call
0709 12:24:35.694640 (+3650339us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b540010b654. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:35.702980 (+  8340us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3624199424}
I20260709 12:24:35.700081 29439 raft_consensus.cc:697] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 8 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:35.705713 29435 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
W20260709 12:24:35.705185 29413 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.986s	user 0.028s	sys 0.016s
I20260709 12:24:35.708758 26430 raft_consensus.cc:3060] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:35.656245 29260 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:35.717296 25650 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:35.711967 29092 raft_consensus.cc:697] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 7 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:35.722121 29429 raft_consensus.cc:2749] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:24:35.744093 25652 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.779s	user 0.020s	sys 0.008s
I20260709 12:24:35.747961 26438 raft_consensus.cc:1275] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:24:35.748979 25677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2204) took 1632 ms. Trace:
W20260709 12:24:35.765897 25652 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.801s	user 0.020s	sys 0.008s
I20260709 12:24:35.760144 25683 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
mode: GRACEFUL
new_leader_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:49108
I20260709 12:24:35.766582 25683 raft_consensus.cc:606] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Received request to transfer leadership to TS 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:24:35.766269 25677 rpcz_store.cc:276] 0709 12:24:34.116441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.271245 (+154804us) service_pool.cc:224] Handling call
0709 12:24:34.289123 (+ 17878us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:35.561034 (+1271911us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:35.748673 (+187639us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54002a0b54. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:35.748904 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2852222208}
I20260709 12:24:35.767022 25683 raft_consensus.cc:614] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:35.749990 25754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 2324) took 1148 ms. Trace:
I20260709 12:24:35.710142 28959 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:35.761510 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 44278.7us
W20260709 12:24:35.760268 25649 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.048s	sys 0.101s
I20260709 12:24:35.767643 25754 rpcz_store.cc:276] 0709 12:24:34.601396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.604008 (+  2612us) service_pool.cc:224] Handling call
0709 12:24:34.604318 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:35.507411 (+903093us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:35.749727 (+242316us) spinlock_profiling.cc:243] Waited 901 ms on lock 0x7b54001dbad4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:35.749926 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2073422720}
I20260709 12:24:35.737816 29344 raft_consensus.cc:697] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 15 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:35.769973 25650 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:35.773940 25650 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:24:35.770576 25649 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.049s	sys 0.101s
I20260709 12:24:35.783201 26430 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 6.
I20260709 12:24:35.769922 29416 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:35.785640 29401 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:35.785451 29416 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:24:35.786012 25650 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:35.787262 29355 raft_consensus.cc:2804] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:24:35.787766 29355 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:35.787868 29429 raft_consensus.cc:2749] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:35.788077 28657 consensus_queue.cc:1048] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:35.788378 29308 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:35.790395 29308 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:35.791541 29231 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:24:35.791833 25649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.770715 29361 raft_consensus.cc:2749] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:35.787216 25650 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
W20260709 12:24:35.743981 29367 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.008s	sys 0.017s
I20260709 12:24:35.792634 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:35.793361 29415 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:35.787695 29416 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:35.772187 28959 raft_consensus.cc:3060] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:35.795415 29001 raft_consensus.cc:3055] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:24:35.795797 29001 raft_consensus.cc:740] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:35.796671 29001 consensus_queue.cc:260] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:35.800442 29358 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:35.800326 25650 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:35.801286 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:35.801154 29439 consensus_queue.cc:237] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:35.801891 25758 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:35.801978 25650 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:35.803140 29370 raft_consensus.cc:2749] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:35.743814 29250 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:35.804155 29250 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:35.805155 26432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 920) took 1479 ms. Trace:
I20260709 12:24:35.805500 26432 rpcz_store.cc:276] 0709 12:24:34.325596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.389272 (+ 63676us) service_pool.cc:224] Handling call
0709 12:24:35.804945 (+1415673us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b54005528d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:35.805078 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2990044032}
I20260709 12:24:35.806123 29250 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:35.761884 29435 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:35.807168 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:35.788388 29355 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:35.810349 29425 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:35.809921 29092 consensus_queue.cc:237] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:35.813198 25678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2198) took 1766 ms. Trace:
I20260709 12:24:35.812704 29344 consensus_queue.cc:237] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:35.793514 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:24:35.813565 25678 rpcz_store.cc:276] 0709 12:24:34.046968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.207592 (+160624us) service_pool.cc:224] Handling call
0709 12:24:34.219515 (+ 11923us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:35.598968 (+1379453us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:35.812409 (+213441us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b54002a58d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:35.813021 (+   612us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b54002a58d0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b608ad 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:35.813146 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3197042688}
I20260709 12:24:35.815201 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:35.803411 25650 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:35.816849 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:35.817718 25763 raft_consensus.cc:2393] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 10: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:35.818038 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:35.819169 26432 raft_consensus.cc:1275] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:24:35.759965 29260 raft_consensus.cc:3060] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:35.766004 28840 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:35.833129 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:35.829659 25758 raft_consensus.cc:2468] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 10.
I20260709 12:24:35.803822 29370 raft_consensus.cc:2804] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:35.818063 25650 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:35.806103 29415 raft_consensus.cc:2749] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:35.854286 26401 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:24:35.677536 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 468702us
I20260709 12:24:35.704385 25801 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
W20260709 12:24:35.880767 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:35.881932 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 177650us
I20260709 12:24:35.882927 25801 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:35.883853 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:35.858003 29370 raft_consensus.cc:697] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 9 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:35.886381 29370 consensus_queue.cc:237] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:35.888290 29231 raft_consensus.cc:2804] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:35.888759 25828 raft_consensus.cc:2468] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 5.
I20260709 12:24:35.888823 29231 raft_consensus.cc:697] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 10 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:35.889915 25828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44202 (request call id 2651) took 1328 ms. Trace:
I20260709 12:24:35.841738 29210 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:35.890331 25828 rpcz_store.cc:276] 0709 12:24:34.561845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.562026 (+   181us) service_pool.cc:224] Handling call
0709 12:24:35.889765 (+1327739us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b54002f5654. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:35.889857 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2993505152}
I20260709 12:24:35.816098 29411 raft_consensus.cc:2804] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:35.822845 29215 raft_consensus.cc:2804] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:35.852397 29410 raft_consensus.cc:2804] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:35.859133 29435 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:35.905412 29401 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.911201 29401 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:35.889528 29361 consensus_queue.cc:1048] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:24:35.913561 29179 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:35.914674 29420 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.915143 29420 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:35.897050 28840 raft_consensus.cc:2749] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:35.906847 29411 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:35.916571 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:35.916883 29411 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:35.917433 25758 raft_consensus.cc:2410] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:24:35.917366 29420 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:35.918605 29231 consensus_queue.cc:237] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:35.922313 29001 raft_consensus.cc:3060] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:24:35.934224 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.921708 29360 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:35.913887 29401 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:24:35.952387 26402 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.934s	user 0.019s	sys 0.055s
W20260709 12:24:35.953869 26402 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.936s	user 0.019s	sys 0.055s
W20260709 12:24:35.956398 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 985508us
W20260709 12:24:35.956789 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 52060us
I20260709 12:24:35.962608 25801 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:35.967939 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:35.969774 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:35.970422 25677 raft_consensus.cc:2468] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 9.
I20260709 12:24:35.970289 29355 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:35.970734 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:35.971477 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:35.970796 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:35.972101 25686 raft_consensus.cc:2468] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 8.
I20260709 12:24:35.972137 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:35.972793 25683 raft_consensus.cc:2468] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 6.
I20260709 12:24:35.963598 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:35.974104 25678 raft_consensus.cc:2410] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:24:35.941329 29296 raft_consensus.cc:2804] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:24:35.990350 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.911481 28959 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:35.823625 29427 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:35.952275 29268 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
W20260709 12:24:36.006872 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.955351 29215 raft_consensus.cc:697] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 7 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
W20260709 12:24:36.020058 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 159547us
I20260709 12:24:35.964579 29410 raft_consensus.cc:697] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 8 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:36.023789 25726 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:24:35.988296 28949 raft_consensus.cc:2804] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:35.991655 29296 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:36.068030 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:36.072863 25834 raft_consensus.cc:1240] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 9. Current term is 10. Ops: []
W20260709 12:24:36.605051 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:36.491606 25757 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.829s	user 0.007s	sys 0.038s
W20260709 12:24:36.429708 26435 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.775s	user 0.023s	sys 0.020s
W20260709 12:24:36.704949 25757 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.047s	user 0.007s	sys 0.044s
W20260709 12:24:36.539003 26437 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.900s	user 0.005s	sys 0.021s
W20260709 12:24:36.706881 26435 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.052s	user 0.028s	sys 0.024s
I20260709 12:24:36.088726 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:36.707316 26437 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.068s	user 0.006s	sys 0.023s
I20260709 12:24:36.702440 25801 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:24:36.409323 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:36.712020 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:36.078035 25828 raft_consensus.cc:1275] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:24:36.454291 25835 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.865s	user 0.010s	sys 0.020s
W20260709 12:24:36.715283 25835 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.126s	user 0.010s	sys 0.025s
W20260709 12:24:36.702193 26436 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.949s	user 0.014s	sys 0.011s
W20260709 12:24:36.715991 26436 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.962s	user 0.015s	sys 0.011s
I20260709 12:24:36.708077 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
W20260709 12:24:36.078924 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 55254.2us
I20260709 12:24:36.717116 25726 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
W20260709 12:24:36.622452 25759 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.007s	user 0.000s	sys 0.017s
W20260709 12:24:36.726629 25759 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.111s	user 0.000s	sys 0.018s
I20260709 12:24:36.728201 25757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48606 (request call id 879) took 1096 ms. Trace:
I20260709 12:24:36.131798 25829 raft_consensus.cc:1240] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 9. Current term is 10. Ops: [9.4-9.4]
I20260709 12:24:36.728672 25757 rpcz_store.cc:276] 0709 12:24:35.631967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:35.632089 (+   122us) service_pool.cc:224] Handling call
0709 12:24:35.632367 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:35.632559 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:24:35.657839 (+ 25280us) log.cc:844] Serialized 14 byte log entry
0709 12:24:36.727795 (+1069956us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:36.727847 (+    52us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:24:36.727889 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:36.728032 (+   143us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:36.728146 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20466,"prepare.queue_time_us":25454,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":6189,"thread_start_us":1049027,"threads_started":1}
W20260709 12:24:36.422199 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:36.732884 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:36.734076 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:36.742445 25831 raft_consensus.cc:2393] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 6: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:36.746644 25726 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
W20260709 12:24:36.747610 25755 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.948s	user 0.013s	sys 0.022s
W20260709 12:24:36.748049 25755 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.949s	user 0.013s	sys 0.023s
W20260709 12:24:36.752197 26434 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.980s	user 0.014s	sys 0.015s
W20260709 12:24:36.752583 26434 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.985s	user 0.015s	sys 0.015s
I20260709 12:24:36.754376 25726 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
W20260709 12:24:36.539793 29421 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.855s	user 0.011s	sys 0.032s
W20260709 12:24:36.759482 26432 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.843s	user 0.010s	sys 0.006s
W20260709 12:24:36.766458 26432 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.850s	user 0.010s	sys 0.006s
I20260709 12:24:36.079133 29296 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:36.758301 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:36.758955 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:36.737155 29245 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.942s	user 0.016s	sys 0.022s
I20260709 12:24:36.021523 29001 consensus_queue.cc:1048] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.738s
I20260709 12:24:36.090063 29189 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
W20260709 12:24:36.738140 29439 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.815s	user 0.005s	sys 0.014s
W20260709 12:24:36.764740 25837 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.003s	sys 0.012s
W20260709 12:24:36.788970 25837 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.004s	sys 0.012s
I20260709 12:24:36.334230 29210 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.762091 29252 raft_consensus.cc:2804] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:36.218101 29409 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:36.598738 29267 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.868s	user 0.006s	sys 0.010s
I20260709 12:24:36.683188 29427 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:36.376287 29401 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.647814 29179 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:36.090830 28657 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.576364 29358 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.077528 29317 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:36.111023 29435 raft_consensus.cc:2764] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 12:24:36.749852 29231 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.820s	user 0.018s	sys 0.012s
I20260709 12:24:36.198565 28949 raft_consensus.cc:697] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 7 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:36.359963 29215 consensus_queue.cc:237] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:36.745451 29196 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:36.751577 28840 raft_consensus.cc:2804] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:24:36.765939 29421 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.087s	user 0.012s	sys 0.034s
I20260709 12:24:36.747154 29360 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:36.750159 29235 raft_consensus.cc:2749] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:36.763432 29346 raft_consensus.cc:2804] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:36.022090 29268 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:36.781904 29245 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.028s	user 0.016s	sys 0.022s
I20260709 12:24:36.807798 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:36.796774 29210 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:36.818282 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:36.812690 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:36.814985 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:36.863178 29355 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:36.757434 25726 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:24:36.813177 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:36.800371 26438 raft_consensus.cc:1275] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:24:36.817544 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:36.919642 25679 raft_consensus.cc:3060] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:36.919775 25680 raft_consensus.cc:1275] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:24:36.111280 29440 consensus_queue.cc:1048] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.713s
I20260709 12:24:36.842767 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:36.843190 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:36.921825 25684 raft_consensus.cc:3060] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:36.850061 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:36.849399 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:36.923904 25685 raft_consensus.cc:3060] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:36.827566 29267 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.097s	user 0.008s	sys 0.011s
W20260709 12:24:36.905833 29092 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.017s	user 0.028s	sys 0.029s
I20260709 12:24:36.793910 28988 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:36.860647 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 44816.7us
I20260709 12:24:36.358843 29410 consensus_queue.cc:237] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:36.781103 25830 raft_consensus.cc:2393] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 7: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:36.791067 29189 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:36.797366 29252 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:36.910425 29346 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:36.831382 29415 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
W20260709 12:24:36.903481 25832 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.786s	user 0.027s	sys 0.029s
W20260709 12:24:36.861515 29231 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.933s	user 0.019s	sys 0.012s
I20260709 12:24:36.843546 29257 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
W20260709 12:24:36.907766 29433 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.007s	sys 0.030s
I20260709 12:24:37.019532 25679 raft_consensus.cc:2468] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 6.
I20260709 12:24:36.939010 29438 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.906769 29196 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:37.025430 25684 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 6.
I20260709 12:24:36.930120 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:36.931023 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
W20260709 12:24:36.789119 29439 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.005s	sys 0.015s
I20260709 12:24:36.843108 29409 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:36.893550 29447 log.cc:927] Time spent T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.449s	user 0.000s	sys 0.001s
I20260709 12:24:37.002461 25683 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 15.
W20260709 12:24:37.005761 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 65095us
W20260709 12:24:36.936092 29092 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.048s	user 0.029s	sys 0.029s
I20260709 12:24:37.007803 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:37.008637 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:37.031723 25649 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:24:36.858902 29401 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:36.915684 28840 raft_consensus.cc:697] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 6 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:37.013023 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:37.047065 25830 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 7.
W20260709 12:24:37.014621 25832 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.897s	user 0.027s	sys 0.030s
I20260709 12:24:36.938104 29443 raft_consensus.cc:2804] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:24:36.922550 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 165208us
I20260709 12:24:37.029034 25833 raft_consensus.cc:2468] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 9.
I20260709 12:24:37.034241 25649 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:37.002653 29235 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.006453 29252 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:37.038677 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:37.087739 25828 raft_consensus.cc:2410] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 11 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
W20260709 12:24:37.043439 26430 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.142s	user 0.014s	sys 0.045s
W20260709 12:24:37.088591 26430 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.187s	user 0.015s	sys 0.045s
W20260709 12:24:37.018653 29433 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.007s	sys 0.030s
I20260709 12:24:37.013314 29346 raft_consensus.cc:3060] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:37.062445 25726 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:36.886200 28657 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:36.885998 29317 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:37.088934 26437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 929) took 1451 ms. Trace:
I20260709 12:24:36.891388 29358 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:37.124742 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.037981 29210 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:37.154716 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:36.945981 28988 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:37.159866 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 125721us
W20260709 12:24:37.050206 29400 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.088s	user 0.022s	sys 0.054s
I20260709 12:24:37.162688 26437 rpcz_store.cc:276] 0709 12:24:35.637867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:35.638000 (+   133us) service_pool.cc:224] Handling call
0709 12:24:35.638334 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:35.638589 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:24:36.711299 (+1072710us) log.cc:844] Serialized 14 byte log entry
0709 12:24:37.088511 (+377212us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:37.088578 (+    67us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:24:37.088637 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:37.088728 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:37.088868 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1192564,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"thread_start_us":1449135,"threads_started":2}
I20260709 12:24:37.054426 29443 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:37.053927 29432 raft_consensus.cc:2764] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 12:24:37.015578 29381 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.276s	user 0.024s	sys 0.047s
I20260709 12:24:37.174479 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:37.178714 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:24:37.163365 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 101040us
I20260709 12:24:37.183630 29443 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:37.184016 29381 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.456s	user 0.030s	sys 0.054s
W20260709 12:24:37.184482 29456 log.cc:927] Time spent T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.179s	user 0.000s	sys 0.000s
I20260709 12:24:37.186141 28988 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:37.167248 29435 raft_consensus.cc:2764] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:24:37.188654 29435 consensus_queue.cc:1048] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:37.189260 25757 raft_consensus.cc:2393] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 8: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:37.190236 25685 raft_consensus.cc:2468] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 7.
I20260709 12:24:37.194057 29443 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:37.196223 29444 log.cc:927] Time spent T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.862s	user 0.005s	sys 0.000s
I20260709 12:24:37.196264 28657 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:37.024861 29415 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:37.197917 25686 raft_consensus.cc:3060] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:37.198338 25763 raft_consensus.cc:2393] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 10: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:37.199560 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:37.201951 25757 raft_consensus.cc:2468] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 8.
I20260709 12:24:37.203059 25800 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:37.204454 28840 consensus_queue.cc:237] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:37.205629 29415 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:37.207598 25686 raft_consensus.cc:2468] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 8.
W20260709 12:24:37.208590 29451 log.cc:927] Time spent T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.192s	user 0.000s	sys 0.000s
I20260709 12:24:37.209093 29296 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:37.210103 26435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 928) took 1573 ms. Trace:
I20260709 12:24:37.211470 29296 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:37.210557 26435 rpcz_store.cc:276] 0709 12:24:35.637061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:35.637236 (+   175us) service_pool.cc:224] Handling call
0709 12:24:35.653544 (+ 16308us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:35.653959 (+   415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:35.653988 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:35.654544 (+   556us) log.cc:844] Serialized 52 byte log entry
0709 12:24:36.710311 (+1055767us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:36.710367 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:36.710462 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:37.209848 (+499386us) raft_consensus.cc:1685] finished
0709 12:24:37.209871 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:37.210033 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1171,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":106,"thread_start_us":1055351,"threads_started":1,"wal-append.queue_time_us":1245458}
I20260709 12:24:37.211825 29196 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:37.212145 29296 raft_consensus.cc:2804] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:37.212688 29296 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.095196 29235 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:37.213111 29296 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:37.218418 29235 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:37.221453 29449 log.cc:927] Time spent T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.288s	user 0.000s	sys 0.000s
I20260709 12:24:37.222944 25759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 2337) took 1609 ms. Trace:
I20260709 12:24:37.168192 29421 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:37.217979 29443 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:37.237841 25760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 2707) took 2007 ms. Trace:
I20260709 12:24:37.250670 26432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 937) took 1336 ms. Trace:
W20260709 12:24:37.251609 29458 log.cc:927] Time spent T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:24:37.251319 26432 rpcz_store.cc:276] 0709 12:24:35.914598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:35.914753 (+   155us) service_pool.cc:224] Handling call
0709 12:24:35.915066 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:35.915421 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:35.915449 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:35.915945 (+   496us) log.cc:844] Serialized 26 byte log entry
0709 12:24:36.770227 (+854282us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:36.770295 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:36.770388 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:37.250346 (+479958us) raft_consensus.cc:1685] finished
0709 12:24:37.250378 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:37.250589 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6167,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":82,"thread_start_us":850621,"threads_started":1,"wal-append.queue_time_us":1332408}
I20260709 12:24:37.253300 25755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 2340) took 1461 ms. Trace:
I20260709 12:24:37.253824 25755 rpcz_store.cc:276] 0709 12:24:35.791973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:35.797711 (+  5738us) service_pool.cc:224] Handling call
0709 12:24:35.798049 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:35.798364 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:35.798392 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:35.798822 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 12:24:36.748562 (+949740us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:36.748605 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:36.748680 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:37.252992 (+504312us) raft_consensus.cc:1685] finished
0709 12:24:37.253024 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:37.253218 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7592,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"thread_start_us":949328,"threads_started":1,"wal-append.queue_time_us":1225756}
I20260709 12:24:37.256273 29468 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:37.256610 29420 consensus_queue.cc:1048] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:37.257108 29468 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:37.260746 25754 raft_consensus.cc:1275] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:24:37.261768 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:37.223429 25759 rpcz_store.cc:276] 0709 12:24:35.614012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:35.614250 (+   238us) service_pool.cc:224] Handling call
0709 12:24:35.614580 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:35.614902 (+   322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:35.614931 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:35.615361 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 12:24:36.727176 (+1111815us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:36.727235 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:36.727329 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:37.222664 (+495335us) raft_consensus.cc:1685] finished
0709 12:24:37.222697 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:37.222869 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":988,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"thread_start_us":1111464,"threads_started":1,"wal-append.queue_time_us":1243736}
I20260709 12:24:37.238456 25760 rpcz_store.cc:276] 0709 12:24:35.230653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:35.230871 (+   218us) service_pool.cc:224] Handling call
0709 12:24:35.231497 (+   626us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:35.231950 (+   453us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:35.231977 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:35.456076 (+224099us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b2c0005c228. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9845aa11 00007f5d9846a372 00007f5d99b9ca01 00007f5d99b6143a 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2
0709 12:24:35.456942 (+   866us) log.cc:844] Serialized 572 byte log entry
0709 12:24:35.896833 (+439891us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:35.896876 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:35.896948 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:37.174167 (+1277219us) raft_consensus.cc:1685] finished
0709 12:24:37.174186 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:37.237745 (+ 63559us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25786752,"thread_start_us":439499,"threads_started":1,"wal-append.queue_time_us":877435}
W20260709 12:24:37.267658 25829 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.018s	sys 0.017s
W20260709 12:24:37.270388 25829 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.018s	sys 0.017s
W20260709 12:24:37.271694 25835 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.011s	sys 0.034s
W20260709 12:24:37.173810 29400 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.305s	user 0.022s	sys 0.054s
I20260709 12:24:37.032126 29257 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:37.039794 29438 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:37.273267 25835 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.012s	sys 0.034s
I20260709 12:24:37.273473 25758 raft_consensus.cc:1240] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 9. Current term is 10. Ops: []
W20260709 12:24:37.282639 25650 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.005s	sys 0.043s
W20260709 12:24:37.282881 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 442035us
I20260709 12:24:37.029493 28949 consensus_queue.cc:237] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:37.283766 25801 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.002s	sys 0.020s
W20260709 12:24:37.302246 25801 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.003s	sys 0.020s
W20260709 12:24:37.302803 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 556598us
W20260709 12:24:37.210561 29453 log.cc:927] Time spent T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.294s	user 0.000s	sys 0.000s
I20260709 12:24:37.307394 26432 raft_consensus.cc:1240] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:37.284994 29445 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.291774 26434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 918) took 1588 ms. Trace:
I20260709 12:24:37.293368 25835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 2635) took 2882 ms. Trace:
I20260709 12:24:37.298429 29416 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
W20260709 12:24:37.298393 25650 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.516s	user 0.008s	sys 0.043s
I20260709 12:24:37.309034 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:37.309940 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:37.310153 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:37.303102 29409 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:37.332494 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:37.335600 25650 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:24:37.310448 25837 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.004s	sys 0.023s
W20260709 12:24:37.347086 25837 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.004s	sys 0.023s
I20260709 12:24:37.321389 25835 rpcz_store.cc:276] 0709 12:24:34.411017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.411138 (+   121us) service_pool.cc:224] Handling call
0709 12:24:34.411438 (+   300us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:34.489276 (+ 77838us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:34.489320 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:34.496595 (+  7275us) log.cc:844] Serialized 52 byte log entry
0709 12:24:35.563298 (+1066703us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:36.715962 (+1152664us) log.cc:844] Serialized 14 byte log entry
0709 12:24:37.293004 (+577042us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:37.293100 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:37.293154 (+    54us) raft_consensus.cc:1685] finished
0709 12:24:37.293167 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:37.293309 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50453,"prepare.queue_time_us":1263506,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":8273,"raft.queue_time_us":128616,"raft.run_cpu_time_us":298,"raft.run_wall_time_us":21722,"thread_start_us":2670686,"threads_started":3,"wal-append.queue_time_us":1162818}
I20260709 12:24:37.353878 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
W20260709 12:24:37.354087 25801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.314054 26434 rpcz_store.cc:276] 0709 12:24:35.703736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:35.712039 (+  8303us) service_pool.cc:224] Handling call
0709 12:24:35.712390 (+   351us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:35.712757 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:35.712789 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:35.713348 (+   559us) log.cc:844] Serialized 52 byte log entry
0709 12:24:36.753086 (+1039738us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:37.281543 (+528457us) log.cc:844] Serialized 14 byte log entry
0709 12:24:37.282265 (+   722us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:37.282357 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:37.282405 (+    48us) raft_consensus.cc:1685] finished
0709 12:24:37.282424 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:37.282566 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10185,"prepare.queue_time_us":182700,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":56884,"raft.queue_time_us":35762,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":19308,"thread_start_us":1475479,"threads_started":2,"wal-append.queue_time_us":1304054}
I20260709 12:24:37.357043 25837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 2656) took 1286 ms. Trace:
I20260709 12:24:37.359427 25650 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:37.361716 25685 raft_consensus.cc:1275] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:24:37.373925 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:37.394742 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:37.395543 25755 raft_consensus.cc:2468] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 6.
I20260709 12:24:37.397047 25833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44202 (request call id 2660) took 1309 ms. Trace:
I20260709 12:24:37.398980 25833 rpcz_store.cc:276] 0709 12:24:36.088005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.088406 (+   401us) service_pool.cc:224] Handling call
0709 12:24:37.396845 (+1308439us) spinlock_profiling.cc:243] Waited 318 ms on lock 0x7b5400118d54. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:37.396978 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":730855680}
I20260709 12:24:37.403509 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
W20260709 12:24:37.404135 26402 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.041s	sys 0.048s
I20260709 12:24:37.333503 29358 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:37.406404 25755 raft_consensus.cc:3060] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:37.406680 26402 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.041s	sys 0.048s
I20260709 12:24:37.357595 25837 rpcz_store.cc:276] 0709 12:24:36.070724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.070858 (+   134us) service_pool.cc:224] Handling call
0709 12:24:36.071268 (+   410us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:36.071532 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:36.789527 (+717995us) log.cc:844] Serialized 14 byte log entry
0709 12:24:37.351105 (+561578us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:37.351183 (+    78us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:37.351242 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:37.356821 (+  5579us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:37.356974 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":864068,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"thread_start_us":1233623,"threads_started":2}
W20260709 12:24:37.408818 25834 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.020s	sys 0.025s
I20260709 12:24:37.350549 29415 raft_consensus.cc:2764] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:24:37.421849 26433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 921) took 1449 ms. Trace:
I20260709 12:24:37.357859 29316 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
W20260709 12:24:37.420431 25834 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.020s	sys 0.025s
W20260709 12:24:37.410388 26402 connection.cc:256] RPC call timeout handler was delayed by -2.9531771470001331s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1521s for a response
I20260709 12:24:37.337088 29346 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:37.342280 29416 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:37.400913 29381 raft_consensus.cc:2749] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:37.402227 29400 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:37.358525 29446 consensus_queue.cc:1059] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 12:24:37.325331 29445 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:37.405663 29189 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:37.431631 26433 rpcz_store.cc:276] 0709 12:24:35.972052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:35.972200 (+   148us) service_pool.cc:224] Handling call
0709 12:24:36.705357 (+733157us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:36.705569 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:24:37.160302 (+454733us) log.cc:844] Serialized 14 byte log entry
0709 12:24:37.421504 (+261202us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:37.421566 (+    62us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:37.421630 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:37.421695 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:37.421796 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":194199,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"thread_start_us":662604,"threads_started":2}
W20260709 12:24:37.439349 26402 connection.cc:256] RPC call timeout handler was delayed by -2.9009771470000487s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1579s for a response
W20260709 12:24:37.582612 26402 connection.cc:256] RPC call timeout handler was delayed by -2.8235771469999236s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1665s for a response
W20260709 12:24:37.582975 26402 connection.cc:256] RPC call timeout handler was delayed by -2.6597771470001135s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1847s for a response
I20260709 12:24:37.397976 28987 consensus_queue.cc:1048] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.055s
W20260709 12:24:37.446915 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 266028us
I20260709 12:24:37.416788 29432 consensus_queue.cc:1048] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.161s
W20260709 12:24:37.568084 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 150164us
W20260709 12:24:37.571470 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.419474 29268 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:37.403581 28988 consensus_queue.cc:1048] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:24:37.428920 29468 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:24:37.583355 26402 connection.cc:256] RPC call timeout handler was delayed by -2.6283274300003541s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15500000000000003s for a response
W20260709 12:24:37.626618 26402 connection.cc:256] RPC call timeout handler was delayed by -2.6165771470000436s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1895s for a response
W20260709 12:24:37.627116 26402 connection.cc:256] RPC call timeout handler was delayed by -2.0901274300003934s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21480000000000002s for a response
W20260709 12:24:37.627477 26402 connection.cc:256] RPC call timeout handler was delayed by -2.0901274300003934s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21480000000000002s for a response
W20260709 12:24:37.627859 26402 connection.cc:256] RPC call timeout handler was delayed by -1.7984771470000851s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2804s for a response
W20260709 12:24:37.628233 26402 connection.cc:256] RPC call timeout handler was delayed by -1.7211274300002515s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25579999999999997s for a response
I20260709 12:24:37.586395 25762 raft_consensus.cc:1240] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:37.421373 29358 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.635846 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:37.567566 29260 consensus_meta.cc:287] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 1.677s	user 0.007s	sys 0.006s
I20260709 12:24:37.592471 25726 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:37.632498 26433 raft_consensus.cc:1240] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:37.633586 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:37.635517 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:37.584398 29196 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.650969 26437 raft_consensus.cc:2368] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 7. Current term is 8.
I20260709 12:24:37.656203 25649 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:37.662722 25755 raft_consensus.cc:2468] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 8.
W20260709 12:24:37.663082 25802 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.923s	user 0.014s	sys 0.011s
I20260709 12:24:37.547463 29316 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:37.650161 26432 raft_consensus.cc:2468] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 7.
W20260709 12:24:37.648895 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 49753.6us
W20260709 12:24:37.666936 25802 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.927s	user 0.014s	sys 0.011s
I20260709 12:24:37.637292 26402 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:37.669479 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:37.672375 26435 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 7.
I20260709 12:24:37.673322 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:37.608523 29317 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:37.580572 29400 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:37.688593 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 96220.8us
I20260709 12:24:37.691403 25726 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
W20260709 12:24:37.689258 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.612872 29443 consensus_queue.cc:1059] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 12:24:37.697326 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:24:37.680371 29411 consensus_meta.cc:287] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 1.761s	user 0.011s	sys 0.004s
I20260709 12:24:37.671845 29438 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:37.710876 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 73771.2us
I20260709 12:24:37.712937 26402 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:37.697427 29235 raft_consensus.cc:2749] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:37.702136 29001 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
W20260709 12:24:37.722960 29487 log.cc:927] Time spent T 00000000000000000000000000000000 P 496fd6924b624e77b03ccfd15653d47b: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:24:37.723582 29471 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.723332 29001 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:37.701946 29468 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.724080 29471 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:37.724370 29468 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:37.726327 29471 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:37.693817 29257 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:37.664711 29358 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:37.675040 29196 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:37.719779 29459 log.cc:927] Time spent T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.401s	user 0.000s	sys 0.001s
I20260709 12:24:37.727102 29468 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:37.759423 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:37.760325 25755 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 9.
I20260709 12:24:37.669965 29260 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:37.764369 25836 raft_consensus.cc:1275] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:24:37.765033 25836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 2661) took 1650 ms. Trace:
I20260709 12:24:37.765352 25836 rpcz_store.cc:276] 0709 12:24:36.115101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.115278 (+   177us) service_pool.cc:224] Handling call
0709 12:24:37.759369 (+1644091us) spinlock_profiling.cc:243] Waited 1.69 ms on lock 0x7b5800133e98. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d96a3cb71 00007f5d96a3ca22 00007f5d9f9558d9 00007f5d9eaafee0 00007f5d9eb790ab 00007f5d9eb79131 00007f5d9eb3afc0 00007f5d9eb25929 00007f5d9eb253d2 00007f5d9809cbd4
0709 12:24:37.759639 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:37.764801 (+  5162us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:37.764981 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3880192}
I20260709 12:24:37.766587 29235 raft_consensus.cc:2804] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:24:37.766947 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 54104.3us
I20260709 12:24:37.768098 29257 raft_consensus.cc:2764] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:24:37.768549 29196 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:37.767740 26402 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:37.769840 29257 raft_consensus.cc:2749] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:37.771692 26402 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
W20260709 12:24:37.773804 29482 log.cc:927] Time spent T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
W20260709 12:24:37.774467 29472 log.cc:927] Time spent T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:24:37.773713 29468 raft_consensus.cc:2749] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:37.745232 29438 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.749245 29210 raft_consensus.cc:2804] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:37.793744 29400 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:37.794938 29346 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:37.795522 29486 raft_consensus.cc:3055] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:37.796031 29486 raft_consensus.cc:740] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
W20260709 12:24:37.797238 29421 consensus_meta.cc:287] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.572s	user 0.011s	sys 0.000s
I20260709 12:24:37.797426 29260 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:37.797727 29421 raft_consensus.cc:2749] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:37.709636 29411 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:37.799691 25829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 2665) took 1602 ms. Trace:
I20260709 12:24:37.800158 29445 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:37.800107 25829 rpcz_store.cc:276] 0709 12:24:36.197619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.730584 (+532965us) service_pool.cc:224] Handling call
0709 12:24:36.758397 (+ 27813us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:37.270797 (+512400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:37.270840 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:37.299867 (+ 29027us) log.cc:844] Serialized 52 byte log entry
0709 12:24:37.663716 (+363849us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:37.673028 (+  9312us) log.cc:844] Serialized 14 byte log entry
0709 12:24:37.701038 (+ 28010us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:37.701191 (+   153us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:37.799450 (+ 98259us) raft_consensus.cc:1685] finished
0709 12:24:37.799470 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:37.799631 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31650,"prepare.queue_time_us":9232,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":9660,"raft.queue_time_us":172446,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":15629,"spinlock_wait_cycles":66176,"thread_start_us":865143,"threads_started":2,"wal-append.queue_time_us":444837}
I20260709 12:24:37.804122 29401 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:24:37.805689 29252 consensus_meta.cc:287] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.646s	user 0.007s	sys 0.002s
I20260709 12:24:37.800468 29411 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:37.806303 29252 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:37.808692 29460 log.cc:927] Time spent T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.366s	user 0.000s	sys 0.001s
I20260709 12:24:37.753086 29495 raft_consensus.cc:2749] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:37.809820 26430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 936) took 1912 ms. Trace:
I20260709 12:24:37.810763 29438 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:37.813409 29438 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:37.751627 29268 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.810212 26430 rpcz_store.cc:276] 0709 12:24:35.897189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:35.898338 (+  1149us) service_pool.cc:224] Handling call
0709 12:24:35.899083 (+   745us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:35.899537 (+   454us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:35.899588 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:35.900975 (+  1387us) log.cc:844] Serialized 572 byte log entry
0709 12:24:37.089026 (+1188051us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:37.089073 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:37.089140 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:37.809593 (+720453us) raft_consensus.cc:1685] finished
0709 12:24:37.809620 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:37.809764 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1187699,"threads_started":1,"wal-append.queue_time_us":1503189}
I20260709 12:24:37.807719 29370 raft_consensus.cc:3055] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:37.789776 29210 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.827129 29370 raft_consensus.cc:740] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:37.825455 29480 consensus_queue.cc:1059] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:24:37.828261 29370 consensus_queue.cc:260] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:37.814126 29268 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:37.838855 29235 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:37.839100 29370 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:37.827355 29210 raft_consensus.cc:3060] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:37.839511 29235 raft_consensus.cc:3060] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:37.830092 29252 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:37.832252 25834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 2659) took 1746 ms. Trace:
I20260709 12:24:37.817193 29496 consensus_queue.cc:1048] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 12:24:37.810782 29316 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:37.850848 25834 rpcz_store.cc:276] 0709 12:24:36.086020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.086195 (+   175us) service_pool.cc:224] Handling call
0709 12:24:36.086928 (+   733us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:36.087434 (+   506us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:36.087476 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:36.745688 (+658212us) log.cc:844] Serialized 572 byte log entry
0709 12:24:37.440101 (+694413us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:37.440172 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:37.440298 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:37.832011 (+391713us) raft_consensus.cc:1685] finished
0709 12:24:37.832032 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:37.832184 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":694005,"threads_started":1,"wal-append.queue_time_us":874524}
W20260709 12:24:37.842399 29296 consensus_meta.cc:287] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.624s	user 0.013s	sys 0.002s
I20260709 12:24:37.852358 29296 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:37.854765 25801 connection.cc:256] RPC call timeout handler was delayed by -1.1789172430003418s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15510000000000002s for a response
W20260709 12:24:37.855193 25801 connection.cc:256] RPC call timeout handler was delayed by -1.1348172430002705s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16000000000000003s for a response
I20260709 12:24:37.855547 29358 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:37.857216 29296 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:37.859462 29475 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.859997 29475 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:37.860742 29268 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:37.860577 29210 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:37.858750 29296 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:37.861924 29475 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:37.862114 29296 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:37.862798 29210 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:37.864356 29296 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:37.864938 29296 consensus_queue.cc:1048] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:37.865197 29092 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.865563 29001 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:37.865720 29092 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:37.850327 29455 log.cc:927] Time spent T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.951s	user 0.003s	sys 0.002s
I20260709 12:24:37.869091 26436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 917) took 2182 ms. Trace:
I20260709 12:24:37.869421 26436 rpcz_store.cc:276] 0709 12:24:35.686464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:35.709117 (+ 22653us) service_pool.cc:224] Handling call
0709 12:24:35.712624 (+  3507us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:35.713030 (+   406us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:35.713081 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:35.715226 (+  2145us) log.cc:844] Serialized 26 byte log entry
0709 12:24:35.969290 (+254064us) spinlock_profiling.cc:243] Waited 4.82 ms on lock 0x7b4800041dd8. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9ea8aaa1 00007f5d9ea81b37 00007f5d9ea819ca 00007f5d9eb7926f 00007f5d9eb78f37 00007f5d9eb8d55c 00007f5d9eb8d508 00007f5d9eb8d488 00007f5d9eb8d443 00007f5d9eb8c6ec 00007f5d9dab6a96
0709 12:24:36.716381 (+747091us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:36.716425 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:36.716486 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:37.849792 (+1133306us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b4400022b4c. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db 00007f5d99708aaf 00007f5d996fc86e 00007f5d996fbbb6 00007f5d996fb7d8 00007f5d99705221 00007f5d997051d9 00007f5d99705169
0709 12:24:37.868893 (+ 19101us) raft_consensus.cc:1685] finished
0709 12:24:37.868914 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:37.869024 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":41281,"raft.run_cpu_time_us":2070,"raft.run_wall_time_us":208962,"spinlock_wait_cycles":35522304,"thread_start_us":962730,"threads_started":1,"wal-append.queue_time_us":1040364}
I20260709 12:24:37.872007 25801 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:37.875047 29492 raft_consensus.cc:2749] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:37.875542 29437 consensus_queue.cc:1048] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:24:37.875977 29462 log.cc:927] Time spent T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.824s	user 0.004s	sys 0.002s
I20260709 12:24:37.867799 29092 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:37.872573 29316 consensus_queue.cc:1059] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:37.878364 29316 raft_consensus.cc:3055] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:37.878772 29316 raft_consensus.cc:740] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
W20260709 12:24:37.881332 29452 log.cc:927] Time spent T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.988s	user 0.001s	sys 0.005s
I20260709 12:24:37.881040 29316 consensus_queue.cc:260] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:37.887521 28959 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:37.891177 25801 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:37.891737 26439 raft_consensus.cc:3055] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:37.894398 26439 raft_consensus.cc:740] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:37.882511 29316 raft_consensus.cc:3060] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:37.897683 25801 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:37.899317 25801 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:37.895442 26439 consensus_queue.cc:260] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:37.904183 25832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 2654) took 1834 ms. Trace:
I20260709 12:24:37.900430 29360 raft_consensus.cc:2749] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:24:37.956795 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 285476us
I20260709 12:24:37.969709 25684 raft_consensus.cc:2393] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 11: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
W20260709 12:24:37.973467 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 281989us
I20260709 12:24:37.973990 25680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2224) took 1158 ms. Trace:
I20260709 12:24:37.975397 25726 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:37.982511 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:37.988863 25726 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:37.989241 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:37.990965 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:37.904274 29001 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:37.993207 25760 raft_consensus.cc:1240] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:37.993324 29001 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:37.999433 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 207991us
I20260709 12:24:38.002264 29504 raft_consensus.cc:2804] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:38.002673 26402 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:38.002939 29504 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:38.003564 29504 raft_consensus.cc:3060] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:37.900660 29092 raft_consensus.cc:2749] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:38.004351 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:38.005318 25828 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:38.008466 29500 raft_consensus.cc:2804] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:38.009102 29500 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:38.009670 29500 raft_consensus.cc:3060] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:38.010124 26401 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:37.982374 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:38.014750 25755 raft_consensus.cc:2410] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 10 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:24:38.015658 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:38.017766 25755 raft_consensus.cc:2468] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 10.
I20260709 12:24:38.017665 29235 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:38.019292 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:38.021749 29427 raft_consensus.cc:2749] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:38.031028 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:38.033615 29235 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:24:38.028955 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.039228 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:38.039397 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:38.039422 29092 raft_consensus.cc:2749] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:38.040313 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:38.041514 25835 raft_consensus.cc:2393] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 11: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:38.043494 25837 raft_consensus.cc:1275] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:38.045073 29231 raft_consensus.cc:2804] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:38.045693 29231 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:38.046216 29231 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:38.050010 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:38.050864 25758 raft_consensus.cc:2468] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 5.
I20260709 12:24:38.053370 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:38.054078 25759 raft_consensus.cc:2468] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 9.
I20260709 12:24:38.062508 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:38.065165 25831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41782 (request call id 778) took 1128 ms. Trace:
I20260709 12:24:38.065824 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:38.055063 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:38.035642 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:38.069749 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 67366.2us
I20260709 12:24:38.071260 26402 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:38.075174 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:38.077418 25837 raft_consensus.cc:1240] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:38.078307 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:38.078802 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:38.079150 29481 log.cc:927] Time spent T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.409s	user 0.000s	sys 0.001s
I20260709 12:24:38.079380 25829 raft_consensus.cc:2410] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for term 10 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 3.
I20260709 12:24:38.080489 25759 raft_consensus.cc:2393] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 8: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:37.981068 25680 rpcz_store.cc:276] 0709 12:24:36.815175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.920918 (+105743us) service_pool.cc:224] Handling call
0709 12:24:36.921285 (+   367us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:37.017058 (+ 95773us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:37.017093 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:37.028879 (+ 11786us) log.cc:844] Serialized 52 byte log entry
0709 12:24:37.482538 (+453659us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:37.736159 (+253621us) log.cc:844] Serialized 14 byte log entry
0709 12:24:37.972398 (+236239us) log.cc:844] Serialized 14 byte log entry
0709 12:24:37.972980 (+   582us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:37.973183 (+   203us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:37.973342 (+   159us) raft_consensus.cc:1685] finished
0709 12:24:37.973360 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:37.973707 (+   347us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":328090,"prepare.queue_time_us":330588,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":77,"raft.queue_time_us":91305,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":3737,"thread_start_us":445719,"threads_started":2,"wal-append.queue_time_us":740385}
I20260709 12:24:38.076998 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:38.033738 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 134472us
I20260709 12:24:38.065605 25831 rpcz_store.cc:276] 0709 12:24:36.936248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.936456 (+   208us) service_pool.cc:224] Handling call
0709 12:24:38.064741 (+1128285us) spinlock_profiling.cc:243] Waited 868 ms on lock 0x7b54002f6054. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:38.064952 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1995863424}
I20260709 12:24:38.081766 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 5 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:38.082275 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:38.083632 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:38.084008 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:38.084956 25682 raft_consensus.cc:1240] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:38.102190 25683 raft_consensus.cc:2368] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 5. Current term is 6.
I20260709 12:24:38.102689 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:38.085421 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:38.066942 25756 raft_consensus.cc:2410] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:24:38.087558 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:38.081766 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:38.103223 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:38.084965 26439 raft_consensus.cc:3060] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:38.090843 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:38.040319 25834 raft_consensus.cc:2393] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 8: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:37.904804 25832 rpcz_store.cc:276] 0709 12:24:36.069522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.069885 (+   363us) service_pool.cc:224] Handling call
0709 12:24:36.108710 (+ 38825us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:36.109023 (+   313us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:24:37.729049 (+1620026us) spinlock_profiling.cc:243] Waited 6.4 ms on lock 0x7b180002ef60. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d997094bc 00007f5d96a5748b 00007f5d9f8b19a9 00007f5d96a7369b 00007f5d96a7193f 00007f5d96a71455 00007f5d9d5593c7 00007f5d99b6b9a7 00007f5d99b7b0bf
0709 12:24:37.729265 (+   216us) log.cc:844] Serialized 14 byte log entry
0709 12:24:37.903412 (+174147us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:37.903491 (+    79us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:37.903581 (+    90us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:37.903938 (+   357us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:37.904109 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9615,"prepare.queue_time_us":920546,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":2161,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":6185,"spinlock_wait_cycles":14714240,"thread_start_us":1102935,"threads_started":2,"wal-append.queue_time_us":151489}
I20260709 12:24:38.092891 25800 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:38.096189 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:38.105098 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:38.096629 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:38.113922 25681 raft_consensus.cc:2393] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 8: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:38.114214 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:38.114928 26433 raft_consensus.cc:3060] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:38.115581 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:38.116065 25760 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:38.116436 26438 raft_consensus.cc:3060] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:38.116081 29415 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:38.121322 29415 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:38.104234 29512 raft_consensus.cc:2749] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:38.124991 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:38.125810 26430 raft_consensus.cc:3060] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:38.128261 25828 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 13.
I20260709 12:24:38.114274 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:38.119575 25801 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:38.131268 25762 raft_consensus.cc:2468] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 8.
W20260709 12:24:38.159406 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 507922us
I20260709 12:24:38.171591 29001 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:38.181859 25754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 2709) took 1009 ms. Trace:
I20260709 12:24:38.182363 25754 rpcz_store.cc:276] 0709 12:24:37.171970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.172950 (+   980us) service_pool.cc:224] Handling call
0709 12:24:37.173364 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:37.261198 (+ 87834us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:38.181415 (+920217us) spinlock_profiling.cc:243] Waited 87 ms on lock 0x7b54000a9954. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:38.181670 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":200062720}
I20260709 12:24:38.186406 26438 raft_consensus.cc:2468] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 10.
I20260709 12:24:38.189008 26439 raft_consensus.cc:1275] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:24:38.189481 26439 pending_rounds.cc:85] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89: Aborting all ops after (but not including) 7
I20260709 12:24:38.189808 26439 pending_rounds.cc:107] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:24:38.190109 26439 raft_consensus.cc:2889] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:38.176385 26433 raft_consensus.cc:2468] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 8.
I20260709 12:24:38.131827 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:38.193064 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 100442us
I20260709 12:24:38.123739 29415 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:38.132718 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:38.199453 26439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 927) took 2560 ms. Trace:
W20260709 12:24:38.200157 29344 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.308s	user 0.020s	sys 0.003s
W20260709 12:24:38.200695 29344 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.309s	user 0.020s	sys 0.003s
I20260709 12:24:38.200080 26439 rpcz_store.cc:276] 0709 12:24:35.636177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:35.636343 (+   166us) service_pool.cc:224] Handling call
0709 12:24:35.656206 (+ 19863us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:37.891633 (+2235427us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b54006052a0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99ad8dc0 00007f5d99b631c0 00007f5d99b64231 00007f5d99b60d8f 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c
0709 12:24:38.084433 (+192800us) spinlock_profiling.cc:243] Waited 98.3 ms on lock 0x7b58007628d0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99abd0aa 00007f5d99b3f447 00007f5d99b57fe7 00007f5d99b597de 00007f5d99b63b49 00007f5d99b64416 00007f5d99b60d8f 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4
0709 12:24:38.190678 (+106245us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:38.196230 (+  5552us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3966223872}
I20260709 12:24:38.204382 29500 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:38.206791 29500 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:38.207952 25755 raft_consensus.cc:2393] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 9: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:38.208242 29001 raft_consensus.cc:2804] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:38.208981 29001 raft_consensus.cc:697] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 6 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:38.210275 29001 consensus_queue.cc:237] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:38.212113 29127 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 12:24:38.215584 29316 raft_consensus.cc:2804] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:38.216116 29316 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:38.216486 29316 raft_consensus.cc:3060] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:38.216697 29231 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:38.217447 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:38.212558 26402 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:38.202875 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
W20260709 12:24:38.241947 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 57873.6us
I20260709 12:24:38.242264 29415 consensus_queue.cc:1059] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:38.243070 25650 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:38.243484 29415 raft_consensus.cc:3055] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:38.244022 29415 raft_consensus.cc:740] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:38.244112 26436 raft_consensus.cc:2468] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 8.
I20260709 12:24:38.244652 29506 raft_consensus.cc:2749] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:38.248826 25686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 2221) took 1434 ms. Trace:
I20260709 12:24:38.249234 25678 raft_consensus.cc:1240] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:38.250370 29504 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:38.250798 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:38.251233 25649 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:38.251817 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:38.252111 25681 raft_consensus.cc:1240] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:24:38.252275 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:38.251283 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:38.386783 25680 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 6.
I20260709 12:24:38.253064 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:38.337783 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:38.278817 26430 raft_consensus.cc:2468] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 8.
W20260709 12:24:38.285113 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 140721us
W20260709 12:24:38.293622 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.329492 25760 raft_consensus.cc:2468] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 9.
I20260709 12:24:38.393385 25756 raft_consensus.cc:1240] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:38.245271 29415 consensus_queue.cc:260] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:38.331168 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 211848us
I20260709 12:24:38.344570 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:38.397969 25758 raft_consensus.cc:2468] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 7.
I20260709 12:24:38.394876 25678 raft_consensus.cc:2368] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 7. Current term is 8.
I20260709 12:24:38.336205 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:38.382939 25679 raft_consensus.cc:1240] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 7 LEADER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:38.249243 25686 rpcz_store.cc:276] 0709 12:24:36.814218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.818016 (+  3798us) service_pool.cc:224] Handling call
0709 12:24:38.248459 (+1430443us) spinlock_profiling.cc:243] Waited 284 ms on lock 0x7b5400158954. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:38.248641 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":652593024}
I20260709 12:24:38.401558 25762 raft_consensus.cc:3060] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:24:38.322530 25683 raft_consensus.cc:2468] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 10.
I20260709 12:24:38.391683 25682 raft_consensus.cc:2468] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 7.
I20260709 12:24:38.400928 25801 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:38.252607 25677 raft_consensus.cc:1240] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:38.412703 25650 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
W20260709 12:24:38.408108 25726 connection.cc:256] RPC call timeout handler was delayed by -4.6953717760002291s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2453s for a response
W20260709 12:24:38.413892 25726 connection.cc:256] RPC call timeout handler was delayed by -4.6854717760002131s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2464s for a response
W20260709 12:24:38.414285 25726 connection.cc:256] RPC call timeout handler was delayed by -4.6854717760002131s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2464s for a response
W20260709 12:24:38.414745 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 52463.5us
I20260709 12:24:38.409765 25759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 2723) took 1048 ms. Trace:
W20260709 12:24:38.414791 25726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.293135 29427 raft_consensus.cc:2749] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:38.289139 25800 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:38.358315 29504 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:38.365574 29516 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.415608 25759 rpcz_store.cc:276] 0709 12:24:37.358124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.164662 (+806538us) service_pool.cc:224] Handling call
0709 12:24:38.211750 (+ 47088us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:38.212104 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:24:38.212499 (+   395us) log.cc:844] Serialized 14 byte log entry
0709 12:24:38.406041 (+193542us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:38.406102 (+    61us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:38.406144 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:38.406215 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:38.406311 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59181,"prepare.queue_time_us":921,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":74874,"thread_start_us":119373,"threads_started":1}
I20260709 12:24:38.444423 26402 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:24:38.444912 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:38.476082 25726 connection.cc:256] RPC call timeout handler was delayed by -3.1954937350001273s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1718s for a response
W20260709 12:24:38.476596 25726 connection.cc:256] RPC call timeout handler was delayed by -3.1900937350005734s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1724s for a response
W20260709 12:24:38.476945 25726 connection.cc:256] RPC call timeout handler was delayed by -3.167593735000537s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17490000000000003s for a response
W20260709 12:24:38.477267 25726 connection.cc:256] RPC call timeout handler was delayed by -2.956093735000195s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19840000000000002s for a response
W20260709 12:24:38.477612 25726 connection.cc:256] RPC call timeout handler was delayed by -2.9245937350001441s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20190000000000002s for a response
W20260709 12:24:38.477933 25726 connection.cc:256] RPC call timeout handler was delayed by -2.8408937350004635s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21120000000000003s for a response
I20260709 12:24:38.431486 29500 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:38.529354 29231 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:24:38.529711 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 128948us
I20260709 12:24:38.462584 29370 consensus_queue.cc:1059] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.086s
W20260709 12:24:38.538272 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.555116 29242 raft_consensus.cc:2749] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:38.556200 29355 raft_consensus.cc:2804] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:24:38.557492 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 78973.5us
W20260709 12:24:38.561051 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 272086us
I20260709 12:24:38.544652 25758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 2726) took 1096 ms. Trace:
W20260709 12:24:38.586098 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 134852us
W20260709 12:24:38.588469 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 253574us
I20260709 12:24:38.589213 28657 raft_consensus.cc:2804] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:38.589334 25650 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:38.589888 28657 raft_consensus.cc:697] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 7 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:38.590222 29440 consensus_queue.cc:1048] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:38.591202 25650 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:24:38.592124 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 194776us
W20260709 12:24:38.592381 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.593036 26402 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:38.581455 25754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 2725) took 1146 ms. Trace:
I20260709 12:24:38.593786 25726 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:38.594594 26402 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:38.593672 25754 rpcz_store.cc:276] 0709 12:24:37.429777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.295553 (+865776us) service_pool.cc:224] Handling call
0709 12:24:38.296027 (+   474us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:38.296548 (+   521us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:24:38.296859 (+   311us) log.cc:844] Serialized 14 byte log entry
0709 12:24:38.486056 (+189197us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:38.486916 (+   860us) log.cc:844] Serialized 26 byte log entry
0709 12:24:38.487106 (+   190us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:38.487215 (+   109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:38.487317 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:38.576006 (+ 88689us) raft_consensus.cc:1685] finished
0709 12:24:38.576032 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:38.576235 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22474,"prepare.queue_time_us":19806,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":33015,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":34641,"spinlock_wait_cycles":30982272,"thread_start_us":172828,"threads_started":1,"wal-append.queue_time_us":231875}
I20260709 12:24:38.596377 25757 raft_consensus.cc:3055] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:38.596839 25757 raft_consensus.cc:740] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:38.597678 29358 raft_consensus.cc:2749] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:24:38.597731 25757 consensus_queue.cc:260] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:38.593262 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.600669 25801 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:38.592154 29480 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.601804 29480 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:38.603528 28949 raft_consensus.cc:2749] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:38.604770 29486 consensus_queue.cc:260] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:38.606379 29486 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:38.607234 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.593097 25800 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:38.608162 26401 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:38.605219 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:38.596421 29512 raft_consensus.cc:2804] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:38.611119 25756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48606 (request call id 894) took 1309 ms. Trace:
I20260709 12:24:38.611469 29480 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:38.612072 29416 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:24:38.640883 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 47899.2us
I20260709 12:24:38.641139 29416 raft_consensus.cc:2804] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:38.641829 29416 raft_consensus.cc:697] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 9 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:38.636543 25756 rpcz_store.cc:276] 0709 12:24:37.301434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.114044 (+812610us) service_pool.cc:224] Handling call
0709 12:24:38.393208 (+279164us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:38.403244 (+ 10036us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:38.610868 (+207624us) spinlock_profiling.cc:243] Waited 279 ms on lock 0x7b54001004d0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b608ad 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:38.611051 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":641105152}
I20260709 12:24:38.643033 29416 consensus_queue.cc:237] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:38.613947 26402 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:24:38.620122 29415 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:38.624099 29500 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:38.624647 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:38.531379 29516 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:38.658947 25757 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:38.634027 29504 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:38.644016 29512 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:38.591142 28657 consensus_queue.cc:237] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:38.641863 26401 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:38.655033 28967 raft_consensus.cc:2804] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:38.650621 26431 raft_consensus.cc:2376] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 8. Re-sending same reply.
I20260709 12:24:38.639699 25762 raft_consensus.cc:2468] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 8.
I20260709 12:24:38.677609 29480 raft_consensus.cc:2764] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:24:38.673470 28967 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
W20260709 12:24:38.684036 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 107002us
I20260709 12:24:38.681365 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:38.686492 28967 raft_consensus.cc:3060] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:38.690448 29516 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:38.668958 29512 raft_consensus.cc:3060] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:38.692751 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:38.604822 29489 consensus_queue.cc:1048] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.078s
I20260709 12:24:38.700369 25760 raft_consensus.cc:1240] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:38.676656 29001 raft_consensus.cc:2804] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:38.702811 25763 raft_consensus.cc:1240] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:38.704126 29231 consensus_queue.cc:1059] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:38.705364 29435 raft_consensus.cc:2749] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:38.685573 29480 raft_consensus.cc:2804] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:38.673513 29504 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:38.748207 25762 raft_consensus.cc:2393] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 7: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:38.708570 29001 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:38.753338 25726 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:24:38.754206 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 54352.9us
I20260709 12:24:38.737643 29242 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:38.723554 29480 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:38.762799 29245 raft_consensus.cc:2804] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:38.762915 29215 raft_consensus.cc:2749] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:38.763347 29245 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:38.763787 29245 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:38.764015 29243 consensus_queue.cc:1048] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:24:38.765565 29242 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:38.766122 28967 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:38.767023 29410 consensus_queue.cc:1059] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:24:38.767578 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:38.767877 29242 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:38.768831 28967 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:38.769829 25726 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:24:38.767902 29410 raft_consensus.cc:3055] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:24:38.774610 29410 raft_consensus.cc:740] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:38.775602 29410 consensus_queue.cc:260] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:38.776254 29440 raft_consensus.cc:2804] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:38.776945 29410 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:38.784588 25763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48606 (request call id 895) took 1481 ms. Trace:
I20260709 12:24:38.785039 25763 rpcz_store.cc:276] 0709 12:24:37.302797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.117609 (+814812us) service_pool.cc:224] Handling call
0709 12:24:38.695953 (+578344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:38.703273 (+  7320us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:38.784326 (+ 81053us) spinlock_profiling.cc:243] Waited 574 ms on lock 0x7b54003971d0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b608ad 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:38.784517 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1320896384}
W20260709 12:24:38.788095 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.789745 25754 raft_consensus.cc:1275] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:24:38.755810 29435 raft_consensus.cc:2764] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:24:38.797829 25763 raft_consensus.cc:1240] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:38.799367 29504 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:38.800271 29245 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:38.802919 29519 log.cc:927] Time spent T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.691s	user 0.003s	sys 0.002s
I20260709 12:24:38.570384 25758 rpcz_store.cc:276] 0709 12:24:37.448031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.398775 (+950744us) service_pool.cc:224] Handling call
0709 12:24:38.399223 (+   448us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:38.399557 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:24:38.399947 (+   390us) log.cc:844] Serialized 14 byte log entry
0709 12:24:38.544189 (+144242us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:38.544265 (+    76us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:38.544327 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:38.544415 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:38.544582 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":223,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":85,"raft.queue_time_us":46101,"spinlock_wait_cycles":26368,"thread_start_us":111974,"threads_started":1}
I20260709 12:24:38.758625 29001 raft_consensus.cc:3060] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:38.786580 29480 raft_consensus.cc:3060] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:38.815289 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 201462us
I20260709 12:24:38.825877 25834 raft_consensus.cc:1240] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 7 LEADER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:38.831887 29516 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:38.832769 26402 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:24:38.832602 29516 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:38.833794 29127 raft_consensus.cc:2804] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:38.834227 26402 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:38.834307 29127 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:38.834770 29516 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:38.834910 29127 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:38.845628 25762 raft_consensus.cc:1275] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:24:38.858944 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:38.864456 25834 raft_consensus.cc:2393] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 8: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:38.868388 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:38.859244 29316 consensus_meta.cc:287] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.642s	user 0.012s	sys 0.000s
I20260709 12:24:38.872675 25828 raft_consensus.cc:2410] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:24:38.875077 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:38.837134 29504 consensus_queue.cc:1059] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:24:38.885658 25836 raft_consensus.cc:2468] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 10.
I20260709 12:24:38.894027 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:38.900023 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 196240us
I20260709 12:24:38.907507 25828 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 8.
I20260709 12:24:38.874981 29316 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:38.928398 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:38.903005 29358 raft_consensus.cc:2749] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:38.909848 29500 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:38.958019 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:38.961547 25685 raft_consensus.cc:1240] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:24:38.964157 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:38.955862 29512 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:38.968181 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:38.970611 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:38.971035 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:38.971385 25831 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:38.971710 25833 raft_consensus.cc:3060] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:38.972620 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:38.973301 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:38.973912 25829 raft_consensus.cc:3060] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:38.973997 25649 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:38.974207 25834 raft_consensus.cc:1240] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 12. Current term is 13. Ops: [10.6-12.7]
I20260709 12:24:38.973400 25836 raft_consensus.cc:2393] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 10: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
W20260709 12:24:38.977020 26402 connection.cc:256] RPC call timeout handler was delayed by -1.4992162929997903s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15300000000000002s for a response
W20260709 12:24:38.977873 26402 connection.cc:256] RPC call timeout handler was delayed by -1.3696162929995808s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1674s for a response
W20260709 12:24:38.978355 26402 connection.cc:256] RPC call timeout handler was delayed by -1.1428162929996688s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1926s for a response
W20260709 12:24:38.978765 26402 connection.cc:256] RPC call timeout handler was delayed by -1.1041162929996062s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19690000000000002s for a response
W20260709 12:24:38.979211 26402 connection.cc:256] RPC call timeout handler was delayed by -1.0825162929995713s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19930000000000003s for a response
I20260709 12:24:38.967545 29512 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:24:38.980962 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.961527 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:38.989754 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:38.993495 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:38.996486 25828 raft_consensus.cc:1240] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 6. Current term is 7. Ops: [4.4-6.5]
I20260709 12:24:38.982481 29506 raft_consensus.cc:2804] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:39.000150 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:38.982828 29245 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:39.006616 26437 raft_consensus.cc:1217] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Deduplicated request from leader. Original: 4.7->[6.8-8.9]   Dedup: 8.9->[]
I20260709 12:24:39.006811 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:39.007105 26437 raft_consensus.cc:1240] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 8. Current term is 9. Ops: [6.8-8.9]
I20260709 12:24:39.007524 26434 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 6.
I20260709 12:24:39.012347 25833 raft_consensus.cc:2468] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 7.
W20260709 12:24:39.012588 29530 log.cc:927] Time spent T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:24:39.013829 29316 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:39.014556 25759 raft_consensus.cc:3055] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:39.014910 25759 raft_consensus.cc:740] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:39.015719 25759 consensus_queue.cc:260] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:39.016702 25759 raft_consensus.cc:3060] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:39.016860 29486 raft_consensus.cc:3055] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:24:39.017387 29486 raft_consensus.cc:740] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:39.018375 29486 consensus_queue.cc:260] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:39.019739 29524 log.cc:927] Time spent T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.316s	user 0.001s	sys 0.001s
I20260709 12:24:39.004928 29506 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:39.024613 29506 raft_consensus.cc:3060] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:39.001543 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:39.002122 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:39.026993 26439 raft_consensus.cc:2393] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 8: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
W20260709 12:24:39.028079 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:39.002440 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 399863us
W20260709 12:24:39.030112 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:39.031037 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 45965.5us
I20260709 12:24:39.031903 25679 raft_consensus.cc:2468] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 11.
I20260709 12:24:39.029618 25763 pending_rounds.cc:85] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 4
I20260709 12:24:39.034308 25763 pending_rounds.cc:107] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:24:39.034675 25763 raft_consensus.cc:2889] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:39.037930 25801 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:39.038633 25649 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:39.045564 25831 raft_consensus.cc:2468] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 11.
I20260709 12:24:39.036439 29355 raft_consensus.cc:697] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 8 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:39.045120 28959 raft_consensus.cc:2804] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:39.052371 29317 raft_consensus.cc:2749] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:24:39.053982 26430 raft_consensus.cc:1240] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 9. Current term is 10. Ops: []
W20260709 12:24:39.060010 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:39.056058 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:39.056133 29536 consensus_queue.cc:1059] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:39.039908 29512 raft_consensus.cc:2749] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:39.055384 29245 consensus_queue.cc:1048] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:39.056816 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:39.065217 28959 raft_consensus.cc:697] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 8 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:39.068367 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:39.068719 28959 consensus_queue.cc:237] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:39.069639 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:39.072197 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:39.076875 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:39.078780 25682 raft_consensus.cc:2468] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 10.
I20260709 12:24:39.077705 26432 raft_consensus.cc:2468] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 9.
W20260709 12:24:39.085032 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 493795us
I20260709 12:24:39.087692 25759 raft_consensus.cc:1275] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:24:39.093534 29480 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:39.095579 29316 consensus_queue.cc:1048] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:39.096421 29480 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:39.088810 29440 raft_consensus.cc:697] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:39.096850 29355 consensus_queue.cc:237] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:39.097410 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:39.098196 26439 raft_consensus.cc:2393] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 8: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:39.097980 29440 consensus_queue.cc:237] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:39.100262 29361 raft_consensus.cc:3055] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:39.100674 29361 raft_consensus.cc:740] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:39.101603 29361 consensus_queue.cc:260] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:39.102741 29361 raft_consensus.cc:3060] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:39.088373 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 50535.7us
I20260709 12:24:39.116039 25829 raft_consensus.cc:2468] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 9.
W20260709 12:24:39.117378 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:39.118458 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:39.119257 25759 raft_consensus.cc:3060] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:24:39.120275 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:39.122256 29001 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:39.124454 29001 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:39.125382 29127 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:39.127342 29127 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:39.128201 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:39.129421 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:39.132728 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 358877us
I20260709 12:24:39.132011 25831 raft_consensus.cc:2468] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 7.
I20260709 12:24:39.138209 25831 raft_consensus.cc:1240] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:39.156405 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:39.160569 25836 raft_consensus.cc:1240] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:39.167382 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:39.169878 26432 raft_consensus.cc:2368] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 7. Current term is 8.
I20260709 12:24:39.176306 25829 raft_consensus.cc:1240] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 6 LEADER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:39.178340 25801 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:39.182454 25726 leader_election.cc:400] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Vote denied by peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) with higher term. Message: Invalid argument: T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 7. Current term is 8.
I20260709 12:24:39.182893 25726 leader_election.cc:403] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:39.216084 29533 raft_consensus.cc:2804] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:39.216976 29533 raft_consensus.cc:697] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 8 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:39.218083 29533 consensus_queue.cc:237] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:39.223846 29537 consensus_queue.cc:1048] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:24:39.227998 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:39.230670 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 92020us
I20260709 12:24:39.231966 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:39.244292 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 108547us
I20260709 12:24:39.246134 25757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 2359) took 1269 ms. Trace:
I20260709 12:24:39.246650 25757 rpcz_store.cc:276] 0709 12:24:37.976324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.595761 (+619437us) service_pool.cc:224] Handling call
0709 12:24:38.596104 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:39.245700 (+649596us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:39.245787 (+    87us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:39.245833 (+    46us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:39.245871 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:39.245944 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:39.246078 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4462,"raft.run_cpu_time_us":55,"raft.run_wall_time_us":55,"thread_start_us":420051,"threads_started":1}
I20260709 12:24:39.238834 29500 raft_consensus.cc:2749] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) with higher term. Message: Invalid argument: T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 7. Current term is 8.
I20260709 12:24:39.259182 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:39.251236 25726 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:24:39.282765 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 44246.8us
I20260709 12:24:39.242146 29537 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
W20260709 12:24:39.301357 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 54550.3us
W20260709 12:24:39.305593 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 72558.9us
I20260709 12:24:39.234241 29506 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:39.327435 26402 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:39.336618 29235 consensus_queue.cc:1059] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
W20260709 12:24:39.355091 29179 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.111s	user 0.024s	sys 0.001s
W20260709 12:24:39.361383 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 432556us
I20260709 12:24:39.362831 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:39.362864 26434 raft_consensus.cc:1240] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:39.365173 25677 raft_consensus.cc:2393] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 10: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:39.372260 25650 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:39.377744 26438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 954) took 1269 ms. Trace:
I20260709 12:24:39.380872 26402 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:24:39.362668 29179 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.287s	user 0.024s	sys 0.002s
I20260709 12:24:39.334542 29537 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:39.378322 26438 rpcz_store.cc:276] 0709 12:24:38.092448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.187645 (+ 95197us) service_pool.cc:224] Handling call
0709 12:24:38.225143 (+ 37498us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:38.254240 (+ 29097us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:24:38.385343 (+131103us) log.cc:844] Serialized 14 byte log entry
0709 12:24:38.956736 (+571393us) log.cc:844] Serialized 14 byte log entry
0709 12:24:39.361051 (+404315us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:39.361104 (+    53us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:24:39.361141 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:39.361731 (+   590us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:39.362017 (+   286us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":378133,"prepare.run_cpu_time_us":102,"prepare.run_wall_time_us":4659,"raft.queue_time_us":142462,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":200,"thread_start_us":1044289,"threads_started":4,"wal-append.queue_time_us":500170}
I20260709 12:24:39.405198 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:39.407857 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:39.409255 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:39.411520 25677 raft_consensus.cc:1240] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:39.408586 25686 raft_consensus.cc:2468] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 10.
I20260709 12:24:39.412556 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:39.419838 25759 raft_consensus.cc:2468] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 12.
I20260709 12:24:39.421271 29127 consensus_queue.cc:1059] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 12:24:39.424554 29231 consensus_queue.cc:1059] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:24:39.425566 29127 raft_consensus.cc:3055] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:39.426204 29127 raft_consensus.cc:740] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:39.425537 29539 raft_consensus.cc:3055] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:39.426594 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:39.431419 25759 raft_consensus.cc:2468] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 8.
I20260709 12:24:39.421186 25837 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 9.
I20260709 12:24:39.433076 25683 raft_consensus.cc:1240] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:24:39.462805 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:39.412218 29215 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.412493 29245 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.436638 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:39.473980 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:39.434679 25726 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.245.132:35611 timed out after 1.718s (SENT) [suppressed 8 similar messages]
I20260709 12:24:39.430972 29536 raft_consensus.cc:2749] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:39.478154 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
W20260709 12:24:39.479434 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 107295us
I20260709 12:24:39.430914 29539 raft_consensus.cc:740] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:39.482048 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:39.484242 25650 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:39.484402 29127 consensus_queue.cc:260] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:39.485662 29242 raft_consensus.cc:2749] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:24:39.441596 29545 raft_consensus.cc:2804] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:39.486948 26401 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:39.423215 29480 consensus_queue.cc:1059] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 12:24:39.494901 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:39.441751 29512 consensus_queue.cc:1059] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:24:39.499989 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:39.496538 25650 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:39.501870 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:39.502686 25759 raft_consensus.cc:3060] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:39.478477 29215 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:39.497057 29540 raft_consensus.cc:2749] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:39.488230 29545 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:39.492561 29415 consensus_queue.cc:1048] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:24:39.509493 29231 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.510210 29506 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:39.510733 29242 raft_consensus.cc:2804] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:24:39.487591 29245 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:39.513278 29545 raft_consensus.cc:3060] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:39.563971 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 129268us
I20260709 12:24:39.555801 29540 raft_consensus.cc:2804] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:39.552289 29541 raft_consensus.cc:2804] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:24:39.583387 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 96511.7us
I20260709 12:24:39.497072 29539 consensus_queue.cc:260] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:39.587944 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 99722.2us
I20260709 12:24:39.570703 29127 raft_consensus.cc:3060] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:39.589751 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:39.577006 29543 log.cc:927] Time spent T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
W20260709 12:24:39.598726 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:39.600525 29534 log.cc:927] Time spent T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.214s	user 0.000s	sys 0.001s
W20260709 12:24:39.601612 25726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:39.602170 25726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:39.603991 29440 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.576113 29242 raft_consensus.cc:697] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 13 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:39.614843 29242 consensus_queue.cc:237] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:39.616003 29547 log.cc:927] Time spent T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 12:24:39.573927 29316 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:39.620501 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:39.620393 29316 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:39.622913 29316 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:39.584604 29540 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:39.623577 29546 log.cc:927] Time spent T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
I20260709 12:24:39.623960 29540 raft_consensus.cc:3060] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:39.611099 29440 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:39.629760 29440 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:39.611842 29435 consensus_queue.cc:1059] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
W20260709 12:24:39.632505 29548 log.cc:927] Time spent T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 12:24:39.613368 29215 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:39.632908 29486 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:39.613826 29245 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:39.638685 29540 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:39.641045 29540 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:24:39.641942 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:39.641098 29361 raft_consensus.cc:2955] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 9 LEADER]: Committing config change with OpId 9.8: config changed from index 3 to 8, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:24:39.643474 25763 raft_consensus.cc:3055] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:39.643829 25763 raft_consensus.cc:740] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:39.644600 25763 consensus_queue.cc:260] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:39.645507 25763 raft_consensus.cc:3060] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:39.646276 29427 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:39.646831 29427 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:39.649231 29427 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:39.649915 29427 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
W20260709 12:24:39.653306 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:39.653761 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:39.656147 28967 raft_consensus.cc:3055] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:39.656632 25760 pending_rounds.cc:85] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 7
I20260709 12:24:39.657011 25760 pending_rounds.cc:107] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:24:39.657241 25760 raft_consensus.cc:2889] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:39.656572 28967 raft_consensus.cc:740] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:39.659677 25762 pending_rounds.cc:85] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 7
I20260709 12:24:39.698292 25762 pending_rounds.cc:107] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:24:39.698613 25762 raft_consensus.cc:2889] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:39.671448 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:39.700229 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:39.668423 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:39.680969 25726 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:39.682945 25800 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:39.667462 25761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48606 (request call id 900) took 1679 ms. Trace:
I20260709 12:24:39.670950 29420 raft_consensus.cc:3055] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:24:39.675717 29535 log.cc:927] Time spent T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.321s	user 0.000s	sys 0.001s
W20260709 12:24:39.680550 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 84615.6us
I20260709 12:24:39.567485 29231 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:39.697160 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:39.606899 29541 raft_consensus.cc:697] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 7 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:39.660300 28967 consensus_queue.cc:260] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:39.723440 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:39.702342 25761 rpcz_store.cc:276] 0709 12:24:37.988277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.642539 (+654262us) service_pool.cc:224] Handling call
0709 12:24:38.643006 (+   467us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:38.785023 (+142017us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:38.785052 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:38.785535 (+   483us) log.cc:844] Serialized 26 byte log entry
0709 12:24:39.155777 (+370242us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:39.155840 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:39.667043 (+511203us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b54001e5854. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:39.667093 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:39.667143 (+    50us) raft_consensus.cc:1685] finished
0709 12:24:39.667158 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:39.667397 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":327717376,"thread_start_us":369784,"threads_started":1,"wal-append.queue_time_us":610647}
I20260709 12:24:39.724948 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
W20260709 12:24:39.727902 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 217530us
I20260709 12:24:39.650385 29427 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:39.741717 28967 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:39.699036 29538 consensus_queue.cc:1048] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
W20260709 12:24:39.743852 26402 leader_election.cc:336] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 1.993s (SENT)
W20260709 12:24:39.739693 29416 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.726s	user 0.016s	sys 0.000s
W20260709 12:24:39.744755 29416 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.016s	sys 0.000s
I20260709 12:24:39.744315 26402 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:39.705477 29316 raft_consensus.cc:2804] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:24:39.746156 29231 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:39.746448 29570 raft_consensus.cc:2749] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:39.746827 25833 raft_consensus.cc:1240] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 9 LEADER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:39.747495 29544 raft_consensus.cc:3055] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:24:39.747623 26402 leader_election.cc:336] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 2.106s (SENT)
I20260709 12:24:39.703104 29420 raft_consensus.cc:740] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:39.758591 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:39.758829 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:39.721717 29500 raft_consensus.cc:2749] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:39.761166 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:39.804860 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 74663.5us
I20260709 12:24:39.763212 29539 raft_consensus.cc:3060] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:39.764667 29541 consensus_queue.cc:237] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:39.765954 29537 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:24:39.767020 29558 log.cc:927] Time spent T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:24:39.760250 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:39.810626 25763 raft_consensus.cc:1275] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:24:39.719702 25759 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 8.
I20260709 12:24:39.818046 25650 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:39.821972 26438 raft_consensus.cc:2468] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 11.
W20260709 12:24:39.817431 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 45351.4us
W20260709 12:24:39.823350 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 219196us
I20260709 12:24:39.827786 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:39.828876 26434 raft_consensus.cc:1240] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 6. Current term is 7. Ops: []
W20260709 12:24:39.830130 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 82532.9us
I20260709 12:24:39.772243 29544 raft_consensus.cc:740] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:39.826324 25763 pending_rounds.cc:85] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 4
I20260709 12:24:39.834259 25763 pending_rounds.cc:107] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:24:39.834682 25763 raft_consensus.cc:2889] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:39.835479 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:39.836338 25757 raft_consensus.cc:3060] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:39.836808 29420 consensus_queue.cc:260] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:39.844388 26439 raft_consensus.cc:2468] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 8.
I20260709 12:24:39.845173 29420 raft_consensus.cc:3060] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:39.817009 29316 raft_consensus.cc:697] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 12 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:39.848973 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:24:39.854415 29552 log.cc:927] Time spent T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
W20260709 12:24:39.856274 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:39.856947 29544 consensus_queue.cc:260] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:39.858428 29544 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:39.860781 29551 raft_consensus.cc:3055] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:39.861202 29551 raft_consensus.cc:740] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:39.862030 29551 consensus_queue.cc:260] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:39.863039 29551 raft_consensus.cc:3060] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:39.864528 25581 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41240 (request call id 369) took 25559 ms (client timeout 15000 ms). Trace:
W20260709 12:24:39.866255 29557 log.cc:927] Time spent T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 12:24:39.865816 29316 consensus_queue.cc:237] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:39.868127 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 50166.7us
I20260709 12:24:39.869767 25763 raft_consensus.cc:1240] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:39.860416 25829 consensus_queue.cc:237] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:39.874111 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:39.880141 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:39.880785 25679 raft_consensus.cc:2468] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 5.
I20260709 12:24:39.851447 29537 raft_consensus.cc:2749] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:39.892043 25650 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:39.845677 29416 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.894038 25726 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:39.898734 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:39.899539 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:39.904239 25682 raft_consensus.cc:2393] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 11: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:39.904569 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:39.905225 25679 raft_consensus.cc:2468] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 9.
I20260709 12:24:39.906177 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:39.915246 26402 leader_election.cc:336] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 2.923s (SENT)
I20260709 12:24:39.915438 26438 raft_consensus.cc:3055] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:39.915764 26438 raft_consensus.cc:740] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:39.917898 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:39.919065 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:39.919694 26437 raft_consensus.cc:3060] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:39.922477 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:39.846050 28657 consensus_queue.cc:1048] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 12:24:39.925781 26436 raft_consensus.cc:1275] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:24:39.930959 26438 consensus_queue.cc:260] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:39.937762 25726 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:39.917914 29486 raft_consensus.cc:2749] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:24:39.943701 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 51767us
I20260709 12:24:39.948007 25755 raft_consensus.cc:1275] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:24:39.952641 29573 log.cc:927] Time spent T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:24:39.953979 26432 raft_consensus.cc:2410] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:24:39.958698 26437 raft_consensus.cc:2468] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 12.
I20260709 12:24:39.966710 29545 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:39.864908 25581 rpcz_store.cc:269] 0709 12:24:14.305462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:14.344436 (+ 38974us) service_pool.cc:224] Handling call
0709 12:24:39.864329 (+25519893us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:34.026700 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:34.164376 (+137676us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:34.167090 (+  2714us) write_op.cc:435] Acquired schema lock
0709 12:24:34.169560 (+  2470us) tablet.cc:662] Decoding operations
0709 12:24:34.240664 (+ 71104us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:34.240742 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:34.240766 (+    24us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:24:34.241302 (+   536us) tablet.cc:701] Row locks acquired
0709 12:24:34.241323 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:24:34.241470 (+   147us) write_op.cc:270] Start()
0709 12:24:34.241594 (+   124us) write_op.cc:276] Timestamp: P: 1783599874241423 usec, L: 0
0709 12:24:34.241613 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:24:34.330098 (+ 88485us) log.cc:844] Serialized 2084 byte log entry
0709 12:24:35.543521 (+1213423us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b5400078854. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b5ce28 00007f5d9d597581 00007f5d9d596d58 00007f5d9d59b9f1 00007f5d9d59b9a9 00007f5d9d59b939 00007f5d9d59b901 00007f5d9d59ab2d 0000000000388634 0000000000388479
0709 12:24:36.230997 (+687476us) op_driver.cc:464] REPLICATION: finished
0709 12:24:37.187309 (+956312us) write_op.cc:301] APPLY: starting
0709 12:24:37.187388 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:37.187580 (+   192us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:37.187604 (+    24us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:37.188288 (+   684us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:37.188472 (+   184us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:24:37.188514 (+    42us) write_op.cc:312] APPLY: finished
0709 12:24:37.188756 (+   242us) log.cc:844] Serialized 47 byte log entry
0709 12:24:37.624623 (+435867us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:37.637934 (+ 13311us) write_op.cc:454] Released schema lock
0709 12:24:37.648242 (+ 10308us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:37.708637 (+ 60395us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:37.712174 (+  3537us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":305209,"reported_tablets":36,"child_traces":[["op",{"apply.queue_time_us":943277,"apply.run_cpu_time_us":16655,"apply.run_wall_time_us":503432,"num_ops":5,"prepare.queue_time_us":465586,"prepare.run_cpu_time_us":15431,"prepare.run_wall_time_us":1542016,"raft.queue_time_us":1277145,"raft.run_cpu_time_us":39236,"raft.run_wall_time_us":1155941,"replication_time_us":1832996,"spinlock_wait_cycles":41956224,"thread_start_us":2550894,"threads_started":5,"wal-append.queue_time_us":735897,"wal-append.run_cpu_time_us":47439,"wal-append.run_wall_time_us":3237913}]]}
I20260709 12:24:39.930558 29245 raft_consensus.cc:2804] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:39.983258 25685 raft_consensus.cc:1240] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:39.972543 26438 raft_consensus.cc:3060] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:39.977399 25757 raft_consensus.cc:2468] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 9.
W20260709 12:24:39.979895 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:39.993686 26401 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:39.996364 25726 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:39.998466 25650 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:39.922477 29416 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:40.002609 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:40.004844 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 101872us
W20260709 12:24:40.005590 26402 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.006702 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:40.008206 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:39.993762 29500 raft_consensus.cc:2804] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:40.017544 29500 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:40.018256 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:40.019119 25834 raft_consensus.cc:1240] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:40.014881 29504 raft_consensus.cc:2804] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:39.995244 29245 raft_consensus.cc:697] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 10 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:40.016242 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:40.018005 29500 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:40.020112 29504 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:40.017000 26433 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 9.
I20260709 12:24:40.015358 29540 raft_consensus.cc:3055] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:40.018157 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:39.997907 29541 raft_consensus.cc:2804] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:40.028111 26439 raft_consensus.cc:1240] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:24:40.030071 25685 raft_consensus.cc:1275] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:24:40.031150 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.032696 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:40.033262 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:40.037027 25726 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:24:40.038260 25801 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:40.040978 29541 raft_consensus.cc:697] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 9 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:40.044487 26438 raft_consensus.cc:1275] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:24:40.027247 29506 raft_consensus.cc:2749] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:39.998514 29355 consensus_queue.cc:1048] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:24:40.029835 29504 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:40.057322 29579 log.cc:927] Time spent T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
W20260709 12:24:40.047987 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 49611.3us
I20260709 12:24:40.061472 25650 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:24:40.061767 25583 catalog_manager.cc:5697] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 4 to 5, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 5 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:40.067579 29504 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:40.067984 29245 consensus_queue.cc:237] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:40.069859 29504 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:40.029652 29540 raft_consensus.cc:740] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:40.074071 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:40.052057 25685 raft_consensus.cc:1275] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:24:40.101915 29243 raft_consensus.cc:2804] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:40.102458 29243 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:40.102875 29243 raft_consensus.cc:3060] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:40.104418 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:40.105012 25680 raft_consensus.cc:3060] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:40.108142 28657 raft_consensus.cc:2749] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:40.117650 25680 raft_consensus.cc:2468] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 6.
I20260709 12:24:40.118239 29243 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:40.119660 25679 raft_consensus.cc:1240] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:40.121407 29243 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:40.123091 29416 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:40.126756 29243 consensus_queue.cc:1059] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:40.128684 29537 raft_consensus.cc:3055] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:40.129096 29537 raft_consensus.cc:740] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:40.130435 25678 raft_consensus.cc:2468] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 7.
I20260709 12:24:40.130103 29537 consensus_queue.cc:260] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:40.131625 29537 raft_consensus.cc:3060] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:40.133669 29545 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:40.139250 25760 raft_consensus.cc:1275] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:24:40.043538 29427 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:24:40.152329 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 121994us
W20260709 12:24:40.153028 29127 consensus_meta.cc:287] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.549s	user 0.008s	sys 0.001s
W20260709 12:24:40.153548 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 92125.3us
I20260709 12:24:40.045140 29541 consensus_queue.cc:237] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:40.154263 29506 consensus_queue.cc:1048] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:24:40.159490 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 148118us
I20260709 12:24:40.092424 29440 raft_consensus.cc:2804] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:40.176994 26402 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:24:40.194653 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.201563 25758 raft_consensus.cc:1275] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 12:24:40.202004 25758 pending_rounds.cc:85] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 6
I20260709 12:24:40.202227 25758 pending_rounds.cc:107] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 12:24:40.202422 26431 raft_consensus.cc:2410] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:24:40.202438 25758 raft_consensus.cc:2889] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:40.203867 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.164331 25760 raft_consensus.cc:2955] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 3 to 8, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:24:40.168569 28967 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.205829 25726 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
W20260709 12:24:40.213980 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.221541 29551 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:40.222172 29551 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:40.224293 29551 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:40.229346 29500 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:40.231540 29500 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:40.229306 29539 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:40.232404 29539 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:40.233354 28967 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:40.237802 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 67784.6us
I20260709 12:24:40.202718 29242 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:40.241654 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 68933us
I20260709 12:24:40.204919 29215 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.245666 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:40.248374 25829 raft_consensus.cc:2468] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 6.
I20260709 12:24:40.250752 25754 raft_consensus.cc:1240] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:40.251436 25726 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:24:40.173002 29001 consensus_queue.cc:1048] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 12:24:40.208835 29127 raft_consensus.cc:2749] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:40.213369 29440 raft_consensus.cc:697] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:40.253036 26402 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:40.202504 29358 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
W20260709 12:24:40.267347 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.249763 29215 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:40.302646 29215 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:24:40.297091 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:40.261754 29361 consensus_meta.cc:287] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.619s	user 0.014s	sys 0.000s
W20260709 12:24:40.309129 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.257365 29539 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:24:40.314178 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.315308 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:40.321437 28967 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:24:40.322696 29588 log.cc:927] Time spent T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
W20260709 12:24:40.324056 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 112235us
I20260709 12:24:40.326429 25726 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:24:40.328138 29486 raft_consensus.cc:2804] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:40.328212 29358 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:40.328864 29486 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:40.329424 29486 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:40.330914 29358 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:24:40.344213 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 105767us
I20260709 12:24:40.349188 26438 raft_consensus.cc:1240] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:40.280793 29504 raft_consensus.cc:2804] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:40.375424 29440 consensus_queue.cc:237] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:40.293715 29427 raft_consensus.cc:2804] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:40.296972 29500 raft_consensus.cc:2804] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:24:40.384182 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 59294.6us
I20260709 12:24:40.291800 29242 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:40.404233 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:40.381127 29427 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:40.410333 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:40.411123 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:40.413937 25829 raft_consensus.cc:2468] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 7.
I20260709 12:24:40.412349 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:40.412770 25759 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 12.
I20260709 12:24:40.415228 26434 raft_consensus.cc:1240] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:40.419509 26439 raft_consensus.cc:2410] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:24:40.424911 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:40.425833 26430 raft_consensus.cc:2393] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 7: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:40.384621 29504 raft_consensus.cc:697] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:40.400836 29480 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:40.438246 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:40.439216 26437 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 6.
I20260709 12:24:40.382649 29550 consensus_queue.cc:1059] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:24:40.414983 29427 raft_consensus.cc:3060] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:40.468137 26433 raft_consensus.cc:1275] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:24:40.479751 26439 raft_consensus.cc:1275] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:24:40.483938 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 98228.8us
W20260709 12:24:40.503705 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.511448 25726 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:40.504006 26437 raft_consensus.cc:2955] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 3 to 8, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:24:40.438619 28967 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:40.478304 29344 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.568696 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:24:40.570185 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 153036us
W20260709 12:24:40.573422 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 69794.5us
W20260709 12:24:40.596699 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 85331us
I20260709 12:24:40.606561 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:40.607339 25679 raft_consensus.cc:2393] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 7: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:40.608609 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:40.485025 29480 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:40.639779 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:40.642268 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 44830.5us
I20260709 12:24:40.568650 29500 raft_consensus.cc:697] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 9 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:40.645186 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:40.646065 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:40.673790 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:40.733862 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:40.663599 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:40.692915 29583 log.cc:927] Time spent T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
W20260709 12:24:40.745854 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 263829us
I20260709 12:24:40.580571 29344 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:40.605059 28967 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:40.646564 25679 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3767151a5d4345659810a40ea7f44873"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
mode: GRACEFUL
new_leader_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:49108
I20260709 12:24:40.831980 25679 raft_consensus.cc:606] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Received request to transfer leadership to TS 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:40.832445 25679 raft_consensus.cc:614] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:24:40.790211 29594 log.cc:927] Time spent T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.282s	user 0.000s	sys 0.000s
W20260709 12:24:40.791405 29596 log.cc:927] Time spent T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
W20260709 12:24:40.846246 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.803399 25685 raft_consensus.cc:1275] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 12:24:40.804736 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:40.847785 25685 pending_rounds.cc:85] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc: Aborting all ops after (but not including) 6
I20260709 12:24:40.805500 25680 raft_consensus.cc:1240] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 7 LEADER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
W20260709 12:24:40.809661 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 203944us
I20260709 12:24:40.848237 25685 pending_rounds.cc:107] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 12:24:40.812158 25763 raft_consensus.cc:2468] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 9.
I20260709 12:24:40.848631 25685 raft_consensus.cc:2889] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:40.812899 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:40.815773 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 172581us
I20260709 12:24:40.823606 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:40.825449 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:40.826903 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:40.851444 25835 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:40.828357 25836 raft_consensus.cc:1275] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:24:40.837639 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:40.838665 25801 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:40.845604 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:40.567804 29545 consensus_queue.cc:1059] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.120s
W20260709 12:24:40.859439 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.876622 25726 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:24:40.876991 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:40.846184 29355 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:40.904901 29592 log.cc:927] Time spent T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.520s	user 0.003s	sys 0.000s
I20260709 12:24:40.675932 29504 consensus_queue.cc:237] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:40.847389 29516 consensus_queue.cc:1048] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.107s
I20260709 12:24:40.975778 26401 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:24:41.067530 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 228968us
I20260709 12:24:41.069031 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:41.069067 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:41.087946 25834 raft_consensus.cc:2393] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 6: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:41.134649 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:40.964942 25828 raft_consensus.cc:2955] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 3 to 8, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
W20260709 12:24:41.145761 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.069761 29242 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:40.961838 29355 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:41.148865 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:41.147500 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 267022us
I20260709 12:24:41.162849 25834 raft_consensus.cc:1240] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:41.122334 29603 raft_consensus.cc:2749] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:24:41.159246 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 183421us
I20260709 12:24:41.168781 25762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 2390) took 1062 ms. Trace:
W20260709 12:24:41.152108 29598 log.cc:927] Time spent T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.530s	user 0.000s	sys 0.001s
I20260709 12:24:41.175561 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:41.169811 25762 rpcz_store.cc:276] 0709 12:24:40.095196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.095400 (+   204us) service_pool.cc:224] Handling call
0709 12:24:40.106547 (+ 11147us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:40.106900 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:40.106934 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:40.107425 (+   491us) log.cc:844] Serialized 26 byte log entry
0709 12:24:40.184141 (+ 76716us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:40.184179 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:40.184246 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:41.157210 (+972964us) raft_consensus.cc:1685] finished
0709 12:24:41.157236 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:41.157369 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1262,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"thread_start_us":76339,"threads_started":1,"wal-append.queue_time_us":183913}
I20260709 12:24:41.147054 29245 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.189379 29537 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.127518 29500 consensus_queue.cc:237] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:41.196918 25801 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
W20260709 12:24:41.170882 29575 log.cc:927] Time spent T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.173s	user 0.001s	sys 0.001s
I20260709 12:24:41.205032 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:41.161684 29602 raft_consensus.cc:3060] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:41.167814 29608 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.172662 29541 raft_consensus.cc:2804] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:24:41.213279 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 336679us
I20260709 12:24:41.171618 29127 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:41.236419 25726 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:41.197762 29358 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.224638 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:41.251817 25726 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:41.209033 29545 raft_consensus.cc:2804] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:24:41.248281 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.282996 25835 raft_consensus.cc:2468] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 10.
I20260709 12:24:41.275002 25829 raft_consensus.cc:1275] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:24:41.190109 29537 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:41.235879 29541 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
W20260709 12:24:41.259557 29604 log.cc:927] Time spent T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.447s	user 0.000s	sys 0.001s
I20260709 12:24:41.245471 29550 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:41.302117 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 64157us
I20260709 12:24:41.206395 29245 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:41.306494 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:41.257162 29619 raft_consensus.cc:2749] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:24:41.323879 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 72165.6us
I20260709 12:24:41.324853 25726 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:41.321044 25680 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 8.
W20260709 12:24:41.304538 29316 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.247s	user 0.021s	sys 0.040s
W20260709 12:24:41.287529 29598 log.cc:927] Time spent T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:24:41.287010 29616 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.275151 29545 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:41.336455 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:41.298756 29541 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:41.288900 29512 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:41.345070 25677 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 15.
I20260709 12:24:41.238978 29608 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:41.348050 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:41.348881 25680 raft_consensus.cc:2376] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 8. Re-sending same reply.
I20260709 12:24:41.316473 29539 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.257244 29127 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:41.331205 29316 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.295s	user 0.021s	sys 0.041s
I20260709 12:24:41.324793 29600 raft_consensus.cc:2749] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:41.322094 29536 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.263077 29358 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:41.325578 29344 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:41.375406 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:41.373152 29606 consensus_queue.cc:1059] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:41.385751 29245 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:41.386373 29619 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:41.386655 25649 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:24:41.440254 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 53683.6us
I20260709 12:24:41.376271 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:41.441725 25682 raft_consensus.cc:2376] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 10. Re-sending same reply.
I20260709 12:24:41.388288 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:41.346873 29545 raft_consensus.cc:3060] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:41.392848 25831 raft_consensus.cc:1275] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:24:41.393179 29537 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:41.357596 29512 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:41.399307 25726 leader_election.cc:400] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Vote denied by peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611) with higher term. Message: Invalid argument: T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 7. Current term is 8.
W20260709 12:24:41.455780 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 56633.6us
I20260709 12:24:41.456403 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:41.456542 25726 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:41.456840 29512 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:41.457522 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:41.457679 25726 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:41.458215 25684 raft_consensus.cc:2393] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 7: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:41.354503 25801 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:41.458982 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:41.459420 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 110825us
W20260709 12:24:41.403087 29599 log.cc:927] Time spent T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.728s	user 0.007s	sys 0.003s
W20260709 12:24:41.405510 29427 consensus_meta.cc:287] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.897s	user 0.004s	sys 0.005s
W20260709 12:24:41.368592 29601 log.cc:927] Time spent T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.475s	user 0.001s	sys 0.001s
I20260709 12:24:41.369782 29623 raft_consensus.cc:2749] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:41.323225 29550 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:41.370949 29612 log.cc:927] Time spent T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 12:24:41.382468 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.375310 29231 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.375075 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:41.374122 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:41.376111 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:41.425486 26437 raft_consensus.cc:1240] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:41.403302 29541 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:41.385854 26431 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36508 (request call id 941) took 1561 ms (client timeout 1721 ms). Trace:
I20260709 12:24:41.433662 29622 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:41.434270 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:41.496613 25833 raft_consensus.cc:2468] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 7.
I20260709 12:24:41.434391 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:41.435371 25650 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:41.497931 25757 raft_consensus.cc:2468] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 10.
W20260709 12:24:41.498232 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 62966.2us
I20260709 12:24:41.437273 25758 raft_consensus.cc:1240] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:41.438697 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:41.499008 25650 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:41.439124 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:41.435993 29242 consensus_queue.cc:1048] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 12:24:41.447984 29355 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:41.448134 29420 raft_consensus.cc:2804] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:41.503413 29420 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:41.504019 29420 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:41.505152 29550 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:41.412284 29539 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:41.449147 29617 log.cc:927] Time spent T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 12:24:41.451337 29440 raft_consensus.cc:3055] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:41.452261 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:41.465121 29544 raft_consensus.cc:2749] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:41.453164 29344 raft_consensus.cc:3055] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:41.453778 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:41.459007 25726 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:41.465840 25759 raft_consensus.cc:1240] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:41.369225 29611 raft_consensus.cc:2749] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:41.451624 29358 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349)
W20260709 12:24:41.464726 29486 consensus_meta.cc:287] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 1.135s	user 0.013s	sys 0.000s
I20260709 12:24:41.570044 25678 raft_consensus.cc:1275] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:24:41.478245 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:41.470815 29608 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:41.468413 29606 raft_consensus.cc:2804] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:41.501276 25677 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 6.
I20260709 12:24:41.501343 25650 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:41.468403 29245 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:41.501894 29537 raft_consensus.cc:2749] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:41.507846 25761 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.919s	user 0.004s	sys 0.017s
W20260709 12:24:41.574316 25761 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.004s	user 0.005s	sys 0.017s
W20260709 12:24:41.494894 26431 rpcz_store.cc:269] 0709 12:24:39.824061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:39.824172 (+   111us) service_pool.cc:224] Handling call
0709 12:24:41.385645 (+1561473us) spinlock_profiling.cc:243] Waited 374 ms on lock 0x7b5400334354. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:41.385778 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":859517824}
I20260709 12:24:41.470885 29621 raft_consensus.cc:2749] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:41.514953 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:41.432102 29536 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:41.520907 25800 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:41.353435 29616 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:41.529911 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 70961.4us
I20260709 12:24:41.532913 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:41.614408 25726 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:41.509058 29410 raft_consensus.cc:2749] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:41.508567 29623 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.501924 29127 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:41.517561 29231 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:41.471247 29427 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:41.629611 25835 raft_consensus.cc:2468] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 10.
I20260709 12:24:41.583688 29544 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:41.584465 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:41.517490 29440 raft_consensus.cc:740] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:41.597684 26439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 966) took 1094 ms. Trace:
I20260709 12:24:41.573428 29606 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:41.614652 26437 raft_consensus.cc:2393] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 8: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:41.497313 29512 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.613371 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:41.616019 25681 raft_consensus.cc:1275] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:41.646639 25682 raft_consensus.cc:2468] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 10.
I20260709 12:24:41.528290 29344 raft_consensus.cc:740] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:41.512840 29600 consensus_queue.cc:1048] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 12:24:41.621845 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:41.460338 29619 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:41.623164 25763 raft_consensus.cc:1275] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:24:41.574309 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 73044.2us
I20260709 12:24:41.624051 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:41.581797 29613 log.cc:927] Time spent T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:24:41.571799 29615 raft_consensus.cc:2749] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:41.655187 25650 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:41.621853 29602 raft_consensus.cc:2749] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:41.631589 29621 raft_consensus.cc:2804] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:41.583662 29607 consensus_queue.cc:1048] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.173s
I20260709 12:24:41.630429 26430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 965) took 1163 ms. Trace:
I20260709 12:24:41.581691 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:41.529412 29550 consensus_queue.cc:1059] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.090s
I20260709 12:24:41.582294 29541 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:24:41.642913 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 122078us
I20260709 12:24:41.636682 26431 raft_consensus.cc:1275] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:24:41.588217 29620 raft_consensus.cc:2749] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:41.616585 29242 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:41.659682 29410 raft_consensus.cc:2749] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:41.633550 26439 rpcz_store.cc:276] 0709 12:24:40.503429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.509441 (+  6012us) service_pool.cc:224] Handling call
0709 12:24:40.572562 (+ 63121us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:40.586878 (+ 14316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:40.586911 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:40.592749 (+  5838us) log.cc:844] Serialized 26 byte log entry
0709 12:24:41.113959 (+521210us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:41.114018 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:41.114113 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:41.597459 (+483346us) raft_consensus.cc:1685] finished
0709 12:24:41.597478 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:41.597618 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13896,"raft.queue_time_us":16481,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":7509,"thread_start_us":280360,"threads_started":1,"wal-append.queue_time_us":826090}
I20260709 12:24:41.575135 25761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 2761) took 1070 ms. Trace:
I20260709 12:24:41.626978 29358 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:41.659456 25677 raft_consensus.cc:2393] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 8: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:41.679558 29358 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:41.679307 25761 rpcz_store.cc:276] 0709 12:24:40.504507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.504647 (+   140us) service_pool.cc:224] Handling call
0709 12:24:40.504933 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:40.505165 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:24:40.517834 (+ 12669us) log.cc:844] Serialized 14 byte log entry
0709 12:24:41.574747 (+1056913us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:41.574814 (+    67us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:24:41.574871 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:41.574951 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:41.575075 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1687,"prepare.queue_time_us":68483,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":326559,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":6394,"thread_start_us":1003971,"threads_started":1}
I20260709 12:24:41.681233 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:41.681792 25761 raft_consensus.cc:2468] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 10.
I20260709 12:24:41.682394 29358 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:41.583487 29486 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:41.683532 25760 raft_consensus.cc:1240] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:24:41.685014 29486 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:41.614665 29245 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:41.666764 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:41.687358 29245 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:41.687963 29627 consensus_queue.cc:1059] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.082s
I20260709 12:24:41.688845 29629 raft_consensus.cc:2804] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:41.689383 29629 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:41.689793 29629 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:41.660629 29512 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:41.693570 29440 consensus_queue.cc:260] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:41.629860 29623 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:41.695206 29440 raft_consensus.cc:3060] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:41.697887 29616 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:41.698225 29427 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:41.645826 29544 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:41.700110 29344 consensus_queue.cc:260] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:41.701107 29544 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:41.701653 29344 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:41.641711 29606 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:41.704481 25757 raft_consensus.cc:2410] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:24:41.705313 26437 raft_consensus.cc:1275] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:24:41.705540 29619 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:41.707327 29545 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:41.708688 25762 raft_consensus.cc:1240] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:41.708480 29420 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:41.517328 29622 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:41.711277 25801 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:41.630342 25726 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:41.584944 29540 consensus_queue.cc:260] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:41.677858 29242 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:41.660125 26434 raft_consensus.cc:1240] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:41.682564 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:41.694159 29512 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:41.668550 26430 rpcz_store.cc:276] 0709 12:24:40.466906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.467048 (+   142us) service_pool.cc:224] Handling call
0709 12:24:40.504891 (+ 37843us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:40.505109 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:40.505133 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:40.509348 (+  4215us) log.cc:844] Serialized 26 byte log entry
0709 12:24:40.836237 (+326889us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:40.836284 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:40.836348 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:41.630142 (+793794us) raft_consensus.cc:1685] finished
0709 12:24:41.630170 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:41.630356 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":200185,"threads_started":1,"wal-append.queue_time_us":632305}
W20260709 12:24:41.669169 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.665496 25650 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:41.662374 29621 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:41.696767 29623 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:41.783162 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.739737 25833 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "819272169f6f4293b6e279793be58b49"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "a866ff967d964388a6f0dff7fd43df89"
 from {username='slave'} at 127.0.0.1:60480
W20260709 12:24:41.797363 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 131964us
W20260709 12:24:41.781507 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:41.748478 25830 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.788s	user 0.000s	sys 0.018s
W20260709 12:24:41.815968 25830 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.955s	user 0.005s	sys 0.022s
W20260709 12:24:41.808332 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 178828us
I20260709 12:24:41.724690 29544 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:41.812551 25833 raft_consensus.cc:606] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 8 LEADER]: Received request to transfer leadership to TS a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:41.717247 29603 raft_consensus.cc:2749] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:41.840976 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:41.843616 25683 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:41.847203 25828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 2686) took 1019 ms. Trace:
I20260709 12:24:41.849731 29242 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:41.850622 29536 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:41.850728 29625 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.851293 29625 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:41.739569 29486 raft_consensus.cc:2749] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:41.852434 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:41.853446 29625 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:41.855629 25683 raft_consensus.cc:2468] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 7.
I20260709 12:24:41.859632 29480 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:41.859907 29231 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:41.861850 29622 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:41.870131 29540 raft_consensus.cc:3060] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:41.867725 29629 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:41.872951 28967 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:41.873808 29629 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:41.879868 29624 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.806113 29611 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.881644 25762 raft_consensus.cc:1240] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:41.786720 29539 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:41.847707 25828 rpcz_store.cc:276] 0709 12:24:40.827882 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.894314 (+ 66432us) service_pool.cc:224] Handling call
0709 12:24:40.950229 (+ 55915us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:40.950475 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:24:41.333233 (+382758us) log.cc:844] Serialized 14 byte log entry
0709 12:24:41.846773 (+513540us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:41.846843 (+    70us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:41.846901 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:41.846985 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:41.847136 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":371971,"threads_started":1}
I20260709 12:24:41.893826 25801 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:41.733230 29538 raft_consensus.cc:2749] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:41.880407 29624 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:42.147658 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 190118us
W20260709 12:24:42.160877 25755 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.024s	sys 0.047s
W20260709 12:24:42.533926 25755 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.024s	user 0.030s	sys 0.081s
W20260709 12:24:42.534256 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.930405 26402 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:24:42.536131 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 605799us
I20260709 12:24:42.159216 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:42.538113 25757 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:24:41.899784 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 86494.1us
I20260709 12:24:42.135753 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:42.539311 25650 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:24:42.260751 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:42.440932 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:42.270089 29629 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.550595 29629 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:42.558889 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:41.749717 29420 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:24:42.592087 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 167518us
I20260709 12:24:42.586015 26434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 968) took 2071 ms. Trace:
I20260709 12:24:42.073829 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:42.581360 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:42.589404 25760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 2399) took 1161 ms. Trace:
I20260709 12:24:42.564803 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:42.585901 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:42.559688 25762 raft_consensus.cc:2468] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 8.
I20260709 12:24:42.108297 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:42.596511 25650 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:42.592672 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:42.131170 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:24:42.586540 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 692756us
I20260709 12:24:42.604012 25760 rpcz_store.cc:276] 0709 12:24:41.428027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:41.436248 (+  8221us) service_pool.cc:224] Handling call
0709 12:24:41.450017 (+ 13769us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:41.683906 (+233889us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:42.589054 (+905148us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b54001e4954. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:42.589337 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":536110336}
W20260709 12:24:42.444573 29643 log.cc:927] Time spent T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 12:24:42.602377 26434 rpcz_store.cc:276] 0709 12:24:40.514728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.515000 (+   272us) service_pool.cc:224] Handling call
0709 12:24:40.586744 (+ 71744us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:41.731221 (+1144477us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:42.585758 (+854537us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54005d02d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:42.585947 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2467960576}
W20260709 12:24:42.564028 25726 connection.cc:256] RPC call timeout handler was delayed by -2.2203337569999348s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17210000000000003s for a response
W20260709 12:24:42.638782 25726 connection.cc:256] RPC call timeout handler was delayed by -1.8486337569997886s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2134s for a response
I20260709 12:24:42.594719 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:24:42.608158 25686 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51578 (request call id 745) took 1334 ms (client timeout 1519 ms). Trace:
I20260709 12:24:42.623816 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:42.640651 25760 raft_consensus.cc:2410] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 11 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
W20260709 12:24:42.532291 29638 log.cc:927] Time spent T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.261s	user 0.001s	sys 0.000s
I20260709 12:24:41.846006 29621 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:42.628754 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:42.633694 25757 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 13.
I20260709 12:24:42.638619 25801 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:42.621701 25756 raft_consensus.cc:2468] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 9.
I20260709 12:24:42.641083 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:42.140496 29545 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:42.582813 29633 log.cc:927] Time spent T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.266s	user 0.000s	sys 0.000s
I20260709 12:24:41.947836 29127 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
W20260709 12:24:42.639825 25686 rpcz_store.cc:269] 0709 12:24:41.274180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.581074 (+1306894us) service_pool.cc:224] Handling call
0709 12:24:42.608073 (+ 26999us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:42.646219 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:42.658011 25762 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:24:42.583667 29637 log.cc:927] Time spent T 00000000000000000000000000000000 P 496fd6924b624e77b03ccfd15653d47b: Append to log took a long time: real 0.272s	user 0.000s	sys 0.000s
I20260709 12:24:41.845345 29544 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:42.596521 29635 log.cc:927] Time spent T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.770s	user 0.001s	sys 0.000s
W20260709 12:24:42.637419 29540 consensus_meta.cc:287] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.767s	user 0.006s	sys 0.007s
I20260709 12:24:42.557741 29361 raft_consensus.cc:2804] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:24:42.670892 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 47940.1us
I20260709 12:24:42.434522 28959 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:42.583112 29606 consensus_meta.cc:287] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.880s	user 0.006s	sys 0.001s
I20260709 12:24:42.557467 29632 raft_consensus.cc:2804] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:42.128033 29358 raft_consensus.cc:3055] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:24:42.236327 29480 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.652108 29420 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:42.560024 29243 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.014s	sys 0.005s
I20260709 12:24:41.956826 29231 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:42.589675 29316 raft_consensus.cc:2749] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:42.609109 29550 raft_consensus.cc:3055] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:42.669731 25760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 2774) took 1084 ms. Trace:
I20260709 12:24:42.718321 29316 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:42.718954 29316 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:42.672689 25835 raft_consensus.cc:1240] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 7 LEADER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:42.717703 25760 rpcz_store.cc:276] 0709 12:24:41.585720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.668708 (+1082988us) service_pool.cc:224] Handling call
0709 12:24:42.669053 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:42.669345 (+   292us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:42.669381 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:42.669437 (+    56us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:24:42.669479 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:42.669543 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:42.669666 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:42.671833 25801 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:42.147961 28967 consensus_queue.cc:1048] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.504s
I20260709 12:24:41.930464 29611 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:41.928910 29536 consensus_queue.cc:1048] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.734s
I20260709 12:24:42.593686 29616 consensus_queue.cc:1059] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 12:24:42.596432 29355 consensus_queue.cc:1059] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 12:24:42.580753 29539 consensus_queue.cc:1048] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.090s
I20260709 12:24:42.750177 25759 raft_consensus.cc:2410] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:24:42.652923 29486 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:42.704816 26430 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.009s	sys 0.043s
W20260709 12:24:42.751859 26430 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.009s	sys 0.043s
I20260709 12:24:42.711213 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:42.713092 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:42.719333 25832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 2690) took 1890 ms. Trace:
I20260709 12:24:42.665499 25756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 2777) took 1079 ms. Trace:
I20260709 12:24:42.757192 25756 rpcz_store.cc:276] 0709 12:24:41.586571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.664595 (+1078024us) service_pool.cc:224] Handling call
0709 12:24:42.664924 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:42.665147 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:42.665183 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:42.665237 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:42.665280 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:42.665350 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:42.665450 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:42.757035 25832 rpcz_store.cc:276] 0709 12:24:40.829314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.953696 (+124382us) service_pool.cc:224] Handling call
0709 12:24:41.383875 (+430179us) spinlock_profiling.cc:243] Waited 2.95 ms on lock 0x7b5800133e98. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d96a3cb71 00007f5d96a3ca22 00007f5d9f9558d9 00007f5d9eaafee0 00007f5d9eb790ab 00007f5d9eb79131 00007f5d9eb3afc0 00007f5d9eb25929 00007f5d9eb253d2 00007f5d9809cbd4
0709 12:24:41.384088 (+   213us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:41.384307 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:41.384331 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:41.384793 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 12:24:41.804500 (+419707us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:41.804535 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:41.804598 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:42.719000 (+914402us) raft_consensus.cc:1685] finished
0709 12:24:42.719046 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:42.719251 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6773632,"thread_start_us":419346,"threads_started":1,"wal-append.queue_time_us":425517}
I20260709 12:24:42.685310 29361 raft_consensus.cc:697] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 10 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:42.691498 29512 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.670843 29127 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:42.732002 29440 consensus_meta.cc:287] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 1.036s	user 0.012s	sys 0.000s
I20260709 12:24:42.733520 25837 raft_consensus.cc:1240] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:42.708879 29243 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.014s	sys 0.009s
I20260709 12:24:42.692679 29358 raft_consensus.cc:740] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:42.706983 29634 consensus_queue.cc:1059] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:24:42.694590 29632 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:42.739032 25829 raft_consensus.cc:1240] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:42.744553 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:42.760526 25834 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:42.763022 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 91256.3us
W20260709 12:24:42.723979 25830 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.035s	sys 0.030s
W20260709 12:24:42.800508 25830 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.036s	sys 0.030s
I20260709 12:24:42.770304 25756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 2780) took 1182 ms. Trace:
I20260709 12:24:42.722374 29545 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:42.717566 29550 raft_consensus.cc:740] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:42.780678 25757 raft_consensus.cc:1275] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:24:42.805805 25757 pending_rounds.cc:85] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 8
I20260709 12:24:42.781330 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:42.806135 25757 pending_rounds.cc:107] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:24:42.693974 29606 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:42.706759 28657 raft_consensus.cc:2749] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:42.792068 26430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 955) took 1163 ms. Trace:
I20260709 12:24:42.825552 26430 rpcz_store.cc:276] 0709 12:24:41.628762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:41.725961 (+ 97199us) service_pool.cc:224] Handling call
0709 12:24:41.844749 (+118788us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:41.881747 (+ 36998us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:24:41.953332 (+ 71585us) log.cc:844] Serialized 14 byte log entry
0709 12:24:42.791498 (+838166us) log.cc:844] Serialized 14 byte log entry
0709 12:24:42.791669 (+   171us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:42.791713 (+    44us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:24:42.791765 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:42.791853 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:42.792006 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15936,"prepare.queue_time_us":97748,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":29667,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":15624,"spinlock_wait_cycles":29703296,"thread_start_us":717561,"threads_started":1}
I20260709 12:24:42.784880 29538 raft_consensus.cc:2749] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:42.693315 28959 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:42.801147 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:42.801985 25762 raft_consensus.cc:2468] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 11.
I20260709 12:24:42.708755 29480 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:42.708758 29420 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:42.806644 25757 raft_consensus.cc:2889] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:42.778653 29512 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:42.808192 25801 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:42.812341 29361 consensus_queue.cc:237] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:42.813495 29355 raft_consensus.cc:3055] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:42.826102 29616 raft_consensus.cc:3055] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:42.821069 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:42.864862 25837 raft_consensus.cc:2468] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 7.
I20260709 12:24:42.842345 29440 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:42.771515 29489 raft_consensus.cc:2749] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:42.872740 29489 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.720301 29231 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:42.873368 29127 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:42.875155 29231 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:24:42.877769 29628 log.cc:927] Time spent T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 1.224s	user 0.008s	sys 0.005s
I20260709 12:24:42.881701 29480 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:42.882766 29606 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:42.883757 28959 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:42.803203 29632 raft_consensus.cc:3060] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:42.843336 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:42.855432 25836 raft_consensus.cc:1240] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:24:42.806106 29629 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:42.859112 25800 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:42.820322 29544 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:42.780434 29486 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:42.868927 29644 log.cc:927] Time spent T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 12:24:42.861894 29355 raft_consensus.cc:740] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:42.885747 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:42.885704 29440 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:42.900421 29624 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:42.824086 29545 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:42.862388 29634 raft_consensus.cc:3055] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:42.911228 25759 raft_consensus.cc:2468] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 8.
W20260709 12:24:42.913772 29646 log.cc:927] Time spent T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.165s	user 0.003s	sys 0.000s
I20260709 12:24:42.867339 29616 raft_consensus.cc:740] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:42.901859 28657 raft_consensus.cc:2764] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:24:42.925048 29231 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.911341 29629 raft_consensus.cc:2804] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:42.801792 25756 rpcz_store.cc:276] 0709 12:24:41.587373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.758921 (+1171548us) service_pool.cc:224] Handling call
0709 12:24:42.759344 (+   423us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:42.759572 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:42.759610 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:42.759670 (+    60us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:42.759716 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:42.759786 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:42.770194 (+ 10408us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:42.794888 25760 raft_consensus.cc:1275] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:24:42.924788 26431 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.884s	user 0.009s	sys 0.024s
I20260709 12:24:42.938604 25686 raft_consensus.cc:1240] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:42.945534 25760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 2778) took 1358 ms. Trace:
W20260709 12:24:42.940862 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 344434us
I20260709 12:24:42.945995 25760 rpcz_store.cc:276] 0709 12:24:41.586838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.754004 (+1167166us) service_pool.cc:224] Handling call
0709 12:24:42.790527 (+ 36523us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:42.945205 (+154678us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:42.945467 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:42.946548 26431 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.919s	user 0.009s	sys 0.025s
W20260709 12:24:42.929366 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 390860us
W20260709 12:24:42.956099 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:42.937696 29231 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:42.959064 29231 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:42.921870 29634 raft_consensus.cc:740] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:42.873343 29489 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:42.936043 25726 connection.cc:256] RPC call timeout handler was delayed by -1.0848903450000762s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1533s for a response
I20260709 12:24:43.147426 29243 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.062036 25760 raft_consensus.cc:1240] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 12. Current term is 13. Ops: []
I20260709 12:24:43.276608 29243 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:43.277298 29489 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:43.114555 29663 log.cc:927] Time spent T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
I20260709 12:24:43.044651 25686 raft_consensus.cc:1240] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:43.279070 25757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 2776) took 1692 ms. Trace:
W20260709 12:24:43.036291 29537 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.004s	sys 0.004s
I20260709 12:24:43.117887 25763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 2773) took 1543 ms. Trace:
W20260709 12:24:43.004563 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:43.112619 28657 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:42.983860 25680 raft_consensus.cc:1275] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:43.281863 28657 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:42.982935 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
W20260709 12:24:43.283609 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 475645us
I20260709 12:24:43.283784 25678 raft_consensus.cc:2393] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 8: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:42.980823 25754 raft_consensus.cc:2393] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 7: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:43.284420 25801 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:43.090927 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:42.964787 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:42.973665 25755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 2406) took 1503 ms. Trace:
I20260709 12:24:43.286180 25683 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:43.280825 25763 rpcz_store.cc:276] 0709 12:24:41.574441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:41.882661 (+308220us) service_pool.cc:224] Handling call
0709 12:24:41.883035 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:41.883461 (+   426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:41.883500 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:41.884070 (+   570us) log.cc:844] Serialized 26 byte log entry
0709 12:24:42.275531 (+391461us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:42.275592 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:42.275704 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:43.117662 (+841958us) raft_consensus.cc:1685] finished
0709 12:24:43.117682 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:43.117826 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13029,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":26510,"thread_start_us":290656,"threads_started":1,"wal-append.queue_time_us":1148102}
I20260709 12:24:43.119508 25830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 2684) took 2292 ms. Trace:
I20260709 12:24:43.288592 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:24:43.012380 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:43.067333 25649 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:43.278086 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
W20260709 12:24:43.280519 29537 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.182s	user 0.008s	sys 0.004s
I20260709 12:24:42.983085 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:43.290699 25650 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:43.291728 26401 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:43.025404 25836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 2691) took 2195 ms. Trace:
I20260709 12:24:42.965058 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:42.963565 26431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 954) took 1343 ms. Trace:
I20260709 12:24:43.298275 25726 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
W20260709 12:24:43.217886 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:43.284660 25754 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48606 (request call id 930) took 1366 ms (client timeout 1714 ms). Trace:
I20260709 12:24:43.285655 25801 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:43.289498 25763 raft_consensus.cc:2410] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:24:42.988914 25756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48606 (request call id 931) took 1059 ms. Trace:
W20260709 12:24:43.300814 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 233543us
I20260709 12:24:43.280824 25761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 2408) took 1802 ms. Trace:
I20260709 12:24:43.200692 25834 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 9.
W20260709 12:24:43.312016 25754 rpcz_store.cc:269] 0709 12:24:41.918191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.130913 (+212722us) service_pool.cc:224] Handling call
0709 12:24:43.284575 (+1153662us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:43.317776 25683 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 7.
W20260709 12:24:43.273489 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 323936us
I20260709 12:24:43.061785 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:43.301755 25800 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:43.279460 25757 rpcz_store.cc:276] 0709 12:24:41.586292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.661748 (+1075456us) service_pool.cc:224] Handling call
0709 12:24:42.662046 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:42.860123 (+198077us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:42.925208 (+ 65085us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b54000415d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:43.278992 (+353784us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":271810432}
I20260709 12:24:43.314132 25836 rpcz_store.cc:276] 0709 12:24:40.829661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.954578 (+124917us) service_pool.cc:224] Handling call
0709 12:24:41.476624 (+522046us) spinlock_profiling.cc:243] Waited 1.5 ms on lock 0x7b5800133e98. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d96a3cb71 00007f5d96a3ca22 00007f5d9f9558d9 00007f5d9eaafee0 00007f5d9eb790ab 00007f5d9eb79131 00007f5d9eb3afc0 00007f5d9eb25929 00007f5d9eb253d2 00007f5d9809cbd4
0709 12:24:41.476814 (+   190us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:42.902374 (+1425560us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:43.025028 (+122654us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b54001b1a54. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:43.025317 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3173340160}
I20260709 12:24:43.322091 25757 raft_consensus.cc:1240] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:43.068470 29662 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:43.322744 26401 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:43.297043 25760 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:24:43.325166 25650 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:43.326361 26402 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:43.324054 26401 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:43.313898 25756 rpcz_store.cc:276] 0709 12:24:41.929867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.987900 (+1058033us) service_pool.cc:224] Handling call
0709 12:24:42.988292 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:42.988521 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:42.988568 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:42.988627 (+    59us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:42.988660 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:42.988707 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:42.988839 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:43.086961 29646 log.cc:927] Time spent T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 12:24:43.315102 25761 rpcz_store.cc:276] 0709 12:24:41.478147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:41.740795 (+262648us) service_pool.cc:224] Handling call
0709 12:24:41.741178 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:41.741415 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:24:41.948054 (+206639us) log.cc:844] Serialized 14 byte log entry
0709 12:24:43.280480 (+1332426us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:43.280533 (+    53us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:24:43.280597 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:43.280663 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:43.280769 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":211593,"prepare.queue_time_us":995382,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":312362,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":7296,"thread_start_us":1049546,"threads_started":3,"wal-append.queue_time_us":771005}
I20260709 12:24:43.286192 25755 rpcz_store.cc:276] 0709 12:24:41.470027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:41.470220 (+   193us) service_pool.cc:224] Handling call
0709 12:24:41.470566 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:41.471627 (+  1061us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:24:42.534399 (+1062772us) log.cc:844] Serialized 14 byte log entry
0709 12:24:42.973180 (+438781us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:42.973254 (+    74us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:42.973315 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:42.973415 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:42.973579 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12638,"prepare.queue_time_us":1214836,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":12802,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"thread_start_us":1449854,"threads_started":2}
I20260709 12:24:43.321133 29661 consensus_queue.cc:1059] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 12:24:43.328047 29536 consensus_queue.cc:1048] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
W20260709 12:24:43.331785 29621 consensus_meta.cc:287] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.651s	user 0.009s	sys 0.001s
I20260709 12:24:43.288813 25830 rpcz_store.cc:276] 0709 12:24:40.827156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.828923 (+  1767us) service_pool.cc:224] Handling call
0709 12:24:40.829384 (+   461us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:41.839879 (+1010495us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:41.839910 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:41.897848 (+ 57938us) log.cc:844] Serialized 26 byte log entry
0709 12:24:42.800960 (+903112us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:42.801013 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:42.801096 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:43.119222 (+318126us) raft_consensus.cc:1685] finished
0709 12:24:43.119252 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:43.119417 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":114133,"raft.queue_time_us":130708,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":8248,"thread_start_us":1694035,"threads_started":2,"wal-append.queue_time_us":958419}
I20260709 12:24:43.334913 25763 raft_consensus.cc:1240] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:43.322965 29489 raft_consensus.cc:2749] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:43.325026 29361 raft_consensus.cc:2804] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:43.285640 29611 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:43.122628 29420 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:43.279597 29243 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:43.337949 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:43.275182 29316 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:43.316737 26431 rpcz_store.cc:276] 0709 12:24:41.620172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:41.690761 (+ 70589us) service_pool.cc:224] Handling call
0709 12:24:41.691150 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:41.691363 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:24:41.930837 (+239474us) log.cc:844] Serialized 14 byte log entry
0709 12:24:42.963132 (+1032295us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:42.963202 (+    70us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:24:42.963263 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:42.963351 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:42.963498 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15720,"prepare.queue_time_us":102323,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":4067,"raft.queue_time_us":35211,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":92,"thread_start_us":1158371,"threads_started":2}
I20260709 12:24:43.343240 25760 raft_consensus.cc:2468] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 11.
I20260709 12:24:43.335031 25761 raft_consensus.cc:1240] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:43.329089 29231 raft_consensus.cc:2804] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:24:43.360837 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:43.341674 29480 raft_consensus.cc:2749] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:43.325253 29538 raft_consensus.cc:2749] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:43.350241 29361 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:43.336333 29537 consensus_queue.cc:1048] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:24:43.367084 29537 consensus_queue.cc:1243] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer a866ff967d964388a6f0dff7fd43df89 log is divergent from this leader: its last log entry 5.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:24:43.367162 29538 raft_consensus.cc:2749] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:43.357187 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:43.361186 29243 consensus_queue.cc:1059] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 12:24:43.364538 29231 raft_consensus.cc:697] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 13 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:43.328984 29540 raft_consensus.cc:2804] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:43.368930 29540 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:43.369343 29540 raft_consensus.cc:3060] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:43.369400 29231 consensus_queue.cc:237] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:43.364344 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:43.372151 29666 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:43.349609 29127 raft_consensus.cc:2804] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:43.109659 29616 consensus_queue.cc:260] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:43.368258 25763 raft_consensus.cc:2468] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 7.
I20260709 12:24:43.372743 29666 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:43.372758 29127 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:43.373984 29127 raft_consensus.cc:3060] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:43.375326 29666 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:43.062007 29355 consensus_queue.cc:260] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:43.348124 29621 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:43.361299 29544 raft_consensus.cc:2764] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 12:24:43.381491 29544 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:43.382335 29544 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:43.328186 29662 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:43.361779 29489 raft_consensus.cc:2804] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:43.044112 29358 consensus_queue.cc:260] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:43.361431 28657 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:43.377110 29361 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:43.376560 29537 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
W20260709 12:24:43.390282 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:43.398648 25756 raft_consensus.cc:1240] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:43.408442 26402 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:43.349989 29634 consensus_queue.cc:260] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:43.411073 29550 consensus_queue.cc:260] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:43.412755 29662 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:24:43.413792 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:43.375903 29666 consensus_queue.cc:1059] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:24:43.492216 29480 raft_consensus.cc:2749] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:43.416921 29544 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:43.419428 29621 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:43.493285 29544 raft_consensus.cc:3055] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:43.398211 28657 raft_consensus.cc:2749] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:43.365339 29316 consensus_queue.cc:1059] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
W20260709 12:24:43.424809 29632 consensus_meta.cc:287] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.521s	user 0.009s	sys 0.000s
I20260709 12:24:43.410143 29537 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:43.392845 29489 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:43.493258 29512 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:24:43.499704 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 91378.4us
I20260709 12:24:43.502180 25758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 2772) took 1931 ms. Trace:
W20260709 12:24:43.506281 29672 log.cc:927] Time spent T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:24:43.506713 26402 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:24:43.507476 29316 raft_consensus.cc:3055] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:24:43.497783 29550 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:43.394621 29664 consensus_queue.cc:1059] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.102s
I20260709 12:24:43.508134 29127 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:43.507863 29316 raft_consensus.cc:740] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:43.502727 25758 rpcz_store.cc:276] 0709 12:24:41.571267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:41.866108 (+294841us) service_pool.cc:224] Handling call
0709 12:24:42.159443 (+293335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:42.159699 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:42.646784 (+487085us) log.cc:844] Serialized 14 byte log entry
0709 12:24:43.300853 (+654069us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:43.300920 (+    67us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:43.300979 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:43.301064 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:43.502002 (+200938us) spinlock_profiling.cc:243] Waited 293 ms on lock 0x7b54000032d0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b608ad 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:43.502120 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":284018,"prepare.queue_time_us":664888,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":42,"raft.queue_time_us":328148,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":5789,"spinlock_wait_cycles":673837952,"thread_start_us":866835,"threads_started":2,"wal-append.queue_time_us":764204}
W20260709 12:24:43.514010 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 188907us
I20260709 12:24:43.494031 29544 raft_consensus.cc:740] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:43.497953 29634 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:43.529958 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 197446us
W20260709 12:24:43.532202 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 188882us
I20260709 12:24:43.532966 25726 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
W20260709 12:24:43.533356 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 189502us
W20260709 12:24:43.534466 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:43.513512 29670 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:43.545606 26402 connection.cc:256] RPC call timeout handler was delayed by -1.8527014400001462s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1831s for a response
W20260709 12:24:43.546273 26402 connection.cc:256] RPC call timeout handler was delayed by -1.8196557080000275s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16160000000000002s for a response
W20260709 12:24:43.546672 26402 connection.cc:256] RPC call timeout handler was delayed by -1.767201440000008s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1926s for a response
W20260709 12:24:43.547176 26402 connection.cc:256] RPC call timeout handler was delayed by -1.7365212599997903s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15300000000000002s for a response
I20260709 12:24:43.524295 29512 raft_consensus.cc:2804] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:24:43.513085 29489 raft_consensus.cc:3060] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:43.553496 25726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:43.554101 25726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:43.510382 29127 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:24:43.547591 26402 connection.cc:256] RPC call timeout handler was delayed by -1.7329212599997845s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1534s for a response
W20260709 12:24:43.569481 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 283939us
W20260709 12:24:43.569856 26402 connection.cc:256] RPC call timeout handler was delayed by -1.7285014399999454s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19690000000000002s for a response
I20260709 12:24:43.557638 26401 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:43.556452 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:43.570712 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:43.571975 25763 raft_consensus.cc:3060] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:43.577837 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 45987.2us
W20260709 12:24:43.577672 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 46589.3us
I20260709 12:24:43.549358 29662 raft_consensus.cc:2804] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:43.512452 29632 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:43.514914 29480 consensus_queue.cc:1048] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:24:43.551801 29512 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:43.555899 29665 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.574625 29611 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.532749 29540 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:43.596148 29675 consensus_queue.cc:1059] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:43.597128 25801 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:43.597311 29675 consensus_queue.cc:1048] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:43.598704 29675 consensus_queue.cc:1048] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:43.600723 29667 raft_consensus.cc:3055] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:43.600939 29675 raft_consensus.cc:2804] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:43.601205 29667 raft_consensus.cc:740] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:43.601748 29675 raft_consensus.cc:697] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 6 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:43.602178 29667 consensus_queue.cc:260] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:43.603678 29667 raft_consensus.cc:3060] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:43.603525 29675 consensus_queue.cc:237] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:43.606673 29676 log.cc:927] Time spent T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.186s	user 0.000s	sys 0.002s
W20260709 12:24:43.610888 29678 log.cc:927] Time spent T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
W20260709 12:24:43.615018 29668 log.cc:927] Time spent T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
W20260709 12:24:43.617028 29669 log.cc:927] Time spent T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 12:24:43.618563 25762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 2781) took 2023 ms. Trace:
I20260709 12:24:43.619107 25762 rpcz_store.cc:276] 0709 12:24:41.595619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.858860 (+1263241us) service_pool.cc:224] Handling call
0709 12:24:42.886832 (+ 27972us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:42.942386 (+ 55554us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:42.942429 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:42.942483 (+    54us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:24:42.942523 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:43.618040 (+675517us) spinlock_profiling.cc:243] Waited 55.3 ms on lock 0x7b54000a9e54. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:43.618101 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:43.618484 (+   383us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":127252864}
I20260709 12:24:43.577868 29621 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:43.568632 29670 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:43.624498 25759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 2410) took 1952 ms. Trace:
I20260709 12:24:43.665788 25757 raft_consensus.cc:1240] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:24:43.584925 29662 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:43.688215 25759 rpcz_store.cc:276] 0709 12:24:41.672464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.940740 (+1268276us) service_pool.cc:224] Handling call
0709 12:24:43.026425 (+ 85685us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:43.026642 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:43.026666 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:43.086769 (+ 60103us) log.cc:844] Serialized 26 byte log entry
0709 12:24:43.354372 (+267603us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:24:43.354416 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:43.354506 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:43.609914 (+255408us) spinlock_profiling.cc:243] Waited 9.32 ms on lock 0x7b4400022b4c. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db 00007f5d99708aaf 00007f5d996fc86e 00007f5d996fbbb6 00007f5d996fb7d8 00007f5d99705221 00007f5d997051d9 00007f5d99705169
0709 12:24:43.624069 (+ 14155us) raft_consensus.cc:1685] finished
0709 12:24:43.624102 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:43.624419 (+   317us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21432576,"thread_start_us":228137,"threads_started":1,"wal-append.queue_time_us":381167}
I20260709 12:24:43.666116 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:43.664742 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:43.650287 25763 raft_consensus.cc:2468] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 10.
I20260709 12:24:43.696195 25760 raft_consensus.cc:2393] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 10: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:43.696359 25755 raft_consensus.cc:2393] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 9: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
W20260709 12:24:43.697326 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 127027us
W20260709 12:24:43.699146 26402 leader_election.cc:336] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 1.674s (SENT)
W20260709 12:24:43.704104 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 133324us
I20260709 12:24:43.593068 29127 raft_consensus.cc:2804] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:43.589154 29685 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:43.592806 29512 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:43.583178 29544 consensus_queue.cc:260] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:43.587072 29680 consensus_queue.cc:1059] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.107s
W20260709 12:24:43.708040 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 109339us
I20260709 12:24:43.720275 29358 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:43.646148 29537 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:43.629426 29536 raft_consensus.cc:3055] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:43.738812 29536 raft_consensus.cc:740] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:43.738926 29632 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:43.638167 29355 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:43.665436 29616 raft_consensus.cc:3060] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:43.666280 29545 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:43.712566 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 121641us
I20260709 12:24:43.712595 25726 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:43.623787 29440 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:43.697013 29662 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:24:43.725929 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:43.732780 25801 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:43.634408 29666 consensus_queue.cc:1059] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.082s
W20260709 12:24:43.741822 26402 connection.cc:256] RPC call timeout handler was delayed by -1.6726965000002565s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17900000000000002s for a response
W20260709 12:24:43.760455 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 72230.9us
I20260709 12:24:43.649294 29611 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:43.710930 29127 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:43.705335 29621 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:43.744540 29629 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.012s	sys 0.034s
I20260709 12:24:43.753017 25726 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:43.756024 29486 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:43.740200 29420 consensus_queue.cc:1048] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:24:43.756310 29538 raft_consensus.cc:3055] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:24:43.762178 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 204928us
I20260709 12:24:43.674309 29665 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:43.644134 29316 consensus_queue.cc:260] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:43.716568 29673 consensus_queue.cc:1059] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
W20260709 12:24:43.765311 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 182485us
W20260709 12:24:43.760972 26402 connection.cc:256] RPC call timeout handler was delayed by -1.5341014400000859s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21850000000000003s for a response
I20260709 12:24:43.758544 29545 raft_consensus.cc:2804] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:43.773447 25801 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
W20260709 12:24:43.769651 29629 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.012s	sys 0.034s
I20260709 12:24:43.781342 29684 consensus_queue.cc:1059] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 12:24:43.769915 29647 raft_consensus.cc:2764] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 12:24:43.788733 26402 connection.cc:256] RPC call timeout handler was delayed by -1.259106673000133s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21389999999999998s for a response
W20260709 12:24:43.790373 26402 connection.cc:256] RPC call timeout handler was delayed by -1.2392624350000006s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1627s for a response
I20260709 12:24:43.787580 25758 raft_consensus.cc:2468] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 8.
I20260709 12:24:43.790757 26401 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:24:43.801056 29681 log.cc:927] Time spent T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:24:43.789806 29545 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:43.798173 25649 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:43.852154 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:43.853075 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:43.853580 26430 raft_consensus.cc:2468] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 8.
I20260709 12:24:43.810971 29361 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:43.855655 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:43.856355 26437 raft_consensus.cc:2368] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 7. Current term is 8.
W20260709 12:24:43.858577 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 60480.2us
I20260709 12:24:43.859462 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:43.860080 26436 raft_consensus.cc:2468] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 8.
W20260709 12:24:43.837074 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 64818.5us
I20260709 12:24:43.784853 29670 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:43.755682 29536 consensus_queue.cc:260] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:43.802752 29611 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:43.808818 29540 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:43.810508 29316 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:43.825866 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:43.715468 29685 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:43.800326 29682 log.cc:927] Time spent T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 12:24:43.904175 29671 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.908380 29679 consensus_queue.cc:1059] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:43.908666 29671 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:43.911053 29621 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:43.911751 29606 raft_consensus.cc:3055] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:43.911131 28959 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.912199 29606 raft_consensus.cc:740] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:43.912546 28959 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:43.913085 29606 consensus_queue.cc:260] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:43.913825 29544 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:43.914367 29606 raft_consensus.cc:3060] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:43.914721 28959 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:43.915164 28657 raft_consensus.cc:2749] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:43.798779 29440 raft_consensus.cc:3055] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:43.916075 29440 raft_consensus.cc:740] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:43.916973 29440 consensus_queue.cc:260] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:43.917934 29440 raft_consensus.cc:3060] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:43.918509 29679 raft_consensus.cc:3055] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:43.918898 29679 raft_consensus.cc:740] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:43.798779 29690 consensus_queue.cc:1048] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:43.891886 29670 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.851063 29661 consensus_queue.cc:1059] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 12:24:43.787724 29486 raft_consensus.cc:2804] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:43.922019 29486 raft_consensus.cc:697] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 9 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:43.922243 28959 raft_consensus.cc:3055] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:43.922629 28959 raft_consensus.cc:740] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:43.922972 29486 consensus_queue.cc:237] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:43.923395 28959 consensus_queue.cc:260] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:43.923715 29536 raft_consensus.cc:3060] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:43.924576 28959 raft_consensus.cc:3060] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:43.841305 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:43.925789 26431 raft_consensus.cc:2410] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:24:43.919736 29679 consensus_queue.cc:260] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:43.926774 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:43.927312 26431 raft_consensus.cc:2468] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 10.
I20260709 12:24:43.927644 29679 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:43.841468 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:43.928426 26439 raft_consensus.cc:2393] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 8: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:43.928269 29512 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:43.929284 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:43.929837 26439 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:43.931190 29512 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:43.935550 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:43.936225 25836 raft_consensus.cc:2468] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 9.
I20260709 12:24:43.937330 29685 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:43.937602 25834 raft_consensus.cc:1275] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:24:43.938720 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:43.940155 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:43.940779 25832 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 11.
I20260709 12:24:43.766763 29127 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:43.843519 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:43.843607 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:43.943361 25759 raft_consensus.cc:3060] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:43.843076 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 52401.6us
I20260709 12:24:43.920544 29670 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:43.950397 29670 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:43.953707 26401 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:43.953908 26435 raft_consensus.cc:2468] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 11.
I20260709 12:24:43.954802 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:43.955302 29537 raft_consensus.cc:3055] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:43.789845 29629 raft_consensus.cc:697] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 11 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
W20260709 12:24:43.875603 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:43.955829 29537 raft_consensus.cc:740] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
W20260709 12:24:43.956194 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:43.956542 29629 consensus_queue.cc:237] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:43.956823 29537 consensus_queue.cc:260] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:43.957881 29537 raft_consensus.cc:3060] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:43.959357 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:43.851516 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:43.960255 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:43.961539 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:43.961704 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:43.962296 25829 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:43.854580 29480 raft_consensus.cc:2804] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:24:43.883664 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 110343us
I20260709 12:24:43.885282 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:43.978408 26430 raft_consensus.cc:3060] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:43.886591 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:43.979132 26437 raft_consensus.cc:2468] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 7.
I20260709 12:24:43.890793 26402 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:43.979944 25801 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:43.876837 29243 raft_consensus.cc:2804] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:43.906024 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:43.904536 29680 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.841490 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:43.955416 26435 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 8.
W20260709 12:24:43.876102 25726 leader_election.cc:336] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Timed out: RequestConsensusVote RPC to 127.23.245.132:35611 timed out after 1.718s (SENT)
I20260709 12:24:43.975402 25759 raft_consensus.cc:2468] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 9.
I20260709 12:24:43.842684 29538 raft_consensus.cc:740] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
W20260709 12:24:43.892149 25650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:43.988371 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:44.003715 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 113003us
I20260709 12:24:43.989085 26439 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 10.
I20260709 12:24:43.989535 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:43.990999 26436 raft_consensus.cc:2393] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 9: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:44.006387 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:44.012835 26432 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:44.009390 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:44.032258 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.002607 26438 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 9.
I20260709 12:24:43.855967 29545 raft_consensus.cc:3060] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:44.007947 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:44.014097 25832 raft_consensus.cc:2468] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 11.
I20260709 12:24:44.040016 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:44.029676 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:44.041556 25650 connection.cc:256] RPC call timeout handler was delayed by -1.5677330729999994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21440000000000003s for a response
I20260709 12:24:44.049990 25834 raft_consensus.cc:1275] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:24:44.043697 26439 raft_consensus.cc:2468] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 8.
I20260709 12:24:44.050253 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:44.050253 25650 connection.cc:256] RPC call timeout handler was delayed by -1.0264296849995844s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15990000000000001s for a response
W20260709 12:24:44.048506 26402 leader_election.cc:336] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 1.530s (SENT)
I20260709 12:24:44.052006 26401 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:24:44.053367 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 149953us
I20260709 12:24:44.053503 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:44.054070 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:44.055179 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:44.055507 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:44.041009 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:24:44.055521 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:44.056087 26437 raft_consensus.cc:2468] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 5.
I20260709 12:24:44.056648 25680 raft_consensus.cc:2393] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 7: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:44.055672 26431 raft_consensus.cc:2393] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 10: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:44.058485 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:44.048800 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 172707us
I20260709 12:24:44.060272 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:44.060822 25679 raft_consensus.cc:2393] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 9: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:44.061201 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:43.911053 29671 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:44.060846 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:44.063028 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:44.063233 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:44.065683 25683 raft_consensus.cc:2468] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 8.
W20260709 12:24:44.068240 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.063589 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:44.010977 29685 raft_consensus.cc:2804] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:44.070482 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:43.994841 29621 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.069964 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
W20260709 12:24:44.070009 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.073258 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:44.072566 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:44.074705 26438 raft_consensus.cc:2393] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 9: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
W20260709 12:24:44.075414 26402 leader_election.cc:336] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 1.534s (SENT)
I20260709 12:24:44.075899 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:44.076567 25683 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:24:44.076779 26402 leader_election.cc:336] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 1.627s (SENT)
I20260709 12:24:44.077929 25650 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
W20260709 12:24:44.078717 25726 leader_election.cc:336] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Timed out: RequestConsensusVote RPC to 127.23.245.132:35611 timed out after 1.724s (SENT)
W20260709 12:24:44.078820 26402 leader_election.cc:336] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 1.926s (SENT)
I20260709 12:24:44.079196 25726 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:44.079977 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:44.080580 25760 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 8.
I20260709 12:24:44.080513 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:44.082628 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:44.082999 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:44.067842 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:44.084734 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:44.083216 25679 raft_consensus.cc:2376] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 8. Re-sending same reply.
I20260709 12:24:44.086413 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:44.086774 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:44.087153 26438 raft_consensus.cc:2393] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 16: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:44.071360 25681 raft_consensus.cc:2468] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 8.
I20260709 12:24:44.087908 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:44.088762 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:44.088465 26438 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 6.
I20260709 12:24:44.075778 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:44.014882 29243 raft_consensus.cc:697] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 11 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:44.079221 26402 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:44.090071 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:44.049247 29550 raft_consensus.cc:2749] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:44.041312 29480 raft_consensus.cc:697] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 10 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:44.091590 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:44.092787 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:44.118862 25677 raft_consensus.cc:2410] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:24:44.118933 25755 raft_consensus.cc:2468] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 8.
I20260709 12:24:43.994454 29667 consensus_queue.cc:1048] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 12:24:44.096545 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:44.113158 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:44.126382 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 48534.2us
I20260709 12:24:44.113394 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:44.051334 29699 raft_consensus.cc:3060] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:44.126771 26431 raft_consensus.cc:2468] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 7.
I20260709 12:24:44.096545 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:44.141309 25834 raft_consensus.cc:2468] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 7.
I20260709 12:24:44.096774 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:44.119084 25680 raft_consensus.cc:2468] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 5.
I20260709 12:24:44.117959 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:44.142832 26435 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:44.117610 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:44.122658 25683 raft_consensus.cc:2410] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 12:24:44.145299 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:44.145819 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:44.146548 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:44.147204 25683 raft_consensus.cc:2468] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 7.
I20260709 12:24:44.118376 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:44.148420 25828 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:44.148726 29671 raft_consensus.cc:2804] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:44.149199 29671 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:44.149586 29671 raft_consensus.cc:3060] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:44.151981 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:44.152563 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:44.152705 26431 raft_consensus.cc:2468] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 8.
I20260709 12:24:44.153209 25684 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 11.
I20260709 12:24:44.154034 25650 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:44.154255 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:44.155089 26431 raft_consensus.cc:1275] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:24:44.124450 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:44.163602 25759 raft_consensus.cc:2410] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:24:44.125094 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
W20260709 12:24:44.164156 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.164150 25682 raft_consensus.cc:2376] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 7. Re-sending same reply.
I20260709 12:24:44.126096 25829 raft_consensus.cc:2468] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 11.
I20260709 12:24:44.104477 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:44.112421 25678 raft_consensus.cc:2468] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 6.
I20260709 12:24:44.166035 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:44.167112 25829 raft_consensus.cc:3060] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:44.131508 26430 raft_consensus.cc:2468] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 10.
I20260709 12:24:44.061189 29540 raft_consensus.cc:2804] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:44.081463 29690 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:44.156657 29243 consensus_queue.cc:237] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:44.157858 29694 raft_consensus.cc:2749] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:44.154047 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:44.201750 25684 raft_consensus.cc:2393] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 11: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:44.148344 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:44.070992 29685 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:44.093083 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:44.127977 26438 raft_consensus.cc:2393] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 10: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:44.204697 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:44.166035 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:44.206137 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:44.206777 25834 raft_consensus.cc:2468] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 7.
I20260709 12:24:44.156023 29706 consensus_queue.cc:1059] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:44.173834 25828 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 10.
I20260709 12:24:44.178282 25829 raft_consensus.cc:2468] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 8.
I20260709 12:24:44.217851 25678 raft_consensus.cc:2468] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 7.
I20260709 12:24:44.218221 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:44.120038 29611 raft_consensus.cc:2749] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:44.189512 26430 pending_rounds.cc:85] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89: Aborting all ops after (but not including) 4
I20260709 12:24:44.049168 29680 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:44.200874 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 199965us
I20260709 12:24:44.213792 26435 raft_consensus.cc:2410] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:24:44.214866 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:44.215441 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 136630us
I20260709 12:24:44.217012 25649 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:44.218324 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:44.168592 26432 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 7.
W20260709 12:24:44.190635 29634 consensus_meta.cc:287] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.645s	user 0.005s	sys 0.005s
I20260709 12:24:44.224644 26430 pending_rounds.cc:107] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 12:24:44.234956 26430 raft_consensus.cc:2889] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:44.225164 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:44.235406 26402 leader_election.cc:336] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 1.969s (SENT)
I20260709 12:24:44.233390 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:44.233448 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 169671us
I20260709 12:24:44.237465 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:44.237758 25726 leader_election.cc:336] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Timed out: RequestConsensusVote RPC to 127.23.245.132:35611 timed out after 1.749s (SENT)
I20260709 12:24:44.238502 25726 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:44.235797 25832 raft_consensus.cc:2468] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 8.
I20260709 12:24:44.180548 29512 raft_consensus.cc:2749] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:44.240846 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:44.241464 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:44.242066 25834 raft_consensus.cc:3060] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Advancing to term 10
W20260709 12:24:44.242995 25801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.244983 25801 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:44.188167 29605 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:44.248173 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:44.248317 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:44.248831 25829 raft_consensus.cc:2468] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 8.
I20260709 12:24:44.249341 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:44.214691 29685 raft_consensus.cc:3060] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:44.256511 26439 raft_consensus.cc:1240] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:44.256932 25685 raft_consensus.cc:1275] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 12:24:44.260710 25685 pending_rounds.cc:85] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc: Aborting all ops after (but not including) 8
I20260709 12:24:44.200054 29540 raft_consensus.cc:697] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 9 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:44.256785 25832 raft_consensus.cc:1275] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:24:44.259594 26402 leader_election.cc:336] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 2.185s (SENT)
I20260709 12:24:44.256691 25828 raft_consensus.cc:1240] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:44.260942 25685 pending_rounds.cc:107] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:24:44.111183 29621 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:44.297646 25833 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 13.
I20260709 12:24:44.308111 26435 raft_consensus.cc:1240] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:44.255220 29355 raft_consensus.cc:2804] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:24:44.271479 29489 consensus_meta.cc:287] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.674s	user 0.009s	sys 0.000s
I20260709 12:24:44.272190 25830 raft_consensus.cc:2410] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:24:44.301487 26402 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:44.313496 25685 raft_consensus.cc:2889] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:44.200241 29690 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:44.225996 29666 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
W20260709 12:24:44.316836 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 79123.6us
I20260709 12:24:44.298888 29634 raft_consensus.cc:2749] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:24:44.335018 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 133807us
I20260709 12:24:44.308176 29665 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:44.340731 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 81157.3us
W20260709 12:24:44.341359 26402 leader_election.cc:336] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 2.915s (SENT)
I20260709 12:24:44.341341 25834 raft_consensus.cc:2468] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 10.
I20260709 12:24:44.343609 25650 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:44.348941 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:44.258556 29673 raft_consensus.cc:2749] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:44.317798 29355 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:44.352514 25832 raft_consensus.cc:2468] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 9.
W20260709 12:24:44.366684 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.368155 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:44.369052 25832 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 11.
W20260709 12:24:44.348191 25726 leader_election.cc:336] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Timed out: RequestConsensusVote RPC to 127.23.245.132:35611 timed out after 1.984s (SENT)
I20260709 12:24:44.258123 29605 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:44.370424 25726 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:44.363202 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:44.349673 29707 raft_consensus.cc:2804] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:44.361171 29680 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:44.329694 29489 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:44.372380 29662 consensus_meta.cc:287] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.607s	user 0.008s	sys 0.002s
I20260709 12:24:44.368726 29355 raft_consensus.cc:3060] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:44.293797 29480 consensus_queue.cc:237] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:44.340346 29666 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:44.414650 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 66474.3us
I20260709 12:24:44.415328 25650 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:24:44.418742 25726 leader_election.cc:336] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Timed out: RequestConsensusVote RPC to 127.23.245.132:35611 timed out after 2.019s (SENT)
W20260709 12:24:44.421898 25726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.422228 25832 raft_consensus.cc:1240] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:44.427083 25650 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:24:44.380482 29707 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:44.405565 29665 raft_consensus.cc:2749] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:44.432233 25831 raft_consensus.cc:2393] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 9: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
W20260709 12:24:44.469601 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.432972 25650 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:24:44.477909 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 223966us
I20260709 12:24:44.431639 29698 raft_consensus.cc:2804] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:44.456897 29707 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:44.483301 29536 raft_consensus.cc:2804] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:44.378571 29540 consensus_queue.cc:237] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:44.419304 29662 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:44.516288 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:44.518040 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.475975 29673 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
W20260709 12:24:44.523491 29714 log.cc:927] Time spent T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
W20260709 12:24:44.524626 29679 consensus_meta.cc:287] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.585s	user 0.009s	sys 0.000s
I20260709 12:24:44.526590 25677 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 10.
I20260709 12:24:44.529196 29538 consensus_queue.cc:260] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:44.542368 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:44.544602 29710 log.cc:927] Time spent T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
I20260709 12:24:44.518527 29536 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:44.498447 29698 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:44.547742 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:44.503289 29701 raft_consensus.cc:2804] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:24:44.552397 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 307502us
I20260709 12:24:44.553413 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:44.615588 25761 raft_consensus.cc:2393] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 11: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:44.563858 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:44.565433 25758 raft_consensus.cc:1240] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:44.546311 29690 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:44.500576 29665 consensus_queue.cc:1048] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 12:24:44.595945 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:44.630057 25760 raft_consensus.cc:2410] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:24:44.579207 25679 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 10.
I20260709 12:24:44.598213 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:44.600438 26431 raft_consensus.cc:1240] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 9 LEADER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 8. Current term is 9. Ops: []
W20260709 12:24:44.620473 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 245435us
I20260709 12:24:44.559167 29550 raft_consensus.cc:2749] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:44.632053 26402 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:44.613425 25573 maintenance_manager.cc:419] P 496fd6924b624e77b03ccfd15653d47b: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033360
I20260709 12:24:44.604740 29536 raft_consensus.cc:3060] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:44.613586 29698 raft_consensus.cc:3060] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:44.653247 25801 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
W20260709 12:24:44.648092 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 176998us
I20260709 12:24:44.624958 29701 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:44.621179 29699 raft_consensus.cc:2749] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:24:44.664503 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.655169 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:44.735273 25837 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 8.
I20260709 12:24:44.656720 25726 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:24:44.736282 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 303376us
I20260709 12:24:44.598884 29671 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:44.558004 29673 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:44.653685 29127 consensus_meta.cc:287] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.705s	user 0.007s	sys 0.003s
I20260709 12:24:44.645852 29538 raft_consensus.cc:3060] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:44.655800 29440 consensus_meta.cc:287] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.737s	user 0.010s	sys 0.002s
I20260709 12:24:44.663761 25801 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:24:44.731986 29545 consensus_meta.cc:287] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.670s	user 0.006s	sys 0.005s
I20260709 12:24:44.738453 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:44.750424 25684 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 11.
I20260709 12:24:44.612358 29358 consensus_queue.cc:1048] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 12:24:44.725911 29701 raft_consensus.cc:3060] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:44.648067 29647 consensus_queue.cc:1048] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.098s
I20260709 12:24:44.755852 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:44.737043 25650 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
W20260709 12:24:44.767732 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 104065us
I20260709 12:24:44.769369 25801 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
W20260709 12:24:44.746765 29681 log.cc:927] Time spent T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.102s	user 0.000s	sys 0.005s
I20260709 12:24:44.738734 29679 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
W20260709 12:24:44.778658 29544 consensus_meta.cc:287] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.864s	user 0.010s	sys 0.003s
W20260709 12:24:44.779500 29716 log.cc:927] Time spent T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
W20260709 12:24:44.779649 25801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:44.780340 29718 log.cc:927] Time spent T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.233s	user 0.000s	sys 0.000s
I20260709 12:24:44.781414 29695 raft_consensus.cc:2749] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:44.781646 25801 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:24:44.782055 29722 log.cc:927] Time spent T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 12:24:44.776003 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:44.782497 29695 raft_consensus.cc:2804] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:44.782873 29695 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:44.783232 29695 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:44.783288 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:44.784189 25684 raft_consensus.cc:2468] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 7.
I20260709 12:24:44.785316 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:44.786621 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:44.788523 25801 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:44.788883 29358 raft_consensus.cc:2749] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:44.772815 29420 raft_consensus.cc:2749] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:44.792759 29316 raft_consensus.cc:2749] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:24:44.794538 28959 consensus_meta.cc:287] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.870s	user 0.009s	sys 0.000s
I20260709 12:24:44.747608 29605 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:44.750165 29621 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:44.752954 29699 raft_consensus.cc:2749] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:44.801712 25686 raft_consensus.cc:2468] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 7.
I20260709 12:24:44.802490 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:44.771935 25650 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:44.805344 25650 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
W20260709 12:24:44.805773 29730 log.cc:927] Time spent T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:24:44.806267 28959 raft_consensus.cc:2749] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:24:44.807205 28959 raft_consensus.cc:2804] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:44.807556 28959 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:44.807898 28959 raft_consensus.cc:3060] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:44.750770 29489 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:44.814087 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:44.824059 25755 raft_consensus.cc:1275] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:24:44.827785 25684 raft_consensus.cc:2410] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 7 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:24:44.747310 29127 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:44.777186 29634 raft_consensus.cc:2804] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:44.757484 29545 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:44.826634 29621 raft_consensus.cc:2804] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:44.853302 26434 raft_consensus.cc:2393] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 8: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:44.839958 29634 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:44.865856 25759 raft_consensus.cc:1240] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:44.816818 29679 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:44.826920 29358 consensus_queue.cc:1059] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:24:44.852869 29621 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
W20260709 12:24:44.876760 25650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.869642 29634 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:44.874701 29738 log.cc:927] Time spent T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
W20260709 12:24:44.885664 25650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.868616 29662 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:44.887904 25650 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:44.877254 29621 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:44.870498 29717 consensus_queue.cc:1059] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.013s
W20260709 12:24:44.896665 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 240004us
I20260709 12:24:44.897675 25650 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:44.901134 25726 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:24:44.867033 29734 consensus_queue.cc:1048] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:24:44.869997 29243 consensus_queue.cc:1059] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:24:44.913734 25650 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:24:44.906647 29726 log.cc:927] Time spent T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.254s	user 0.000s	sys 0.001s
I20260709 12:24:44.910846 29671 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:44.902544 29673 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:44.874980 29727 consensus_queue.cc:1048] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 12:24:44.939970 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:44.940800 26435 raft_consensus.cc:2393] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 11: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:44.941723 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:44.942955 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:44.943179 25801 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:44.944223 26435 raft_consensus.cc:1240] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 13 LEADER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 12. Current term is 13. Ops: []
I20260709 12:24:44.944751 29489 raft_consensus.cc:2749] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:44.947191 26435 raft_consensus.cc:1240] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:44.948400 29243 raft_consensus.cc:2804] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:44.948830 29243 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:44.949102 29489 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.918313 29732 raft_consensus.cc:2804] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:44.949412 29243 raft_consensus.cc:3060] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:44.949717 29489 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:44.950368 29732 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:44.950740 29732 raft_consensus.cc:3060] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:44.954739 29489 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:44.948776 25650 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:44.958181 26435 raft_consensus.cc:1240] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:44.962088 26438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 984) took 1009 ms. Trace:
I20260709 12:24:44.962821 25650 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:44.911672 29420 raft_consensus.cc:3055] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:44.962656 26438 rpcz_store.cc:276] 0709 12:24:43.952494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.219592 (+267098us) service_pool.cc:224] Handling call
0709 12:24:44.220026 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:44.233594 (+ 13568us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:44.233637 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:44.253441 (+ 19804us) log.cc:844] Serialized 26 byte log entry
0709 12:24:44.427961 (+174520us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:24:44.961451 (+533490us) log.cc:844] Serialized 14 byte log entry
0709 12:24:44.961721 (+   270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.961791 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:44.961832 (+    41us) raft_consensus.cc:1685] finished
0709 12:24:44.961850 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:44.962007 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":117206,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":27,"raft.queue_time_us":1932,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":15568,"thread_start_us":593739,"threads_started":2,"wal-append.queue_time_us":249573}
I20260709 12:24:44.968950 25726 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:24:44.970551 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:44.918519 29717 raft_consensus.cc:2749] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:44.970852 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:44.964725 29750 raft_consensus.cc:2804] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:44.974702 26438 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 7.
I20260709 12:24:44.973213 25726 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:44.982728 26438 raft_consensus.cc:1275] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:24:44.979220 25801 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:24:44.991813 25726 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.245.132:35611 timed out after 2.197s (SENT) [suppressed 39 similar messages]
I20260709 12:24:44.992805 26438 pending_rounds.cc:85] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89: Aborting all ops after (but not including) 8
I20260709 12:24:44.994211 26438 pending_rounds.cc:107] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:24:44.994468 26438 raft_consensus.cc:2889] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:44.967974 29671 raft_consensus.cc:2804] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:44.998356 25726 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:24:44.966533 29420 raft_consensus.cc:740] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:44.976262 29673 raft_consensus.cc:2804] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:44.987049 29662 raft_consensus.cc:2804] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:45.011034 29662 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:45.011601 29361 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:45.011632 29662 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:44.977154 29750 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:44.999703 29671 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:45.011865 29741 log.cc:927] Time spent T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 12:24:44.968370 29243 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:45.035020 26435 raft_consensus.cc:1240] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:24:45.039712 29695 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:45.001161 29127 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:45.015966 29673 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:45.012557 29489 raft_consensus.cc:2804] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:45.032001 29545 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:24:45.086808 29537 consensus_meta.cc:287] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 1.129s	user 0.009s	sys 0.003s
I20260709 12:24:45.044219 29671 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:24:45.250808 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.045207 29679 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:45.255295 25680 raft_consensus.cc:2468] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 9.
I20260709 12:24:45.192968 29673 raft_consensus.cc:3060] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:24:45.121618 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.247658 29489 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:45.270008 29666 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:45.270493 29489 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:45.279471 29751 log.cc:927] Time spent T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.252s	user 0.001s	sys 0.000s
I20260709 12:24:45.272437 29662 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:45.282066 29243 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:45.283836 29695 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:45.284865 26437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 960) took 1301 ms. Trace:
I20260709 12:24:45.285356 26437 rpcz_store.cc:276] 0709 12:24:43.983378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.803436 (+820058us) service_pool.cc:224] Handling call
0709 12:24:44.803757 (+   321us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:44.804193 (+   436us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:44.804238 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:44.804747 (+   509us) log.cc:844] Serialized 52 byte log entry
0709 12:24:44.905865 (+101118us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:44.905906 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.905969 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:45.259874 (+353905us) spinlock_profiling.cc:243] Waited 3.83 ms on lock 0x7b4400022b4c. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db 00007f5d99708aaf 00007f5d996fc86e 00007f5d996fbbb6 00007f5d996fb7d8 00007f5d99705221 00007f5d997051d9 00007f5d99705169
0709 12:24:45.284498 (+ 24624us) raft_consensus.cc:1685] finished
0709 12:24:45.284528 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:45.284793 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2336,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":116,"spinlock_wait_cycles":8806784,"thread_start_us":100767,"threads_started":1,"wal-append.queue_time_us":160374}
I20260709 12:24:45.288884 26437 raft_consensus.cc:1275] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
W20260709 12:24:45.272820 29721 log.cc:927] Time spent T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.490s	user 0.002s	sys 0.000s
I20260709 12:24:45.282099 26431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 978) took 1332 ms. Trace:
I20260709 12:24:45.291532 26431 rpcz_store.cc:276] 0709 12:24:43.949880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.188819 (+238939us) service_pool.cc:224] Handling call
0709 12:24:44.225769 (+ 36950us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:44.634463 (+408694us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:45.281807 (+647344us) spinlock_profiling.cc:243] Waited 371 ms on lock 0x7b54005c2454. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:45.282025 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":852570880}
I20260709 12:24:45.292277 26430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 983) took 1341 ms. Trace:
I20260709 12:24:45.292632 26430 rpcz_store.cc:276] 0709 12:24:43.951067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.188927 (+237860us) service_pool.cc:224] Handling call
0709 12:24:44.189301 (+   374us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:44.296518 (+107217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:44.296546 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:44.297089 (+   543us) log.cc:844] Serialized 52 byte log entry
0709 12:24:44.558413 (+261324us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:44.558467 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.558552 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:45.271967 (+713415us) spinlock_profiling.cc:243] Waited 30.1 ms on lock 0x7b4400022b4c. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db 00007f5d99708aaf 00007f5d996fc86e 00007f5d996fbbb6 00007f5d996fb7d8 00007f5d99705221 00007f5d997051d9 00007f5d99705169
0709 12:24:45.292006 (+ 20039us) raft_consensus.cc:1685] finished
0709 12:24:45.292026 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:45.292223 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":41230,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":6813,"spinlock_wait_cycles":69310720,"thread_start_us":260954,"threads_started":1,"wal-append.queue_time_us":483966}
I20260709 12:24:45.296552 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:45.295471 29662 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:45.036325 29750 raft_consensus.cc:3060] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:45.299161 25837 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44202 (request call id 2714) took 1306 ms (client timeout 1683 ms). Trace:
W20260709 12:24:45.116783 29606 consensus_meta.cc:287] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 1.202s	user 0.013s	sys 0.002s
W20260709 12:24:45.299547 25837 rpcz_store.cc:269] 0709 12:24:43.992619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.041257 (+ 48638us) service_pool.cc:224] Handling call
0709 12:24:45.298998 (+1257741us) spinlock_profiling.cc:243] Waited 670 ms on lock 0x7b5400117e54. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:45.299108 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1540277504}
I20260709 12:24:45.043763 29701 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:45.301368 25583 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52974 (request call id 255) took 27121 ms (client timeout 15000 ms). Trace:
I20260709 12:24:45.301956 29701 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:45.106237 29420 consensus_queue.cc:260] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:45.342010 29489 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:45.343716 29717 consensus_queue.cc:1059] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 12:24:45.349509 29489 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:45.197311 29440 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.353320 29440 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:45.355381 29440 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:45.036432 29744 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.356163 26439 raft_consensus.cc:1240] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:45.356050 29744 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:45.358098 29744 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:45.201045 29736 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.358506 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:45.358826 29736 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:45.359177 25763 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:45.361091 29736 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:45.201256 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:45.201987 29757 log.cc:927] Time spent T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 12:24:45.202306 29661 raft_consensus.cc:2749] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:45.361812 25678 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 10.
I20260709 12:24:45.362716 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:45.203217 29759 log.cc:927] Time spent T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
I20260709 12:24:45.205724 26432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 961) took 1221 ms. Trace:
W20260709 12:24:45.207459 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 575492us
I20260709 12:24:45.363832 26432 rpcz_store.cc:276] 0709 12:24:43.984622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.813253 (+828631us) service_pool.cc:224] Handling call
0709 12:24:44.819992 (+  6739us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:44.820240 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:44.820265 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:44.832817 (+ 12552us) log.cc:844] Serialized 26 byte log entry
0709 12:24:44.915667 (+ 82850us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:44.957080 (+ 41413us) log.cc:844] Serialized 14 byte log entry
0709 12:24:44.957296 (+   216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.957382 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:45.205535 (+248153us) raft_consensus.cc:1685] finished
0709 12:24:45.205551 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:45.205672 (+   121us) inbound_call.cc:177] Queueing success response
0709 12:24:45.217176 (+ 11504us) spinlock_profiling.cc:243] Waited 4.21 ms on lock 0x7b180001ef40. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d96a743f3 00007f5d96a767c1 00007f5d96a76779 00007f5d96a76709 00007f5d96a766d1 00007f5d96a759cd 0000000000388634 0000000000388479 00007f5d96a5783a
Metrics: {"prepare.queue_time_us":45125,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":3989,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"spinlock_wait_cycles":9692032,"thread_start_us":47319,"threads_started":1,"wal-append.queue_time_us":233625}
I20260709 12:24:45.365338 26402 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:45.366560 26402 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:24:45.044106 25726 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
W20260709 12:24:45.368865 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 328718us
I20260709 12:24:45.370532 25726 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:45.372223 29742 raft_consensus.cc:2749] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:45.372918 29742 raft_consensus.cc:2804] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:45.373387 29742 raft_consensus.cc:697] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 8 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
W20260709 12:24:45.373914 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.374318 29742 consensus_queue.cc:237] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:45.029891 29747 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:45.376541 29747 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:45.351675 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:45.378656 29747 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:45.211038 29696 consensus_queue.cc:1059] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:24:45.379194 29747 raft_consensus.cc:2804] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:45.012688 29611 raft_consensus.cc:2804] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:45.380010 29611 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:45.380414 29611 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:45.212167 29749 log.cc:927] Time spent T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.241s	user 0.001s	sys 0.000s
I20260709 12:24:45.214998 29686 raft_consensus.cc:3055] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:24:45.221050 29740 log.cc:927] Time spent T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.427s	user 0.002s	sys 0.000s
W20260709 12:24:45.222244 29739 log.cc:927] Time spent T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.443s	user 0.000s	sys 0.001s
I20260709 12:24:45.224524 25833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44218 (request call id 1633) took 1258 ms. Trace:
I20260709 12:24:45.228416 29670 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:45.230273 25685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51578 (request call id 761) took 1178 ms. Trace:
I20260709 12:24:45.231691 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:45.233171 25830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41782 (request call id 813) took 1267 ms. Trace:
I20260709 12:24:45.407259 25830 rpcz_store.cc:276] 0709 12:24:43.966208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.053850 (+ 87642us) service_pool.cc:224] Handling call
0709 12:24:45.232975 (+1179125us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b54002f4754. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:45.233112 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":469814656}
I20260709 12:24:45.408354 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:45.402614 25833 rpcz_store.cc:276] 0709 12:24:43.965913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.088457 (+122544us) service_pool.cc:224] Handling call
0709 12:24:45.224336 (+1135879us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b54001f3954. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:45.224452 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":478570752}
I20260709 12:24:45.409536 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:45.410051 25833 raft_consensus.cc:2468] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 11.
I20260709 12:24:45.410862 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:45.234931 29685 consensus_meta.cc:287] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.934s	user 0.008s	sys 0.003s
W20260709 12:24:45.236246 29756 log.cc:927] Time spent T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
W20260709 12:24:45.219856 29737 log.cc:927] Time spent T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.441s	user 0.000s	sys 0.001s
I20260709 12:24:45.045781 29746 consensus_queue.cc:1048] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.166s
I20260709 12:24:45.101399 29731 consensus_queue.cc:1048] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.152s
I20260709 12:24:45.413237 29744 consensus_queue.cc:1048] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:24:45.442144 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:45.440078 25832 raft_consensus.cc:1240] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:24:45.258209 29671 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:45.297665 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:45.308552 29673 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:45.301749 25583 rpcz_store.cc:269] 0709 12:24:18.180600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:18.258043 (+ 77443us) service_pool.cc:224] Handling call
0709 12:24:45.301281 (+27043238us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:40.635616 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:41.087964 (+452348us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:41.127388 (+ 39424us) write_op.cc:435] Acquired schema lock
0709 12:24:41.137470 (+ 10082us) tablet.cc:662] Decoding operations
0709 12:24:41.275682 (+138212us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:41.296715 (+ 21033us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:41.306307 (+  9592us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:24:41.400487 (+ 94180us) tablet.cc:701] Row locks acquired
0709 12:24:41.400553 (+    66us) write_op.cc:260] PREPARE: finished
0709 12:24:41.400789 (+   236us) write_op.cc:270] Start()
0709 12:24:41.400982 (+   193us) write_op.cc:276] Timestamp: P: 1783599881400714 usec, L: 0
0709 12:24:41.401013 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 12:24:41.401932 (+   919us) log.cc:844] Serialized 539 byte log entry
0709 12:24:43.421802 (+2019870us) op_driver.cc:464] REPLICATION: finished
0709 12:24:43.764641 (+342839us) write_op.cc:301] APPLY: starting
0709 12:24:43.783210 (+ 18569us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:43.791377 (+  8167us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:43.791532 (+   155us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:43.791877 (+   345us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:43.792154 (+   277us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:24:43.792202 (+    48us) write_op.cc:312] APPLY: finished
0709 12:24:43.792484 (+   282us) log.cc:844] Serialized 23 byte log entry
0709 12:24:43.792661 (+   177us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:43.792739 (+    78us) write_op.cc:454] Released schema lock
0709 12:24:43.792794 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:43.793172 (+   378us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:43.793200 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":11330,"reported_tablets":34,"child_traces":[["op",{"apply.queue_time_us":302519,"apply.run_cpu_time_us":2199,"apply.run_wall_time_us":39699,"num_ops":1,"prepare.queue_time_us":286547,"prepare.run_cpu_time_us":26265,"prepare.run_wall_time_us":1271646,"raft.queue_time_us":616575,"raft.run_cpu_time_us":13429,"raft.run_wall_time_us":172865,"replication_time_us":2020560,"thread_start_us":1059949,"threads_started":4,"wal-append.queue_time_us":629176,"wal-append.run_cpu_time_us":14526,"wal-append.run_wall_time_us":2730635}]]}
W20260709 12:24:45.400040 29536 consensus_meta.cc:287] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.733s	user 0.013s	sys 0.000s
I20260709 12:24:45.318470 29719 consensus_queue.cc:1048] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:24:45.322923 25837 raft_consensus.cc:1240] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 6 LEADER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:24:45.323258 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:45.438201 28959 consensus_meta.cc:287] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.630s	user 0.007s	sys 0.003s
I20260709 12:24:45.323498 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:45.438781 29538 consensus_meta.cc:287] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.691s	user 0.009s	sys 0.001s
I20260709 12:24:45.452983 25831 raft_consensus.cc:2468] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 7.
I20260709 12:24:45.323977 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:45.324571 29316 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.326350 25835 raft_consensus.cc:1275] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:24:45.326947 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:45.328966 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:45.458408 25761 raft_consensus.cc:2393] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 9: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:45.399592 29686 raft_consensus.cc:740] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:45.459662 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:45.459877 29686 consensus_queue.cc:260] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:45.460553 25761 raft_consensus.cc:2468] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 10.
I20260709 12:24:45.461189 29686 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:45.461755 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:45.330844 29621 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:45.350221 25677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51578 (request call id 773) took 1294 ms. Trace:
I20260709 12:24:45.463498 25677 rpcz_store.cc:276] 0709 12:24:44.055794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.145558 (+ 89764us) service_pool.cc:224] Handling call
0709 12:24:45.350053 (+1204495us) spinlock_profiling.cc:243] Waited 94.6 ms on lock 0x7b54000b27d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:45.350155 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":217660672}
I20260709 12:24:45.350845 25759 raft_consensus.cc:1275] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260709 12:24:45.464560 25759 pending_rounds.cc:85] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 2
I20260709 12:24:45.464845 25759 pending_rounds.cc:107] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 5.3
W20260709 12:24:45.351032 26434 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36518 (request call id 827) took 1527 ms (client timeout 1724 ms). Trace:
I20260709 12:24:45.406150 29440 raft_consensus.cc:2804] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:24:45.370743 29760 log.cc:927] Time spent T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
W20260709 12:24:45.216274 29752 log.cc:927] Time spent T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 12:24:45.474507 29746 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:45.363672 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:45.367781 26402 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:45.384865 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:45.357542 26439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 959) took 1374 ms. Trace:
I20260709 12:24:45.476034 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:45.476171 26439 rpcz_store.cc:276] 0709 12:24:43.983065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.320483 (+337418us) service_pool.cc:224] Handling call
0709 12:24:45.355991 (+1035508us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:45.356566 (+   575us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:45.357368 (+   802us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54006b67d0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b608ad 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:45.357487 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2344387968}
W20260709 12:24:45.356953 29707 consensus_meta.cc:287] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.844s	user 0.011s	sys 0.000s
I20260709 12:24:45.399957 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:45.477751 26432 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:45.379379 29696 raft_consensus.cc:3055] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:24:45.403666 25754 raft_consensus.cc:1275] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:24:45.299301 29732 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:45.045795 29729 log.cc:927] Time spent T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
W20260709 12:24:45.139696 29355 consensus_meta.cc:287] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.711s	user 0.005s	sys 0.008s
I20260709 12:24:45.379554 29747 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:45.411777 25763 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 8.
I20260709 12:24:45.406105 25685 rpcz_store.cc:276] 0709 12:24:44.052068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.052237 (+   169us) service_pool.cc:224] Handling call
0709 12:24:44.075181 (+ 22944us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:44.331399 (+256218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:45.230032 (+898633us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b5400202e54. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:45.230218 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":416969600}
I20260709 12:24:45.439383 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:45.440093 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:45.445443 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 454915us
I20260709 12:24:45.440171 29685 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:45.315323 29745 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.448324 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:45.479370 29696 raft_consensus.cc:740] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:45.417222 25726 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:24:45.454056 25836 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 10.
W20260709 12:24:45.465350 26434 rpcz_store.cc:269] 0709 12:24:43.823601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.824765 (+  1164us) service_pool.cc:224] Handling call
0709 12:24:45.350845 (+1526080us) spinlock_profiling.cc:243] Waited 893 ms on lock 0x7b54006b67d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:45.350975 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2053527424}
I20260709 12:24:45.351495 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:45.466523 25829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 2712) took 1501 ms. Trace:
I20260709 12:24:45.470801 25800 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:45.470795 25762 raft_consensus.cc:2393] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 11: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:45.465173 25759 raft_consensus.cc:2889] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:45.405544 29750 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:45.473915 29621 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:24:45.371670 26433 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36518 (request call id 830) took 1547 ms (client timeout 2019 ms). Trace:
W20260709 12:24:45.481598 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 113878us
I20260709 12:24:45.402143 29662 consensus_queue.cc:1048] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:24:45.549271 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
W20260709 12:24:45.464586 29634 consensus_meta.cc:287] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.570s	user 0.007s	sys 0.003s
I20260709 12:24:45.456204 29536 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:45.558339 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:45.549502 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:45.568207 26436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36508 (request call id 964) took 1553 ms. Trace:
I20260709 12:24:45.484603 29707 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:45.575528 26432 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 8.
I20260709 12:24:45.577140 25828 raft_consensus.cc:1275] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:24:45.442323 29670 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:45.483033 29698 consensus_meta.cc:287] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.757s	user 0.005s	sys 0.005s
I20260709 12:24:45.413904 25801 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:45.488523 29440 raft_consensus.cc:697] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:45.458503 28959 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:45.470381 29316 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:45.638484 29744 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:45.683885 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
W20260709 12:24:45.769217 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 299163us
I20260709 12:24:45.788831 25800 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:45.770388 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:45.713210 25763 raft_consensus.cc:1275] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:24:45.790880 25763 raft_consensus.cc:1240] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:45.673926 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:45.756011 25686 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.765s	user 0.029s	sys 0.024s
W20260709 12:24:45.791961 25686 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.801s	user 0.029s	sys 0.024s
I20260709 12:24:45.755102 26436 rpcz_store.cc:276] 0709 12:24:44.014826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.065569 (+ 50743us) service_pool.cc:224] Handling call
0709 12:24:45.484813 (+1419244us) spinlock_profiling.cc:243] Waited 998 ms on lock 0x7b54006f3bd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:45.568124 (+ 83311us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2295928704}
W20260709 12:24:45.754889 26433 rpcz_store.cc:269] 0709 12:24:43.824529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.825042 (+   513us) service_pool.cc:224] Handling call
0709 12:24:45.371507 (+1546465us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400334354. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:45.371618 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2542505728}
I20260709 12:24:45.771843 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:45.769701 26402 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:24:45.740877 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.831068 29316 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:45.832016 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:45.657261 29740 log.cc:927] Time spent T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:24:45.585529 29747 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:24:45.832644 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 418816us
W20260709 12:24:45.700431 29751 log.cc:927] Time spent T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:24:45.757894 25829 rpcz_store.cc:276] 0709 12:24:43.965006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.249551 (+284545us) service_pool.cc:224] Handling call
0709 12:24:44.250034 (+   483us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:44.569342 (+319308us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:44.569389 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:44.570179 (+   790us) log.cc:844] Serialized 52 byte log entry
0709 12:24:44.722378 (+152199us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:45.144969 (+422591us) log.cc:844] Serialized 14 byte log entry
0709 12:24:45.208394 (+ 63425us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:45.208502 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:45.220358 (+ 11856us) spinlock_profiling.cc:243] Waited 19.3 ms on lock 0x7b4400022b4c. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db 00007f5d99708aaf 00007f5d996fc86e 00007f5d996fbbb6 00007f5d996fb7d8 00007f5d99705221 00007f5d997051d9 00007f5d99705169
0709 12:24:45.454711 (+234353us) raft_consensus.cc:1685] finished
0709 12:24:45.466233 (+ 11522us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:45.466450 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34784,"prepare.queue_time_us":41633,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":46820,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":176,"spinlock_wait_cycles":44351872,"thread_start_us":849805,"threads_started":3,"wal-append.queue_time_us":222924}
I20260709 12:24:45.587875 29673 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:45.553275 29540 raft_consensus.cc:2749] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:45.770164 29606 raft_consensus.cc:2749] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:45.863950 29605 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:45.864151 29606 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:45.864519 29605 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:45.864727 29606 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:45.865342 29725 consensus_queue.cc:1059] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:45.866566 29605 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:45.866914 29684 raft_consensus.cc:3055] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:45.866788 29606 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:45.730158 29671 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:45.867375 29684 raft_consensus.cc:740] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:45.868705 29540 raft_consensus.cc:2804] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:45.869299 29540 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:45.869518 29684 consensus_queue.cc:260] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:45.870772 29684 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:45.650378 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 67747.5us
W20260709 12:24:45.871721 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.580480 29717 consensus_queue.cc:1059] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.195s
I20260709 12:24:45.872838 29717 raft_consensus.cc:3055] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:45.873193 29717 raft_consensus.cc:740] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:45.873993 29717 consensus_queue.cc:260] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:45.875168 29717 raft_consensus.cc:3060] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:45.772190 29731 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.876283 29731 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:45.786078 29769 log.cc:927] Time spent T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:24:45.785651 29698 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:45.786767 25679 raft_consensus.cc:1240] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:45.637024 29745 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:45.880807 29767 consensus_queue.cc:1175] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5cccf20a8bff46dba6601f241d172b8a" responder_term: 7 status { last_received { term: 7 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 7 index: 6 } }
W20260709 12:24:45.801417 29765 log.cc:927] Time spent T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.211s	user 0.001s	sys 0.001s
I20260709 12:24:45.773100 29634 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:45.554694 29746 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:45.585350 29355 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:45.803305 25682 raft_consensus.cc:2393] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 12: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:45.792160 25762 raft_consensus.cc:1240] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:45.829388 25685 raft_consensus.cc:1240] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:45.829416 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 412223us
I20260709 12:24:45.903496 25685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2268) took 1806 ms. Trace:
I20260709 12:24:45.903973 25685 rpcz_store.cc:276] 0709 12:24:44.096638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.802500 (+1705862us) service_pool.cc:224] Handling call
0709 12:24:45.829223 (+ 26723us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:45.903193 (+ 73970us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:45.903429 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:45.905277 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:45.906196 25685 raft_consensus.cc:2393] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 7: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:45.906090 25726 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:45.907095 29673 raft_consensus.cc:2804] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:24:45.907209 25726 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:45.907493 29673 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
W20260709 12:24:45.837522 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 67901.1us
I20260709 12:24:45.907862 29673 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:45.907987 29621 raft_consensus.cc:2804] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:45.908492 29621 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:45.908577 26402 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:45.908926 29621 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:45.909107 29606 consensus_queue.cc:1059] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:45.910255 29606 raft_consensus.cc:3055] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:45.910614 29606 raft_consensus.cc:740] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:45.911010 29550 raft_consensus.cc:2749] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:45.839680 29512 raft_consensus.cc:3055] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:24:45.860157 29316 raft_consensus.cc:2804] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:45.860549 29666 raft_consensus.cc:2804] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:45.869928 29540 raft_consensus.cc:3060] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:45.786427 29732 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:24:45.881700 25680 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51578 (request call id 780) took 1824 ms (client timeout 1929 ms). Trace:
W20260709 12:24:45.919143 25680 rpcz_store.cc:269] 0709 12:24:44.057505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.142744 (+ 85239us) service_pool.cc:224] Handling call
0709 12:24:45.881533 (+1738789us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54002a53d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:45.881644 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2515384064}
I20260709 12:24:45.773005 25678 raft_consensus.cc:2468] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 11.
I20260709 12:24:45.899667 25650 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:24:45.890182 29763 log.cc:927] Time spent T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.116s	user 0.005s	sys 0.000s
W20260709 12:24:45.838577 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 49829.4us
I20260709 12:24:45.837978 29719 raft_consensus.cc:2749] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:45.942826 29719 consensus_queue.cc:1048] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:45.952679 25650 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:45.953770 26438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 970) took 1071 ms. Trace:
I20260709 12:24:45.910635 26402 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:24:45.859251 25761 raft_consensus.cc:1240] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:45.837347 29700 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:45.976251 29700 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:45.978590 29611 consensus_meta.cc:287] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.598s	user 0.007s	sys 0.005s
I20260709 12:24:45.978765 29700 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:45.979028 29611 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:45.980000 29361 raft_consensus.cc:2749] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:45.980172 25757 raft_consensus.cc:1240] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:45.914130 25726 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
W20260709 12:24:45.981637 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 67558.2us
I20260709 12:24:45.831055 28959 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:45.984968 29746 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:45.911561 29606 consensus_queue.cc:260] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:45.985445 25679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2259) took 1918 ms. Trace:
I20260709 12:24:45.986249 29606 raft_consensus.cc:3060] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:45.985953 25679 rpcz_store.cc:276] 0709 12:24:44.067062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.832769 (+765707us) service_pool.cc:224] Handling call
0709 12:24:44.833071 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:45.878351 (+1045280us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:45.985170 (+106819us) spinlock_profiling.cc:243] Waited 953 ms on lock 0x7b5400158954. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:45.985376 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2192893184}
I20260709 12:24:45.917222 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:45.987965 29667 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:45.988492 25685 raft_consensus.cc:2393] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 8: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:45.989166 29685 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:45.989740 25685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2271) took 1833 ms. Trace:
I20260709 12:24:45.990103 25685 rpcz_store.cc:276] 0709 12:24:44.156432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.989020 (+1832588us) service_pool.cc:224] Handling call
0709 12:24:45.989310 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:45.989460 (+   150us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:45.989484 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:45.989521 (+    37us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:45.989551 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:45.989598 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:45.989686 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:45.991354 25685 raft_consensus.cc:1240] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:45.920011 29666 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:45.915290 29316 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:45.992184 29666 raft_consensus.cc:3060] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:45.988502 29667 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:45.992272 29316 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:45.993762 29745 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:45.993976 29667 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:24:45.994815 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 84237.2us
I20260709 12:24:45.995551 26402 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:45.996448 26402 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:45.941340 29420 raft_consensus.cc:3060] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:45.941730 25800 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
W20260709 12:24:46.007506 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 65866.6us
I20260709 12:24:45.954317 26438 rpcz_store.cc:276] 0709 12:24:44.881961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.992277 (+110316us) service_pool.cc:224] Handling call
0709 12:24:44.992624 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:44.994968 (+  2344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:44.995000 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:44.995451 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 12:24:45.154122 (+158671us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:24:45.450459 (+296337us) log.cc:844] Serialized 14 byte log entry
0709 12:24:45.450879 (+   420us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:45.451016 (+   137us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:45.880134 (+429118us) spinlock_profiling.cc:243] Waited 2.05 ms on lock 0x7b180039a720. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d96a743f3 00007f5d96a767c1 00007f5d96a76779 00007f5d96a76709 00007f5d96a766d1 00007f5d96a759cd 0000000000388634 0000000000388479 00007f5d96a5783a
0709 12:24:45.953372 (+ 73238us) raft_consensus.cc:1685] finished
0709 12:24:45.953495 (+   123us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:45.953675 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":400007,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":4460,"raft.queue_time_us":908,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":102,"spinlock_wait_cycles":4707712,"thread_start_us":110441,"threads_started":1,"wal-append.queue_time_us":423517}
I20260709 12:24:45.959231 29536 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:45.964319 25684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2266) took 1894 ms. Trace:
I20260709 12:24:45.966136 29440 consensus_queue.cc:237] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:45.884812 29696 consensus_queue.cc:260] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:46.017612 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:46.018244 25756 raft_consensus.cc:3060] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:46.019389 25829 raft_consensus.cc:1275] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
W20260709 12:24:45.968537 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.995689 29731 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:45.969058 29634 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:45.969591 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:45.867357 29744 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:45.971243 29355 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:45.913539 29698 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:45.976761 29670 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:46.060890 25679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:40214 (request call id 97) took 1890 ms. Trace:
I20260709 12:24:46.061374 25679 rpcz_store.cc:276] 0709 12:24:44.156791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.987241 (+1830450us) service_pool.cc:224] Handling call
0709 12:24:46.047423 (+ 60182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:46.062500 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:46.063171 29707 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:45.940557 29750 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:45.991868 25685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40230 (request call id 1565) took 1834 ms. Trace:
I20260709 12:24:46.064025 29621 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:46.064312 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:45.920661 25677 raft_consensus.cc:2368] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 8. Current term is 9.
I20260709 12:24:46.066152 29621 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:45.983771 25726 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:46.067004 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
W20260709 12:24:46.067203 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 83503.1us
I20260709 12:24:46.067682 25677 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:46.028673 29127 raft_consensus.cc:2804] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:46.068830 25757 raft_consensus.cc:1240] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:45.975176 29540 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:46.021456 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:46.020112 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:46.069912 25759 raft_consensus.cc:3060] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:46.070051 25828 raft_consensus.cc:3060] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:24:46.071070 29540 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:46.071615 29540 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:46.033317 26402 connection.cc:256] RPC call timeout handler was delayed by -1.0738794260000759s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1572s for a response
W20260709 12:24:46.074065 26402 connection.cc:256] RPC call timeout handler was delayed by -1.0405794260000221s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16090000000000002s for a response
W20260709 12:24:46.074383 26402 connection.cc:256] RPC call timeout handler was delayed by -1.0117794259999755s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16410000000000002s for a response
I20260709 12:24:46.064031 25679 raft_consensus.cc:1275] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:24:46.075414 26402 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:46.012970 25684 rpcz_store.cc:276] 0709 12:24:44.069997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.844718 (+774721us) service_pool.cc:224] Handling call
0709 12:24:44.849399 (+  4681us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:44.866492 (+ 17093us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:44.866526 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:44.873059 (+  6533us) log.cc:844] Serialized 26 byte log entry
0709 12:24:45.130843 (+257784us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:45.131176 (+   333us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:45.131287 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:45.964077 (+832790us) raft_consensus.cc:1685] finished
0709 12:24:45.964102 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:45.964257 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5901,"raft.queue_time_us":16829,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":5729,"thread_start_us":236627,"threads_started":1,"wal-append.queue_time_us":843754}
I20260709 12:24:46.075780 25679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2273) took 1299 ms. Trace:
I20260709 12:24:46.038666 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:46.076231 25679 rpcz_store.cc:276] 0709 12:24:44.776350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.063364 (+1287014us) service_pool.cc:224] Handling call
0709 12:24:46.063679 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:46.075546 (+ 11867us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:46.075730 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:46.076807 26402 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:46.045380 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:46.033139 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:46.077210 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:46.077507 25763 raft_consensus.cc:3060] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:46.053339 29744 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:46.054013 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:46.087121 25755 raft_consensus.cc:2468] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 10.
I20260709 12:24:46.057711 25584 catalog_manager.cc:5697] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:24:46.088227 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:46.018023 29662 raft_consensus.cc:2749] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:46.017174 29667 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:46.088730 25584 catalog_manager.cc:5697] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:24:46.089464 29667 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:46.090304 25584 catalog_manager.cc:5697] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:24:46.028519 29684 raft_consensus.cc:2804] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:46.057225 29611 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:46.032050 26435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 976) took 1088 ms. Trace:
I20260709 12:24:46.038321 29685 raft_consensus.cc:2749] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:46.092674 29685 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:46.092060 26435 rpcz_store.cc:276] 0709 12:24:44.943210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.259634 (+316424us) service_pool.cc:224] Handling call
0709 12:24:45.259905 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:45.260677 (+   772us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:24:45.746759 (+486082us) log.cc:844] Serialized 14 byte log entry
0709 12:24:46.030134 (+283375us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:46.030191 (+    57us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:46.030232 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:46.031881 (+  1649us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:46.031998 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":210004,"prepare.queue_time_us":412523,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":5720,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":3149,"thread_start_us":457292,"threads_started":2}
I20260709 12:24:46.093135 29685 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:46.091698 25584 catalog_manager.cc:5697] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 3 to 6, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 6 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:24:46.095237 29685 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:46.095137 25584 catalog_manager.cc:5697] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 6 to 9, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to f82778701b464892aab92a752ed7ffdc (127.23.245.129), now has a pending config: VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129), VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130), VOTER 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131), VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 9 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } } pending_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:24:46.028436 29489 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.097379 29489 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:46.033336 29536 raft_consensus.cc:2749] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:46.059932 29747 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:46.104099 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:46.104378 25758 raft_consensus.cc:2393] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 12: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:46.030668 29700 raft_consensus.cc:2804] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:46.064105 25685 rpcz_store.cc:276] 0709 12:24:44.157294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.990934 (+1833640us) service_pool.cc:224] Handling call
0709 12:24:45.991204 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:45.991675 (+   471us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:45.991823 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:46.068898 29621 raft_consensus.cc:2749] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:46.123734 25763 raft_consensus.cc:2468] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 9.
I20260709 12:24:45.914013 29512 raft_consensus.cc:740] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
W20260709 12:24:46.029743 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 77194.5us
I20260709 12:24:46.072405 29696 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:46.077862 25800 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:46.051574 25682 raft_consensus.cc:1240] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 15. Current term is 16. Ops: []
I20260709 12:24:46.167783 25685 raft_consensus.cc:1275] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:24:46.168715 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:46.169476 25830 raft_consensus.cc:1275] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 12:24:46.170724 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
W20260709 12:24:46.079947 25726 leader_election.cc:336] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Timed out: RequestConsensusVote RPC to 127.23.245.132:35611 timed out after 1.587s (SENT)
I20260709 12:24:46.079874 25759 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 9.
I20260709 12:24:46.084508 25828 raft_consensus.cc:2468] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 9.
I20260709 12:24:46.171600 25726 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:46.172734 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:46.174074 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:46.085870 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:46.107398 25584 catalog_manager.cc:5697] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 3 to 9. New cstate: current_term: 9 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:24:46.111572 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:46.111508 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 44875.4us
I20260709 12:24:46.175868 25679 raft_consensus.cc:2468] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 9.
I20260709 12:24:46.112599 28959 consensus_queue.cc:1048] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:46.113147 29666 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:46.113677 29684 raft_consensus.cc:697] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 8 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:46.112257 29540 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:46.095865 29685 raft_consensus.cc:2749] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:46.115334 29489 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:46.201278 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:46.204030 26430 raft_consensus.cc:3060] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:46.115777 25677 raft_consensus.cc:2468] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 8.
I20260709 12:24:46.116396 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:46.117875 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:46.085717 29750 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.205739 25677 raft_consensus.cc:1240] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:46.206461 25677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2276) took 1371 ms. Trace:
I20260709 12:24:46.206826 25677 rpcz_store.cc:276] 0709 12:24:44.834750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.205201 (+1370451us) service_pool.cc:224] Handling call
0709 12:24:46.205535 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:46.206194 (+   659us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:46.206400 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:46.127059 25568 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 5aae9f34f7154346afd482b3183ee180 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 6e673265293d4e9a937dc45150aeb1b8 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:24:46.127846 25757 raft_consensus.cc:1240] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 7. Current term is 8. Ops: []
W20260709 12:24:46.003357 25681 consensus_meta.cc:287] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.539s	user 0.006s	sys 0.009s
I20260709 12:24:46.208738 25681 raft_consensus.cc:2468] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 10.
W20260709 12:24:46.154860 25754 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.022s	sys 0.021s
I20260709 12:24:46.177322 25679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2275) took 1398 ms. Trace:
W20260709 12:24:46.209355 25754 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.023s	sys 0.022s
I20260709 12:24:46.180173 25685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2274) took 1402 ms. Trace:
I20260709 12:24:46.209534 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:46.085091 25834 raft_consensus.cc:2468] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 8.
I20260709 12:24:46.176246 25584 catalog_manager.cc:5697] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 4 to 11, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 11 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } }
I20260709 12:24:46.133183 29629 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:46.185904 25682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2272) took 1410 ms. Trace:
I20260709 12:24:46.209830 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:46.189447 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:46.189551 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:46.191190 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:46.217509 25837 raft_consensus.cc:3060] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:46.192106 25755 raft_consensus.cc:2393] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 8: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:46.200615 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:46.208529 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:46.219575 26432 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 11.
I20260709 12:24:46.219702 25677 raft_consensus.cc:1240] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:24:46.210646 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:46.220567 25677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40230 (request call id 1580) took 1120 ms. Trace:
W20260709 12:24:46.184273 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 106484us
I20260709 12:24:46.217417 25828 raft_consensus.cc:2393] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 12: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:46.220993 25677 rpcz_store.cc:276] 0709 12:24:45.100011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.219021 (+1119010us) service_pool.cc:224] Handling call
0709 12:24:46.219430 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:46.220266 (+   836us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:46.220504 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:46.211059 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:46.223080 25677 raft_consensus.cc:1240] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 12:24:46.184616 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 104705us
W20260709 12:24:46.208178 25568 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 81315.9us
I20260709 12:24:46.210722 25584 catalog_manager.cc:5697] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 8 to 10, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 10 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:24:46.225890 25726 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:46.226181 25584 catalog_manager.cc:5697] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 10 to 12, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 12 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:46.209427 25679 rpcz_store.cc:276] 0709 12:24:44.778891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.176499 (+1397608us) service_pool.cc:224] Handling call
0709 12:24:46.176768 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:46.176969 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:46.177003 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:46.177045 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:46.177072 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:46.177133 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:46.177258 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:46.209793 25685 rpcz_store.cc:276] 0709 12:24:44.777447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.146827 (+1369380us) service_pool.cc:224] Handling call
0709 12:24:46.147255 (+   428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:46.168348 (+ 21093us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:46.180110 (+ 11762us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:46.243225 25756 raft_consensus.cc:2468] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 9.
I20260709 12:24:46.202510 29605 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:46.086308 29673 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:46.232362 29629 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:46.232589 29512 consensus_queue.cc:260] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:46.211054 29671 consensus_queue.cc:1059] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:24:46.190991 29536 consensus_queue.cc:1059] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:24:46.200238 29670 consensus_queue.cc:1059] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:24:46.190069 29706 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.200846 29361 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.168094 29700 raft_consensus.cc:697] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 7 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:46.193614 29707 consensus_queue.cc:1048] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:24:46.132694 29616 consensus_queue.cc:1059] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.092s
I20260709 12:24:46.238417 26436 raft_consensus.cc:1240] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:46.238468 25684 raft_consensus.cc:2468] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 8.
I20260709 12:24:46.235440 25584 catalog_manager.cc:5697] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } }
I20260709 12:24:46.227787 25726 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:46.215868 25682 rpcz_store.cc:276] 0709 12:24:44.775393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.031020 (+1255627us) service_pool.cc:224] Handling call
0709 12:24:46.051396 (+ 20376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:46.185647 (+134251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:46.185851 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:46.242709 25649 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:46.190258 29744 raft_consensus.cc:2749] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:46.253480 26401 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:24:46.416115 25686 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.007s	sys 0.010s
I20260709 12:24:46.378118 25837 raft_consensus.cc:2410] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 12:24:46.318323 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:46.653465 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
W20260709 12:24:46.653784 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 576989us
I20260709 12:24:46.654367 25832 raft_consensus.cc:3060] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:46.655202 26402 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:24:46.328511 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:46.288586 26430 raft_consensus.cc:2468] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 9.
I20260709 12:24:46.656839 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:46.657145 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:46.282389 25681 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51578 (request call id 771) took 2201 ms (client timeout 1800 ms). Trace:
I20260709 12:24:46.312361 29719 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:46.658480 25681 rpcz_store.cc:269] 0709 12:24:44.055312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.088256 (+ 32944us) service_pool.cc:224] Handling call
0709 12:24:46.256302 (+2168046us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54002648d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:46.256440 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3019923840}
I20260709 12:24:46.651376 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:46.659492 29719 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:46.652206 25686 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.752s	user 0.012s	sys 0.011s
I20260709 12:24:46.660076 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:46.660889 25681 raft_consensus.cc:2393] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 9: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:46.328867 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:46.661674 25679 raft_consensus.cc:2376] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 7. Re-sending same reply.
I20260709 12:24:46.662838 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:46.326833 25762 raft_consensus.cc:1240] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 13. Current term is 14. Ops: []
W20260709 12:24:46.465716 25680 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.014s	sys 0.027s
I20260709 12:24:46.663018 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:46.660475 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
W20260709 12:24:46.427704 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:46.668028 25680 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.014s	sys 0.031s
I20260709 12:24:46.664680 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:46.667616 25831 raft_consensus.cc:3060] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:46.669378 25679 raft_consensus.cc:2393] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 9: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:46.670768 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:46.671535 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:46.672628 25686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51578 (request call id 776) took 2616 ms. Trace:
I20260709 12:24:46.672756 29797 raft_consensus.cc:2764] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 12:24:46.673913 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 446207us
I20260709 12:24:46.674137 29691 raft_consensus.cc:2804] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:46.674914 29691 raft_consensus.cc:697] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 9 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:46.675041 29694 raft_consensus.cc:3055] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:46.673067 25686 rpcz_store.cc:276] 0709 12:24:44.056540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.802860 (+746320us) service_pool.cc:224] Handling call
0709 12:24:44.803149 (+   289us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:44.803837 (+   688us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:44.803864 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:44.825543 (+ 21679us) log.cc:844] Serialized 52 byte log entry
0709 12:24:44.965774 (+140231us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:45.828953 (+863179us) log.cc:844] Serialized 14 byte log entry
0709 12:24:46.660573 (+831620us) log.cc:844] Serialized 14 byte log entry
0709 12:24:46.672303 (+ 11730us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:46.672377 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:46.672426 (+    49us) raft_consensus.cc:1685] finished
0709 12:24:46.672439 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:46.672570 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82281,"prepare.queue_time_us":79330,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":72,"raft.queue_time_us":31789,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":159,"thread_start_us":1666763,"threads_started":3,"wal-append.queue_time_us":132608}
I20260709 12:24:46.675429 29694 raft_consensus.cc:740] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:46.675936 29691 consensus_queue.cc:237] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:46.676440 29694 consensus_queue.cc:260] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:46.677757 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 435233us
I20260709 12:24:46.678536 25726 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:46.673410 25681 raft_consensus.cc:1240] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:24:46.679783 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:46.679819 29797 consensus_queue.cc:1048] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:46.684837 25584 catalog_manager.cc:5697] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 3 to 9. New cstate: current_term: 9 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } }
I20260709 12:24:46.692651 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:46.444384 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 113530us
I20260709 12:24:46.484311 25830 raft_consensus.cc:2468] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 6.
W20260709 12:24:46.699040 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 445838us
I20260709 12:24:46.554009 29667 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:46.530694 29127 raft_consensus.cc:697] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 7 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
W20260709 12:24:46.699901 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 44765.7us
W20260709 12:24:46.718957 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:46.229254 29750 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:46.239264 29621 raft_consensus.cc:3060] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:46.686729 25584 catalog_manager.cc:5697] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 4 to 8, leader changed from a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 8 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:24:46.705260 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:46.706470 29512 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:46.254647 29746 consensus_queue.cc:1059] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.460s
W20260709 12:24:46.697676 26403 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.009s	sys 0.001s
I20260709 12:24:46.252262 29685 raft_consensus.cc:2749] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:24:46.713436 25836 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.013s	sys 0.010s
I20260709 12:24:46.465011 29747 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:46.263365 29725 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.336565 29717 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.721689 29671 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.700083 29694 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:46.720796 26402 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:24:46.698797 25678 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.753s	user 0.004s	sys 0.006s
I20260709 12:24:46.699080 29540 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:46.239068 29634 consensus_queue.cc:1048] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.471s
I20260709 12:24:46.636034 29777 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
W20260709 12:24:46.710292 29768 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.774s	user 0.011s	sys 0.038s
I20260709 12:24:46.726169 25831 raft_consensus.cc:2468] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 9.
W20260709 12:24:46.507591 29550 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.014s	sys 0.008s
I20260709 12:24:46.728554 25584 catalog_manager.cc:5697] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 5 to 7, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 7 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } }
I20260709 12:24:46.416649 29684 consensus_queue.cc:237] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:46.731731 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:46.731734 25800 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.000s	sys 0.013s
W20260709 12:24:46.781591 25800 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.000s	sys 0.014s
W20260709 12:24:46.781971 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 559209us
I20260709 12:24:46.782873 25800 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:46.729033 25682 raft_consensus.cc:2393] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 9: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
W20260709 12:24:46.737811 25836 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.014s	sys 0.010s
W20260709 12:24:46.784416 26438 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.015s	sys 0.007s
W20260709 12:24:46.784722 26438 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.015s	sys 0.007s
W20260709 12:24:46.730397 29440 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.008s	sys 0.017s
W20260709 12:24:46.785403 29440 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.009s	sys 0.017s
I20260709 12:24:46.697789 29361 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:46.788383 29361 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:46.543058 25683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2267) took 2452 ms. Trace:
I20260709 12:24:46.713555 29787 raft_consensus.cc:2804] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:24:46.793921 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 98377.3us
I20260709 12:24:46.794862 25801 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:24:46.775039 29768 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.839s	user 0.012s	sys 0.038s
W20260709 12:24:46.760679 25678 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.815s	user 0.005s	sys 0.006s
I20260709 12:24:46.662726 29719 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:46.698236 29706 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:46.776942 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 56247.3us
I20260709 12:24:46.765166 29673 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:46.728097 29788 raft_consensus.cc:2804] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:46.778903 25584 catalog_manager.cc:5697] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 5 to 10, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 10 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
W20260709 12:24:46.730444 25829 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.000s	sys 0.024s
W20260709 12:24:46.784175 25760 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.003s	sys 0.018s
W20260709 12:24:46.836102 25829 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.000s	sys 0.024s
W20260709 12:24:46.836198 25760 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.003s	sys 0.019s
I20260709 12:24:46.795620 25801 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:46.390012 29316 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:46.808193 25800 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:46.789513 25683 rpcz_store.cc:276] 0709 12:24:44.090268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.450427 (+1360159us) service_pool.cc:224] Handling call
0709 12:24:45.450744 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:45.451094 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:45.451122 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:45.453950 (+  2828us) log.cc:844] Serialized 26 byte log entry
0709 12:24:46.004155 (+550205us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:46.030642 (+ 26487us) log.cc:844] Serialized 14 byte log entry
0709 12:24:46.073775 (+ 43133us) spinlock_profiling.cc:243] Waited 34.3 ms on lock 0x7b180042ec80. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d969eec0a 00007f5da012e219 00007f5d96a76a40 00007f5d96a714e4 00007f5d96a71455 00007f5d99b59060 00007f5d99b6b716 00007f5d99b7c287 00007f5d99b7c208
0709 12:24:46.080691 (+  6916us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:46.080764 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:46.542301 (+461537us) spinlock_profiling.cc:243] Waited 22.7 ms on lock 0x7b180042ec80. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d96a743f3 00007f5d96a767c1 00007f5d96a76779 00007f5d96a76709 00007f5d96a766d1 00007f5d96a759cd 0000000000388634 0000000000388479 00007f5d96a5783a
0709 12:24:46.542730 (+   429us) raft_consensus.cc:1685] finished
0709 12:24:46.542766 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:46.542972 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15000,"prepare.queue_time_us":29220,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":50292,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":4761,"spinlock_wait_cycles":131127424,"thread_start_us":415603,"threads_started":1,"wal-append.queue_time_us":840498}
W20260709 12:24:46.778162 29550 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.806s	user 0.014s	sys 0.017s
I20260709 12:24:46.778303 29685 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:46.830968 26402 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:46.745332 29666 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:46.835317 25584 catalog_manager.cc:5697] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 7 to 9, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 9 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:24:46.830657 25678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2270) took 2703 ms. Trace:
W20260709 12:24:46.850032 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 54468.5us
I20260709 12:24:46.754081 29725 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:46.855443 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 125517us
I20260709 12:24:46.855487 25584 catalog_manager.cc:5697] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 7 to 9, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 9 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
W20260709 12:24:46.861153 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 182649us
I20260709 12:24:46.765707 29671 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:46.832921 29787 raft_consensus.cc:697] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 8 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:46.761281 29717 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:46.850802 29780 log.cc:927] Time spent T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.083s	user 0.000s	sys 0.004s
I20260709 12:24:46.832278 29540 raft_consensus.cc:2749] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:46.855551 25678 rpcz_store.cc:276] 0709 12:24:44.127225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.936814 (+1809589us) service_pool.cc:224] Handling call
0709 12:24:45.937158 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:45.937395 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:24:45.945943 (+  8548us) log.cc:844] Serialized 14 byte log entry
0709 12:24:46.830284 (+884341us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:46.830349 (+    65us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:24:46.830404 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:46.830468 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:46.830591 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2396,"prepare.queue_time_us":8123,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":3227,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":5516,"thread_start_us":881581,"threads_started":1,"wal-append.queue_time_us":750132}
I20260709 12:24:46.878767 25726 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:24:46.841536 29792 consensus_queue.cc:1059] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 12:24:46.871133 25584 catalog_manager.cc:5697] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 1 to 6, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 6 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:24:46.753785 29127 consensus_queue.cc:237] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:46.781816 29777 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:46.856950 29719 raft_consensus.cc:3055] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:46.901216 25726 leader_election.cc:400] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 election: Vote denied by peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) with higher term. Message: Invalid argument: T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 8. Current term is 9.
I20260709 12:24:46.902240 25584 catalog_manager.cc:5697] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:24:46.968922 25832 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 9.
I20260709 12:24:46.980669 25726 leader_election.cc:403] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
W20260709 12:24:46.980894 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 120980us
I20260709 12:24:46.980546 25584 catalog_manager.cc:5697] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 9 to 10, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 10 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:46.982322 25584 catalog_manager.cc:5697] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 3 to 6, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 6 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:46.856804 29685 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:46.902616 25650 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:46.908079 29787 consensus_queue.cc:237] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:46.782490 29700 consensus_queue.cc:237] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:46.950289 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 119403us
I20260709 12:24:46.846063 29746 consensus_queue.cc:1048] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 12:24:46.861094 29695 raft_consensus.cc:2804] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:24:46.705897 29742 consensus_queue.cc:1175] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6e673265293d4e9a937dc45150aeb1b8" responder_term: 11 status { last_received { term: 10 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:24:46.891484 29616 raft_consensus.cc:2804] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:24:46.984127 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 83085.8us
W20260709 12:24:46.984462 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 200525us
I20260709 12:24:46.984154 25584 catalog_manager.cc:5697] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 5 to 6, leader changed from a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 6 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:24:46.902958 29784 log.cc:927] Time spent T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 12:24:46.986760 25754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 2810) took 1574 ms. Trace:
W20260709 12:24:46.993017 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 90456.9us
I20260709 12:24:46.980221 29719 raft_consensus.cc:740] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:46.995056 25680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2269) took 2880 ms. Trace:
I20260709 12:24:47.036903 25800 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:47.036834 25680 rpcz_store.cc:276] 0709 12:24:44.114488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.919985 (+1805497us) service_pool.cc:224] Handling call
0709 12:24:45.920326 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:45.920530 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:45.920564 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:45.921049 (+   485us) log.cc:844] Serialized 26 byte log entry
0709 12:24:46.668593 (+747544us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:46.668660 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:46.668751 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:46.994869 (+326118us) raft_consensus.cc:1685] finished
0709 12:24:46.994887 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:46.995003 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":728048,"threads_started":1,"wal-append.queue_time_us":767935}
I20260709 12:24:46.949331 29666 raft_consensus.cc:2804] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:47.020397 25584 catalog_manager.cc:5697] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 6 to 7, leader changed from a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 7 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:24:46.961828 29791 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:46.993628 29802 raft_consensus.cc:2804] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:47.026027 25836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44218 (request call id 1644) took 1006 ms. Trace:
I20260709 12:24:47.044175 25584 catalog_manager.cc:5697] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 9 to 10, leader changed from a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 10 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:24:47.026542 25650 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:47.018131 29616 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:47.005208 29695 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:47.031391 29744 consensus_queue.cc:1059] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:47.032158 29440 consensus_queue.cc:1059] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:47.032461 29777 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:47.026149 25754 rpcz_store.cc:276] 0709 12:24:45.412180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.497429 (+ 85249us) service_pool.cc:224] Handling call
0709 12:24:45.560022 (+ 62593us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:45.560277 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:24:46.209820 (+649543us) log.cc:844] Serialized 14 byte log entry
0709 12:24:46.985886 (+776066us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:46.985960 (+    74us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:24:46.986031 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:46.986541 (+   510us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:46.986687 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":145204,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":49,"raft.queue_time_us":25197,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":5753,"thread_start_us":1395770,"threads_started":3,"wal-append.queue_time_us":623824}
I20260709 12:24:46.986588 29673 raft_consensus.cc:2749] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) with higher term. Message: Invalid argument: T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 8. Current term is 9.
I20260709 12:24:46.995003 29792 raft_consensus.cc:2749] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:24:47.043294 29800 raft_consensus.cc:2804] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:47.049747 25584 catalog_manager.cc:5697] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 7 to 9, leader changed from a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 9 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:24:47.044739 25836 rpcz_store.cc:276] 0709 12:24:46.019224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.030464 (+ 11240us) service_pool.cc:224] Handling call
0709 12:24:46.030777 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:46.114186 (+ 83409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:46.114216 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:46.114720 (+   504us) log.cc:844] Serialized 26 byte log entry
0709 12:24:46.784621 (+669901us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:46.784682 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:46.915206 (+130524us) spinlock_profiling.cc:243] Waited 67.6 ms on lock 0x7b5400245754. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:46.915266 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:47.014283 (+ 99017us) raft_consensus.cc:1685] finished
0709 12:24:47.014303 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:47.025951 (+ 11648us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15290,"raft.queue_time_us":16511,"raft.run_cpu_time_us":50,"raft.run_wall_time_us":50,"spinlock_wait_cycles":155544448,"thread_start_us":669500,"threads_started":1,"wal-append.queue_time_us":803864}
I20260709 12:24:47.090332 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:47.119877 25584 catalog_manager.cc:5697] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } }
I20260709 12:24:47.120705 25754 raft_consensus.cc:2393] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 11: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
W20260709 12:24:47.120977 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 81967.9us
I20260709 12:24:47.042649 29629 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:47.121275 25584 catalog_manager.cc:5697] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:47.128224 25584 catalog_manager.cc:5697] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:24:47.129525 25584 catalog_manager.cc:5697] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 5 to 6, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 6 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:47.130977 25584 catalog_manager.cc:5697] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:24:47.043641 29666 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:47.132277 29666 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:24:47.118053 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 120423us
I20260709 12:24:47.044044 29745 raft_consensus.cc:2749] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:24:47.094858 25650 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:24:47.142499 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 47778.6us
I20260709 12:24:47.143497 25650 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:47.056126 29616 raft_consensus.cc:3060] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:47.144186 26404 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.973s	user 0.023s	sys 0.045s
I20260709 12:24:47.135706 25584 catalog_manager.cc:5697] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 6 to 9, leader changed from a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 9 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
W20260709 12:24:47.149581 26404 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.977s	user 0.024s	sys 0.045s
I20260709 12:24:47.050009 29802 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:47.056327 29698 raft_consensus.cc:2804] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:47.154254 25650 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:47.155519 25650 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:47.125186 29550 raft_consensus.cc:3055] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:24:47.188755 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:47.049813 29747 consensus_queue.cc:1059] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.098s
I20260709 12:24:47.190526 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:47.093111 29695 raft_consensus.cc:3060] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:24:47.212061 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:47.175173 29767 raft_consensus.cc:2749] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:24:47.115358 29755 consensus_queue.cc:1048] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 12:24:47.148201 29799 raft_consensus.cc:3055] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:24:47.248047 29777 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:47.248643 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 112437us
I20260709 12:24:47.251461 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:47.248466 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:47.146721 29673 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:47.255327 26432 raft_consensus.cc:2468] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 10.
W20260709 12:24:47.223850 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 133100us
I20260709 12:24:47.262513 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:47.263195 26432 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 10.
I20260709 12:24:47.119102 29811 consensus_queue.cc:1059] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.115s
I20260709 12:24:47.263847 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:47.262513 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:47.157385 29802 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:47.273669 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:47.274307 25830 raft_consensus.cc:2468] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 9.
I20260709 12:24:47.263406 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:47.275162 26439 raft_consensus.cc:1240] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 12:24:47.276422 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:47.087044 29791 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:47.156270 29803 raft_consensus.cc:2749] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:47.265868 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:47.283205 25760 raft_consensus.cc:2393] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 10: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:47.283586 25831 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:47.266893 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:47.285360 25828 raft_consensus.cc:2393] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 12: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:47.267431 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:47.286269 25837 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:47.267741 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:47.268083 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:47.148912 29717 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:47.249822 29797 raft_consensus.cc:3055] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:47.280663 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:24:47.281179 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 125741us
I20260709 12:24:47.281389 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:47.287952 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:47.324280 26431 raft_consensus.cc:2376] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 10. Re-sending same reply.
I20260709 12:24:47.149196 29670 raft_consensus.cc:2749] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:47.288599 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:47.288065 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:47.217819 29808 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.191416 29550 raft_consensus.cc:740] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:47.217195 29800 raft_consensus.cc:697] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 8 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:47.298575 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:47.343225 26433 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:47.263242 29807 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.311712 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:47.312335 25760 raft_consensus.cc:1240] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:47.312281 25650 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:47.266311 29706 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:47.264380 29316 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:47.216681 29776 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:47.254431 29767 raft_consensus.cc:2749] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:24:47.324409 26432 raft_consensus.cc:2393] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 10: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:47.148020 29736 consensus_queue.cc:1048] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.115s
I20260709 12:24:47.329022 25831 raft_consensus.cc:2468] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 12.
I20260709 12:24:47.422667 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:47.325492 26437 raft_consensus.cc:2468] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 9.
I20260709 12:24:47.154103 29719 consensus_queue.cc:260] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:47.302848 29794 log.cc:927] Time spent T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.408s	user 0.001s	sys 0.000s
W20260709 12:24:47.311105 29782 log.cc:927] Time spent T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.413s	user 0.000s	sys 0.002s
I20260709 12:24:47.349059 25650 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:47.251729 29799 raft_consensus.cc:740] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:47.454586 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:47.455400 25754 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:24:47.353142 29783 log.cc:927] Time spent T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.363s	user 0.000s	sys 0.001s
I20260709 12:24:47.279503 29673 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:47.352962 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:47.460794 26431 raft_consensus.cc:2393] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 9: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:47.268579 29787 consensus_queue.cc:1048] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.065s
I20260709 12:24:47.303385 29671 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:47.356344 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:47.302759 29797 raft_consensus.cc:740] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:47.305379 29725 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:47.268870 29777 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:47.331557 25837 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 14.
I20260709 12:24:47.423439 25760 raft_consensus.cc:2393] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 14: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:47.312176 29801 raft_consensus.cc:2749] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:24:47.437880 26402 leader_election.cc:336] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 1.800s (SENT)
I20260709 12:24:47.338217 29707 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.422369 29706 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:47.452521 26433 raft_consensus.cc:2468] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 8.
I20260709 12:24:47.463253 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:47.353403 29670 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.463266 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:47.481294 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:24:47.482403 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 133398us
I20260709 12:24:47.511955 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:47.513087 25650 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:47.497257 26402 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:47.443747 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:47.499758 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 68850.1us
I20260709 12:24:47.515232 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:47.515955 25837 raft_consensus.cc:2393] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 6: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:47.516376 25835 raft_consensus.cc:1240] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:47.516598 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:47.516721 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:47.504648 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:47.517189 25836 raft_consensus.cc:2468] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 9.
I20260709 12:24:47.517930 26433 raft_consensus.cc:2410] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
W20260709 12:24:47.519690 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 81905.5us
I20260709 12:24:47.470974 29767 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:47.526161 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:47.425797 29776 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:47.528779 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:47.498178 29719 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:47.524480 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
W20260709 12:24:47.522547 26402 leader_election.cc:336] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 1.929s (SENT)
I20260709 12:24:47.530308 26430 raft_consensus.cc:2376] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 9. Re-sending same reply.
I20260709 12:24:47.482520 29821 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.521605 25650 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:47.524053 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:47.548069 25678 raft_consensus.cc:2468] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 6.
I20260709 12:24:47.548411 25650 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:47.524281 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:47.421753 29819 consensus_queue.cc:1059] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.159s
I20260709 12:24:47.495193 29671 raft_consensus.cc:2749] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:47.534458 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:47.555968 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:47.556991 25681 raft_consensus.cc:2393] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 12: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:47.556886 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:47.540732 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:47.541088 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:47.558550 25759 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 9.
I20260709 12:24:47.549954 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:47.536314 26402 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:47.559630 25755 raft_consensus.cc:2468] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 6.
W20260709 12:24:47.560141 26402 leader_election.cc:336] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 2.008s (SENT)
I20260709 12:24:47.560645 26402 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:47.556893 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:47.561947 25680 raft_consensus.cc:2393] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 8: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:47.565785 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:47.344189 29808 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:47.569984 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:47.526510 29792 raft_consensus.cc:2749] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:47.520370 29814 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.638511 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:47.638528 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:47.365116 29807 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:47.524900 29717 raft_consensus.cc:2749] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:47.668936 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:47.685379 25761 raft_consensus.cc:2393] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 8: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
W20260709 12:24:47.566851 29782 log.cc:927] Time spent T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:24:47.638701 29803 raft_consensus.cc:2749] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:24:47.567072 29795 log.cc:927] Time spent T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.426s	user 0.001s	sys 0.001s
I20260709 12:24:47.514415 29706 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:47.505291 29707 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:47.739880 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:47.545852 29629 consensus_queue.cc:1059] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.171s
I20260709 12:24:47.644479 29744 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:47.747937 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:47.521652 29670 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:47.756031 26432 raft_consensus.cc:2376] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 11. Re-sending same reply.
I20260709 12:24:47.637449 29666 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:47.568101 29821 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:47.711869 29814 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:47.566692 29799 consensus_queue.cc:260] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:47.574793 29797 consensus_queue.cc:260] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:47.566395 29800 consensus_queue.cc:237] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:47.549454 29767 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:47.832158 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:47.700414 29827 raft_consensus.cc:2804] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:47.704427 29787 raft_consensus.cc:2749] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:47.844218 25677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2279) took 2263 ms. Trace:
I20260709 12:24:47.911948 25677 rpcz_store.cc:276] 0709 12:24:45.580864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.224099 (+643235us) service_pool.cc:224] Handling call
0709 12:24:46.224729 (+   630us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:46.291066 (+ 66337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:46.291112 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:46.291671 (+   559us) log.cc:844] Serialized 26 byte log entry
0709 12:24:46.810256 (+518585us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:46.811019 (+   763us) log.cc:844] Serialized 14 byte log entry
0709 12:24:46.829722 (+ 18703us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:46.829807 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:47.844003 (+1014196us) raft_consensus.cc:1685] finished
0709 12:24:47.844028 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:47.844162 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":84161,"prepare.queue_time_us":283,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":37,"raft.queue_time_us":100079,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":19558,"thread_start_us":341752,"threads_started":1,"wal-append.queue_time_us":607633}
I20260709 12:24:47.915544 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:47.906512 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:47.934538 26439 raft_consensus.cc:2368] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 7. Current term is 8.
I20260709 12:24:47.935619 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:47.708494 29667 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.838s	user 0.007s	sys 0.025s
W20260709 12:24:47.758627 29785 log.cc:927] Time spent T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.483s	user 0.001s	sys 0.001s
W20260709 12:24:47.830803 29815 log.cc:927] Time spent T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.258s	user 0.000s	sys 0.000s
W20260709 12:24:47.850380 29420 consensus_meta.cc:287] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 1.822s	user 0.012s	sys 0.001s
W20260709 12:24:47.830209 29825 log.cc:927] Time spent T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
W20260709 12:24:47.828683 29817 log.cc:927] Time spent T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.357s	user 0.000s	sys 0.001s
I20260709 12:24:47.753808 29717 raft_consensus.cc:2804] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:47.812712 29629 raft_consensus.cc:3055] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:47.766999 29826 raft_consensus.cc:3055] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:24:47.910275 29786 log.cc:927] Time spent T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.568s	user 0.000s	sys 0.001s
I20260709 12:24:47.950538 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:48.029134 26439 raft_consensus.cc:2468] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 8.
I20260709 12:24:47.944926 29827 raft_consensus.cc:697] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 6 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:47.808342 29807 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:47.840991 29707 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:47.842621 29673 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:47.758064 29835 raft_consensus.cc:2749] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:47.838626 29747 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:47.960500 25679 raft_consensus.cc:2410] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:24:47.961380 29777 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:24:47.965696 29616 consensus_meta.cc:287] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.774s	user 0.000s	sys 0.009s
W20260709 12:24:47.966517 29806 log.cc:927] Time spent T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 12:24:47.963727 29802 consensus_meta.cc:287] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.671s	user 0.007s	sys 0.000s
I20260709 12:24:47.973960 29792 consensus_queue.cc:1048] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:24:47.948552 29667 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.091s	user 0.016s	sys 0.026s
W20260709 12:24:47.975464 29621 consensus_meta.cc:287] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 1.244s	user 0.012s	sys 0.000s
W20260709 12:24:47.978145 29696 consensus_meta.cc:287] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 1.790s	user 0.007s	sys 0.004s
W20260709 12:24:47.978978 29512 consensus_meta.cc:287] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 1.235s	user 0.009s	sys 0.001s
I20260709 12:24:47.986791 29810 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.989048 29742 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:47.990536 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:47.998328 25800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:47.998744 29605 consensus_meta.cc:287] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 1.735s	user 0.008s	sys 0.004s
I20260709 12:24:47.999490 29489 raft_consensus.cc:3055] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:48.000067 29686 raft_consensus.cc:3055] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:24:47.832321 29808 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:47.848747 29791 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:47.810302 29706 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:47.948021 29799 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:24:48.016346 25754 consensus_meta.cc:287] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.560s	user 0.008s	sys 0.002s
I20260709 12:24:47.858332 29440 raft_consensus.cc:3055] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:24:48.027186 26401 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.006s	sys 0.011s
I20260709 12:24:48.185811 29686 raft_consensus.cc:740] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
W20260709 12:24:48.221166 26401 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.006s	sys 0.011s
W20260709 12:24:48.221602 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 758035us
I20260709 12:24:48.221894 29686 consensus_queue.cc:260] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:47.771060 29744 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:48.034866 25759 raft_consensus.cc:1275] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:24:48.180994 29725 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.036770 25762 raft_consensus.cc:1240] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:48.030352 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:48.224406 29744 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:47.857198 29538 raft_consensus.cc:3055] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:48.227340 29538 raft_consensus.cc:740] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
W20260709 12:24:48.041049 25832 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.728s	user 0.005s	sys 0.013s
I20260709 12:24:48.042820 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:48.055856 25833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44218 (request call id 1646) took 2036 ms. Trace:
I20260709 12:24:48.025043 29826 raft_consensus.cc:740] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
W20260709 12:24:48.056077 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 144387us
W20260709 12:24:48.039625 29694 consensus_meta.cc:287] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 1.276s	user 0.012s	sys 0.000s
I20260709 12:24:48.033864 29717 raft_consensus.cc:697] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 9 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:48.036919 29361 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:48.059970 25726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:48.171098 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 167033us
W20260709 12:24:48.050973 29811 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.010s	sys 0.013s
I20260709 12:24:48.183580 25829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44218 (request call id 1647) took 2160 ms. Trace:
I20260709 12:24:48.182936 29489 raft_consensus.cc:740] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:48.055383 29747 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:48.228148 25754 raft_consensus.cc:2468] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 11.
I20260709 12:24:48.233108 25758 raft_consensus.cc:1240] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:48.231009 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:48.229486 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:48.250195 26402 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:48.232371 25763 raft_consensus.cc:1275] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:24:48.249402 25832 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.936s	user 0.005s	sys 0.014s
I20260709 12:24:48.252066 25833 rpcz_store.cc:276] 0709 12:24:46.019789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.020517 (+   728us) service_pool.cc:224] Handling call
0709 12:24:46.020810 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:46.030909 (+ 10099us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:24:46.030935 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:46.038531 (+  7596us) log.cc:844] Serialized 26 byte log entry
0709 12:24:46.512338 (+473807us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:46.512382 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:46.512456 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:47.049628 (+537172us) spinlock_profiling.cc:243] Waited 45.6 ms on lock 0x7b48002301d8. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9ea8aaa1 00007f5d9ea81b37 00007f5d9ea819ca 00007f5d9eb7926f 00007f5d9eb78f37 00007f5d9eb8d55c 00007f5d9eb8d508 00007f5d9eb8d488 00007f5d9eb8d443 00007f5d9eb8c6ec 00007f5d9dab6a96
0709 12:24:48.050678 (+1001050us) raft_consensus.cc:1685] finished
0709 12:24:48.050700 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:48.055805 (+  5105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47422,"raft.queue_time_us":10179,"raft.run_cpu_time_us":5403,"raft.run_wall_time_us":1018966,"spinlock_wait_cycles":104861056,"thread_start_us":458371,"threads_started":1,"wal-append.queue_time_us":1093233}
W20260709 12:24:48.252761 25726 connection.cc:256] RPC call timeout handler was delayed by -1.2029279019998285s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18620000000000003s for a response
I20260709 12:24:48.211663 29685 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:48.223347 29725 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:48.017057 29629 raft_consensus.cc:740] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:48.182936 29809 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.180642 29666 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:48.260145 26402 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:48.183153 29605 raft_consensus.cc:2749] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:24:48.257489 29811 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.832s	user 0.010s	sys 0.014s
I20260709 12:24:48.169778 29802 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:48.178257 29621 raft_consensus.cc:2749] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:48.256675 26436 raft_consensus.cc:1240] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 7. Current term is 8. Ops: []
W20260709 12:24:48.051369 29698 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.832s	user 0.007s	sys 0.012s
I20260709 12:24:48.057228 29616 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:48.185096 29831 log.cc:927] Time spent T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 12:24:48.185545 29810 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:48.263686 29809 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:48.294603 29767 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:48.258577 29798 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.291376 29812 raft_consensus.cc:2749] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:48.184942 29742 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:48.258394 29673 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:48.296166 29673 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:48.297317 29742 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:48.297685 29814 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:48.298256 29673 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:48.278223 29717 consensus_queue.cc:237] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:48.264096 29819 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.266520 29840 raft_consensus.cc:2749] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:48.260453 29792 consensus_queue.cc:1048] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:24:48.294422 29821 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:48.242189 29827 consensus_queue.cc:237] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:48.295614 29826 consensus_queue.cc:260] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:48.308231 29819 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:48.309065 29826 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:48.262315 29685 consensus_queue.cc:1059] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:24:48.172088 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:48.444681 29685 raft_consensus.cc:3055] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:48.445295 29685 raft_consensus.cc:740] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:48.034538 25649 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:24:48.450314 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 415703us
I20260709 12:24:48.450392 29805 raft_consensus.cc:2749] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:24:48.046612 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 498251us
W20260709 12:24:48.360989 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.250065 25759 raft_consensus.cc:2468] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 11.
I20260709 12:24:48.362624 25686 raft_consensus.cc:2468] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 10.
W20260709 12:24:48.253675 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.466784 29691 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.469247 29809 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:48.231593 25755 raft_consensus.cc:1240] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 13. Current term is 14. Ops: []
I20260709 12:24:48.240870 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:48.474701 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:48.249388 25754 raft_consensus.cc:1275] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:24:48.476213 29750 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:48.192175 25756 raft_consensus.cc:1240] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 11. Current term is 12. Ops: []
I20260709 12:24:48.447248 29685 consensus_queue.cc:260] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:48.369350 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 115843us
I20260709 12:24:48.478400 29685 raft_consensus.cc:3060] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:48.478924 25726 connection.cc:256] RPC call timeout handler was delayed by -1.0331515599996237s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20310000000000003s for a response
W20260709 12:24:48.480218 25726 leader_election.cc:336] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Timed out: RequestConsensusVote RPC to 127.23.245.132:35611 timed out after 1.955s (SENT)
I20260709 12:24:48.480909 26431 raft_consensus.cc:1275] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:24:48.482031 25726 leader_election.cc:336] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Timed out: RequestConsensusVote RPC to 127.23.245.132:35611 timed out after 1.971s (SENT)
W20260709 12:24:48.381031 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 199109us
I20260709 12:24:48.484179 29799 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.484562 25833 raft_consensus.cc:1240] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:24:48.253509 25829 rpcz_store.cc:276] 0709 12:24:46.022989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.023128 (+   139us) service_pool.cc:224] Handling call
0709 12:24:46.023476 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:46.031056 (+  7580us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:46.031086 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:46.031536 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 12:24:46.836637 (+805101us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:46.836682 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:46.836766 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:48.183379 (+1346613us) raft_consensus.cc:1685] finished
0709 12:24:48.183401 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:48.183527 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13365,"raft.queue_time_us":9732,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":37470,"thread_start_us":769719,"threads_started":1,"wal-append.queue_time_us":1178033}
I20260709 12:24:48.485235 29799 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:48.386281 25801 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
W20260709 12:24:48.391058 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 130864us
W20260709 12:24:48.392745 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.258080 26433 raft_consensus.cc:2468] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 11.
I20260709 12:24:48.494962 29819 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:48.496028 26433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36518 (request call id 851) took 1242 ms. Trace:
I20260709 12:24:48.496505 26433 rpcz_store.cc:276] 0709 12:24:47.253865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.778126 (+524261us) service_pool.cc:224] Handling call
0709 12:24:48.495590 (+717464us) spinlock_profiling.cc:243] Waited 266 ms on lock 0x7b54005528d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:48.495804 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":611115392}
I20260709 12:24:48.394063 26438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 995) took 2230 ms. Trace:
I20260709 12:24:48.498242 26438 rpcz_store.cc:276] 0709 12:24:46.163545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.163692 (+   147us) service_pool.cc:224] Handling call
0709 12:24:46.164113 (+   421us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:46.785210 (+621097us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:46.785240 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:46.785772 (+   532us) log.cc:844] Serialized 52 byte log entry
0709 12:24:47.057090 (+271318us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:24:47.135223 (+ 78133us) log.cc:844] Serialized 14 byte log entry
0709 12:24:47.214315 (+ 79092us) log.cc:844] Serialized 14 byte log entry
0709 12:24:47.214501 (+   186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:47.214575 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:47.859955 (+645380us) spinlock_profiling.cc:243] Waited 5.09 ms on lock 0x7b1800436480. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d96a743f3 00007f5d96a767c1 00007f5d96a76779 00007f5d96a76709 00007f5d96a766d1 00007f5d96a759cd 0000000000388634 0000000000388479 00007f5d96a5783a
0709 12:24:47.861066 (+  1111us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b1800436480. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d96a74522 00007f5d96a767c1 00007f5d96a76779 00007f5d96a76709 00007f5d96a766d1 00007f5d96a759cd 0000000000388634 0000000000388479 00007f5d96a5783a
0709 12:24:48.393399 (+532333us) raft_consensus.cc:1685] finished
0709 12:24:48.393455 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:48.393849 (+   394us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":224191,"prepare.queue_time_us":984255,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":454483,"raft.run_cpu_time_us":388,"raft.run_wall_time_us":84307,"spinlock_wait_cycles":42955776,"thread_start_us":907293,"threads_started":3,"wal-append.queue_time_us":777664}
I20260709 12:24:48.395423 26439 raft_consensus.cc:1275] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:24:48.257450 29440 raft_consensus.cc:740] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:48.502763 29316 raft_consensus.cc:3055] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:48.503343 29316 raft_consensus.cc:740] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:48.503409 29440 consensus_queue.cc:260] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:48.505060 29440 raft_consensus.cc:3060] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:48.505306 25679 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51578 (request call id 790) took 2175 ms (client timeout 2139 ms). Trace:
W20260709 12:24:48.505868 25679 rpcz_store.cc:269] 0709 12:24:46.330084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.670200 (+340116us) service_pool.cc:224] Handling call
0709 12:24:48.504710 (+1834510us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54002481d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:48.504991 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2963761408}
I20260709 12:24:48.506317 26402 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:48.259323 29361 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:48.289618 29489 consensus_queue.cc:260] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:48.228205 29538 consensus_queue.cc:260] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:48.431392 29616 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:48.512061 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:48.289511 29698 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.095s	user 0.007s	sys 0.012s
I20260709 12:24:48.512814 29489 raft_consensus.cc:3060] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:48.513289 29698 raft_consensus.cc:697] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 9 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:48.513620 29538 raft_consensus.cc:3060] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:48.514775 29698 consensus_queue.cc:237] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:48.260156 29719 consensus_meta.cc:287] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.700s	user 0.005s	sys 0.005s
I20260709 12:24:48.306769 29725 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:48.298306 29776 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:48.306528 29747 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:48.309329 29810 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:48.433974 29767 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.518077 29361 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:48.518828 29852 raft_consensus.cc:2749] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:24:48.289443 29788 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.387s	user 0.013s	sys 0.010s
W20260709 12:24:48.519681 29788 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.623s	user 0.013s	sys 0.011s
I20260709 12:24:48.520071 26401 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:48.305048 29802 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:48.259248 29836 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:48.522030 29836 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:48.295336 29798 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:48.524911 29836 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:48.443204 29797 raft_consensus.cc:3060] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:48.525447 29798 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:48.527055 29686 raft_consensus.cc:3060] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:48.464341 26430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36518 (request call id 846) took 1211 ms. Trace:
I20260709 12:24:48.528064 26430 rpcz_store.cc:276] 0709 12:24:47.252375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.252540 (+   165us) service_pool.cc:224] Handling call
0709 12:24:48.463863 (+1211323us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b5400746154. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:48.464087 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":499786624}
I20260709 12:24:48.261216 25832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 2746) took 1069 ms. Trace:
I20260709 12:24:48.488059 26431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36518 (request call id 850) took 1229 ms. Trace:
I20260709 12:24:48.529147 26431 rpcz_store.cc:276] 0709 12:24:47.253498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.059556 (+806058us) service_pool.cc:224] Handling call
0709 12:24:48.480064 (+420508us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:48.481423 (+  1359us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.482720 (+  1297us) spinlock_profiling.cc:243] Waited 288 ms on lock 0x7b5400746150. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b608ad 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:48.482915 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":661374208}
I20260709 12:24:48.531272 29810 raft_consensus.cc:2804] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:48.531749 29810 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:48.529165 25832 rpcz_store.cc:276] 0709 12:24:47.191339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.192637 (+  1298us) service_pool.cc:224] Handling call
0709 12:24:47.251340 (+ 58703us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:47.251566 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:47.310349 (+ 58783us) log.cc:844] Serialized 14 byte log entry
0709 12:24:48.260874 (+950525us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:48.260934 (+    60us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:48.260985 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.261052 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:48.261160 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8777,"prepare.queue_time_us":297956,"prepare.run_cpu_time_us":8775,"prepare.run_wall_time_us":59628,"raft.queue_time_us":9306,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":5143,"spinlock_wait_cycles":8112896,"thread_start_us":996919,"threads_started":2,"wal-append.queue_time_us":944143}
W20260709 12:24:48.531512 29667 consensus_queue.cc:1175] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a866ff967d964388a6f0dff7fd43df89" responder_term: 9 status { last_received { term: 7 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 8. Current term is 9. Ops: [8.10-8.10]" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 12:24:48.491017 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 105153us
I20260709 12:24:48.482577 25726 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
W20260709 12:24:48.494195 29695 consensus_meta.cc:287] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 1.238s	user 0.001s	sys 0.017s
I20260709 12:24:48.487471 25759 raft_consensus.cc:2468] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 10.
I20260709 12:24:48.480949 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:48.301302 29670 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:48.537551 25761 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 8.
I20260709 12:24:48.540235 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:48.541431 25686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 2286) took 1015 ms. Trace:
I20260709 12:24:48.467638 29691 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:48.545033 25686 rpcz_store.cc:276] 0709 12:24:47.526154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.526263 (+   109us) service_pool.cc:224] Handling call
0709 12:24:48.541202 (+1014939us) spinlock_profiling.cc:243] Waited 805 ms on lock 0x7b5400264dd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:48.541345 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1852479360}
I20260709 12:24:48.518447 29767 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:48.433194 29629 consensus_queue.cc:260] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:48.520117 29788 raft_consensus.cc:697] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 9 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
W20260709 12:24:48.557824 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 51704.9us
I20260709 12:24:48.532220 29810 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:48.490872 29746 raft_consensus.cc:2749] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:48.431818 29550 consensus_queue.cc:260] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:48.564078 29550 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:24:48.565699 29852 consensus_queue.cc:1175] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6e673265293d4e9a937dc45150aeb1b8" responder_term: 14 status { last_received { term: 13 index: 13 } last_committed_idx: 12 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 13. Current term is 14. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 12:24:48.566973 29813 consensus_queue.cc:1175] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6e673265293d4e9a937dc45150aeb1b8" responder_term: 8 status { last_received { term: 7 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 7. Current term is 8. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:24:48.539487 29695 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:48.569882 25649 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:48.548538 25801 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:48.559197 26402 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:48.560340 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:48.561231 25832 raft_consensus.cc:1240] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 11. Current term is 12. Ops: [9.4-11.5]
I20260709 12:24:48.561522 29767 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:48.571102 25649 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:24:48.562523 26432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36518 (request call id 847) took 1306 ms. Trace:
W20260709 12:24:48.596755 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.543496 25800 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:48.592401 26432 rpcz_store.cc:276] 0709 12:24:47.252643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.503723 (+251080us) service_pool.cc:224] Handling call
0709 12:24:48.533624 (+1029901us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x7b540078df54. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:48.559049 (+ 25425us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":559817472}
I20260709 12:24:48.596728 29836 raft_consensus.cc:2749] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:24:48.616227 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 72974.4us
W20260709 12:24:48.635727 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 153815us
I20260709 12:24:48.637830 29695 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:48.641119 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 82137.8us
I20260709 12:24:48.562618 29629 raft_consensus.cc:3060] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:48.645766 29843 log.cc:927] Time spent T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.354s	user 0.004s	sys 0.000s
I20260709 12:24:48.646461 29776 raft_consensus.cc:3060] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:48.648435 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 77511.9us
I20260709 12:24:48.544585 29696 consensus_queue.cc:1048] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.112s
W20260709 12:24:48.664389 29832 log.cc:927] Time spent T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.762s	user 0.003s	sys 0.013s
I20260709 12:24:48.612025 29755 raft_consensus.cc:2804] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:24:48.669349 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 72077.3us
W20260709 12:24:48.672828 25726 leader_election.cc:336] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Timed out: RequestConsensusVote RPC to 127.23.245.132:35611 timed out after 1.979s (SENT)
I20260709 12:24:48.673620 29813 consensus_queue.cc:1059] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:48.682858 26402 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:48.683934 25726 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
W20260709 12:24:48.682907 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 134568us
I20260709 12:24:48.680630 29755 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:48.678476 29767 raft_consensus.cc:2804] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:48.704330 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:48.700366 25649 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:48.681257 29852 consensus_queue.cc:1048] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:24:48.696250 29798 raft_consensus.cc:2749] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:48.700570 29799 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:48.696270 29755 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:48.690117 29813 raft_consensus.cc:3055] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:24:48.710104 25726 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:48.697364 29767 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:48.713261 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.715328 29127 raft_consensus.cc:2749] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:48.705724 29696 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:48.723600 25759 raft_consensus.cc:1240] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:48.721467 29793 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.719058 29767 raft_consensus.cc:3060] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:48.730826 29854 log.cc:927] Time spent T 00000000000000000000000000000000 P 496fd6924b624e77b03ccfd15653d47b: Append to log took a long time: real 0.379s	user 0.005s	sys 0.000s
I20260709 12:24:48.720824 29725 raft_consensus.cc:2804] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:48.723825 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:48.729611 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:48.724881 29696 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:48.716567 29813 raft_consensus.cc:740] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:48.737015 29747 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.724092 29745 raft_consensus.cc:2749] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:48.742949 26439 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 10.
I20260709 12:24:48.735276 29691 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:48.733338 29698 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:48.742569 29836 raft_consensus.cc:2749] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:48.746264 29793 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:48.755817 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.745518 29725 raft_consensus.cc:697] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 11 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:48.715947 29316 consensus_queue.cc:260] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:48.762766 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:48.748095 29799 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.766136 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:48.733603 29788 consensus_queue.cc:237] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:48.776752 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:48.776994 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.776826 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:48.777580 29127 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:48.777936 25834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44218 (request call id 1652) took 1511 ms. Trace:
I20260709 12:24:48.773707 26402 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
W20260709 12:24:48.783933 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 78372.4us
I20260709 12:24:48.790337 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:48.760432 29747 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:48.794206 26432 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 10.
I20260709 12:24:48.800269 25754 raft_consensus.cc:2468] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 9.
I20260709 12:24:48.812141 29812 raft_consensus.cc:2749] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:48.818663 25761 raft_consensus.cc:2468] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 7.
I20260709 12:24:48.800802 29799 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:48.824973 29725 consensus_queue.cc:237] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:48.826314 29799 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:48.808841 29813 consensus_queue.cc:260] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:48.830092 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:48.830677 29813 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:48.830816 25832 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 16.
I20260709 12:24:48.783943 25834 rpcz_store.cc:276] 0709 12:24:47.266804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.267292 (+   488us) service_pool.cc:224] Handling call
0709 12:24:47.294709 (+ 27417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:47.425110 (+130401us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:47.425142 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:47.464835 (+ 39693us) log.cc:844] Serialized 26 byte log entry
0709 12:24:47.715432 (+250597us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:47.715470 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:47.715532 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:48.663693 (+948161us) spinlock_profiling.cc:243] Waited 10.9 ms on lock 0x7b24001db6b8. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d968fa9c4 00007f5d968f8acb 00007f5d96ab3dc9 00007f5d96ab3a55 00007f5d96ab309d 00007f5d996e510e 00007f5d996fc88c 00007f5d996fbbb6 00007f5d996fb7d8 00007f5d99705221
0709 12:24:48.765364 (+101671us) raft_consensus.cc:1685] finished
0709 12:24:48.765386 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:48.777680 (+ 12294us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":129967,"raft.queue_time_us":215998,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":8310,"spinlock_wait_cycles":24978816,"thread_start_us":193228,"threads_started":1,"wal-append.queue_time_us":404338}
I20260709 12:24:48.836428 29696 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:48.840256 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 83493us
I20260709 12:24:48.844653 25762 raft_consensus.cc:1240] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 11. Current term is 12. Ops: []
I20260709 12:24:48.840234 25759 raft_consensus.cc:1240] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:24:48.822665 29691 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.793938 29127 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:48.868057 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:48.868816 25757 raft_consensus.cc:3060] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:48.869335 29127 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:48.872134 26437 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 14.
I20260709 12:24:48.878455 29316 raft_consensus.cc:3060] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:48.880028 29857 log.cc:927] Time spent T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 12:24:48.880123 29810 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:48.882362 25726 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:48.882937 29810 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:48.883363 29440 raft_consensus.cc:2804] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:48.883848 29440 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:48.884233 29440 raft_consensus.cc:3060] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:48.886497 26437 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36518 (request call id 861) took 1462 ms (client timeout 1635 ms). Trace:
W20260709 12:24:48.886950 26437 rpcz_store.cc:269] 0709 12:24:47.424554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.434252 (+  9698us) service_pool.cc:224] Handling call
0709 12:24:48.886233 (+1451981us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54005a8554. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:48.886406 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3018002176}
I20260709 12:24:48.892606 25757 raft_consensus.cc:2468] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 11.
I20260709 12:24:48.894785 26402 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:48.894873 29810 consensus_queue.cc:1059] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:48.892743 29440 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:48.895699 29127 raft_consensus.cc:3060] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:48.895946 29810 raft_consensus.cc:3055] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:48.896406 29810 raft_consensus.cc:740] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:48.897270 26402 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:48.897457 29810 consensus_queue.cc:260] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:48.898571 29440 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:48.907900 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:48.898932 29810 raft_consensus.cc:3060] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:48.900230 29550 raft_consensus.cc:2804] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:48.899549 26402 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:48.903497 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:24:48.910133 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.911269 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:48.917623 26402 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:24:48.918861 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:48.921456 25800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.927443 26439 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 16.
I20260709 12:24:48.937857 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:24:48.939731 25800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.926084 29685 raft_consensus.cc:2804] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:48.926301 29852 raft_consensus.cc:2749] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:48.923323 29550 raft_consensus.cc:697] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 8 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:48.949056 25754 raft_consensus.cc:1240] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:48.949088 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:48.950801 25755 raft_consensus.cc:2393] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 11: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:48.951869 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:48.952605 25754 raft_consensus.cc:2468] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 10.
I20260709 12:24:48.953171 29671 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.953843 29671 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:48.954579 25650 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:48.957578 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:48.945176 29685 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:48.935516 29316 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.985730 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:48.984781 25762 raft_consensus.cc:2468] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 8.
W20260709 12:24:48.959851 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.955998 29686 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:48.987507 25726 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:48.990820 29797 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.991278 29316 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:48.991420 29797 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:48.992180 29821 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.992830 29821 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:48.993449 29797 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:48.993633 29670 raft_consensus.cc:2749] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:48.988773 29685 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:48.994655 29747 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:48.993461 29316 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:48.994995 29821 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:48.926136 29691 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:49.001950 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:49.002648 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:49.003854 25684 raft_consensus.cc:1240] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 9 LEADER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 12:24:49.004290 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:49.003579 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:49.004704 25686 raft_consensus.cc:1275] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:24:49.005695 25679 raft_consensus.cc:1240] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:24:49.008301 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:49.046509 25677 raft_consensus.cc:2468] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 8.
I20260709 12:24:49.009217 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:49.008212 25757 raft_consensus.cc:2468] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 8.
I20260709 12:24:49.011546 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:49.012259 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:49.012528 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.013202 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:49.008168 29420 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.013782 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:49.012455 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:49.019157 29802 consensus_queue.cc:1059] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:49.020155 29793 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:48.990017 29826 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.021857 29821 consensus_queue.cc:1059] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:49.022811 25754 raft_consensus.cc:1275] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:24:49.024834 29776 raft_consensus.cc:2749] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:49.025861 25650 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:49.007797 29755 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:49.030622 25755 raft_consensus.cc:1275] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:24:49.031162 29698 raft_consensus.cc:2749] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:48.989388 29805 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.032058 29686 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:49.033924 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:49.035802 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:49.036156 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:49.021901 29767 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:49.037508 26433 raft_consensus.cc:2393] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 11: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:49.039110 25801 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:49.040428 29842 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:49.041615 29550 consensus_queue.cc:237] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:49.042851 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.053637 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:49.051748 25682 raft_consensus.cc:2468] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 11.
I20260709 12:24:49.061817 25685 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:49.061934 25829 raft_consensus.cc:2393] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 8: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:49.062036 29691 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:49.062516 25649 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:49.062943 29821 raft_consensus.cc:3055] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:24:49.086503 29821 raft_consensus.cc:740] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:49.064100 25680 raft_consensus.cc:2468] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 9.
I20260709 12:24:49.065131 25679 raft_consensus.cc:1275] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:24:49.065806 26435 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36518 (request call id 845) took 1813 ms (client timeout 1743 ms). Trace:
I20260709 12:24:49.066346 29717 raft_consensus.cc:3055] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:24:49.067430 25833 raft_consensus.cc:2468] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 9.
W20260709 12:24:49.087960 26435 rpcz_store.cc:269] 0709 12:24:47.252050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.254679 (+  2629us) service_pool.cc:224] Handling call
0709 12:24:49.065453 (+1810774us) spinlock_profiling.cc:243] Waited 1.74 s on lock 0x7b54002e8bd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:49.065612 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3999379200}
I20260709 12:24:49.068436 29732 raft_consensus.cc:2804] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:24:49.068707 29755 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:49.069165 29538 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:49.069859 29826 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:49.072201 29670 consensus_queue.cc:1059] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:24:49.073566 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 125783us
I20260709 12:24:49.075176 25832 raft_consensus.cc:2468] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 12.
I20260709 12:24:49.077155 26432 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:49.078544 29747 raft_consensus.cc:2804] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:24:49.085505 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:24:49.085682 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 140853us
I20260709 12:24:49.058789 29127 raft_consensus.cc:2749] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:49.082489 25836 raft_consensus.cc:2468] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 7.
I20260709 12:24:49.068001 29827 consensus_queue.cc:1059] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:49.088937 26401 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:49.088006 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:49.039985 29671 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:49.091377 29717 raft_consensus.cc:740] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:49.097136 29732 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:49.099547 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:49.097476 26439 raft_consensus.cc:2468] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 9.
I20260709 12:24:49.098181 25683 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 6.
I20260709 12:24:49.099339 25726 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:49.063589 29420 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:49.108990 25649 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:49.109741 25649 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:49.107313 26438 raft_consensus.cc:2468] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 9.
I20260709 12:24:49.115029 29788 raft_consensus.cc:2804] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:49.115419 25679 raft_consensus.cc:1240] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 9 LEADER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:49.094357 29725 raft_consensus.cc:2749] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:49.116639 25834 raft_consensus.cc:2468] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 9.
I20260709 12:24:49.113449 25755 raft_consensus.cc:2468] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 8.
I20260709 12:24:49.123361 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:49.117754 29788 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:49.124841 29797 raft_consensus.cc:2804] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:24:49.120568 29776 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:49.125475 29797 raft_consensus.cc:697] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:49.125996 29776 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:49.126621 29797 consensus_queue.cc:237] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:49.111675 29732 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:49.114254 29698 raft_consensus.cc:2749] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:49.114368 29671 raft_consensus.cc:2804] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:49.130885 25649 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:49.111294 29747 raft_consensus.cc:697] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:49.092069 29805 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:49.140436 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:49.118687 29755 raft_consensus.cc:2804] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:49.142870 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:49.144150 25755 raft_consensus.cc:1240] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:24:49.140199 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:49.146627 26435 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:49.128748 29788 raft_consensus.cc:3060] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:49.147380 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:49.145398 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:49.151779 25832 raft_consensus.cc:2468] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 8.
I20260709 12:24:49.152860 25829 raft_consensus.cc:1275] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:24:49.154417 25833 raft_consensus.cc:1240] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:49.120960 29538 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:49.156849 29361 consensus_queue.cc:1048] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:49.157936 25835 raft_consensus.cc:1275] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 10. (term mismatch)
I20260709 12:24:49.158099 25837 raft_consensus.cc:1240] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 13. Current term is 14. Ops: [13.13-13.13]
I20260709 12:24:49.142962 29852 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:49.158540 29538 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:49.159227 25757 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:49.158306 25835 pending_rounds.cc:85] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a: Aborting all ops after (but not including) 9
I20260709 12:24:49.141630 29671 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:49.155175 29812 consensus_queue.cc:1059] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 12:24:49.158911 29852 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:49.151077 29316 consensus_queue.cc:1048] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 12:24:49.165012 29812 raft_consensus.cc:3055] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:49.165349 29812 raft_consensus.cc:740] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:49.166210 29852 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:49.166325 29812 consensus_queue.cc:260] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:49.164366 25831 raft_consensus.cc:1275] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:24:49.145460 29755 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:49.159997 25835 pending_rounds.cc:107] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a: Aborting uncommitted NO_OP operation due to leader change: 8.10
I20260709 12:24:49.169581 25835 raft_consensus.cc:2889] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:49.170269 25834 raft_consensus.cc:2393] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 10: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:49.118391 29842 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:49.174124 25650 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:49.171758 26439 raft_consensus.cc:1275] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:24:49.163199 29671 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:49.176352 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:49.167665 29812 raft_consensus.cc:3060] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:49.162176 29776 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:49.180233 25755 raft_consensus.cc:2410] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:24:49.181026 29694 consensus_queue.cc:1048] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:24:49.181520 29536 raft_consensus.cc:2804] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:49.181951 29536 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:49.182289 29536 raft_consensus.cc:3060] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:49.183151 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:49.171756 29755 raft_consensus.cc:3060] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:49.146088 29717 consensus_queue.cc:260] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:49.177048 29861 log.cc:927] Time spent T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:24:49.167686 29420 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:49.188627 26432 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 12.
I20260709 12:24:49.183746 25801 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:49.192378 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:49.188258 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:49.177716 29767 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:49.195701 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:49.192378 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:49.195006 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.197074 25757 raft_consensus.cc:2468] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 12.
I20260709 12:24:49.198103 29805 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:49.198339 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:49.198966 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:49.199347 29793 raft_consensus.cc:2804] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:49.199728 25754 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:24:49.179694 29538 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.201651 29691 raft_consensus.cc:2749] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:49.228299 29747 consensus_queue.cc:237] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:49.230916 25834 raft_consensus.cc:2468] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 11.
I20260709 12:24:49.231312 25758 raft_consensus.cc:2468] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 10.
I20260709 12:24:49.231731 29793 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:49.232270 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:24:49.236016 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 49668.6us
I20260709 12:24:49.236111 25801 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:49.243609 25836 raft_consensus.cc:2410] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:24:49.247527 26401 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:24:49.248636 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.238782 29793 raft_consensus.cc:3060] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:49.198917 29686 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:49.256871 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 55514.5us
I20260709 12:24:49.258661 25649 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:49.257172 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:49.203660 29826 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:49.264820 25763 raft_consensus.cc:2393] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 9: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:49.274325 25685 raft_consensus.cc:2468] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 12.
I20260709 12:24:49.262559 29810 raft_consensus.cc:2804] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:24:49.277074 29686 raft_consensus.cc:2804] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:49.296998 29686 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:49.297346 29864 log.cc:927] Time spent T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 12:24:49.297436 29686 raft_consensus.cc:3060] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:49.282886 29717 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:49.334762 25834 raft_consensus.cc:1275] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:24:49.335497 29686 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:49.336102 29863 log.cc:927] Time spent T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 12:24:49.337489 29842 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:49.339128 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
W20260709 12:24:49.340024 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.277208 29316 raft_consensus.cc:3060] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:49.263726 29538 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:49.342563 29538 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:49.339838 25763 raft_consensus.cc:3060] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:49.344805 29686 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:49.352926 29821 consensus_queue.cc:260] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:49.354594 29821 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:49.356086 29316 raft_consensus.cc:2749] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:49.356536 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:49.358278 25763 raft_consensus.cc:2468] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 11.
I20260709 12:24:49.359470 25649 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:49.365773 26435 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 11.
W20260709 12:24:49.367609 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 100693us
W20260709 12:24:49.371224 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 43812us
I20260709 12:24:49.373106 25754 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 11.
I20260709 12:24:49.374449 25649 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:24:49.380177 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 99854.4us
I20260709 12:24:49.375612 25650 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:49.363063 29810 raft_consensus.cc:697] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 12 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:49.392513 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:49.375082 29686 raft_consensus.cc:2804] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:49.403164 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:49.405115 29540 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.405501 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:49.387308 29538 raft_consensus.cc:2804] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:49.405423 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:49.406508 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:49.411906 26435 raft_consensus.cc:2410] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:24:49.413424 25650 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:49.414722 25834 raft_consensus.cc:1275] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:24:49.402747 29670 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:49.384990 29685 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:49.419267 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:49.405740 29540 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:49.424479 25760 raft_consensus.cc:2393] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 8: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
W20260709 12:24:49.420893 26402 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.421469 25650 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
W20260709 12:24:49.428048 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.425066 29691 consensus_queue.cc:1048] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 12:24:49.430727 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:49.407506 29686 raft_consensus.cc:697] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 11 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:49.415642 29538 raft_consensus.cc:697] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 11 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:49.450760 26437 raft_consensus.cc:2393] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 10: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:49.421836 29802 raft_consensus.cc:2804] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:49.464709 25829 raft_consensus.cc:1275] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:24:49.466126 29865 log.cc:927] Time spent T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:24:49.473251 29732 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:49.475500 29732 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:49.478861 25801 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:49.476624 29691 raft_consensus.cc:2804] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:24:49.477274 29802 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:49.496310 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:49.497360 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 75962.8us
I20260709 12:24:49.499835 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:49.508392 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:49.508507 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:49.508988 29540 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:49.510289 26433 raft_consensus.cc:1275] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:24:49.512071 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:49.512777 25835 raft_consensus.cc:2468] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 6.
I20260709 12:24:49.514398 29686 consensus_queue.cc:237] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:49.515241 29540 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.515815 29540 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:49.518980 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 86875.9us
I20260709 12:24:49.520509 25801 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:49.521687 29540 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:49.522368 29813 raft_consensus.cc:2804] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:49.522799 29813 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:49.522979 25801 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:49.523195 29813 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:49.524466 29725 raft_consensus.cc:2804] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:49.524842 29725 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:49.525142 29725 raft_consensus.cc:3060] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:49.526911 29755 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:49.528353 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:49.529157 25755 raft_consensus.cc:2393] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 11: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:49.530550 29536 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:49.490422 29420 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.532275 29420 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:49.532941 29725 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:49.534126 29685 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:49.511812 29793 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:49.534885 29725 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:49.534972 29538 consensus_queue.cc:237] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:49.535861 29813 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:49.536633 29793 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:49.537810 29813 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:49.492209 29316 raft_consensus.cc:2749] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:49.541226 29671 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:49.543200 29671 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:49.488544 29810 consensus_queue.cc:237] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:49.547331 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:49.548686 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:49.549909 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:49.551044 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:49.552796 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:49.555619 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:49.560272 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:49.560806 25755 raft_consensus.cc:3060] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:49.502307 29691 raft_consensus.cc:697] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 12 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:49.563151 29691 consensus_queue.cc:237] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:49.564255 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:49.564817 25761 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:49.568989 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:49.569801 25829 raft_consensus.cc:2468] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 8.
I20260709 12:24:49.496536 29802 raft_consensus.cc:3060] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:49.573859 25755 raft_consensus.cc:2468] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 9.
I20260709 12:24:49.574757 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:49.543392 29755 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:49.577906 25649 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:49.580693 25761 raft_consensus.cc:2468] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 11.
I20260709 12:24:49.581307 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:49.588312 25726 leader_election.cc:336] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Timed out: RequestConsensusVote RPC to 127.23.245.132:35611 timed out after 1.507s (SENT)
I20260709 12:24:49.588903 25726 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:49.606374 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:49.618407 25760 raft_consensus.cc:2393] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 11: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:49.621089 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:49.624284 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:49.626708 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:49.627491 25830 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:49.619568 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:49.632917 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:49.633775 26437 raft_consensus.cc:2468] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 10.
I20260709 12:24:49.634862 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:49.635677 26439 raft_consensus.cc:3060] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:49.628384 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:49.637777 26431 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:24:49.644559 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:49.602572 29805 raft_consensus.cc:2804] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:24:49.646564 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 169667us
I20260709 12:24:49.643514 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:49.656561 25682 raft_consensus.cc:2468] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 12.
W20260709 12:24:49.664143 26402 leader_election.cc:336] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 2.139s (SENT)
W20260709 12:24:49.665194 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 93306.5us
W20260709 12:24:49.665472 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.667199 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:49.668011 25829 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:49.640486 29440 raft_consensus.cc:2749] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:49.681557 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:49.646848 29732 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:49.689791 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:49.690671 26435 raft_consensus.cc:3060] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:49.621531 29788 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:49.667155 29316 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:49.718339 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:49.725378 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 61264.8us
W20260709 12:24:49.726424 26402 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:49.726753 26402 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.728761 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:49.732072 25830 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 17.
I20260709 12:24:49.734508 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:49.738436 26431 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 17.
I20260709 12:24:49.738924 26439 raft_consensus.cc:2468] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 11.
W20260709 12:24:49.737316 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 134290us
I20260709 12:24:49.740597 25649 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:49.727761 26402 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:49.772301 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:49.772913 26437 raft_consensus.cc:3060] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:24:49.773198 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 88573us
I20260709 12:24:49.776693 25760 raft_consensus.cc:1275] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:24:49.779960 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:49.782701 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
W20260709 12:24:49.786252 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 44467.8us
I20260709 12:24:49.793835 26435 raft_consensus.cc:2468] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 10.
I20260709 12:24:49.812431 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:49.788738 25801 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
W20260709 12:24:49.782060 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 163190us
I20260709 12:24:49.814478 25683 raft_consensus.cc:2393] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 17: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:49.812654 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:49.815162 25650 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:49.818732 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:49.733744 29732 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:49.821668 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:49.737035 29316 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:49.822238 25685 raft_consensus.cc:1240] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 12:24:49.771708 29813 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:49.822170 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:49.830371 25682 raft_consensus.cc:1240] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 11. Current term is 12. Ops: [11.8-11.8]
W20260709 12:24:49.829911 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 102243us
I20260709 12:24:49.786962 25800 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:49.789314 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:49.785918 29776 raft_consensus.cc:2749] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:49.837517 26439 raft_consensus.cc:1240] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 11. Current term is 12. Ops: []
I20260709 12:24:49.838219 26402 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:49.823853 25677 raft_consensus.cc:2468] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 7.
I20260709 12:24:49.778903 29686 raft_consensus.cc:2804] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:49.829317 25650 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:49.832690 25755 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:49.770792 29788 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:49.842836 26437 raft_consensus.cc:2468] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 11.
I20260709 12:24:49.788719 29852 consensus_queue.cc:1048] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 12:24:49.853786 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:49.854410 25761 raft_consensus.cc:3060] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:24:49.822431 29805 raft_consensus.cc:697] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 9 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:49.838554 29826 raft_consensus.cc:2749] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:49.857102 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:49.860199 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
W20260709 12:24:49.862303 29873 log.cc:927] Time spent T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
I20260709 12:24:49.863646 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:49.875895 25677 raft_consensus.cc:3060] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:49.882079 29826 raft_consensus.cc:2804] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:49.882536 29826 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:49.882941 29826 raft_consensus.cc:3060] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:49.884828 25755 raft_consensus.cc:1275] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:24:49.887079 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:49.887864 25755 raft_consensus.cc:2410] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 13 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:24:49.851717 29810 raft_consensus.cc:2749] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:49.850098 29536 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:49.893029 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:49.875450 29686 raft_consensus.cc:697] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 11 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:49.897287 29776 consensus_queue.cc:1048] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:49.898891 29805 consensus_queue.cc:237] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:49.899459 29316 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:49.837303 29813 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:49.904928 29670 raft_consensus.cc:2749] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:49.880069 29691 raft_consensus.cc:2804] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:24:49.912045 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 73915.7us
W20260709 12:24:49.913389 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 126496us
W20260709 12:24:49.913183 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 83932.7us
I20260709 12:24:49.918645 25801 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:49.918326 25800 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:49.938445 25829 raft_consensus.cc:2468] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 12.
I20260709 12:24:49.939352 25761 raft_consensus.cc:2468] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 10.
I20260709 12:24:49.911654 29827 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.940514 25649 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:49.911767 29420 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:49.920518 29691 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:49.906351 29793 consensus_queue.cc:1059] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:24:49.906126 29686 consensus_queue.cc:237] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:49.945125 29316 raft_consensus.cc:2804] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:49.946825 29691 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:49.949717 29725 raft_consensus.cc:2804] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:49.941184 29670 consensus_queue.cc:1048] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:24:49.979243 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:49.980027 25761 raft_consensus.cc:2393] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 8: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:49.983808 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:49.948599 29717 consensus_queue.cc:1048] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:24:49.997669 25800 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:49.966096 29316 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:50.001236 25681 raft_consensus.cc:1240] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 12 LEADER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 11. Current term is 12. Ops: []
I20260709 12:24:50.009299 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:50.012034 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:50.012696 26435 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 10.
I20260709 12:24:49.976205 29725 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:49.973165 29894 raft_consensus.cc:2804] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:24:50.014871 25726 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.245.132:35611 timed out after 2.031s (SENT) [suppressed 18 similar messages]
I20260709 12:24:49.954295 29827 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:50.021327 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 83320.3us
I20260709 12:24:49.976575 29810 consensus_queue.cc:1048] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:24:50.035169 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:50.038461 26431 raft_consensus.cc:2410] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:24:50.024690 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:50.039463 25761 raft_consensus.cc:1275] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:24:50.014189 29316 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:50.019644 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:24:50.020061 29821 consensus_meta.cc:287] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.665s	user 0.009s	sys 0.005s
I20260709 12:24:50.018834 29725 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:50.046378 25726 leader_election.cc:336] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Timed out: RequestConsensusVote RPC to 127.23.245.132:35611 timed out after 2.197s (SENT)
I20260709 12:24:50.030182 29897 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.023983 29732 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:50.069643 26435 raft_consensus.cc:2376] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 8. Re-sending same reply.
I20260709 12:24:50.046907 25726 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:50.070856 26437 raft_consensus.cc:1275] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:24:50.075330 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 44531us
I20260709 12:24:50.037257 29694 consensus_queue.cc:1048] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:24:50.081012 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:50.081379 29316 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:50.081738 26431 raft_consensus.cc:2368] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 10. Current term is 11.
I20260709 12:24:50.076385 29797 raft_consensus.cc:2749] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:50.083053 25677 raft_consensus.cc:2468] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 9.
I20260709 12:24:50.083941 29316 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:50.085865 29316 raft_consensus.cc:2804] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:50.086340 29316 raft_consensus.cc:697] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 11 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:50.087481 29902 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.087316 29316 consensus_queue.cc:237] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:50.088040 29902 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:50.090155 29902 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:50.091948 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:50.092985 25650 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:24:50.101166 29890 log.cc:927] Time spent T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
W20260709 12:24:50.102205 29882 log.cc:927] Time spent T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 12:24:50.066900 29897 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:50.091257 29813 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:24:50.118086 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:50.121940 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.091094 29884 raft_consensus.cc:2764] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:24:50.129419 25650 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:50.145288 25650 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:50.172878 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:50.173964 25677 raft_consensus.cc:2393] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 12: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:50.176205 25801 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
W20260709 12:24:50.170806 29802 consensus_meta.cc:287] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.598s	user 0.009s	sys 0.001s
I20260709 12:24:50.182065 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:50.182824 26431 raft_consensus.cc:2376] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 11. Re-sending same reply.
I20260709 12:24:50.183856 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:50.184454 25681 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:24:50.177757 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:50.180593 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:50.178537 25650 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:50.186452 25650 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:50.092497 29536 consensus_queue.cc:1048] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.084s
I20260709 12:24:50.173718 29732 raft_consensus.cc:2749] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:50.188927 25650 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:50.194628 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:50.193539 26439 raft_consensus.cc:2393] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 11: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:50.195394 26437 raft_consensus.cc:2393] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 11: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:50.195423 25650 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:24:50.192708 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 195146us
I20260709 12:24:50.180016 29793 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.184911 29717 raft_consensus.cc:2749] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:50.177492 29903 raft_consensus.cc:2749] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:50.208986 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:50.209789 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:50.213887 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:50.195014 29883 raft_consensus.cc:2804] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:50.214959 25682 raft_consensus.cc:1240] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 7. Current term is 8. Ops: []
W20260709 12:24:50.216324 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 177483us
I20260709 12:24:50.194638 29902 raft_consensus.cc:2749] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:50.213938 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:50.218657 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 46548.4us
I20260709 12:24:50.219753 25685 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 8.
I20260709 12:24:50.220757 25801 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:50.221791 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:50.205957 29538 raft_consensus.cc:2804] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:24:50.223732 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:50.224555 26439 raft_consensus.cc:2410] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:24:50.223928 25684 raft_consensus.cc:2468] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 9.
I20260709 12:24:50.218231 29793 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:50.230720 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:50.229106 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:50.232148 29827 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:50.219614 29883 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:50.236167 29883 raft_consensus.cc:3060] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:50.238488 29888 log.cc:927] Time spent T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.341s	user 0.000s	sys 0.002s
I20260709 12:24:50.238997 25681 raft_consensus.cc:2468] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 9.
W20260709 12:24:50.240566 29893 log.cc:927] Time spent T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
I20260709 12:24:50.242064 29793 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:50.192452 29802 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:50.245411 25726 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
W20260709 12:24:50.242259 29880 log.cc:927] Time spent T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.345s	user 0.000s	sys 0.001s
I20260709 12:24:50.252483 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:50.255704 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:50.255981 29909 raft_consensus.cc:3060] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:50.256428 25686 raft_consensus.cc:2468] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 11.
I20260709 12:24:50.257725 25685 raft_consensus.cc:1240] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:24:50.258205 29810 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.258510 26402 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:50.224836 29685 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.224519 29797 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.258687 29810 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:50.245260 29694 raft_consensus.cc:2764] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 12:24:50.271240 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 50539.9us
I20260709 12:24:50.278376 25801 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:50.275250 25650 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:50.272013 29799 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.267942 29776 raft_consensus.cc:2804] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:50.277650 25680 raft_consensus.cc:2393] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 10: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:50.262286 29538 raft_consensus.cc:697] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 17 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:50.283555 25801 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:50.276592 29897 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:50.268955 29685 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:50.279155 29671 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.279863 29793 raft_consensus.cc:2749] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:24:50.322194 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:50.318455 25801 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:50.267768 29788 consensus_queue.cc:1059] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:24:50.322767 25829 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:50.294076 29776 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:50.325646 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:50.326041 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 102995us
I20260709 12:24:50.271574 29797 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:50.335139 25834 raft_consensus.cc:2468] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 8.
I20260709 12:24:50.327131 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:50.335810 25830 raft_consensus.cc:3060] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:50.316936 29671 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:50.336789 29900 consensus_queue.cc:1059] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 12:24:50.319553 25685 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3767151a5d4345659810a40ea7f44873"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
mode: GRACEFUL
new_leader_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:49108
I20260709 12:24:50.337699 25685 raft_consensus.cc:606] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Received request to transfer leadership to TS 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:50.338027 25685 raft_consensus.cc:614] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:50.338635 29671 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:50.282275 29826 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:50.280758 29691 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:50.334676 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:50.281205 29827 consensus_queue.cc:1048] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 12:24:50.344573 25830 raft_consensus.cc:2468] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 9.
I20260709 12:24:50.284992 29805 raft_consensus.cc:2749] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:50.319456 29898 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.315743 29911 raft_consensus.cc:2804] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:50.285596 29907 raft_consensus.cc:2749] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:50.355077 25726 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:50.290458 29725 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:50.300436 29799 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:50.360548 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 102097us
W20260709 12:24:50.360307 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 136201us
I20260709 12:24:50.362804 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:50.374761 25830 raft_consensus.cc:2468] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 9.
I20260709 12:24:50.365289 25650 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:50.335507 29776 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:50.380115 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:24:50.380050 29538 consensus_queue.cc:237] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:50.382071 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:50.383217 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:50.384229 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:50.384559 29717 raft_consensus.cc:2804] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:50.384980 29717 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:50.385144 25833 raft_consensus.cc:2410] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:24:50.385367 29717 raft_consensus.cc:3060] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:50.385588 29685 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:50.390446 25650 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:50.373984 26402 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:50.372223 25829 raft_consensus.cc:2468] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 11.
I20260709 12:24:50.366020 25835 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 12.
I20260709 12:24:50.373422 25682 raft_consensus.cc:2393] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 10: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:50.377295 29799 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:50.401162 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:24:50.404664 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 68442.4us
I20260709 12:24:50.406191 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:50.407097 25755 raft_consensus.cc:2368] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 8. Current term is 9.
I20260709 12:24:50.410269 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:50.412977 25761 raft_consensus.cc:2368] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 10. Current term is 11.
I20260709 12:24:50.411592 25650 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:50.417219 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:50.392807 29911 raft_consensus.cc:697] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 10 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:50.404296 29805 raft_consensus.cc:2804] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:50.367173 29898 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:50.449795 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:50.409128 29921 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.456403 25761 raft_consensus.cc:2393] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 10: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:50.408515 29799 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:50.395771 29916 raft_consensus.cc:2749] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:50.460457 29810 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:50.460949 29916 raft_consensus.cc:2749] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:24:50.461781 29810 raft_consensus.cc:2804] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:50.462246 29810 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:50.460489 29799 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:50.462669 29810 raft_consensus.cc:3060] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:50.463984 29909 raft_consensus.cc:2749] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:50.464233 29799 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:50.464958 29921 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:50.467242 29921 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:50.452709 29797 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:50.419961 29902 raft_consensus.cc:2804] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:24:50.478786 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:50.480804 25801 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:50.483559 25754 raft_consensus.cc:2468] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 9.
I20260709 12:24:50.482959 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:50.485381 25761 raft_consensus.cc:2468] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 12.
I20260709 12:24:50.467762 29921 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.488626 25685 raft_consensus.cc:1275] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:50.489368 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:50.489874 25686 raft_consensus.cc:1240] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 12:24:50.490468 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:50.490758 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:50.499610 25754 raft_consensus.cc:2468] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 11.
I20260709 12:24:50.499666 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:50.449924 29805 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:50.503860 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:50.504683 25755 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:50.500897 26438 raft_consensus.cc:2410] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:24:50.482947 29902 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:50.520774 29914 log.cc:927] Time spent T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:24:50.478462 29917 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.525159 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:24:50.522238 29912 log.cc:927] Time spent T 00000000000000000000000000000000 P 496fd6924b624e77b03ccfd15653d47b: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
I20260709 12:24:50.529829 25755 raft_consensus.cc:2468] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 9.
I20260709 12:24:50.529974 25760 raft_consensus.cc:1275] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:24:50.508683 29805 raft_consensus.cc:3060] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:50.526757 29894 raft_consensus.cc:697] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 10 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
W20260709 12:24:50.555183 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 181262us
I20260709 12:24:50.556854 26402 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:50.522882 29902 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:50.568679 26402 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:50.567663 26401 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:50.527653 29913 raft_consensus.cc:2749] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:50.571792 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:50.584154 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:50.584942 26433 raft_consensus.cc:3060] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:50.512915 29921 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:50.589818 29755 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.590327 29755 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:50.552881 29717 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:50.592310 29755 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:50.593923 29717 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:50.596855 29922 raft_consensus.cc:2955] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 8 LEADER]: Committing config change with OpId 6.8: config changed from index 6 to 8, VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:24:50.599201 26433 raft_consensus.cc:2468] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 10.
I20260709 12:24:50.599961 25683 raft_consensus.cc:2468] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 8.
I20260709 12:24:50.601414 29898 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:50.602140 29909 raft_consensus.cc:2804] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:50.608107 26435 raft_consensus.cc:1275] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 12:24:50.608657 26435 pending_rounds.cc:85] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89: Aborting all ops after (but not including) 6
I20260709 12:24:50.608951 26435 pending_rounds.cc:107] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 12:24:50.609313 26435 raft_consensus.cc:2889] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:50.616784 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:50.617169 25755 raft_consensus.cc:1275] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:24:50.617384 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.617456 25760 raft_consensus.cc:2468] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 8.
I20260709 12:24:50.622105 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:50.620097 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:50.622732 25763 raft_consensus.cc:2468] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 8.
W20260709 12:24:50.626397 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 145663us
I20260709 12:24:50.627429 25801 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:24:50.631613 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 63010.8us
I20260709 12:24:50.586557 29923 raft_consensus.cc:2749] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:50.611243 29788 raft_consensus.cc:2804] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:50.610677 29826 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:50.633442 26402 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:50.624706 29927 consensus_queue.cc:1059] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 12:24:50.634194 29852 consensus_queue.cc:1059] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:24:50.635406 29879 log.cc:927] Time spent T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.910s	user 0.003s	sys 0.001s
I20260709 12:24:50.586781 29911 consensus_queue.cc:237] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:50.636137 29921 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349)
I20260709 12:24:50.538452 29917 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:50.624925 29919 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:50.659682 29896 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.659668 29919 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:50.660456 29896 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:50.640275 29909 raft_consensus.cc:697] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 9 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:50.641419 29788 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:50.672016 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:50.675062 26436 raft_consensus.cc:2468] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 9.
I20260709 12:24:50.680024 25754 raft_consensus.cc:2410] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 12:24:50.679939 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 53395.1us
I20260709 12:24:50.688203 29944 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.688843 29944 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:50.662215 29919 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:50.691586 29919 consensus_queue.cc:1048] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:50.691836 29941 consensus_queue.cc:1048] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 12:24:50.668742 29909 consensus_queue.cc:237] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:50.664160 29920 raft_consensus.cc:2804] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:50.674129 29788 raft_consensus.cc:3060] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:50.668059 29896 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:50.673796 29921 raft_consensus.cc:2749] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:24:50.715606 29929 log.cc:927] Time spent T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 12:24:50.716095 29936 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:50.715893 29895 consensus_queue.cc:1048] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:24:50.662333 29927 consensus_queue.cc:1243] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer f82778701b464892aab92a752ed7ffdc log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
W20260709 12:24:50.731133 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.733546 29934 raft_consensus.cc:2804] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:50.733779 29931 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.734109 29934 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:50.734501 29934 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:50.734314 29931 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:50.736198 29936 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:50.739271 29936 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:50.741139 29930 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.741736 29930 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:50.719208 29920 raft_consensus.cc:697] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 9 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:50.769765 26439 raft_consensus.cc:1240] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:50.764358 29917 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:50.778957 26436 raft_consensus.cc:1275] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:24:50.653611 29894 consensus_queue.cc:237] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:50.788357 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:50.789752 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:50.794262 25836 raft_consensus.cc:2410] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 12:24:50.795763 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 153082us
I20260709 12:24:50.795935 25835 raft_consensus.cc:1275] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 12:24:50.745494 29921 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.803903 29920 consensus_queue.cc:237] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:50.805178 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:50.798403 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:50.808568 25831 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:50.809428 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:50.778528 29930 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:50.811777 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:50.815407 25681 raft_consensus.cc:2468] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 8.
I20260709 12:24:50.810247 25678 raft_consensus.cc:2468] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 11.
W20260709 12:24:50.817559 26402 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:50.807852 29883 consensus_meta.cc:287] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.571s	user 0.010s	sys 0.000s
W20260709 12:24:50.818080 26402 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.829219 29810 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:50.829924 29316 raft_consensus.cc:3055] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:24:50.830381 29316 raft_consensus.cc:740] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:50.831187 29316 consensus_queue.cc:260] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:50.831861 26430 raft_consensus.cc:2468] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 9.
I20260709 12:24:50.832633 29316 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:50.833245 29717 consensus_queue.cc:1048] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:50.833813 29931 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:50.833595 29788 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:50.836781 29805 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:50.842830 29902 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:50.842972 29776 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:50.809231 29921 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:50.811630 29361 consensus_queue.cc:1048] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 12:24:50.848810 29883 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:50.809186 29821 consensus_queue.cc:1059] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 12:24:50.855847 29940 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.856706 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:50.883895 26439 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 10.
I20260709 12:24:50.857026 25677 raft_consensus.cc:1240] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:24:50.857479 26402 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:50.858243 29934 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:50.859339 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:50.858629 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:50.888049 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:50.888511 26430 raft_consensus.cc:2468] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 8.
I20260709 12:24:50.888983 25763 raft_consensus.cc:2393] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 11: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:50.860201 29895 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.865670 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:50.871217 25836 raft_consensus.cc:1275] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:24:50.871779 25832 raft_consensus.cc:2468] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 8.
I20260709 12:24:50.900472 29883 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:50.868276 29911 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:50.902917 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:50.902040 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:50.904402 29776 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:50.904492 29942 raft_consensus.cc:2749] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:24:50.904731 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 47415.2us
I20260709 12:24:50.905831 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:50.907297 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:50.917358 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:50.928433 26432 raft_consensus.cc:2393] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 10: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:50.912891 25684 raft_consensus.cc:1240] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:50.915845 26438 raft_consensus.cc:1275] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:24:50.917877 25832 raft_consensus.cc:3060] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:50.936012 29902 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:50.938318 29934 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:50.941397 29725 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:50.941568 29921 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:50.942562 25679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40230 (request call id 1602) took 1362 ms. Trace:
I20260709 12:24:50.942973 25679 rpcz_store.cc:276] 0709 12:24:49.580030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.580143 (+   113us) service_pool.cc:224] Handling call
0709 12:24:50.942354 (+1362211us) spinlock_profiling.cc:243] Waited 640 ms on lock 0x7b540029f9d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:50.942502 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1472020224}
I20260709 12:24:50.948462 29917 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.892079 29940 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:50.949028 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:50.949069 29917 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:50.950755 29940 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:50.952575 29917 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:50.953712 26430 raft_consensus.cc:2410] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 15 because replica has last-logged OpId of term: 13 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260709 12:24:50.948928 29911 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:50.957362 29802 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:50.957975 29911 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:50.960021 29892 log.cc:927] Time spent T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.946s	user 0.002s	sys 0.003s
I20260709 12:24:50.963233 25831 raft_consensus.cc:2468] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 10.
I20260709 12:24:50.963970 26430 raft_consensus.cc:3055] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:50.964465 26430 raft_consensus.cc:740] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
W20260709 12:24:50.980851 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 53687.9us
I20260709 12:24:51.022027 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:51.024540 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:51.027961 26430 consensus_queue.cc:260] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:51.029042 25800 leader_election.cc:400] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 election: Vote denied by peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267) with higher term. Message: Invalid argument: T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 8. Current term is 9.
I20260709 12:24:51.029102 26430 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:51.029525 25800 leader_election.cc:403] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:24:51.025396 25836 raft_consensus.cc:2468] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 11.
I20260709 12:24:51.033187 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:50.927680 29805 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:50.976531 29887 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.079s	user 0.021s	sys 0.042s
I20260709 12:24:51.035656 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:51.037894 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:51.036031 25800 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:51.036376 25756 raft_consensus.cc:2468] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 8.
W20260709 12:24:51.040987 29886 log.cc:927] Time spent T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 1.143s	user 0.003s	sys 0.006s
I20260709 12:24:51.041160 25800 leader_election.cc:400] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 election: Vote denied by peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267) with higher term. Message: Invalid argument: T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 10. Current term is 11.
I20260709 12:24:51.041507 25800 leader_election.cc:403] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:24:51.042055 26432 raft_consensus.cc:1275] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:24:51.044188 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:51.045384 26402 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:51.046916 25800 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
W20260709 12:24:51.036684 29887 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.139s	user 0.021s	sys 0.043s
I20260709 12:24:51.048813 29316 raft_consensus.cc:3060] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:51.049968 25800 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:24:51.050982 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:50.969259 25832 raft_consensus.cc:2468] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 10.
I20260709 12:24:50.903961 29895 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:51.058120 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:51.060134 25832 raft_consensus.cc:2468] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 8.
I20260709 12:24:51.061872 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:51.062657 25836 raft_consensus.cc:2468] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 10.
I20260709 12:24:51.063660 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:51.065339 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:51.056845 25835 raft_consensus.cc:2468] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 8.
I20260709 12:24:51.066448 25831 raft_consensus.cc:2393] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 10: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:51.047753 29911 raft_consensus.cc:2749] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:51.116888 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:51.039729 29931 raft_consensus.cc:2749] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267) with higher term. Message: Invalid argument: T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 8. Current term is 9.
I20260709 12:24:51.124722 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:51.126564 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 67432.2us
I20260709 12:24:51.065815 29930 raft_consensus.cc:2804] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:51.134912 25680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 2295) took 1361 ms. Trace:
I20260709 12:24:51.132984 29316 raft_consensus.cc:2749] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:51.137774 25680 rpcz_store.cc:276] 0709 12:24:49.773446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.773563 (+   117us) service_pool.cc:224] Handling call
0709 12:24:51.134653 (+1361090us) spinlock_profiling.cc:243] Waited 437 ms on lock 0x7b54002652d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:51.134837 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1004639488}
I20260709 12:24:51.136190 25800 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:51.067760 29725 raft_consensus.cc:2749] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267) with higher term. Message: Invalid argument: T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 10. Current term is 11.
I20260709 12:24:51.140805 25832 raft_consensus.cc:2393] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 9: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:51.140690 25800 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
W20260709 12:24:51.132901 29932 log.cc:927] Time spent T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:24:51.133024 29952 consensus_queue.cc:1048] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:24:51.120092 29921 raft_consensus.cc:2749] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:24:51.140054 29888 log.cc:927] Time spent T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 12:24:51.146180 29909 raft_consensus.cc:2749] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:51.140244 29930 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:51.214488 29316 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.215060 29316 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:51.246305 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.160662 29931 raft_consensus.cc:2804] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:51.273545 25828 raft_consensus.cc:1275] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:24:51.274837 29686 raft_consensus.cc:3055] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:24:51.259517 29930 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:51.266237 29931 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:51.305131 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:51.310459 26430 raft_consensus.cc:1275] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:24:51.311003 26430 pending_rounds.cc:85] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89: Aborting all ops after (but not including) 7
I20260709 12:24:51.311313 26430 pending_rounds.cc:107] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:24:51.311612 26430 raft_consensus.cc:2889] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:51.312374 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 273503us
I20260709 12:24:51.270644 29940 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:51.315632 26402 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:51.296172 29686 raft_consensus.cc:740] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:51.306885 29931 raft_consensus.cc:3060] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:51.325038 29685 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 12:24:51.332363 25828 raft_consensus.cc:1240] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:51.334448 25831 raft_consensus.cc:2468] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 10.
I20260709 12:24:51.335582 26402 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:51.336244 29934 consensus_queue.cc:1048] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:51.324898 29776 raft_consensus.cc:2749] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:51.340034 26402 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:24:51.342811 25726 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.946s	user 0.001s	sys 0.009s
I20260709 12:24:51.342818 26402 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:51.317627 29921 consensus_queue.cc:1048] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 12:24:51.349396 25835 raft_consensus.cc:1275] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:24:51.322932 29940 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:51.352048 29776 raft_consensus.cc:2749] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:51.352167 25828 raft_consensus.cc:1240] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:51.329078 29922 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:44194 (request call id 94) took 11471 ms. Trace:
I20260709 12:24:51.352963 25831 raft_consensus.cc:1240] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 8 LEADER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:51.344978 29933 raft_consensus.cc:2749] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:51.355664 25650 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:51.360919 29887 raft_consensus.cc:2804] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:51.361922 29887 raft_consensus.cc:697] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 8 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:51.361732 29949 consensus_queue.cc:1048] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:24:51.348366 29942 raft_consensus.cc:2749] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:51.360976 25650 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:51.365556 29805 raft_consensus.cc:2804] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:51.366230 29805 raft_consensus.cc:697] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 10 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:51.367944 25650 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:51.406599 29883 raft_consensus.cc:2804] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:51.408255 25837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 2779) took 1081 ms. Trace:
W20260709 12:24:51.409655 25726 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.013s	user 0.002s	sys 0.010s
I20260709 12:24:51.358033 29895 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:51.419829 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:51.422274 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:51.422891 26432 raft_consensus.cc:3060] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:51.424585 29961 log.cc:927] Time spent T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:24:51.367333 29805 consensus_queue.cc:237] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:51.430099 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 1.08987e+06us
I20260709 12:24:51.431522 29685 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:51.432128 29685 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:51.432564 26432 raft_consensus.cc:2468] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 10.
I20260709 12:24:51.432238 29887 consensus_queue.cc:237] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:51.433044 25834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 2781) took 1070 ms. Trace:
I20260709 12:24:51.434391 29685 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:51.438499 29931 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:51.440380 29891 raft_consensus.cc:3055] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:51.440819 29891 raft_consensus.cc:740] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:51.441696 29891 consensus_queue.cc:260] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:51.442655 29891 raft_consensus.cc:3060] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:51.408674 25837 rpcz_store.cc:276] 0709 12:24:50.336402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.336566 (+   164us) service_pool.cc:224] Handling call
0709 12:24:50.336906 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:50.358680 (+ 21774us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:50.358719 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:50.376459 (+ 17740us) log.cc:844] Serialized 26 byte log entry
0709 12:24:50.861532 (+485073us) spinlock_profiling.cc:243] Waited 12.6 ms on lock 0x7b18002e3480. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d96a56e07 00007f5d9f8b19a9 00007f5d96a7369b 00007f5d96a7193f 00007f5d96a73c02 00007f5d996fb20b 00007f5d99700d23 00007f5d997010d1 00007f5d99b1ca0f
0709 12:24:51.118166 (+256634us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:51.118199 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:51.118262 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:51.368013 (+249751us) raft_consensus.cc:1685] finished
0709 12:24:51.368032 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:51.408192 (+ 40160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1756,"raft.queue_time_us":20301,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":2949,"spinlock_wait_cycles":29052800,"thread_start_us":235046,"threads_started":2,"wal-append.queue_time_us":936726}
I20260709 12:24:51.433509 25834 rpcz_store.cc:276] 0709 12:24:50.362725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.362917 (+   192us) service_pool.cc:224] Handling call
0709 12:24:50.374312 (+ 11395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:50.393307 (+ 18995us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:50.393337 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:50.393374 (+    37us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:50.393403 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:51.432824 (+1039421us) spinlock_profiling.cc:243] Waited 18.8 ms on lock 0x7b54002f6554. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:51.432869 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:51.432990 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43265280}
I20260709 12:24:51.417472 29905 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.415685 29883 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:51.420569 29949 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.359754 29686 consensus_queue.cc:260] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:51.473111 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 130352us
I20260709 12:24:51.466809 29883 raft_consensus.cc:3060] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:51.474045 26402 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:51.474900 26402 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:51.486492 29685 consensus_queue.cc:1048] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:51.471818 29949 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:51.477591 29933 raft_consensus.cc:2804] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:51.469959 29905 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:51.503866 25684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51578 (request call id 808) took 1275 ms. Trace:
I20260709 12:24:51.504572 29905 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:51.504323 25684 rpcz_store.cc:276] 0709 12:24:50.228365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.228660 (+   295us) service_pool.cc:224] Handling call
0709 12:24:50.232377 (+  3717us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:50.929091 (+696714us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:51.503611 (+574520us) spinlock_profiling.cc:243] Waited 663 ms on lock 0x7b5400159354. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:51.503787 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1525069568}
W20260709 12:24:51.507076 29950 log.cc:927] Time spent T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.229s	user 0.000s	sys 0.000s
I20260709 12:24:51.481930 29917 consensus_queue.cc:1048] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:24:51.497886 29967 consensus_queue.cc:1059] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:51.357596 29922 rpcz_store.cc:276] 0709 12:24:39.852019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:39.852197 (+   178us) service_pool.cc:224] Handling call
0709 12:24:39.922976 (+ 70779us) log.cc:844] Serialized 508 byte log entry
0709 12:24:51.315486 (+11392510us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21169,"raft.queue_time_us":32067,"raft.run_cpu_time_us":1722,"raft.run_wall_time_us":178911,"thread_start_us":39747,"threads_started":1,"wal-append.queue_time_us":230816,"wal-append.run_cpu_time_us":2573,"wal-append.run_wall_time_us":1157772}
I20260709 12:24:51.502086 29930 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:51.483834 29921 raft_consensus.cc:2804] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:51.516009 25726 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:51.518031 25726 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:51.519181 29917 raft_consensus.cc:2804] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:24:51.481662 29940 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:51.513504 29967 raft_consensus.cc:3055] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:51.527823 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:51.538244 29685 consensus_queue.cc:1059] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:24:51.540391 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:51.540472 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:51.540961 29685 raft_consensus.cc:3055] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:51.541198 25837 raft_consensus.cc:2468] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 10.
I20260709 12:24:51.541332 29685 raft_consensus.cc:740] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:51.541718 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:51.542363 25834 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 14.
I20260709 12:24:51.543522 25828 raft_consensus.cc:1240] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 9 LEADER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:24:51.545269 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:51.546484 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:51.548568 25677 raft_consensus.cc:1240] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:24:51.550587 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:51.551152 25679 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:51.551424 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:51.516625 29921 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:51.552336 29921 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:51.556447 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:51.516274 29931 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:51.494792 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:51.538468 29967 raft_consensus.cc:740] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:51.542469 29685 consensus_queue.cc:260] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:51.565768 29685 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:51.495985 29933 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:51.565135 29967 consensus_queue.cc:260] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:51.571834 25685 raft_consensus.cc:2468] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 11.
I20260709 12:24:51.571864 25679 raft_consensus.cc:2468] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 12.
I20260709 12:24:51.589331 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:51.539685 29905 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:51.605873 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 97760.5us
I20260709 12:24:51.606328 29940 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
W20260709 12:24:51.606231 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 88275.4us
I20260709 12:24:51.614526 26402 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:51.586385 29933 raft_consensus.cc:3060] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:51.617944 26402 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:51.616760 29967 raft_consensus.cc:3060] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:51.619242 29942 consensus_queue.cc:1059] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:24:51.615773 29936 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.637461 29944 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:51.637652 29930 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:51.619985 29934 raft_consensus.cc:2749] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:51.641124 25683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 2314) took 1151 ms. Trace:
I20260709 12:24:51.619607 29917 raft_consensus.cc:697] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:51.623631 29776 raft_consensus.cc:2749] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:51.650315 25683 rpcz_store.cc:276] 0709 12:24:50.489518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.490243 (+   725us) service_pool.cc:224] Handling call
0709 12:24:51.640931 (+1150688us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b5400203354. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:51.641061 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":231404288}
I20260709 12:24:51.618546 29905 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:51.652400 29973 raft_consensus.cc:2804] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:24:51.655639 29973 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:51.657305 29905 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:51.623476 29883 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:51.639499 29921 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:51.621142 29940 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:51.672753 29937 log.cc:927] Time spent T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 1.002s	user 0.004s	sys 0.000s
I20260709 12:24:51.673902 25833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 2783) took 1275 ms. Trace:
I20260709 12:24:51.674283 25833 rpcz_store.cc:276] 0709 12:24:50.398571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.408383 (+  9812us) service_pool.cc:224] Handling call
0709 12:24:50.449553 (+ 41170us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:50.481184 (+ 31631us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:50.481226 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:50.499131 (+ 17905us) log.cc:844] Serialized 26 byte log entry
0709 12:24:50.613916 (+114785us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:50.724547 (+110631us) log.cc:844] Serialized 14 byte log entry
0709 12:24:50.731452 (+  6905us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.731529 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:51.672228 (+940699us) spinlock_profiling.cc:243] Waited 2.79 ms on lock 0x7b4400022b4c. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db 00007f5d99708aaf 00007f5d996fc86e 00007f5d996fbbb6 00007f5d996fb7d8 00007f5d99705221 00007f5d997051d9 00007f5d99705169
0709 12:24:51.673628 (+  1400us) raft_consensus.cc:1685] finished
0709 12:24:51.673718 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:51.673841 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6600,"prepare.queue_time_us":111180,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":55,"raft.queue_time_us":6708,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":33789,"spinlock_wait_cycles":6406912,"thread_start_us":189968,"threads_started":2,"wal-append.queue_time_us":156046}
I20260709 12:24:51.648572 29944 consensus_queue.cc:1059] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 12:24:51.676863 29917 consensus_queue.cc:237] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:51.677511 29788 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:51.680174 29940 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:51.681285 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:51.648902 29936 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:51.683451 29670 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:51.683986 29670 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:51.685102 29936 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:51.655120 29972 consensus_queue.cc:1048] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:24:51.686076 29670 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:51.688060 29805 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.688354 25684 raft_consensus.cc:2368] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 9. Current term is 10.
I20260709 12:24:51.688910 29923 raft_consensus.cc:3055] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:51.688627 29805 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:51.689337 29923 raft_consensus.cc:740] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:51.690310 29923 consensus_queue.cc:260] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:51.688915 29883 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:51.695948 29921 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:51.661639 29949 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:51.663329 29973 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:51.714274 29805 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:51.760746 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 132332us
I20260709 12:24:51.762012 26401 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:51.719278 29691 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:51.774592 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 153448us
I20260709 12:24:51.768163 29942 raft_consensus.cc:2749] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:51.776073 26402 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:51.777355 29967 raft_consensus.cc:2804] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:51.778123 29967 raft_consensus.cc:697] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 11 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
W20260709 12:24:51.779090 29963 log.cc:927] Time spent T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.411s	user 0.001s	sys 0.001s
I20260709 12:24:51.758584 29933 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:51.780886 26402 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:51.786125 26433 raft_consensus.cc:2393] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 9: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:51.786634 29921 raft_consensus.cc:2804] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:24:51.780105 29967 consensus_queue.cc:237] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:51.797087 29921 raft_consensus.cc:697] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 12 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:51.798460 29921 consensus_queue.cc:237] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:51.801965 29979 consensus_queue.cc:1048] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:24:51.803938 29933 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:51.805693 26402 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:51.812502 29942 raft_consensus.cc:2804] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:51.812995 29942 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:51.812835 26402 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:51.813544 29942 raft_consensus.cc:3060] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:51.814011 29933 raft_consensus.cc:2804] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:24:51.814467 29933 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:51.814889 29933 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:51.816408 26402 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:51.817287 29979 raft_consensus.cc:2749] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:51.818982 29973 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:51.821295 29973 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:51.854439 29933 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:51.858798 29933 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:51.860560 29942 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:51.869282 29942 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:24:51.890568 29974 log.cc:927] Time spent T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.235s	user 0.003s	sys 0.000s
W20260709 12:24:51.913643 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:51.939731 29953 log.cc:927] Time spent T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 1.024s	user 0.002s	sys 0.006s
I20260709 12:24:51.960427 29810 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:51.961668 29923 raft_consensus.cc:3060] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:51.969564 29973 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:51.970263 29973 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:51.972808 29973 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:52.029448 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:52.032191 25756 raft_consensus.cc:2955] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Committing config change with OpId 6.8: config changed from index 6 to 8, VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
W20260709 12:24:52.039276 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:52.040757 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:52.050778 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:52.055691 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:52.052318 25761 raft_consensus.cc:1275] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:24:52.058211 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:52.059788 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:52.061378 25763 raft_consensus.cc:3060] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:52.057447 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:52.071087 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:52.072345 25757 raft_consensus.cc:2368] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 12. Current term is 13.
I20260709 12:24:52.074024 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:52.074795 25757 raft_consensus.cc:2468] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 8.
W20260709 12:24:52.075969 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 454366us
I20260709 12:24:52.080343 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:52.130528 29981 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:52.131328 29981 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:52.134416 29981 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:52.192581 29698 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:52.193476 29698 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:52.685086 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:52.788548 29698 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:52.790419 29934 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.791105 29934 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:52.797596 29934 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:52.798357 29934 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.798873 29934 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:52.800962 29934 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:52.801493 29934 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
W20260709 12:24:52.801918 25756 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.003s	sys 0.005s
W20260709 12:24:52.802523 25756 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.003s	sys 0.005s
I20260709 12:24:52.802008 29934 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:52.803210 25763 consensus_meta.cc:287] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.741s	user 0.009s	sys 0.000s
I20260709 12:24:52.803540 25763 raft_consensus.cc:2468] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 9.
W20260709 12:24:52.806080 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 726417us
I20260709 12:24:52.807633 25726 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:52.808661 25726 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:24:52.808770 25801 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:52.809571 25801 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
W20260709 12:24:52.909863 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 100347us
W20260709 12:24:53.057866 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 71309.8us
I20260709 12:24:53.138639 29934 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:53.139437 29934 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:53.140728 29989 raft_consensus.cc:2749] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:53.141453 29934 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:53.142316 29989 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.142637 29991 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:53.142899 29989 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:53.143276 29991 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:53.144124 29934 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:24:53.144532 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:53.144695 29934 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:53.145097 29989 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:53.145156 29934 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:53.145764 29989 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:53.146588 29991 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:53.147043 29988 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.147480 29989 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:53.141587 29990 raft_consensus.cc:2804] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:24:53.138463 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 329830us
I20260709 12:24:53.148090 29934 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:53.151327 29990 raft_consensus.cc:697] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:53.152160 29989 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:53.152382 29990 consensus_queue.cc:237] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:53.153553 25726 leader_election.cc:400] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Vote denied by peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611) with higher term. Message: Invalid argument: T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 10. Current term is 11.
I20260709 12:24:53.153594 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:53.148023 29988 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:53.156666 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:53.157060 25758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 2520) took 1096 ms. Trace:
I20260709 12:24:53.157259 25829 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:53.157444 25758 rpcz_store.cc:276] 0709 12:24:52.060581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.156209 (+1095628us) service_pool.cc:224] Handling call
0709 12:24:53.156546 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:53.156757 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:53.156783 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:53.156824 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:53.156856 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:53.156907 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:53.157010 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:53.156916 29989 consensus_queue.cc:1048] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 12:24:53.158399 29988 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:53.161710 25837 raft_consensus.cc:1275] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:24:53.164633 25569 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 237622cb71464b3ca091560bd9d8c06b with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:53.163898 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:53.165398 29934 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.165390 25837 raft_consensus.cc:2468] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 12.
I20260709 12:24:53.166236 29934 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:53.168634 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:53.174664 29934 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:24:53.178188 25801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:53.178898 29934 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:53.179977 29934 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:53.180601 29952 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:53.181180 29952 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:53.182451 29934 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349)
I20260709 12:24:53.183568 29952 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:53.184229 25829 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 13.
I20260709 12:24:53.184564 29952 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.185037 29952 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:53.185513 25830 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44202 (request call id 2784) took 2786 ms (client timeout 1799 ms). Trace:
I20260709 12:24:53.153944 25726 leader_election.cc:403] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:53.185601 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:53.185976 25830 rpcz_store.cc:269] 0709 12:24:50.399049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.399168 (+   119us) service_pool.cc:224] Handling call
0709 12:24:53.185286 (+2786118us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b54001b1554. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:53.185421 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":622159616}
I20260709 12:24:53.186596 25829 raft_consensus.cc:2410] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:24:53.187173 25726 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:24:53.187795 29990 raft_consensus.cc:2749] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611) with higher term. Message: Invalid argument: T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 10. Current term is 11.
I20260709 12:24:53.188824 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:53.189121 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:53.189338 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:53.189946 25763 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:53.189594 25758 raft_consensus.cc:2393] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 9: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:53.187532 29952 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:53.192410 29952 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:53.193028 29952 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:53.195770 29952 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:53.197052 29952 raft_consensus.cc:2804] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:53.197539 29952 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:53.197576 29897 raft_consensus.cc:2749] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:53.198002 29952 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:53.198414 25763 raft_consensus.cc:2468] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 12.
I20260709 12:24:53.200637 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:53.201563 25726 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:53.202003 29990 raft_consensus.cc:2764] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260709 12:24:53.202716 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:53.205065 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:53.205791 25756 raft_consensus.cc:2468] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 9.
I20260709 12:24:53.199677 29897 consensus_queue.cc:1048] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 12:24:53.207688 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:53.203368 25763 raft_consensus.cc:2468] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 10.
I20260709 12:24:53.209632 29988 raft_consensus.cc:2749] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:53.217854 25726 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:53.219310 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:53.219604 29897 consensus_queue.cc:1048] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:53.221788 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:53.224237 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:53.224846 25756 raft_consensus.cc:3060] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:53.211639 29952 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:53.229991 29952 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:53.233507 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:53.233526 26401 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:53.234297 25758 raft_consensus.cc:2468] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 10.
I20260709 12:24:53.235270 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:53.235932 26401 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:24:53.235954 25757 raft_consensus.cc:2468] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 8.
I20260709 12:24:53.236698 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:53.237309 29921 raft_consensus.cc:2749] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:53.237987 29921 raft_consensus.cc:2804] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:53.238333 29921 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:53.238693 29921 raft_consensus.cc:3060] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:53.239399 25760 raft_consensus.cc:2468] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 9.
I20260709 12:24:53.236711 29990 raft_consensus.cc:3060] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:53.245342 25756 raft_consensus.cc:2468] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 11.
I20260709 12:24:53.249126 25755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 2516) took 1193 ms. Trace:
I20260709 12:24:53.249665 25755 rpcz_store.cc:276] 0709 12:24:52.055675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.205993 (+1150318us) service_pool.cc:224] Handling call
0709 12:24:53.206330 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:53.210676 (+  4346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:53.210704 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:53.211204 (+   500us) log.cc:844] Serialized 26 byte log entry
0709 12:24:53.244135 (+ 32931us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:53.244185 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:53.244260 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:53.244318 (+    58us) raft_consensus.cc:1685] finished
0709 12:24:53.244332 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:53.249054 (+  4722us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3938,"raft.queue_time_us":5070,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"thread_start_us":32552,"threads_started":1,"wal-append.queue_time_us":31013}
W20260709 12:24:53.252115 25836 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.654s	user 0.049s	sys 0.050s
W20260709 12:24:53.252491 25836 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.654s	user 0.049s	sys 0.050s
I20260709 12:24:53.252388 29921 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:53.253330 25836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41782 (request call id 867) took 1666 ms. Trace:
I20260709 12:24:53.254472 29921 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:53.253701 25836 rpcz_store.cc:276] 0709 12:24:51.586548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:51.586746 (+   198us) service_pool.cc:224] Handling call
0709 12:24:51.587060 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:51.597437 (+ 10377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:51.597468 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:51.598051 (+   583us) log.cc:844] Serialized 26 byte log entry
0709 12:24:53.253006 (+1654955us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:53.253050 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:53.253117 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:53.253154 (+    37us) raft_consensus.cc:1685] finished
0709 12:24:53.253164 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:53.253281 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10001,"raft.queue_time_us":25732,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":3994,"spinlock_wait_cycles":20352,"thread_start_us":1654498,"threads_started":1,"wal-append.queue_time_us":183568}
I20260709 12:24:53.256942 29952 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:53.257551 29952 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:53.258972 29988 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:53.259605 29988 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:53.260241 29952 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:53.261631 29988 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:53.261966 29990 raft_consensus.cc:2749] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:24:53.259032 25726 connection.cc:256] RPC call timeout handler was delayed by -3.3689453550000508s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17980000000000002s for a response
W20260709 12:24:53.262631 25726 connection.cc:256] RPC call timeout handler was delayed by -3.2726453549998951s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1905s for a response
W20260709 12:24:53.262904 25726 connection.cc:256] RPC call timeout handler was delayed by -3.13674535500013s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2056s for a response
I20260709 12:24:53.263290 26401 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:53.263408 29988 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:53.264463 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:53.264499 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:53.264917 29988 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:53.265410 25755 raft_consensus.cc:3060] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:53.267055 29988 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:53.267457 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:53.268122 29942 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.268860 29934 raft_consensus.cc:2804] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:53.268585 29942 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:53.269243 29934 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:53.269619 29934 raft_consensus.cc:3060] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:53.270790 29942 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:53.267903 29921 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:53.273335 25755 raft_consensus.cc:2468] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 10.
I20260709 12:24:53.274591 29671 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.282366 29921 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:53.282492 29671 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:53.275600 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:53.276372 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:53.277626 26437 raft_consensus.cc:1275] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:24:53.284448 25829 raft_consensus.cc:2410] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:24:53.278223 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:53.285004 26432 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 10.
I20260709 12:24:53.285712 29671 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:53.285818 29921 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:24:53.277001 25650 connection.cc:256] RPC call timeout handler was delayed by -1.2476662470003248s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1799s for a response
I20260709 12:24:53.278669 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:53.287184 26439 raft_consensus.cc:2393] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 10: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:53.279232 25756 raft_consensus.cc:1275] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:24:53.263754 25726 connection.cc:256] RPC call timeout handler was delayed by -2.4286813149997215s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1552s for a response
I20260709 12:24:53.280037 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:53.280043 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:53.288228 25760 raft_consensus.cc:2468] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 11.
I20260709 12:24:53.280344 29934 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:53.288599 26434 raft_consensus.cc:2468] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 6.
I20260709 12:24:53.280138 26401 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:24:53.286486 25650 connection.cc:256] RPC call timeout handler was delayed by -1.1634312720002526s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1799s for a response
W20260709 12:24:53.287675 25726 connection.cc:256] RPC call timeout handler was delayed by -2.2810813149994829s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1716s for a response
I20260709 12:24:53.289789 26401 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:24:53.289999 25726 connection.cc:256] RPC call timeout handler was delayed by -1.8697813149997273s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21730000000000002s for a response
I20260709 12:24:53.290656 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:53.290843 29942 raft_consensus.cc:2804] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:53.291133 25650 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:53.291339 29942 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:53.291515 25829 raft_consensus.cc:2410] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:24:53.291568 26433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 1049) took 2517 ms. Trace:
I20260709 12:24:53.291832 29942 raft_consensus.cc:3060] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:53.292939 29671 raft_consensus.cc:2804] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:53.293442 29671 raft_consensus.cc:697] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 10 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:53.293882 25650 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:53.292081 26433 rpcz_store.cc:276] 0709 12:24:50.774091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:51.680981 (+906890us) service_pool.cc:224] Handling call
0709 12:24:53.291391 (+1610410us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b54006f54d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:53.291507 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":239129472}
I20260709 12:24:53.294791 25650 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:24:53.295836 25832 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44218 (request call id 1663) took 2378 ms (client timeout 2758 ms). Trace:
I20260709 12:24:53.296089 25833 raft_consensus.cc:1275] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:24:53.296242 25832 rpcz_store.cc:269] 0709 12:24:50.917621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:51.116561 (+198940us) service_pool.cc:224] Handling call
0709 12:24:53.295636 (+2179075us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b5400050fd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:53.295773 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36826880}
I20260709 12:24:53.295517 29671 consensus_queue.cc:237] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:53.290668 25726 connection.cc:256] RPC call timeout handler was delayed by -1.8112813149996327s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2238s for a response
W20260709 12:24:53.300501 25726 connection.cc:256] RPC call timeout handler was delayed by -1.4314813149999281s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.266s for a response
W20260709 12:24:53.300868 25726 connection.cc:256] RPC call timeout handler was delayed by -1.3828813149998496s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27140000000000003s for a response
I20260709 12:24:53.300565 26401 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:24:53.301138 25726 connection.cc:256] RPC call timeout handler was delayed by -1.3432813149997855s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2758s for a response
W20260709 12:24:53.301441 25726 connection.cc:256] RPC call timeout handler was delayed by -1.3432813149997855s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2758s for a response
W20260709 12:24:53.301716 25726 connection.cc:256] RPC call timeout handler was delayed by -1.0867813149998256s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3043s for a response
I20260709 12:24:53.301849 26401 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:53.304689 29852 raft_consensus.cc:2804] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:53.305334 29852 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:53.305826 29852 raft_consensus.cc:3060] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:53.307058 29776 raft_consensus.cc:3055] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:53.307567 29776 raft_consensus.cc:740] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:53.309765 29776 consensus_queue.cc:260] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:53.310834 29776 raft_consensus.cc:3060] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:53.312278 25726 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:53.312996 29934 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:53.312945 29942 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:53.313896 29810 raft_consensus.cc:2804] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:53.314291 26401 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:53.314626 29810 raft_consensus.cc:697] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 11 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:53.315178 29942 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:53.319411 25762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48606 (request call id 988) took 2623 ms. Trace:
I20260709 12:24:53.320046 25762 rpcz_store.cc:276] 0709 12:24:50.696221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.696350 (+   129us) service_pool.cc:224] Handling call
0709 12:24:50.719489 (+ 23139us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:50.719905 (+   416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:50.719964 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:50.730309 (+ 10345us) log.cc:844] Serialized 26 byte log entry
0709 12:24:50.867263 (+136954us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:24:50.867298 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.867385 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:51.939012 (+1071627us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b4400022b4c. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db 00007f5d99708aaf 00007f5d996fc86e 00007f5d996fbbb6 00007f5d996fb7d8 00007f5d99705221 00007f5d997051d9 00007f5d99705169
0709 12:24:53.318935 (+1379923us) raft_consensus.cc:1685] finished
0709 12:24:53.318969 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:53.319305 (+   336us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":109,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":5945,"spinlock_wait_cycles":27343744,"thread_start_us":73991,"threads_started":1,"wal-append.queue_time_us":146681}
I20260709 12:24:53.325404 29988 raft_consensus.cc:2749] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:53.325604 29810 consensus_queue.cc:237] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:53.327083 25726 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:53.327859 29988 raft_consensus.cc:2749] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:53.329514 25726 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:53.324899 29921 consensus_queue.cc:1048] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 12:24:53.331530 29921 raft_consensus.cc:2804] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:53.331900 29921 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:53.332279 29921 raft_consensus.cc:3060] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:53.334618 25726 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:53.337494 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:53.338460 25762 raft_consensus.cc:2468] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 9.
I20260709 12:24:53.339948 26433 raft_consensus.cc:1240] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:53.341567 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:53.342134 25762 raft_consensus.cc:3060] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:53.342686 26401 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:53.344640 25650 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:53.345206 25726 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:53.346269 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:53.346560 29979 raft_consensus.cc:2804] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:53.347003 29990 raft_consensus.cc:2749] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:53.347886 29671 consensus_queue.cc:1048] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:53.348932 29802 raft_consensus.cc:2804] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:24:53.342453 29988 raft_consensus.cc:2749] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:53.349288 29671 raft_consensus.cc:2804] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:24:53.349529 25682 raft_consensus.cc:1240] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 12 LEADER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 11. Current term is 12. Ops: []
I20260709 12:24:53.350075 29671 raft_consensus.cc:697] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 13 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:53.346658 25678 raft_consensus.cc:1275] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:24:53.350526 25760 raft_consensus.cc:3060] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:53.353073 25726 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:53.350713 25678 pending_rounds.cc:85] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc: Aborting all ops after (but not including) 6
I20260709 12:24:53.347038 29979 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:53.354794 25678 pending_rounds.cc:107] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:24:53.354909 29979 raft_consensus.cc:3060] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:53.355257 25678 raft_consensus.cc:2889] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:53.356159 29990 raft_consensus.cc:2804] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:53.356602 29990 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:53.356957 29990 raft_consensus.cc:3060] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:53.320984 29942 raft_consensus.cc:2804] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:53.358723 25726 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
W20260709 12:24:53.360330 26402 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:53.361188 26402 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:53.364751 29996 consensus_queue.cc:1048] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:24:53.365792 29776 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.366534 29776 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:53.367444 29996 raft_consensus.cc:2749] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:53.368305 29989 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.368826 29989 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:53.375979 29991 raft_consensus.cc:2749] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:53.376408 29989 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:53.377426 25677 raft_consensus.cc:1275] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:24:53.378328 25755 raft_consensus.cc:1275] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:24:53.378443 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:53.379124 25677 raft_consensus.cc:2468] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 8.
I20260709 12:24:53.380046 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:53.380131 29942 raft_consensus.cc:697] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 10 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:53.380734 25678 raft_consensus.cc:2468] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 12.
I20260709 12:24:53.381232 29942 consensus_queue.cc:237] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:53.381768 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:53.382755 29940 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:53.383265 29940 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:53.384451 25649 connection.cc:256] RPC call timeout handler was delayed by -1.2956266040000628s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 12:24:53.385315 29940 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:53.386617 29940 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:53.349359 29802 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:53.385756 25678 raft_consensus.cc:2468] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 7.
I20260709 12:24:53.385802 25726 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:53.395203 25682 raft_consensus.cc:1275] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:24:53.360636 29988 raft_consensus.cc:2749] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:53.916783 29988 raft_consensus.cc:2764] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
W20260709 12:24:53.398468 25858 debug-util.cc:398] Leaking SignalData structure 0x7b0800354160 after lost signal to thread 24537
I20260709 12:24:53.387125 25762 raft_consensus.cc:2468] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 11.
I20260709 12:24:53.401684 29776 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:53.399401 29671 consensus_queue.cc:237] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:53.703717 25572 maintenance_manager.cc:643] P 496fd6924b624e77b03ccfd15653d47b: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 8.933s	user 0.204s	sys 0.096s Metrics: {"bytes_written":31024,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":130910,"dirs.run_cpu_time_us":476,"dirs.run_wall_time_us":34116,"drs_written":1,"lbm_read_time_us":14396,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":3,"lbm_write_time_us":168733,"lbm_writes_1-10_ms":1,"lbm_writes_10-100_ms":4,"lbm_writes_lt_1ms":29,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":75838,"threads_started":1,"update_count":30}
W20260709 12:24:53.427505 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 81597.9us
I20260709 12:24:54.606410 25650 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:54.609601 25573 maintenance_manager.cc:419] P 496fd6924b624e77b03ccfd15653d47b: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 11072 bytes on disk
I20260709 12:24:53.781767 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:54.612332 25680 raft_consensus.cc:2468] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 8.
I20260709 12:24:54.612823 25680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 2324) took 1267 ms. Trace:
I20260709 12:24:54.613121 25680 rpcz_store.cc:276] 0709 12:24:53.345805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.780909 (+435104us) service_pool.cc:224] Handling call
0709 12:24:54.612766 (+831857us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:53.380151 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:54.615789 25677 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 2336) took 1237 ms (client timeout 1517 ms). Trace:
W20260709 12:24:54.616160 25677 rpcz_store.cc:269] 0709 12:24:53.378226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.379932 (+  1706us) service_pool.cc:224] Handling call
0709 12:24:54.615736 (+1235804us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:54.617065 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:54.617780 25677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 2334) took 1240 ms. Trace:
I20260709 12:24:54.618067 25677 rpcz_store.cc:276] 0709 12:24:53.377723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.616832 (+1239109us) service_pool.cc:224] Handling call
0709 12:24:54.617709 (+   877us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:54.618855 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:54.074287 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
W20260709 12:24:54.703274 25681 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 2329) took 1326 ms (client timeout 1709 ms). Trace:
I20260709 12:24:53.917272 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:54.704906 25682 raft_consensus.cc:2393] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 7: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
W20260709 12:24:54.705300 25682 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40230 (request call id 1607) took 1309 ms (client timeout 1661 ms). Trace:
W20260709 12:24:54.705611 25682 rpcz_store.cc:269] 0709 12:24:53.396268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.917006 (+520738us) service_pool.cc:224] Handling call
0709 12:24:54.705245 (+788239us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:54.706612 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:54.707280 25682 raft_consensus.cc:2393] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 10: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:54.707616 25682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 2332) took 1330 ms. Trace:
I20260709 12:24:54.037963 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:54.708933 25683 raft_consensus.cc:2393] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 10: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
W20260709 12:24:54.709311 25683 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 2319) took 1375 ms (client timeout 1688 ms). Trace:
W20260709 12:24:54.709707 25683 rpcz_store.cc:269] 0709 12:24:53.334225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.037625 (+703400us) service_pool.cc:224] Handling call
0709 12:24:54.709257 (+671632us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:54.710673 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:54.711230 25683 raft_consensus.cc:2468] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 8.
I20260709 12:24:54.711670 25683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40230 (request call id 1612) took 1310 ms. Trace:
W20260709 12:24:53.918610 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 532839us
W20260709 12:24:53.800006 25684 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51578 (request call id 817) took 2275 ms (client timeout 2083 ms). Trace:
W20260709 12:24:54.816125 25684 rpcz_store.cc:269] 0709 12:24:51.524153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:51.524413 (+   260us) service_pool.cc:224] Handling call
0709 12:24:53.799737 (+2275324us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b54002cf6d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:53.799876 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":313302272}
I20260709 12:24:54.817369 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:54.818167 25684 raft_consensus.cc:2393] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 12: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:54.818559 25684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 2331) took 1441 ms. Trace:
I20260709 12:24:54.818857 25684 rpcz_store.cc:276] 0709 12:24:53.376959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.817057 (+1440098us) service_pool.cc:224] Handling call
0709 12:24:54.818507 (+  1450us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:53.415364 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:54.820951 25678 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40230 (request call id 1606) took 1425 ms (client timeout 1539 ms). Trace:
W20260709 12:24:54.821326 25678 rpcz_store.cc:269] 0709 12:24:53.395802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.411712 (+ 15910us) service_pool.cc:224] Handling call
0709 12:24:54.820892 (+1409180us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:54.822302 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:54.823022 25678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40230 (request call id 1620) took 1419 ms. Trace:
I20260709 12:24:54.823339 25678 rpcz_store.cc:276] 0709 12:24:53.408233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.822014 (+1413781us) service_pool.cc:224] Handling call
0709 12:24:54.822971 (+   957us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:53.971984 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:54.824977 25755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48606 (request call id 1015) took 1233 ms. Trace:
I20260709 12:24:54.825369 25755 rpcz_store.cc:276] 0709 12:24:53.594815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.971664 (+376849us) service_pool.cc:224] Handling call
0709 12:24:54.824917 (+853253us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:54.826485 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:24:54.046262 25756 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.007s	sys 0.012s
W20260709 12:24:54.829960 25756 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.481s	user 0.010s	sys 0.012s
I20260709 12:24:54.830857 25756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48606 (request call id 1012) took 1489 ms. Trace:
I20260709 12:24:53.719156 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:54.833699 25758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48606 (request call id 1017) took 1238 ms. Trace:
I20260709 12:24:54.834051 25758 rpcz_store.cc:276] 0709 12:24:53.595503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.718839 (+123336us) service_pool.cc:224] Handling call
0709 12:24:54.833599 (+1114760us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:54.835134 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:24:53.964598 25760 consensus_meta.cc:287] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.613s	user 0.010s	sys 0.001s
I20260709 12:24:54.243764 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:54.837427 25760 raft_consensus.cc:2468] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 9.
W20260709 12:24:54.837738 25686 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40230 (request call id 1619) took 1434 ms (client timeout 1660 ms). Trace:
W20260709 12:24:54.838104 25686 rpcz_store.cc:269] 0709 12:24:53.403662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.243420 (+839758us) service_pool.cc:224] Handling call
0709 12:24:54.837681 (+594261us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:54.838905 25760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48606 (request call id 1011) took 1497 ms. Trace:
I20260709 12:24:54.838964 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:54.839680 25686 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:24:54.246687 25754 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53474 (request call id 2885) took 3734 ms (client timeout 2768 ms). Trace:
I20260709 12:24:54.261816 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:54.841257 25763 raft_consensus.cc:2368] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for earlier term 8. Current term is 9.
I20260709 12:24:54.266543 25761 raft_consensus.cc:1275] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:24:54.263751 25762 raft_consensus.cc:1275] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:24:54.841964 25755 raft_consensus.cc:2410] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 12:24:53.845970 25801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:54.083989 25858 debug-util.cc:398] Leaking SignalData structure 0x7b08001e4320 after lost signal to thread 25618
W20260709 12:24:54.861039 25858 debug-util.cc:398] Leaking SignalData structure 0x7b080039f280 after lost signal to thread 25711
W20260709 12:24:54.861447 25858 debug-util.cc:398] Leaking SignalData structure 0x7b08003c6de0 after lost signal to thread 25712
I20260709 12:24:54.861644 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:54.862581 25762 raft_consensus.cc:2410] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 12:24:54.862703 25858 debug-util.cc:398] Leaking SignalData structure 0x7b0800270700 after lost signal to thread 25787
W20260709 12:24:53.850544 25800 connection.cc:256] RPC call timeout handler was delayed by -1.3819265140000425s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1688s for a response
I20260709 12:24:54.292321 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
W20260709 12:24:54.865622 25800 connection.cc:256] RPC call timeout handler was delayed by -1.2505265140002848s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1834s for a response
I20260709 12:24:54.865833 25759 raft_consensus.cc:3060] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:54.866021 25800 connection.cc:256] RPC call timeout handler was delayed by -1.1015169410002272s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15990000000000001s for a response
W20260709 12:24:54.866266 25584 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41232 (request call id 390) took 15728 ms (client timeout 15000 ms). Trace:
W20260709 12:24:54.866389 25800 connection.cc:256] RPC call timeout handler was delayed by -1.0561265140004252s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.205s for a response
I20260709 12:24:54.868287 25582 catalog_manager.cc:5697] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 4 to 10. New cstate: current_term: 10 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:54.866562 25686 raft_consensus.cc:2468] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 13.
I20260709 12:24:54.869903 25686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40230 (request call id 1617) took 1466 ms. Trace:
I20260709 12:24:54.870292 25686 rpcz_store.cc:276] 0709 12:24:53.403068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.838711 (+1435643us) service_pool.cc:224] Handling call
0709 12:24:54.869848 (+ 31137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:54.870043 25582 catalog_manager.cc:5697] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 8 to 9, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 9 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:54.871344 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:53.744966 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:54.863858 25858 debug-util.cc:398] Leaking SignalData structure 0x7b080024cc00 after lost signal to thread 25861
W20260709 12:24:54.872942 25858 debug-util.cc:398] Leaking SignalData structure 0x7b08003eb360 after lost signal to thread 25862
W20260709 12:24:53.746137 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:53.957816 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 46110us
W20260709 12:24:54.866760 25584 rpcz_store.cc:269] 0709 12:24:39.137504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:39.171358 (+ 33854us) service_pool.cc:224] Handling call
0709 12:24:54.866054 (+15694696us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:48.246376 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:48.288482 (+ 42106us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:48.290207 (+  1725us) write_op.cc:435] Acquired schema lock
0709 12:24:48.291661 (+  1454us) tablet.cc:662] Decoding operations
0709 12:24:48.313536 (+ 21875us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:48.313598 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:48.313616 (+    18us) tablet.cc:685] Acquiring locks for 30 operations
0709 12:24:48.314948 (+  1332us) tablet.cc:701] Row locks acquired
0709 12:24:48.314960 (+    12us) write_op.cc:260] PREPARE: finished
0709 12:24:48.315070 (+   110us) write_op.cc:270] Start()
0709 12:24:48.315146 (+    76us) write_op.cc:276] Timestamp: P: 1783599888315028 usec, L: 0
0709 12:24:48.315159 (+    13us) op_driver.cc:348] REPLICATION: starting
0709 12:24:48.315729 (+   570us) log.cc:844] Serialized 12295 byte log entry
0709 12:24:49.124061 (+808332us) op_driver.cc:464] REPLICATION: finished
0709 12:24:49.422053 (+297992us) write_op.cc:301] APPLY: starting
0709 12:24:49.477714 (+ 55661us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:49.559314 (+ 81600us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:49.559420 (+   106us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:49.883808 (+324388us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:49.942409 (+ 58601us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=60
0709 12:24:49.942458 (+    49us) write_op.cc:312] APPLY: finished
0709 12:24:50.108383 (+165925us) log.cc:844] Serialized 200 byte log entry
0709 12:24:50.272631 (+164248us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:50.411990 (+139359us) write_op.cc:454] Released schema lock
0709 12:24:50.450450 (+ 38460us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:50.530533 (+ 80083us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:50.539031 (+  8498us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":459212,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":251565,"apply.run_cpu_time_us":25821,"apply.run_wall_time_us":1100206,"num_ops":30,"prepare.queue_time_us":432885,"prepare.run_cpu_time_us":7181,"prepare.run_wall_time_us":135779,"raft.queue_time_us":243080,"raft.run_cpu_time_us":8650,"raft.run_wall_time_us":181894,"replication_time_us":758077,"spinlock_wait_cycles":53120,"thread_start_us":531770,"threads_started":5,"wal-append.queue_time_us":151354,"wal-append.run_cpu_time_us":77054,"wal-append.run_wall_time_us":4703428}]]}
I20260709 12:24:54.876809 26401 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:24:53.860308 26402 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:54.878862 26402 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:54.878742 25759 raft_consensus.cc:2468] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 10.
I20260709 12:24:54.880198 30034 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.880868 30037 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:53.740985 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:53.614709 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:53.986872 29316 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:53.700093 29686 raft_consensus.cc:3060] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:53.747421 29694 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:54.896785 29694 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:53.407727 29802 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:24:54.008701 29810 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.013s	sys 0.010s
W20260709 12:24:54.904381 25858 debug-util.cc:398] Leaking SignalData structure 0x7b080020c460 after lost signal to thread 26463
W20260709 12:24:54.904758 25858 debug-util.cc:398] Leaking SignalData structure 0x7b08003ca200 after lost signal to thread 26464
W20260709 12:24:54.904803 29810 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.506s	user 0.014s	sys 0.011s
I20260709 12:24:53.814955 29842 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.906247 29842 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:54.016413 29852 consensus_meta.cc:287] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.710s	user 0.015s	sys 0.000s
I20260709 12:24:54.909143 29852 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:53.857141 29909 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:54.912844 29909 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:54.914886 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 100842us
I20260709 12:24:54.915329 29909 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:53.651003 29921 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:54.918785 29842 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:53.388406 29934 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:54.920349 29934 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:54.923012 29934 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:53.412397 29940 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:54.925989 29940 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:24:54.127610 29942 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.742s	user 0.025s	sys 0.004s
W20260709 12:24:54.929176 29942 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.544s	user 0.028s	sys 0.004s
I20260709 12:24:53.668105 29979 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:53.943519 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:53.877032 29905 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:54.933670 26431 raft_consensus.cc:3060] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:54.911785 29852 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:54.934204 29905 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:54.935120 29909 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.868227 29907 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:54.936064 29909 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:54.936637 29907 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:53.968474 29813 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:54.959867 29813 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:53.857687 29931 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.978112 29967 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.434237 29990 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:53.867219 29898 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.984694 29898 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:54.985221 29990 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:54.985965 25757 raft_consensus.cc:1240] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:54.986909 29898 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:54.987488 29898 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:54.987844 25757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48606 (request call id 1014) took 1612 ms. Trace:
I20260709 12:24:54.987988 29898 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:54.988263 25757 rpcz_store.cc:276] 0709 12:24:53.375542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.375689 (+   147us) service_pool.cc:224] Handling call
0709 12:24:53.377661 (+  1972us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:54.986356 (+1608695us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:54.987632 (+  1276us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b54003971d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:54.987787 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3698381056}
I20260709 12:24:54.990155 29898 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:53.935019 29922 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:53.917375 30007 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.992570 29922 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:54.969578 29967 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:53.920509 30023 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.969594 30025 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.453081 29923 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:53.614472 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:53.896134 30021 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.623632 29976 consensus_queue.cc:1048] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:54.993193 30007 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:55.001040 29821 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.001227 29802 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:55.001626 29821 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:55.002357 25677 raft_consensus.cc:2368] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 12. Current term is 13.
I20260709 12:24:54.056988 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:55.012265 29990 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.013754 29990 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:53.638556 30001 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.016918 30001 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:55.019274 30001 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:53.923245 30019 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.021533 30019 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:55.022655 26430 raft_consensus.cc:2468] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 10.
I20260709 12:24:53.970022 30026 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:55.024493 26430 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36518 (request call id 887) took 1408 ms (client timeout 1721 ms). Trace:
I20260709 12:24:55.024756 30026 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:55.024914 26430 rpcz_store.cc:269] 0709 12:24:53.615707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.056738 (+441031us) service_pool.cc:224] Handling call
0709 12:24:55.024321 (+967583us) spinlock_profiling.cc:243] Waited 9.25 ms on lock 0x7b54002e8bd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:55.024435 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21286144}
I20260709 12:24:55.026116 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:55.026690 26430 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 9.
I20260709 12:24:53.956260 30024 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:55.027983 30024 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:55.030169 30024 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:53.906698 30022 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.031509 30022 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:55.033665 30022 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:53.901471 30018 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:55.037195 30018 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:55.037724 29821 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:53.978112 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:55.040304 30018 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:54.010460 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:55.042176 26434 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36518 (request call id 879) took 1436 ms (client timeout 1539 ms). Trace:
W20260709 12:24:55.042536 26434 rpcz_store.cc:269] 0709 12:24:53.606090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.010099 (+404009us) service_pool.cc:224] Handling call
0709 12:24:55.042112 (+1032013us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:53.618394 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:54.545322 25708 debug-util.cc:398] Leaking SignalData structure 0x7b0800212a80 after lost signal to thread 24537
I20260709 12:24:54.566258 25679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2320) took 1231 ms. Trace:
I20260709 12:24:54.622295 25572 maintenance_manager.cc:643] P 496fd6924b624e77b03ccfd15653d47b: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.002s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":348,"lbm_reads_lt_1ms":4}
I20260709 12:24:54.623219 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:55.044946 26439 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36518 (request call id 880) took 1438 ms (client timeout 1862 ms). Trace:
I20260709 12:24:54.632643 30005 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.045516 25680 raft_consensus.cc:2468] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 11.
I20260709 12:24:55.043550 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:55.046185 25680 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40230 (request call id 1611) took 1644 ms (client timeout 1861 ms). Trace:
I20260709 12:24:55.045866 30005 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:55.046470 26434 raft_consensus.cc:2468] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 6.
W20260709 12:24:55.046607 25680 rpcz_store.cc:269] 0709 12:24:53.401278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.622959 (+1221681us) service_pool.cc:224] Handling call
0709 12:24:55.046115 (+423156us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:55.047075 26434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36508 (request call id 1041) took 1083 ms. Trace:
W20260709 12:24:55.045378 26439 rpcz_store.cc:269] 0709 12:24:53.606472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.617222 (+ 10750us) service_pool.cc:224] Handling call
0709 12:24:55.044888 (+1427666us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:55.048266 30005 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:24:55.045562 25708 debug-util.cc:398] Leaking SignalData structure 0x7b080010e040 after lost signal to thread 25618
I20260709 12:24:54.672863 30030 consensus_queue.cc:1048] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:24:55.047441 26434 rpcz_store.cc:276] 0709 12:24:53.963790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.043251 (+1079461us) service_pool.cc:224] Handling call
0709 12:24:55.047009 (+  3758us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:55.044835 25679 rpcz_store.cc:276] 0709 12:24:53.334554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.911512 (+576958us) service_pool.cc:224] Handling call
0709 12:24:53.919567 (+  8055us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:53.919883 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:53.919914 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:54.282235 (+362321us) spinlock_profiling.cc:243] Waited 360 ms on lock 0x7b2c00013008. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9845aa11 00007f5d9846a372 00007f5d99b9ca01 00007f5d99b6143a 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2
0709 12:24:54.282693 (+   458us) log.cc:844] Serialized 26 byte log entry
0709 12:24:54.560898 (+278205us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:54.560932 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:54.560996 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:54.565948 (+  4952us) raft_consensus.cc:1685] finished
0709 12:24:54.565970 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:54.566193 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":24972,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"spinlock_wait_cycles":827831680,"thread_start_us":277836,"threads_started":1,"wal-append.queue_time_us":278954}
W20260709 12:24:55.050225 25708 debug-util.cc:398] Leaking SignalData structure 0x7b0800115f20 after lost signal to thread 25711
W20260709 12:24:55.050534 25708 debug-util.cc:398] Leaking SignalData structure 0x7b08001b1040 after lost signal to thread 25712
I20260709 12:24:55.050825 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:55.051545 25679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40230 (request call id 1621) took 1622 ms. Trace:
I20260709 12:24:55.051991 25679 rpcz_store.cc:276] 0709 12:24:53.429437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.050578 (+1621141us) service_pool.cc:224] Handling call
0709 12:24:55.051487 (+   909us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:55.052882 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:54.703672 25681 rpcz_store.cc:269] 0709 12:24:53.376384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.073972 (+697588us) service_pool.cc:224] Handling call
0709 12:24:54.703212 (+629240us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:55.047708 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:55.054427 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:54.720988 25683 rpcz_store.cc:276] 0709 12:24:53.401560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.710425 (+1308865us) service_pool.cc:224] Handling call
0709 12:24:54.711616 (+  1191us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:55.055037 25680 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40230 (request call id 1610) took 1654 ms (client timeout 2162 ms). Trace:
I20260709 12:24:55.055601 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:55.050047 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:55.056414 25683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40230 (request call id 1622) took 1623 ms. Trace:
I20260709 12:24:55.056599 26434 raft_consensus.cc:2393] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 9: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:55.056820 25683 rpcz_store.cc:276] 0709 12:24:53.435109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.055357 (+1620248us) service_pool.cc:224] Handling call
0709 12:24:55.056358 (+  1001us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:55.057125 26434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36508 (request call id 1031) took 1095 ms. Trace:
I20260709 12:24:55.057569 26434 rpcz_store.cc:276] 0709 12:24:53.962050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.049817 (+1087767us) service_pool.cc:224] Handling call
0709 12:24:55.057067 (+  7250us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:55.057879 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:55.058571 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:54.840430 25754 rpcz_store.cc:269] 0709 12:24:50.511794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.512539 (+   745us) service_pool.cc:224] Handling call
0709 12:24:54.246378 (+3733839us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b5400396cd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:54.246575 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":353406720}
I20260709 12:24:55.055063 25681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 2338) took 1676 ms. Trace:
I20260709 12:24:55.059626 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:55.059422 25681 rpcz_store.cc:276] 0709 12:24:53.378770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.054128 (+1675358us) service_pool.cc:224] Handling call
0709 12:24:55.055009 (+   881us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:55.060850 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:55.061352 25681 raft_consensus.cc:1275] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:24:55.061474 25754 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 13.
I20260709 12:24:55.062002 25681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2337) took 1683 ms. Trace:
W20260709 12:24:55.055442 25680 rpcz_store.cc:269] 0709 12:24:53.401017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.047414 (+1646397us) service_pool.cc:224] Handling call
0709 12:24:55.054979 (+  7565us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:54.839403 25760 rpcz_store.cc:276] 0709 12:24:53.341095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.341218 (+   123us) service_pool.cc:224] Handling call
0709 12:24:54.838774 (+1497556us) spinlock_profiling.cc:243] Waited 3.59 ms on lock 0x7b54003a66d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:54.838859 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8262016}
I20260709 12:24:55.064517 26434 raft_consensus.cc:2410] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:24:54.843359 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:55.068414 25684 raft_consensus.cc:2468] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 9.
W20260709 12:24:55.068994 25684 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40230 (request call id 1613) took 1667 ms (client timeout 2143 ms). Trace:
W20260709 12:24:55.069404 25684 rpcz_store.cc:269] 0709 12:24:53.401850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.843179 (+1441329us) service_pool.cc:224] Handling call
0709 12:24:55.068932 (+225753us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:54.845542 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:55.072247 25761 raft_consensus.cc:2468] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 9.
I20260709 12:24:55.073472 25761 raft_consensus.cc:1240] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:55.074812 25761 raft_consensus.cc:1275] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 12:24:54.848137 29767 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:55.076227 29767 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:55.078573 29767 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:54.848613 29755 consensus_queue.cc:1048] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:54.850198 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:55.082813 25763 raft_consensus.cc:1240] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:54.854650 25649 leader_election.cc:400] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 election: Vote denied by peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267) with higher term. Message: Invalid argument: T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for earlier term 8. Current term is 9.
W20260709 12:24:55.084203 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 229696us
I20260709 12:24:55.086966 30022 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.864003 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:55.087507 30022 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:55.088383 25762 raft_consensus.cc:2393] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 13: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:55.089931 30022 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:55.090507 25762 raft_consensus.cc:1275] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:24:54.864593 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:55.091816 25758 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:54.865034 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:55.097043 25755 raft_consensus.cc:1275] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:24:54.872041 25686 raft_consensus.cc:2468] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 10.
W20260709 12:24:55.098966 25686 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40230 (request call id 1614) took 1696 ms (client timeout 2157 ms). Trace:
W20260709 12:24:55.099368 25686 rpcz_store.cc:269] 0709 12:24:53.402161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.871095 (+1468934us) service_pool.cc:224] Handling call
0709 12:24:55.098910 (+227815us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:55.100680 25686 raft_consensus.cc:1275] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:24:55.101222 25686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40230 (request call id 1618) took 1697 ms. Trace:
I20260709 12:24:55.101531 25686 rpcz_store.cc:276] 0709 12:24:53.403357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.100067 (+1696710us) service_pool.cc:224] Handling call
0709 12:24:55.100373 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:55.101002 (+   629us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.101171 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:54.880774 30034 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:55.104465 30034 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:53.612700 26433 raft_consensus.cc:1240] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 14. Current term is 15. Ops: []
I20260709 12:24:55.106423 26433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36518 (request call id 878) took 1699 ms. Trace:
I20260709 12:24:55.106768 26433 rpcz_store.cc:276] 0709 12:24:53.406798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.406937 (+   139us) service_pool.cc:224] Handling call
0709 12:24:53.407311 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:55.106126 (+1698815us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.106339 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:54.881726 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:54.884702 26436 raft_consensus.cc:2393] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 11: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
W20260709 12:24:55.108788 26436 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36518 (request call id 888) took 1492 ms (client timeout 1660 ms). Trace:
W20260709 12:24:55.109162 26436 rpcz_store.cc:269] 0709 12:24:53.615857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.740641 (+124784us) service_pool.cc:224] Handling call
0709 12:24:55.108729 (+1368088us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:54.885106 30037 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:55.112074 29810 raft_consensus.cc:2804] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:55.112679 29810 raft_consensus.cc:697] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 11 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:55.113622 29810 consensus_queue.cc:237] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:54.894004 25582 catalog_manager.cc:5697] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:54.916988 29694 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:54.919276 29921 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:54.660072 25650 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
W20260709 12:24:55.119392 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 459377us
I20260709 12:24:55.122267 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:55.122972 25759 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 6.
I20260709 12:24:54.930739 26438 raft_consensus.cc:2468] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 12.
I20260709 12:24:55.124055 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:55.125172 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:55.125409 26438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36518 (request call id 883) took 1511 ms. Trace:
I20260709 12:24:55.125746 25759 raft_consensus.cc:2468] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 9.
I20260709 12:24:55.125972 26438 rpcz_store.cc:276] 0709 12:24:53.614368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.614473 (+   105us) service_pool.cc:224] Handling call
0709 12:24:55.125206 (+1510733us) spinlock_profiling.cc:243] Waited 45.5 ms on lock 0x7b5400316ad4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:55.125338 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":104543104}
I20260709 12:24:55.126631 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:54.931377 29316 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:54.932052 30043 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.127573 30043 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:55.128144 29694 raft_consensus.cc:2804] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:55.128594 29694 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:55.128990 29694 raft_consensus.cc:3060] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:55.130162 30043 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:54.933598 29979 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:53.633411 29933 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.127429 29316 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:55.131712 29933 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:54.942512 26431 raft_consensus.cc:2468] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 10.
W20260709 12:24:54.945947 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 73864.2us
W20260709 12:24:54.952689 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 76004.9us
I20260709 12:24:54.953475 30041 consensus_queue.cc:1048] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:54.954654 29907 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:55.133827 29316 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:54.956265 30045 consensus_queue.cc:1048] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:24:55.134342 26431 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 1061) took 1856 ms (client timeout 1559 ms). Trace:
W20260709 12:24:55.134878 25800 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.245.130:37267 timed out after 1.688s (SENT) [suppressed 16 similar messages]
W20260709 12:24:55.134744 26431 rpcz_store.cc:269] 0709 12:24:53.277532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.943247 (+665715us) service_pool.cc:224] Handling call
0709 12:24:55.134273 (+1191026us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:55.139074 26401 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:54.962780 29813 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:54.967828 29931 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:55.141040 30022 consensus_queue.cc:1059] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:55.141613 29931 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:54.970302 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 54740.1us
I20260709 12:24:55.141881 30042 raft_consensus.cc:2804] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:55.142526 29979 raft_consensus.cc:3055] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:24:55.142940 29979 raft_consensus.cc:740] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:55.134711 25650 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:55.145354 25833 raft_consensus.cc:1275] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
W20260709 12:24:54.971526 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 91713.2us
I20260709 12:24:54.980226 29909 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:54.978065 29905 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:54.013438 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:54.999797 30044 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.002595 30007 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:54.995190 29967 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:55.147990 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:55.003803 25677 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40230 (request call id 1608) took 1607 ms (client timeout 1837 ms). Trace:
I20260709 12:24:55.148291 30044 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:55.148615 25677 rpcz_store.cc:269] 0709 12:24:53.396660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.618638 (+1221978us) service_pool.cc:224] Handling call
0709 12:24:55.003633 (+384995us) spinlock_profiling.cc:243] Waited 383 ms on lock 0x7b5400232654. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:55.003751 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":880428800}
W20260709 12:24:55.148020 26432 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36518 (request call id 881) took 1534 ms (client timeout 1954 ms). Trace:
I20260709 12:24:55.005497 29802 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:24:55.149426 26432 rpcz_store.cc:269] 0709 12:24:53.613826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.013117 (+399291us) service_pool.cc:224] Handling call
0709 12:24:55.147964 (+1134847us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:55.149842 29755 raft_consensus.cc:3060] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:54.995555 30023 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:55.152220 30023 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:54.996441 30025 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:55.152638 25835 raft_consensus.cc:1275] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 12 index: 5. (index mismatch)
I20260709 12:24:55.154174 30025 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:54.997175 29923 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:54.998109 26437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36518 (request call id 882) took 1384 ms. Trace:
I20260709 12:24:55.155889 30044 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:55.156067 26437 rpcz_store.cc:276] 0709 12:24:53.614090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.614197 (+   107us) service_pool.cc:224] Handling call
0709 12:24:54.998035 (+1383838us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:55.156981 29802 consensus_queue.cc:1059] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:55.157416 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:55.158176 25832 raft_consensus.cc:2468] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 8.
I20260709 12:24:55.158350 30007 raft_consensus.cc:3055] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:24:55.158828 30007 raft_consensus.cc:740] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:55.111706 30037 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:55.159768 30007 consensus_queue.cc:260] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:55.161475 29933 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:55.161720 30007 raft_consensus.cc:3060] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:55.143803 29979 consensus_queue.cc:260] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:55.163899 29979 raft_consensus.cc:3060] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:55.166512 30034 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.167059 30034 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:55.166558 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:55.168833 25677 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 6.
I20260709 12:24:55.169162 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:54.993136 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:54.994699 29922 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:55.012137 30036 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:55.015812 29990 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:54.998968 30021 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:55.194738 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:55.195391 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:55.195400 25832 raft_consensus.cc:2468] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 9.
I20260709 12:24:55.195969 25835 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:55.026760 30026 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:55.027240 26430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36518 (request call id 889) took 1411 ms. Trace:
I20260709 12:24:53.822912 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:55.034617 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 88928.8us
I20260709 12:24:55.023720 30019 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:55.041097 30018 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:55.220651 25801 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:55.220992 30018 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:55.220573 26435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36518 (request call id 884) took 1605 ms. Trace:
I20260709 12:24:55.221647 25801 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:55.222035 26435 rpcz_store.cc:276] 0709 12:24:53.615238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.822596 (+207358us) service_pool.cc:224] Handling call
0709 12:24:55.220514 (+1397918us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:55.222470 25801 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:55.223192 26435 raft_consensus.cc:1240] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:55.223799 26435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 1032) took 1261 ms. Trace:
I20260709 12:24:55.223533 29909 raft_consensus.cc:2804] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:55.223480 30018 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:54.643750 30029 raft_consensus.cc:2749] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:55.224143 29922 raft_consensus.cc:2804] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:24:55.051620 25708 debug-util.cc:398] Leaking SignalData structure 0x7b08002197e0 after lost signal to thread 25787
I20260709 12:24:54.057963 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:55.226114 25685 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 2321) took 1891 ms (client timeout 1834 ms). Trace:
I20260709 12:24:55.226186 30021 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:24:55.226485 25685 rpcz_store.cc:269] 0709 12:24:53.334859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.057690 (+722831us) service_pool.cc:224] Handling call
0709 12:24:55.226028 (+1168338us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:55.227412 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:55.227977 25685 raft_consensus.cc:2468] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 9.
I20260709 12:24:55.228869 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:55.229844 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:55.230495 25685 raft_consensus.cc:2393] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 10: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:55.231174 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:55.053557 25679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40230 (request call id 1615) took 1651 ms. Trace:
I20260709 12:24:55.208853 29755 raft_consensus.cc:2749] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:55.232050 25679 rpcz_store.cc:276] 0709 12:24:53.402444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.052662 (+1650218us) service_pool.cc:224] Handling call
0709 12:24:55.053507 (+   845us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:55.048719 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:55.232980 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:55.058743 25683 raft_consensus.cc:2393] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 13: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:54.707906 25682 rpcz_store.cc:276] 0709 12:24:53.377214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.706337 (+1329123us) service_pool.cc:224] Handling call
0709 12:24:54.707571 (+  1234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:55.233606 26439 raft_consensus.cc:2393] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 10: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:54.843955 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:54.831234 25756 rpcz_store.cc:276] 0709 12:24:53.341435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.341555 (+   120us) service_pool.cc:224] Handling call
0709 12:24:53.341876 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:53.348101 (+  6225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:53.348130 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:53.348635 (+   505us) log.cc:844] Serialized 26 byte log entry
0709 12:24:54.830433 (+1481798us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:24:54.830483 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:54.830565 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:54.830618 (+    53us) raft_consensus.cc:1685] finished
0709 12:24:54.830632 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:54.830767 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2727,"raft.queue_time_us":6997,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":156,"thread_start_us":1481392,"threads_started":1,"wal-append.queue_time_us":87073,"wal-append.run_cpu_time_us":26186,"wal-append.run_wall_time_us":1325209}
I20260709 12:24:55.234021 26439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36518 (request call id 890) took 1617 ms. Trace:
I20260709 12:24:55.062666 25681 rpcz_store.cc:276] 0709 12:24:53.378502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.060709 (+1682207us) service_pool.cc:224] Handling call
0709 12:24:55.061004 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:55.061764 (+   760us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.061951 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:55.234356 26439 rpcz_store.cc:276] 0709 12:24:53.616419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.048447 (+1432028us) service_pool.cc:224] Handling call
0709 12:24:55.233969 (+185522us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:55.116791 25582 catalog_manager.cc:5697] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 6 to 7, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 7 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:55.203866 29694 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:55.235546 25582 catalog_manager.cc:5697] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 2 to 6, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 6 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:24:55.237030 25683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 2330) took 1860 ms. Trace:
I20260709 12:24:55.237397 25683 rpcz_store.cc:276] 0709 12:24:53.376689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.057650 (+1680961us) service_pool.cc:224] Handling call
0709 12:24:55.236971 (+179321us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:55.238200 25680 raft_consensus.cc:1240] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 12. Current term is 13. Ops: []
I20260709 12:24:55.142527 30042 raft_consensus.cc:697] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 9 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:55.141911 30022 consensus_queue.cc:1048] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:24:55.243842 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:55.244525 25686 raft_consensus.cc:2468] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 9.
I20260709 12:24:55.241442 25801 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:55.171499 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:55.173830 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:55.249707 26433 raft_consensus.cc:2410] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:24:55.174154 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:55.250165 25755 raft_consensus.cc:1813] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Handling vote request from an unknown peer f82778701b464892aab92a752ed7ffdc
I20260709 12:24:55.250715 25755 raft_consensus.cc:2410] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:24:55.250589 25680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40230 (request call id 1605) took 1855 ms. Trace:
I20260709 12:24:55.182085 25757 raft_consensus.cc:2468] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 6.
I20260709 12:24:55.193965 25759 raft_consensus.cc:2410] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:24:55.196821 26430 rpcz_store.cc:276] 0709 12:24:53.616124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.025868 (+1409744us) service_pool.cc:224] Handling call
0709 12:24:55.027155 (+  1287us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:55.251243 25680 rpcz_store.cc:276] 0709 12:24:53.395368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.066914 (+1671546us) service_pool.cc:224] Handling call
0709 12:24:55.238031 (+171117us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:55.240457 (+  2426us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.250342 (+  9885us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b5400232650. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b608ad 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:55.250515 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":392802560}
I20260709 12:24:55.243072 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:55.252579 26430 raft_consensus.cc:1275] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 12:24:55.252686 25677 raft_consensus.cc:2410] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:24:55.252954 26430 pending_rounds.cc:85] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89: Aborting all ops after (but not including) 8
I20260709 12:24:55.253276 26430 pending_rounds.cc:107] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:24:55.253522 26430 raft_consensus.cc:2889] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:55.197961 25832 raft_consensus.cc:1275] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:24:55.200213 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:55.200717 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 48833.2us
I20260709 12:24:55.201526 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:55.256282 25763 raft_consensus.cc:2468] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 12.
I20260709 12:24:55.172264 29923 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:55.205084 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:55.261394 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:55.262128 25829 raft_consensus.cc:2393] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 10: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:55.262226 25832 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 13.
I20260709 12:24:55.205964 26434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36518 (request call id 885) took 1590 ms. Trace:
I20260709 12:24:55.263406 26434 rpcz_store.cc:276] 0709 12:24:53.615416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.058330 (+1442914us) service_pool.cc:224] Handling call
0709 12:24:55.205901 (+147571us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:55.264637 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:55.264822 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:55.206554 25758 raft_consensus.cc:2410] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 13 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:24:55.265228 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:55.200413 30036 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:55.207981 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:55.209077 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:55.210031 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:55.269945 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:55.270062 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:55.270143 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:55.270641 26431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36508 (request call id 1039) took 1307 ms. Trace:
I20260709 12:24:55.270960 26431 rpcz_store.cc:276] 0709 12:24:53.963476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.135635 (+1172159us) service_pool.cc:224] Handling call
0709 12:24:55.209864 (+ 74229us) spinlock_profiling.cc:243] Waited 37.6 ms on lock 0x7b5800004598. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d96a3cb71 00007f5d96a3ca22 00007f5d9f9558d9 00007f5d9eaafee0 00007f5d9eb790ab 00007f5d9eb79131 00007f5d9eb270a0 00007f5d9eb26984 00007f5d980a16d4 00007f5d980a1662
0709 12:24:55.270586 (+ 60722us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":86480128}
I20260709 12:24:55.271353 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:55.210961 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:55.272328 26432 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 9.
I20260709 12:24:55.272832 26432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36508 (request call id 1035) took 1310 ms. Trace:
I20260709 12:24:55.273138 26432 rpcz_store.cc:276] 0709 12:24:53.962859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.150161 (+1187302us) service_pool.cc:224] Handling call
0709 12:24:55.210834 (+ 60673us) spinlock_profiling.cc:243] Waited 23.5 ms on lock 0x7b5800004598. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d96a3cb71 00007f5d96a3ca22 00007f5d9f9558d9 00007f5d9eaafee0 00007f5d9eb790ab 00007f5d9eb79131 00007f5d9eb270a0 00007f5d9eb26984 00007f5d980a16d4 00007f5d980a1662
0709 12:24:55.272769 (+ 61935us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53949824}
I20260709 12:24:55.213675 29802 consensus_queue.cc:1048] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:24:55.215178 25649 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:55.224354 29909 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:55.224239 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:55.281256 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:55.281816 25831 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 9.
I20260709 12:24:55.225103 29922 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:55.225297 25708 debug-util.cc:398] Leaking SignalData structure 0x7b0800162740 after lost signal to thread 25788
I20260709 12:24:55.239991 25678 raft_consensus.cc:2368] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 9. Current term is 10.
I20260709 12:24:55.062691 25754 raft_consensus.cc:1240] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 9. Current term is 10. Ops: []
W20260709 12:24:55.284116 25708 debug-util.cc:398] Leaking SignalData structure 0x7b08003250c0 after lost signal to thread 25861
W20260709 12:24:55.284394 25708 debug-util.cc:398] Leaking SignalData structure 0x7b0800302f40 after lost signal to thread 25862
I20260709 12:24:55.284346 25754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 2895) took 1004 ms. Trace:
I20260709 12:24:55.284823 25754 rpcz_store.cc:276] 0709 12:24:54.279457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.062207 (+782750us) service_pool.cc:224] Handling call
0709 12:24:55.062508 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:55.284092 (+221584us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.284297 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:55.224172 26435 rpcz_store.cc:276] 0709 12:24:53.962341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.222725 (+1260384us) service_pool.cc:224] Handling call
0709 12:24:55.223025 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:55.223565 (+   540us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.223753 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:55.181473 25761 raft_consensus.cc:1240] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:55.253118 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
W20260709 12:24:55.285625 25708 debug-util.cc:398] Leaking SignalData structure 0x7b08002f53c0 after lost signal to thread 26463
I20260709 12:24:55.285996 25679 raft_consensus.cc:2376] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 9. Re-sending same reply.
W20260709 12:24:55.204980 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 59269.1us
I20260709 12:24:55.258766 26401 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:55.260110 29931 raft_consensus.cc:2804] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:55.289435 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:55.266036 26433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36508 (request call id 1033) took 1303 ms. Trace:
I20260709 12:24:55.290426 26433 rpcz_store.cc:276] 0709 12:24:53.962527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.107748 (+1145221us) service_pool.cc:224] Handling call
0709 12:24:55.265969 (+158221us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:55.267120 26439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 1034) took 1304 ms. Trace:
I20260709 12:24:55.291178 26439 rpcz_store.cc:276] 0709 12:24:53.962703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.234981 (+1272278us) service_pool.cc:224] Handling call
0709 12:24:55.266490 (+ 31509us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:55.266732 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:55.266769 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:55.266827 (+    58us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:24:55.266872 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.266941 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:55.267060 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:55.274250 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:55.292299 25683 raft_consensus.cc:2468] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 10.
I20260709 12:24:55.274885 26438 raft_consensus.cc:2393] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 9: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:55.275343 26436 raft_consensus.cc:2393] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 9: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:55.293905 26436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36518 (request call id 886) took 1678 ms. Trace:
I20260709 12:24:55.294348 26436 rpcz_store.cc:276] 0709 12:24:53.615560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.109791 (+1494231us) service_pool.cc:224] Handling call
0709 12:24:55.207792 (+ 98001us) spinlock_profiling.cc:243] Waited 63.7 ms on lock 0x7b5800004598. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d96a3cb71 00007f5d96a3ca22 00007f5d9f9558d9 00007f5d9eaafee0 00007f5d9eb790ab 00007f5d9eb79131 00007f5d9eb270a0 00007f5d9eb26984 00007f5d980a16d4 00007f5d980a1662
0709 12:24:55.293828 (+ 86036us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":146506496}
I20260709 12:24:55.277468 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:55.296026 25832 raft_consensus.cc:2468] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 12.
I20260709 12:24:55.277575 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:55.277782 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 62687.2us
I20260709 12:24:55.297806 25649 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:55.278644 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:55.298952 25763 raft_consensus.cc:2468] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 9.
I20260709 12:24:55.279418 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:55.280037 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:55.299973 25680 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 6.
I20260709 12:24:55.280344 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:55.301478 25685 raft_consensus.cc:2410] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:24:55.273630 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:55.280807 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:55.265924 26430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 1036) took 1302 ms. Trace:
I20260709 12:24:55.302558 26430 rpcz_store.cc:276] 0709 12:24:53.963015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.252015 (+1289000us) service_pool.cc:224] Handling call
0709 12:24:55.252290 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:55.265711 (+ 13421us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.265874 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:55.288523 25759 raft_consensus.cc:2468] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 9.
I20260709 12:24:55.304402 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:55.304845 25649 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:55.305627 25679 raft_consensus.cc:1240] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:24:55.267887 29905 raft_consensus.cc:2804] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:24:55.306463 25678 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40230 (request call id 1609) took 1905 ms (client timeout 2003 ms). Trace:
I20260709 12:24:55.306550 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:55.306898 25678 rpcz_store.cc:269] 0709 12:24:53.400704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.823902 (+1423198us) service_pool.cc:224] Handling call
0709 12:24:55.306410 (+482508us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:55.312171 25837 raft_consensus.cc:2393] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 13: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:55.312974 26438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36508 (request call id 1044) took 1347 ms. Trace:
I20260709 12:24:55.313484 26438 rpcz_store.cc:276] 0709 12:24:53.965466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.126938 (+1161472us) service_pool.cc:224] Handling call
0709 12:24:55.208882 (+ 81944us) spinlock_profiling.cc:243] Waited 46.4 ms on lock 0x7b5800004598. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d96a3cb71 00007f5d96a3ca22 00007f5d9f9558d9 00007f5d9eaafee0 00007f5d9eb790ab 00007f5d9eb79131 00007f5d9eb270a0 00007f5d9eb26984 00007f5d980a16d4 00007f5d980a1662
0709 12:24:55.312895 (+104013us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":106817280}
I20260709 12:24:55.241122 30037 consensus_queue.cc:1048] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:24:55.318638 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:55.319195 25829 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:24:55.290045 25761 raft_consensus.cc:2468] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 8.
I20260709 12:24:55.322209 25649 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:24:55.322666 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:55.323277 26434 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 11.
I20260709 12:24:55.324105 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:55.289453 25708 debug-util.cc:398] Leaking SignalData structure 0x7b08002c8680 after lost signal to thread 26464
W20260709 12:24:55.326332 25708 debug-util.cc:398] Leaking SignalData structure 0x7b08003c3060 after lost signal to thread 29953
I20260709 12:24:55.326259 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:55.326823 25708 debug-util.cc:398] Leaking SignalData structure 0x7b08003f2260 after lost signal to thread 29970
I20260709 12:24:55.324683 26434 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 9.
I20260709 12:24:55.328784 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:55.329257 26434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 1038) took 1365 ms. Trace:
I20260709 12:24:55.329586 26434 rpcz_store.cc:276] 0709 12:24:53.963326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.328502 (+1365176us) service_pool.cc:224] Handling call
0709 12:24:55.328774 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:55.328949 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:55.328974 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:55.329015 (+    41us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:55.329043 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.329094 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:55.329209 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:55.319728 25829 raft_consensus.cc:606] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 9 LEADER]: Received request to transfer leadership to TS 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:55.331856 26401 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:55.332510 25685 raft_consensus.cc:1275] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:24:55.333062 26401 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:55.286026 29909 raft_consensus.cc:3060] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:55.278780 29755 raft_consensus.cc:2749] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:55.305929 29931 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:55.344135 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:55.333866 25686 raft_consensus.cc:1275] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:24:55.334714 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:55.335333 26432 raft_consensus.cc:1240] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:55.288537 29922 raft_consensus.cc:3060] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:55.348693 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:55.349293 25758 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 8.
I20260709 12:24:55.350409 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:55.351116 25758 raft_consensus.cc:3060] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:55.346753 26435 raft_consensus.cc:2468] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 7.
I20260709 12:24:55.338985 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:55.353391 25754 raft_consensus.cc:2468] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 11.
I20260709 12:24:55.288738 29694 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:55.306631 29923 raft_consensus.cc:2804] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:24:55.328401 29990 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:55.349220 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:55.362531 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:55.333223 26434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 1040) took 1369 ms. Trace:
I20260709 12:24:55.362833 25685 raft_consensus.cc:2468] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 8.
I20260709 12:24:55.361462 29923 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:55.368245 29923 raft_consensus.cc:3060] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:24:55.369697 25801 leader_election.cc:336] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 1.953s (SENT)
I20260709 12:24:55.336903 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:55.366508 26434 rpcz_store.cc:276] 0709 12:24:53.963638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.330542 (+1366904us) service_pool.cc:224] Handling call
0709 12:24:55.332795 (+  2253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:55.332957 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:55.332982 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:55.333019 (+    37us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:55.333050 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.333094 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:55.333176 (+    82us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:55.355520 26432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 1037) took 1392 ms. Trace:
I20260709 12:24:55.357506 25649 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:55.358210 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:55.333880 25726 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:55.359041 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:55.373587 26433 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 17.
I20260709 12:24:55.372519 26432 rpcz_store.cc:276] 0709 12:24:53.963169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.273893 (+1310724us) service_pool.cc:224] Handling call
0709 12:24:55.327729 (+ 53836us) spinlock_profiling.cc:243] Waited 7.26 ms on lock 0x7b5800004598. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d96a3cb71 00007f5d96a3ca22 00007f5d9f9558d9 00007f5d9eaafee0 00007f5d9eb790ab 00007f5d9eb79131 00007f5d9eb3afc0 00007f5d9eb25929 00007f5d9eb253d2 00007f5d9809cbd4
0709 12:24:55.327897 (+   168us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:55.347513 (+ 19616us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.355440 (+  7927us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16708992}
I20260709 12:24:55.359474 25681 raft_consensus.cc:3055] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:55.374646 25681 raft_consensus.cc:740] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:55.375594 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:55.376361 25756 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 11.
I20260709 12:24:55.360159 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:55.337284 29671 raft_consensus.cc:2804] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:55.371656 25582 catalog_manager.cc:5697] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:24:55.384500 25582 catalog_manager.cc:5697] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 4 to 6, leader changed from a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 6 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:55.386842 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:55.372682 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:55.379824 25649 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:55.380771 25801 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:55.363162 25763 raft_consensus.cc:2468] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 11.
I20260709 12:24:55.371831 26436 raft_consensus.cc:2468] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 9.
I20260709 12:24:55.342993 30026 raft_consensus.cc:2804] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:55.382257 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:55.396386 26432 raft_consensus.cc:2468] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 8.
I20260709 12:24:55.338989 29896 raft_consensus.cc:2749] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:55.382583 26401 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:55.339170 30019 raft_consensus.cc:2804] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:55.389122 26437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36518 (request call id 891) took 1771 ms. Trace:
I20260709 12:24:55.347870 30007 raft_consensus.cc:2804] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:55.389902 29316 consensus_queue.cc:1048] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:24:55.390690 25784 debug-util.cc:398] Leaking SignalData structure 0x7b0800201c60 after lost signal to thread 24534
I20260709 12:24:55.348381 29931 raft_consensus.cc:3060] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:55.375644 25681 consensus_queue.cc:260] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:55.397653 25649 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:24:55.424665 25784 debug-util.cc:398] Leaking SignalData structure 0x7b0800201a60 after lost signal to thread 24537
W20260709 12:24:55.449939 25784 debug-util.cc:398] Leaking SignalData structure 0x7b0800201e00 after lost signal to thread 25618
I20260709 12:24:55.449810 26437 rpcz_store.cc:276] 0709 12:24:53.617646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.156799 (+1539153us) service_pool.cc:224] Handling call
0709 12:24:55.217517 (+ 60718us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b5800004598. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d96a3cb71 00007f5d96a3ca22 00007f5d9f9558d9 00007f5d9eaafee0 00007f5d9eb790ab 00007f5d9eb79131 00007f5d9eb3afc0 00007f5d9eb25929 00007f5d9eb253d2 00007f5d9809cbd4
0709 12:24:55.217784 (+   267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:55.218331 (+   547us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:55.218370 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:55.218985 (+   615us) log.cc:844] Serialized 26 byte log entry
0709 12:24:55.341889 (+122904us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:55.341925 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.342434 (+   509us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:55.374424 (+ 31990us) raft_consensus.cc:1685] finished
0709 12:24:55.374444 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:55.389053 (+ 14609us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2090,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"spinlock_wait_cycles":37697408,"thread_start_us":122484,"threads_started":1,"wal-append.queue_time_us":146057}
W20260709 12:24:55.451206 25784 debug-util.cc:398] Leaking SignalData structure 0x7b0800201fc0 after lost signal to thread 25711
I20260709 12:24:55.424021 26430 raft_consensus.cc:1240] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:24:55.451848 26430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 1042) took 1487 ms. Trace:
I20260709 12:24:55.452195 26430 rpcz_store.cc:276] 0709 12:24:53.964750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.423298 (+1458548us) service_pool.cc:224] Handling call
0709 12:24:55.423705 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:55.451601 (+ 27896us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.451796 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:55.397528 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:55.426733 26433 raft_consensus.cc:2410] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 12:24:55.448026 26402 leader_election.cc:336] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Timed out: RequestConsensusVote RPC to 127.23.245.131:36237 timed out after 1.718s (SENT)
W20260709 12:24:55.448625 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 67962.2us
I20260709 12:24:55.455683 25681 raft_consensus.cc:3060] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:55.430766 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 96936.7us
I20260709 12:24:55.393064 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:55.460356 26435 raft_consensus.cc:2468] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 10.
I20260709 12:24:55.442351 25582 catalog_manager.cc:5697] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 1 to 4, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 4 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } }
I20260709 12:24:55.428077 26401 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:24:55.465072 25784 debug-util.cc:398] Leaking SignalData structure 0x7b0800201f00 after lost signal to thread 25712
I20260709 12:24:55.458106 25726 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:24:55.466284 25784 debug-util.cc:398] Leaking SignalData structure 0x7b08003d1100 after lost signal to thread 25787
I20260709 12:24:55.397969 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:55.465495 26401 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:55.465339 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:55.469085 25837 raft_consensus.cc:3060] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:24:55.469389 25784 debug-util.cc:398] Leaking SignalData structure 0x7b0800369420 after lost signal to thread 25788
I20260709 12:24:55.469492 26435 raft_consensus.cc:1240] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:55.470108 26436 raft_consensus.cc:1275] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:24:55.470676 26436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 1045) took 1504 ms. Trace:
W20260709 12:24:55.470783 25784 debug-util.cc:398] Leaking SignalData structure 0x7b08003cf180 after lost signal to thread 25861
W20260709 12:24:55.471329 25784 debug-util.cc:398] Leaking SignalData structure 0x7b08003337c0 after lost signal to thread 25862
W20260709 12:24:55.472860 25784 debug-util.cc:398] Leaking SignalData structure 0x7b0800366e20 after lost signal to thread 26463
W20260709 12:24:55.473839 25784 debug-util.cc:398] Leaking SignalData structure 0x7b0800408720 after lost signal to thread 26464
I20260709 12:24:55.471012 26436 rpcz_store.cc:276] 0709 12:24:53.966107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.448087 (+1481980us) service_pool.cc:224] Handling call
0709 12:24:55.448401 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:55.470458 (+ 22057us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.470623 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:55.388397 26434 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 12.
W20260709 12:24:55.474690 25784 debug-util.cc:398] Leaking SignalData structure 0x7b08003b5940 after lost signal to thread 29934
I20260709 12:24:55.455677 25686 raft_consensus.cc:2410] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 12:24:55.478277 26402 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:55.480509 25784 debug-util.cc:398] Leaking SignalData structure 0x7b08003eb880 after lost signal to thread 30014
I20260709 12:24:55.470958 25800 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:24:55.487057 25758 raft_consensus.cc:2468] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 12.
I20260709 12:24:55.487731 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:55.361418 30030 consensus_queue.cc:1048] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.090s
I20260709 12:24:55.389859 30044 raft_consensus.cc:3060] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:55.493865 25686 raft_consensus.cc:2468] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 11.
I20260709 12:24:55.448673 30025 raft_consensus.cc:2804] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:55.427552 29842 raft_consensus.cc:2749] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:55.504289 25582 catalog_manager.cc:5697] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 4 to 5, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 5 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:24:55.396153 30026 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:55.499642 30044 raft_consensus.cc:2749] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:55.464874 30019 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:55.384768 29990 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:55.472360 29813 raft_consensus.cc:2804] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:55.500231 29967 raft_consensus.cc:2804] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:55.428710 30007 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
W20260709 12:24:55.519030 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 121439us
I20260709 12:24:55.648134 30007 raft_consensus.cc:3060] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:55.648983 25649 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:55.651403 25649 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:55.485033 30023 raft_consensus.cc:2804] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:55.521106 30026 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:55.391394 29694 raft_consensus.cc:2749] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:24:55.610791 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 139897us
I20260709 12:24:55.664697 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:55.609614 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:55.521479 30019 raft_consensus.cc:3060] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:55.545310 29671 raft_consensus.cc:697] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 10 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:55.528318 29813 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:55.567241 25755 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 11.
I20260709 12:24:55.580075 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:55.570292 26402 leader_election.cc:336] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Timed out: RequestConsensusVote RPC to 127.23.245.131:36237 timed out after 1.772s (SENT)
I20260709 12:24:55.528391 30043 consensus_queue.cc:1048] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 12:24:55.488332 29898 consensus_queue.cc:1059] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 12:24:55.708794 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:55.570639 25582 catalog_manager.cc:5697] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 2 to 6, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 6 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:55.516007 30025 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:55.566696 29907 raft_consensus.cc:2804] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:24:55.512564 29896 raft_consensus.cc:2749] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:55.559862 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:55.640237 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 182177us
I20260709 12:24:55.643182 25835 raft_consensus.cc:2468] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 13.
I20260709 12:24:55.383740 30042 consensus_queue.cc:237] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:55.716100 25726 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:55.624395 29909 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:55.658432 26431 raft_consensus.cc:2468] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 11.
I20260709 12:24:55.685357 29813 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:55.599491 30046 raft_consensus.cc:2804] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:24:55.665580 25680 raft_consensus.cc:2468] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 9.
I20260709 12:24:55.671195 25760 raft_consensus.cc:1275] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 12:24:55.679718 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:55.680078 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:55.680872 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:55.681360 26402 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:55.682700 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:55.687089 30053 log.cc:927] Time spent T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 12:24:55.691949 30062 consensus_queue.cc:1059] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:24:55.693347 29905 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:55.677788 30060 raft_consensus.cc:2804] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:55.659327 30023 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:55.696635 30001 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:55.697307 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:55.697695 29990 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:55.698338 30063 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.698457 30034 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:55.698129 29671 consensus_queue.cc:237] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:55.665951 29842 raft_consensus.cc:2804] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:55.704203 26401 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:55.656618 30036 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:55.710124 25837 raft_consensus.cc:2468] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 11.
I20260709 12:24:55.744167 29905 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:55.528643 29967 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:55.667449 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 195578us
I20260709 12:24:55.720978 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:55.732606 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 162353us
I20260709 12:24:55.827201 25684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40230 (request call id 1616) took 2424 ms. Trace:
I20260709 12:24:55.734704 25582 catalog_manager.cc:5697] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:24:55.828781 25582 catalog_manager.cc:5697] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 4 to 5, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 5 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:24:55.735667 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:55.729777 25760 pending_rounds.cc:85] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 7
I20260709 12:24:55.830860 25760 pending_rounds.cc:107] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 12:24:55.831216 25760 raft_consensus.cc:2889] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:55.737959 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:55.739701 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:55.714411 30025 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:55.745599 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:55.718240 29907 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:55.748243 25833 raft_consensus.cc:1240] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:55.749334 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:55.750654 25726 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:24:55.842914 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 92330.2us
I20260709 12:24:55.841428 25679 raft_consensus.cc:2393] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 7: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:55.843993 25726 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:55.752280 30046 raft_consensus.cc:697] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
W20260709 12:24:55.789582 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:55.775990 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:55.793471 25836 raft_consensus.cc:1275] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:24:55.777155 30063 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:55.738869 29921 raft_consensus.cc:2749] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:24:55.795852 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 91737.4us
I20260709 12:24:55.711728 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:55.803864 25683 raft_consensus.cc:2468] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 9.
I20260709 12:24:55.817425 29896 raft_consensus.cc:3055] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:55.820214 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:55.745235 30060 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:55.744948 30023 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:55.824575 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
W20260709 12:24:55.835448 26402 leader_election.cc:336] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Timed out: RequestConsensusVote RPC to 127.23.245.131:36237 timed out after 1.915s (SENT)
I20260709 12:24:55.827250 25801 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:55.850977 26401 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:55.739141 29923 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:55.854481 25763 raft_consensus.cc:1275] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:24:55.855175 26435 raft_consensus.cc:1275] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:24:55.857784 26435 raft_consensus.cc:1275] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:24:55.827632 25684 rpcz_store.cc:276] 0709 12:24:53.402807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.070036 (+1667229us) service_pool.cc:224] Handling call
0709 12:24:55.070366 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:55.070748 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:55.070783 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:55.071306 (+   523us) log.cc:844] Serialized 26 byte log entry
0709 12:24:55.323068 (+251762us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:55.323121 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.323228 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:55.826983 (+503755us) raft_consensus.cc:1685] finished
0709 12:24:55.827001 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:55.827142 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":121,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"thread_start_us":251285,"threads_started":1,"wal-append.queue_time_us":417710}
I20260709 12:24:55.788113 30059 raft_consensus.cc:2804] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:24:55.846530 25650 connection.cc:256] RPC call timeout handler was delayed by -1.0562239109999609s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1559s for a response
I20260709 12:24:55.848047 25726 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:55.849777 25678 raft_consensus.cc:2393] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 8: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:55.824703 29979 raft_consensus.cc:2804] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:55.859062 26402 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:55.866647 26402 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
W20260709 12:24:55.847963 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 182959us
I20260709 12:24:55.863353 26435 raft_consensus.cc:1275] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:24:55.859513 25726 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:55.872372 25726 leader_election.cc:400] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 election: Vote denied by peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) with higher term. Message: Invalid argument: T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 12. Current term is 13.
I20260709 12:24:55.870559 26432 raft_consensus.cc:1240] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:55.840950 29967 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:55.840462 30036 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:55.841396 30029 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.882823 26435 raft_consensus.cc:1240] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 10 LEADER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:55.879760 25649 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:55.883615 25800 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:55.847198 29907 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:55.797443 30043 consensus_queue.cc:1059] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 12:24:55.749881 30001 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:55.893822 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:55.850219 29896 raft_consensus.cc:740] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:55.866277 30040 raft_consensus.cc:2804] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:24:55.889297 25830 raft_consensus.cc:1275] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:24:55.861754 30059 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:55.849805 29842 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:55.890281 26437 raft_consensus.cc:1240] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 12. Current term is 13. Ops: []
I20260709 12:24:55.890407 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:55.915144 25833 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:55.894961 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:55.890503 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:55.887681 26402 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
W20260709 12:24:55.902307 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 75143.7us
I20260709 12:24:55.873214 29979 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:55.863719 30061 raft_consensus.cc:2804] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:55.860050 30044 raft_consensus.cc:2804] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:55.917912 26402 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:55.919221 30022 raft_consensus.cc:2749] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:55.861202 30060 raft_consensus.cc:3060] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:55.881809 30018 raft_consensus.cc:2749] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:55.880842 29990 raft_consensus.cc:2804] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:55.917249 25801 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:56.014938 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:56.021970 26436 raft_consensus.cc:2468] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 9.
I20260709 12:24:56.022541 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:55.913365 30058 consensus_queue.cc:1048] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.126s
I20260709 12:24:56.015558 29810 raft_consensus.cc:2804] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:24:56.015730 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 100627us
I20260709 12:24:56.029016 25726 leader_election.cc:400] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 election: Vote denied by peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) with higher term. Message: Invalid argument: T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 9. Current term is 10.
I20260709 12:24:56.029573 25726 leader_election.cc:403] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:24:56.016525 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:55.954648 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 59448.6us
W20260709 12:24:56.017562 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 97148.1us
I20260709 12:24:55.913036 29755 raft_consensus.cc:2804] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:56.035804 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:56.016271 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 98435.9us
I20260709 12:24:56.023716 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:56.037556 29316 raft_consensus.cc:2749] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:24:56.024931 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 141525us
I20260709 12:24:56.039062 26402 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:56.027033 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:56.034233 26437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 1046) took 2051 ms. Trace:
I20260709 12:24:56.040934 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:55.919952 29842 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:56.041534 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:55.920567 30059 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:55.950285 29979 raft_consensus.cc:3060] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:55.954588 30066 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.041345 26437 rpcz_store.cc:276] 0709 12:24:53.983254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.451374 (+1468120us) service_pool.cc:224] Handling call
0709 12:24:55.451655 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:55.914815 (+463160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:56.034026 (+119211us) spinlock_profiling.cc:243] Waited 438 ms on lock 0x7b5400316ad4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:56.034168 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1008340352}
I20260709 12:24:56.044648 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:56.070962 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:55.889277 30064 consensus_queue.cc:1048] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.144s
I20260709 12:24:56.074342 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:56.042196 29755 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:56.078291 30034 consensus_queue.cc:1048] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:55.895558 30036 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:56.093941 30036 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:56.094497 30036 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:56.094928 29931 consensus_meta.cc:287] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.606s	user 0.010s	sys 0.000s
I20260709 12:24:56.094996 30036 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:56.004320 30041 consensus_queue.cc:1048] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.092s
I20260709 12:24:56.095505 29931 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:56.097545 29931 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:56.098053 30058 consensus_queue.cc:1059] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:56.098793 30058 consensus_queue.cc:1243] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer f82778701b464892aab92a752ed7ffdc log is divergent from this leader: its last log entry 11.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:24:56.099290 30058 raft_consensus.cc:2749] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) with higher term. Message: Invalid argument: T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 9. Current term is 10.
I20260709 12:24:56.014109 30044 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:55.956063 29694 consensus_queue.cc:1048] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.113s
I20260709 12:24:56.078814 30068 consensus_queue.cc:1048] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:24:56.087944 29922 consensus_meta.cc:287] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.710s	user 0.009s	sys 0.001s
I20260709 12:24:55.968133 30061 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:55.958740 30040 raft_consensus.cc:697] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 12 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
W20260709 12:24:56.101944 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 184793us
I20260709 12:24:56.102406 25837 raft_consensus.cc:2393] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 9: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:56.106057 29316 raft_consensus.cc:2804] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:55.915643 30029 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:56.024739 29990 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:56.144273 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:56.146283 25836 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:56.079098 26402 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:56.138017 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:56.043533 30072 raft_consensus.cc:2749] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:56.071520 30022 raft_consensus.cc:2804] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:24:56.103972 30048 log.cc:927] Time spent T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:24:56.142788 29316 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:56.161996 29316 raft_consensus.cc:3060] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:56.114105 30044 raft_consensus.cc:3060] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:56.071895 29810 raft_consensus.cc:697] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 9 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:56.166567 25834 raft_consensus.cc:2393] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 9: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
W20260709 12:24:56.115001 30083 log.cc:927] Time spent T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 12:24:56.115494 30058 raft_consensus.cc:3055] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:24:56.108683 30026 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:56.103382 29755 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:56.150261 25801 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:56.152281 30022 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:56.143796 30080 log.cc:927] Time spent T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:24:56.144317 29909 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:56.140703 29922 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:56.172632 30058 raft_consensus.cc:740] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
W20260709 12:24:56.175680 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 143255us
I20260709 12:24:56.183787 30022 raft_consensus.cc:3060] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:56.141525 30061 raft_consensus.cc:3060] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:56.140094 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 102457us
I20260709 12:24:56.153254 30056 raft_consensus.cc:2749] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:56.173744 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:56.042037 30046 consensus_queue.cc:237] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:56.156351 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:56.175894 25801 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:56.101106 30066 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:56.149542 29990 raft_consensus.cc:3060] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:56.185604 30041 raft_consensus.cc:2804] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:24:56.100565 29896 consensus_queue.cc:260] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:56.213325 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:56.215005 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:56.214713 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:56.216200 25801 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:56.203281 29316 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:56.278481 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 199480us
I20260709 12:24:56.239197 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:56.216874 25836 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 15.
I20260709 12:24:56.286206 25760 raft_consensus.cc:2468] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 9.
I20260709 12:24:56.342788 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:56.343627 26402 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:56.342633 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:56.344167 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:56.345002 25831 raft_consensus.cc:2468] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 10.
I20260709 12:24:56.345504 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:56.345780 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:56.346099 25836 raft_consensus.cc:2376] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 15. Re-sending same reply.
I20260709 12:24:56.347148 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:56.348340 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:56.200323 30071 log.cc:927] Time spent T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.250s	user 0.000s	sys 0.001s
I20260709 12:24:56.357726 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:56.196326 30069 log.cc:927] Time spent T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
W20260709 12:24:56.350601 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 134471us
I20260709 12:24:56.371491 25801 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:56.226231 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:56.223047 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:56.351426 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:56.375533 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:56.222597 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:24:56.353713 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 324897us
W20260709 12:24:56.354571 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 217194us
W20260709 12:24:56.355626 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 144151us
W20260709 12:24:56.204404 30073 log.cc:927] Time spent T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 12:24:56.350162 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:56.364514 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:56.384610 25831 raft_consensus.cc:3060] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:56.381652 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:56.387265 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:56.390126 25836 raft_consensus.cc:2468] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 10.
I20260709 12:24:56.384106 25759 raft_consensus.cc:2393] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 11: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:56.391206 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:56.198205 30026 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:56.200687 30036 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:56.192443 29923 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:56.219408 30041 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:56.203104 29813 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:56.207157 30064 consensus_queue.cc:1048] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.210s
I20260709 12:24:56.209858 30062 consensus_queue.cc:1048] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.197s
I20260709 12:24:56.209726 29686 consensus_queue.cc:1048] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.208s
I20260709 12:24:56.192178 29810 consensus_queue.cc:237] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:56.341204 30043 consensus_queue.cc:1059] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.090s
I20260709 12:24:56.187801 29898 consensus_queue.cc:1059] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.243s
I20260709 12:24:56.196553 30040 consensus_queue.cc:237] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:56.467398 25833 consensus_meta.cc:287] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.552s	user 0.008s	sys 0.000s
I20260709 12:24:56.402168 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:56.395246 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:56.440799 25762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48606 (request call id 1028) took 1241 ms. Trace:
W20260709 12:24:56.570922 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 189508us
W20260709 12:24:56.533808 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 190196us
I20260709 12:24:56.407462 25801 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:56.409368 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:56.394018 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:56.575214 25754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 2921) took 1384 ms. Trace:
I20260709 12:24:56.571075 25762 rpcz_store.cc:276] 0709 12:24:55.199077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.390400 (+191323us) service_pool.cc:224] Handling call
0709 12:24:55.390769 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:55.648238 (+257469us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:55.648271 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:55.648987 (+   716us) log.cc:844] Serialized 26 byte log entry
0709 12:24:55.712531 (+ 63544us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:55.712565 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.712631 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:56.440591 (+727960us) raft_consensus.cc:1685] finished
0709 12:24:56.440618 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:56.440743 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":167956,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":1347,"thread_start_us":320047,"threads_started":2,"wal-append.queue_time_us":192953}
I20260709 12:24:56.572569 25833 raft_consensus.cc:2468] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 13.
I20260709 12:24:56.408706 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:56.577783 25754 rpcz_store.cc:276] 0709 12:24:55.191093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.381265 (+190172us) service_pool.cc:224] Handling call
0709 12:24:55.425536 (+ 44271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:55.559356 (+133820us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:55.559385 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:55.568591 (+  9206us) log.cc:844] Serialized 26 byte log entry
0709 12:24:55.710844 (+142253us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:55.710881 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.710941 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:56.561178 (+850237us) raft_consensus.cc:1685] finished
0709 12:24:56.561203 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:56.575133 (+ 13930us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":146823,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":10855,"thread_start_us":235876,"threads_started":2,"wal-append.queue_time_us":277874}
I20260709 12:24:56.393368 29316 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:56.188670 30068 raft_consensus.cc:2804] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:56.523355 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:56.583608 25831 raft_consensus.cc:2468] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 11.
I20260709 12:24:56.482971 26439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 1043) took 2517 ms. Trace:
I20260709 12:24:56.476991 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:56.574587 25836 raft_consensus.cc:2468] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 9.
I20260709 12:24:56.582665 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:56.586266 26439 rpcz_store.cc:276] 0709 12:24:53.965154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.424762 (+1459608us) service_pool.cc:224] Handling call
0709 12:24:55.471903 (+ 47141us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:55.712882 (+240979us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:55.712928 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:55.717558 (+  4630us) log.cc:844] Serialized 26 byte log entry
0709 12:24:55.848483 (+130925us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:55.848519 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.848589 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:56.482700 (+634111us) raft_consensus.cc:1685] finished
0709 12:24:56.482743 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:56.482897 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79095,"raft.queue_time_us":71411,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":9775,"thread_start_us":273196,"threads_started":2,"wal-append.queue_time_us":170987}
I20260709 12:24:56.588617 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:56.589941 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:56.577853 25761 raft_consensus.cc:2410] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:24:56.592314 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:56.593308 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:56.581779 25726 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:56.201787 29922 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:56.384366 29896 raft_consensus.cc:3060] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:56.581583 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:56.226753 30072 raft_consensus.cc:2804] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:56.600222 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:56.593909 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:56.363348 30074 raft_consensus.cc:2804] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:24:56.384661 29905 consensus_meta.cc:287] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.542s	user 0.008s	sys 0.001s
I20260709 12:24:56.576905 30037 raft_consensus.cc:993] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a: : Instructing follower 6e673265293d4e9a937dc45150aeb1b8 to start an election
W20260709 12:24:56.604652 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.536146 30039 raft_consensus.cc:3055] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:56.602104 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:56.417296 30063 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:56.438939 29979 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:56.200815 30060 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:56.364643 29767 consensus_queue.cc:1175] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5cccf20a8bff46dba6601f241d172b8a" responder_term: 9 status { last_received { term: 7 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 8. Current term is 9. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:24:56.523684 30044 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:56.437376 30076 consensus_queue.cc:1048] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.202s
I20260709 12:24:56.202404 30058 consensus_queue.cc:260] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 12.5, Last appended by leader: 5, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:56.703504 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:56.809967 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:56.640919 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:24:56.810462 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.811013 25835 raft_consensus.cc:2468] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 7.
I20260709 12:24:56.707535 25800 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:56.680493 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:56.812350 29316 raft_consensus.cc:2804] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:56.674852 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:56.638665 25754 raft_consensus.cc:1240] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:24:56.606154 25759 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:56.641212 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:56.751698 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:56.815112 25683 raft_consensus.cc:2468] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 12.
I20260709 12:24:56.673035 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:56.585559 30041 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:24:56.882509 30088 log.cc:927] Time spent T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.174s	user 0.000s	sys 0.000s
W20260709 12:24:56.883579 30082 log.cc:927] Time spent T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
W20260709 12:24:56.885785 30085 log.cc:927] Time spent T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:24:56.585779 30068 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:56.816790 30074 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:56.886276 30068 raft_consensus.cc:3060] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:56.608742 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:56.887564 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:56.573843 30059 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:56.888715 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:56.519809 29755 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:56.877079 29694 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:56.889737 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:56.890061 29694 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:56.890751 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:56.891093 29755 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:56.891768 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:56.813393 26437 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.006s	sys 0.014s
W20260709 12:24:56.620337 25726 connection.cc:256] RPC call timeout handler was delayed by -1.4497319360002621s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2143s for a response
W20260709 12:24:56.766731 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.892514 25757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 2924) took 1217 ms. Trace:
W20260709 12:24:56.892575 26437 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.006s	sys 0.014s
I20260709 12:24:56.642570 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:56.813647 29316 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
W20260709 12:24:56.720878 30109 log.cc:927] Time spent T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
W20260709 12:24:56.812112 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 104658us
I20260709 12:24:56.893640 29316 raft_consensus.cc:3060] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:56.893900 25832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 2812) took 1163 ms. Trace:
I20260709 12:24:56.894313 25832 rpcz_store.cc:276] 0709 12:24:55.730343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.731243 (+   900us) service_pool.cc:224] Handling call
0709 12:24:55.731538 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:55.796932 (+ 65394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:55.796968 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:55.838523 (+ 41555us) log.cc:844] Serialized 26 byte log entry
0709 12:24:55.918039 (+ 79516us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:24:55.918248 (+   209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.918781 (+   533us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:56.893716 (+974935us) raft_consensus.cc:1685] finished
0709 12:24:56.893738 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:56.893851 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1915,"raft.queue_time_us":80973,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":160,"thread_start_us":140792,"threads_started":2,"wal-append.queue_time_us":858134}
I20260709 12:24:56.892938 25757 rpcz_store.cc:276] 0709 12:24:55.675193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.675397 (+   204us) service_pool.cc:224] Handling call
0709 12:24:55.675870 (+   473us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:55.714612 (+ 38742us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:55.714643 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:55.728752 (+ 14109us) log.cc:844] Serialized 26 byte log entry
0709 12:24:55.889577 (+160825us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:56.152000 (+262423us) log.cc:844] Serialized 14 byte log entry
0709 12:24:56.152226 (+   226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:56.152325 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:56.892291 (+739966us) raft_consensus.cc:1685] finished
0709 12:24:56.892311 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:56.892461 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33828,"prepare.queue_time_us":203811,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":130900,"raft.run_cpu_time_us":373,"raft.run_wall_time_us":174332,"thread_start_us":340547,"threads_started":2,"wal-append.queue_time_us":850615}
W20260709 12:24:56.598328 26402 leader_election.cc:336] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Timed out: RequestConsensusVote RPC to 127.23.245.131:36237 timed out after 1.995s (SENT)
W20260709 12:24:56.896256 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 297956us
W20260709 12:24:56.896813 26402 leader_election.cc:336] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Timed out: RequestConsensusVote RPC to 127.23.245.131:36237 timed out after 2.056s (SENT)
I20260709 12:24:56.861702 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:56.667096 29907 consensus_meta.cc:287] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.717s	user 0.008s	sys 0.001s
I20260709 12:24:56.621497 30026 raft_consensus.cc:2749] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:56.897200 26402 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:56.460510 30001 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:56.605014 30019 consensus_meta.cc:287] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.897s	user 0.002s	sys 0.015s
W20260709 12:24:56.878756 25650 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.013s	sys 0.005s
I20260709 12:24:56.879318 25759 raft_consensus.cc:2410] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 12:24:56.786440 29842 consensus_meta.cc:287] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.690s	user 0.009s	sys 0.003s
W20260709 12:24:56.753752 30110 log.cc:927] Time spent T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:24:56.652976 30036 raft_consensus.cc:2804] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:56.881505 25754 raft_consensus.cc:1240] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 11. Current term is 12. Ops: [11.9-11.9]
W20260709 12:24:56.881709 30107 log.cc:927] Time spent T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 12:24:56.949039 29842 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:56.436031 30091 raft_consensus.cc:2804] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:56.952080 30091 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:56.938088 29907 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:56.952513 30091 raft_consensus.cc:3060] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:56.953855 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:56.954104 29907 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:56.954612 25830 raft_consensus.cc:2393] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 10: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:56.955022 25686 raft_consensus.cc:1240] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:24:56.949676 30036 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:56.886373 30074 raft_consensus.cc:3060] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:56.895476 25800 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:56.959520 29907 raft_consensus.cc:2749] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:24:56.959676 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 64262.9us
I20260709 12:24:56.961748 25800 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:56.962531 29907 raft_consensus.cc:2749] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:24:56.725051 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 317625us
W20260709 12:24:56.964279 30025 consensus_meta.cc:287] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 1.104s	user 0.011s	sys 0.000s
I20260709 12:24:56.964200 25801 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:56.964685 30025 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:56.965502 29922 raft_consensus.cc:2749] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:56.965725 30043 consensus_queue.cc:1059] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:24:56.966792 30043 raft_consensus.cc:3055] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:24:56.967156 30043 raft_consensus.cc:740] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:56.897701 25763 raft_consensus.cc:1240] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 11. Current term is 12. Ops: []
W20260709 12:24:56.892637 25726 connection.cc:256] RPC call timeout handler was delayed by -1.4371319360002417s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2157s for a response
I20260709 12:24:56.898330 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
W20260709 12:24:56.968382 25726 connection.cc:256] RPC call timeout handler was delayed by -1.4056319360001908s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21920000000000003s for a response
W20260709 12:24:56.968828 25726 leader_election.cc:336] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Timed out: RequestConsensusVote RPC to 127.23.245.132:35611 timed out after 1.539s (SENT)
I20260709 12:24:56.969079 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:56.969178 25726 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:56.969650 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:56.969949 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:56.970295 26439 raft_consensus.cc:2468] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 6.
I20260709 12:24:56.971230 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:56.971311 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:56.972159 26434 raft_consensus.cc:2368] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 9. Current term is 10.
I20260709 12:24:56.963395 25800 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:56.975104 29979 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:56.975348 29907 consensus_queue.cc:1048] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:24:56.976238 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:56.976639 30044 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:56.977035 25800 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:56.977284 30044 raft_consensus.cc:2749] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:56.977445 29898 raft_consensus.cc:2749] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:24:56.978400 26432 raft_consensus.cc:1240] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:56.979476 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:56.980315 26432 raft_consensus.cc:2410] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 11 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 12:24:56.980671 30115 log.cc:927] Time spent T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:24:56.982331 26434 raft_consensus.cc:1240] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:56.982481 30060 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:56.983317 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:56.983883 26433 raft_consensus.cc:3060] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:56.982121 25801 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:56.969667 25832 raft_consensus.cc:2468] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 9.
I20260709 12:24:56.606863 30022 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:56.989042 25683 raft_consensus.cc:1240] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:56.989130 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:56.989689 25684 raft_consensus.cc:3060] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:56.990978 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:56.991892 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:56.993450 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
W20260709 12:24:56.645973 30106 log.cc:927] Time spent T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:24:56.875613 25761 raft_consensus.cc:3060] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:56.986723 25801 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:56.800335 30066 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:56.928874 25677 raft_consensus.cc:2410] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:24:56.748003 29909 raft_consensus.cc:2804] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:24:56.614403 29921 raft_consensus.cc:2749] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:56.929926 25758 raft_consensus.cc:2393] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 9: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:56.930470 26436 raft_consensus.cc:2393] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 12: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:56.899276 26430 raft_consensus.cc:1240] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 9 LEADER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:56.812460 30072 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:56.827438 29905 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:56.824060 30039 raft_consensus.cc:740] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:56.938666 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:56.939991 25650 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.013s	sys 0.005s
W20260709 12:24:57.024463 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 808055us
I20260709 12:24:56.943617 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:56.945607 29316 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:56.899730 30063 raft_consensus.cc:1081] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 9 LEADER]: Signalling peer 6e673265293d4e9a937dc45150aeb1b8 to start an election
W20260709 12:24:56.949117 30103 log.cc:927] Time spent T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.246s	user 0.003s	sys 0.004s
I20260709 12:24:56.955370 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:56.753993 29931 raft_consensus.cc:3055] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:24:56.957131 30050 log.cc:927] Time spent T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.479s	user 0.004s	sys 0.000s
I20260709 12:24:56.957387 25828 raft_consensus.cc:1240] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 13. Current term is 14. Ops: []
I20260709 12:24:57.034082 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:56.958627 30036 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:57.013036 25801 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:57.013876 25683 raft_consensus.cc:2393] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 9: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:57.015506 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:57.037282 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:57.017671 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:57.038378 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:57.039603 25801 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:57.039876 25830 raft_consensus.cc:1275] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:24:56.754101 30113 consensus_queue.cc:1048] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.196s
I20260709 12:24:56.621727 30112 consensus_queue.cc:1048] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.340s
I20260709 12:24:56.945118 29810 raft_consensus.cc:2749] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:57.021376 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:57.009641 30025 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:57.049590 25681 raft_consensus.cc:3060] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:57.049870 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 479876us
I20260709 12:24:56.939994 29694 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:57.024430 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:57.008917 30037 raft_consensus.cc:2749] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:57.034695 25650 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:57.014492 29922 raft_consensus.cc:2749] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:24:57.028904 29967 consensus_meta.cc:287] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 1.134s	user 0.000s	sys 0.012s
I20260709 12:24:57.019582 29909 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:56.946688 30019 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:57.049127 26433 raft_consensus.cc:2468] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 8.
I20260709 12:24:57.031219 29931 raft_consensus.cc:740] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:57.053663 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:57.057921 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:57.061270 25685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2354) took 1307 ms. Trace:
I20260709 12:24:57.075572 25685 rpcz_store.cc:276] 0709 12:24:55.753940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.840551 (+ 86611us) service_pool.cc:224] Handling call
0709 12:24:55.860397 (+ 19846us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:55.860753 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:55.860780 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:56.072245 (+211465us) spinlock_profiling.cc:243] Waited 1 ms on lock 0x7b2c00013008. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9845aa11 00007f5d9846a372 00007f5d99b9ca01 00007f5d99b6143a 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2
0709 12:24:56.072723 (+   478us) log.cc:844] Serialized 26 byte log entry
0709 12:24:56.355771 (+283048us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:56.355804 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:56.355878 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:57.048207 (+692329us) raft_consensus.cc:1685] finished
0709 12:24:57.048226 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:57.061184 (+ 12958us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3208,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":16202,"spinlock_wait_cycles":2307968,"thread_start_us":255495,"threads_started":1,"wal-append.queue_time_us":383533}
I20260709 12:24:57.021238 30072 raft_consensus.cc:3060] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:57.071106 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:57.064695 25650 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:24:57.079380 25681 raft_consensus.cc:2468] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 8.
W20260709 12:24:57.049104 30007 consensus_meta.cc:287] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 1.400s	user 0.008s	sys 0.004s
I20260709 12:24:57.030151 29316 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:57.048045 30066 raft_consensus.cc:2749] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:57.068668 25761 raft_consensus.cc:2468] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 8.
I20260709 12:24:57.036475 29813 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:57.079487 25650 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:57.084326 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:57.091600 25757 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:57.092288 25761 raft_consensus.cc:1275] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:24:57.107827 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 171449us
I20260709 12:24:57.114208 26402 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
W20260709 12:24:57.115242 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 145136us
I20260709 12:24:57.116220 25757 raft_consensus.cc:2468] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 10.
W20260709 12:24:57.117213 25726 leader_election.cc:336] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Timed out: RequestConsensusVote RPC to 127.23.245.132:35611 timed out after 1.862s (SENT)
I20260709 12:24:57.117725 25726 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:57.067365 29694 raft_consensus.cc:2749] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:56.993166 30043 consensus_queue.cc:260] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:57.068596 29909 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:57.041798 30001 consensus_queue.cc:1048] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:24:57.126231 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:57.129534 25754 raft_consensus.cc:3060] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:24:57.127099 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 47727.9us
W20260709 12:24:57.093662 29990 consensus_meta.cc:287] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.752s	user 0.007s	sys 0.013s
I20260709 12:24:57.130846 25650 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
W20260709 12:24:57.128793 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 89284.3us
I20260709 12:24:57.078871 29898 raft_consensus.cc:2749] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:57.122432 26402 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:24:57.138417 25801 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:57.117969 29802 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.154177 29802 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:57.142868 29896 raft_consensus.cc:2749] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:57.141093 29931 consensus_queue.cc:260] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:57.156024 30111 consensus_queue.cc:1059] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.120s
I20260709 12:24:57.143512 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:57.141372 30026 raft_consensus.cc:2804] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:57.129716 29755 raft_consensus.cc:2749] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:57.147737 30090 raft_consensus.cc:2749] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:57.157263 30078 raft_consensus.cc:2749] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:57.144042 30122 raft_consensus.cc:2804] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:57.150291 30068 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:57.074280 29967 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:57.159740 30068 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:57.161069 29802 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:57.152823 30061 consensus_meta.cc:287] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.944s	user 0.010s	sys 0.000s
I20260709 12:24:57.164539 30061 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:57.166592 29967 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:57.153472 29694 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:57.078493 30039 consensus_queue.cc:260] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:57.154490 30029 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:57.137389 30023 consensus_meta.cc:287] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 1.256s	user 0.012s	sys 0.001s
I20260709 12:24:57.094717 30007 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:57.161266 25686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2355) took 1329 ms. Trace:
I20260709 12:24:57.188261 25686 rpcz_store.cc:276] 0709 12:24:55.832162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.847254 (+ 15092us) service_pool.cc:224] Handling call
0709 12:24:55.957279 (+110025us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:56.957746 (+1000467us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:57.160254 (+202508us) spinlock_profiling.cc:243] Waited 997 ms on lock 0x7b54002486d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:57.161083 (+   829us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b54002486d0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b608ad 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:57.161208 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2546242688}
I20260709 12:24:57.162119 25834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41782 (request call id 870) took 1121 ms. Trace:
I20260709 12:24:57.162243 25830 raft_consensus.cc:1240] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:57.162601 26438 raft_consensus.cc:1240] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:24:57.190224 25834 rpcz_store.cc:276] 0709 12:24:56.040835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:56.041319 (+   484us) service_pool.cc:224] Handling call
0709 12:24:57.161920 (+1120601us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b54004218d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:57.162043 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":281484672}
I20260709 12:24:57.192142 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:57.192970 25754 raft_consensus.cc:2468] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 12.
I20260709 12:24:57.195793 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:57.197060 25682 raft_consensus.cc:1275] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 12:24:57.197523 25682 pending_rounds.cc:85] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc: Aborting all ops after (but not including) 9
I20260709 12:24:57.197816 25682 pending_rounds.cc:107] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 12:24:57.198109 25682 raft_consensus.cc:2889] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:57.198192 25650 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:57.157029 30066 raft_consensus.cc:2749] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:57.157051 25829 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:57.149636 30074 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:57.152436 30119 log.cc:927] Time spent T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 12:24:57.169999 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:57.173527 26431 raft_consensus.cc:1240] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:57.182000 25801 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:24:57.156541 29931 raft_consensus.cc:3060] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:57.136492 30114 raft_consensus.cc:2749] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:57.149724 30036 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:57.184768 29694 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:57.211870 25829 raft_consensus.cc:2468] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 10.
I20260709 12:24:57.194293 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:57.212916 25677 raft_consensus.cc:1240] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 9. Current term is 10. Ops: []
W20260709 12:24:57.169045 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:57.192345 26401 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:24:57.213691 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 96520.8us
I20260709 12:24:57.211714 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:57.214655 25726 leader_election.cc:336] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Timed out: RequestConsensusVote RPC to 127.23.245.132:35611 timed out after 1.954s (SENT)
I20260709 12:24:57.214917 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:57.215041 25726 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:57.215471 26431 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:57.200412 26402 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:24:57.216766 25834 raft_consensus.cc:1240] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:57.157299 30026 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:57.205523 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:57.206521 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:57.207086 25801 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:57.201092 30068 consensus_queue.cc:1048] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 12:24:57.138600 29990 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:57.226143 25726 leader_election.cc:336] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Timed out: RequestConsensusVote RPC to 127.23.245.132:35611 timed out after 2.003s (SENT)
I20260709 12:24:57.227098 26432 raft_consensus.cc:1240] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 12 LEADER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:24:57.218546 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:57.204046 30029 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.221097 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:57.211308 30094 raft_consensus.cc:2749] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:57.221520 30102 raft_consensus.cc:2804] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:57.289088 30102 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:57.289541 30102 raft_consensus.cc:3060] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:57.291316 30007 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:57.199215 30023 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:57.293789 29694 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:57.295059 30023 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:57.295804 30036 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:57.296307 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:57.297408 29990 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:57.298306 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:57.299444 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:57.222123 25801 leader_election.cc:400] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 election: Vote denied by peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611) with higher term. Message: Invalid argument: T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 9. Current term is 10.
I20260709 12:24:57.300081 25801 leader_election.cc:403] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 12:24:57.300561 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 81544.6us
I20260709 12:24:57.301249 25801 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:57.301077 30102 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:57.302052 29813 raft_consensus.cc:2749] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611) with higher term. Message: Invalid argument: T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 9. Current term is 10.
I20260709 12:24:57.302691 29813 raft_consensus.cc:2749] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:57.303380 26435 raft_consensus.cc:1813] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Handling vote request from an unknown peer f82778701b464892aab92a752ed7ffdc
I20260709 12:24:57.303890 26435 raft_consensus.cc:2368] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for earlier term 9. Current term is 10.
I20260709 12:24:57.145728 30041 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:57.304869 30030 raft_consensus.cc:3055] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:57.305292 30030 raft_consensus.cc:740] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:57.306269 30102 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:57.306408 30041 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:57.306077 30030 consensus_queue.cc:260] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:57.307474 30030 raft_consensus.cc:3060] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:57.307652 26438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 1066) took 1454 ms. Trace:
I20260709 12:24:57.254196 30029 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:57.308123 26438 rpcz_store.cc:276] 0709 12:24:55.853311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.864145 (+ 10834us) service_pool.cc:224] Handling call
0709 12:24:55.891146 (+ 27001us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:57.191862 (+1300716us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:57.307415 (+115553us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b5400474fd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:57.307594 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2923527552}
I20260709 12:24:57.309293 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:57.309753 30029 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:57.309960 26438 raft_consensus.cc:2393] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 10: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:57.256157 30022 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:57.310825 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:57.311376 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:57.223126 30061 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:57.225265 26401 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:24:57.312531 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 87349.6us
I20260709 12:24:57.312805 25828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 2819) took 1559 ms. Trace:
I20260709 12:24:57.313288 25828 rpcz_store.cc:276] 0709 12:24:55.753328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.797713 (+ 44385us) service_pool.cc:224] Handling call
0709 12:24:55.847029 (+ 49316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:57.034142 (+1187113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:57.312543 (+278401us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400118854. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:57.312734 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2552345472}
I20260709 12:24:57.314646 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:57.211766 30090 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:57.249396 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:57.249908 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:57.250609 25760 raft_consensus.cc:2368] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 10. Current term is 11.
I20260709 12:24:57.250572 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:57.251653 25756 raft_consensus.cc:1240] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:24:57.319890 25677 raft_consensus.cc:2393] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 12: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:57.184598 30037 consensus_queue.cc:1059] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:24:57.324611 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:57.320925 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:57.252601 25726 leader_election.cc:336] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Timed out: RequestConsensusVote RPC to 127.23.245.132:35611 timed out after 2.031s (SENT)
I20260709 12:24:57.229081 25650 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:57.216367 29898 raft_consensus.cc:2804] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:24:57.258585 30128 log.cc:927] Time spent T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:24:57.257815 25684 raft_consensus.cc:2468] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 9.
I20260709 12:24:57.258872 26431 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 10.
I20260709 12:24:57.259410 25678 raft_consensus.cc:3060] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:57.224225 30056 raft_consensus.cc:2749] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:24:57.228837 30039 raft_consensus.cc:3060] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:57.228338 29922 raft_consensus.cc:2749] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:57.227033 29979 raft_consensus.cc:2804] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:57.332134 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:57.281769 26430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 1047) took 2337 ms. Trace:
I20260709 12:24:57.283914 25758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53460 (request call id 2541) took 1070 ms. Trace:
I20260709 12:24:57.333509 25758 rpcz_store.cc:276] 0709 12:24:56.213013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:56.381407 (+168394us) service_pool.cc:224] Handling call
0709 12:24:57.283675 (+902268us) spinlock_profiling.cc:243] Waited 510 ms on lock 0x7b54001da1d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:57.283842 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1173178112}
I20260709 12:24:57.302771 25801 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:57.321000 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:57.334822 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:57.335402 25830 raft_consensus.cc:2393] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 10: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:57.322631 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:57.325709 25726 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:57.326949 25686 raft_consensus.cc:2468] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 10.
I20260709 12:24:57.219888 30026 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:57.327857 30068 raft_consensus.cc:2804] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:24:57.330966 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 101974us
I20260709 12:24:57.333454 26430 rpcz_store.cc:276] 0709 12:24:54.943950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.468746 (+524796us) service_pool.cc:224] Handling call
0709 12:24:55.469012 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:57.019689 (+1550677us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:57.281529 (+261840us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b54006301d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:57.281704 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3288730880}
I20260709 12:24:57.320664 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:57.328261 29898 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:57.342685 26434 raft_consensus.cc:2393] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 9: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
W20260709 12:24:57.347133 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 44442us
I20260709 12:24:57.277642 29905 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:57.349347 26430 raft_consensus.cc:1240] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:24:57.352726 25801 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:24:57.355873 30112 consensus_queue.cc:1059] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:57.357326 30112 raft_consensus.cc:3055] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:24:57.357802 30112 raft_consensus.cc:740] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:57.357728 29694 consensus_queue.cc:1059] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:57.359794 29896 raft_consensus.cc:3055] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:57.359357 30112 consensus_queue.cc:260] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:57.360394 29896 raft_consensus.cc:740] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:57.361102 30112 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:57.362838 30007 consensus_queue.cc:1059] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 12:24:57.366907 30007 raft_consensus.cc:3055] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:24:57.367368 30007 raft_consensus.cc:740] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:57.368600 30007 consensus_queue.cc:260] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:57.361547 29896 consensus_queue.cc:260] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:57.371709 29896 raft_consensus.cc:3060] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:57.372339 30007 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:57.377070 26402 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:57.330425 30090 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:57.344228 30005 raft_consensus.cc:2804] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:24:57.382781 26402 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:57.383041 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:57.388424 25833 raft_consensus.cc:2393] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 18: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:57.384303 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:57.349251 29898 raft_consensus.cc:3060] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:57.398311 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:24:57.398765 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 146238us
I20260709 12:24:57.326303 29909 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:57.399996 25726 connection.cc:256] RPC call timeout handler was delayed by -1.2382319360003748s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2378s for a response
W20260709 12:24:57.405067 25726 connection.cc:256] RPC call timeout handler was delayed by -1.094231936000142s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25379999999999997s for a response
I20260709 12:24:57.402976 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
W20260709 12:24:57.405614 25726 connection.cc:256] RPC call timeout handler was delayed by -1.094231936000142s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25379999999999997s for a response
I20260709 12:24:57.348750 29979 raft_consensus.cc:697] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 10 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:57.407631 25801 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:57.375864 30056 raft_consensus.cc:2749] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:57.392246 30022 raft_consensus.cc:2749] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:57.376662 29922 raft_consensus.cc:2749] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:57.380988 30068 raft_consensus.cc:697] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 12 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:57.415050 26436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 1080) took 1388 ms. Trace:
W20260709 12:24:57.415413 26402 leader_election.cc:336] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 1.586s (SENT)
I20260709 12:24:57.415416 26436 rpcz_store.cc:276] 0709 12:24:56.026521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:56.026754 (+   233us) service_pool.cc:224] Handling call
0709 12:24:57.414858 (+1388104us) spinlock_profiling.cc:243] Waited 860 ms on lock 0x7b54002e9854. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:57.414980 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1979145088}
I20260709 12:24:57.416525 25726 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:24:57.416910 26436 raft_consensus.cc:1275] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:24:57.425287 25835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41782 (request call id 899) took 1230 ms. Trace:
I20260709 12:24:57.425695 25835 rpcz_store.cc:276] 0709 12:24:56.195051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:56.357448 (+162397us) service_pool.cc:224] Handling call
0709 12:24:57.425136 (+1067688us) spinlock_profiling.cc:243] Waited 452 ms on lock 0x7b540035a054. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:57.425235 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1040183040}
I20260709 12:24:57.351111 29802 consensus_queue.cc:1059] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:24:57.390267 30021 raft_consensus.cc:2749] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:57.390381 30113 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:57.428764 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:57.399274 30041 raft_consensus.cc:2804] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:57.381767 30023 consensus_queue.cc:1048] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 12:24:57.404515 30005 raft_consensus.cc:697] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 13 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:57.430733 29905 raft_consensus.cc:2804] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:57.379839 30063 consensus_queue.cc:1059] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:24:57.425086 30044 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:57.449792 30046 raft_consensus.cc:2804] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:24:57.434114 30036 consensus_queue.cc:1048] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 12:24:57.474797 30005 consensus_queue.cc:237] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:57.475370 29979 consensus_queue.cc:237] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:57.480343 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:57.481051 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:57.481415 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:57.482618 25830 raft_consensus.cc:2410] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:24:57.458671 30034 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:57.495174 25682 raft_consensus.cc:2468] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 11.
I20260709 12:24:57.469108 30044 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:57.516721 25685 raft_consensus.cc:2410] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
W20260709 12:24:57.517339 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:57.517370 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:57.485996 30041 raft_consensus.cc:697] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 8 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:57.497848 30026 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:57.508040 30068 consensus_queue.cc:237] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:57.510932 25683 raft_consensus.cc:2468] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 10.
I20260709 12:24:57.511437 30034 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:57.512063 25678 raft_consensus.cc:2468] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 9.
W20260709 12:24:57.512557 30138 log.cc:927] Time spent T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
I20260709 12:24:57.513845 30090 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:57.471697 30074 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:57.474310 30046 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:57.522919 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:57.449860 30113 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:57.448599 30127 consensus_queue.cc:1048] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.078s
W20260709 12:24:57.535511 30091 consensus_meta.cc:287] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.582s	user 0.009s	sys 0.002s
I20260709 12:24:57.483526 30064 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:57.519265 30060 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.530191 26438 raft_consensus.cc:1240] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:24:57.530823 30045 raft_consensus.cc:3055] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:57.531378 26435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 1076) took 1637 ms. Trace:
W20260709 12:24:57.531492 30143 log.cc:927] Time spent T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
W20260709 12:24:57.531872 30139 log.cc:927] Time spent T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 12:24:57.532320 26439 raft_consensus.cc:1240] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 8. Current term is 10. Ops: []
I20260709 12:24:57.532963 29909 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:57.533206 30044 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:57.533706 30034 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:24:57.534946 30130 log.cc:927] Time spent T 00000000000000000000000000000000 P 496fd6924b624e77b03ccfd15653d47b: Append to log took a long time: real 0.207s	user 0.002s	sys 0.000s
W20260709 12:24:57.544003 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 127538us
I20260709 12:24:57.529486 30046 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:24:57.546125 25650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:57.546172 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:57.546315 25726 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:57.550633 25726 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:57.537870 26435 rpcz_store.cc:276] 0709 12:24:55.894114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.894742 (+   628us) service_pool.cc:224] Handling call
0709 12:24:57.531174 (+1636432us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b540012f554. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:57.531323 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3190110464}
W20260709 12:24:57.552295 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 144731us
I20260709 12:24:57.541574 30045 raft_consensus.cc:740] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
W20260709 12:24:57.563318 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:57.561877 25726 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:57.569823 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:57.570120 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:57.572530 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:57.573601 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:24:57.574086 25801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:57.574282 26430 raft_consensus.cc:2368] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 8. Current term is 9.
I20260709 12:24:57.574417 26435 raft_consensus.cc:1240] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:57.574542 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:57.575250 25680 raft_consensus.cc:2368] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 8. Current term is 9.
I20260709 12:24:57.575173 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:24:57.574545 25801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:57.579344 25801 leader_election.cc:400] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 election: Vote denied by peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611) with higher term. Message: Invalid argument: T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 8. Current term is 9.
I20260709 12:24:57.580160 25801 leader_election.cc:403] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:24:57.580896 25726 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:57.582700 25680 raft_consensus.cc:1240] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:57.605914 25726 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:57.609755 30153 consensus_queue.cc:1059] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:57.542960 30060 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:57.565658 30044 raft_consensus.cc:2749] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:57.616523 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:57.536947 30091 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:57.554363 30150 raft_consensus.cc:2804] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:24:57.583767 30127 raft_consensus.cc:2804] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:57.617856 25755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 2932) took 1405 ms. Trace:
I20260709 12:24:57.615245 30090 raft_consensus.cc:2749] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:57.619455 30157 consensus_queue.cc:1059] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.015s
I20260709 12:24:57.611196 30061 raft_consensus.cc:3060] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:57.542742 30064 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:57.621490 25755 rpcz_store.cc:276] 0709 12:24:56.212637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:56.830001 (+617364us) service_pool.cc:224] Handling call
0709 12:24:56.887638 (+ 57637us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:57.060461 (+172823us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:57.060489 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:57.060928 (+   439us) log.cc:844] Serialized 26 byte log entry
0709 12:24:57.195207 (+134279us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:57.195244 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:57.195304 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:57.617664 (+422360us) raft_consensus.cc:1685] finished
0709 12:24:57.617686 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:57.617802 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":43871,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":5327,"thread_start_us":248414,"threads_started":2,"wal-append.queue_time_us":248578}
I20260709 12:24:57.631471 25829 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25bd5658646b41608d707d196c6e0585"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "a866ff967d964388a6f0dff7fd43df89"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:24:57.544574 30072 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:57.611800 30063 raft_consensus.cc:3060] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:57.560626 29898 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:57.566066 29909 consensus_queue.cc:1059] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 12:24:57.582398 30074 consensus_queue.cc:1059] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 12:24:57.636826 25832 raft_consensus.cc:2393] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 11: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:57.624346 30150 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
W20260709 12:24:57.645635 30147 log.cc:927] Time spent T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:24:57.648706 25833 raft_consensus.cc:1240] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:57.651347 25837 raft_consensus.cc:1240] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:57.644629 30043 raft_consensus.cc:3060] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:24:57.656462 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 50638.7us
I20260709 12:24:57.584712 30041 consensus_queue.cc:237] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:57.638353 30127 raft_consensus.cc:697] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:57.658038 25726 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:57.649734 30150 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:57.660564 25726 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:24:57.661360 30157 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:57.654291 29909 consensus_queue.cc:1243] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer a866ff967d964388a6f0dff7fd43df89 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:24:57.663619 30026 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:57.665408 30036 raft_consensus.cc:2804] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:57.698330 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:57.698655 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:57.704530 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:57.698804 30113 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:57.707703 25677 raft_consensus.cc:2393] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 10: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:57.707798 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:57.708541 26433 raft_consensus.cc:2368] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 10. Current term is 11.
I20260709 12:24:57.699618 30068 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.700249 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:57.710809 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:57.701805 30137 raft_consensus.cc:3055] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:57.702085 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:57.702353 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:57.713797 25679 raft_consensus.cc:3060] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:57.672283 30146 log.cc:927] Time spent T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.189s	user 0.004s	sys 0.000s
I20260709 12:24:57.709076 25831 raft_consensus.cc:1240] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 8 LEADER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:57.708669 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:57.711462 26430 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 9.
I20260709 12:24:57.713075 25680 raft_consensus.cc:2393] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 9: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:57.716075 25726 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:57.722168 25726 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:57.703820 30036 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:57.649377 30045 consensus_queue.cc:260] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:57.726121 30162 raft_consensus.cc:2804] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:24:57.669677 30044 consensus_queue.cc:1059] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:24:57.735846 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:57.736644 26430 raft_consensus.cc:3060] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:57.739590 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:57.727990 30036 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:57.744714 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:57.744967 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:57.746338 25680 raft_consensus.cc:3060] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:57.746316 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:57.725462 30137 raft_consensus.cc:740] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:57.754253 30065 raft_consensus.cc:3055] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:57.760885 30060 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:57.764729 25677 raft_consensus.cc:1275] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:24:57.743341 30162 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:57.738381 30072 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:57.769150 26430 raft_consensus.cc:2468] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 10.
I20260709 12:24:57.769409 25679 raft_consensus.cc:2468] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 10.
I20260709 12:24:57.767992 30065 raft_consensus.cc:740] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:57.772360 30162 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:57.773110 30056 raft_consensus.cc:2749] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:57.713299 30068 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:57.776168 25801 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:57.743158 30045 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:57.782195 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 60097.8us
I20260709 12:24:57.728390 30127 consensus_queue.cc:237] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:57.783090 30065 consensus_queue.cc:260] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:57.791093 30116 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.792538 30064 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:57.804908 25649 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:57.788053 30068 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:57.788951 30113 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.811775 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:57.811877 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:57.812235 25755 raft_consensus.cc:1240] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:57.812795 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:57.813760 25754 raft_consensus.cc:1275] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:24:57.795670 30044 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:57.824169 30044 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:57.791706 30116 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:57.828673 30044 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:57.816498 30060 raft_consensus.cc:2749] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:57.820068 30113 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:57.835043 29813 raft_consensus.cc:3055] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:57.835403 30113 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:57.835479 29813 raft_consensus.cc:740] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:57.835995 30047 raft_consensus.cc:2804] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:57.836539 30047 raft_consensus.cc:697] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 10 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:57.836432 29813 consensus_queue.cc:260] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:57.837677 29813 raft_consensus.cc:3060] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:57.837422 30047 consensus_queue.cc:237] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:57.843746 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:57.808017 30122 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:57.846218 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:57.847256 25679 raft_consensus.cc:2393] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 10: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:57.845094 30122 raft_consensus.cc:3060] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:57.850471 30167 log.cc:927] Time spent T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:24:57.789235 30137 consensus_queue.cc:260] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:57.857193 30137 raft_consensus.cc:3060] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:57.861028 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 52482.8us
I20260709 12:24:57.860198 30061 raft_consensus.cc:2749] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:57.866324 25650 leader_election.cc:400] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Vote denied by peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611) with higher term. Message: Invalid argument: T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for earlier term 9. Current term is 10.
I20260709 12:24:57.870615 30059 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:57.866684 29767 consensus_queue.cc:1048] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:24:57.877717 30046 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:57.879194 30056 raft_consensus.cc:3055] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:57.879596 30056 raft_consensus.cc:740] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:57.880403 30056 consensus_queue.cc:260] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:57.881486 30056 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:57.883422 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:57.886437 25680 raft_consensus.cc:2468] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 11.
I20260709 12:24:57.898198 26434 raft_consensus.cc:1240] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:24:57.904325 25829 raft_consensus.cc:606] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Received request to transfer leadership to TS a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:57.905457 25829 raft_consensus.cc:614] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:57.909605 30063 raft_consensus.cc:2749] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611) with higher term. Message: Invalid argument: T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 8. Current term is 9.
I20260709 12:24:57.910485 30046 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:57.911710 30087 raft_consensus.cc:3055] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:24:57.912185 30087 raft_consensus.cc:740] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:57.913008 30087 consensus_queue.cc:260] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:57.914322 30087 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:24:57.919773 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:57.921006 30116 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:57.921888 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:57.922633 25758 raft_consensus.cc:2393] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 10: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:57.922489 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:57.904279 30173 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:57.915199 30058 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:57.930409 25682 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 14.
I20260709 12:24:57.932050 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:57.932860 25762 raft_consensus.cc:2393] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 12: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:57.934676 25649 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:57.937027 25649 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:57.939363 25649 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:57.944736 26434 raft_consensus.cc:1240] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:57.941846 30150 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:57.948189 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:57.948060 29767 raft_consensus.cc:2749] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:24:57.952332 30150 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:57.954434 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:57.958277 30162 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:57.937881 29755 raft_consensus.cc:2749] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:24:57.938198 29967 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.942857 30030 raft_consensus.cc:2749] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:24:57.977918 30136 log.cc:927] Time spent T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.720s	user 0.002s	sys 0.002s
I20260709 12:24:57.991441 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:24:57.991701 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 705646us
I20260709 12:24:58.013049 25800 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
W20260709 12:24:57.996658 25760 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53460 (request call id 2539) took 1784 ms (client timeout 1688 ms). Trace:
W20260709 12:24:58.016682 25760 rpcz_store.cc:269] 0709 12:24:56.212292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:56.342567 (+130275us) service_pool.cc:224] Handling call
0709 12:24:57.996403 (+1653836us) spinlock_profiling.cc:243] Waited 905 ms on lock 0x7b5400396cd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:57.996574 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2082402688}
I20260709 12:24:58.017146 25726 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:58.012852 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:58.009045 25832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41782 (request call id 900) took 1813 ms. Trace:
I20260709 12:24:58.018404 25726 leader_election.cc:400] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Vote denied by peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611) with higher term. Message: Invalid argument: T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 10. Current term is 11.
I20260709 12:24:58.018700 25726 leader_election.cc:403] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:58.020390 25726 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
W20260709 12:24:57.990971 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:58.023142 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:58.023448 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:58.018133 25832 rpcz_store.cc:276] 0709 12:24:56.195304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.017361 (+822057us) service_pool.cc:224] Handling call
0709 12:24:58.008855 (+991494us) spinlock_profiling.cc:243] Waited 598 ms on lock 0x7b54002f5b54. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:58.008988 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1375211264}
I20260709 12:24:58.009830 25835 raft_consensus.cc:1240] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:24:58.025799 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:58.023898 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:24:57.986292 30039 consensus_meta.cc:287] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.654s	user 0.007s	sys 0.003s
I20260709 12:24:58.032819 25726 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:58.024958 26402 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:58.038928 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:58.041270 25726 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:58.006431 30158 raft_consensus.cc:3055] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:24:57.989257 30162 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:58.046586 26402 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:58.047884 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:58.048509 25726 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:24:57.994558 30091 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:57.946745 30173 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:58.044009 25828 raft_consensus.cc:2468] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 10.
I20260709 12:24:58.033913 30078 raft_consensus.cc:2804] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:58.057314 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:58.066076 25831 raft_consensus.cc:3060] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:24:58.056090 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:58.067266 26402 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:58.067667 25832 raft_consensus.cc:2393] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 9: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:58.068601 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:58.068787 26402 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:58.069438 25832 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 15.
I20260709 12:24:58.070712 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:58.056548 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:58.073114 25836 raft_consensus.cc:2393] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 10: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:58.056953 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:58.073547 25800 leader_election.cc:400] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Vote denied by peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267) with higher term. Message: Invalid argument: T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 10. Current term is 11.
I20260709 12:24:58.058034 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:58.058390 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:58.075575 25833 raft_consensus.cc:2393] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 9: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:58.059389 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:58.039691 30056 raft_consensus.cc:2749] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:58.042761 30150 raft_consensus.cc:3060] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:24:58.037326 30114 consensus_queue.cc:1048] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:24:58.050336 30178 raft_consensus.cc:2749] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:58.049140 30021 raft_consensus.cc:2749] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:24:58.047739 30158 raft_consensus.cc:740] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:58.103979 30158 consensus_queue.cc:260] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:58.105618 30158 raft_consensus.cc:3060] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:57.979645 30036 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:58.109898 30036 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:58.048168 30046 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:58.110499 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:58.117571 25686 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 12.
I20260709 12:24:58.021013 29967 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:58.126238 29967 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:24:58.132648 30152 log.cc:927] Time spent T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.512s	user 0.002s	sys 0.000s
I20260709 12:24:58.066663 30090 raft_consensus.cc:2749] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:24:58.088274 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:58.054870 30127 raft_consensus.cc:2804] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:58.048471 30094 raft_consensus.cc:3055] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:58.096336 30068 raft_consensus.cc:2749] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:58.096848 25758 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:53460
I20260709 12:24:58.143425 25758 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:58.036814 29921 consensus_queue.cc:1059] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 12:24:58.037678 29922 consensus_queue.cc:1059] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:24:58.074023 25800 leader_election.cc:403] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:58.053927 30173 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:58.093109 29979 raft_consensus.cc:2749] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:24:58.094303 30177 log.cc:927] Time spent T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 12:24:58.057601 30061 consensus_queue.cc:1059] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.083s
I20260709 12:24:58.077034 30026 raft_consensus.cc:2749] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:58.143872 25758 raft_consensus.cc:3060] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:58.141412 30094 raft_consensus.cc:740] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:58.141185 30127 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:58.147436 29921 raft_consensus.cc:3055] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:58.148113 29922 raft_consensus.cc:3055] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:24:58.093451 30078 raft_consensus.cc:697] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 8 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
W20260709 12:24:58.153962 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 80603us
I20260709 12:24:58.172489 25800 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:58.173537 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:58.173803 25800 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:58.176677 26437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 1081) took 2088 ms. Trace:
I20260709 12:24:58.162518 25831 raft_consensus.cc:2468] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 11.
I20260709 12:24:58.177033 26437 rpcz_store.cc:276] 0709 12:24:56.088040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:56.109334 (+ 21294us) service_pool.cc:224] Handling call
0709 12:24:56.109793 (+   459us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:56.115981 (+  6188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:56.116028 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:56.144616 (+ 28588us) log.cc:844] Serialized 52 byte log entry
0709 12:24:56.893228 (+748612us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:24:56.938518 (+ 45290us) log.cc:844] Serialized 14 byte log entry
0709 12:24:57.157876 (+219358us) spinlock_profiling.cc:243] Waited 3.61 ms on lock 0x7b1800371200. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d96a743f3 00007f5d96a767c1 00007f5d96a76779 00007f5d96a76709 00007f5d96a766d1 00007f5d96a759cd 0000000000388634 0000000000388479 00007f5d96a5783a
0709 12:24:58.003746 (+845870us) spinlock_profiling.cc:243] Waited 3.05 ms on lock 0x7b1800371200. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d969eec0a 00007f5da012e219 00007f5d96a76a40 00007f5d96a714e4 00007f5d96a71455 00007f5d9d5593c7 00007f5d99b6b9a7 00007f5d99b7b0bf 00007f5d99b7b038
0709 12:24:58.003993 (+   247us) log.cc:844] Serialized 14 byte log entry
0709 12:24:58.176377 (+172384us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:58.176450 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:58.176490 (+    40us) raft_consensus.cc:1685] finished
0709 12:24:58.176503 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:58.176629 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1064704,"prepare.queue_time_us":1113442,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":85,"raft.queue_time_us":7485,"raft.run_cpu_time_us":301,"raft.run_wall_time_us":18452,"spinlock_wait_cycles":15320704,"thread_start_us":883410,"threads_started":2,"wal-append.queue_time_us":749175,"wal-append.run_cpu_time_us":2999,"wal-append.run_wall_time_us":1236372}
I20260709 12:24:58.169787 30127 raft_consensus.cc:3060] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:58.197158 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:58.200178 25835 raft_consensus.cc:2468] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 11.
W20260709 12:24:58.180389 30157 consensus_meta.cc:287] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.519s	user 0.004s	sys 0.007s
I20260709 12:24:58.170128 29922 raft_consensus.cc:740] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:58.180701 30047 raft_consensus.cc:2749] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:24:58.169896 29921 raft_consensus.cc:740] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:58.181071 29907 raft_consensus.cc:2749] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267) with higher term. Message: Invalid argument: T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 10. Current term is 11.
I20260709 12:24:58.180217 30045 raft_consensus.cc:2749] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:58.190567 30061 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:58.214617 25758 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:58.223196 26432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 1068) took 1243 ms. Trace:
I20260709 12:24:58.202737 25726 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
W20260709 12:24:58.228664 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:58.231207 26432 rpcz_store.cc:276] 0709 12:24:56.979445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:56.980863 (+  1418us) service_pool.cc:224] Handling call
0709 12:24:56.981146 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:57.228667 (+247521us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:58.222828 (+994161us) spinlock_profiling.cc:243] Waited 246 ms on lock 0x7b540060fc54. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:58.223121 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":565036800}
I20260709 12:24:58.233196 30090 raft_consensus.cc:2804] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:58.233952 30090 raft_consensus.cc:697] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 11 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:58.239627 25756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 2554) took 1695 ms. Trace:
I20260709 12:24:58.240211 25756 rpcz_store.cc:276] 0709 12:24:56.545137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:56.936467 (+391330us) service_pool.cc:224] Handling call
0709 12:24:56.936843 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:57.326470 (+389627us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:58.239285 (+912815us) spinlock_profiling.cc:243] Waited 292 ms on lock 0x7b5400298954. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:58.239547 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":672090496}
I20260709 12:24:58.232214 25726 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:58.215976 30157 raft_consensus.cc:2749] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:58.249759 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:58.196295 30122 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:58.257284 25756 raft_consensus.cc:1240] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:58.245505 30046 raft_consensus.cc:2749] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:58.235114 30090 consensus_queue.cc:237] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:58.249759 30174 raft_consensus.cc:2804] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:24:58.256347 30181 log.cc:927] Time spent T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:24:58.253253 25835 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:58.250926 29842 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:24:58.267725 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 199008us
I20260709 12:24:58.206785 30078 consensus_queue.cc:237] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:58.245826 30061 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:58.270707 26402 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:58.275552 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:58.276367 25686 raft_consensus.cc:2393] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 10: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:58.227092 30094 consensus_queue.cc:260] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:58.280079 26402 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:58.281769 25684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51578 (request call id 868) took 1084 ms. Trace:
I20260709 12:24:58.282155 25684 rpcz_store.cc:276] 0709 12:24:57.197500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.328904 (+131404us) service_pool.cc:224] Handling call
0709 12:24:57.480991 (+152087us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:57.481189 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:57.481212 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:57.481618 (+   406us) log.cc:844] Serialized 26 byte log entry
0709 12:24:57.624396 (+142778us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:57.624435 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:57.624508 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:57.758491 (+133983us) raft_consensus.cc:1685] finished
0709 12:24:57.758512 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:58.281523 (+523011us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b54002a0150. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b608ad 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:58.281711 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":349051136,"thread_start_us":108126,"threads_started":1,"wal-append.queue_time_us":143137}
I20260709 12:24:58.283267 25758 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:58.283638 25760 raft_consensus.cc:1240] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:58.283941 26402 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:58.266294 30174 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:58.286828 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:58.286827 25801 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:58.290818 25726 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:58.292526 25726 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:58.296514 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:58.297780 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:58.295789 25801 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:58.279526 29810 raft_consensus.cc:3060] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:58.303303 30019 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:58.304600 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:58.305384 25758 raft_consensus.cc:2393] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 10: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:58.306219 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:58.262452 29922 consensus_queue.cc:260] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:58.307395 29922 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:58.310111 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:58.311087 30154 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.313581 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:58.314378 25836 raft_consensus.cc:2393] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 14: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:24:58.315254 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:58.316769 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:58.317559 25833 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:58.311822 30154 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:58.320230 30179 log.cc:927] Time spent T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 12:24:58.321110 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:58.321372 26431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 1071) took 1146 ms. Trace:
I20260709 12:24:58.321895 26431 rpcz_store.cc:276] 0709 12:24:57.174468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.336504 (+162036us) service_pool.cc:224] Handling call
0709 12:24:57.336724 (+   220us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:57.336893 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:24:58.172161 (+835268us) log.cc:844] Serialized 14 byte log entry
0709 12:24:58.320961 (+148800us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:58.321016 (+    55us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:58.321097 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:58.321170 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:58.321307 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":704379,"prepare.queue_time_us":743736,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"thread_start_us":277736,"threads_started":2}
I20260709 12:24:58.323725 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:58.315827 25836 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 9.
I20260709 12:24:58.325886 25726 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:58.363346 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:58.365325 25726 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:58.334919 25833 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 10.
I20260709 12:24:58.367244 25726 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:24:58.368494 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 72784.8us
I20260709 12:24:58.294267 30116 raft_consensus.cc:2749] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:58.291520 30174 raft_consensus.cc:3060] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:58.369937 25801 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:58.297271 30047 raft_consensus.cc:2749] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:24:58.373332 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 89469.7us
I20260709 12:24:58.280521 29933 consensus_queue.cc:1048] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:24:58.380389 25801 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:58.379881 25835 raft_consensus.cc:2468] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 13.
I20260709 12:24:58.269057 29921 consensus_queue.cc:260] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:58.328475 25649 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:58.299952 30046 raft_consensus.cc:2749] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:24:58.380973 26402 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:58.378033 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:58.389503 25801 leader_election.cc:400] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 election: Vote denied by peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) with higher term. Message: Invalid argument: T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 8. Current term is 9.
I20260709 12:24:58.389992 25761 raft_consensus.cc:2410] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 12:24:58.390755 25800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:58.390755 25801 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
W20260709 12:24:58.392186 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 63810us
I20260709 12:24:58.392935 25649 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:58.395053 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:58.395705 25835 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 9.
I20260709 12:24:58.383684 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:58.301069 30094 raft_consensus.cc:3060] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:58.363299 30157 raft_consensus.cc:2749] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:58.372262 30162 raft_consensus.cc:2749] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:24:58.372305 30036 consensus_queue.cc:1048] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:24:58.396756 25833 raft_consensus.cc:2468] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 9.
I20260709 12:24:58.346025 30154 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:58.296909 30091 consensus_queue.cc:1059] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.088s
I20260709 12:24:58.401437 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:58.299710 30039 consensus_queue.cc:1059] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 12:24:58.415967 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:58.375499 30043 raft_consensus.cc:2804] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:58.378667 30025 raft_consensus.cc:2749] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:58.381088 30076 raft_consensus.cc:2749] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:24:58.404023 26402 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:58.419257 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:58.379341 30172 raft_consensus.cc:2804] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:58.423367 25833 raft_consensus.cc:2376] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 13. Re-sending same reply.
I20260709 12:24:58.423388 26402 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:58.395200 30007 raft_consensus.cc:2749] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:24:58.430965 30195 log.cc:927] Time spent T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:24:58.431994 30191 log.cc:927] Time spent T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:24:58.432257 30068 raft_consensus.cc:2804] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:24:58.432763 30068 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:58.433045 30189 log.cc:927] Time spent T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:24:58.433135 30068 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:58.395210 29842 raft_consensus.cc:2749] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:58.401124 30045 raft_consensus.cc:2749] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:24:58.437546 25759 raft_consensus.cc:1240] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 12. Current term is 13. Ops: []
W20260709 12:24:58.439839 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:58.440368 30192 log.cc:927] Time spent T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
W20260709 12:24:58.441043 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:58.444756 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:58.445909 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:58.446686 25833 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:58.447043 29898 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:58.448410 25828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41782 (request call id 916) took 1224 ms. Trace:
I20260709 12:24:58.449901 30122 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:58.428243 29813 consensus_queue.cc:1059] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:58.428608 30039 raft_consensus.cc:2749] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:24:58.450585 25837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 2837) took 1234 ms. Trace:
I20260709 12:24:58.450960 25837 rpcz_store.cc:276] 0709 12:24:57.215873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.528916 (+313043us) service_pool.cc:224] Handling call
0709 12:24:57.529211 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:57.651900 (+122689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:58.450367 (+798467us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b5400359654. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:58.450534 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":280299776}
I20260709 12:24:58.452361 30063 raft_consensus.cc:3055] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:58.448781 25828 rpcz_store.cc:276] 0709 12:24:57.224336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.315662 (+ 91326us) service_pool.cc:224] Handling call
0709 12:24:58.448261 (+1132599us) spinlock_profiling.cc:243] Waited 718 ms on lock 0x7b540010b654. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:58.448357 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1652312448}
I20260709 12:24:58.452824 30063 raft_consensus.cc:740] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:58.453473 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:58.453631 30063 consensus_queue.cc:260] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:58.454543 30063 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:58.454655 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:58.455245 25828 raft_consensus.cc:2468] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 9.
I20260709 12:24:58.457569 30026 raft_consensus.cc:3060] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:58.426473 26402 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:58.458782 25763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48606 (request call id 1048) took 1234 ms. Trace:
I20260709 12:24:58.458958 25837 raft_consensus.cc:1240] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 14. Current term is 15. Ops: [13.13-14.14]
I20260709 12:24:58.460348 25837 raft_consensus.cc:1240] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:24:58.459196 25763 rpcz_store.cc:276] 0709 12:24:57.224825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.224978 (+   153us) service_pool.cc:224] Handling call
0709 12:24:57.225256 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:57.407945 (+182689us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:24:57.540179 (+132234us) log.cc:844] Serialized 14 byte log entry
0709 12:24:57.584545 (+ 44366us) log.cc:844] Serialized 14 byte log entry
0709 12:24:57.584972 (+   427us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:57.585037 (+    65us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:24:57.585095 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:57.721416 (+136321us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x7b1800441160. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d96a422a6 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419
0709 12:24:57.772766 (+ 51350us) spinlock_profiling.cc:243] Waited 6.09 ms on lock 0x7b1800441160. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d96a743f3 00007f5d96a767c1 00007f5d96a76779 00007f5d96a76709 00007f5d96a766d1 00007f5d96a759cd 0000000000388634 0000000000388479 00007f5d96a5783a
0709 12:24:58.458545 (+685779us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b54001dced4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:58.458602 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:58.458730 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8676,"prepare.queue_time_us":56671,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":5979,"raft.queue_time_us":14404,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":8667,"spinlock_wait_cycles":483202176,"thread_start_us":140424,"threads_started":2,"wal-append.queue_time_us":29590}
I20260709 12:24:58.463037 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:58.467633 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:58.471462 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:58.407660 30116 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:58.473340 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:24:58.480891 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 54502.2us
I20260709 12:24:58.481359 26436 raft_consensus.cc:2393] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 10: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:58.482082 26402 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:58.485574 25833 raft_consensus.cc:2468] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 11.
I20260709 12:24:58.485586 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:58.486472 25835 raft_consensus.cc:2410] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:24:58.488677 30025 raft_consensus.cc:2749] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:58.489084 30065 raft_consensus.cc:3060] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:58.489334 30061 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:58.492605 25650 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:58.498796 30007 raft_consensus.cc:2749] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:58.479784 30043 raft_consensus.cc:697] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 9 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:58.500197 30043 consensus_queue.cc:237] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:58.502293 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:58.424701 30157 raft_consensus.cc:2804] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:24:58.504961 26402 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:24:58.506582 26402 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:58.508601 25828 raft_consensus.cc:2468] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 10.
I20260709 12:24:58.509860 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:58.513435 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:58.514593 25835 raft_consensus.cc:2410] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:24:58.486495 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:58.485044 30172 raft_consensus.cc:697] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:58.494479 30034 raft_consensus.cc:2804] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:58.484591 30019 consensus_queue.cc:1059] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
W20260709 12:24:58.515754 30137 consensus_meta.cc:287] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.658s	user 0.011s	sys 0.002s
I20260709 12:24:58.552969 25828 raft_consensus.cc:1275] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:24:58.490753 29802 consensus_queue.cc:1059] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.058s
W20260709 12:24:58.565635 25800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:58.542016 30023 raft_consensus.cc:2804] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:58.549593 30157 raft_consensus.cc:697] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
W20260709 12:24:58.556749 30058 consensus_meta.cc:287] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.618s	user 0.008s	sys 0.002s
I20260709 12:24:58.550568 30042 raft_consensus.cc:2749] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:24:58.598129 25836 raft_consensus.cc:3055] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:58.598521 25836 raft_consensus.cc:740] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:58.571491 25835 raft_consensus.cc:1275] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:24:58.572291 25828 raft_consensus.cc:1240] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 12. Current term is 13. Ops: []
I20260709 12:24:58.574546 25763 raft_consensus.cc:1240] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:58.580478 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:58.605552 25829 raft_consensus.cc:2468] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 11.
I20260709 12:24:58.586843 30137 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:58.595414 30122 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.553009 30005 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.612512 25759 raft_consensus.cc:1240] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:58.612624 25760 raft_consensus.cc:1275] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 12 index: 5. Preceding OpId from leader: term: 11 index: 5. (term mismatch)
I20260709 12:24:58.556396 29755 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:24:58.614953 25760 pending_rounds.cc:85] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 4
W20260709 12:24:58.614319 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 247123us
I20260709 12:24:58.619706 25763 raft_consensus.cc:1240] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 12. Current term is 13. Ops: []
I20260709 12:24:58.619729 25760 pending_rounds.cc:107] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 12.5
I20260709 12:24:58.620280 25760 raft_consensus.cc:2889] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:58.599283 25836 consensus_queue.cc:260] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:58.622743 25836 raft_consensus.cc:3060] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:58.620620 25726 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:58.630837 25726 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:58.627694 25832 raft_consensus.cc:2468] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 10.
W20260709 12:24:58.635603 29905 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.158s	user 0.015s	sys 0.012s
W20260709 12:24:58.648851 29905 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.173s	user 0.015s	sys 0.012s
I20260709 12:24:58.649147 29905 raft_consensus.cc:697] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 10 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:58.650311 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:58.650910 25828 raft_consensus.cc:3060] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:58.649771 30056 raft_consensus.cc:2804] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:24:58.652390 30193 log.cc:927] Time spent T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
I20260709 12:24:58.652663 30056 raft_consensus.cc:697] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 12 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:58.620790 30005 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:58.656067 30005 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:58.629343 29755 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:58.617262 30023 raft_consensus.cc:697] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 9 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:58.661558 30023 consensus_queue.cc:237] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:58.663190 25726 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89
W20260709 12:24:58.629580 29907 consensus_queue.cc:1175] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6e673265293d4e9a937dc45150aeb1b8" responder_term: 10 status { last_received { term: 9 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 9. Current term is 10. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:24:58.664165 30021 consensus_queue.cc:1059] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:24:58.621436 30113 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:58.665892 30113 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:58.650424 30066 raft_consensus.cc:3055] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:58.669144 30066 raft_consensus.cc:740] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:58.670078 30178 raft_consensus.cc:2804] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:24:58.670565 30178 raft_consensus.cc:697] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:58.671387 30178 consensus_queue.cc:237] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:58.672099 30174 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:58.674110 30174 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:58.674559 25761 raft_consensus.cc:1240] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 11. Current term is 12. Ops: []
I20260709 12:24:58.670094 30066 consensus_queue.cc:260] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:58.675769 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:58.653569 30056 consensus_queue.cc:237] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:58.638360 30171 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.739s	user 0.000s	sys 0.026s
I20260709 12:24:58.628520 30170 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.676347 30066 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:58.676363 25829 raft_consensus.cc:2468] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 11.
I20260709 12:24:58.682495 25836 raft_consensus.cc:2468] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 10.
I20260709 12:24:58.643985 30036 raft_consensus.cc:2749] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:24:58.616086 30122 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:58.682000 30171 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.787s	user 0.000s	sys 0.026s
W20260709 12:24:58.689039 30154 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 12:24:58.615823 30137 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:58.716409 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 53278.8us
I20260709 12:24:58.719146 25726 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:24:58.701406 25828 raft_consensus.cc:2468] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 11.
I20260709 12:24:58.720885 25726 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
W20260709 12:24:58.729123 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:58.715126 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 324417us
I20260709 12:24:58.741916 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:58.721194 25828 raft_consensus.cc:1240] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 17. Current term is 18. Ops: []
I20260709 12:24:58.750187 25828 raft_consensus.cc:1240] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 10. Current term is 11. Ops: [8.8-10.9]
I20260709 12:24:58.751893 30078 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.757870 30078 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:58.753448 30197 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:58.760744 25829 raft_consensus.cc:1240] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:58.769562 25828 raft_consensus.cc:1240] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 12. Current term is 13. Ops: []
I20260709 12:24:58.727644 30058 raft_consensus.cc:2804] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:58.733165 29755 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:58.687534 30170 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:24:58.782523 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 229698us
I20260709 12:24:58.784253 26402 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:58.680739 30172 consensus_queue.cc:237] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:58.787560 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:58.778884 30058 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:58.701277 30157 consensus_queue.cc:237] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:58.779897 30034 raft_consensus.cc:697] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 10 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
W20260709 12:24:58.792332 30127 consensus_meta.cc:287] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.571s	user 0.009s	sys 0.002s
I20260709 12:24:58.786337 30042 raft_consensus.cc:2749] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:24:58.776875 30197 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:58.798787 30058 raft_consensus.cc:3060] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:58.801810 30026 raft_consensus.cc:2749] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:58.905484 30026 raft_consensus.cc:3055] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:24:58.906176 30026 raft_consensus.cc:740] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:58.908061 30034 consensus_queue.cc:237] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:58.864856 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 299867us
I20260709 12:24:58.918733 30090 raft_consensus.cc:2749] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:58.921103 30122 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:58.919689 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:58.880283 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:24:58.878651 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 157672us
I20260709 12:24:58.925446 25726 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:58.869635 25650 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:58.927981 30178 raft_consensus.cc:2749] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:58.901145 25830 raft_consensus.cc:1275] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:24:58.778366 29905 consensus_queue.cc:237] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:58.929482 30197 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:58.898357 25828 raft_consensus.cc:1275] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:24:58.802093 30113 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:58.934355 30213 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:24:58.935573 25828 raft_consensus.cc:1275] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:24:58.936123 30197 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.936374 30001 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.937625 30026 consensus_queue.cc:260] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:58.925390 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:58.948880 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:58.949227 30198 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:58.950244 26432 raft_consensus.cc:2393] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 12: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:58.935321 30213 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:58.955976 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 86986.1us
I20260709 12:24:58.955617 30001 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:58.957369 25650 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:58.958703 30001 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:58.959220 30210 raft_consensus.cc:2749] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:24:58.948880 25800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:58.804401 30127 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:58.967372 30127 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:58.968575 25758 raft_consensus.cc:2393] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 10: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:58.970497 30213 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:58.970844 30113 consensus_queue.cc:1059] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:24:58.971350 29802 raft_consensus.cc:2749] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:58.972040 30113 raft_consensus.cc:3055] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:24:58.972054 26437 raft_consensus.cc:1240] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:58.972605 30113 raft_consensus.cc:740] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:58.950349 30198 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:58.975174 30113 consensus_queue.cc:260] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:58.976805 30198 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:58.977406 30113 raft_consensus.cc:3060] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:58.980044 30137 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:58.986886 30150 consensus_meta.cc:287] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.852s	user 0.011s	sys 0.008s
I20260709 12:24:58.987502 30150 raft_consensus.cc:2749] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611) with higher term. Message: Invalid argument: T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 10. Current term is 11.
I20260709 12:24:58.989044 30090 consensus_queue.cc:1059] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:58.989321 25726 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:58.991884 29933 raft_consensus.cc:3055] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:24:58.992178 29921 raft_consensus.cc:3060] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:58.992451 29933 raft_consensus.cc:740] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
W20260709 12:24:58.994273 30116 consensus_meta.cc:287] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.502s	user 0.007s	sys 0.015s
I20260709 12:24:58.994027 29933 consensus_queue.cc:260] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:58.994766 30116 raft_consensus.cc:2749] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:24:58.990819 30197 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:58.995895 29933 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:59.001403 26432 raft_consensus.cc:1275] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:24:59.005812 30090 raft_consensus.cc:3055] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:24:59.012776 30090 raft_consensus.cc:740] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:59.013881 30111 raft_consensus.cc:3055] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:24:59.014396 30111 raft_consensus.cc:740] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:59.014143 30090 consensus_queue.cc:260] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:59.014858 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:59.015791 26437 raft_consensus.cc:2468] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 9.
I20260709 12:24:59.008147 30127 raft_consensus.cc:2804] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:59.006524 30026 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:59.016517 30127 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:59.013916 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:59.017007 30127 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:59.018077 29979 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:24:59.018836 29979 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:58.992089 30172 consensus_queue.cc:1048] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
W20260709 12:24:59.020684 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:59.015832 30090 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:59.021363 29979 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:59.015717 30111 consensus_queue.cc:260] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:59.026142 25835 raft_consensus.cc:1275] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 12:24:59.028098 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:24:59.028658 30194 log.cc:927] Time spent T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.710s	user 0.004s	sys 0.000s
I20260709 12:24:59.028162 25833 raft_consensus.cc:1275] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:24:59.031344 30078 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:59.032922 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:59.034646 25830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41782 (request call id 915) took 1816 ms. Trace:
W20260709 12:24:59.036507 30204 log.cc:927] Time spent T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
I20260709 12:24:59.042703 25835 pending_rounds.cc:85] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a: Aborting all ops after (but not including) 8
W20260709 12:24:59.042562 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 81182.4us
I20260709 12:24:59.007707 25726 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:24:59.050482 25835 pending_rounds.cc:107] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 12:24:59.055438 25835 raft_consensus.cc:2889] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:59.064060 30216 log.cc:927] Time spent T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.219s	user 0.002s	sys 0.000s
I20260709 12:24:59.069624 30157 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:59.070411 30157 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:59.071476 29810 consensus_meta.cc:287] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.741s	user 0.008s	sys 0.012s
I20260709 12:24:59.072271 30170 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:59.044543 25830 rpcz_store.cc:276] 0709 12:24:57.217765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.816143 (+598378us) service_pool.cc:224] Handling call
0709 12:24:57.827264 (+ 11121us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:58.929062 (+1101798us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:59.034256 (+105194us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54004213d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:59.034567 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2467201408}
I20260709 12:24:59.086519 26432 raft_consensus.cc:1240] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:59.088873 29922 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.089772 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:59.089598 29922 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:59.073980 29810 raft_consensus.cc:2749] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:59.058073 30127 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:59.098104 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:59.100536 25837 raft_consensus.cc:1240] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 10 LEADER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:59.105397 30173 raft_consensus.cc:3055] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:59.105904 30173 raft_consensus.cc:740] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
W20260709 12:24:59.106420 30219 log.cc:927] Time spent T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.269s	user 0.001s	sys 0.000s
I20260709 12:24:59.106981 30173 consensus_queue.cc:260] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:59.107460 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 99995.7us
W20260709 12:24:59.110918 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:59.114360 30068 consensus_meta.cc:287] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.681s	user 0.014s	sys 0.005s
W20260709 12:24:59.115440 30176 log.cc:927] Time spent T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 1.106s	user 0.000s	sys 0.003s
I20260709 12:24:59.116775 26436 raft_consensus.cc:1275] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:24:59.124421 30059 raft_consensus.cc:2804] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:59.125001 30001 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:59.125283 30059 raft_consensus.cc:697] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:59.125859 30001 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:59.126760 30059 consensus_queue.cc:237] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:59.128580 30094 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
W20260709 12:24:59.129436 30207 log.cc:927] Time spent T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.297s	user 0.001s	sys 0.000s
I20260709 12:24:59.130271 25757 raft_consensus.cc:2468] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 11.
I20260709 12:24:59.104923 25801 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:59.133611 26432 raft_consensus.cc:2468] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 13.
I20260709 12:24:59.115027 30068 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:59.129441 30218 log.cc:927] Time spent T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.293s	user 0.001s	sys 0.002s
I20260709 12:24:59.149456 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:59.139462 30122 consensus_queue.cc:1059] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 12:24:59.129433 30094 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:59.085758 30058 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:59.163069 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:59.163970 25763 raft_consensus.cc:1240] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:59.156015 30197 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:59.168686 29922 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:59.171209 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:59.162542 30173 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:24:59.174901 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 114242us
I20260709 12:24:59.175400 29842 raft_consensus.cc:3055] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:24:59.179596 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:59.133046 30170 consensus_queue.cc:1048] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 12:24:59.181878 30001 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:59.194777 29842 raft_consensus.cc:740] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:59.205397 29842 consensus_queue.cc:260] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:59.205878 25650 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:59.207096 29842 raft_consensus.cc:3060] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:59.183516 25756 raft_consensus.cc:1275] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:24:59.184306 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:59.184760 30111 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:24:59.194229 30222 log.cc:927] Time spent T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 12:24:59.207809 25650 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:59.178663 30157 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:59.219949 30094 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:59.220060 30197 raft_consensus.cc:2749] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:24:59.220312 30058 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:59.219560 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:59.208321 26402 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
W20260709 12:24:59.222573 25800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:59.220338 25681 raft_consensus.cc:1275] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:59.225159 30001 raft_consensus.cc:2804] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:59.227169 30001 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:59.227272 25754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 2943) took 1308 ms. Trace:
I20260709 12:24:59.227586 30001 raft_consensus.cc:3060] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:59.225548 25837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44218 (request call id 1705) took 1160 ms. Trace:
I20260709 12:24:59.227622 25754 rpcz_store.cc:276] 0709 12:24:57.919052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.919182 (+   130us) service_pool.cc:224] Handling call
0709 12:24:57.920849 (+  1667us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:58.054162 (+133313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:58.054208 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:58.054266 (+    58us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:24:58.054311 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:59.212357 (+1158046us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b54003a6bd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:59.215064 (+  2707us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:59.227041 (+ 11977us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":306084992}
I20260709 12:24:59.229434 25837 rpcz_store.cc:276] 0709 12:24:58.061174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.461148 (+399974us) service_pool.cc:224] Handling call
0709 12:24:58.461389 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:59.101118 (+639729us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:59.210001 (+108883us) spinlock_profiling.cc:243] Waited 631 ms on lock 0x7b54003c5354. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:24:59.221838 (+ 11837us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1451734912}
I20260709 12:24:59.225206 30007 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.233698 30007 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:59.236281 30007 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:59.215001 29802 raft_consensus.cc:2749] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:24:59.240759 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 136139us
I20260709 12:24:59.241762 25801 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:59.241931 30127 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:59.244556 30068 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:59.208294 30210 consensus_queue.cc:1059] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:24:59.250844 25650 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:59.256771 25726 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:59.261323 25650 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:59.263734 29755 raft_consensus.cc:2749] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:59.264246 29990 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:59.264931 29990 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:59.267309 29990 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:59.268409 30007 raft_consensus.cc:2749] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:59.268827 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:59.269371 30007 consensus_queue.cc:1059] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:24:59.269888 25681 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 10.
I20260709 12:24:59.270450 30007 consensus_queue.cc:1048] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:24:59.272524 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 64335.3us
I20260709 12:24:59.274004 25686 raft_consensus.cc:1240] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 11. Current term is 12. Ops: []
I20260709 12:24:59.274356 26402 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:59.275158 30005 raft_consensus.cc:3055] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:24:59.275338 30026 raft_consensus.cc:2804] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:59.275672 30005 raft_consensus.cc:740] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:59.276005 30026 raft_consensus.cc:697] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 11 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:59.276863 30005 consensus_queue.cc:260] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:59.278496 30005 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:24:59.278299 30113 consensus_queue.cc:1048] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:59.277043 30026 consensus_queue.cc:237] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:59.231504 30122 consensus_queue.cc:1059] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 12:24:59.283952 30068 raft_consensus.cc:2749] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:59.286754 25681 raft_consensus.cc:1275] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:24:59.287469 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:59.292433 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:59.294003 30210 consensus_queue.cc:1059] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:24:59.295255 30197 raft_consensus.cc:2804] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:24:59.261474 25684 raft_consensus.cc:1240] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:59.296048 30197 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:59.296470 30197 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:59.297444 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:59.298084 30065 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.298740 30065 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:59.300634 30122 raft_consensus.cc:3055] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:24:59.300518 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 58902.3us
I20260709 12:24:59.301112 30065 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:59.301745 30065 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.302270 30065 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:59.295392 30210 raft_consensus.cc:3055] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:24:59.303201 30210 raft_consensus.cc:740] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:59.304497 30210 consensus_queue.cc:260] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:59.305307 30212 log.cc:927] Time spent T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.471s	user 0.003s	sys 0.000s
I20260709 12:24:59.305928 30210 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:24:59.306120 25759 raft_consensus.cc:1275] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:24:59.301128 30122 raft_consensus.cc:740] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:59.308143 29990 raft_consensus.cc:2749] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:59.336838 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:59.343497 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:59.342167 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:59.352124 26402 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:59.349466 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:59.365392 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:59.366139 25681 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 10.
I20260709 12:24:59.372267 25835 raft_consensus.cc:3060] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:59.375209 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:59.366446 30122 consensus_queue.cc:260] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:59.380338 30122 raft_consensus.cc:3060] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:59.378328 25801 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:24:59.388543 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:59.392360 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:59.394497 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:59.395465 29905 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.395617 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:59.396795 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:59.396341 29905 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:59.398032 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:59.398542 30066 consensus_queue.cc:1048] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:24:59.399441 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:59.402725 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:59.404521 30065 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:59.405853 30208 log.cc:927] Time spent T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.574s	user 0.002s	sys 0.002s
I20260709 12:24:59.408411 25757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48606 (request call id 1062) took 1100 ms. Trace:
I20260709 12:24:59.408835 25757 rpcz_store.cc:276] 0709 12:24:58.308230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.309794 (+  1564us) service_pool.cc:224] Handling call
0709 12:24:59.408199 (+1098405us) spinlock_profiling.cc:243] Waited 721 ms on lock 0x7b54001dbfd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:24:59.408339 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1658796288}
I20260709 12:24:59.410897 30215 consensus_queue.cc:1048] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 12:24:59.388480 29907 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.384850 25830 raft_consensus.cc:2468] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 13.
I20260709 12:24:59.414604 25756 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:24:59.386070 29755 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.396354 25758 raft_consensus.cc:2468] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 12.
I20260709 12:24:59.415632 25684 raft_consensus.cc:1275] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:24:59.420765 30043 raft_consensus.cc:2804] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:24:59.420603 29907 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:59.421422 25761 raft_consensus.cc:1275] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:24:59.421319 30043 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:59.421918 30043 raft_consensus.cc:3060] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:59.424623 29755 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:59.427700 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:59.432673 30043 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:59.436645 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:59.438834 25683 raft_consensus.cc:1275] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:24:59.441699 29802 raft_consensus.cc:3055] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:24:59.442225 29802 raft_consensus.cc:740] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:59.423516 29907 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:24:59.399672 29905 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:24:59.447630 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 59227.5us
I20260709 12:24:59.448413 25679 raft_consensus.cc:2410] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:24:59.451531 25680 raft_consensus.cc:1240] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 9. Current term is 10. Ops: []
I20260709 12:24:59.452900 29755 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:59.453717 29967 raft_consensus.cc:2804] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:24:59.454573 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 118414us
I20260709 12:24:59.455691 26402 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:59.456216 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:24:59.460039 25831 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "a866ff967d964388a6f0dff7fd43df89"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:24:59.460554 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:59.460820 25831 raft_consensus.cc:606] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Received request to transfer leadership to TS a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:59.461179 25831 raft_consensus.cc:614] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:59.461632 30043 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:59.462153 25837 raft_consensus.cc:1275] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:24:59.463045 26431 raft_consensus.cc:1275] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:24:59.464644 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:59.464789 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:59.465840 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:59.465976 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:59.466612 25684 raft_consensus.cc:2468] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 10.
I20260709 12:24:59.467152 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:59.468459 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:59.469162 26437 raft_consensus.cc:2468] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 7.
I20260709 12:24:59.470187 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:59.471293 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:59.472545 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:59.474310 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:59.475108 25833 raft_consensus.cc:2368] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 13. Current term is 14.
I20260709 12:24:59.476271 29802 consensus_queue.cc:260] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:59.477548 29802 raft_consensus.cc:3060] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:59.494115 25835 raft_consensus.cc:2468] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 10.
I20260709 12:24:59.508255 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:59.508975 25800 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:59.509245 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:59.501853 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:59.503371 30213 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.512562 30007 consensus_queue.cc:1048] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:59.513057 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:59.511765 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:59.514969 25754 raft_consensus.cc:3060] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:24:59.511996 30213 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:59.518949 30157 consensus_queue.cc:1048] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:59.520471 25726 leader_election.cc:400] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237) with higher term. Message: Invalid argument: T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 13. Current term is 14.
I20260709 12:24:59.520761 25763 raft_consensus.cc:1275] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:24:59.520994 25726 leader_election.cc:403] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:59.523639 25726 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:59.525259 30170 raft_consensus.cc:2804] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:24:59.525655 30170 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:59.526005 30170 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:59.444952 30001 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:59.527629 25754 raft_consensus.cc:2468] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 14.
I20260709 12:24:59.528738 29990 raft_consensus.cc:2749] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237) with higher term. Message: Invalid argument: T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 13. Current term is 14.
I20260709 12:24:59.529892 30001 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:59.531200 25680 raft_consensus.cc:1275] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:24:59.529089 30213 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:59.511660 30197 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:59.536955 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:59.537529 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:59.537892 25830 raft_consensus.cc:2410] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 10 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:24:59.539427 25828 raft_consensus.cc:1275] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 12:24:59.540563 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:59.541249 25832 raft_consensus.cc:2468] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 11.
I20260709 12:24:59.541631 30197 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:59.539441 25678 raft_consensus.cc:2393] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 10: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:24:59.542722 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:59.543370 25837 raft_consensus.cc:2468] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 12.
I20260709 12:24:59.544237 25834 raft_consensus.cc:2393] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 10: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:59.554507 25726 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
W20260709 12:24:59.566078 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 57200.8us
I20260709 12:24:59.481814 29967 raft_consensus.cc:697] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 10 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:59.585814 25756 raft_consensus.cc:2410] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 16 because replica has last-logged OpId of term: 14 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 13.
I20260709 12:24:59.588846 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:59.595569 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:59.596906 25835 raft_consensus.cc:1275] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:24:59.597856 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:59.598703 25757 raft_consensus.cc:2393] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 12: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:59.598829 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:59.600057 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:59.589489 25831 raft_consensus.cc:2468] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 7.
W20260709 12:24:59.604630 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:59.611286 30059 consensus_queue.cc:1048] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:59.611853 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:59.573251 29907 raft_consensus.cc:2749] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:59.618316 26439 raft_consensus.cc:3060] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:24:59.612708 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 157186us
I20260709 12:24:59.628561 26436 raft_consensus.cc:1275] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:24:59.628772 26402 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:59.629292 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:59.629596 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:24:59.630021 25837 raft_consensus.cc:1813] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Handling vote request from an unknown peer f82778701b464892aab92a752ed7ffdc
I20260709 12:24:59.630159 26432 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:59.630512 25837 raft_consensus.cc:2368] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for earlier term 9. Current term is 10.
I20260709 12:24:59.631089 30018 raft_consensus.cc:2804] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:24:59.631136 26402 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:24:59.608072 30173 raft_consensus.cc:2804] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:59.631783 30018 raft_consensus.cc:697] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 11 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:59.632284 30023 consensus_queue.cc:1048] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:59.632812 30018 consensus_queue.cc:237] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:59.633245 25801 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:59.634017 30023 raft_consensus.cc:2804] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:24:59.634639 30023 raft_consensus.cc:697] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 10 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:24:59.595590 30170 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:59.639333 30078 consensus_queue.cc:1059] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:59.641719 30078 raft_consensus.cc:3055] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:24:59.642132 30078 raft_consensus.cc:740] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:59.643134 30078 consensus_queue.cc:260] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:59.635514 30154 consensus_queue.cc:1048] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:59.646080 29921 consensus_queue.cc:1048] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:24:59.646417 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:59.640115 30198 consensus_queue.cc:1048] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:59.644550 30078 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:59.648257 26402 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:59.649302 29921 raft_consensus.cc:2749] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:59.650103 25758 raft_consensus.cc:1275] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:24:59.646308 30170 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:59.640479 25801 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:59.590178 30113 raft_consensus.cc:2804] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:59.662038 25833 raft_consensus.cc:2393] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 13: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
W20260709 12:24:59.662184 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 60384.2us
I20260709 12:24:59.662158 25801 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:59.655902 26439 raft_consensus.cc:2468] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 14.
I20260709 12:24:59.590992 30157 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.662083 25759 raft_consensus.cc:2468] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 10.
I20260709 12:24:59.621650 29802 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:59.675729 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:59.677188 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:59.679682 25800 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:24:59.588682 30213 consensus_queue.cc:1059] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.078s
I20260709 12:24:59.682650 25685 raft_consensus.cc:1275] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:24:59.599521 25726 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:59.661810 30113 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:59.666134 29922 raft_consensus.cc:2749] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:59.665503 30173 raft_consensus.cc:697] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:24:59.687106 25757 raft_consensus.cc:1813] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Handling vote request from an unknown peer f82778701b464892aab92a752ed7ffdc
I20260709 12:24:59.665423 30197 raft_consensus.cc:2749] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:24:59.688215 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 80500.6us
W20260709 12:24:59.688333 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 88887us
I20260709 12:24:59.691557 25757 raft_consensus.cc:2410] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 12:24:59.703351 25800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:59.687338 30198 raft_consensus.cc:2804] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:24:59.675760 30043 consensus_queue.cc:1048] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 12:24:59.676424 29921 consensus_queue.cc:1048] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:24:59.689991 30113 raft_consensus.cc:3060] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:59.710770 25763 raft_consensus.cc:1240] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 13. Current term is 14. Ops: [11.5-13.6]
I20260709 12:24:59.725272 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:59.741309 25758 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:24:59.696442 30090 raft_consensus.cc:2749] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:24:59.719039 30210 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.719156 29905 consensus_queue.cc:1048] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:24:59.746134 30210 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:59.718658 30023 consensus_queue.cc:237] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:59.750694 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:59.674266 30157 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:59.730875 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:59.732307 30173 consensus_queue.cc:237] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:59.734639 25650 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:24:59.681448 30154 consensus_queue.cc:1048] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 12:24:59.736977 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:59.738037 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:59.739096 29921 consensus_queue.cc:1048] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:59.682227 29802 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:24:59.756500 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 43726.5us
I20260709 12:24:59.755268 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:24:59.698498 30059 consensus_queue.cc:1048] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 12:24:59.758775 25837 raft_consensus.cc:2468] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 10.
I20260709 12:24:59.759262 25834 raft_consensus.cc:2393] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 10: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:24:59.763175 25833 raft_consensus.cc:1275] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:24:59.759357 25650 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:59.761142 25760 raft_consensus.cc:2468] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 9.
I20260709 12:24:59.761731 25758 raft_consensus.cc:2410] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 12:24:59.766503 25649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:59.768159 25650 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:59.772373 25801 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:59.776386 25650 leader_election.cc:400] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Vote denied by peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237) with higher term. Message: Invalid argument: T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for earlier term 9. Current term is 10.
I20260709 12:24:59.776757 25650 leader_election.cc:403] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:59.759099 29842 raft_consensus.cc:2749] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:24:59.781524 25801 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:59.774305 30007 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.774580 29755 raft_consensus.cc:2804] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:59.778246 25649 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:59.842908 26432 raft_consensus.cc:2468] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 10.
W20260709 12:24:59.843170 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 64989.5us
I20260709 12:24:59.786430 30111 raft_consensus.cc:3055] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:24:59.793327 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:59.777740 29922 consensus_queue.cc:1048] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 12:24:59.794862 29905 raft_consensus.cc:2749] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:59.797264 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:59.769552 30210 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:24:59.763432 30122 consensus_queue.cc:1048] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 12:24:59.842690 29755 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:59.812790 30214 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:24:59.760308 30198 raft_consensus.cc:697] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 14 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:24:59.762941 29907 raft_consensus.cc:2749] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:59.827414 26436 raft_consensus.cc:1240] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 10. Current term is 11. Ops: []
I20260709 12:24:59.700896 29967 consensus_queue.cc:237] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:59.840080 25678 raft_consensus.cc:1275] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
W20260709 12:24:59.843240 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 61815.3us
W20260709 12:24:59.782943 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 59200.7us
I20260709 12:24:59.790335 30157 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:59.846073 25649 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:24:59.846647 30005 raft_consensus.cc:2804] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:59.774581 30213 raft_consensus.cc:2804] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:24:59.849046 25677 raft_consensus.cc:2468] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 7.
I20260709 12:24:59.806569 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:24:59.845067 30111 raft_consensus.cc:740] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:24:59.845292 30065 raft_consensus.cc:2749] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:24:59.873669 25801 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:24:59.915418 25801 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:24:59.884467 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:24:59.862710 29755 raft_consensus.cc:3060] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:59.892815 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:59.891762 30198 consensus_queue.cc:237] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:59.922818 30078 raft_consensus.cc:2749] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:24:59.925424 29922 raft_consensus.cc:2804] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:59.925907 29922 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:59.872660 29842 consensus_queue.cc:1059] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:24:59.854075 30007 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:24:59.926311 29922 raft_consensus.cc:3060] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:59.904091 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:59.906644 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:59.907421 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:59.912338 26432 raft_consensus.cc:1240] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 17. Current term is 18. Ops: []
I20260709 12:24:59.928902 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:24:59.886364 25726 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:24:59.914052 25685 raft_consensus.cc:2468] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 9.
I20260709 12:24:59.925647 30078 consensus_queue.cc:1048] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:24:59.930125 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 43864.4us
I20260709 12:24:59.893287 30113 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:24:59.927942 26438 raft_consensus.cc:2468] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 7.
I20260709 12:24:59.885506 30005 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:59.937127 26437 raft_consensus.cc:2393] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 11: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:24:59.887012 30210 raft_consensus.cc:2804] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:24:59.935232 29990 raft_consensus.cc:2749] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:24:59.888425 30213 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:24:59.934695 26430 raft_consensus.cc:2468] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 10.
I20260709 12:24:59.940132 30005 raft_consensus.cc:3060] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:24:59.954597 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:24:59.939904 30210 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:59.943612 30213 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:24:59.965867 25837 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 15.
I20260709 12:24:59.966177 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:24:59.966966 25833 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:24:59.943499 29802 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:24:59.968268 30210 raft_consensus.cc:3060] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:00.011874 25801 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
W20260709 12:25:00.015003 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 309141us
I20260709 12:25:00.043802 25801 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:00.055286 25834 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "a866ff967d964388a6f0dff7fd43df89"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:25:00.055894 25834 raft_consensus.cc:606] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Received request to transfer leadership to TS a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:00.056299 25834 raft_consensus.cc:614] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:00.042587 30170 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:00.045387 30078 raft_consensus.cc:2749] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:00.047164 30026 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:00.053542 30197 raft_consensus.cc:2804] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:00.068920 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
W20260709 12:25:00.077121 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 304452us
I20260709 12:25:00.047261 30065 consensus_queue.cc:1048] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 12:25:00.092935 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:00.103387 25837 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:00.084857 29802 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.009413 30111 consensus_queue.cc:260] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:00.073098 30170 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:00.104882 30197 raft_consensus.cc:697] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 10 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:00.127122 25650 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:00.131162 25650 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:00.138871 25801 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:00.113852 30043 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.156505 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:00.122219 30113 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:00.171478 25832 raft_consensus.cc:1275] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:00.117595 29802 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:00.114161 30026 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:00.143191 30249 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:00.203495 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:00.160419 30043 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:00.202077 30018 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
W20260709 12:25:00.233896 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 89547us
I20260709 12:25:00.211378 30252 raft_consensus.cc:3055] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:25:00.251320 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:00.204708 30249 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:00.254355 25836 raft_consensus.cc:1275] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:00.255122 25760 raft_consensus.cc:1275] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:25:00.255251 30259 log.cc:927] Time spent T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 12:25:00.255364 30251 log.cc:927] Time spent T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
W20260709 12:25:00.261691 30244 log.cc:927] Time spent T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
W20260709 12:25:00.262686 30247 log.cc:927] Time spent T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
I20260709 12:25:00.264133 25677 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
mode: GRACEFUL
new_leader_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:49108
W20260709 12:25:00.264801 30245 log.cc:927] Time spent T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 12:25:00.265403 30278 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.269261 30043 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:25:00.270117 30240 log.cc:927] Time spent T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.422s	user 0.003s	sys 0.000s
I20260709 12:25:00.243757 30252 raft_consensus.cc:740] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:00.251443 30197 consensus_queue.cc:237] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:00.277634 30214 raft_consensus.cc:2749] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237) with higher term. Message: Invalid argument: T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for earlier term 9. Current term is 10.
I20260709 12:25:00.277735 30265 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:00.281891 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:00.290939 25833 raft_consensus.cc:2468] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 14.
W20260709 12:25:00.248031 30246 log.cc:927] Time spent T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.206s	user 0.002s	sys 0.000s
I20260709 12:25:00.237136 30266 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:00.298861 25837 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 16.
I20260709 12:25:00.307850 25677 raft_consensus.cc:606] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 11 LEADER]: Received request to transfer leadership to TS 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:00.319998 30026 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:00.309062 30111 raft_consensus.cc:3060] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:00.252907 30263 raft_consensus.cc:2804] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:00.309867 30253 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.250746 29905 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:00.278861 30170 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:00.294144 30157 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:00.330538 25649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:00.355630 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 224535us
I20260709 12:25:00.323369 29802 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:00.250893 30018 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:00.334983 30043 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.309940 29990 consensus_queue.cc:1048] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
W20260709 12:25:00.387079 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 108432us
I20260709 12:25:00.357215 30263 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:00.403633 25726 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:00.406296 25650 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:00.385829 30170 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.424111 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:00.425004 26439 raft_consensus.cc:1240] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:00.330132 30278 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:00.430576 25686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51578 (request call id 875) took 1084 ms. Trace:
W20260709 12:25:00.470435 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 64217us
I20260709 12:25:00.470338 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:00.409045 30263 raft_consensus.cc:3060] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:00.411000 30262 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.433794 25683 raft_consensus.cc:1275] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:25:00.434454 25680 raft_consensus.cc:1275] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:00.387550 30157 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:00.405020 30215 consensus_queue.cc:1048] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 12:25:00.508296 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:25:00.386420 30253 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:00.412287 30043 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:00.515745 25682 raft_consensus.cc:1275] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:25:00.494011 30214 raft_consensus.cc:2749] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:00.391211 30266 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:00.519734 25754 raft_consensus.cc:2468] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 8.
I20260709 12:25:00.503129 29967 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.506618 25686 rpcz_store.cc:276] 0709 12:24:59.337564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.340741 (+  3177us) service_pool.cc:224] Handling call
0709 12:24:59.430417 (+ 89676us) spinlock_profiling.cc:243] Waited 1.65 ms on lock 0x7b5800003698. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d96a3cb71 00007f5d96a3ceee 000000000036eb39 00007f5d9eab01e0 00007f5d9eb790c4 00007f5d9eb79131 00007f5d9eb3afc0 00007f5d9eb25929 00007f5d9eb253d2 00007f5d9809cbd4
0709 12:24:59.430598 (+   181us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:59.431146 (+   548us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:59.431178 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:59.431689 (+   511us) log.cc:844] Serialized 26 byte log entry
0709 12:24:59.679756 (+248067us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:59.679794 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:59.679857 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:00.269270 (+589413us) spinlock_profiling.cc:243] Waited 3.85 ms on lock 0x7b4400022b4c. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db 00007f5d99708aaf 00007f5d996fc86e 00007f5d996fbbb6 00007f5d996fb7d8 00007f5d99705221 00007f5d997051d9 00007f5d99705169
0709 12:25:00.421590 (+152320us) raft_consensus.cc:1685] finished
0709 12:25:00.421611 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:00.421732 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":217,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":97,"spinlock_wait_cycles":12651136,"thread_start_us":235592,"threads_started":1,"wal-append.queue_time_us":363302}
W20260709 12:25:00.531152 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 127591us
I20260709 12:25:00.413816 29905 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:00.426693 30170 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:00.511708 30289 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:00.534706 30005 consensus_meta.cc:287] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.554s	user 0.007s	sys 0.004s
I20260709 12:25:00.514256 30262 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:00.595213 26434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 1093) took 1006 ms. Trace:
I20260709 12:25:00.583423 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:00.599395 25682 raft_consensus.cc:1275] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:25:00.603433 25680 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 14.
W20260709 12:25:00.618770 25649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:00.618603 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:00.626735 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:00.633354 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 126471us
I20260709 12:25:00.635340 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:00.635819 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:00.636021 25835 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 14.
I20260709 12:25:00.600832 29802 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.527629 30210 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:00.573612 29967 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:00.601748 26434 rpcz_store.cc:276] 0709 12:24:59.463704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.471468 (+  7764us) service_pool.cc:224] Handling call
0709 12:24:59.471841 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:59.519167 (+ 47326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:59.519201 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:59.519752 (+   551us) log.cc:844] Serialized 26 byte log entry
0709 12:24:59.594957 (+ 75205us) spinlock_profiling.cc:243] Waited 25.2 ms on lock 0x7b180040c660. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d96a56e07 00007f5d9f8b19a9 00007f5d96a7369b 00007f5d96a7193f 00007f5d96a73c02 00007f5d996fb20b 00007f5d99700d23 00007f5d997010d1 00007f5d99b1ca0f
0709 12:24:59.770447 (+175490us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:24:59.770488 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:59.770551 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:00.424573 (+654022us) raft_consensus.cc:1685] finished
0709 12:25:00.424596 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:00.469817 (+ 45221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":107707,"raft.queue_time_us":38458,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"spinlock_wait_cycles":57936640,"thread_start_us":174455,"threads_started":1,"wal-append.queue_time_us":423406}
I20260709 12:25:00.595901 30173 consensus_queue.cc:1048] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 12:25:00.596571 30289 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:00.631114 30288 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.657015 30288 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:00.659453 30288 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:00.634871 30291 raft_consensus.cc:2804] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:00.660965 30278 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:00.661314 30291 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:00.661784 30291 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:00.661012 30018 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:25:00.664978 29755 consensus_meta.cc:287] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.740s	user 0.003s	sys 0.007s
I20260709 12:25:00.665385 29755 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:00.664574 29802 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:00.667374 29755 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:00.663718 29922 consensus_meta.cc:287] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.737s	user 0.009s	sys 0.001s
I20260709 12:25:00.528542 30252 consensus_queue.cc:260] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:00.630620 30249 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:00.594596 30005 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:00.645593 30269 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.642817 29990 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
W20260709 12:25:00.686750 30281 log.cc:927] Time spent T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
W20260709 12:25:00.687390 30277 log.cc:927] Time spent T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
W20260709 12:25:00.712182 30260 log.cc:927] Time spent T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.316s	user 0.000s	sys 0.001s
W20260709 12:25:00.713445 30257 log.cc:927] Time spent T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.275s	user 0.001s	sys 0.000s
I20260709 12:25:00.715047 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:00.688820 30253 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:00.689445 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:00.716470 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:00.716910 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:00.717276 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:00.716429 30263 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:00.690400 30279 log.cc:927] Time spent T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
I20260709 12:25:00.719872 29967 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:00.697922 25760 raft_consensus.cc:3060] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:00.721315 30263 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:00.688454 25761 raft_consensus.cc:1240] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:00.725114 30280 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:00.726029 30280 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:00.726850 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:00.696365 30278 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.727856 30278 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:00.673396 29922 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:00.729339 29905 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:00.729991 30278 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:00.715176 30210 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:00.733796 30248 log.cc:927] Time spent T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.633s	user 0.002s	sys 0.000s
I20260709 12:25:00.738153 30289 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:00.738847 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:00.739022 30269 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:00.730130 29922 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:00.741660 30269 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:00.742640 30157 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:00.743813 30170 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:00.667402 30213 consensus_meta.cc:287] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.650s	user 0.006s	sys 0.003s
I20260709 12:25:00.681950 30288 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.747892 26401 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:25:00.708248 25650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:00.758647 25650 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:00.775826 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:00.780373 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:00.782444 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:00.759749 29967 raft_consensus.cc:2804] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:00.763789 30198 raft_consensus.cc:2804] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:00.756918 30288 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:00.777890 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 209434us
I20260709 12:25:00.768761 30094 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.787621 30271 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.796536 30271 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:00.798871 30294 consensus_queue.cc:1059] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:00.798919 30271 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:00.800324 30122 raft_consensus.cc:3055] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:00.800521 30288 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:00.800860 30122 raft_consensus.cc:740] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:00.801824 30122 consensus_queue.cc:260] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:00.803138 30122 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:00.784276 30018 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.804498 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:00.805163 25650 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:00.804328 30018 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:00.807366 30018 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:00.808211 30293 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.808323 30284 raft_consensus.cc:2749] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:00.808563 30297 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.808878 30293 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:00.809231 30297 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:00.810063 25682 raft_consensus.cc:1275] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:25:00.810456 25682 pending_rounds.cc:85] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc: Aborting all ops after (but not including) 5
I20260709 12:25:00.810717 25682 pending_rounds.cc:107] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:25:00.810945 25682 raft_consensus.cc:2889] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:00.811090 30293 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:00.811607 30290 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.786870 30210 raft_consensus.cc:2749] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:00.812132 30290 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:00.829664 30290 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:00.812428 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:00.831115 25762 raft_consensus.cc:3060] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:25:00.784552 29967 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:00.832373 29967 raft_consensus.cc:3060] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:00.832985 30005 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:00.834779 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:00.818003 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:00.755805 30213 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:00.835703 30094 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:00.838174 30265 raft_consensus.cc:2749] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:00.752833 29990 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:00.813064 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:00.839679 25758 raft_consensus.cc:3060] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:00.835146 30266 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:00.840405 25755 raft_consensus.cc:2468] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 13.
I20260709 12:25:00.842731 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:00.819334 25650 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:00.815363 30018 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.814056 30043 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:25:00.913419 25800 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.703s	user 0.020s	sys 0.053s
W20260709 12:25:00.906744 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 87491us
W20260709 12:25:00.913827 25800 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.020s	sys 0.053s
W20260709 12:25:00.844496 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:00.905624 25686 raft_consensus.cc:2468] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 12.
I20260709 12:25:00.813685 30280 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:00.917963 30298 consensus_queue.cc:1048] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:00.919088 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:00.912889 30090 consensus_queue.cc:1048] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 12:25:00.913079 30173 consensus_queue.cc:1048] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:25:00.922757 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:00.923281 25726 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:00.924229 30299 consensus_queue.cc:1048] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:00.925801 30299 raft_consensus.cc:2804] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:00.811898 30297 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:00.926213 30299 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:00.926687 30299 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:00.896548 25760 raft_consensus.cc:1275] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:00.933911 25726 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:00.900532 30290 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:00.939342 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:00.899384 30253 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.943812 30253 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:00.945452 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:00.946198 30253 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:00.946290 26435 raft_consensus.cc:3060] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:00.948236 26432 raft_consensus.cc:1275] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:25:00.949327 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:00.950565 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:00.951175 25834 raft_consensus.cc:3060] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:00.913532 30157 consensus_queue.cc:1048] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 12:25:00.892915 30291 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:00.993213 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:00.953109 25833 raft_consensus.cc:1240] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 13. Current term is 14. Ops: [9.4-13.6]
I20260709 12:25:00.958477 26402 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:00.955130 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:00.959704 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:25:00.982115 25726 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.245.132:35611 timed out after 1.584s (SENT) [suppressed 45 similar messages]
I20260709 12:25:00.931496 30111 raft_consensus.cc:2749] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:01.009430 26435 raft_consensus.cc:2468] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 8.
I20260709 12:25:01.006445 25834 raft_consensus.cc:2468] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 11.
I20260709 12:25:00.952371 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:01.012310 25829 raft_consensus.cc:2393] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 8: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:01.012746 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:00.996338 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:00.958913 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:00.973337 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:01.015947 25758 raft_consensus.cc:2468] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 11.
I20260709 12:25:00.991619 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:01.017279 25649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:01.018589 25762 raft_consensus.cc:2468] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 11.
W20260709 12:25:00.951839 30254 log.cc:927] Time spent T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.188s	user 0.001s	sys 0.002s
I20260709 12:25:01.020077 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:01.021085 25686 raft_consensus.cc:2468] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 10.
W20260709 12:25:01.021989 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:01.019711 25759 raft_consensus.cc:2468] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 10.
I20260709 12:25:00.930250 30018 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:01.019084 25830 raft_consensus.cc:2468] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 11.
I20260709 12:25:00.959287 30026 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.024097 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:00.959157 30266 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.954216 30094 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:00.961041 30213 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:00.961408 30090 raft_consensus.cc:2804] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:01.029422 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:01.029490 25650 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:00.954955 30007 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:01.041610 25650 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:01.045637 30094 raft_consensus.cc:2804] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:25:01.046180 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 87808.1us
I20260709 12:25:01.047513 26402 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:01.046175 30094 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:01.048583 30094 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:01.049991 30068 raft_consensus.cc:2804] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:01.050268 30295 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:01.050918 30295 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:01.050485 30068 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:00.953126 29990 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:01.033639 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:01.029835 26433 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 9.
I20260709 12:25:00.959178 30271 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:01.036458 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:01.041920 26438 raft_consensus.cc:2393] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 11: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:01.052385 30302 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.052945 25831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44218 (request call id 1726) took 1344 ms. Trace:
I20260709 12:25:01.053123 30280 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:01.053241 30295 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:01.031181 25801 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:01.055377 25830 raft_consensus.cc:1275] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:25:01.059130 30197 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.081552 30301 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.081833 30197 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:01.082129 30301 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:01.055615 30154 consensus_queue.cc:1048] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 12:25:01.084443 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:01.084985 30267 raft_consensus.cc:2749] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:01.085330 25755 raft_consensus.cc:2410] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:25:01.086272 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:01.079905 30295 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:01.087018 30295 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:01.056946 26402 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:01.088327 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:01.089272 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:01.089926 25828 raft_consensus.cc:2468] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 12.
I20260709 12:25:01.090564 29810 consensus_queue.cc:1048] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:01.091361 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:00.960402 30290 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:01.096148 30197 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:01.097143 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:01.097522 30295 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:01.097787 25685 raft_consensus.cc:2468] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 10.
I20260709 12:25:01.044773 25760 raft_consensus.cc:2468] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 10.
I20260709 12:25:01.031874 29755 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:01.058637 25759 raft_consensus.cc:2393] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 12: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:01.035470 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:01.061800 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:01.101910 25758 raft_consensus.cc:2468] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 10.
I20260709 12:25:01.061137 30068 raft_consensus.cc:3060] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:01.043123 30090 raft_consensus.cc:697] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:01.045110 30266 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:01.098030 30290 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:01.057958 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:25:01.081061 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 49976.7us
I20260709 12:25:01.080255 25650 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:01.064404 25831 rpcz_store.cc:276] 0709 12:24:59.708128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.713762 (+  5634us) service_pool.cc:224] Handling call
0709 12:24:59.740837 (+ 27075us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:59.757708 (+ 16871us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:24:59.757738 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:59.775109 (+ 17371us) log.cc:844] Serialized 26 byte log entry
0709 12:24:59.794562 (+ 19453us) spinlock_profiling.cc:243] Waited 2.93 ms on lock 0x7b48002301d8. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9ea8aaa1 00007f5d9ea81b37 00007f5d9ea819ca 00007f5d9eb7926f 00007f5d9eb78f37 00007f5d9eb8d55c 00007f5d9eb8d508 00007f5d9eb8d488 00007f5d9eb8d443 00007f5d9eb8c6ec 00007f5d9dab6a96
0709 12:25:00.135009 (+340447us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:25:00.135086 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:00.135178 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:00.951143 (+815965us) spinlock_profiling.cc:243] Waited 6.98 ms on lock 0x7b4400022b4c. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db 00007f5d99708aaf 00007f5d996fc86e 00007f5d996fbbb6 00007f5d996fb7d8 00007f5d99705221 00007f5d997051d9 00007f5d99705169
0709 12:25:01.052723 (+101580us) raft_consensus.cc:1685] finished
0709 12:25:01.052749 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:01.052889 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26649,"raft.queue_time_us":17847,"raft.run_cpu_time_us":1919,"raft.run_wall_time_us":34376,"spinlock_wait_cycles":22786688,"thread_start_us":277355,"threads_started":1,"wal-append.queue_time_us":879462}
I20260709 12:25:01.092552 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
W20260709 12:25:01.099423 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 144622us
I20260709 12:25:01.055455 30213 raft_consensus.cc:2749] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:01.059594 29967 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:01.035207 30026 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:01.124691 25682 raft_consensus.cc:2393] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 8: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:01.061990 25762 raft_consensus.cc:2393] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 10: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:01.098158 30295 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.128814 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:01.125578 25649 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:01.129887 25760 raft_consensus.cc:1275] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:25:01.165973 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:01.165390 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:01.169508 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:25:01.173046 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 44940.3us
I20260709 12:25:01.132210 25800 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:01.173318 25828 raft_consensus.cc:2393] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 10: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:01.170985 26433 raft_consensus.cc:2468] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 11.
W20260709 12:25:01.173744 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 48287.5us
W20260709 12:25:01.173635 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 94146.3us
I20260709 12:25:01.172295 25685 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 10.
I20260709 12:25:01.175496 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:01.176136 26436 raft_consensus.cc:2468] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 10.
W20260709 12:25:01.175953 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 43832.1us
I20260709 12:25:01.177348 25649 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:25:01.178542 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 88686.9us
I20260709 12:25:01.180615 25800 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
W20260709 12:25:01.181368 25649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:01.178063 30297 raft_consensus.cc:2804] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:01.128645 30005 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.176172 30295 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:01.183974 30005 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:01.184327 30090 consensus_queue.cc:237] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 5, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:01.185070 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:01.185669 30295 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:01.186025 30005 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:01.186094 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:01.187090 25685 raft_consensus.cc:2410] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:25:01.188668 26437 raft_consensus.cc:1240] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:01.188746 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:01.189741 25682 raft_consensus.cc:2468] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 13.
I20260709 12:25:01.190498 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:01.187671 30213 raft_consensus.cc:2804] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:01.191076 25831 raft_consensus.cc:2468] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 13.
I20260709 12:25:01.207938 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:01.208904 25830 raft_consensus.cc:2468] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 9.
I20260709 12:25:01.182181 30265 raft_consensus.cc:2804] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:01.176568 30301 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:01.188868 30291 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:01.098853 30271 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:01.122133 29755 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:01.250619 25726 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
W20260709 12:25:01.240238 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 43709.6us
I20260709 12:25:01.189888 30197 raft_consensus.cc:2804] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:25:01.242215 30312 log.cc:927] Time spent T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 12:25:01.245375 30023 consensus_queue.cc:1048] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:01.248595 30026 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:01.194129 30297 raft_consensus.cc:697] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 8 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:01.252771 25831 raft_consensus.cc:1275] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:25:01.108351 30280 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:01.214339 30213 raft_consensus.cc:697] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 11 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:01.258031 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:01.266592 25830 raft_consensus.cc:2468] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 10.
I20260709 12:25:01.249341 30018 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:01.255410 25726 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:01.122254 30302 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:01.265045 30265 raft_consensus.cc:697] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 11 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:01.258738 29990 raft_consensus.cc:2804] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:01.262615 30197 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:01.380631 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:01.253774 30094 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:01.456295 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 259833us
W20260709 12:25:01.537122 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:01.241277 30090 consensus_queue.cc:1048] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.134s
I20260709 12:25:01.268311 29922 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:01.268579 26434 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 12.
I20260709 12:25:01.276988 30065 raft_consensus.cc:2804] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:01.304773 30291 raft_consensus.cc:2804] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:01.611547 30291 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:01.544201 30271 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:01.546507 30280 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:01.554708 25650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:01.591764 30197 raft_consensus.cc:3060] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:01.557940 26439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 1107) took 1815 ms. Trace:
I20260709 12:25:01.632515 26439 rpcz_store.cc:276] 0709 12:24:59.726181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.726426 (+   245us) service_pool.cc:224] Handling call
0709 12:25:00.424812 (+698386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:00.425473 (+   661us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.457757 (+1032284us) spinlock_profiling.cc:243] Waited 685 ms on lock 0x7b540078f850. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b608ad 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:01.541783 (+ 84026us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1574376192}
I20260709 12:25:01.276005 30296 raft_consensus.cc:2804] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:25:01.566807 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 309545us
I20260709 12:25:01.555402 25726 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
W20260709 12:25:01.556984 30315 log.cc:927] Time spent T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.300s	user 0.007s	sys 0.002s
W20260709 12:25:01.607628 25649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:01.458714 30213 consensus_queue.cc:237] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:01.562191 30252 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:01.558945 30299 consensus_meta.cc:287] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.632s	user 0.009s	sys 0.009s
I20260709 12:25:01.617267 30291 raft_consensus.cc:3060] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:01.590476 29990 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:01.635706 26402 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:01.556380 30290 consensus_queue.cc:1048] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
W20260709 12:25:01.663360 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 108028us
I20260709 12:25:01.604275 25831 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:01.624325 29921 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.619526 30068 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:01.716451 30311 log.cc:927] Time spent T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.463s	user 0.001s	sys 0.009s
I20260709 12:25:01.716871 30271 raft_consensus.cc:2749] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:01.716905 30157 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:01.717856 26432 raft_consensus.cc:2393] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 11: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:01.717758 30157 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:01.718245 30068 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:01.697368 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:01.700404 30297 consensus_queue.cc:237] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:01.719028 30290 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:01.719116 25677 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 13.
I20260709 12:25:01.590785 29907 consensus_queue.cc:1048] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.071s
I20260709 12:25:01.624862 30262 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:01.615989 29922 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:01.715253 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 79660.3us
I20260709 12:25:01.662197 30296 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:01.694859 30170 raft_consensus.cc:2804] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:01.713801 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:01.880231 26439 raft_consensus.cc:2468] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 12.
W20260709 12:25:01.718309 30319 log.cc:927] Time spent T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:25:01.694540 30274 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:01.711498 29967 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:01.711023 29990 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:01.719605 30290 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:01.877183 29755 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:01.780107 29921 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:01.880532 30315 log.cc:927] Time spent T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.179s	user 0.001s	sys 0.003s
I20260709 12:25:01.877525 30157 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:01.923676 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:01.711867 30299 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:01.879817 30170 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:01.911293 30303 log.cc:927] Time spent T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.429s	user 0.000s	sys 0.010s
I20260709 12:25:01.879488 30296 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:01.891793 30278 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:01.918104 29907 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:01.924666 30301 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:01.944736 30319 log.cc:927] Time spent T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:25:01.953719 25757 raft_consensus.cc:2368] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for earlier term 12. Current term is 13.
I20260709 12:25:01.955895 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:01.960641 30299 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:01.961061 29921 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:01.961387 30278 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:01.962371 29922 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:01.963483 30278 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:01.964102 30290 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:01.967402 29907 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:01.968477 25679 raft_consensus.cc:2410] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for term 14 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 12:25:01.944382 30170 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:01.883888 30274 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:01.882213 30265 consensus_queue.cc:237] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:02.002066 30266 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:02.004645 30065 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:02.005442 30065 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:02.005723 29907 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:02.007781 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:02.008459 26433 raft_consensus.cc:3060] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:02.009835 30261 log.cc:927] Time spent T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 1.405s	user 0.000s	sys 0.002s
I20260709 12:25:02.011855 30252 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:02.014396 30252 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:02.007627 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:02.016400 26431 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 18.
I20260709 12:25:02.017385 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:02.017961 26431 raft_consensus.cc:2468] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 13.
I20260709 12:25:02.018450 26431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36508 (request call id 1108) took 1063 ms. Trace:
I20260709 12:25:02.018774 26431 rpcz_store.cc:276] 0709 12:25:00.955379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.017135 (+1061756us) service_pool.cc:224] Handling call
0709 12:25:02.018400 (+  1265us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:02.020632 30252 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:02.019814 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:02.022842 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:02.023955 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:02.024569 29990 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:01.982788 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:01.982553 25801 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:02.025748 26439 raft_consensus.cc:2468] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 6.
W20260709 12:25:02.026362 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 43959.9us
I20260709 12:25:02.026566 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:02.024973 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:02.027097 26439 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:02.027580 30305 raft_consensus.cc:2804] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:02.028158 30305 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:02.028676 30305 raft_consensus.cc:3060] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:01.967531 30197 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:02.033205 29921 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:02.033887 29921 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:02.035223 29810 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:02.035310 29967 consensus_queue.cc:1048] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:02.036094 29921 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:02.035899 29810 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:02.036859 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:01.969831 30301 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:02.090772 26431 raft_consensus.cc:2468] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 12.
I20260709 12:25:02.053452 25757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53474 (request call id 2990) took 1079 ms. Trace:
I20260709 12:25:02.093900 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:02.080386 25831 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 17.
I20260709 12:25:02.167960 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:02.168620 25831 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 18.
I20260709 12:25:02.169688 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:02.087774 26439 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 17.
I20260709 12:25:02.172616 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:02.173179 26439 raft_consensus.cc:2376] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 17. Re-sending same reply.
I20260709 12:25:02.174067 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:02.175159 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:02.180656 30197 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:02.027112 25801 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
W20260709 12:25:02.182382 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 155349us
I20260709 12:25:02.183936 25801 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:02.038102 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:02.091416 25684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2392) took 1684 ms. Trace:
I20260709 12:25:01.983448 30280 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.037580 25762 raft_consensus.cc:2468] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 10.
I20260709 12:25:02.188916 25759 raft_consensus.cc:2393] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 13: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:02.092720 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:02.189702 25758 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 9.
I20260709 12:25:02.093534 25757 rpcz_store.cc:276] 0709 12:25:00.974091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.088037 (+113946us) service_pool.cc:224] Handling call
0709 12:25:02.053176 (+965139us) spinlock_profiling.cc:243] Waited 864 ms on lock 0x7b54001e7154. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:02.053359 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1988062464}
I20260709 12:25:02.039572 26437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 1124) took 1093 ms. Trace:
I20260709 12:25:02.054414 30198 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:02.220674 30198 raft_consensus.cc:3060] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:02.224054 30335 raft_consensus.cc:2749] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:02.224943 30335 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:02.225451 30335 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:02.037616 29990 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:02.038519 29810 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:02.113958 30301 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:02.098886 30302 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:02.129446 25679 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40230 (request call id 1656) took 1725 ms (client timeout 1737 ms). Trace:
W20260709 12:25:02.132068 30268 log.cc:927] Time spent T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 1.513s	user 0.000s	sys 0.007s
I20260709 12:25:02.133402 25832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44218 (request call id 1733) took 1069 ms. Trace:
W20260709 12:25:02.135424 25649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:02.136830 29842 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:02.138353 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:02.235775 25760 raft_consensus.cc:2468] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 9.
I20260709 12:25:02.140453 30289 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.140868 30154 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:02.142161 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:02.142899 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:02.185274 25684 rpcz_store.cc:276] 0709 12:25:00.406874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.411745 (+  4871us) service_pool.cc:224] Handling call
0709 12:25:00.494005 (+ 82260us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:00.579044 (+ 85039us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:00.579082 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:00.594052 (+ 14970us) log.cc:844] Serialized 26 byte log entry
0709 12:25:00.914405 (+320353us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:00.914448 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:00.914513 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:02.091101 (+1176588us) raft_consensus.cc:1685] finished
0709 12:25:02.091128 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:02.091301 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18418,"raft.queue_time_us":92376,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":15411,"thread_start_us":347915,"threads_started":2,"wal-append.queue_time_us":430180}
I20260709 12:25:02.144325 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:02.145030 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:02.145998 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:02.153903 30294 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:02.154263 30059 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.119428 30305 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:02.153339 30291 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:02.155411 30094 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:02.156744 29907 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:02.274201 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:02.158308 30274 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:02.043823 30267 consensus_queue.cc:1048] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.115s
I20260709 12:25:02.274968 25836 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 12.
I20260709 12:25:02.160478 26433 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 10.
W20260709 12:25:02.164006 25800 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.014s	sys 0.064s
I20260709 12:25:02.043985 26402 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:25:02.276757 25800 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.015s	sys 0.064s
I20260709 12:25:02.197624 30296 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:02.200508 30330 log.cc:927] Time spent T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.088s	user 0.001s	sys 0.002s
I20260709 12:25:02.201857 30065 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:02.207212 25831 raft_consensus.cc:2468] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 12.
I20260709 12:25:02.208032 30197 raft_consensus.cc:2749] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:02.218235 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:02.190650 26437 rpcz_store.cc:276] 0709 12:25:00.946057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.946175 (+   118us) service_pool.cc:224] Handling call
0709 12:25:00.946435 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:01.189152 (+242717us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:02.039333 (+850181us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b5400711454. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:02.039498 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":541223808}
I20260709 12:25:02.229213 26434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 1126) took 1194 ms. Trace:
I20260709 12:25:02.162596 30157 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
W20260709 12:25:02.232784 25649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:02.250133 25837 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 13.
W20260709 12:25:02.305253 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 261359us
I20260709 12:25:02.250669 25835 raft_consensus.cc:2468] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 11.
W20260709 12:25:02.231805 25679 rpcz_store.cc:269] 0709 12:25:00.404361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.404503 (+   142us) service_pool.cc:224] Handling call
0709 12:25:02.129202 (+1724699us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b5400232654. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:02.129351 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3549404544}
I20260709 12:25:02.257366 25829 raft_consensus.cc:2468] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 7.
I20260709 12:25:02.300575 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:02.274044 29907 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:02.191906 25801 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:02.175763 26439 raft_consensus.cc:2468] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 10.
I20260709 12:25:00.739966 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:02.227818 30335 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:02.302320 26434 rpcz_store.cc:276] 0709 12:25:01.034760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.184812 (+150052us) service_pool.cc:224] Handling call
0709 12:25:02.228997 (+1044185us) spinlock_profiling.cc:243] Waited 82.9 ms on lock 0x7b5400333954. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:02.229124 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":190601984}
I20260709 12:25:02.303412 26431 raft_consensus.cc:2393] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 12: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
W20260709 12:25:02.316382 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 124573us
I20260709 12:25:02.317934 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:02.319535 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:02.315706 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:02.320348 25759 raft_consensus.cc:3060] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:02.320672 25680 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:02.322474 25756 raft_consensus.cc:1275] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:25:02.322870 25756 pending_rounds.cc:85] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 8
I20260709 12:25:02.323135 25756 pending_rounds.cc:107] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:25:02.323478 25756 raft_consensus.cc:2889] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:02.323802 25801 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:02.324767 25754 raft_consensus.cc:1240] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:02.238354 30275 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.299809 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:02.312146 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:02.232111 25832 rpcz_store.cc:276] 0709 12:25:01.065265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.065402 (+   137us) service_pool.cc:224] Handling call
0709 12:25:01.079945 (+ 14543us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:01.093011 (+ 13066us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:25:01.175079 (+ 82068us) log.cc:844] Serialized 14 byte log entry
0709 12:25:01.539829 (+364750us) log.cc:844] Serialized 14 byte log entry
0709 12:25:01.924607 (+384778us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:01.924661 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:01.924705 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:02.133180 (+208475us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b54004204d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:02.133227 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:02.133349 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":765085,"prepare.queue_time_us":424817,"prepare.run_cpu_time_us":158,"prepare.run_wall_time_us":7435,"raft.queue_time_us":354757,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":5790,"spinlock_wait_cycles":29507968,"thread_start_us":466518,"threads_started":3,"wal-append.queue_time_us":391567}
I20260709 12:25:02.328500 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:02.329654 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:02.356763 25684 raft_consensus.cc:2468] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 10.
I20260709 12:25:02.330981 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:02.358212 25677 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:02.332558 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:02.334767 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:02.336287 25801 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:02.336799 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:02.337284 30065 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:02.239748 29842 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:02.309746 30094 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.251210 30154 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:02.311826 30267 raft_consensus.cc:2764] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader election decision vote started in defunct term 16: won
I20260709 12:25:02.339516 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:02.381209 26439 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 12.
I20260709 12:25:02.382351 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:02.383071 26439 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 10.
I20260709 12:25:02.340948 30301 raft_consensus.cc:2749] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:02.384925 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:02.384905 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:02.342787 29907 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:02.344949 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:02.386781 26434 raft_consensus.cc:2468] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 13.
I20260709 12:25:02.345089 30305 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:02.345650 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:02.346566 30291 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:02.347967 30296 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:02.348449 30288 raft_consensus.cc:2804] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:02.352375 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:02.359732 25756 raft_consensus.cc:2468] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 10.
W20260709 12:25:02.318842 30268 log.cc:927] Time spent T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:25:02.397181 26431 raft_consensus.cc:1275] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:25:02.398664 26431 raft_consensus.cc:1240] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:25:02.235627 30280 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:02.367717 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:02.368338 26437 raft_consensus.cc:2368] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 13. Current term is 14.
I20260709 12:25:02.362646 30282 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.279986 30059 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:02.304764 30274 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:02.369647 25800 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:02.366999 30275 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:02.390314 26433 raft_consensus.cc:1275] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:02.427896 26434 raft_consensus.cc:1275] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:25:02.395484 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:02.365845 25650 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:25:02.429454 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 63692.4us
I20260709 12:25:02.315750 30157 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:02.401000 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 64826.4us
I20260709 12:25:02.440564 25801 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:02.384902 30336 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:02.248936 30289 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:02.390998 30288 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:02.431241 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 61699.1us
I20260709 12:25:02.401496 30329 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:02.402221 25833 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.025s	sys 0.029s
W20260709 12:25:02.455621 25833 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.026s	sys 0.030s
I20260709 12:25:02.441792 25834 raft_consensus.cc:2468] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 11.
I20260709 12:25:02.434306 25650 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:02.456473 25800 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:02.443600 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:02.426789 30291 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:02.419862 30278 raft_consensus.cc:2804] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:02.380393 30094 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:02.433068 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:02.430054 29842 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:02.445744 25801 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:02.437369 30213 raft_consensus.cc:2804] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:02.439659 30305 raft_consensus.cc:2804] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:02.432667 30252 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:02.461264 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:02.280526 30294 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:02.478904 25800 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:02.488708 26430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 1118) took 1789 ms. Trace:
I20260709 12:25:02.428745 26439 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 18.
I20260709 12:25:02.454483 30288 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:02.455281 30302 raft_consensus.cc:2804] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:02.498138 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:02.463861 29905 raft_consensus.cc:2804] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:02.462240 30278 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:02.441493 30274 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:02.491575 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 45953.5us
I20260709 12:25:02.509124 25801 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:02.510203 25835 raft_consensus.cc:1240] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:02.464087 30305 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:02.521907 26439 raft_consensus.cc:1275] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:25:02.463006 29802 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:02.523327 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:02.537498 25832 raft_consensus.cc:1240] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:02.489285 26430 rpcz_store.cc:276] 0709 12:25:00.698987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.699160 (+   173us) service_pool.cc:224] Handling call
0709 12:25:00.699495 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:00.703809 (+  4314us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:25:01.020371 (+316562us) log.cc:844] Serialized 14 byte log entry
0709 12:25:02.137343 (+1116972us) spinlock_profiling.cc:243] Waited 1.66 ms on lock 0x7b180031fcc0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d96a56e07 00007f5d9f8b19a9 00007f5d96a7369b 00007f5d96a7193f 00007f5d96a73c02 00007f5d996fb20b 00007f5d99700d23 00007f5d9970123a 00007f5d99b6ba2a
0709 12:25:02.488198 (+350855us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:02.488255 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:02.488301 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:02.488500 (+   199us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:02.488638 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15980,"prepare.queue_time_us":318318,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":3226,"raft.queue_time_us":17742,"spinlock_wait_cycles":3807104,"thread_start_us":633290,"threads_started":2}
W20260709 12:25:02.498322 30170 consensus_meta.cc:287] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.520s	user 0.010s	sys 0.000s
I20260709 12:25:02.465296 29755 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:02.490013 30249 raft_consensus.cc:2749] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:02.462778 30296 consensus_queue.cc:1048] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.062s
I20260709 12:25:02.432435 30282 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:02.461863 30329 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:02.463833 30336 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:02.541818 30154 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:02.542050 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:02.521188 30278 raft_consensus.cc:3060] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:02.543011 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:02.490386 30213 raft_consensus.cc:697] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 11 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:02.545801 25829 raft_consensus.cc:1275] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:25:02.526342 25801 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
W20260709 12:25:02.649071 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 122820us
I20260709 12:25:02.504972 29922 raft_consensus.cc:2804] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:02.498471 30302 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:02.496873 30335 raft_consensus.cc:2804] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:25:02.549582 26436 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36508 (request call id 1105) took 1589 ms (client timeout 2040 ms). Trace:
I20260709 12:25:02.542097 29802 raft_consensus.cc:2804] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:02.507303 29905 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:02.488411 30301 consensus_queue.cc:1048] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:25:02.554210 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:02.463845 30291 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:02.592732 30337 log.cc:927] Time spent T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 12:25:02.611541 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:02.579645 30094 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:02.550283 30333 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.540702 30276 raft_consensus.cc:3060] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:02.549829 30170 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:02.541009 30305 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:02.588929 30329 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:02.572927 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:25:02.633167 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 304638us
I20260709 12:25:02.506659 30252 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:02.549698 29755 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:02.579764 30336 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:02.633605 25835 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 10.
I20260709 12:25:02.653435 25801 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
W20260709 12:25:02.658811 26436 rpcz_store.cc:269] 0709 12:25:00.954474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.958646 (+  4172us) service_pool.cc:224] Handling call
0709 12:25:02.544163 (+1585517us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b5400373f54. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:02.544293 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":372266880}
I20260709 12:25:02.621510 30286 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:02.668293 25836 raft_consensus.cc:2410] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:25:02.663261 30275 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:02.660475 30302 raft_consensus.cc:3060] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:02.692178 30289 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:02.654832 30154 raft_consensus.cc:2749] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:02.693622 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:02.696341 25677 raft_consensus.cc:2468] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 14.
I20260709 12:25:02.657135 30280 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:02.658591 30335 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:02.668170 29905 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:02.661773 29802 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:02.859292 25832 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 18.
I20260709 12:25:02.858558 25649 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:02.861819 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:02.859854 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:25:02.689509 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 253507us
W20260709 12:25:02.877507 29990 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.036s	sys 0.141s
I20260709 12:25:02.654951 29922 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:02.964931 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:25:02.890110 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 236757us
W20260709 12:25:02.891000 25759 consensus_meta.cc:287] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.567s	user 0.003s	sys 0.008s
I20260709 12:25:02.967752 25759 raft_consensus.cc:2468] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 11.
I20260709 12:25:02.894667 26430 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 12.
I20260709 12:25:02.957049 25650 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:02.968060 25801 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:25:02.893203 30344 log.cc:927] Time spent T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.223s	user 0.000s	sys 0.000s
W20260709 12:25:02.957163 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 105368us
I20260709 12:25:02.974746 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:02.976812 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:02.784729 30333 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:02.981626 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 123157us
I20260709 12:25:02.977064 29922 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:02.984136 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:25:02.987061 30338 log.cc:927] Time spent T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.385s	user 0.000s	sys 0.000s
W20260709 12:25:02.988520 30339 log.cc:927] Time spent T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.373s	user 0.000s	sys 0.001s
I20260709 12:25:02.989532 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:25:02.990108 30343 log.cc:927] Time spent T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:25:02.982740 25649 leader_election.cc:400] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 election: Vote denied by peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267) with higher term. Message: Invalid argument: T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for earlier term 12. Current term is 13.
I20260709 12:25:02.990917 25649 leader_election.cc:403] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
W20260709 12:25:02.991240 30350 log.cc:927] Time spent T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.404s	user 0.001s	sys 0.000s
I20260709 12:25:02.991621 25678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40230 (request call id 1655) took 2587 ms. Trace:
I20260709 12:25:02.992022 25678 rpcz_store.cc:276] 0709 12:25:00.403901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.404140 (+   239us) service_pool.cc:224] Handling call
0709 12:25:00.404494 (+   354us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:00.499487 (+ 94993us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:00.499526 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:00.531234 (+ 31708us) log.cc:844] Serialized 52 byte log entry
0709 12:25:02.130390 (+1599156us) spinlock_profiling.cc:243] Waited 4.1 ms on lock 0x7b18003e3020. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d96a56e07 00007f5d9f8b19a9 00007f5d96a7369b 00007f5d96a7193f 00007f5d96a73c02 00007f5d996fb20b 00007f5d99700d23 00007f5d997010d1 00007f5d99b1ca0f
0709 12:25:02.464825 (+334435us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:25:02.464869 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:02.464938 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:02.991313 (+526375us) raft_consensus.cc:1685] finished
0709 12:25:02.991332 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:02.991543 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48113,"raft.queue_time_us":141721,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":26674,"spinlock_wait_cycles":9426304,"thread_start_us":334257,"threads_started":1,"wal-append.queue_time_us":2088856}
I20260709 12:25:02.998662 29922 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:03.004328 25831 raft_consensus.cc:1275] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:25:03.005153 30291 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:03.003422 29922 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:03.008519 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:03.016667 26436 raft_consensus.cc:2468] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 13.
W20260709 12:25:03.018777 30327 log.cc:927] Time spent T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.902s	user 0.003s	sys 0.000s
W20260709 12:25:02.965588 29990 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.037s	sys 0.142s
I20260709 12:25:03.021136 30357 raft_consensus.cc:2804] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:25:03.021369 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 64418.6us
I20260709 12:25:03.021672 30357 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:03.021994 30111 raft_consensus.cc:2804] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:03.022145 30357 raft_consensus.cc:3060] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:03.022450 30111 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:03.023001 30111 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:03.023479 25649 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:03.022390 25650 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:02.954973 30335 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:02.952317 30274 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:02.950030 30356 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
W20260709 12:25:03.011897 25680 consensus_meta.cc:287] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.688s	user 0.006s	sys 0.001s
I20260709 12:25:02.961398 29802 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:02.685177 30213 consensus_queue.cc:237] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:02.952656 30336 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:03.040697 25828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44218 (request call id 1737) took 1939 ms. Trace:
I20260709 12:25:03.044102 25680 raft_consensus.cc:2468] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 13.
W20260709 12:25:03.051419 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 152240us
I20260709 12:25:02.981835 30280 raft_consensus.cc:2804] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:03.072031 25686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2406) took 1388 ms. Trace:
W20260709 12:25:03.036517 30340 log.cc:927] Time spent T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.454s	user 0.000s	sys 0.001s
I20260709 12:25:02.945736 30286 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:03.008751 30157 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:03.077206 25686 rpcz_store.cc:276] 0709 12:25:01.683223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.683365 (+   142us) service_pool.cc:224] Handling call
0709 12:25:01.683841 (+   476us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:01.712855 (+ 29014us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:01.712903 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:01.722961 (+ 10058us) log.cc:844] Serialized 52 byte log entry
0709 12:25:02.164259 (+441298us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:25:02.164317 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:02.164405 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:03.071797 (+907392us) raft_consensus.cc:1685] finished
0709 12:25:03.071817 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:03.071976 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4292,"raft.queue_time_us":7242,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":107,"thread_start_us":273882,"threads_started":1,"wal-append.queue_time_us":521621}
I20260709 12:25:03.071660 25726 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
W20260709 12:25:03.083382 26433 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.036s	sys 0.049s
W20260709 12:25:03.091472 26433 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.036s	sys 0.049s
W20260709 12:25:03.071137 30341 log.cc:927] Time spent T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.403s	user 0.000s	sys 0.001s
I20260709 12:25:03.036827 29922 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:03.033469 30291 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:03.009613 30154 consensus_queue.cc:1048] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 12:25:03.067377 25828 rpcz_store.cc:276] 0709 12:25:01.101513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.192227 (+ 90714us) service_pool.cc:224] Handling call
0709 12:25:01.192661 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:01.255342 (+ 62681us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:25:01.270899 (+ 15557us) log.cc:844] Serialized 14 byte log entry
0709 12:25:01.954917 (+684018us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:01.979587 (+ 24670us) log.cc:844] Serialized 26 byte log entry
0709 12:25:01.980032 (+   445us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:01.980161 (+   129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.980366 (+   205us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:03.018207 (+1037841us) spinlock_profiling.cc:243] Waited 42.8 ms on lock 0x7b4400022b4c. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db 00007f5d99708aaf 00007f5d996fc86e 00007f5d996fbbb6 00007f5d996fb7d8 00007f5d99705221 00007f5d997051d9 00007f5d99705169
0709 12:25:03.038943 (+ 20736us) raft_consensus.cc:1685] finished
0709 12:25:03.040440 (+  1497us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:03.040629 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":376130,"prepare.queue_time_us":16057,"prepare.run_cpu_time_us":19604,"prepare.run_wall_time_us":262529,"raft.queue_time_us":80556,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":188,"spinlock_wait_cycles":98422528,"thread_start_us":358360,"threads_started":1,"wal-append.queue_time_us":802165}
I20260709 12:25:03.070806 30274 raft_consensus.cc:2804] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:03.076939 30280 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:03.070498 30094 raft_consensus.cc:2749] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267) with higher term. Message: Invalid argument: T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for earlier term 12. Current term is 13.
W20260709 12:25:03.138936 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 115522us
W20260709 12:25:03.139285 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 67813.8us
I20260709 12:25:03.132663 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:03.140789 25828 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:03.142269 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:03.095082 30282 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:03.088495 30066 raft_consensus.cc:2749] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:03.093271 30372 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
W20260709 12:25:03.137187 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 114640us
I20260709 12:25:03.140192 25726 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:03.158023 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:03.111860 30294 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:03.156800 25650 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:03.167632 25650 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:03.140337 30280 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:03.133287 30274 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:03.159122 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:03.183760 25761 raft_consensus.cc:2468] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 11.
I20260709 12:25:03.164809 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:03.147517 30252 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:03.178857 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:03.224534 25756 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 6.
I20260709 12:25:03.180562 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:03.180429 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:03.094293 30336 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:03.186482 30348 log.cc:927] Time spent T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 12:25:03.197333 25754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 2998) took 1059 ms. Trace:
I20260709 12:25:03.208778 25833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44218 (request call id 1731) took 2154 ms. Trace:
I20260709 12:25:03.209015 30346 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:03.209334 30364 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:03.249485 30364 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:03.209568 29810 consensus_queue.cc:1048] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:03.252393 25758 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:03.209816 30157 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:03.256327 30157 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:03.163425 30282 raft_consensus.cc:2804] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:03.257826 30282 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:03.258370 30282 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:03.258720 30157 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:03.126302 29922 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:03.215598 26432 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 1127) took 2177 ms (client timeout 1602 ms). Trace:
W20260709 12:25:03.260862 26432 rpcz_store.cc:269] 0709 12:25:01.038513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.053997 (+ 15484us) service_pool.cc:224] Handling call
0709 12:25:03.215334 (+2161337us) spinlock_profiling.cc:243] Waited 616 ms on lock 0x7b54006f4854. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:03.215486 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1415781248}
I20260709 12:25:03.261513 29922 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:03.216784 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:03.216701 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:03.145162 30367 raft_consensus.cc:2749] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:03.262750 26433 raft_consensus.cc:2376] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 12. Re-sending same reply.
I20260709 12:25:03.162566 25726 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:03.263990 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:03.228046 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:03.242372 30170 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:03.219750 30274 raft_consensus.cc:3060] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:03.087339 30356 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:03.225921 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:03.267576 30367 raft_consensus.cc:2749] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:03.266837 25678 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 10.
I20260709 12:25:03.271200 25756 raft_consensus.cc:2393] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 11: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:03.235611 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:03.177428 29990 raft_consensus.cc:2804] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:03.272646 29990 raft_consensus.cc:697] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:03.273010 30333 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:03.273617 29990 consensus_queue.cc:237] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:03.238221 25754 rpcz_store.cc:276] 0709 12:25:02.137613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.143467 (+  5854us) service_pool.cc:224] Handling call
0709 12:25:02.143780 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:02.346053 (+202273us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:03.196958 (+850905us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b54000032d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:03.197255 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":415776640}
I20260709 12:25:03.244657 25828 raft_consensus.cc:2468] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 14.
W20260709 12:25:03.235292 30250 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.680s	user 0.026s	sys 0.067s
I20260709 12:25:03.181447 30294 raft_consensus.cc:2804] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:03.248220 30346 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:03.257897 25763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 2592) took 3247 ms. Trace:
W20260709 12:25:03.264091 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 101645us
I20260709 12:25:03.298825 25726 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:03.247038 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:03.236209 25833 rpcz_store.cc:276] 0709 12:25:01.054407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.054555 (+   148us) service_pool.cc:224] Handling call
0709 12:25:01.054893 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:01.538500 (+483607us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:25:01.890454 (+351954us) log.cc:844] Serialized 14 byte log entry
0709 12:25:02.456015 (+565561us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:02.456074 (+    59us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:02.456113 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:03.208498 (+752385us) spinlock_profiling.cc:243] Waited 249 ms on lock 0x7b5400246654. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:03.208543 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:03.208682 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3750,"prepare.queue_time_us":78649,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":41,"raft.queue_time_us":5114,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":25736,"spinlock_wait_cycles":573231488,"thread_start_us":880460,"threads_started":2,"wal-append.queue_time_us":640928}
I20260709 12:25:03.247537 30336 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:03.297329 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:03.302285 25726 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:25:03.229816 30299 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:03.247133 30361 log.cc:927] Time spent T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 12:25:03.295142 30250 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.744s	user 0.026s	sys 0.068s
I20260709 12:25:03.298179 25763 rpcz_store.cc:276] 0709 12:25:00.010573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.010741 (+   168us) service_pool.cc:224] Handling call
0709 12:25:00.011180 (+   439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:00.052962 (+ 41782us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:00.052993 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:02.137665 (+2084672us) spinlock_profiling.cc:243] Waited 995 us on lock 0x7b2c0005c228. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9845aa11 00007f5d9846a372 00007f5d99b9ca01 00007f5d99b6143a 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2
0709 12:25:02.138065 (+   400us) log.cc:844] Serialized 26 byte log entry
0709 12:25:02.617513 (+479448us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:02.617565 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:02.617675 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:03.257565 (+639890us) raft_consensus.cc:1685] finished
0709 12:25:03.257591 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:03.257812 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21919,"raft.queue_time_us":35072,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":6728,"spinlock_wait_cycles":2301568,"thread_start_us":479027,"threads_started":1,"wal-append.queue_time_us":1117877}
W20260709 12:25:03.308483 26438 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 1122) took 2365 ms (client timeout 2176 ms). Trace:
I20260709 12:25:03.312273 26402 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:03.313872 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:03.316115 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:03.316751 25759 raft_consensus.cc:2468] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 12.
W20260709 12:25:03.310968 26438 rpcz_store.cc:269] 0709 12:25:00.942883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.943034 (+   151us) service_pool.cc:224] Handling call
0709 12:25:03.308272 (+2365238us) spinlock_profiling.cc:243] Waited 91.7 ms on lock 0x7b5400227254. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:03.308415 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":210928512}
I20260709 12:25:03.227335 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:03.307502 25726 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:03.325150 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:03.141516 30291 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:03.327210 25760 raft_consensus.cc:2393] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 11: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:03.297739 30294 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:03.327786 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:03.334062 25680 raft_consensus.cc:2393] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 15: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:03.335275 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:03.335899 25683 raft_consensus.cc:2468] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 12.
I20260709 12:25:03.316038 30367 raft_consensus.cc:2804] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:03.338028 30367 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:03.338379 30367 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:03.338649 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:03.339429 25837 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:03.339555 30170 consensus_queue.cc:1048] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:03.341320 30276 raft_consensus.cc:2749] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:03.342878 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:03.344022 30157 consensus_queue.cc:1059] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:03.345098 30157 raft_consensus.cc:3055] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:03.344902 30305 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:03.345467 30157 raft_consensus.cc:740] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:03.346063 25832 raft_consensus.cc:2393] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 11: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
W20260709 12:25:03.346563 30288 consensus_meta.cc:287] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.826s	user 0.009s	sys 0.000s
I20260709 12:25:03.346899 25837 raft_consensus.cc:2468] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 13.
I20260709 12:25:03.339783 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:03.344038 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:03.346330 30157 consensus_queue.cc:260] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:03.171608 30372 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:03.346531 30170 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:03.366156 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 198893us
W20260709 12:25:03.153015 30058 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.012s	sys 0.030s
I20260709 12:25:03.368011 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:03.369638 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:03.308087 30299 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:03.372223 25685 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 10.
I20260709 12:25:03.397307 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:03.401538 25683 raft_consensus.cc:3060] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:03.396865 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:25:03.372354 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 165925us
I20260709 12:25:03.375377 25758 raft_consensus.cc:1275] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:03.403155 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:03.385157 25684 raft_consensus.cc:1275] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 12:25:03.405087 25684 pending_rounds.cc:85] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc: Aborting all ops after (but not including) 8
I20260709 12:25:03.405433 25684 pending_rounds.cc:107] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:25:03.405675 25684 raft_consensus.cc:2889] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:03.410738 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:03.411481 25685 raft_consensus.cc:2468] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 12.
I20260709 12:25:03.412581 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:03.347179 30288 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:03.372002 30058 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.830s	user 0.013s	sys 0.030s
I20260709 12:25:03.352181 30111 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:03.415762 30384 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:03.416432 25758 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 6.
I20260709 12:25:03.339697 29905 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:03.397496 30364 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:03.423496 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:03.352260 30294 raft_consensus.cc:3060] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:03.407478 30157 raft_consensus.cc:3060] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:03.428766 25679 raft_consensus.cc:1275] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:03.431533 25684 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:03.417214 30198 consensus_meta.cc:287] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 1.196s	user 0.012s	sys 0.001s
I20260709 12:25:03.412312 30336 raft_consensus.cc:2749] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:03.437435 25830 raft_consensus.cc:2368] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 13. Current term is 14.
I20260709 12:25:03.432276 30215 consensus_queue.cc:1059] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 12:25:03.441540 25829 raft_consensus.cc:1240] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:25:03.426689 30023 raft_consensus.cc:2749] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:03.447839 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:03.407258 30359 consensus_queue.cc:1048] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.078s
I20260709 12:25:03.428663 29755 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:03.460350 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:03.376745 30170 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:03.469066 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:03.466797 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 63984.1us
W20260709 12:25:03.471519 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 149146us
I20260709 12:25:03.471961 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:03.472348 26402 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:03.473467 25757 raft_consensus.cc:1240] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
W20260709 12:25:03.477573 30290 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.325s	user 0.002s	sys 0.010s
W20260709 12:25:03.478011 30290 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.326s	user 0.002s	sys 0.010s
I20260709 12:25:03.484172 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:03.485402 25679 raft_consensus.cc:2410] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:25:03.437744 30058 consensus_queue.cc:1048] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 12:25:03.492333 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:03.493891 25679 raft_consensus.cc:2410] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 12 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:25:03.430631 30384 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:03.496470 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:03.502539 25682 raft_consensus.cc:2410] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:25:03.462512 30366 raft_consensus.cc:2804] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:03.500270 25763 raft_consensus.cc:1275] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:25:03.507673 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:03.484495 29905 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:03.447085 30198 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:03.511757 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 163264us
I20260709 12:25:03.504484 30390 raft_consensus.cc:2749] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:03.521224 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:03.524111 25686 raft_consensus.cc:2468] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 9.
W20260709 12:25:03.511322 30278 consensus_meta.cc:287] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.926s	user 0.012s	sys 0.001s
I20260709 12:25:03.504531 30023 raft_consensus.cc:3055] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:03.518834 25726 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:03.506824 30366 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:03.518431 30302 consensus_meta.cc:287] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.562s	user 0.009s	sys 0.002s
I20260709 12:25:03.533968 30278 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:03.518105 30351 raft_consensus.cc:2804] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:03.536907 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:03.540524 25726 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:03.545871 25683 raft_consensus.cc:2468] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 11.
W20260709 12:25:03.545482 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 71438.7us
I20260709 12:25:03.523164 30305 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:03.533577 30357 consensus_meta.cc:287] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.511s	user 0.008s	sys 0.004s
I20260709 12:25:03.549357 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:03.568545 25833 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 10.
I20260709 12:25:03.531766 30023 raft_consensus.cc:740] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:03.570945 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:03.546353 29755 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:03.518425 30250 consensus_queue.cc:1059] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 12:25:03.545698 30346 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:03.548092 30090 raft_consensus.cc:2804] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:03.579718 30394 raft_consensus.cc:3055] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:03.579480 29755 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:03.580161 30394 raft_consensus.cc:740] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:03.580346 30390 consensus_queue.cc:1048] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:03.581018 30394 consensus_queue.cc:260] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:03.581636 29755 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:03.536442 30291 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:03.538879 30366 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:03.588660 30381 log.cc:927] Time spent T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:25:03.576393 30402 consensus_queue.cc:1059] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:03.590138 25682 raft_consensus.cc:2410] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for term 14 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 12:25:03.591131 30384 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:03.592656 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:03.592870 30286 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:03.593873 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:03.594502 25682 raft_consensus.cc:2468] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 8.
I20260709 12:25:03.595346 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:25:03.599432 29802 consensus_meta.cc:287] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.517s	user 0.007s	sys 0.000s
I20260709 12:25:03.548748 30351 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:03.602348 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:25:03.603390 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 126721us
I20260709 12:25:03.607124 26402 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:03.608192 30390 raft_consensus.cc:2749] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:03.612169 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:03.615283 26431 raft_consensus.cc:2468] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 10.
I20260709 12:25:03.616897 26435 raft_consensus.cc:1275] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:25:03.628856 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:03.545744 30302 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:03.609654 30387 log.cc:927] Time spent T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:25:03.632337 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:03.607200 30351 raft_consensus.cc:3060] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:03.600659 30299 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:03.636112 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:03.608956 30346 raft_consensus.cc:2804] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:25:03.623313 30335 consensus_meta.cc:287] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.555s	user 0.010s	sys 0.000s
I20260709 12:25:03.609962 30111 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:03.654558 25801 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:03.648921 26402 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:25:03.612619 25650 connection.cc:256] RPC call timeout handler was delayed by -1.235810433000097s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1602s for a response
I20260709 12:25:03.610966 30090 raft_consensus.cc:697] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:03.652655 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:03.657898 25684 raft_consensus.cc:2468] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 11.
I20260709 12:25:03.572628 30357 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:03.628558 30288 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:03.663218 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:25:03.655718 25650 connection.cc:256] RPC call timeout handler was delayed by -1.1017104330003349s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1751s for a response
I20260709 12:25:03.657071 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:03.601404 29802 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:03.658931 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:03.661067 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:03.665356 25756 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Advancing to term 13
W20260709 12:25:03.664363 25650 connection.cc:256] RPC call timeout handler was delayed by -1.088896572000067s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16040000000000001s for a response
W20260709 12:25:03.666043 25650 connection.cc:256] RPC call timeout handler was delayed by -1.0198104330002025s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18420000000000003s for a response
I20260709 12:25:03.669449 25650 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
W20260709 12:25:03.661458 25649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.663893 25686 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 10.
I20260709 12:25:03.670480 30213 raft_consensus.cc:2749] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:03.671828 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:03.672879 25756 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 13.
I20260709 12:25:03.672021 25684 raft_consensus.cc:2368] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 12. Current term is 13.
I20260709 12:25:03.653982 30400 consensus_queue.cc:1048] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:25:03.682336 25684 raft_consensus.cc:1240] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:03.624286 30282 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:03.684087 30393 raft_consensus.cc:2804] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:03.684561 30393 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:03.684733 30282 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:03.684935 30393 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:03.686146 25679 raft_consensus.cc:2368] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 13. Current term is 14.
I20260709 12:25:03.685837 30274 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:03.685889 25682 raft_consensus.cc:1240] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:03.687282 25678 raft_consensus.cc:1240] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:03.658396 30346 raft_consensus.cc:697] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:03.689231 30357 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:03.689833 30346 consensus_queue.cc:237] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:03.692646 30397 log.cc:927] Time spent T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:25:03.692701 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:03.703775 30396 log.cc:927] Time spent T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
W20260709 12:25:03.705787 30392 log.cc:927] Time spent T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 12:25:03.708514 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:03.710207 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:03.710949 25837 raft_consensus.cc:2468] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 13.
I20260709 12:25:03.711825 25677 raft_consensus.cc:2393] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 19: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:03.720209 25686 raft_consensus.cc:1240] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:03.720938 26402 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:03.711910 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:25:03.724704 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 184237us
W20260709 12:25:03.725911 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 46445.4us
I20260709 12:25:03.728645 25649 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:03.713330 30302 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:03.741966 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:03.657188 30335 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:03.768134 30059 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:03.740067 30384 raft_consensus.cc:2804] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:03.792766 30384 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:03.793202 30384 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:03.768759 29755 consensus_queue.cc:1059] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:03.796377 25830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41782 (request call id 956) took 1221 ms. Trace:
I20260709 12:25:03.796809 25830 rpcz_store.cc:276] 0709 12:25:02.575005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.575211 (+   206us) service_pool.cc:224] Handling call
0709 12:25:03.796132 (+1220921us) spinlock_profiling.cc:243] Waited 767 ms on lock 0x7b54002c15d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:03.796292 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1763326848}
I20260709 12:25:03.798045 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:03.798122 29755 raft_consensus.cc:3055] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:03.798594 29755 raft_consensus.cc:740] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:03.651507 30023 consensus_queue.cc:260] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:03.743693 30198 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:03.691823 30399 consensus_queue.cc:1048] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 12:25:03.800547 30023 raft_consensus.cc:3060] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:03.801740 30399 consensus_queue.cc:1048] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:03.802802 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:03.804064 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:03.804239 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:03.805101 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:03.805224 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:03.805475 25832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41782 (request call id 957) took 1209 ms. Trace:
I20260709 12:25:03.805645 25758 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:03.805912 25832 rpcz_store.cc:276] 0709 12:25:02.596168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.964793 (+368625us) service_pool.cc:224] Handling call
0709 12:25:03.805293 (+840500us) spinlock_profiling.cc:243] Waited 361 ms on lock 0x7b5400246b54. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:03.805418 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":829851520}
I20260709 12:25:03.807024 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:03.716485 30367 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:03.808784 25754 raft_consensus.cc:2393] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 14: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:03.781649 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:03.764873 30090 consensus_queue.cc:237] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:03.792237 29802 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 19 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:03.798671 25830 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 12.
I20260709 12:25:03.735234 30213 raft_consensus.cc:2804] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:25:03.820070 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 84141us
I20260709 12:25:03.820816 30367 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:03.822408 25726 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:25:03.824344 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 89553.4us
I20260709 12:25:03.833508 26402 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:03.834619 26402 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:03.841902 25758 raft_consensus.cc:2468] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 11.
I20260709 12:25:03.843381 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:03.816279 30282 consensus_queue.cc:1059] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
W20260709 12:25:03.811723 30280 consensus_meta.cc:287] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.568s	user 0.007s	sys 0.003s
I20260709 12:25:03.814845 30059 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:03.799513 30351 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:03.823290 30213 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:03.850546 30391 raft_consensus.cc:2804] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:03.856449 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:03.873778 25837 raft_consensus.cc:2468] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 14.
I20260709 12:25:03.857059 30390 raft_consensus.cc:2804] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:03.842868 30400 raft_consensus.cc:2749] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:03.857883 30278 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:03.822269 30366 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:03.859545 30334 log.cc:927] Time spent T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 1.730s	user 0.000s	sys 0.005s
I20260709 12:25:03.866379 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:03.865688 25726 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:03.866138 25832 raft_consensus.cc:2468] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 11.
I20260709 12:25:03.872655 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:03.874671 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:03.875084 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:03.873500 30059 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:03.883939 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:03.892175 25837 raft_consensus.cc:2468] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 11.
I20260709 12:25:03.865677 30274 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:03.873613 30213 raft_consensus.cc:3060] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:03.896581 30407 raft_consensus.cc:2749] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:03.869328 30384 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:03.898607 30372 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:03.901091 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:03.901758 25679 raft_consensus.cc:2468] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 12.
I20260709 12:25:03.904567 30351 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:03.877844 30390 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:03.905375 25686 raft_consensus.cc:1275] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 5. (term mismatch)
I20260709 12:25:03.905748 30390 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:03.907074 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:03.907733 25756 raft_consensus.cc:3060] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:03.887751 29802 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:03.908674 29802 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:03.873584 30391 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:03.909583 30391 raft_consensus.cc:3060] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:03.909914 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:03.910579 25833 raft_consensus.cc:2468] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 11.
I20260709 12:25:03.911149 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:03.911810 25832 raft_consensus.cc:2468] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 9.
I20260709 12:25:03.912119 30411 consensus_queue.cc:1048] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:25:03.912758 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:03.897992 30059 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:03.913781 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:03.872467 30280 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:03.913777 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:03.916739 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:03.917016 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:03.917440 25755 raft_consensus.cc:2393] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 12: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:03.918184 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:03.919062 25755 raft_consensus.cc:2393] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 11: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:03.921748 25758 raft_consensus.cc:1240] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:25:03.922233 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:03.922919 25758 raft_consensus.cc:1275] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:25:03.923244 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:03.925905 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:03.926818 25837 raft_consensus.cc:2393] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 11: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:03.928757 25829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41782 (request call id 960) took 1257 ms. Trace:
I20260709 12:25:03.929180 25829 rpcz_store.cc:276] 0709 12:25:02.670905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.008547 (+337642us) service_pool.cc:224] Handling call
0709 12:25:03.041267 (+ 32720us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:03.448654 (+407387us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:03.928475 (+479821us) spinlock_profiling.cc:243] Waited 400 ms on lock 0x7b54002f4754. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:03.928694 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":920023808}
W20260709 12:25:03.934441 30353 log.cc:927] Time spent T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.783s	user 0.002s	sys 0.002s
I20260709 12:25:03.937044 25681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40230 (request call id 1658) took 3532 ms. Trace:
I20260709 12:25:03.937386 25681 rpcz_store.cc:276] 0709 12:25:00.405004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.413073 (+  8069us) service_pool.cc:224] Handling call
0709 12:25:00.469085 (+ 56012us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:00.674303 (+205218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:00.674351 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:00.704214 (+ 29863us) log.cc:844] Serialized 26 byte log entry
0709 12:25:02.238041 (+1533827us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b18004403e0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d96a56e07 00007f5d9f8b19a9 00007f5d96a7369b 00007f5d96a7193f 00007f5d96a73c02 00007f5d996fb20b 00007f5d99700d23 00007f5d997010d1 00007f5d99b1ca0f
0709 12:25:02.622373 (+384332us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:02.622409 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:03.804650 (+1182241us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b54000b27d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:03.804702 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:03.933779 (+129077us) spinlock_profiling.cc:243] Waited 3.52 ms on lock 0x7b4400022b4c. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db 00007f5d99708aaf 00007f5d996fc86e 00007f5d996fbbb6 00007f5d996fb7d8 00007f5d99705221 00007f5d997051d9 00007f5d99705169
0709 12:25:03.936857 (+  3078us) raft_consensus.cc:1685] finished
0709 12:25:03.936877 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:03.936991 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32054,"raft.queue_time_us":38047,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":12273,"spinlock_wait_cycles":440855040,"thread_start_us":383884,"threads_started":1,"wal-append.queue_time_us":2343175}
I20260709 12:25:03.941195 25836 raft_consensus.cc:1240] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:03.941109 30393 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:03.938583 29802 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:03.937316 30213 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:03.943289 25836 raft_consensus.cc:1275] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 14 index: 5. (index mismatch)
I20260709 12:25:03.943259 30393 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:03.943953 30280 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:03.945393 30294 consensus_meta.cc:287] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.503s	user 0.008s	sys 0.008s
I20260709 12:25:03.945866 30294 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:03.947906 30294 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:03.945393 30157 consensus_meta.cc:287] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.502s	user 0.010s	sys 0.002s
I20260709 12:25:03.948796 25837 raft_consensus.cc:1240] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:03.923835 25828 raft_consensus.cc:2468] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 11.
I20260709 12:25:03.911543 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:03.905813 25686 pending_rounds.cc:85] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc: Aborting all ops after (but not including) 4
I20260709 12:25:03.954175 25686 pending_rounds.cc:107] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc: Aborting uncommitted NO_OP operation due to leader change: 11.5
I20260709 12:25:03.954466 25686 raft_consensus.cc:2889] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:03.954799 25686 pending_rounds.cc:107] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc: Aborting uncommitted NO_OP operation due to leader change: 13.6
I20260709 12:25:03.955032 25686 raft_consensus.cc:2889] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:03.919903 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:03.956511 30213 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:03.956972 25755 raft_consensus.cc:2468] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 11.
I20260709 12:25:03.951681 25756 raft_consensus.cc:2468] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 10.
W20260709 12:25:03.960253 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 62447.2us
I20260709 12:25:03.970160 30394 raft_consensus.cc:3060] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:03.975574 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 139766us
I20260709 12:25:03.976691 26402 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:03.981871 25726 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
W20260709 12:25:03.982216 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 243183us
I20260709 12:25:03.984759 25650 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:03.986310 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:03.987404 25650 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:03.992583 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:03.997925 25726 leader_election.cc:400] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Vote denied by peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) with higher term. Message: Invalid argument: T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 12. Current term is 13.
I20260709 12:25:03.962356 30391 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:03.990054 30058 raft_consensus.cc:2749] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:04.009390 25726 leader_election.cc:403] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:04.009815 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:04.010432 25835 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:03.982702 29921 raft_consensus.cc:2749] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:04.007952 30213 raft_consensus.cc:2804] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:03.991101 30007 raft_consensus.cc:2804] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:04.017565 25836 raft_consensus.cc:1275] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:25:04.017812 25726 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:04.014397 30213 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:04.014598 30157 raft_consensus.cc:2749] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) with higher term. Message: Invalid argument: T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 12. Current term is 13.
I20260709 12:25:04.015720 30384 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:04.032121 25726 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:04.015522 30412 raft_consensus.cc:3055] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:04.018553 30007 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:04.025943 30059 raft_consensus.cc:2804] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:04.027233 30213 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:04.068583 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:04.070317 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:04.020148 30290 consensus_queue.cc:1059] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 12:25:04.075167 25828 raft_consensus.cc:3060] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:04.076526 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 44488.7us
I20260709 12:25:04.074384 25836 raft_consensus.cc:2393] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 19: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:04.077337 25726 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:04.077549 25835 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 13.
I20260709 12:25:04.079437 30286 raft_consensus.cc:2749] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:04.079855 30391 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:04.035856 30412 raft_consensus.cc:740] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:04.081508 30290 raft_consensus.cc:3055] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:04.081959 30290 raft_consensus.cc:740] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:04.034384 30367 consensus_queue.cc:1048] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:25:04.082849 30290 consensus_queue.cc:260] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:04.085000 30390 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:04.088713 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:04.065950 30059 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:04.090072 30059 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:04.090976 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
W20260709 12:25:04.091248 30415 log.cc:927] Time spent T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.083s	user 0.002s	sys 0.000s
I20260709 12:25:04.091557 25837 raft_consensus.cc:3060] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:04.096225 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:04.096835 25832 raft_consensus.cc:1813] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Handling vote request from an unknown peer f82778701b464892aab92a752ed7ffdc
I20260709 12:25:04.097293 25832 raft_consensus.cc:2393] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 11: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:04.102329 30286 raft_consensus.cc:2804] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:04.102432 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:04.038192 30007 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:04.103482 30290 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:04.112812 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:04.112428 30007 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:04.116288 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:04.117238 25830 raft_consensus.cc:2393] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 14: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:04.128149 25837 raft_consensus.cc:2468] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 12.
I20260709 12:25:04.148926 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:04.149925 25686 raft_consensus.cc:2393] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 11: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:04.151182 25680 raft_consensus.cc:1240] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:04.147197 30286 raft_consensus.cc:697] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:04.154548 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:04.132745 30390 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:04.236788 25828 raft_consensus.cc:2468] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 8.
W20260709 12:25:04.291632 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 220767us
W20260709 12:25:04.293349 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 316765us
I20260709 12:25:04.082167 30412 consensus_queue.cc:260] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:04.294116 26402 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:04.294471 30412 raft_consensus.cc:3060] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:04.295214 26402 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:04.297530 26402 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:04.299942 26402 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:04.298357 25650 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:04.228791 30111 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:04.301354 26402 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:04.304833 25650 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:04.304283 26402 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:04.155795 30059 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:04.298177 30394 raft_consensus.cc:2749] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:04.298439 30411 raft_consensus.cc:2749] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:04.316054 25650 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:04.301477 30390 raft_consensus.cc:2749] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:04.300374 30007 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:04.330252 30335 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:04.330938 30007 raft_consensus.cc:2804] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:04.331139 25677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 2409) took 1148 ms. Trace:
I20260709 12:25:04.331552 30007 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:04.332120 30007 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:04.311571 30384 raft_consensus.cc:2749] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:04.309669 30267 raft_consensus.cc:2804] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:04.334311 30267 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:04.334846 30267 raft_consensus.cc:3060] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:04.335490 30366 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:04.338091 30059 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:04.306016 30385 raft_consensus.cc:2749] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:04.340744 26402 leader_election.cc:400] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Vote denied by peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) with higher term. Message: Invalid argument: T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 13. Current term is 14.
I20260709 12:25:04.341495 26402 leader_election.cc:403] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:04.348613 25650 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:04.331568 25677 rpcz_store.cc:276] 0709 12:25:03.182507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.235333 (+ 52826us) service_pool.cc:224] Handling call
0709 12:25:04.330952 (+1095619us) spinlock_profiling.cc:243] Waited 439 ms on lock 0x7b54002657d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:04.331085 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1010552192}
I20260709 12:25:04.353091 30414 raft_consensus.cc:2749] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:04.354256 25650 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:04.355880 30414 raft_consensus.cc:2749] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:04.349934 30286 consensus_queue.cc:237] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:04.359447 25650 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:04.310840 30297 raft_consensus.cc:2749] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:04.366742 26402 leader_election.cc:400] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237) with higher term. Message: Invalid argument: T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 13. Current term is 14.
I20260709 12:25:04.367669 26402 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:04.369594 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:04.370028 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:04.371449 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:04.365792 25650 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:04.373831 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:04.358882 30385 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:25:04.380082 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:04.380921 26435 raft_consensus.cc:2410] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for term 15 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260709 12:25:04.377230 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:04.383642 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:04.314735 30111 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:04.384908 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:04.386912 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:04.376102 30266 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:04.387537 26437 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 10.
I20260709 12:25:04.384245 26438 raft_consensus.cc:2376] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 17. Re-sending same reply.
I20260709 12:25:04.388463 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:04.388288 25650 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:04.390033 26439 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 10.
I20260709 12:25:04.368361 30390 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:04.363234 30384 consensus_queue.cc:1059] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 12:25:04.379133 30294 raft_consensus.cc:2749] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:04.398950 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:04.400019 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:04.400708 26434 raft_consensus.cc:2393] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 14: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:04.401381 26435 raft_consensus.cc:1240] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:04.400476 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:04.386054 30275 raft_consensus.cc:2804] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:04.402935 25678 raft_consensus.cc:2393] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 19: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:04.403766 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:04.404438 25726 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:04.390491 30414 raft_consensus.cc:2804] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:04.405762 26437 raft_consensus.cc:1275] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:25:04.405838 25726 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:04.424969 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:04.398790 30265 raft_consensus.cc:2804] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:04.419315 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:04.424422 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:04.428829 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:04.430619 25681 raft_consensus.cc:2393] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 12: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:04.432283 26435 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:04.405274 30275 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:04.431291 25726 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:04.439733 25726 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:04.440788 30059 raft_consensus.cc:2804] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:04.441306 30059 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:04.441785 30059 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:04.444218 30366 consensus_queue.cc:1059] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:04.445366 30385 raft_consensus.cc:2749] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) with higher term. Message: Invalid argument: T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 13. Current term is 14.
I20260709 12:25:04.445688 30366 raft_consensus.cc:3055] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:04.446278 30366 raft_consensus.cc:740] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:04.392910 30297 consensus_queue.cc:1048] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:25:04.407016 30157 raft_consensus.cc:2749] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:04.397194 30390 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:04.462760 30425 log.cc:927] Time spent T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
W20260709 12:25:04.467662 30420 log.cc:927] Time spent T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 12:25:04.468622 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:04.449939 30265 raft_consensus.cc:697] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 13 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:04.482813 30266 raft_consensus.cc:2749] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:04.486171 30267 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:04.494407 30213 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:04.450276 30275 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:04.435192 30291 raft_consensus.cc:2749] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:04.502360 30007 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:04.504887 30356 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:04.511478 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 856983us
I20260709 12:25:04.512095 30288 raft_consensus.cc:2749] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:25:04.520239 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 707261us
I20260709 12:25:04.527019 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:04.529270 26435 raft_consensus.cc:2468] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 11.
I20260709 12:25:04.452502 30408 raft_consensus.cc:2804] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:04.539050 30007 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:04.540637 30390 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:04.542824 25650 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:04.574302 25650 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:04.543103 30265 consensus_queue.cc:237] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:04.590045 25801 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:04.591035 26430 raft_consensus.cc:2468] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 11.
I20260709 12:25:04.544061 30154 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:04.543931 30335 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:04.551043 30197 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:04.521040 30423 log.cc:927] Time spent T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 12:25:04.544070 30412 consensus_queue.cc:1048] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:25:04.553288 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:04.558607 30267 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:04.559827 30059 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:04.572233 25760 raft_consensus.cc:2468] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 8.
I20260709 12:25:04.572417 25800 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:04.593909 30354 raft_consensus.cc:2804] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:04.593644 25801 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:04.602114 25801 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:04.447407 30366 consensus_queue.cc:260] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:04.592643 25682 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:04.592710 30094 raft_consensus.cc:2804] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:04.524511 30364 consensus_queue.cc:1059] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 12:25:04.598421 25829 raft_consensus.cc:2468] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 11.
I20260709 12:25:04.573509 30408 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:04.613111 30059 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:04.618952 30059 raft_consensus.cc:3055] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:04.619529 30059 raft_consensus.cc:740] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:04.620491 30059 consensus_queue.cc:260] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:04.621788 30059 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:04.598906 30154 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:04.628027 30408 raft_consensus.cc:3060] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:04.632990 30213 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:04.600135 30335 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:04.635399 30094 raft_consensus.cc:697] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 8 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:04.636390 30094 consensus_queue.cc:237] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:04.637351 30335 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:04.638345 26435 raft_consensus.cc:1240] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:25:04.640409 25650 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:04.642993 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:04.643525 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:04.644470 26432 raft_consensus.cc:2393] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 10: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:04.644833 25682 raft_consensus.cc:2468] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 14.
W20260709 12:25:04.647576 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:04.647751 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:04.647576 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:04.648849 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:04.649657 26435 raft_consensus.cc:2393] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 12: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:04.650369 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:04.650974 26435 raft_consensus.cc:2393] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 19: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:04.648962 30414 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:04.607585 30383 raft_consensus.cc:2804] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:04.607262 30278 raft_consensus.cc:2804] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:04.606878 30382 raft_consensus.cc:2749] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:04.607448 30301 raft_consensus.cc:2804] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:04.655139 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:04.662497 26434 raft_consensus.cc:2393] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 11: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:04.662555 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:04.640666 30354 raft_consensus.cc:697] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 12 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:04.656522 30356 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:04.646884 30154 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:04.656903 30414 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:04.656594 30297 raft_consensus.cc:2804] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:04.599632 30197 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:04.646404 30267 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
W20260709 12:25:04.665517 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 144641us
I20260709 12:25:04.659269 30383 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:04.661157 30278 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:04.684397 25649 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:04.688437 26438 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 14.
I20260709 12:25:04.691483 25649 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:04.695043 30252 raft_consensus.cc:2804] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:04.685490 30383 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:04.695580 30252 raft_consensus.cc:697] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 10 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:04.694630 30275 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:04.668308 30301 raft_consensus.cc:697] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 11 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:04.682085 30297 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:04.686110 30278 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:04.675522 30356 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:04.706913 30297 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:04.685950 30267 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:04.735669 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 132974us
W20260709 12:25:04.742637 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 139508us
I20260709 12:25:04.743847 25800 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:04.743939 25801 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:04.749146 30275 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:04.749478 30197 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:04.728935 30354 consensus_queue.cc:237] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:04.760879 30356 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:04.762161 25650 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:04.762555 30301 consensus_queue.cc:237] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:04.780412 30356 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:04.781558 30356 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:04.786691 25800 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:04.810575 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:04.731564 30007 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:04.813318 25650 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:04.815743 30356 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:04.815510 30378 consensus_queue.cc:1048] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:04.818614 25650 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:04.819746 25650 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:04.822079 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:04.822822 25757 raft_consensus.cc:2393] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 14: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
W20260709 12:25:04.825789 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 134382us
I20260709 12:25:04.810068 30275 raft_consensus.cc:2804] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:25:04.831030 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 87171.5us
I20260709 12:25:04.832340 25801 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:04.820960 30402 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:04.809181 30442 raft_consensus.cc:2804] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:04.820850 30197 raft_consensus.cc:2804] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:04.836431 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:04.837179 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:04.837201 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:04.837551 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:04.863633 26432 raft_consensus.cc:3060] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:25:04.840566 25831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44218 (request call id 1743) took 1885 ms. Trace:
I20260709 12:25:04.868109 25831 rpcz_store.cc:276] 0709 12:25:02.955636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.006973 (+ 51337us) service_pool.cc:224] Handling call
0709 12:25:03.007278 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:03.007464 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:25:03.413438 (+405974us) log.cc:844] Serialized 14 byte log entry
0709 12:25:03.464406 (+ 50968us) log.cc:844] Serialized 14 byte log entry
0709 12:25:04.510356 (+1045950us) spinlock_profiling.cc:243] Waited 3.59 ms on lock 0x7b18000433c0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d969eec0a 00007f5da012e219 00007f5d96a76a40 00007f5d96a714e4 00007f5d96a71455 00007f5d99b59060 00007f5d99b6b716 00007f5d99b7c287 00007f5d99b7c208
0709 12:25:04.666820 (+156464us) log.cc:844] Serialized 14 byte log entry
0709 12:25:04.831591 (+164771us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:04.831643 (+    52us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:04.831688 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:04.831748 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:04.840511 (+  8763us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1020499,"prepare.queue_time_us":462441,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":95,"raft.queue_time_us":1062928,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":21723,"spinlock_wait_cycles":8385664,"thread_start_us":769087,"threads_started":4,"wal-append.queue_time_us":123684,"wal-append.run_cpu_time_us":1951,"wal-append.run_wall_time_us":1112223}
I20260709 12:25:04.841996 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:04.871163 26430 raft_consensus.cc:3060] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:04.844127 25801 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:04.877637 25801 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:04.878720 30066 raft_consensus.cc:2749] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:04.880455 30066 raft_consensus.cc:2804] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:04.880934 30066 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:04.881381 30066 raft_consensus.cc:3060] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:04.885120 26434 raft_consensus.cc:2393] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 19: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:04.885648 25801 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:04.850039 30278 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:04.854817 25837 raft_consensus.cc:1240] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:04.889788 26437 raft_consensus.cc:2393] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 14: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:04.856191 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:04.890340 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:04.860119 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:04.814348 30382 consensus_queue.cc:1059] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:25:04.829206 30215 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:04.824420 30437 raft_consensus.cc:2749] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:04.888873 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:04.828706 30390 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:04.829061 30275 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:04.839600 30154 raft_consensus.cc:2749] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:04.823891 30414 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:04.905318 25828 raft_consensus.cc:1240] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:04.860317 30198 raft_consensus.cc:2749] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:04.886835 30197 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:04.863674 30450 raft_consensus.cc:2749] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:04.916806 26432 raft_consensus.cc:2468] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 8.
I20260709 12:25:04.912511 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:04.916860 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:04.923009 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:04.921077 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:04.892223 30442 raft_consensus.cc:697] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 11 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:04.924162 25828 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:04.907629 30275 raft_consensus.cc:3060] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:04.827293 30252 consensus_queue.cc:237] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:04.946913 25836 raft_consensus.cc:1275] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:25:04.948416 25837 raft_consensus.cc:1275] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:25:04.921097 30197 raft_consensus.cc:3060] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:04.940733 30426 log.cc:927] Time spent T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.487s	user 0.003s	sys 0.002s
I20260709 12:25:04.861413 30402 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:04.919389 30443 raft_consensus.cc:2804] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:25:04.960979 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 134197us
I20260709 12:25:04.958185 25650 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:04.961191 25757 raft_consensus.cc:1240] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:04.958168 25836 raft_consensus.cc:1275] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:25:04.908627 26430 raft_consensus.cc:2468] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 12.
I20260709 12:25:04.970038 25650 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:05.006253 30265 raft_consensus.cc:2749] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:25:05.006860 25650 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:05.007707 30265 raft_consensus.cc:2749] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:05.007194 25828 raft_consensus.cc:2468] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 13.
I20260709 12:25:04.922930 30356 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:04.972605 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:04.975834 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:04.976241 26432 raft_consensus.cc:1240] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:04.976693 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:04.978922 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:05.013067 25756 raft_consensus.cc:2393] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 10: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:05.013185 29755 consensus_queue.cc:260] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:05.014428 29755 raft_consensus.cc:3060] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:05.014623 30414 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:05.014691 30170 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:05.015352 30356 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:04.980048 30267 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:04.907305 30215 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:04.907514 30390 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:05.024237 30390 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:05.027006 30432 log.cc:927] Time spent T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.297s	user 0.000s	sys 0.007s
I20260709 12:25:04.988523 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:04.993103 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:04.998051 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:05.029489 25832 raft_consensus.cc:2468] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 12.
W20260709 12:25:05.000371 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 84642.3us
I20260709 12:25:05.031358 30378 raft_consensus.cc:2749] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:05.008639 30443 raft_consensus.cc:697] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 11 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:05.032913 30443 consensus_queue.cc:237] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:05.037683 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:05.038704 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:05.019761 30280 consensus_queue.cc:1059] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:25:05.038257 29921 raft_consensus.cc:2955] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 10 LEADER]: Committing config change with OpId 6.8: config changed from index 6 to 8, VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
W20260709 12:25:05.021445 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 46563.6us
I20260709 12:25:04.980631 30437 raft_consensus.cc:2749] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:04.984210 25649 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:05.027783 30266 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.039403 26433 raft_consensus.cc:2468] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 11.
W20260709 12:25:05.043480 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 59363.9us
I20260709 12:25:05.045419 30266 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:05.047530 30266 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:05.048249 26437 raft_consensus.cc:2410] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 18 because replica has last-logged OpId of term: 13 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260709 12:25:05.049862 25685 raft_consensus.cc:1240] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:05.051090 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:05.051846 25678 raft_consensus.cc:2393] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 13: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:05.052664 25684 raft_consensus.cc:1275] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:25:05.054751 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:05.054838 30301 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.055831 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:05.055526 25757 raft_consensus.cc:2368] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for earlier term 13. Current term is 14.
I20260709 12:25:04.983881 30354 consensus_queue.cc:1048] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 12:25:05.060276 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:05.008826 25650 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:05.042663 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:05.068581 25755 raft_consensus.cc:2393] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 13: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:05.071195 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:05.071296 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 62548us
I20260709 12:25:05.071944 25759 raft_consensus.cc:2468] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 8.
I20260709 12:25:05.072381 25650 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:05.074069 25650 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:05.079609 25683 raft_consensus.cc:1275] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:25:05.019423 30278 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:05.083225 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:05.087709 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:05.056680 30382 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:05.078881 30450 raft_consensus.cc:2749] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:05.055500 30301 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:05.106360 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:05.075764 30265 raft_consensus.cc:2749] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:05.086403 30437 raft_consensus.cc:2749] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:05.070869 30266 consensus_queue.cc:1059] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 12:25:05.119946 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:05.090296 30215 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:05.137194 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:05.138521 30265 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
W20260709 12:25:05.138899 30446 log.cc:927] Time spent T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 12:25:05.139163 30265 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:05.141203 25678 raft_consensus.cc:2393] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 14: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:05.142859 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:05.154749 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:05.066962 30442 consensus_queue.cc:237] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:05.159405 25801 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:05.105091 30382 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:05.167657 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:05.167608 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:05.168955 25683 raft_consensus.cc:2393] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 19: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:05.169273 25685 raft_consensus.cc:2468] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 10.
I20260709 12:25:05.175101 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:05.177430 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:05.178167 25683 raft_consensus.cc:2368] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 12. Current term is 13.
I20260709 12:25:05.169297 25801 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:05.179293 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:05.181540 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:05.182261 25828 raft_consensus.cc:2393] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 19: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
W20260709 12:25:05.179816 30447 log.cc:927] Time spent T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 12:25:05.139839 30383 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:05.186983 25801 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
W20260709 12:25:05.186830 30408 consensus_meta.cc:287] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.558s	user 0.002s	sys 0.009s
I20260709 12:25:05.178941 30302 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:05.203398 25829 raft_consensus.cc:1240] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:05.204381 25801 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:05.190023 30325 raft_consensus.cc:2749] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:05.190357 30197 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:05.201750 30402 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:05.224970 30393 raft_consensus.cc:3055] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:05.231412 30393 raft_consensus.cc:740] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:05.232528 30393 consensus_queue.cc:260] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:05.233858 30393 raft_consensus.cc:3060] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:05.234683 30444 log.cc:927] Time spent T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.234s	user 0.001s	sys 0.000s
I20260709 12:25:05.241212 30265 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:05.196976 30297 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:05.256666 30457 raft_consensus.cc:2749] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:05.257449 30457 raft_consensus.cc:2749] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:05.260633 30111 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:05.265637 25649 leader_election.cc:400] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 election: Vote denied by peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267) with higher term. Message: Invalid argument: T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for earlier term 13. Current term is 14.
I20260709 12:25:05.266064 25649 leader_election.cc:403] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:25:05.271021 26431 raft_consensus.cc:1275] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:25:05.238266 30459 raft_consensus.cc:2749] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:05.272500 26433 raft_consensus.cc:1275] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:25:05.273507 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:05.274236 26432 raft_consensus.cc:2368] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for earlier term 13. Current term is 14.
I20260709 12:25:05.217584 30455 consensus_queue.cc:1059] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 12:25:05.275326 30382 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:05.278469 30297 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:05.204855 30275 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:05.205359 30408 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:05.280517 30356 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:05.281407 25763 raft_consensus.cc:2368] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 10. Current term is 11.
I20260709 12:25:05.283071 30408 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:05.284847 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:05.286036 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:05.287073 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:05.287285 25830 raft_consensus.cc:2393] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 12: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:05.287730 25828 raft_consensus.cc:2393] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 13: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:05.290846 26433 raft_consensus.cc:1275] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:05.289490 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:05.210319 30302 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:05.289702 26401 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:05.297178 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:05.299430 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:05.301716 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:05.303642 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:05.296860 30435 raft_consensus.cc:2749] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267) with higher term. Message: Invalid argument: T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for earlier term 13. Current term is 14.
I20260709 12:25:05.313364 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:05.313697 30354 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.314304 30354 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:05.314801 30197 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:05.315037 30302 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:05.280570 30275 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:05.315879 30275 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.316037 30066 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:05.316838 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
W20260709 12:25:05.317431 30448 log.cc:927] Time spent T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.231s	user 0.003s	sys 0.000s
I20260709 12:25:05.317742 25836 raft_consensus.cc:1240] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:05.318132 30301 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:05.316455 30275 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:05.318264 30066 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:05.320114 30275 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:05.321316 30383 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:05.321787 25650 leader_election.cc:400] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 election: Vote denied by peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611) with higher term. Message: Invalid argument: T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for earlier term 13. Current term is 14.
I20260709 12:25:05.322440 30111 consensus_queue.cc:1048] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:05.323181 29842 consensus_queue.cc:1048] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:05.317438 25828 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:05.316481 30354 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:05.327539 25650 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:05.333719 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:05.349472 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
W20260709 12:25:05.375787 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 48326.5us
I20260709 12:25:05.376858 25650 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:05.378398 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:05.379365 26431 raft_consensus.cc:2468] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 9.
I20260709 12:25:05.381932 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:05.383031 26430 raft_consensus.cc:2410] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:25:05.383783 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:05.300801 30007 raft_consensus.cc:2749] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:05.314828 30399 raft_consensus.cc:2804] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:05.404211 25650 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:25:05.404456 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 200146us
I20260709 12:25:05.405412 25650 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:05.394747 25836 raft_consensus.cc:1275] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:25:05.402391 25828 raft_consensus.cc:2468] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 15.
I20260709 12:25:05.407404 29755 raft_consensus.cc:2749] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:05.407548 25650 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:05.408917 30111 raft_consensus.cc:2749] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:05.410403 25834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44218 (request call id 1746) took 2392 ms. Trace:
I20260709 12:25:05.405892 25801 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:05.410457 25828 raft_consensus.cc:1275] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:25:05.384542 30265 raft_consensus.cc:2749] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:05.414499 25650 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:05.410924 25834 rpcz_store.cc:276] 0709 12:25:03.017949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.590023 (+572074us) service_pool.cc:224] Handling call
0709 12:25:03.590321 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:04.514256 (+923935us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:04.514300 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:04.519134 (+  4834us) log.cc:844] Serialized 26 byte log entry
0709 12:25:04.605446 (+ 86312us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:04.605484 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:05.404256 (+798772us) spinlock_profiling.cc:243] Waited 200 ms on lock 0x7b54001b0654. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:05.404303 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:05.404347 (+    44us) raft_consensus.cc:1685] finished
0709 12:25:05.404365 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:05.410345 (+  5980us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":742729,"raft.queue_time_us":728004,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":5276,"spinlock_wait_cycles":459495680,"thread_start_us":66043,"threads_started":1,"wal-append.queue_time_us":148188}
I20260709 12:25:05.323228 30435 consensus_queue.cc:1048] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.081s
I20260709 12:25:05.420938 25650 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:05.416169 25801 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:05.433717 25678 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 10.
I20260709 12:25:05.403416 30354 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.405858 29842 raft_consensus.cc:2749] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:05.409909 30378 raft_consensus.cc:2749] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:05.403733 30399 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:05.489127 30399 raft_consensus.cc:3060] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:05.489800 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:05.446396 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:05.447806 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:05.452768 25801 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:05.417357 30301 raft_consensus.cc:2804] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:05.416451 30400 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.449847 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:05.434903 29755 consensus_queue.cc:1048] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 12:25:05.419404 30007 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.495078 30400 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:05.495251 30007 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:05.496160 30335 raft_consensus.cc:3055] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:05.496536 30335 raft_consensus.cc:740] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:05.497279 30400 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:05.497658 30007 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:05.464103 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:05.494079 30463 raft_consensus.cc:2749] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:05.464941 26438 raft_consensus.cc:1240] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:05.500680 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:05.501938 30301 raft_consensus.cc:697] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 14 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:05.503110 30301 consensus_queue.cc:237] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:05.504371 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:05.466774 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:05.504984 25759 raft_consensus.cc:2468] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 11.
I20260709 12:25:05.470925 30366 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:05.449151 30094 raft_consensus.cc:2804] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:05.463558 30275 consensus_queue.cc:1048] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 12:25:05.442930 30066 raft_consensus.cc:2804] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:05.507902 25801 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:05.481195 25800 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:05.483978 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:05.484910 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:05.485805 25831 raft_consensus.cc:1240] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:25:05.493714 26434 raft_consensus.cc:2393] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 11: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:05.434801 30111 raft_consensus.cc:2804] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:25:05.481410 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:05.512477 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:05.514569 25801 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:05.515435 25801 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:05.515758 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:05.519829 25649 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:05.520581 25757 raft_consensus.cc:2368] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 12. Current term is 13.
W20260709 12:25:05.526871 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 45860.4us
I20260709 12:25:05.531440 25801 leader_election.cc:400] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 election: Vote denied by peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) with higher term. Message: Invalid argument: T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 12. Current term is 13.
I20260709 12:25:05.531862 25801 leader_election.cc:403] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:25:05.536127 25800 leader_election.cc:400] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 election: Vote denied by peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267) with higher term. Message: Invalid argument: T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 10. Current term is 11.
I20260709 12:25:05.536580 25800 leader_election.cc:403] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:25:05.521487 30094 raft_consensus.cc:697] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 15 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:05.497324 30335 consensus_queue.cc:260] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:05.537366 30197 raft_consensus.cc:2749] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:05.538192 29842 raft_consensus.cc:2804] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:05.540719 29842 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:05.541088 29842 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:05.512151 30111 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:05.541978 30111 raft_consensus.cc:3060] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:05.543423 25758 raft_consensus.cc:1240] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:25:05.539546 30302 raft_consensus.cc:2804] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:05.544411 25761 raft_consensus.cc:1240] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:05.544847 25800 leader_election.cc:400] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 election: Vote denied by peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267) with higher term. Message: Invalid argument: T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 12. Current term is 13.
I20260709 12:25:05.511667 30066 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:05.557194 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:25:05.568851 25800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:05.548599 29905 raft_consensus.cc:3060] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:05.492868 30354 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:05.569994 25681 raft_consensus.cc:1240] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:05.551003 30459 raft_consensus.cc:2749] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) with higher term. Message: Invalid argument: T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 12. Current term is 13.
W20260709 12:25:05.571463 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:05.517771 30170 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:05.521925 30390 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.575647 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:05.605839 25835 raft_consensus.cc:2393] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 11: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
W20260709 12:25:05.608180 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:05.574752 25801 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:05.576511 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:05.570956 25683 raft_consensus.cc:2468] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 13.
I20260709 12:25:05.574733 25677 raft_consensus.cc:1240] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:25:05.585105 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:05.585867 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:05.586452 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:05.612239 25678 raft_consensus.cc:3060] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:05.539471 30335 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:05.589782 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:05.590420 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:05.594709 29905 raft_consensus.cc:2749] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267) with higher term. Message: Invalid argument: T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 10. Current term is 11.
I20260709 12:25:05.596659 30198 raft_consensus.cc:3055] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:05.539278 30383 raft_consensus.cc:2749] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:25:05.539418 30154 raft_consensus.cc:2749] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:25:05.705374 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 64093.1us
I20260709 12:25:05.614207 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:05.521282 30400 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:05.620018 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 45325.2us
I20260709 12:25:05.706561 26435 raft_consensus.cc:1275] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:25:05.549125 30302 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:05.626789 25832 raft_consensus.cc:1275] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:05.627465 25650 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:05.632370 25682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40230 (request call id 1693) took 1533 ms. Trace:
I20260709 12:25:05.570868 30066 raft_consensus.cc:3060] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:05.539073 30094 consensus_queue.cc:237] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 14.5, Last appended by leader: 5, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:05.718124 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:05.630681 30198 raft_consensus.cc:740] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
W20260709 12:25:05.616537 30461 log.cc:927] Time spent T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:25:05.630425 30252 consensus_queue.cc:1059] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:25:05.662053 29921 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.688047 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:05.688544 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:05.689828 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:05.732815 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:05.699426 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:05.733496 25832 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 17.
I20260709 12:25:05.701020 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:05.714166 30302 raft_consensus.cc:3060] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:05.623580 25755 raft_consensus.cc:1240] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:05.706652 25677 raft_consensus.cc:2468] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 11.
W20260709 12:25:05.708959 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 46602.3us
I20260709 12:25:05.712502 25682 rpcz_store.cc:276] 0709 12:25:04.099262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:04.099391 (+   129us) service_pool.cc:224] Handling call
0709 12:25:05.632169 (+1532778us) spinlock_profiling.cc:243] Waited 489 ms on lock 0x7b5400158e54. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:05.632299 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1125529472}
I20260709 12:25:05.714669 25681 raft_consensus.cc:1240] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:05.747223 25759 raft_consensus.cc:1275] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:25:05.623847 30458 raft_consensus.cc:2749] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:05.748034 30473 raft_consensus.cc:2749] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:05.717331 30157 consensus_queue.cc:1048] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:25:05.756146 30354 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:05.623056 30170 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:05.660476 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:05.761660 30170 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:05.719187 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:05.720041 25801 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:05.763547 25801 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
W20260709 12:25:05.720979 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 93601.2us
I20260709 12:25:05.767417 30459 raft_consensus.cc:2749] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:05.768056 30459 raft_consensus.cc:2749] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:05.770015 26431 raft_consensus.cc:1275] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 12:25:05.770394 26431 pending_rounds.cc:85] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89: Aborting all ops after (but not including) 9
I20260709 12:25:05.770605 26431 pending_rounds.cc:107] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 12:25:05.770829 26431 raft_consensus.cc:2889] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:05.742961 29921 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:05.723435 25680 raft_consensus.cc:1240] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:05.774019 29921 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:05.731303 30288 consensus_queue.cc:1059] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:25:05.775416 30288 raft_consensus.cc:3055] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:05.664448 30463 consensus_queue.cc:1059] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.100s
I20260709 12:25:05.624274 30390 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:05.693778 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:05.627215 30356 consensus_queue.cc:1059] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.099s
I20260709 12:25:05.743858 25829 raft_consensus.cc:2368] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 7. Current term is 8.
I20260709 12:25:05.735805 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:05.775764 30288 raft_consensus.cc:740] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:05.793828 25680 raft_consensus.cc:1240] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 10 LEADER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:05.732946 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:05.786980 30198 consensus_queue.cc:260] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:05.681870 25678 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 11.
I20260709 12:25:05.795590 25686 raft_consensus.cc:1275] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:25:05.718523 30400 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:05.798020 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:05.788480 30378 consensus_queue.cc:1048] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:05.807122 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:05.807775 25832 raft_consensus.cc:2468] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 13.
I20260709 12:25:05.800426 25756 raft_consensus.cc:1275] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:25:05.810930 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:05.650305 26402 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:05.805697 25836 raft_consensus.cc:1275] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:25:05.805044 26434 raft_consensus.cc:1275] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 12:25:05.813078 26434 pending_rounds.cc:85] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89: Aborting all ops after (but not including) 9
I20260709 12:25:05.813377 26434 pending_rounds.cc:107] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 12:25:05.813658 26434 raft_consensus.cc:2889] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:05.814311 25834 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 11.
W20260709 12:25:05.818439 25801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:05.820566 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 170380us
I20260709 12:25:05.824558 25650 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:05.827785 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:05.796492 30458 consensus_queue.cc:1048] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:25:05.821173 30356 raft_consensus.cc:3055] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:25:05.832824 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 126659us
I20260709 12:25:05.881016 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:05.834547 25800 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:05.827390 29921 raft_consensus.cc:2764] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:25:05.830137 29755 raft_consensus.cc:2804] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:05.831272 30215 consensus_queue.cc:1059] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 12:25:05.818713 30198 raft_consensus.cc:3060] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:05.889621 29842 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:05.892413 25681 raft_consensus.cc:1240] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:05.883701 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:05.884150 25832 raft_consensus.cc:1275] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:05.893555 25755 raft_consensus.cc:2468] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 11.
W20260709 12:25:05.885290 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 50816.4us
I20260709 12:25:05.898556 25800 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:05.906672 25800 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:05.831475 30385 consensus_queue.cc:1059] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 12:25:05.844905 30356 raft_consensus.cc:740] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
W20260709 12:25:05.923857 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 91212.2us
I20260709 12:25:05.892372 29755 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:05.892247 29802 raft_consensus.cc:2804] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:05.896879 30301 raft_consensus.cc:2749] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:05.922143 30280 raft_consensus.cc:2749] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:05.922255 30383 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:05.928223 30335 raft_consensus.cc:2749] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:25:05.954033 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 71570.2us
I20260709 12:25:05.931668 29755 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:05.892944 30483 consensus_queue.cc:1048] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 12:25:05.955412 25726 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:05.944835 29842 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:05.954813 30390 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:05.938194 30459 consensus_queue.cc:1048] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
W20260709 12:25:05.983563 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:05.955602 30383 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:05.995616 25726 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:05.969756 30399 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:06.013338 30383 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:05.980011 30356 consensus_queue.cc:260] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:06.001235 30111 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:06.016186 30356 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:06.018206 30111 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:06.019059 30197 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:06.019340 30492 consensus_queue.cc:1059] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:06.019816 30197 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:06.055217 26439 raft_consensus.cc:1240] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:06.077399 30491 raft_consensus.cc:2749] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:06.080238 30197 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:06.054437 30302 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:06.081629 30066 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:06.082297 30302 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:06.082798 25830 raft_consensus.cc:1240] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:25:06.089860 30399 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:05.996764 30400 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:06.024740 30483 raft_consensus.cc:2804] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:06.108415 30483 raft_consensus.cc:697] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 14 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:06.109445 30483 consensus_queue.cc:237] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:06.103359 29755 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:06.112435 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 116919us
I20260709 12:25:06.114300 25726 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:06.115414 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:06.116416 25726 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:06.118558 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:06.119087 30494 raft_consensus.cc:2804] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:06.120652 30494 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:06.120833 29755 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:06.121052 30494 raft_consensus.cc:3060] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:06.128957 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:06.129746 25754 raft_consensus.cc:2393] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 10: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:06.130951 25761 raft_consensus.cc:1275] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:25:06.135448 30485 log.cc:927] Time spent T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.300s	user 0.002s	sys 0.000s
I20260709 12:25:06.137521 30066 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:06.117936 30496 raft_consensus.cc:2804] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:06.138433 30496 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:06.138818 30496 raft_consensus.cc:3060] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:06.139293 30366 consensus_meta.cc:287] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.631s	user 0.011s	sys 0.000s
W20260709 12:25:06.141721 26401 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.245.130:37267 timed out after 1.721s (SENT) [suppressed 8 similar messages]
W20260709 12:25:06.142864 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:06.145814 30489 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:06.146347 30385 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:06.145927 25837 raft_consensus.cc:1275] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 12:25:06.148402 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 221407us
I20260709 12:25:06.148873 25762 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 11.
I20260709 12:25:06.117997 25726 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:06.146448 30489 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:06.147758 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:06.160045 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
W20260709 12:25:06.164882 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:06.163450 30399 raft_consensus.cc:3055] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:06.172495 30399 raft_consensus.cc:740] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:06.172806 29755 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:06.173085 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:06.173316 29755 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:06.173763 25831 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:06.173405 30399 consensus_queue.cc:260] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:06.174767 30399 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:06.175319 29755 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:06.175849 30356 consensus_queue.cc:1048] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:06.147207 30170 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.176838 30170 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:06.164618 30007 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.179127 30007 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:06.180474 30490 log.cc:927] Time spent T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 12:25:06.166519 26402 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:06.183455 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:06.184361 25833 raft_consensus.cc:2468] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 14.
I20260709 12:25:06.185628 26433 raft_consensus.cc:1240] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:06.185772 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:06.166769 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:06.186856 26402 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:06.187726 25761 raft_consensus.cc:2410] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:25:06.138427 30267 consensus_queue.cc:1059] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:25:06.168016 30400 consensus_queue.cc:1059] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:06.161204 30366 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.169006 25829 raft_consensus.cc:1240] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:25:06.186851 25835 raft_consensus.cc:2393] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 10: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:06.181759 30007 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:06.231205 25831 raft_consensus.cc:2468] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 14.
W20260709 12:25:06.227861 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 65521.6us
I20260709 12:25:06.152491 30408 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.146925 30385 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:06.227139 30474 log.cc:927] Time spent T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.415s	user 0.002s	sys 0.002s
I20260709 12:25:06.241636 30213 raft_consensus.cc:3055] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:06.243657 30489 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:06.245451 30400 raft_consensus.cc:3055] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:06.247843 30501 raft_consensus.cc:2749] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:25:06.246945 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 60160.7us
I20260709 12:25:06.263624 26402 leader_election.cc:400] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237) with higher term. Message: Invalid argument: T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 7. Current term is 8.
I20260709 12:25:06.264068 26402 leader_election.cc:403] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:06.164433 30495 raft_consensus.cc:2749] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:06.253079 25726 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:25:06.227591 30390 raft_consensus.cc:2804] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:06.272014 30455 raft_consensus.cc:3055] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:06.272711 30455 raft_consensus.cc:740] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:06.273936 30455 consensus_queue.cc:260] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:06.266695 30390 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:06.276523 30390 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:06.276680 30455 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:06.023653 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:25:06.283756 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 142055us
I20260709 12:25:06.285842 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:06.286536 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:06.286824 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:06.288341 26402 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:06.232185 30366 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:06.291082 26430 raft_consensus.cc:1275] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:06.292470 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:06.252947 30213 raft_consensus.cc:740] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:06.256541 30400 raft_consensus.cc:740] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:06.300729 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:06.302079 26430 raft_consensus.cc:3060] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:06.304896 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:06.300486 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:06.306826 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:06.317162 26435 raft_consensus.cc:2468] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 12.
I20260709 12:25:06.303210 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:06.310014 26401 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:06.248927 30408 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:06.325714 29802 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:06.326252 29802 raft_consensus.cc:3060] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:06.257076 30493 consensus_queue.cc:1059] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 12:25:06.330530 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:06.331140 25757 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:06.289961 30170 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:06.334499 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 44350.2us
I20260709 12:25:06.335508 25726 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:06.293668 30489 raft_consensus.cc:2749] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237) with higher term. Message: Invalid argument: T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 7. Current term is 8.
W20260709 12:25:06.336666 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 48404.1us
I20260709 12:25:06.337420 26402 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:06.337378 26430 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 11.
I20260709 12:25:06.342777 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:06.323850 30495 raft_consensus.cc:2804] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:06.344345 26430 raft_consensus.cc:3060] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:06.327982 30252 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.294713 30492 consensus_queue.cc:1048] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 12:25:06.346588 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:06.349519 26436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 1166) took 1020 ms. Trace:
I20260709 12:25:06.349807 25755 raft_consensus.cc:3060] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:25:06.347677 25758 raft_consensus.cc:1275] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:25:06.353546 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:06.355537 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:06.346570 30499 consensus_queue.cc:1048] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:25:06.343343 30501 raft_consensus.cc:2804] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:06.390763 26430 raft_consensus.cc:2468] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 10.
I20260709 12:25:06.350047 26436 rpcz_store.cc:276] 0709 12:25:05.329129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:05.331022 (+  1893us) service_pool.cc:224] Handling call
0709 12:25:05.331358 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:05.380119 (+ 48761us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:05.380149 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:05.403344 (+ 23195us) log.cc:844] Serialized 26 byte log entry
0709 12:25:05.511224 (+107880us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:05.511298 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:05.511433 (+   135us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:06.160062 (+648629us) spinlock_profiling.cc:243] Waited 9.01 ms on lock 0x7b20000e4ff8. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9970fb91 00007f5d99731a19 00007f5d996fc8c3 00007f5d996fbbb6 00007f5d996fb7d8 00007f5d99705221 00007f5d997051d9 00007f5d99705169 00007f5d99705131 00007f5d9970442d 0000000000388634
0709 12:25:06.345834 (+185772us) raft_consensus.cc:1685] finished
0709 12:25:06.345856 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:06.349436 (+  3580us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48373,"raft.queue_time_us":52952,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":13894,"spinlock_wait_cycles":20724096,"thread_start_us":62443,"threads_started":1,"wal-append.queue_time_us":315300}
I20260709 12:25:06.328284 30504 consensus_queue.cc:1048] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:25:06.342150 30502 raft_consensus.cc:2749] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:25:06.394793 30489 raft_consensus.cc:2749] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:06.396271 30501 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:06.494279 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:06.357998 30252 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:06.499037 25757 raft_consensus.cc:2468] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 12.
W20260709 12:25:06.512089 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 166874us
I20260709 12:25:06.513526 25726 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:06.486877 30492 raft_consensus.cc:2804] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:06.498016 30501 raft_consensus.cc:3060] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:06.389465 30400 consensus_queue.cc:260] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:06.506909 30385 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:25:06.528288 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 190929us
I20260709 12:25:06.504005 30495 raft_consensus.cc:697] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
W20260709 12:25:06.552635 30506 log.cc:927] Time spent T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 12:25:06.523936 30492 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:06.565454 30252 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:06.553830 30502 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:06.576742 25755 raft_consensus.cc:2468] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 10.
W20260709 12:25:06.583653 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:06.588110 30499 raft_consensus.cc:3060] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:06.588143 30170 consensus_queue.cc:1048] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:06.556353 30492 raft_consensus.cc:3060] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:06.555459 30366 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:06.578280 30400 raft_consensus.cc:3060] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:06.602988 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 74178.3us
I20260709 12:25:06.578181 26402 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
W20260709 12:25:06.611866 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:06.612569 30483 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.613101 30483 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:06.613929 30480 log.cc:927] Time spent T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.787s	user 0.011s	sys 0.002s
I20260709 12:25:06.615459 30483 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:06.616997 25726 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
W20260709 12:25:06.617606 25800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:06.617817 30483 raft_consensus.cc:2749] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:06.619118 30483 consensus_queue.cc:1048] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:25:06.582319 30502 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:06.620600 25831 raft_consensus.cc:1240] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 14. Current term is 15. Ops: [9.4-14.5]
I20260709 12:25:06.620791 25757 raft_consensus.cc:1240] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:06.620150 25726 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:06.622247 30514 raft_consensus.cc:2804] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:06.622555 30502 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:06.622804 30514 raft_consensus.cc:697] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:06.623656 25726 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a
W20260709 12:25:06.624406 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 46357.4us
I20260709 12:25:06.628732 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:06.626629 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:06.629626 25837 raft_consensus.cc:2468] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 10.
I20260709 12:25:06.629827 25835 raft_consensus.cc:2468] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 10.
I20260709 12:25:06.632157 25832 raft_consensus.cc:1240] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:25:06.631425 30511 raft_consensus.cc:2804] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:06.639724 26439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 1170) took 1021 ms. Trace:
I20260709 12:25:06.639515 30514 consensus_queue.cc:237] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:06.640277 25830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 2919) took 1140 ms. Trace:
I20260709 12:25:06.640919 29921 raft_consensus.cc:3055] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:06.641350 29921 raft_consensus.cc:740] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:06.640731 25830 rpcz_store.cc:276] 0709 12:25:05.499872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:05.505663 (+  5791us) service_pool.cc:224] Handling call
0709 12:25:05.535552 (+ 29889us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:06.083202 (+547650us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:06.640033 (+556831us) spinlock_profiling.cc:243] Waited 547 ms on lock 0x7b54001b1554. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:06.640219 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1258032384}
I20260709 12:25:06.640092 26439 rpcz_store.cc:276] 0709 12:25:05.618784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:05.619401 (+   617us) service_pool.cc:224] Handling call
0709 12:25:05.663481 (+ 44080us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:06.055750 (+392269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:06.639492 (+583742us) spinlock_profiling.cc:243] Waited 391 ms on lock 0x7b5400633654. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:06.639668 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":900370688}
I20260709 12:25:06.642338 29921 consensus_queue.cc:260] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:06.678834 25726 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:06.679885 26402 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:06.685214 26402 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:06.633692 30510 raft_consensus.cc:2749] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:06.681213 29921 raft_consensus.cc:3060] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:06.646760 30450 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:06.650950 30252 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.674746 30511 raft_consensus.cc:697] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:06.697602 26402 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:06.629139 30495 consensus_queue.cc:237] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:06.687817 30385 raft_consensus.cc:2749] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:06.675640 30463 consensus_queue.cc:1048] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:25:06.720870 30252 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:06.688817 30442 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:06.728603 25834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44218 (request call id 1777) took 1152 ms. Trace:
I20260709 12:25:06.686654 30481 raft_consensus.cc:2804] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:06.740581 30481 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:06.741083 30481 raft_consensus.cc:3060] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:06.729239 30494 consensus_meta.cc:287] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.608s	user 0.012s	sys 0.000s
I20260709 12:25:06.744789 30494 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:06.747439 30408 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:06.730196 30509 raft_consensus.cc:2804] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:25:06.748725 30479 log.cc:927] Time spent T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.912s	user 0.004s	sys 0.002s
I20260709 12:25:06.748984 30509 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:06.749533 30509 raft_consensus.cc:3060] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:06.747602 30494 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:06.760102 30505 log.cc:927] Time spent T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.256s	user 0.000s	sys 0.002s
W20260709 12:25:06.678982 30393 consensus_queue.cc:1175] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f82778701b464892aab92a752ed7ffdc" responder_term: 9 status { last_received { term: 9 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 9 index: 9 } }
I20260709 12:25:06.684798 30157 consensus_queue.cc:1059] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 12:25:06.731328 26402 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:06.772574 30489 raft_consensus.cc:2749] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:25:06.773231 30496 consensus_meta.cc:287] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.634s	user 0.012s	sys 0.000s
I20260709 12:25:06.773727 30496 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:06.775939 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:06.700166 30450 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:06.776605 25830 raft_consensus.cc:2468] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 12.
I20260709 12:25:06.776818 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:06.777951 30450 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:06.779263 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:06.718430 30066 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:06.780087 25836 raft_consensus.cc:2410] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:25:06.780143 30066 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:06.782245 30066 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:06.783067 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:06.783437 25761 raft_consensus.cc:1240] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:06.783995 30442 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:06.785223 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:06.786119 30442 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:06.787041 25830 raft_consensus.cc:1240] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:06.786799 29802 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:06.788816 29802 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:06.788486 30509 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:06.687558 30267 consensus_queue.cc:1059] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:25:06.739130 30288 consensus_queue.cc:260] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:06.739956 25762 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48606 (request call id 1129) took 1953 ms (client timeout 1721 ms). Trace:
I20260709 12:25:06.733753 25834 rpcz_store.cc:276] 0709 12:25:05.576194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:05.576299 (+   105us) service_pool.cc:224] Handling call
0709 12:25:06.728404 (+1152105us) spinlock_profiling.cc:243] Waited 94.3 ms on lock 0x7b5400117e54. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:06.728535 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":216868224}
W20260709 12:25:06.816453 25762 rpcz_store.cc:269] 0709 12:25:04.786755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:04.810262 (+ 23507us) service_pool.cc:224] Handling call
0709 12:25:06.739683 (+1929421us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b54003a70d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:06.739845 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3055298304}
I20260709 12:25:06.723874 30512 raft_consensus.cc:2749] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:06.823241 26434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 1152) took 1255 ms. Trace:
I20260709 12:25:06.823762 26434 rpcz_store.cc:276] 0709 12:25:05.568176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:05.568453 (+   277us) service_pool.cc:224] Handling call
0709 12:25:05.568719 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:05.814162 (+245443us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:06.822905 (+1008743us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b5400393d54. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:06.823161 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":542746496}
I20260709 12:25:06.828200 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:06.829236 26434 raft_consensus.cc:2368] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 9. Current term is 10.
W20260709 12:25:06.792383 30399 consensus_meta.cc:287] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.617s	user 0.010s	sys 0.004s
I20260709 12:25:06.778890 30511 consensus_queue.cc:237] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:06.835937 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:06.837375 26439 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 12.
I20260709 12:25:06.820019 30496 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:06.842796 30510 raft_consensus.cc:3055] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:06.844475 26402 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:06.790756 30502 consensus_queue.cc:1059] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 12:25:06.831225 30288 raft_consensus.cc:3060] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:06.830264 30489 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.857065 30491 raft_consensus.cc:3055] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:06.863343 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:06.863691 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:06.866856 25762 raft_consensus.cc:2376] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 11. Re-sending same reply.
I20260709 12:25:06.867172 25757 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 13.
I20260709 12:25:06.838089 30385 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:06.868989 25756 raft_consensus.cc:1240] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:06.868328 30499 raft_consensus.cc:2749] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:06.869769 30399 raft_consensus.cc:2804] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:06.870560 26402 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:06.906467 26436 raft_consensus.cc:1240] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:25:06.872927 26401 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:06.873765 30492 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:06.842731 30509 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:06.887581 30252 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:06.887933 30170 raft_consensus.cc:3055] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:06.855026 30510 raft_consensus.cc:740] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:06.866024 30455 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.903003 30400 raft_consensus.cc:3055] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:06.905539 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:25:06.861411 30390 consensus_meta.cc:287] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.584s	user 0.010s	sys 0.002s
I20260709 12:25:06.886783 29810 raft_consensus.cc:3055] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:06.922560 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:06.914758 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:06.900329 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:06.906354 30399 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:06.866468 30491 raft_consensus.cc:740] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:06.918826 26435 raft_consensus.cc:1275] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:25:06.913355 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:06.916781 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:25:06.923986 25801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:06.912722 30502 raft_consensus.cc:2804] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:06.920710 30066 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.924356 29810 raft_consensus.cc:740] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:06.924484 30443 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.929134 30066 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:06.930493 26401 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:06.914758 30402 raft_consensus.cc:2749] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:06.929536 30456 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.868840 30489 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:06.915392 30170 raft_consensus.cc:740] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:06.916633 30266 consensus_queue.cc:1059] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.018s
W20260709 12:25:06.930110 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 251381us
I20260709 12:25:06.920529 30400 raft_consensus.cc:740] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:06.924474 30278 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.908589 30385 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:06.949317 25726 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:06.930365 30502 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:06.959699 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:06.959968 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:06.960533 26430 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 11.
I20260709 12:25:06.961638 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:06.962445 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:06.963215 25829 raft_consensus.cc:3060] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:06.965361 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:06.919960 30442 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.938467 30501 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:06.912532 30512 consensus_queue.cc:1059] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:25:06.928493 30399 raft_consensus.cc:3060] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:06.936857 30509 raft_consensus.cc:2749] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:06.969098 26430 raft_consensus.cc:1275] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:25:06.922969 30455 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:06.925743 30390 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:06.940115 30252 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:06.952064 30451 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:06.970413 30493 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.009s	sys 0.030s
I20260709 12:25:06.993319 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:25:06.998015 30493 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.009s	sys 0.030s
I20260709 12:25:06.998236 25830 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 11.
I20260709 12:25:06.967777 30502 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:07.001422 30213 consensus_queue.cc:260] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:07.003000 30213 raft_consensus.cc:3060] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:07.021376 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:07.020450 30502 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:07.029466 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:07.030668 30502 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:25:07.037925 30515 log.cc:927] Time spent T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:25:07.038440 30066 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:07.038959 30519 log.cc:927] Time spent T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:25:06.996692 30496 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:07.040673 30516 log.cc:927] Time spent T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:25:07.040483 30496 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:07.043040 30496 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:06.941913 30456 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:07.048445 25829 raft_consensus.cc:2468] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 10.
I20260709 12:25:07.053330 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:06.933197 30443 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:06.969209 30157 raft_consensus.cc:2804] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:07.061779 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:07.063804 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:07.066737 26438 raft_consensus.cc:1240] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 17. Current term is 18. Ops: [14.14-17.15]
I20260709 12:25:07.071831 25684 raft_consensus.cc:2393] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 12: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:06.953789 30514 consensus_queue.cc:1059] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:25:07.075690 30378 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:07.094007 30378 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:06.973351 30510 consensus_queue.cc:260] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:07.096167 30378 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:07.088676 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:07.090312 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:07.097796 30266 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:07.098021 25755 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 15.
I20260709 12:25:07.091804 30514 raft_consensus.cc:3055] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:07.098403 30266 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:07.099064 30514 raft_consensus.cc:740] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:07.100162 30514 consensus_queue.cc:260] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:07.100881 30266 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:07.068915 29802 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.088725 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:07.101930 25686 raft_consensus.cc:2468] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 10.
I20260709 12:25:07.101761 29802 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:07.088621 30111 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.992141 30491 consensus_queue.cc:260] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:07.103035 30111 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:07.103344 30491 raft_consensus.cc:3060] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:07.096223 30510 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:07.107337 30111 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:07.101603 30514 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:07.066694 30473 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.107267 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:07.113934 25680 raft_consensus.cc:2368] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 9. Current term is 10.
I20260709 12:25:07.091653 30502 consensus_queue.cc:1059] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:06.971179 30481 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:06.971342 30442 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:07.057387 30066 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.967705 30278 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:07.069850 30157 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:07.119745 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:07.143393 25650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.044009 30451 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:07.153282 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:07.151295 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:25:07.147100 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 152726us
I20260709 12:25:07.154284 26430 raft_consensus.cc:2468] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 11.
I20260709 12:25:07.155236 25726 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
W20260709 12:25:07.163009 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.163954 25762 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 13.
I20260709 12:25:07.172634 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:07.044068 30170 consensus_queue.cc:260] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 14.5, Last appended by leader: 5, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:07.174309 30521 log.cc:927] Time spent T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
I20260709 12:25:07.174384 30170 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:07.145610 30378 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:07.175462 30481 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:07.175370 30378 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:07.176059 30492 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:07.156173 30450 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:07.176376 25686 raft_consensus.cc:1240] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 15 LEADER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:07.177150 30511 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:07.199014 30450 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:07.201104 30450 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:07.206941 30511 raft_consensus.cc:2749] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:07.208019 30294 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.152917 30066 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:07.208549 30294 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:07.210443 30066 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:07.145427 30111 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:07.211212 30111 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:07.213235 30111 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:07.214819 30378 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:07.177825 30456 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:07.180051 25726 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:07.218822 25761 raft_consensus.cc:1275] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 14 index: 5. Preceding OpId from leader: term: 15 index: 6. (index mismatch)
I20260709 12:25:07.124243 30473 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:07.220324 25726 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:07.221904 25726 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:07.222220 30473 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:07.222615 30170 raft_consensus.cc:2749] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:07.222822 25726 leader_election.cc:400] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Vote denied by peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611) with higher term. Message: Invalid argument: T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 9. Current term is 10.
I20260709 12:25:07.223145 25726 leader_election.cc:403] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:07.180160 30522 consensus_queue.cc:1048] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:07.223366 30170 raft_consensus.cc:2749] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:07.181407 30278 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:07.183420 30451 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:07.188021 25757 raft_consensus.cc:1240] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:07.043471 30252 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:07.123880 30400 consensus_queue.cc:260] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:07.226814 30400 raft_consensus.cc:3060] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:07.226987 30252 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:07.228195 30492 raft_consensus.cc:2804] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:07.229010 30492 raft_consensus.cc:697] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 11 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:07.230077 30492 consensus_queue.cc:237] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:07.189626 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:07.191113 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
W20260709 12:25:07.231977 30512 consensus_queue.cc:1175] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6e673265293d4e9a937dc45150aeb1b8" responder_term: 11 status { last_received { term: 11 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 11 index: 10 } }
I20260709 12:25:07.189684 25680 raft_consensus.cc:1240] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:25:07.103816 29802 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:07.107309 30528 consensus_queue.cc:1048] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.086s
I20260709 12:25:07.233301 29810 consensus_queue.cc:260] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:07.234724 29810 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:07.154398 30157 raft_consensus.cc:3060] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:07.238639 25726 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:07.156664 30366 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.240459 30518 raft_consensus.cc:2804] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:07.240224 30366 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:07.241019 30518 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:07.241496 30518 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:07.197053 30442 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:07.197880 30455 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:07.217494 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
W20260709 12:25:07.246351 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.181418 30443 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:07.228334 30170 raft_consensus.cc:2749] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611) with higher term. Message: Invalid argument: T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 9. Current term is 10.
I20260709 12:25:07.247543 30511 consensus_queue.cc:1048] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:07.185859 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:07.249027 26437 raft_consensus.cc:2393] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 9: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:07.249521 30266 raft_consensus.cc:3055] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:07.228274 29921 raft_consensus.cc:3055] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:07.249915 30266 raft_consensus.cc:740] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:07.250190 29921 raft_consensus.cc:740] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:07.250844 30266 consensus_queue.cc:260] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:07.251281 29921 consensus_queue.cc:260] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:07.252624 29921 raft_consensus.cc:3060] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:07.256505 26401 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:25:07.259272 25726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.259615 30366 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:07.259323 30502 raft_consensus.cc:2804] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:07.260493 30502 raft_consensus.cc:697] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 13 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
W20260709 12:25:07.262471 25726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.246470 25681 raft_consensus.cc:2468] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 10.
W20260709 12:25:07.195545 30524 log.cc:927] Time spent T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:25:07.264952 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:07.267670 26430 raft_consensus.cc:2468] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 12.
I20260709 12:25:07.272776 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:07.274511 30518 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:07.274575 30366 consensus_queue.cc:1059] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:25:07.275837 30366 raft_consensus.cc:3055] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:25:07.276314 30366 raft_consensus.cc:740] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:07.277045 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:07.277288 30366 consensus_queue.cc:260] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:07.278851 30366 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:07.261361 30502 consensus_queue.cc:237] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:07.285375 25726 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:07.286125 26438 raft_consensus.cc:1275] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:25:07.210443 30294 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:07.288511 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:07.289186 26437 raft_consensus.cc:3060] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:07.290560 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:07.290863 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:07.291096 25726 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:07.291471 25762 raft_consensus.cc:2468] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 11.
I20260709 12:25:07.287787 30489 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:07.293174 26401 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:07.294592 30489 raft_consensus.cc:2804] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:07.294975 30489 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:07.295312 30489 raft_consensus.cc:3060] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:07.292182 30443 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:07.296456 30443 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:07.297820 30390 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:07.298486 30443 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:07.301347 30501 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:07.303633 30385 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:07.304940 30266 raft_consensus.cc:3060] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:07.305385 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:07.305338 30507 raft_consensus.cc:3055] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:07.306289 30507 raft_consensus.cc:740] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:07.307147 30507 consensus_queue.cc:260] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:07.308141 30507 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:07.318228 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 272993us
I20260709 12:25:07.322822 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:07.325012 25759 raft_consensus.cc:1240] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 11. Current term is 12. Ops: [9.7-11.8]
I20260709 12:25:07.332057 26437 raft_consensus.cc:2468] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 13.
I20260709 12:25:07.336779 25833 raft_consensus.cc:1275] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 15 index: 6. (index mismatch)
I20260709 12:25:07.336308 25681 raft_consensus.cc:1275] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:25:07.341449 25685 raft_consensus.cc:1240] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:07.343257 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:07.345073 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:07.345561 25726 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:07.310560 30294 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.348613 25726 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:07.348979 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:07.351122 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:07.443096 26435 raft_consensus.cc:2468] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 12.
I20260709 12:25:07.445536 25834 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 15.
W20260709 12:25:07.446904 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 294748us
I20260709 12:25:07.446586 25649 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:25:07.445544 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 97031.2us
I20260709 12:25:07.447808 25650 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:07.402303 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
W20260709 12:25:07.405412 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.424997 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:07.316277 30492 raft_consensus.cc:2749] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:07.343784 25833 raft_consensus.cc:2468] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 9.
W20260709 12:25:07.425920 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.434650 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:07.449993 25681 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 10.
I20260709 12:25:07.351588 30481 raft_consensus.cc:2749] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:07.349941 29802 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.359983 30066 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:07.332973 30491 raft_consensus.cc:2749] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:07.438665 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:07.440925 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:07.441735 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:07.455502 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:07.455777 25761 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 15.
I20260709 12:25:07.456053 25680 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 15.
I20260709 12:25:07.456362 25762 raft_consensus.cc:2410] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:25:07.449182 25726 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:07.451217 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
W20260709 12:25:07.452636 25800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.453503 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:07.457080 25686 raft_consensus.cc:3060] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:07.457273 25800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.340804 30408 consensus_queue.cc:1048] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.097s
I20260709 12:25:07.458071 25726 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:07.458693 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:07.459378 25832 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 15.
I20260709 12:25:07.460328 25828 raft_consensus.cc:1240] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:07.460644 25831 raft_consensus.cc:1275] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 12:25:07.460994 25831 pending_rounds.cc:85] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a: Aborting all ops after (but not including) 8
I20260709 12:25:07.461217 25831 pending_rounds.cc:107] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:25:07.461436 25831 raft_consensus.cc:2889] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:07.462103 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:07.469602 25726 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:07.462760 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:07.451115 30356 raft_consensus.cc:2804] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:25:07.518693 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 49212.6us
I20260709 12:25:07.519670 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:07.519886 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:07.487252 30496 raft_consensus.cc:2804] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:07.518759 30538 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:07.530809 30538 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:07.520651 30443 consensus_queue.cc:1059] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 12:25:07.461436 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:07.523051 30111 raft_consensus.cc:2804] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:07.523761 30378 raft_consensus.cc:2804] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:07.463377 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:07.525508 30007 consensus_queue.cc:1048] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:07.526640 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:07.521268 25800 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:07.534549 25832 raft_consensus.cc:2393] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 14: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
W20260709 12:25:07.520519 30539 log.cc:927] Time spent T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 12:25:07.487396 30499 raft_consensus.cc:2804] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:07.535861 30499 raft_consensus.cc:697] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:07.521550 30481 raft_consensus.cc:2804] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:07.536455 30496 raft_consensus.cc:697] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:07.537266 30481 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:07.537640 30481 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:07.537976 30496 consensus_queue.cc:237] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:07.549136 25582 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41224 (request call id 335) took 28952 ms (client timeout 15000 ms). Trace:
I20260709 12:25:07.538920 30455 raft_consensus.cc:2804] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:07.541973 30499 consensus_queue.cc:237] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:07.549981 25836 raft_consensus.cc:1275] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 12:25:07.549870 30455 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:07.550534 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:07.551399 30455 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:07.551569 25762 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 13.
I20260709 12:25:07.532176 25833 raft_consensus.cc:3060] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:07.557315 25800 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:07.545600 30408 consensus_queue.cc:1048] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:07.519445 25584 catalog_manager.cc:5697] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 10 to 13, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 13 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:07.543802 26402 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:07.570216 26402 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:07.570137 25584 catalog_manager.cc:5697] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:25:07.571319 26402 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:07.532522 25829 raft_consensus.cc:2410] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:25:07.572079 30502 raft_consensus.cc:2749] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:25:07.521353 30540 log.cc:927] Time spent T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:25:07.531934 30443 raft_consensus.cc:3055] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:07.532938 30538 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:07.533206 30111 raft_consensus.cc:697] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 12 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:07.533465 30378 raft_consensus.cc:697] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 10 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:07.462875 29802 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:07.572757 30502 raft_consensus.cc:2749] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:25:07.571491 25584 catalog_manager.cc:5697] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: config changed from index 6 to 8, term changed from 6 to 8, VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129) evicted. New cstate: current_term: 8 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:25:07.602815 25829 raft_consensus.cc:1275] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:25:07.586191 25801 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.042s	sys 0.091s
I20260709 12:25:07.611243 25686 raft_consensus.cc:2468] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 11.
I20260709 12:25:07.618852 25834 raft_consensus.cc:3060] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:07.620236 25833 raft_consensus.cc:2468] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 13.
W20260709 12:25:07.697930 25801 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.047s	sys 0.102s
W20260709 12:25:07.700133 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 700892us
W20260709 12:25:07.628403 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.706211 26435 raft_consensus.cc:1275] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:25:07.708020 25801 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:07.462335 30518 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:07.586010 30399 consensus_meta.cc:287] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.596s	user 0.008s	sys 0.000s
I20260709 12:25:07.712406 30511 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.584666 30267 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:07.620452 30170 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:07.586283 30356 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:07.723611 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 261822us
I20260709 12:25:07.723075 25584 catalog_manager.cc:5697] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:25:07.705719 30385 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:07.574767 29921 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.573884 30535 raft_consensus.cc:2804] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:07.619850 30443 raft_consensus.cc:740] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:07.659067 30529 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.455338 30473 consensus_queue.cc:1048] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.263s
W20260709 12:25:07.728801 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 281050us
I20260709 12:25:07.733587 25834 raft_consensus.cc:2468] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 11.
W20260709 12:25:07.748013 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.751123 25649 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:07.750938 25584 catalog_manager.cc:5697] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: config changed from index 3 to 8, term changed from 9 to 10, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER f82778701b464892aab92a752ed7ffdc (127.23.245.129), VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130), VOTER 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131), VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 10 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:07.720156 30526 raft_consensus.cc:2764] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:25:07.670220 30514 consensus_queue.cc:1048] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 12:25:07.456574 30294 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:07.463521 30066 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:07.585158 30157 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:07.769063 25650 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:07.620139 30481 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:07.770268 25584 catalog_manager.cc:5697] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:25:07.721524 30495 consensus_queue.cc:1048] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 12:25:07.722987 30456 consensus_queue.cc:1059] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:25:07.751250 30356 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:07.772869 29810 consensus_meta.cc:287] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.538s	user 0.010s	sys 0.001s
I20260709 12:25:07.729162 30511 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:07.774755 30213 consensus_meta.cc:287] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.771s	user 0.012s	sys 0.002s
I20260709 12:25:07.751250 30278 consensus_queue.cc:1059] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:25:07.787389 30511 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:07.788872 30544 raft_consensus.cc:2804] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:07.789300 30544 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:07.789644 30544 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:25:07.790444 30366 consensus_meta.cc:287] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.511s	user 0.013s	sys 0.000s
I20260709 12:25:07.792315 30473 raft_consensus.cc:2804] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:07.792227 30455 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:07.792788 30473 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:07.793149 30473 raft_consensus.cc:3060] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:07.794649 30455 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:07.804541 30111 consensus_queue.cc:237] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:07.761698 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 49052.2us
I20260709 12:25:07.727684 30399 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:07.764120 30385 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:07.781157 25584 catalog_manager.cc:5697] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 12 to 13, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 13 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } }
I20260709 12:25:07.727118 30528 consensus_queue.cc:1048] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 12:25:07.795514 30278 raft_consensus.cc:3055] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:25:07.806936 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 57292.3us
I20260709 12:25:07.808912 26435 raft_consensus.cc:1275] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:25:07.814291 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:07.810477 25726 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:07.815099 25684 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 13.
I20260709 12:25:07.820935 25584 catalog_manager.cc:5697] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:25:07.823660 25801 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:07.751076 30170 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:07.846355 25833 raft_consensus.cc:2468] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 13.
I20260709 12:25:07.848871 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:07.762236 29921 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:07.845587 25584 catalog_manager.cc:5697] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:25:07.853999 26430 raft_consensus.cc:1240] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:25:07.853760 25584 catalog_manager.cc:5697] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 10 to 11, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 11 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:25:07.773873 30450 consensus_queue.cc:1059] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 12:25:07.812114 30512 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:07.773654 30529 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:07.894761 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 84388.3us
I20260709 12:25:07.883472 25762 raft_consensus.cc:2393] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 16: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
W20260709 12:25:07.929872 25726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.855611 25584 catalog_manager.cc:5697] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 9 to 12, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 12 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:07.924249 30534 consensus_queue.cc:1048] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:25:07.905418 29810 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:07.895730 30066 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:25:07.853399 30532 log.cc:927] Time spent T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 12:25:07.896088 30538 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.847347 30514 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:07.822889 30278 raft_consensus.cc:740] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:07.931684 25584 catalog_manager.cc:5697] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 9 to 12, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 12 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:07.896490 30542 log.cc:927] Time spent T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
W20260709 12:25:07.897462 30489 consensus_meta.cc:287] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.602s	user 0.009s	sys 0.000s
I20260709 12:25:07.823179 30518 consensus_queue.cc:1048] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.122s
I20260709 12:25:07.768658 30378 consensus_queue.cc:237] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:07.895855 30511 raft_consensus.cc:2804] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:07.852525 30456 raft_consensus.cc:2749] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:07.905494 30548 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:07.953016 30538 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:07.852260 30366 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:07.963683 25584 catalog_manager.cc:5697] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 6 to 9, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 9 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
W20260709 12:25:07.926255 30507 consensus_meta.cc:287] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.597s	user 0.010s	sys 0.000s
I20260709 12:25:07.935731 30481 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:07.549703 25582 rpcz_store.cc:269] 0709 12:24:38.596809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.597078 (+   269us) service_pool.cc:224] Handling call
0709 12:25:07.518373 (+28921295us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:56.779495 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:56.780684 (+  1189us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:56.780736 (+    52us) write_op.cc:435] Acquired schema lock
0709 12:24:56.780758 (+    22us) tablet.cc:662] Decoding operations
0709 12:24:56.887365 (+106607us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:56.887443 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:56.887467 (+    24us) tablet.cc:685] Acquiring locks for 12 operations
0709 12:24:56.888517 (+  1050us) tablet.cc:701] Row locks acquired
0709 12:24:56.888558 (+    41us) write_op.cc:260] PREPARE: finished
0709 12:24:56.888713 (+   155us) write_op.cc:270] Start()
0709 12:24:56.888842 (+   129us) write_op.cc:276] Timestamp: P: 1783599896888653 usec, L: 0
0709 12:24:56.888858 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 12:24:56.949434 (+ 60576us) log.cc:844] Serialized 4806 byte log entry
0709 12:24:57.868456 (+919022us) op_driver.cc:464] REPLICATION: finished
0709 12:24:58.431518 (+563062us) spinlock_profiling.cc:243] Waited 1.27 ms on lock 0x7b4400022b4c. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db 00007f5d99708aaf 00007f5d96a570ac 00007f5d9f8b19a9 00007f5d96a7369b 00007f5d96a7193f 00007f5d96a73c02 00007f5d9d597ef0
0709 12:24:58.764191 (+332673us) write_op.cc:301] APPLY: starting
0709 12:24:58.776545 (+ 12354us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:58.989858 (+213313us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:58.989932 (+    74us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:59.468399 (+478467us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:59.468815 (+   416us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 12:24:59.468869 (+    54us) write_op.cc:312] APPLY: finished
0709 12:24:59.469468 (+   599us) log.cc:844] Serialized 113 byte log entry
0709 12:24:59.687397 (+217929us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:59.755265 (+ 67868us) write_op.cc:454] Released schema lock
0709 12:24:59.762759 (+  7494us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:59.824196 (+ 61437us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:59.824240 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":42690,"reported_tablets":45,"spinlock_wait_cycles":6912,"child_traces":[["op",{"apply.queue_time_us":874307,"apply.run_cpu_time_us":54051,"apply.run_wall_time_us":1032129,"cfile_cache_hit":46,"cfile_cache_hit_bytes":48070,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6217,"cfile_init":2,"lbm_read_time_us":7176,"lbm_reads_1-10_ms":2,"lbm_reads_lt_1ms":10,"num_ops":12,"prepare.queue_time_us":334325,"prepare.run_cpu_time_us":41638,"prepare.run_wall_time_us":343997,"raft.queue_time_us":235541,"raft.run_cpu_time_us":27864,"raft.run_wall_time_us":846752,"replication_time_us":973734,"spinlock_wait_cycles":4208768,"thread_start_us":1544896,"threads_started":5,"wal-append.queue_time_us":620079,"wal-append.run_cpu_time_us":20426,"wal-append.run_wall_time_us":2651187}]]}
W20260709 12:25:07.972862 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 191716us
I20260709 12:25:07.996364 25650 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:07.992858 25584 catalog_manager.cc:5697] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 7 to 9, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 9 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } }
I20260709 12:25:07.895870 30356 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:07.936378 30512 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:08.003589 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:08.004751 25835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44218 (request call id 1788) took 1043 ms. Trace:
I20260709 12:25:08.003942 25584 catalog_manager.cc:5697] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 9 to 11, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 11 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } }
I20260709 12:25:08.005790 25835 rpcz_store.cc:276] 0709 12:25:06.961054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:06.964061 (+  3007us) service_pool.cc:224] Handling call
0709 12:25:06.964470 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:07.017749 (+ 53279us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:07.017974 (+   225us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:07.019039 (+  1065us) log.cc:844] Serialized 26 byte log entry
0709 12:25:07.448563 (+429524us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:07.450372 (+  1809us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:07.450436 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:08.004525 (+554089us) raft_consensus.cc:1685] finished
0709 12:25:08.004547 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:08.004691 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":142306,"raft.run_cpu_time_us":60,"raft.run_wall_time_us":60,"thread_start_us":481625,"threads_started":2,"wal-append.queue_time_us":686236}
I20260709 12:25:07.940814 29810 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:08.007310 25584 catalog_manager.cc:5697] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:25:07.937574 30492 consensus_queue.cc:1048] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 12:25:07.976326 30450 raft_consensus.cc:3055] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:08.010739 25584 catalog_manager.cc:5697] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 6 to 8, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 8 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:25:07.969846 30514 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:07.993355 30511 raft_consensus.cc:697] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:08.015229 25584 catalog_manager.cc:5697] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 8 to 9, leader changed from a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 9 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:08.019332 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 170360us
W20260709 12:25:08.008561 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 257491us
I20260709 12:25:07.975170 30489 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:08.023514 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:08.018006 25800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.995767 29802 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:08.024226 25759 raft_consensus.cc:2468] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 11.
I20260709 12:25:08.029866 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:08.026309 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:08.031225 25756 raft_consensus.cc:2468] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 14.
I20260709 12:25:08.026584 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:08.020139 25584 catalog_manager.cc:5697] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:08.036614 25835 raft_consensus.cc:1275] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:25:08.028578 25801 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:08.024840 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:08.038141 25761 raft_consensus.cc:2468] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 11.
I20260709 12:25:08.038426 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:08.011479 30450 raft_consensus.cc:740] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:08.036612 25800 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:08.041414 25757 raft_consensus.cc:2393] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 11: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
W20260709 12:25:08.037387 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 103733us
I20260709 12:25:08.041602 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:07.995062 30548 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:08.002405 30366 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:08.068291 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:08.047672 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:08.049093 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:08.076460 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:08.075984 25726 leader_election.cc:400] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Vote denied by peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) with higher term. Message: Invalid argument: T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 9. Current term is 10.
I20260709 12:25:08.056159 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:08.078706 25757 raft_consensus.cc:2368] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for earlier term 11. Current term is 12.
I20260709 12:25:08.048780 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:08.046299 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:08.073387 26430 raft_consensus.cc:2410] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:25:08.055619 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:08.034950 25584 catalog_manager.cc:5697] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 7 to 8, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 8 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:25:08.089684 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:08.079450 26434 raft_consensus.cc:2468] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 11.
I20260709 12:25:08.081489 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:08.036442 30266 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.096899 26433 raft_consensus.cc:1240] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:25:08.097095 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:08.092440 25832 raft_consensus.cc:2393] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 11: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:08.092005 25584 catalog_manager.cc:5697] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:25:08.092803 26431 raft_consensus.cc:2410] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:25:08.086688 25829 raft_consensus.cc:2393] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 16: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
W20260709 12:25:08.079869 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 83582.5us
I20260709 12:25:08.125171 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:08.126748 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:08.124351 25584 catalog_manager.cc:5697] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } }
I20260709 12:25:08.127561 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:08.128290 25686 raft_consensus.cc:2393] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 11: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:08.127782 25584 catalog_manager.cc:5697] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 5 to 9, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 9 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } }
I20260709 12:25:08.128793 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:08.129496 25679 raft_consensus.cc:2393] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 13: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:08.130491 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:08.131356 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:08.134320 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:08.101373 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:08.098416 30549 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.115398 30535 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:08.116783 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:08.079713 30481 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:08.144002 30481 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:08.074832 30543 consensus_queue.cc:1048] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 12:25:08.146027 30481 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:08.146579 30463 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:08.147326 30267 raft_consensus.cc:2749] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:08.147126 30463 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:08.096659 30499 consensus_queue.cc:1059] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 12:25:08.149230 30499 raft_consensus.cc:3055] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:08.149670 30499 raft_consensus.cc:740] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:08.150048 30548 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:08.132434 30400 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.150493 30499 consensus_queue.cc:260] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:08.151044 30400 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:08.121652 30170 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:08.136678 30450 consensus_queue.cc:260] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:08.153069 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:08.163007 25680 raft_consensus.cc:3060] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:08.043982 29802 raft_consensus.cc:2804] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:08.080546 25801 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:08.080456 25726 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:08.044260 30455 raft_consensus.cc:2749] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:08.011911 30278 consensus_queue.cc:260] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:08.071295 30294 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:08.070331 30526 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.070150 30456 raft_consensus.cc:2804] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:08.121415 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:08.074324 30157 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:08.135465 26430 raft_consensus.cc:2468] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 8.
I20260709 12:25:08.129230 25584 catalog_manager.cc:5697] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 12 to 14, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 14 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:08.139671 26436 raft_consensus.cc:2468] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 11.
I20260709 12:25:08.141917 30007 consensus_queue.cc:1048] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:25:08.143142 30554 log.cc:927] Time spent T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:25:08.118494 30266 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:08.168054 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:08.223176 29802 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:08.152541 30535 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:08.152391 30511 consensus_queue.cc:237] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:08.152793 30529 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:08.168062 30385 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:08.151880 30499 raft_consensus.cc:3060] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:08.172713 30544 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:08.174683 30545 log.cc:927] Time spent T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.232s	user 0.000s	sys 0.001s
I20260709 12:25:08.174094 30443 consensus_queue.cc:260] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:08.287495 30443 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:08.254308 29802 raft_consensus.cc:3060] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:08.180943 30356 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:08.181641 25680 raft_consensus.cc:2468] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 12.
I20260709 12:25:08.293958 25683 raft_consensus.cc:1275] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 12:25:08.183475 30366 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:08.161321 30549 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:08.185283 30399 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:08.295264 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:08.296214 25679 raft_consensus.cc:1275] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:25:08.186777 30514 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:08.187847 30538 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:08.189955 30451 consensus_queue.cc:1048] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:08.307384 30266 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:08.214512 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 134182us
W20260709 12:25:08.221694 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 142168us
I20260709 12:25:08.312364 25801 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:08.312677 30507 consensus_queue.cc:1048] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:08.313470 25801 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:08.314775 25801 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:08.315420 30528 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:08.316409 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:08.317067 25832 raft_consensus.cc:3060] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:08.140237 30111 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.316293 30529 raft_consensus.cc:2804] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:08.320470 30529 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:08.320199 30111 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:08.320878 30529 raft_consensus.cc:3060] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:08.322263 30111 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:08.236547 25762 raft_consensus.cc:2393] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 14: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
W20260709 12:25:08.238178 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 103502us
I20260709 12:25:08.324209 25650 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:08.324573 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:08.325150 25837 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:08.325714 25650 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:08.328088 30007 raft_consensus.cc:2804] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:08.328246 30252 raft_consensus.cc:3060] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:08.328511 30007 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:08.328910 30400 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:08.332228 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:08.332830 25833 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 13.
I20260709 12:25:08.328976 30007 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:08.333745 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:08.149200 30463 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:08.335572 30463 raft_consensus.cc:2764] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 12:25:08.336483 25650 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:08.336784 25831 raft_consensus.cc:1275] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:08.337275 30566 raft_consensus.cc:2804] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:08.337833 30566 raft_consensus.cc:697] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 14 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:08.152204 30393 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.338802 30393 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:08.339895 30544 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:08.340605 30544 consensus_queue.cc:1048] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:08.340888 30543 consensus_queue.cc:1059] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:08.340929 30393 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:08.230720 30278 raft_consensus.cc:3060] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:08.246541 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:08.344273 25754 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 18.
I20260709 12:25:08.327745 30568 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:08.344982 30568 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:08.246634 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:08.226064 30495 raft_consensus.cc:2804] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:08.225302 30558 raft_consensus.cc:2749] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:08.248101 25760 raft_consensus.cc:1240] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 11. Current term is 12. Ops: [9.7-11.8]
I20260709 12:25:08.347994 30495 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:08.271477 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:08.348449 30495 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:08.349113 25800 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
W20260709 12:25:08.272550 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:08.235739 30456 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:08.349876 30558 raft_consensus.cc:2804] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:08.289739 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:08.350322 30558 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:08.179227 30489 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:08.350687 30558 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:08.291016 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:08.351368 25829 raft_consensus.cc:2468] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 12.
I20260709 12:25:08.289781 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:08.290834 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:08.351853 29810 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349)
I20260709 12:25:08.185436 30512 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:08.297513 25683 raft_consensus.cc:2393] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 16: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:08.298069 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:08.353539 25686 raft_consensus.cc:2468] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 14.
I20260709 12:25:08.291522 30385 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.347995 25761 raft_consensus.cc:2468] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 14.
I20260709 12:25:08.301673 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:08.290737 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:08.299715 25755 raft_consensus.cc:1240] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:25:08.355463 25681 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:08.338732 30566 consensus_queue.cc:237] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:08.360235 25762 raft_consensus.cc:1275] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:25:08.239017 30526 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:08.390336 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:08.393419 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:08.393730 25681 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 14.
I20260709 12:25:08.367251 25837 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 12.
I20260709 12:25:08.349962 30456 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:08.354393 30385 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:08.368340 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:08.368709 26431 raft_consensus.cc:1275] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:08.398420 26436 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 11.
I20260709 12:25:08.368364 30563 raft_consensus.cc:3055] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:08.370923 29921 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:08.373128 30514 consensus_queue.cc:1048] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:08.375412 25726 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:08.376817 25758 raft_consensus.cc:1240] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:08.377369 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:08.378969 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:08.379633 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:08.384136 30549 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:08.384387 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:08.385114 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:08.385818 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:08.386436 30450 raft_consensus.cc:3060] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:08.388291 25836 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:25:08.433043 25836 raft_consensus.cc:606] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Received request to transfer leadership to TS 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:08.433537 25836 raft_consensus.cc:614] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:08.388550 25801 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:08.389106 25832 raft_consensus.cc:2468] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 11.
I20260709 12:25:08.394032 26434 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:08.401466 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:08.437234 26431 raft_consensus.cc:2468] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 11.
I20260709 12:25:08.399405 25650 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:08.364368 25800 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:08.431596 26438 raft_consensus.cc:2468] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 10.
I20260709 12:25:08.431704 25755 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 10.
I20260709 12:25:08.431838 25754 raft_consensus.cc:3060] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:08.422494 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:08.432441 26430 raft_consensus.cc:2393] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 18: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:08.406365 25649 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:08.456566 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:25:08.456470 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 68001.6us
W20260709 12:25:08.457711 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 58370.8us
I20260709 12:25:08.441865 25835 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 11.
I20260709 12:25:08.457348 26436 raft_consensus.cc:2468] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 10.
I20260709 12:25:08.460873 25726 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:08.470530 25726 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:08.470810 25650 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:08.441076 29810 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:08.463881 26401 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:25:08.464570 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 100273us
I20260709 12:25:08.464779 25801 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:08.429976 30518 raft_consensus.cc:2749] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:08.341672 30007 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:08.392627 30543 consensus_queue.cc:1048] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.068s
I20260709 12:25:08.400535 30563 raft_consensus.cc:740] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:08.475029 26436 raft_consensus.cc:1275] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:25:08.476989 25726 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
W20260709 12:25:08.463431 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 57129.5us
I20260709 12:25:08.459717 30111 raft_consensus.cc:2804] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:08.481050 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:08.490073 25649 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:08.481702 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:08.482225 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:08.466925 30451 raft_consensus.cc:2804] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:08.482924 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:08.499048 26402 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:08.499329 25834 raft_consensus.cc:2393] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 11: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:08.483623 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:08.484572 25833 raft_consensus.cc:1240] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:25:08.463264 30549 raft_consensus.cc:2804] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:08.487259 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:25:08.468998 30473 consensus_meta.cc:287] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.674s	user 0.007s	sys 0.007s
I20260709 12:25:08.491693 25801 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:08.491952 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:08.485158 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:08.500408 25835 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 11.
I20260709 12:25:08.502069 25832 raft_consensus.cc:2393] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 10: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:08.482339 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:08.502588 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:08.503343 25835 raft_consensus.cc:2393] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 16: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:08.503255 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:08.504051 25837 raft_consensus.cc:2468] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 10.
I20260709 12:25:08.500744 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:08.502976 25829 raft_consensus.cc:2368] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for earlier term 11. Current term is 12.
I20260709 12:25:08.506457 25649 leader_election.cc:400] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Vote denied by peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267) with higher term. Message: Invalid argument: T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for earlier term 11. Current term is 12.
I20260709 12:25:08.506799 25649 leader_election.cc:403] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:08.506887 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:08.508221 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:08.509032 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:08.475414 30531 raft_consensus.cc:2804] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:08.509619 25679 raft_consensus.cc:2468] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 9.
I20260709 12:25:08.513222 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:08.513396 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:08.499172 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:08.501313 26402 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:08.520654 26430 raft_consensus.cc:2410] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:25:08.463325 30157 consensus_queue.cc:1048] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:25:08.475112 30492 raft_consensus.cc:2804] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:08.519738 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:08.516583 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:08.534514 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:25:08.550774 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 44445.7us
I20260709 12:25:08.490793 30534 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.471599 30512 consensus_queue.cc:1059] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 12:25:08.497012 30463 raft_consensus.cc:2749] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:08.505116 30451 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:08.521724 25650 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:08.522792 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:08.524240 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:25:08.564603 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 63085.7us
I20260709 12:25:08.561657 25680 raft_consensus.cc:1240] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:08.573302 25683 raft_consensus.cc:2468] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 10.
I20260709 12:25:08.561461 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:08.566061 30213 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Advancing to term 12
W20260709 12:25:08.566663 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 75052.4us
I20260709 12:25:08.467689 30442 consensus_queue.cc:1059] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 12:25:08.575162 25801 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:08.491470 30111 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:08.496111 30496 raft_consensus.cc:2804] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:08.521281 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:08.474098 30366 consensus_queue.cc:1048] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 12:25:08.509585 30561 raft_consensus.cc:2804] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:08.501855 30549 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:08.603480 26402 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:08.574225 25828 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 19.
I20260709 12:25:08.521370 26436 raft_consensus.cc:2468] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 10.
I20260709 12:25:08.510042 30294 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:08.604372 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 114127us
I20260709 12:25:08.605964 25726 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:08.491216 29810 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:08.584108 30569 log.cc:927] Time spent T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 12:25:08.586947 30356 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.578104 30451 raft_consensus.cc:3060] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:08.555554 30537 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.504906 30567 raft_consensus.cc:2749] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:08.555600 30551 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.575981 30534 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:08.587637 29802 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:08.527891 30531 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:08.665886 29810 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:08.602175 30563 consensus_queue.cc:260] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:08.600349 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 81655.9us
I20260709 12:25:08.561820 30267 raft_consensus.cc:3060] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:08.555931 30552 raft_consensus.cc:2749] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:08.526094 30568 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:08.643460 30512 raft_consensus.cc:2804] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:08.672871 30512 raft_consensus.cc:697] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 12 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:08.673775 30512 consensus_queue.cc:237] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.9, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:08.609163 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:08.666138 30531 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:08.677464 30582 raft_consensus.cc:3055] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:08.678000 30582 raft_consensus.cc:740] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:08.680032 30526 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:08.680465 25682 raft_consensus.cc:1240] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:25:08.652961 30537 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:08.562433 30455 raft_consensus.cc:2749] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:08.555896 30518 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:08.681833 30518 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:08.683235 30537 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:08.665934 29802 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:08.653359 30551 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:08.689829 30551 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:08.690201 30502 raft_consensus.cc:3055] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:08.694485 25685 raft_consensus.cc:1240] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 11. Current term is 13. Ops: []
I20260709 12:25:08.619947 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:08.620645 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:08.621271 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:08.614238 26402 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:25:08.581132 25754 raft_consensus.cc:2468] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 12.
I20260709 12:25:08.626555 30589 consensus_queue.cc:1059] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:08.633344 30590 consensus_queue.cc:1048] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:08.634658 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:08.696772 26434 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 12.
I20260709 12:25:08.557865 30571 raft_consensus.cc:2749] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:08.558274 30492 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
W20260709 12:25:08.635778 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 124744us
W20260709 12:25:08.703398 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 128336us
I20260709 12:25:08.705109 25801 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:08.555861 30514 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:08.516316 30473 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:08.600310 30111 raft_consensus.cc:3060] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:08.519052 29921 raft_consensus.cc:2804] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:08.600812 30496 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:08.648488 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:08.608290 30549 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:08.609211 30378 raft_consensus.cc:2749] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:08.667901 30528 raft_consensus.cc:2749] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:08.608369 30561 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:08.654875 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:08.600859 30558 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:08.648111 30356 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:08.613219 30507 consensus_queue.cc:1048] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 12:25:08.646656 30535 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:08.659111 30534 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:08.659786 30489 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:08.760593 25836 raft_consensus.cc:2410] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:25:08.662793 30456 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:08.578824 30529 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:08.636384 30294 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:08.664503 30385 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:08.680631 30526 raft_consensus.cc:2804] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:08.692659 25650 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:08.631376 25758 raft_consensus.cc:1240] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260709 12:25:08.698068 26401 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:25:08.696749 26431 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 19.
W20260709 12:25:08.706079 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 91894.7us
I20260709 12:25:08.706619 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:08.780203 26402 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:08.718849 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:08.721922 25679 raft_consensus.cc:2393] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 16: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:08.747754 30561 raft_consensus.cc:3060] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:08.607810 25726 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:08.690629 30502 raft_consensus.cc:740] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:08.743315 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:08.787233 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 179490us
I20260709 12:25:08.787710 25759 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 11.
I20260709 12:25:08.745287 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:08.788797 25678 raft_consensus.cc:2393] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 16: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:08.679180 30582 consensus_queue.cc:260] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:08.725782 25801 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:25:08.789589 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 63928.8us
I20260709 12:25:08.791203 25726 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:08.793066 25828 raft_consensus.cc:1275] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:25:08.795528 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:08.795995 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:08.796574 26434 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 10.
I20260709 12:25:08.727139 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:08.751720 25677 raft_consensus.cc:2393] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 12: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:08.757117 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:08.799759 25755 raft_consensus.cc:3060] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:25:08.757666 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:08.757815 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:08.758193 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:08.802611 25754 raft_consensus.cc:2393] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 16: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:08.721256 29921 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:08.764652 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:08.714916 30492 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:08.715543 30543 consensus_queue.cc:1059] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 12:25:08.769443 30456 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:08.771195 30529 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:08.773579 30294 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:08.776151 25830 raft_consensus.cc:1240] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:08.776569 25686 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 14.
I20260709 12:25:08.777221 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:08.724414 25761 raft_consensus.cc:2410] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:25:08.746796 30562 raft_consensus.cc:2804] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:08.785218 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:08.747754 30496 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:08.725867 30514 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:08.786096 30526 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:08.805941 25835 raft_consensus.cc:1240] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:08.758716 30499 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.816568 30579 raft_consensus.cc:2804] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:08.817724 25801 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:08.819585 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:25:08.819460 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 121461us
I20260709 12:25:08.811570 26402 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:25:08.828636 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 136041us
I20260709 12:25:08.856765 25650 leader_election.cc:400] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Vote denied by peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237) with higher term. Message: Invalid argument: T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for earlier term 11. Current term is 12.
I20260709 12:25:08.857698 25650 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:08.859835 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:08.822700 30385 raft_consensus.cc:2804] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:08.830552 30571 raft_consensus.cc:2804] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:08.800803 25756 raft_consensus.cc:2468] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 12.
I20260709 12:25:08.805182 25762 raft_consensus.cc:1275] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:25:08.842226 30252 consensus_meta.cc:287] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.513s	user 0.009s	sys 0.001s
I20260709 12:25:08.870569 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:08.849691 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:08.820160 29921 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:08.845598 30007 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:08.878078 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 60461.8us
I20260709 12:25:08.849937 30526 raft_consensus.cc:3060] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:08.864149 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:08.883018 25828 raft_consensus.cc:2393] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 12: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:08.780506 30489 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:08.867359 25650 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:08.826319 30581 raft_consensus.cc:2804] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:08.874397 25682 raft_consensus.cc:2393] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 14: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:08.847460 30566 raft_consensus.cc:2749] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:08.861606 30393 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.884559 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:08.861874 30582 raft_consensus.cc:3060] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:08.889104 30585 log.cc:927] Time spent T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:25:08.877578 30529 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:08.884279 30456 raft_consensus.cc:2749] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:08.860564 30579 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:08.856894 30518 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:08.861065 30499 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:08.868381 30501 raft_consensus.cc:2804] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:08.839560 25755 raft_consensus.cc:2468] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 13.
I20260709 12:25:08.864274 30385 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:08.876096 30378 raft_consensus.cc:2749] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:08.877381 30252 raft_consensus.cc:2749] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:08.841722 30495 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:08.981616 30538 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.964119 30579 raft_consensus.cc:3060] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:08.923300 30604 raft_consensus.cc:2749] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:25:08.967904 30501 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:08.917898 30531 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:08.919930 30393 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:09.014730 30213 raft_consensus.cc:2749] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267) with higher term. Message: Invalid argument: T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for earlier term 11. Current term is 12.
I20260709 12:25:08.973492 30356 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:08.989248 30583 raft_consensus.cc:2804] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:08.950313 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:08.878845 25801 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:08.895820 30581 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:08.863093 30493 consensus_queue.cc:1048] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.087s
W20260709 12:25:09.030488 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 151707us
I20260709 12:25:08.902858 30267 raft_consensus.cc:2749] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:25:08.973423 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:08.974068 25681 raft_consensus.cc:2468] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 10.
W20260709 12:25:08.980417 30576 log.cc:927] Time spent T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.265s	user 0.001s	sys 0.000s
W20260709 12:25:08.981155 30578 log.cc:927] Time spent T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260709 12:25:08.951228 30589 raft_consensus.cc:2749] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:08.966725 30385 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:08.898196 25650 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:25:09.049970 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 151879us
I20260709 12:25:08.993917 25760 raft_consensus.cc:2368] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 14. Current term is 15.
I20260709 12:25:08.873829 30502 consensus_queue.cc:260] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:08.960827 30529 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:08.923535 30562 raft_consensus.cc:697] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
W20260709 12:25:08.939239 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 80122.7us
I20260709 12:25:09.034675 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:09.062856 26432 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:09.040577 30514 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:09.041114 30535 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:09.041277 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:08.996183 30538 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:09.043185 25801 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:09.043396 25834 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "a866ff967d964388a6f0dff7fd43df89"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:25:09.064527 25834 raft_consensus.cc:606] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Received request to transfer leadership to TS a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:09.064661 25801 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:08.998129 30501 raft_consensus.cc:3060] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:09.050155 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:09.066642 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:09.067945 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:09.069188 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:25:09.044552 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 253405us
I20260709 12:25:09.015596 30456 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.042219 30581 raft_consensus.cc:3060] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:09.058460 29802 raft_consensus.cc:3055] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:09.064877 25834 raft_consensus.cc:614] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:09.082319 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:09.083572 25834 raft_consensus.cc:1240] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:25:09.000092 30531 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:09.056254 25650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:09.065793 26402 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:09.070350 25726 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:09.095314 30538 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:09.096520 30495 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:09.097705 30598 log.cc:927] Time spent T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 12:25:09.100378 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:09.101251 25682 raft_consensus.cc:2468] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 9.
I20260709 12:25:09.102372 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:09.103937 30595 raft_consensus.cc:2804] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:09.104399 30595 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:09.104507 30489 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:09.104780 30595 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:09.104918 30579 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:09.059681 30378 raft_consensus.cc:2804] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:25:09.108247 30378 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:09.108605 30378 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:09.108803 30267 raft_consensus.cc:2804] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:09.109194 30267 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:09.109526 30267 raft_consensus.cc:3060] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:09.111364 30563 raft_consensus.cc:3060] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:09.113371 30393 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:09.081641 29802 raft_consensus.cc:740] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:09.114770 29802 consensus_queue.cc:260] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:09.115934 29802 raft_consensus.cc:3060] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:09.118073 30529 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:09.072508 30512 consensus_queue.cc:1059] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 12:25:09.119489 25833 raft_consensus.cc:1275] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:25:09.081286 30456 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:09.122432 30456 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:09.072185 30587 raft_consensus.cc:2749] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:09.058560 30549 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:09.125725 30549 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:09.128134 25828 raft_consensus.cc:2468] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 12.
I20260709 12:25:09.129158 30561 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:09.131209 30561 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:09.134163 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 278294us
I20260709 12:25:09.134285 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:09.134881 26435 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:09.135800 25650 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:09.140295 25682 raft_consensus.cc:1240] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 12 LEADER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 11. Current term is 12. Ops: [9.7-11.8]
I20260709 12:25:09.082319 25680 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 12.
I20260709 12:25:09.090483 26432 raft_consensus.cc:2468] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 15.
I20260709 12:25:09.093498 26402 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
W20260709 12:25:09.147905 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 77652.4us
I20260709 12:25:09.149498 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:09.149767 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:09.153147 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:09.154170 30400 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.154665 30400 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:09.156896 30400 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:09.146258 30111 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:09.151207 29921 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:09.162616 30111 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:09.162776 29921 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:09.163475 29921 raft_consensus.cc:2804] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:09.146514 30492 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:09.164228 30562 consensus_queue.cc:237] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:09.166090 30492 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:09.153898 26432 raft_consensus.cc:3060] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:09.169257 25801 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:09.171258 25833 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:25:09.172784 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:09.105083 30489 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:09.150974 30450 consensus_meta.cc:287] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.706s	user 0.003s	sys 0.008s
I20260709 12:25:09.175743 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:09.177299 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:09.107753 30579 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:09.174408 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:09.128623 30499 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:09.187656 25757 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:09.196822 30561 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.197392 30561 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:09.199612 30561 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:09.200137 30493 consensus_queue.cc:1048] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:09.204171 30603 raft_consensus.cc:2804] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:25:09.208532 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 72846.1us
I20260709 12:25:09.188810 25833 raft_consensus.cc:606] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 8 LEADER]: Received request to transfer leadership to TS 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:09.164258 29921 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:09.218267 26432 raft_consensus.cc:2468] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 13.
I20260709 12:25:09.296094 25757 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 12.
I20260709 12:25:09.298764 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:09.299706 25682 raft_consensus.cc:2468] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 12.
I20260709 12:25:09.236850 25650 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
W20260709 12:25:09.315819 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 79071us
I20260709 12:25:09.180163 30495 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:09.215266 25684 raft_consensus.cc:2468] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 9.
I20260709 12:25:09.189327 30442 raft_consensus.cc:2804] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:09.188407 30571 raft_consensus.cc:697] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 12 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:09.370721 30603 raft_consensus.cc:697] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 14 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:09.318686 30549 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.319339 30607 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:09.375618 30604 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.314306 29921 raft_consensus.cc:3060] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:09.376775 30514 consensus_queue.cc:1048] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:09.378690 30378 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:09.379101 25726 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:09.318312 30501 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:09.151968 30451 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:09.213814 30111 raft_consensus.cc:2749] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:25:09.449847 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 70901.2us
I20260709 12:25:09.357795 30450 raft_consensus.cc:2804] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:09.381003 30526 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:09.208174 30489 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:09.446138 30496 consensus_meta.cc:287] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.593s	user 0.012s	sys 0.000s
I20260709 12:25:09.438586 30442 raft_consensus.cc:697] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 15 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:09.343539 30385 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:09.448793 30604 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:09.462329 30561 raft_consensus.cc:2804] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:09.473284 30612 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:09.475612 30577 log.cc:927] Time spent T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.892s	user 0.004s	sys 0.000s
I20260709 12:25:09.457587 30587 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:09.481258 30378 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 20 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:09.384766 30495 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:09.411636 30549 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:09.504099 30450 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:09.441424 30607 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:09.563491 30561 raft_consensus.cc:697] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:09.578300 30450 raft_consensus.cc:3060] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:09.567881 29921 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:09.564579 30612 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:09.542793 30496 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:09.568853 30587 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:09.564234 30603 consensus_queue.cc:237] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:09.562095 30571 consensus_queue.cc:237] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:09.694053 30451 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:09.697777 30501 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:09.719138 30618 log.cc:927] Time spent T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 12:25:09.707860 30614 log.cc:927] Time spent T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260709 12:25:09.705475 30526 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:09.716313 30611 log.cc:927] Time spent T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 12:25:09.721961 30385 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:09.733314 30604 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:09.741348 30581 consensus_meta.cc:287] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.620s	user 0.012s	sys 0.000s
I20260709 12:25:09.674885 30442 consensus_queue.cc:237] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:09.739153 30495 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:09.692631 30561 consensus_queue.cc:237] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:09.767230 30587 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:09.759233 30607 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:09.742738 30549 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:09.771517 30595 consensus_meta.cc:287] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.626s	user 0.011s	sys 0.000s
I20260709 12:25:09.793298 30595 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:09.796106 30595 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:09.772161 30581 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:09.798662 30581 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:09.780032 30609 log.cc:927] Time spent T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 12:25:09.723287 30489 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:09.787524 30496 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:09.765841 30612 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:09.842571 30562 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.007s	sys 0.006s
W20260709 12:25:09.843219 30562 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.007s	sys 0.006s
W20260709 12:25:09.884588 25634 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 588287us
W20260709 12:25:09.891286 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 574336us
I20260709 12:25:09.896369 25650 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:09.913612 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:09.915436 25682 raft_consensus.cc:2468] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 12.
I20260709 12:25:09.899690 25650 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
W20260709 12:25:09.535372 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:09.541883 25834 raft_consensus.cc:1240] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 8. Current term is 9. Ops: []
W20260709 12:25:09.561036 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:09.972710 26402 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.824s	user 0.076s	sys 0.099s
W20260709 12:25:09.973248 26402 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.825s	user 0.076s	sys 0.099s
I20260709 12:25:09.973058 25763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 3089) took 1162 ms. Trace:
I20260709 12:25:09.470279 26435 raft_consensus.cc:2468] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 12.
I20260709 12:25:09.974493 25760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53460 (request call id 2678) took 1200 ms. Trace:
W20260709 12:25:09.982932 26401 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.003s	sys 0.002s
I20260709 12:25:09.982811 25760 rpcz_store.cc:276] 0709 12:25:08.772704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.776937 (+  4233us) service_pool.cc:224] Handling call
0709 12:25:09.973246 (+1196309us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b540005fad4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:09.973516 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":382723968}
W20260709 12:25:09.975082 26438 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.824s	user 0.012s	sys 0.028s
I20260709 12:25:09.983574 25681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51578 (request call id 942) took 1470 ms. Trace:
W20260709 12:25:09.984136 26438 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.833s	user 0.013s	sys 0.028s
I20260709 12:25:09.984256 25681 rpcz_store.cc:276] 0709 12:25:08.512877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.512990 (+   113us) service_pool.cc:224] Handling call
0709 12:25:09.983183 (+1470193us) spinlock_profiling.cc:243] Waited 454 ms on lock 0x7b54002a58d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:09.983384 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1045132160}
I20260709 12:25:09.985553 26438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 1192) took 1374 ms. Trace:
W20260709 12:25:09.987205 25684 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51578 (request call id 926) took 1863 ms (client timeout 1709 ms). Trace:
I20260709 12:25:09.986006 26438 rpcz_store.cc:276] 0709 12:25:08.611155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.611454 (+   299us) service_pool.cc:224] Handling call
0709 12:25:08.611857 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:08.612155 (+   298us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:25:08.750754 (+138599us) log.cc:844] Serialized 14 byte log entry
0709 12:25:09.984829 (+1234075us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:09.984971 (+   142us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:09.985073 (+   102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:09.985248 (+   175us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:09.985493 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36875,"prepare.queue_time_us":249463,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":168472,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":116,"thread_start_us":1339726,"threads_started":3,"wal-append.queue_time_us":651077}
I20260709 12:25:09.997682 29921 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349)
W20260709 12:25:09.977438 25761 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48606 (request call id 1180) took 1603 ms (client timeout 1933 ms). Trace:
W20260709 12:25:09.999198 25761 rpcz_store.cc:269] 0709 12:25:08.373919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.378741 (+  4822us) service_pool.cc:224] Handling call
0709 12:25:09.967935 (+1589194us) spinlock_profiling.cc:243] Waited 293 ms on lock 0x7b54001dced4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:09.977198 (+  9263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":673086336}
I20260709 12:25:09.980778 26433 raft_consensus.cc:1240] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:10.001124 30213 raft_consensus.cc:2749] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:10.002269 30561 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.003738 30549 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.003266 30561 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:10.004441 30455 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:10.004714 30549 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:10.005554 30455 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:10.006826 30561 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:09.983566 26401 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.003s	sys 0.002s
W20260709 12:25:09.987641 25684 rpcz_store.cc:269] 0709 12:25:08.123986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.126538 (+  2552us) service_pool.cc:224] Handling call
0709 12:25:09.986755 (+1860217us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54003fdc54. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:09.986981 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2450789632}
I20260709 12:25:09.990585 30007 raft_consensus.cc:2749] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:09.993076 25830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44218 (request call id 1818) took 1502 ms. Trace:
W20260709 12:25:09.975673 25836 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44202 (request call id 2940) took 1495 ms (client timeout 1986 ms). Trace:
I20260709 12:25:09.976589 26437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 1190) took 1374 ms. Trace:
I20260709 12:25:09.993913 25835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 2949) took 1504 ms. Trace:
I20260709 12:25:09.973867 25763 rpcz_store.cc:276] 0709 12:25:08.805134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.805270 (+   136us) service_pool.cc:224] Handling call
0709 12:25:08.805569 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:08.958397 (+152828us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:08.958432 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:08.958942 (+   510us) log.cc:844] Serialized 26 byte log entry
0709 12:25:09.208629 (+249687us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:09.208743 (+   114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:09.208810 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:09.967503 (+758693us) raft_consensus.cc:1685] finished
0709 12:25:09.967551 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:09.967900 (+   349us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":152689,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":120,"thread_start_us":385590,"threads_started":2,"wal-append.queue_time_us":574362}
I20260709 12:25:09.996527 29810 raft_consensus.cc:2804] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:25:09.979542 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 886043us
I20260709 12:25:09.567507 30267 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:10.010993 26437 rpcz_store.cc:276] 0709 12:25:08.601646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.601775 (+   129us) service_pool.cc:224] Handling call
0709 12:25:08.602062 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:08.748289 (+146227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:08.748323 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:08.748368 (+    45us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:08.748414 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:09.975877 (+1227463us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b54004db054. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:09.975955 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:09.976213 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":335803136}
I20260709 12:25:10.011058 25835 rpcz_store.cc:276] 0709 12:25:08.489095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.511928 (+ 22833us) service_pool.cc:224] Handling call
0709 12:25:08.512477 (+   549us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:08.847687 (+335210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:09.993316 (+1145629us) spinlock_profiling.cc:243] Waited 293 ms on lock 0x7b54003877d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:09.993693 (+   377us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":674493696}
I20260709 12:25:10.029125 25682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40230 (request call id 1738) took 1261 ms. Trace:
I20260709 12:25:10.032730 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:10.033071 30526 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.033776 25755 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:10.034129 30526 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:10.037500 30562 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.037961 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:10.038465 30562 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:10.041405 30157 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:10.042721 30157 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:10.008201 30549 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:10.010248 25830 rpcz_store.cc:276] 0709 12:25:08.491944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.528288 (+ 36344us) service_pool.cc:224] Handling call
0709 12:25:08.560804 (+ 32516us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:08.826797 (+265993us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:09.992287 (+1165490us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b54001b0654. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:09.992789 (+   502us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":494738816}
I20260709 12:25:10.045308 30455 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:10.045998 30455 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:10.047196 25685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51578 (request call id 932) took 1921 ms. Trace:
I20260709 12:25:10.046972 30455 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:10.047456 30558 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:10.010632 25836 rpcz_store.cc:269] 0709 12:25:08.480284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.482020 (+  1736us) service_pool.cc:224] Handling call
0709 12:25:09.975055 (+1493035us) spinlock_profiling.cc:243] Waited 269 ms on lock 0x7b54001b1a54. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:09.975449 (+   394us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":618838784}
I20260709 12:25:10.031936 25682 rpcz_store.cc:276] 0709 12:25:08.765092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.917387 (+1152295us) service_pool.cc:224] Handling call
0709 12:25:09.918130 (+   743us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:09.918892 (+   762us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:09.918931 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:09.919852 (+   921us) log.cc:844] Serialized 26 byte log entry
0709 12:25:09.974000 (+ 54148us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:09.974049 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:09.978979 (+  4930us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:10.026608 (+ 47629us) raft_consensus.cc:1685] finished
0709 12:25:10.026642 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:10.026871 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":81719,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":274,"thread_start_us":39532,"threads_started":1,"wal-append.queue_time_us":89922}
I20260709 12:25:10.056846 30526 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:10.057816 25832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44218 (request call id 1819) took 1557 ms. Trace:
I20260709 12:25:10.057960 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:10.058840 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:10.058622 30571 consensus_queue.cc:1059] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:10.060010 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:10.060241 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:10.061182 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:10.061542 30581 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.047688 25685 rpcz_store.cc:276] 0709 12:25:08.125649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.125890 (+   241us) service_pool.cc:224] Handling call
0709 12:25:08.142418 (+ 16528us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:08.700671 (+558253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:10.046567 (+1345896us) spinlock_profiling.cc:243] Waited 525 ms on lock 0x7b54002a53d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:10.046985 (+   418us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1206982912}
I20260709 12:25:10.065191 30267 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:10.059326 30613 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:10.078073 30562 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:10.079080 25677 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51578 (request call id 936) took 1945 ms (client timeout 2151 ms). Trace:
I20260709 12:25:10.080829 30473 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:10.087368 30549 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:10.106983 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 139293us
I20260709 12:25:10.112445 25650 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:10.112466 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:25:10.107635 25677 rpcz_store.cc:269] 0709 12:25:08.133409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.134109 (+   700us) service_pool.cc:224] Handling call
0709 12:25:10.078593 (+1944484us) spinlock_profiling.cc:243] Waited 615 ms on lock 0x7b54002a0154. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:10.078881 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1413963008}
I20260709 12:25:10.095589 25832 rpcz_store.cc:276] 0709 12:25:08.508847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.576957 (+ 68110us) service_pool.cc:224] Handling call
0709 12:25:08.577250 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:08.692461 (+115211us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:25:08.717945 (+ 25484us) log.cc:844] Serialized 14 byte log entry
0709 12:25:08.743747 (+ 25802us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:08.743795 (+    48us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:08.743837 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:10.057321 (+1313484us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b54004218d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:10.057386 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:10.057653 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39609,"prepare.queue_time_us":78057,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":32937,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":23023,"spinlock_wait_cycles":264402688,"thread_start_us":13998,"threads_started":1}
I20260709 12:25:10.122488 25760 raft_consensus.cc:2468] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 9.
I20260709 12:25:10.120489 25835 raft_consensus.cc:2468] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 14.
I20260709 12:25:10.120687 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:10.122823 30581 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:10.122538 25837 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.900s	user 0.003s	sys 0.019s
W20260709 12:25:10.127650 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:10.133669 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:10.134398 25757 raft_consensus.cc:2468] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 13.
I20260709 12:25:10.135283 25686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51578 (request call id 940) took 1626 ms. Trace:
I20260709 12:25:10.135723 25686 rpcz_store.cc:276] 0709 12:25:08.508448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.509017 (+   569us) service_pool.cc:224] Handling call
0709 12:25:10.134893 (+1625876us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b54002cf1d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:10.135116 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":464660736}
I20260709 12:25:10.137645 25761 raft_consensus.cc:2410] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 12:25:10.137794 25837 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.928s	user 0.003s	sys 0.020s
I20260709 12:25:10.132804 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:10.143029 25837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 2951) took 1650 ms. Trace:
I20260709 12:25:10.127755 30157 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:10.140401 25683 raft_consensus.cc:1275] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:25:10.150305 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:10.151130 25759 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:10.129397 30393 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:10.145220 25758 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:10.124244 30549 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:10.125133 30562 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:10.155642 30473 raft_consensus.cc:2749] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:10.159334 30393 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:10.163296 30393 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:10.164299 25830 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:10.164417 25762 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 18.
I20260709 12:25:10.167454 30586 raft_consensus.cc:2749] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:10.165532 30581 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:10.166141 30443 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:10.138087 30571 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:10.172887 30443 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:10.174578 30549 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:10.175150 30443 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:10.143543 25837 rpcz_store.cc:276] 0709 12:25:08.492667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.524719 (+ 32052us) service_pool.cc:224] Handling call
0709 12:25:08.524913 (+   194us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:08.840589 (+315676us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:08.840620 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:08.841077 (+   457us) log.cc:844] Serialized 26 byte log entry
0709 12:25:09.173660 (+332583us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:10.140466 (+966806us) log.cc:844] Serialized 14 byte log entry
0709 12:25:10.142574 (+  2108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:10.142701 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:10.142784 (+    83us) raft_consensus.cc:1685] finished
0709 12:25:10.142796 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:10.142960 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35452,"prepare.queue_time_us":199047,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":152043,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":101,"thread_start_us":1507879,"threads_started":3,"wal-append.queue_time_us":531361}
I20260709 12:25:10.176169 25836 raft_consensus.cc:2468] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 12.
I20260709 12:25:10.172901 30571 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:10.177335 30562 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:10.113790 30613 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:10.185650 30613 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:10.149631 30526 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:10.186739 29802 consensus_meta.cc:287] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 1.070s	user 0.002s	sys 0.016s
I20260709 12:25:10.187125 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:10.191144 25830 raft_consensus.cc:2468] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 15.
I20260709 12:25:10.195078 30562 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:10.196254 30463 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:10.196962 30502 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:10.204476 30455 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:10.232152 25832 raft_consensus.cc:2393] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 11: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:10.179764 30571 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:10.209039 25836 raft_consensus.cc:1275] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:25:10.209193 25683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2452) took 1573 ms. Trace:
I20260709 12:25:10.215824 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:10.217288 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:10.237093 25755 raft_consensus.cc:2468] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 15.
W20260709 12:25:10.217895 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 140881us
I20260709 12:25:10.217980 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:10.218219 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:10.237185 25834 raft_consensus.cc:2468] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 12.
I20260709 12:25:10.231040 25758 raft_consensus.cc:2468] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 12.
I20260709 12:25:10.236714 25683 rpcz_store.cc:276] 0709 12:25:08.635571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.638233 (+  2662us) service_pool.cc:224] Handling call
0709 12:25:10.137508 (+1499275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:10.149067 (+ 11559us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:10.208951 (+ 59884us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b54002cf1d0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b608ad 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:10.209102 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3446910720}
I20260709 12:25:10.246172 25759 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 12.
W20260709 12:25:10.248049 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 113404us
W20260709 12:25:10.249055 30450 consensus_meta.cc:287] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.610s	user 0.013s	sys 0.008s
I20260709 12:25:10.249655 25829 raft_consensus.cc:2393] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 12: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:10.250620 25831 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:10.254400 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:10.256314 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:10.231772 30463 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:10.264923 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:25:10.265542 30617 log.cc:927] Time spent T 00000000000000000000000000000000 P 496fd6924b624e77b03ccfd15653d47b: Append to log took a long time: real 0.700s	user 0.013s	sys 0.000s
I20260709 12:25:10.307847 26433 raft_consensus.cc:3060] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:10.268987 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:10.269748 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:10.309635 26435 raft_consensus.cc:3060] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:10.270748 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:10.186766 30526 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:10.314105 30463 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:10.314606 25832 raft_consensus.cc:2468] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 12.
I20260709 12:25:10.315369 30526 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:10.276075 30385 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:10.317370 25830 raft_consensus.cc:2468] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 11.
I20260709 12:25:10.276820 26401 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:10.317565 30385 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:10.318838 26401 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:10.277356 30267 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:10.282006 29810 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:10.282356 30562 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:10.283195 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:10.324944 25755 raft_consensus.cc:2468] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 12.
I20260709 12:25:10.284554 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:10.284937 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:10.287693 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:10.288736 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:10.290555 25680 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40230 (request call id 1735) took 1529 ms (client timeout 1773 ms). Trace:
I20260709 12:25:10.259814 25828 raft_consensus.cc:1275] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:25:10.325889 25758 raft_consensus.cc:2368] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 11. Current term is 12.
I20260709 12:25:10.302311 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:10.304713 25754 raft_consensus.cc:1240] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:10.304536 25650 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:10.325958 25761 raft_consensus.cc:2468] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 11.
I20260709 12:25:10.268458 30613 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:10.311405 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:10.312286 30535 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.323688 25831 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 14.
I20260709 12:25:10.325524 26437 raft_consensus.cc:2368] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 12. Current term is 13.
I20260709 12:25:10.271520 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:10.330878 26438 raft_consensus.cc:2393] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 9: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:10.324622 29810 raft_consensus.cc:3060] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:10.326037 25680 rpcz_store.cc:269] 0709 12:25:08.760955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.871975 (+111020us) service_pool.cc:224] Handling call
0709 12:25:10.290184 (+1418209us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b540015a254. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:10.290369 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":336636288}
I20260709 12:25:10.326882 30561 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.338235 25762 raft_consensus.cc:2393] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 12: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:10.339599 30385 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:10.306531 30450 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:10.345320 25760 raft_consensus.cc:2410] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:25:10.329218 30267 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:10.347833 30111 raft_consensus.cc:2749] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:10.348358 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:10.349052 26431 raft_consensus.cc:2468] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 10.
I20260709 12:25:10.349751 30612 raft_consensus.cc:2749] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:10.350585 30512 raft_consensus.cc:2804] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:10.350943 30267 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:10.330122 30613 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:10.351514 26432 raft_consensus.cc:3060] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:10.351935 25757 raft_consensus.cc:2393] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 11: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:10.343217 26401 leader_election.cc:400] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 election: Vote denied by peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267) with higher term. Message: Invalid argument: T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 11. Current term is 12.
I20260709 12:25:10.353262 26401 leader_election.cc:403] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:25:10.351161 30512 raft_consensus.cc:697] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 12 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:10.353894 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:10.354779 26434 raft_consensus.cc:2468] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 9.
I20260709 12:25:10.354842 30512 consensus_queue.cc:237] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:10.351480 30562 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:10.360648 30562 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:10.362939 30613 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:10.363142 26433 raft_consensus.cc:2468] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 9.
I20260709 12:25:10.364795 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:10.368726 26432 raft_consensus.cc:2468] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 12.
I20260709 12:25:10.369148 26435 raft_consensus.cc:2468] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 11.
I20260709 12:25:10.373755 30561 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:10.376292 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:10.376981 26434 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:10.380869 30491 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:10.381604 26438 raft_consensus.cc:2393] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 13: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:10.381546 30491 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:10.381979 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:10.382570 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:10.383037 26435 raft_consensus.cc:2393] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 11: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:10.385859 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:25:10.386137 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 81770.2us
I20260709 12:25:10.385902 25756 raft_consensus.cc:1240] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 13. Current term is 14. Ops: []
W20260709 12:25:10.388696 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 50267.7us
I20260709 12:25:10.389400 26401 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:10.392000 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:10.383785 30491 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:10.395347 26437 raft_consensus.cc:2468] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 12.
I20260709 12:25:10.396641 26401 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:10.398952 30558 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:10.395005 30586 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.399993 30586 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:10.407903 30450 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:10.409256 30586 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:10.393307 30613 raft_consensus.cc:2804] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:10.410136 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:10.410533 30613 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:10.410969 26433 raft_consensus.cc:2393] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 12: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:10.411000 30613 raft_consensus.cc:3060] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:10.411737 26431 raft_consensus.cc:2393] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 18: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:10.412451 30583 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:10.412930 30583 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:10.415391 25756 raft_consensus.cc:1240] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:10.352924 30535 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:10.417156 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:10.418107 30535 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:10.420305 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:10.422148 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:10.422490 25800 leader_election.cc:400] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 election: Vote denied by peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267) with higher term. Message: Invalid argument: T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 14. Current term is 15.
I20260709 12:25:10.422727 25760 raft_consensus.cc:3060] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:10.422865 25800 leader_election.cc:403] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
W20260709 12:25:10.423471 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 167540us
I20260709 12:25:10.424434 30559 raft_consensus.cc:2749] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267) with higher term. Message: Invalid argument: T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 14. Current term is 15.
I20260709 12:25:10.424808 25800 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:10.426110 30559 raft_consensus.cc:2804] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:10.426146 25800 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:10.426602 30559 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:10.427022 30559 raft_consensus.cc:3060] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:10.399703 30558 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:10.428929 30558 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:10.432176 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:10.432278 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:10.432928 26439 raft_consensus.cc:2468] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 12.
I20260709 12:25:10.433285 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:10.434448 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:10.435233 26430 raft_consensus.cc:2393] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 12: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:10.436121 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:10.436712 26437 raft_consensus.cc:2468] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 13.
I20260709 12:25:10.437906 30537 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:10.393970 30561 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:10.440141 30537 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:10.441027 30526 raft_consensus.cc:993] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a: : Instructing follower 6e673265293d4e9a937dc45150aeb1b8 to start an election
I20260709 12:25:10.441098 30463 raft_consensus.cc:2804] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:10.441644 30463 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:10.442173 30463 raft_consensus.cc:3060] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:10.442469 30537 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:10.441706 30526 raft_consensus.cc:1081] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 8 LEADER]: Signalling peer 6e673265293d4e9a937dc45150aeb1b8 to start an election
I20260709 12:25:10.443979 25650 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:10.446833 30450 raft_consensus.cc:2804] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:10.447393 30450 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:10.447798 30450 raft_consensus.cc:3060] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:10.437765 29810 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:10.452111 30111 consensus_queue.cc:1048] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:10.453753 29810 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:10.454293 30463 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:10.459367 25760 raft_consensus.cc:2468] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 12.
I20260709 12:25:10.456316 29802 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:10.464277 29802 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:10.466786 29802 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:10.469156 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 78084.5us
I20260709 12:25:10.468397 25801 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:10.475142 30612 raft_consensus.cc:2804] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:10.460731 30537 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:10.487532 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:10.489753 26432 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 6.
I20260709 12:25:10.490530 25800 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:10.481727 26434 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 12.
I20260709 12:25:10.493494 30558 raft_consensus.cc:2804] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:10.494215 30558 raft_consensus.cc:697] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 12 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:10.495420 30558 consensus_queue.cc:237] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:10.496173 30571 raft_consensus.cc:2749] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267) with higher term. Message: Invalid argument: T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 11. Current term is 12.
I20260709 12:25:10.490772 30612 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:10.500360 30612 raft_consensus.cc:3060] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:10.505111 30463 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:10.506657 30559 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:10.508947 30559 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:10.512045 26430 raft_consensus.cc:1275] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:10.512996 30537 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:10.513949 30450 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:10.515240 30537 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:10.516638 25726 leader_election.cc:400] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Vote denied by peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611) with higher term. Message: Invalid argument: T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 12. Current term is 13.
I20260709 12:25:10.517885 30252 consensus_queue.cc:1059] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:10.523449 30252 raft_consensus.cc:3055] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:10.523841 30252 raft_consensus.cc:740] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:10.524889 30252 consensus_queue.cc:260] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:10.526273 30252 raft_consensus.cc:3060] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:10.528239 25726 leader_election.cc:403] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:10.529091 30522 raft_consensus.cc:2749] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611) with higher term. Message: Invalid argument: T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 12. Current term is 13.
W20260709 12:25:10.529981 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 44295us
I20260709 12:25:10.530721 25726 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:10.531785 30522 raft_consensus.cc:2804] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:10.532280 30522 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:10.532670 30522 raft_consensus.cc:3060] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:10.536499 25726 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:10.536772 25801 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:10.538076 25801 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:10.538503 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:10.538914 30586 raft_consensus.cc:2804] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:10.521124 30378 consensus_queue.cc:1059] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:10.539335 30586 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:10.539772 30586 raft_consensus.cc:3060] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:10.522092 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 53923.5us
I20260709 12:25:10.522202 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:10.536624 30463 raft_consensus.cc:2804] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:10.537942 30535 consensus_queue.cc:1059] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:10.539330 25756 raft_consensus.cc:2393] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 12: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:10.519004 25650 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:10.539964 30378 raft_consensus.cc:3055] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:10.518626 30583 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:10.544513 30378 raft_consensus.cc:740] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:10.545568 25649 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:10.548264 25754 raft_consensus.cc:1275] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:10.549518 25801 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:10.550457 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:10.551867 25800 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:10.553437 30612 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:10.555632 30612 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:10.556509 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:10.560190 29810 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.556111 30571 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.556665 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:10.561239 25757 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 6.
I20260709 12:25:10.560904 29810 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:10.551110 26432 raft_consensus.cc:2468] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 11.
I20260709 12:25:10.561169 30571 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:10.560655 25760 raft_consensus.cc:3060] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:10.542848 30450 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:10.568264 30537 raft_consensus.cc:2749] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:10.569481 30526 raft_consensus.cc:3055] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:10.569918 30526 raft_consensus.cc:740] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:10.568338 30587 raft_consensus.cc:2804] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:10.515758 30613 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:10.550669 30561 raft_consensus.cc:2804] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:10.564045 29810 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:10.556960 30463 raft_consensus.cc:697] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 18 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:10.579190 30442 raft_consensus.cc:2804] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:10.579223 30456 raft_consensus.cc:2804] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:10.580600 30456 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:10.580943 30456 raft_consensus.cc:3060] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:10.580973 25649 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:10.583140 29802 raft_consensus.cc:2749] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:10.583312 25649 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:10.583601 30584 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.583865 29802 consensus_queue.cc:1048] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:10.584420 30561 raft_consensus.cc:697] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 11 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:10.584508 30584 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:10.585608 30561 consensus_queue.cc:237] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:10.586352 30512 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
W20260709 12:25:10.586738 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:10.586745 30442 raft_consensus.cc:697] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 12 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:10.576229 30473 raft_consensus.cc:2749] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:25:10.587175 30512 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:10.588474 30378 consensus_queue.cc:260] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:10.588671 30442 consensus_queue.cc:237] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:10.589795 30378 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:10.590348 30512 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:10.578029 25726 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:10.600579 26433 raft_consensus.cc:2393] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 12: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:10.601248 25837 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "a866ff967d964388a6f0dff7fd43df89"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:25:10.597736 30393 consensus_queue.cc:1048] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 12:25:10.602010 25837 raft_consensus.cc:606] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Received request to transfer leadership to TS a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:10.602368 25837 raft_consensus.cc:614] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:10.602921 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:10.603621 30587 raft_consensus.cc:697] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 9 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:10.604043 25754 raft_consensus.cc:2410] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 19 because replica has last-logged OpId of term: 17 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 13.
I20260709 12:25:10.605048 30537 raft_consensus.cc:2804] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:10.605799 30537 raft_consensus.cc:697] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 13 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
W20260709 12:25:10.607178 30639 log.cc:927] Time spent T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:25:10.604691 30587 consensus_queue.cc:237] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:10.608845 30463 consensus_queue.cc:237] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:10.605911 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 87097.8us
I20260709 12:25:10.617470 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:10.617270 30558 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.619606 26430 raft_consensus.cc:1275] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:25:10.620126 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:10.620733 25756 raft_consensus.cc:2468] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 11.
I20260709 12:25:10.621363 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:10.621807 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:10.621984 26431 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 19.
I20260709 12:25:10.623075 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:10.623831 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:10.624538 25801 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:10.607239 30537 consensus_queue.cc:237] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:10.625039 30526 consensus_queue.cc:260] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:10.626482 30526 raft_consensus.cc:3060] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:10.620667 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:10.627574 26439 raft_consensus.cc:2393] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 13: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:10.624759 25757 raft_consensus.cc:2410] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:25:10.628468 30559 raft_consensus.cc:2749] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:10.629216 30559 consensus_queue.cc:1048] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:10.619247 30558 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:10.633003 30558 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:10.633283 25680 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d32f766d8f384968a837db40f23c072c"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
mode: GRACEFUL
new_leader_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:49108
I20260709 12:25:10.633863 30584 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:10.634066 25680 raft_consensus.cc:606] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Received request to transfer leadership to TS 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:10.635007 25680 raft_consensus.cc:614] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:10.637195 30613 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:10.640991 30571 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:10.641705 30473 consensus_queue.cc:1059] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:10.642244 30456 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:10.643712 29802 raft_consensus.cc:3055] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:10.644112 29802 raft_consensus.cc:740] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:10.645128 29802 consensus_queue.cc:260] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:10.646333 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:10.648149 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:10.649055 25837 raft_consensus.cc:1240] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:10.649222 25831 raft_consensus.cc:1275] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:25:10.649557 25831 pending_rounds.cc:85] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a: Aborting all ops after (but not including) 6
I20260709 12:25:10.649250 30581 consensus_queue.cc:1048] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:25:10.650125 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:10.649957 25831 pending_rounds.cc:107] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:25:10.650691 25831 raft_consensus.cc:2889] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:10.650738 25834 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:10.651080 25831 pending_rounds.cc:107] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 12:25:10.651368 25831 raft_consensus.cc:2889] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:10.651436 25801 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:10.657848 25831 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "a866ff967d964388a6f0dff7fd43df89"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:25:10.658440 25831 raft_consensus.cc:606] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 8 LEADER]: Received request to transfer leadership to TS a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:10.660964 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:10.717173 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:10.667528 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:10.675933 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:10.682570 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:10.682680 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:10.682170 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:10.685021 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:10.684511 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:10.720634 26438 raft_consensus.cc:3060] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:10.672349 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 54833us
W20260709 12:25:10.722590 25801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:10.703960 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:10.698395 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:10.723662 25832 raft_consensus.cc:1275] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 12:25:10.705667 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:10.706166 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
W20260709 12:25:10.711151 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:10.670745 25760 raft_consensus.cc:2468] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 13.
I20260709 12:25:10.667788 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:10.666847 25834 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 20.
I20260709 12:25:10.729745 26432 raft_consensus.cc:2468] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 12.
I20260709 12:25:10.682775 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:10.730746 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:10.731657 25834 raft_consensus.cc:2393] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 13: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:10.732558 25762 raft_consensus.cc:1275] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:25:10.732560 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:10.733722 25762 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:53460
I20260709 12:25:10.734579 25762 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:10.734979 25762 raft_consensus.cc:3060] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:10.704310 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:10.735730 25836 raft_consensus.cc:3060] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:10.720643 29802 raft_consensus.cc:3060] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:10.706423 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:10.734860 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:10.744690 25831 raft_consensus.cc:2468] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 8.
I20260709 12:25:10.746179 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:10.705964 30559 raft_consensus.cc:993] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a: : Instructing follower a866ff967d964388a6f0dff7fd43df89 to start an election
I20260709 12:25:10.747164 25801 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:10.746106 25834 raft_consensus.cc:2468] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 11.
I20260709 12:25:10.749909 30558 raft_consensus.cc:2804] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:10.750614 30558 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:10.750861 25831 raft_consensus.cc:2393] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 11: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:10.751071 30558 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:10.752092 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:10.748438 30559 raft_consensus.cc:1081] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 8 LEADER]: Signalling peer a866ff967d964388a6f0dff7fd43df89 to start an election
I20260709 12:25:10.770593 26432 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a"
dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
 from {username='slave'} at 127.0.0.1:36508
I20260709 12:25:10.771346 26432 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:10.771796 26432 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:10.778844 30491 raft_consensus.cc:2764] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:25:10.712839 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:10.722438 25649 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:10.643210 30586 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:10.784698 25830 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:10.724288 25832 pending_rounds.cc:85] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a: Aborting all ops after (but not including) 9
I20260709 12:25:10.785519 26435 raft_consensus.cc:1275] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:10.785697 25832 pending_rounds.cc:107] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 12:25:10.785962 25832 raft_consensus.cc:2889] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:10.787832 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:10.682262 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:25:10.784109 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:10.791620 26433 raft_consensus.cc:2393] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 9: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:10.722052 25726 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:10.793746 26439 raft_consensus.cc:2410] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:25:10.794199 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:25:10.797639 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 75679.5us
I20260709 12:25:10.795660 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:10.798758 26433 raft_consensus.cc:3060] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:10.809561 25836 raft_consensus.cc:2468] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 11.
I20260709 12:25:10.681882 30456 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:10.808487 26432 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:10.819279 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:10.813454 25762 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:10.823058 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:10.819818 25726 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:10.682117 30450 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:10.782095 30584 raft_consensus.cc:2764] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 12:25:10.850869 25833 raft_consensus.cc:2368] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for earlier term 9. Current term is 10.
I20260709 12:25:10.851727 25835 raft_consensus.cc:2368] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for earlier term 10. Current term is 11.
I20260709 12:25:10.851645 26432 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:10.823858 26431 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:10.854228 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:10.856710 26401 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:10.682338 30111 consensus_queue.cc:1059] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.116s
I20260709 12:25:10.698944 30378 consensus_queue.cc:1059] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.120s
I20260709 12:25:10.863091 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:10.863373 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:10.865590 25756 raft_consensus.cc:1240] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:10.861881 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:10.871040 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:10.875594 25762 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:10.878284 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:10.818511 30491 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
W20260709 12:25:10.872126 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 52375.8us
I20260709 12:25:10.885295 25837 raft_consensus.cc:2393] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 11: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:10.885859 29802 raft_consensus.cc:2804] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:10.850275 30473 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:10.890323 25828 raft_consensus.cc:3060] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:10.869745 30252 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:10.908473 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:10.908290 30252 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:10.909174 26434 raft_consensus.cc:2368] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for earlier term 10. Current term is 11.
I20260709 12:25:10.911046 30252 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:10.912570 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:10.913698 25837 raft_consensus.cc:2393] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 14: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:10.914332 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:10.915373 30491 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:10.902100 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:10.872392 30393 raft_consensus.cc:2804] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:10.904301 26439 raft_consensus.cc:1240] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:10.905099 30496 raft_consensus.cc:2804] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:10.905256 26430 raft_consensus.cc:1240] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:10.905645 30583 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:10.905441 30558 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:10.906469 30495 raft_consensus.cc:2804] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:10.926410 25830 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 12.
I20260709 12:25:10.933928 30393 raft_consensus.cc:697] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 13 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:10.941154 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:10.920993 30496 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:10.942420 30537 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
W20260709 12:25:10.966209 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 243846us
I20260709 12:25:10.967231 26434 raft_consensus.cc:1240] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 10. Current term is 11. Ops: []
W20260709 12:25:10.957401 30644 log.cc:927] Time spent T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 12:25:10.973140 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: true dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:10.973858 25830 raft_consensus.cc:3055] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:10.974282 25830 raft_consensus.cc:740] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:10.946655 30495 raft_consensus.cc:697] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:10.926276 30473 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:10.958563 30496 raft_consensus.cc:3060] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:10.980679 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:10.979692 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:10.984447 25837 raft_consensus.cc:3060] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:10.984633 30548 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:10.985234 30548 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:10.987293 30548 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:10.988489 30586 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:10.988569 30495 consensus_queue.cc:237] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:10.989328 25830 consensus_queue.cc:260] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:10.990379 25830 raft_consensus.cc:3060] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:10.992251 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:10.992874 25680 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 11.
I20260709 12:25:10.993556 25832 raft_consensus.cc:1275] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:10.994547 25762 raft_consensus.cc:1275] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:25:10.919449 30450 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:10.993558 30558 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:10.979606 30537 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:11.027117 30537 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:11.032096 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 461090us
W20260709 12:25:11.036043 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.014104 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:11.039382 26430 raft_consensus.cc:2393] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 11: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:10.942655 30393 consensus_queue.cc:237] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:11.042152 25837 raft_consensus.cc:2468] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 13.
I20260709 12:25:10.973680 30252 raft_consensus.cc:3055] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:11.043236 25830 raft_consensus.cc:2468] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 9.
I20260709 12:25:11.072958 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:11.075667 30548 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.076385 30548 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:11.078547 30548 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:11.080152 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.072361 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:11.081286 25683 raft_consensus.cc:3060] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:11.061542 26438 raft_consensus.cc:2468] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 13.
I20260709 12:25:11.063876 26433 raft_consensus.cc:2468] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 12.
I20260709 12:25:11.035696 30450 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:11.070007 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 59693.2us
W20260709 12:25:11.087440 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.093772 30584 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.091322 30612 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.107548 25680 raft_consensus.cc:2393] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 14: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:11.013182 30613 consensus_queue.cc:1048] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.073s
W20260709 12:25:11.111531 30645 log.cc:927] Time spent T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.407s	user 0.001s	sys 0.000s
I20260709 12:25:11.116748 25829 raft_consensus.cc:2468] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 11.
I20260709 12:25:11.115166 30502 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.117688 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:11.117924 25686 raft_consensus.cc:1240] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:11.117799 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:11.116554 25801 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:11.137352 25762 raft_consensus.cc:3060] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:25:11.087931 30561 consensus_queue.cc:1059] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:25:11.071712 30252 raft_consensus.cc:740] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:11.118554 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:11.040841 30522 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:11.130329 29802 raft_consensus.cc:697] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 12 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
W20260709 12:25:11.139153 25801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.120054 30491 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:11.144745 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:11.151073 25800 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:11.176584 25677 raft_consensus.cc:2393] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 13: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:11.176995 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:11.190039 25726 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:11.193742 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:11.192871 30558 raft_consensus.cc:2749] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:25:11.201779 25801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.147831 30587 raft_consensus.cc:2804] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:11.204442 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:11.199154 30473 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:11.212236 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:11.178324 30581 consensus_queue.cc:1048] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 12:25:11.219659 25679 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 14.
I20260709 12:25:11.219605 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:11.220408 25681 raft_consensus.cc:3060] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:11.151952 30111 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:11.227484 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 48097.3us
I20260709 12:25:11.135993 30612 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:11.234413 25686 raft_consensus.cc:2468] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 9.
I20260709 12:25:11.233917 29802 consensus_queue.cc:237] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:11.236732 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:11.240890 25828 raft_consensus.cc:2468] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 13.
I20260709 12:25:11.242226 25836 raft_consensus.cc:1240] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:11.151417 30502 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:11.220431 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:11.247644 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:11.248266 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:11.255872 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:11.257229 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:11.258381 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:11.258967 25680 raft_consensus.cc:2468] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 12.
I20260709 12:25:11.260195 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:11.259805 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:11.178871 30584 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:11.263010 25681 raft_consensus.cc:2468] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 11.
W20260709 12:25:11.239979 30463 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.018s	sys 0.015s
I20260709 12:25:11.274420 25680 raft_consensus.cc:2393] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 9: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:11.221776 30656 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.267005 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:11.247802 30548 raft_consensus.cc:2804] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:11.283953 25726 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:11.295351 25683 raft_consensus.cc:2468] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 11.
I20260709 12:25:11.285907 25762 raft_consensus.cc:2468] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 13.
I20260709 12:25:11.274011 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:11.300081 25681 raft_consensus.cc:1275] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:25:11.274293 30463 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.018s	sys 0.015s
I20260709 12:25:11.303090 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:11.303855 26402 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:11.304998 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:11.305493 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:25:11.300185 30649 log.cc:927] Time spent T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 12:25:11.306862 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:11.287552 30548 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:11.254015 30587 raft_consensus.cc:697] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 13 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:11.309540 25685 raft_consensus.cc:2393] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 11: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:11.310148 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:11.310786 25686 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 6.
I20260709 12:25:11.310772 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:11.309123 25682 raft_consensus.cc:2468] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 9.
I20260709 12:25:11.313696 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:11.317198 26434 raft_consensus.cc:3060] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:11.319531 25684 raft_consensus.cc:1275] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:11.239364 30252 consensus_queue.cc:260] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:11.322662 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:11.323239 26438 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:11.326066 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:11.346732 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:11.349596 25678 raft_consensus.cc:2393] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 15: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:11.350942 30522 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:11.353444 30502 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:11.354632 26431 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 20.
I20260709 12:25:11.354990 30502 raft_consensus.cc:2749] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:11.366235 30584 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:11.317384 30548 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:11.372725 25801 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 2.232s (SENT) [suppressed 20 similar messages]
W20260709 12:25:11.373641 30653 log.cc:927] Time spent T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.293s	user 0.001s	sys 0.000s
I20260709 12:25:11.375811 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:11.322319 30456 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:11.380944 30456 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:11.382314 25681 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 14.
I20260709 12:25:11.383425 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:11.384274 25681 raft_consensus.cc:2410] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:25:11.384430 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:11.382371 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:11.385365 25686 raft_consensus.cc:2376] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 9. Re-sending same reply.
I20260709 12:25:11.386260 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:11.386552 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:11.387346 25686 raft_consensus.cc:2393] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 14: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:11.385242 25682 raft_consensus.cc:2376] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 14. Re-sending same reply.
I20260709 12:25:11.389513 25680 raft_consensus.cc:2393] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 16: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:11.391772 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:11.299964 30656 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:11.300726 30111 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:11.407810 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 256869us
I20260709 12:25:11.408733 25800 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:11.393020 26433 raft_consensus.cc:1275] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:25:11.387089 25685 raft_consensus.cc:2468] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 11.
I20260709 12:25:11.392957 25684 raft_consensus.cc:2468] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 12.
I20260709 12:25:11.402750 26434 raft_consensus.cc:2468] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 10.
I20260709 12:25:11.413470 25800 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:11.407554 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:11.415053 25678 raft_consensus.cc:2468] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 10.
W20260709 12:25:11.418898 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 154995us
I20260709 12:25:11.385260 30378 raft_consensus.cc:3055] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:11.354663 30522 raft_consensus.cc:2804] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:11.420149 25682 raft_consensus.cc:2393] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 20: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:11.421922 26434 raft_consensus.cc:1275] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:25:11.426183 25758 raft_consensus.cc:1275] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:25:11.428033 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:11.428779 30657 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.428969 30587 consensus_queue.cc:237] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:11.430316 25762 raft_consensus.cc:1275] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:25:11.430611 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:11.441802 25836 raft_consensus.cc:3060] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:25:11.431284 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:11.431993 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:11.442608 25829 raft_consensus.cc:3055] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:11.442909 25829 raft_consensus.cc:740] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:11.431972 30612 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:25:11.412665 30665 log.cc:927] Time spent T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:25:11.412050 26438 raft_consensus.cc:2468] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 13.
I20260709 12:25:11.433509 25677 raft_consensus.cc:3060] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:11.420028 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 116073us
I20260709 12:25:11.434002 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:11.435578 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:11.453363 25686 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:11.445312 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.457837 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:11.416329 30581 raft_consensus.cc:2749] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:11.459986 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:11.460835 26438 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 12.
I20260709 12:25:11.419148 30584 raft_consensus.cc:2749] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:11.468096 26434 raft_consensus.cc:1275] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:25:11.434725 30378 raft_consensus.cc:740] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:11.438114 30522 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:11.469020 25680 raft_consensus.cc:2468] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 13.
I20260709 12:25:11.474413 26402 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:11.472765 25836 raft_consensus.cc:2468] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 13.
I20260709 12:25:11.477389 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:11.476765 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:11.485533 30656 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:11.496717 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:11.497534 25678 raft_consensus.cc:2468] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 12.
I20260709 12:25:11.500526 26434 raft_consensus.cc:1275] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:25:11.502305 25801 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:11.508723 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:11.509534 25683 raft_consensus.cc:2393] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 16: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:11.511166 25758 raft_consensus.cc:2468] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 13.
I20260709 12:25:11.511584 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:11.478602 30522 raft_consensus.cc:3060] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:11.509074 25726 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:11.514472 26434 raft_consensus.cc:1240] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:11.517005 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:11.518925 25680 raft_consensus.cc:2410] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:25:11.512260 25685 raft_consensus.cc:2376] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 14. Re-sending same reply.
I20260709 12:25:11.500190 25829 consensus_queue.cc:260] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:11.521924 26401 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:11.522078 30667 raft_consensus.cc:2804] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:11.522578 30667 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:11.522881 30668 raft_consensus.cc:2804] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:11.523515 30668 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:11.523902 30668 raft_consensus.cc:3060] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:11.525751 26402 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:11.526575 30393 raft_consensus.cc:2749] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:11.522966 30667 raft_consensus.cc:3060] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:11.528530 26402 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:11.536288 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:11.533077 30656 consensus_queue.cc:1048] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:11.536969 25678 raft_consensus.cc:2393] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 14: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:11.463549 30657 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } attrs { replace: true } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:11.533134 25650 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:11.537773 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:11.538792 25650 leader_election.cc:400] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 election: Vote denied by peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611) with higher term. Message: Invalid argument: T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for earlier term 10. Current term is 11.
I20260709 12:25:11.538844 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:11.539181 25650 leader_election.cc:403] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:25:11.519325 30584 raft_consensus.cc:2749] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:11.489789 30672 consensus_queue.cc:1048] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 12:25:11.541186 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:11.541764 25681 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:11.542053 30660 raft_consensus.cc:2749] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:11.542861 30660 raft_consensus.cc:2749] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611) with higher term. Message: Invalid argument: T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for earlier term 10. Current term is 11.
I20260709 12:25:11.543745 30660 consensus_queue.cc:1059] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:11.544811 30660 raft_consensus.cc:3055] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:11.545161 30660 raft_consensus.cc:740] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:11.546077 30660 consensus_queue.cc:260] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:11.547365 30660 raft_consensus.cc:3060] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:11.548947 25685 raft_consensus.cc:1275] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:25:11.549921 25650 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:11.541262 30442 consensus_queue.cc:1048] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 12:25:11.550920 25678 raft_consensus.cc:2393] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 9: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:11.551847 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:11.553450 25678 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:11.552335 30378 consensus_queue.cc:260] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:11.554100 30378 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:11.555474 30661 raft_consensus.cc:2804] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:25:11.556277 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:11.561570 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:11.552354 25829 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:11.539465 30657 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:11.552690 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:11.568136 25680 raft_consensus.cc:3060] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:11.529970 25801 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:11.568812 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:11.530177 25686 raft_consensus.cc:2468] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 9.
I20260709 12:25:11.567185 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:11.569388 25683 raft_consensus.cc:2376] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 11. Re-sending same reply.
I20260709 12:25:11.549997 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:11.571080 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:11.571287 30586 raft_consensus.cc:2804] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:11.571571 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:11.571841 30586 raft_consensus.cc:697] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 10 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
W20260709 12:25:11.572443 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 63432.7us
I20260709 12:25:11.573232 25726 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:11.572937 30586 consensus_queue.cc:237] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:11.574208 30673 raft_consensus.cc:2764] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:25:11.574420 25726 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:11.574929 30673 raft_consensus.cc:2749] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:11.575037 25801 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:11.575729 30677 raft_consensus.cc:2804] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:11.576651 30677 raft_consensus.cc:697] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:11.576573 30526 consensus_queue.cc:1048] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:11.578111 30535 raft_consensus.cc:2804] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:11.577677 30677 consensus_queue.cc:237] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:11.579209 25685 raft_consensus.cc:2393] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 13: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:11.571817 25830 raft_consensus.cc:2393] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 11: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:11.579378 25726 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
W20260709 12:25:11.581586 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 53185.2us
I20260709 12:25:11.578660 30535 raft_consensus.cc:697] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 13 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:11.584921 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:11.583000 26402 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:11.589684 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:11.591675 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:11.673782 25836 raft_consensus.cc:1813] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Handling vote request from an unknown peer f82778701b464892aab92a752ed7ffdc
I20260709 12:25:11.674453 25836 raft_consensus.cc:2393] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 12: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:11.594174 30571 consensus_queue.cc:1048] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:25:11.675933 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 92982.6us
I20260709 12:25:11.676599 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:25:11.595315 30647 log.cc:927] Time spent T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.578s	user 0.003s	sys 0.000s
I20260709 12:25:11.598801 26433 raft_consensus.cc:1240] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 12. Current term is 13. Ops: []
W20260709 12:25:11.607753 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:11.678555 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 93554.8us
W20260709 12:25:11.680987 25801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:11.682477 25650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.689549 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:11.690375 29802 consensus_queue.cc:1048] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:11.580003 30661 raft_consensus.cc:697] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 20 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:11.683560 26402 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:25:11.695868 25801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.696691 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:11.701231 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:11.583969 30463 consensus_queue.cc:1048] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.095s
I20260709 12:25:11.575667 30673 consensus_queue.cc:1048] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.103s
I20260709 12:25:11.597380 30674 raft_consensus.cc:2749] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:11.709611 30456 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:11.712498 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:11.714011 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:11.720536 30535 consensus_queue.cc:237] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:11.726580 30672 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:11.727178 30672 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:11.729331 30672 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:11.729835 30672 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:11.730278 30672 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:11.746624 25801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.746341 25680 raft_consensus.cc:2468] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 10.
I20260709 12:25:11.753250 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:11.680186 30393 raft_consensus.cc:2749] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:11.775216 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
W20260709 12:25:11.699707 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 120399us
W20260709 12:25:11.786226 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 94131.2us
I20260709 12:25:11.787472 25650 leader_election.cc:400] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 election: Vote denied by peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237) with higher term. Message: Invalid argument: T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for earlier term 10. Current term is 11.
I20260709 12:25:11.788873 25650 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:11.691094 30612 raft_consensus.cc:2804] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:11.805496 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:11.806252 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:11.806558 25680 raft_consensus.cc:1240] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:11.807397 25726 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:11.675526 30581 consensus_queue.cc:1048] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.178s
I20260709 12:25:11.815239 25650 leader_election.cc:400] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 election: Vote denied by peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237) with higher term. Message: Invalid argument: T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for earlier term 9. Current term is 10.
I20260709 12:25:11.816202 25650 leader_election.cc:403] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:25:11.830165 25681 raft_consensus.cc:2468] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 13.
I20260709 12:25:11.804880 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:11.832373 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 148883us
I20260709 12:25:11.803432 25829 raft_consensus.cc:2468] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 9.
W20260709 12:25:11.837991 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 53495.2us
I20260709 12:25:11.839349 30613 raft_consensus.cc:2804] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:25:11.852037 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.852291 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:11.853452 30491 raft_consensus.cc:3055] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:11.833086 30660 raft_consensus.cc:3060] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:11.913558 30548 consensus_meta.cc:287] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.543s	user 0.011s	sys 0.000s
W20260709 12:25:11.856292 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 51808.1us
I20260709 12:25:11.839607 25686 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 12.
I20260709 12:25:11.869338 25678 raft_consensus.cc:2468] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 15.
W20260709 12:25:11.895099 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 80056us
I20260709 12:25:11.933161 25650 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:11.897890 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:11.870513 30450 raft_consensus.cc:2749] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237) with higher term. Message: Invalid argument: T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for earlier term 9. Current term is 10.
I20260709 12:25:11.937356 26402 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:11.875955 30674 raft_consensus.cc:2804] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:11.811385 30561 consensus_queue.cc:1048] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260709 12:25:11.918278 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:11.874402 30111 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:11.900483 25800 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
W20260709 12:25:11.975704 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 75343.6us
I20260709 12:25:11.934652 29802 raft_consensus.cc:2804] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:25:11.946270 25801 leader_election.cc:336] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 1.562s (SENT)
W20260709 12:25:11.965444 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 44323.4us
I20260709 12:25:11.978538 26402 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:25:11.980352 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 48594.6us
I20260709 12:25:11.966501 25678 raft_consensus.cc:1240] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:11.968077 25683 raft_consensus.cc:2468] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 12.
W20260709 12:25:11.931165 30496 consensus_meta.cc:287] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.916s	user 0.011s	sys 0.000s
I20260709 12:25:11.994596 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:11.995599 25686 raft_consensus.cc:2468] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 12.
I20260709 12:25:11.996542 25801 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:11.987422 30631 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.911772 30456 consensus_queue.cc:1048] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 12:25:12.009471 26402 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:12.004406 25650 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:12.010993 30450 raft_consensus.cc:2749] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:11.917474 30668 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:11.926795 30491 raft_consensus.cc:740] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:11.999138 30631 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:12.021401 25678 raft_consensus.cc:1275] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:25:11.997494 30526 raft_consensus.cc:2749] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:12.018790 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:11.973886 30613 raft_consensus.cc:697] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 13 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:11.987274 30571 raft_consensus.cc:2804] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:25:12.045029 25677 consensus_meta.cc:287] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.580s	user 0.005s	sys 0.004s
I20260709 12:25:12.007154 30502 raft_consensus.cc:2749] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:25:12.048033 25677 raft_consensus.cc:2468] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 11.
I20260709 12:25:12.046710 26437 raft_consensus.cc:1275] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 12:25:12.050628 26437 pending_rounds.cc:85] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89: Aborting all ops after (but not including) 11
I20260709 12:25:12.050973 26437 pending_rounds.cc:107] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 12:25:12.051291 26437 raft_consensus.cc:2889] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:12.048189 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:11.944983 30657 consensus_queue.cc:1059] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.080s
I20260709 12:25:12.059248 25683 raft_consensus.cc:1275] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 12:25:12.059707 25683 pending_rounds.cc:85] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc: Aborting all ops after (but not including) 6
I20260709 12:25:12.008090 30612 raft_consensus.cc:697] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 11 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:11.944901 30548 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:12.060462 25683 pending_rounds.cc:107] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:25:12.068764 25683 raft_consensus.cc:2889] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:25:12.056309 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 79433us
I20260709 12:25:12.010308 30496 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:12.072353 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:12.046993 30393 raft_consensus.cc:2749] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:12.077795 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:12.078555 25685 raft_consensus.cc:2376] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 12. Re-sending same reply.
I20260709 12:25:12.084914 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:12.092044 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:12.020412 25650 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
W20260709 12:25:12.096267 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 75951.8us
W20260709 12:25:12.096194 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 99764.5us
I20260709 12:25:11.985587 30661 consensus_queue.cc:237] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:12.099453 25763 raft_consensus.cc:2368] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 13. Current term is 14.
I20260709 12:25:12.070240 30571 raft_consensus.cc:697] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 11 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:12.081312 30584 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.075523 30587 raft_consensus.cc:2749] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:25:12.115784 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.112426 29802 raft_consensus.cc:697] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 13 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:12.113710 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:12.118597 26402 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:12.128495 25685 raft_consensus.cc:1275] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:12.089262 30450 consensus_queue.cc:1059] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 12:25:12.133364 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:12.133659 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:12.134203 25686 raft_consensus.cc:2393] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 14: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:12.135262 25762 raft_consensus.cc:1275] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:25:12.134431 26437 raft_consensus.cc:2468] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 9.
I20260709 12:25:12.151454 25678 raft_consensus.cc:1275] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:25:12.154532 26402 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
W20260709 12:25:12.157178 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.159030 26433 raft_consensus.cc:1275] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:25:12.151522 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.119429 30688 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:12.151981 29802 consensus_queue.cc:237] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:12.172036 30612 consensus_queue.cc:237] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:12.177945 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: true dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:12.178917 25686 raft_consensus.cc:2393] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 9: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
W20260709 12:25:12.222457 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 60049.5us
I20260709 12:25:12.117797 30584 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:12.177933 30502 raft_consensus.cc:2804] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:12.233230 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:12.233657 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 104770us
I20260709 12:25:12.236768 25762 raft_consensus.cc:1240] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:12.131835 30669 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:12.127985 30491 consensus_queue.cc:260] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:12.253779 25650 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:12.254102 26402 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:12.132984 30613 consensus_queue.cc:237] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:12.268564 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:12.270952 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:12.271625 25754 raft_consensus.cc:3060] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:12.276646 30696 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:12.276868 30669 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:12.286999 30393 consensus_queue.cc:1048] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:12.289072 30393 raft_consensus.cc:2764] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:25:12.290014 30691 raft_consensus.cc:2764] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:25:12.256420 30502 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:12.292199 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:12.194480 30688 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:12.269734 30668 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:12.327446 30491 raft_consensus.cc:3060] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:12.361191 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 107142us
I20260709 12:25:12.367717 26402 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:12.237298 30571 consensus_queue.cc:237] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:12.327848 30502 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:12.359268 30522 consensus_meta.cc:287] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.833s	user 0.011s	sys 0.000s
W20260709 12:25:12.396162 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 142462us
W20260709 12:25:12.375177 30683 log.cc:927] Time spent T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.283s	user 0.002s	sys 0.000s
W20260709 12:25:12.393848 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 464470us
I20260709 12:25:12.412838 29802 raft_consensus.cc:2804] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:12.413643 29802 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:12.399863 25761 raft_consensus.cc:1240] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:25:12.414258 29802 raft_consensus.cc:3060] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:12.387720 26402 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:12.374264 30252 raft_consensus.cc:3060] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:12.369876 30496 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:12.396255 30684 log.cc:927] Time spent T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.299s	user 0.000s	sys 0.001s
I20260709 12:25:12.393903 30393 raft_consensus.cc:2804] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:12.444496 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:12.444772 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:12.432235 26402 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:12.444564 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:25:12.447992 30682 log.cc:927] Time spent T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.276s	user 0.000s	sys 0.001s
I20260709 12:25:12.458103 30715 raft_consensus.cc:2749] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:25:12.459266 30686 log.cc:927] Time spent T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
W20260709 12:25:12.460922 30690 log.cc:927] Time spent T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.191s	user 0.000s	sys 0.000s
W20260709 12:25:12.462641 30707 log.cc:927] Time spent T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 12:25:12.462903 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.462792 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:12.464564 25756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48606 (request call id 1214) took 1228 ms. Trace:
W20260709 12:25:12.459364 30708 log.cc:927] Time spent T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:25:12.467025 25649 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:12.464923 25756 rpcz_store.cc:276] 0709 12:25:11.236144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.236368 (+   224us) service_pool.cc:224] Handling call
0709 12:25:11.261071 (+ 24703us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:11.497790 (+236719us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:11.497860 (+    70us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:11.517009 (+ 19149us) log.cc:844] Serialized 26 byte log entry
0709 12:25:11.817861 (+300852us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:11.817902 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:11.817974 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:12.464377 (+646403us) raft_consensus.cc:1685] finished
0709 12:25:12.464396 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:12.464509 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":70673,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":144,"thread_start_us":406555,"threads_started":2,"wal-append.queue_time_us":459079}
I20260709 12:25:12.470291 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:12.471556 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:12.472395 30378 consensus_meta.cc:287] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.918s	user 0.006s	sys 0.005s
I20260709 12:25:12.473579 30378 consensus_queue.cc:1048] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:12.474285 30669 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:12.474880 30378 consensus_queue.cc:1059] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:12.475546 30378 consensus_queue.cc:1243] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer 6e673265293d4e9a937dc45150aeb1b8 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 12:25:12.448208 30660 consensus_meta.cc:287] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.504s	user 0.011s	sys 0.000s
I20260709 12:25:12.476955 30660 raft_consensus.cc:2749] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:25:12.479207 25763 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53460 (request call id 2706) took 1656 ms (client timeout 1870 ms). Trace:
W20260709 12:25:12.479727 25763 rpcz_store.cc:269] 0709 12:25:10.822830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:10.823093 (+   263us) service_pool.cc:224] Handling call
0709 12:25:12.478948 (+1655855us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54001dced4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:12.479139 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2824016256}
I20260709 12:25:12.400665 30522 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:12.508460 25756 raft_consensus.cc:2468] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 8.
I20260709 12:25:12.508826 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:12.515357 25649 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:12.518646 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:12.519994 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:12.520536 30612 raft_consensus.cc:2749] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:12.526059 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:12.533636 25726 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.007s	sys 0.023s
W20260709 12:25:12.537694 25726 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.007s	sys 0.023s
W20260709 12:25:12.538056 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 555974us
I20260709 12:25:12.538329 25762 raft_consensus.cc:2393] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 13: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
W20260709 12:25:12.539388 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.539580 25726 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:12.540423 25680 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 14.
W20260709 12:25:12.540556 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 126910us
I20260709 12:25:12.541395 25801 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
W20260709 12:25:12.548568 25801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:12.549047 25801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:12.550175 25801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.512742 30378 raft_consensus.cc:3055] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:12.536993 29802 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:12.516435 30660 raft_consensus.cc:2749] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:25:12.562475 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:12.574492 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 142348us
I20260709 12:25:12.575045 29802 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:12.576332 26402 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:12.579523 26402 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:12.552119 30442 raft_consensus.cc:2749] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:12.553748 30378 raft_consensus.cc:740] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:12.562830 30559 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:12.568684 30674 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.010s	sys 0.004s
I20260709 12:25:12.570047 30496 raft_consensus.cc:2804] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:12.599606 29802 raft_consensus.cc:2749] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:12.600282 26402 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
W20260709 12:25:12.613417 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:12.630548 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 53625.9us
I20260709 12:25:12.633121 30668 consensus_queue.cc:1048] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:12.634171 25801 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:12.633236 30710 raft_consensus.cc:2749] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:12.633445 30670 raft_consensus.cc:2804] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:12.636535 30670 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:12.636916 30670 raft_consensus.cc:3060] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:12.634191 30718 log.cc:927] Time spent T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 12:25:12.608775 30674 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.011s	sys 0.004s
I20260709 12:25:12.644560 30674 raft_consensus.cc:697] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:12.645117 30696 raft_consensus.cc:2749] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:12.645587 30674 consensus_queue.cc:237] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:12.646524 30689 log.cc:927] Time spent T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.378s	user 0.000s	sys 0.002s
I20260709 12:25:12.647725 25755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 2716) took 1057 ms. Trace:
I20260709 12:25:12.648082 25755 rpcz_store.cc:276] 0709 12:25:11.589913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.590460 (+   547us) service_pool.cc:224] Handling call
0709 12:25:11.686785 (+ 96325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:11.738338 (+ 51553us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:11.738381 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:11.785739 (+ 47358us) log.cc:844] Serialized 26 byte log entry
0709 12:25:12.026322 (+240583us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:12.026357 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:12.329321 (+302964us) spinlock_profiling.cc:243] Waited 51.1 ms on lock 0x7b54001e4e54. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:12.329371 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:12.646136 (+316765us) spinlock_profiling.cc:243] Waited 17.9 ms on lock 0x7b240015afe8. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d968fa9c4 00007f5d968f8acb 00007f5d96ab3dc9 00007f5d96ab3a55 00007f5d96ab309d 00007f5d996e510e 00007f5d996fc88c 00007f5d996fbbb6 00007f5d996fb7d8 00007f5d99705221
0709 12:25:12.647505 (+  1369us) raft_consensus.cc:1685] finished
0709 12:25:12.647527 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:12.647669 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":658,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":17553,"spinlock_wait_cycles":158694016,"thread_start_us":184437,"threads_started":1,"wal-append.queue_time_us":333371}
I20260709 12:25:12.650262 25755 raft_consensus.cc:1275] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:25:12.650471 25762 raft_consensus.cc:1240] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 11 LEADER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:12.632479 26402 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:12.650352 30670 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:12.633327 30720 consensus_queue.cc:1048] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.109s
I20260709 12:25:12.660221 30672 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:12.584141 30691 raft_consensus.cc:2749] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:12.655939 25801 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
W20260709 12:25:12.602053 25726 connection.cc:256] RPC call timeout handler was delayed by -1.5987370249999913s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1985s for a response
I20260709 12:25:12.655162 26402 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:25:12.728473 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 331229us
I20260709 12:25:12.726864 25754 raft_consensus.cc:2468] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 14.
I20260709 12:25:12.766860 25758 raft_consensus.cc:1240] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:12.626693 30660 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.629031 30584 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:25:12.765769 25726 connection.cc:256] RPC call timeout handler was delayed by -1.5555370250003762s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2033s for a response
I20260709 12:25:12.658813 30710 raft_consensus.cc:2804] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:12.672812 30535 raft_consensus.cc:2749] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:25:12.783564 25726 connection.cc:256] RPC call timeout handler was delayed by -1.5483370250003645s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2041s for a response
I20260709 12:25:12.584539 30669 consensus_queue.cc:1048] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.140s
I20260709 12:25:12.785781 25682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40230 (request call id 1741) took 1250 ms. Trace:
W20260709 12:25:12.789774 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 134683us
I20260709 12:25:12.672614 30688 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:12.721334 30393 raft_consensus.cc:697] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 11 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:12.628381 30559 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:12.725041 30496 raft_consensus.cc:697] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
W20260709 12:25:12.799067 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 143241us
W20260709 12:25:12.798187 30667 consensus_meta.cc:287] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 1.219s	user 0.017s	sys 0.008s
I20260709 12:25:12.608788 30694 consensus_queue.cc:1059] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.200s
I20260709 12:25:12.823823 25649 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:12.813088 25801 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:12.825807 25649 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:12.793892 25682 rpcz_store.cc:276] 0709 12:25:11.534869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.966483 (+431614us) service_pool.cc:224] Handling call
0709 12:25:12.001037 (+ 34554us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:12.022438 (+ 21401us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:12.022483 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:12.036950 (+ 14467us) log.cc:844] Serialized 26 byte log entry
0709 12:25:12.372516 (+335566us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:12.769149 (+396633us) log.cc:844] Serialized 14 byte log entry
0709 12:25:12.785443 (+ 16294us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:12.785521 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:12.785562 (+    41us) raft_consensus.cc:1685] finished
0709 12:25:12.785574 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:12.785719 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16443,"prepare.queue_time_us":45703,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":88077,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":7302,"thread_start_us":612900,"threads_started":2,"wal-append.queue_time_us":400448}
I20260709 12:25:12.791294 30710 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:12.873277 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:12.874162 25686 raft_consensus.cc:2468] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 15.
I20260709 12:25:12.796357 30612 raft_consensus.cc:2804] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:25:12.818041 30729 log.cc:927] Time spent T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 12:25:12.813416 30681 log.cc:927] Time spent T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.754s	user 0.001s	sys 0.003s
W20260709 12:25:12.811625 30723 log.cc:927] Time spent T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 12:25:12.805275 30699 raft_consensus.cc:2749] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:12.814421 30657 raft_consensus.cc:3055] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:12.909144 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:12.813310 30584 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:12.916391 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 103379us
I20260709 12:25:12.916498 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:12.929033 25678 raft_consensus.cc:2468] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 12.
I20260709 12:25:12.930940 25677 raft_consensus.cc:2376] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 11. Re-sending same reply.
I20260709 12:25:12.931026 25801 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:12.916498 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:25:12.917598 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:12.918143 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 87226.2us
I20260709 12:25:12.793823 30378 consensus_queue.cc:260] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:12.935506 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:25:12.931401 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 124508us
I20260709 12:25:12.937572 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:12.816627 30722 raft_consensus.cc:3055] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:12.815660 30522 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:12.809891 30717 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.882304 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:12.930300 25763 raft_consensus.cc:1240] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 LEADER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:12.870139 30710 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:12.832132 30661 raft_consensus.cc:2749] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:12.943229 26437 raft_consensus.cc:1275] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:25:12.882521 30535 raft_consensus.cc:2749] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:12.939602 29802 consensus_queue.cc:1048] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:12.936977 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:12.979225 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:12.975630 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:12.980803 26430 raft_consensus.cc:3060] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:12.981072 25759 raft_consensus.cc:3060] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:25:12.981233 25677 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 12.
I20260709 12:25:12.813681 30667 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:12.974889 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:12.926493 30688 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:12.946990 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:12.976925 25754 raft_consensus.cc:1217] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Deduplicated request from leader. Original: 9.6->[11.7-14.8]   Dedup: 11.7->[14.8-14.8]
I20260709 12:25:12.983954 25678 raft_consensus.cc:3060] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:12.986574 25754 raft_consensus.cc:1240] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 14. Current term is 15. Ops: [11.7-14.8]
I20260709 12:25:12.984786 25682 raft_consensus.cc:2393] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 12: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:12.928489 30657 raft_consensus.cc:740] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:12.985381 25755 raft_consensus.cc:1275] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:25:12.808736 30660 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:12.979076 30378 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:12.941936 30442 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:12.978660 30716 log.cc:927] Time spent T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.317s	user 0.000s	sys 0.001s
I20260709 12:25:12.930068 30612 raft_consensus.cc:697] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 9 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:12.989461 29802 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.992146 30393 consensus_queue.cc:237] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:13.011795 30657 consensus_queue.cc:260] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:12.942734 30722 raft_consensus.cc:740] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:12.945267 30715 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.809811 30496 consensus_queue.cc:237] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:13.037802 29802 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:13.039942 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:25:13.040516 25726 connection.cc:256] RPC call timeout handler was delayed by -1.5069370250002976s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20870000000000002s for a response
W20260709 12:25:12.983979 30681 log.cc:927] Time spent T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:25:13.040869 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:25:13.063618 25726 connection.cc:256] RPC call timeout handler was delayed by -1.4889370250002685s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21070000000000003s for a response
I20260709 12:25:13.064541 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:12.978677 30726 raft_consensus.cc:2749] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:25:13.067775 25726 connection.cc:256] RPC call timeout handler was delayed by -1.2161325510001006s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20750000000000002s for a response
W20260709 12:25:13.069938 25726 connection.cc:256] RPC call timeout handler was delayed by -1.172941396999704s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16060000000000002s for a response
W20260709 12:25:13.071324 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 83462.2us
I20260709 12:25:12.942392 30584 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:13.077736 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.080502 25678 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 7.
W20260709 12:25:13.093077 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 117425us
I20260709 12:25:13.095587 25726 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:12.992722 30688 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:13.109211 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:13.065768 30670 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:13.106845 25759 raft_consensus.cc:2468] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 10.
I20260709 12:25:13.090018 30657 raft_consensus.cc:3060] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:13.073805 30695 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:13.159207 30676 raft_consensus.cc:2749] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:13.159235 30695 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:13.160840 30745 log.cc:927] Time spent T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 12:25:13.161676 30695 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:13.070050 30715 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:13.163228 26438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 1215) took 1580 ms. Trace:
I20260709 12:25:13.163591 26438 rpcz_store.cc:276] 0709 12:25:11.583284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.583425 (+   141us) service_pool.cc:224] Handling call
0709 12:25:13.163017 (+1579592us) spinlock_profiling.cc:243] Waited 762 ms on lock 0x7b54006f54d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:13.163146 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1752920320}
I20260709 12:25:13.164517 30715 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:13.067559 30661 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:13.165643 30661 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:13.166054 25650 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
W20260709 12:25:13.166550 30736 log.cc:927] Time spent T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:25:13.167068 30722 consensus_queue.cc:260] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:13.011057 30717 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:13.170243 30717 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:13.172024 30661 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:13.157280 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:13.157930 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 67309.3us
W20260709 12:25:13.176478 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.177961 30739 raft_consensus.cc:2749] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:25:13.158600 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 64696.3us
I20260709 12:25:13.181741 30674 consensus_queue.cc:1059] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:13.180563 25801 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:13.185535 30693 raft_consensus.cc:2749] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:13.186010 25801 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:13.113687 30559 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:13.188126 26430 raft_consensus.cc:2468] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 14.
I20260709 12:25:13.189555 30688 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:13.189869 30676 raft_consensus.cc:3055] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:13.190441 30676 raft_consensus.cc:740] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:13.191479 30676 consensus_queue.cc:260] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:13.198444 30693 raft_consensus.cc:2804] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:25:13.198781 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.198941 30693 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:13.200318 25801 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:13.104597 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:13.211043 25678 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 16.
I20260709 12:25:13.197759 25726 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:13.217974 30693 raft_consensus.cc:3060] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:13.219502 25801 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:13.221451 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:13.225723 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:13.191529 30667 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:13.193349 30491 consensus_meta.cc:287] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.825s	user 0.013s	sys 0.008s
I20260709 12:25:13.228931 25726 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:13.231709 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:13.232621 25836 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 12.
I20260709 12:25:13.233839 25801 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:13.225816 26401 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:13.238876 25760 raft_consensus.cc:1275] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:25:13.236853 25757 raft_consensus.cc:2468] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 11.
I20260709 12:25:13.240264 25829 raft_consensus.cc:1275] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:25:13.242671 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:13.243211 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:13.244009 25828 raft_consensus.cc:2468] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 11.
I20260709 12:25:13.243268 25831 raft_consensus.cc:2468] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 13.
I20260709 12:25:13.245780 25830 raft_consensus.cc:1275] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:25:13.246311 30669 raft_consensus.cc:2804] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:13.234160 30561 consensus_queue.cc:1048] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 12:25:13.245292 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:13.252700 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:13.230368 30674 raft_consensus.cc:2804] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:13.230248 30535 raft_consensus.cc:2804] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:13.228389 30586 raft_consensus.cc:2749] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:13.230592 30715 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:13.271428 25800 leader_election.cc:400] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 election: Vote denied by peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267) with higher term. Message: Invalid argument: T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 13. Current term is 14.
I20260709 12:25:13.271955 25800 leader_election.cc:403] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:25:13.238095 30720 raft_consensus.cc:2749] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:13.384240 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:13.385911 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:13.386619 30739 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.386751 26437 raft_consensus.cc:1240] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 6. Current term is 7. Ops: []
W20260709 12:25:13.387146 30724 log.cc:927] Time spent T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:25:13.381475 30715 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:13.390095 30715 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:13.337656 30661 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.390938 30661 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:13.392781 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 162675us
I20260709 12:25:13.396842 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:13.398022 25759 raft_consensus.cc:2410] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:25:13.399411 30661 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:13.400663 30584 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:13.260984 30674 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:13.401262 30584 raft_consensus.cc:2804] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:13.401769 30584 raft_consensus.cc:697] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 14 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:13.402685 30584 consensus_queue.cc:237] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:13.263077 30535 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:13.404281 30535 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:13.360759 30676 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:13.408716 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 178572us
I20260709 12:25:13.393579 30670 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:13.415367 25757 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53474 (request call id 3100) took 1182 ms (client timeout 1517 ms). Trace:
W20260709 12:25:13.415861 25757 rpcz_store.cc:269] 0709 12:25:12.232683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.232876 (+   193us) service_pool.cc:224] Handling call
0709 12:25:13.415210 (+1182334us) spinlock_profiling.cc:243] Waited 985 ms on lock 0x7b54001db0d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:13.415310 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2266098048}
I20260709 12:25:13.172703 30612 consensus_queue.cc:237] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:13.435392 25726 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:13.387188 30739 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:13.442843 25682 raft_consensus.cc:2410] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:25:13.408411 30674 raft_consensus.cc:3060] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:13.452196 30660 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:13.432062 30661 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.408617 30586 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
W20260709 12:25:13.468830 25761 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.009s	sys 0.014s
W20260709 12:25:13.469475 25761 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.010s	sys 0.014s
I20260709 12:25:13.470491 25761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 3104) took 1070 ms. Trace:
I20260709 12:25:13.481360 30561 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.482106 30561 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:13.504014 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 68689.9us
I20260709 12:25:13.433063 30670 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:13.505700 25726 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:13.468462 30720 raft_consensus.cc:2749] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:13.513584 25726 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
W20260709 12:25:13.514201 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 280448us
I20260709 12:25:13.515192 25801 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:13.460879 30710 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:13.468922 30661 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:13.518898 30735 consensus_queue.cc:1048] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:13.520977 30661 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:13.470811 30586 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:13.523265 30586 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:13.496968 30726 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.505439 30442 raft_consensus.cc:2749] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:13.493230 30667 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:13.529341 30695 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:13.556618 30747 log.cc:927] Time spent T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
W20260709 12:25:13.528774 30252 consensus_meta.cc:287] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 1.099s	user 0.013s	sys 0.000s
I20260709 12:25:13.529327 30735 consensus_queue.cc:1048] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:25:13.529958 30726 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:13.535286 30586 consensus_queue.cc:1048] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:13.536037 30752 raft_consensus.cc:2749] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:13.531558 30754 raft_consensus.cc:3060] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:13.537055 30739 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:13.545351 30535 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:13.549683 30670 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:13.513693 30704 raft_consensus.cc:2749] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:25:13.568305 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 157368us
I20260709 12:25:13.572795 25679 raft_consensus.cc:2468] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 11.
I20260709 12:25:13.525743 30706 consensus_queue.cc:1048] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.043s
W20260709 12:25:13.589802 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:13.591001 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.614563 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:13.566174 30667 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:13.623225 25726 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:25:13.618554 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 152855us
I20260709 12:25:13.580684 30669 raft_consensus.cc:697] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 14 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:13.634774 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:13.635728 30667 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:13.636382 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:13.636580 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:13.639798 25831 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 16.
I20260709 12:25:13.637724 25830 raft_consensus.cc:2468] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 12.
I20260709 12:25:13.614463 30561 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:13.650724 26432 raft_consensus.cc:1240] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:13.585819 30674 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:13.654018 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:13.654695 25834 raft_consensus.cc:1240] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:13.655333 26402 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
W20260709 12:25:13.653404 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 138327us
I20260709 12:25:13.658918 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:13.640857 30660 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.663185 25726 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:13.658418 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:13.644457 30704 raft_consensus.cc:2804] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:13.641284 30548 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:13.665297 26437 raft_consensus.cc:3060] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:13.666412 30739 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:13.670567 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:13.648803 30631 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:13.671343 25726 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
W20260709 12:25:13.674906 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.672976 25801 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:13.695595 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:13.696100 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:13.692143 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:13.698707 25837 raft_consensus.cc:1240] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:13.649844 30720 consensus_queue.cc:1048] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 12:25:13.671885 30704 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:13.744375 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 89103.9us
I20260709 12:25:13.689052 30561 raft_consensus.cc:2764] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:25:13.762084 25833 raft_consensus.cc:1275] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:25:13.762555 26402 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:13.765051 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:13.766685 25837 raft_consensus.cc:1240] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:13.767082 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:13.699924 30706 raft_consensus.cc:2749] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:13.770040 26402 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:25:13.741068 30729 log.cc:927] Time spent T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:25:13.745457 30704 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:13.670308 30660 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:13.688972 30442 consensus_queue.cc:1048] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.082s
I20260709 12:25:13.740893 30763 raft_consensus.cc:2804] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:25:13.765050 30749 log.cc:927] Time spent T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.259s	user 0.000s	sys 0.001s
W20260709 12:25:13.787748 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 117010us
W20260709 12:25:13.798354 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 125927us
I20260709 12:25:13.690861 30739 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:13.778213 25833 raft_consensus.cc:1275] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:25:13.689033 30252 consensus_queue.cc:1059] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.081s
I20260709 12:25:13.749181 30760 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:13.804582 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:13.813822 25801 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:13.814810 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:13.768715 30755 raft_consensus.cc:2804] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:13.818106 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:13.854945 25833 raft_consensus.cc:2468] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 9.
W20260709 12:25:13.812007 30502 consensus_meta.cc:287] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 1.394s	user 0.010s	sys 0.003s
I20260709 12:25:13.841521 25763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 3112) took 1381 ms. Trace:
I20260709 12:25:13.844475 25650 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:25:13.844841 30693 consensus_meta.cc:287] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.597s	user 0.010s	sys 0.000s
I20260709 12:25:13.768898 30737 consensus_queue.cc:1048] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.048s
W20260709 12:25:13.845477 30740 log.cc:927] Time spent T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.751s	user 0.000s	sys 0.015s
I20260709 12:25:13.845085 30760 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:13.845285 30695 raft_consensus.cc:2749] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:13.801566 30667 raft_consensus.cc:2804] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:13.846921 26434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36518 (request call id 1011) took 1851 ms. Trace:
I20260709 12:25:13.783208 30688 raft_consensus.cc:2804] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:13.849907 25837 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 16.
I20260709 12:25:13.856587 25763 rpcz_store.cc:276] 0709 12:25:12.460256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.572065 (+111809us) service_pool.cc:224] Handling call
0709 12:25:12.595688 (+ 23623us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:12.980487 (+384799us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:13.841270 (+860783us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x7b54001e7654. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:13.841455 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":764133248}
I20260709 12:25:13.863399 30450 raft_consensus.cc:2749] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:13.865978 30378 consensus_queue.cc:1059] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:13.866842 30717 consensus_queue.cc:1048] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:25:13.868675 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 54969.1us
I20260709 12:25:13.801800 30715 consensus_queue.cc:1048] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 12:25:13.869704 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:13.857936 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:13.855645 30535 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:13.765550 30669 consensus_queue.cc:237] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:13.876116 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 89241.7us
I20260709 12:25:13.890087 26402 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:13.816650 30726 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:13.846390 30661 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.816012 30763 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:13.884467 25801 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:13.896927 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:13.901404 25677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51578 (request call id 973) took 1024 ms. Trace:
I20260709 12:25:13.945425 25833 raft_consensus.cc:2468] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 9.
W20260709 12:25:13.871070 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 106263us
I20260709 12:25:13.877082 30667 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:13.907761 30739 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:13.909168 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:13.868552 30502 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:13.879458 30688 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:13.924505 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:13.948664 25835 raft_consensus.cc:2468] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 15.
W20260709 12:25:13.937968 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 45213.7us
I20260709 12:25:13.913103 30763 raft_consensus.cc:3060] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:13.902177 30378 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.872576 30693 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:13.939615 30766 log.cc:927] Time spent T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.127s	user 0.003s	sys 0.000s
I20260709 12:25:13.921291 30661 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:13.944088 30762 raft_consensus.cc:2749] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:13.912575 30393 raft_consensus.cc:2804] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:13.945355 25677 rpcz_store.cc:276] 0709 12:25:12.877493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.982120 (+104627us) service_pool.cc:224] Handling call
0709 12:25:12.982477 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:13.013050 (+ 30573us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:25:13.013103 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:13.057038 (+ 43935us) log.cc:844] Serialized 26 byte log entry
0709 12:25:13.252991 (+195953us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:13.253047 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:13.253135 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:13.892737 (+639602us) raft_consensus.cc:1685] finished
0709 12:25:13.892768 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:13.901299 (+  8531us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":474,"raft.queue_time_us":24875,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":5450,"thread_start_us":152485,"threads_started":1,"wal-append.queue_time_us":359648}
I20260709 12:25:13.877365 30755 raft_consensus.cc:697] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 11 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
W20260709 12:25:13.945811 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 61509.8us
I20260709 12:25:13.956465 30535 raft_consensus.cc:2804] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:13.937718 30674 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:13.971541 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:13.978899 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:13.983176 26438 raft_consensus.cc:1240] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 14. Current term is 15. Ops: []
W20260709 12:25:13.967990 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 103869us
I20260709 12:25:13.997978 25837 raft_consensus.cc:2393] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 13: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:13.986720 25683 raft_consensus.cc:1275] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:25:13.955185 30667 raft_consensus.cc:3060] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:13.956815 30688 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:13.953768 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:13.993331 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:13.993399 25828 raft_consensus.cc:1240] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:13.999231 25650 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:14.001003 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:13.995769 25726 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:25:14.003993 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:25:13.985771 30761 log.cc:927] Time spent T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.237s	user 0.001s	sys 0.001s
W20260709 12:25:14.010687 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:13.994581 30559 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.009s	sys 0.011s
I20260709 12:25:14.074386 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:13.985430 30393 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:13.959266 30735 consensus_queue.cc:1048] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 12:25:14.154964 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
W20260709 12:25:14.102097 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 102949us
I20260709 12:25:13.994100 30535 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:13.969213 30378 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:14.122311 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:14.076213 30559 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.009s	sys 0.011s
I20260709 12:25:14.002101 30758 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
W20260709 12:25:14.178956 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 211230us
W20260709 12:25:14.154795 30756 log.cc:927] Time spent T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.242s	user 0.002s	sys 0.000s
I20260709 12:25:14.166002 30393 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:14.190864 25832 raft_consensus.cc:1240] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 13. Current term is 14. Ops: []
W20260709 12:25:14.188597 26437 consensus_meta.cc:287] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.518s	user 0.001s	sys 0.009s
I20260709 12:25:14.193140 25683 raft_consensus.cc:2468] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 12.
I20260709 12:25:14.193344 26437 raft_consensus.cc:2468] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 10.
I20260709 12:25:14.156672 30674 raft_consensus.cc:2804] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:14.165246 30450 raft_consensus.cc:2804] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:14.168864 30726 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:14.199895 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 204198us
W20260709 12:25:14.211032 30753 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.030s	sys 0.019s
W20260709 12:25:14.211508 30753 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.031s	sys 0.019s
W20260709 12:25:14.196300 30748 log.cc:927] Time spent T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.274s	user 0.001s	sys 0.000s
I20260709 12:25:14.183960 30535 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:14.007000 30739 consensus_queue.cc:1048] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.194s
I20260709 12:25:14.193092 30660 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:14.241466 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 231584us
I20260709 12:25:14.242791 25801 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:14.249835 25801 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:14.250617 30762 raft_consensus.cc:2749] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:14.206037 30450 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:14.244334 30772 log.cc:927] Time spent T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 12:25:14.199359 30674 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:14.213410 30737 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:14.265673 30502 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:14.265769 25726 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:25:14.266459 30785 log.cc:927] Time spent T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.320s	user 0.001s	sys 0.000s
I20260709 12:25:14.266556 30693 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:14.245699 30720 consensus_queue.cc:1059] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 12:25:14.272812 30764 raft_consensus.cc:2804] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:14.292057 30764 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:14.292469 30764 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:14.215981 30726 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:14.271644 30450 raft_consensus.cc:3060] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:14.255570 30660 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:14.274101 30770 log.cc:927] Time spent T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.347s	user 0.000s	sys 0.001s
I20260709 12:25:14.252099 30760 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:14.273623 30771 log.cc:927] Time spent T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 12:25:14.198374 30758 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:14.313156 30726 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:14.280815 30674 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:14.293632 30784 log.cc:927] Time spent T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:25:14.287559 30737 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:14.327102 30737 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:14.327262 30754 consensus_meta.cc:287] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.741s	user 0.005s	sys 0.004s
I20260709 12:25:14.327674 30754 raft_consensus.cc:2749] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267) with higher term. Message: Invalid argument: T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 13. Current term is 14.
I20260709 12:25:14.330688 30674 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:14.332841 30674 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:14.335048 30667 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:14.336313 30776 log.cc:927] Time spent T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.331s	user 0.000s	sys 0.001s
W20260709 12:25:14.338165 30769 log.cc:927] Time spent T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.461s	user 0.002s	sys 0.002s
W20260709 12:25:14.338296 30657 consensus_meta.cc:287] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 1.137s	user 0.009s	sys 0.003s
I20260709 12:25:14.320737 30693 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:14.339334 30777 log.cc:927] Time spent T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.377s	user 0.001s	sys 0.001s
I20260709 12:25:14.339591 30693 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:14.334993 25830 raft_consensus.cc:2468] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 14.
I20260709 12:25:14.342183 30693 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:14.349964 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:14.350687 26430 raft_consensus.cc:2468] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 13.
I20260709 12:25:14.355520 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:14.356613 26437 raft_consensus.cc:2393] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 12: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:14.322069 30758 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:14.378013 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:14.386111 29802 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:14.389920 30780 consensus_queue.cc:1048] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:14.347082 30661 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:14.398020 26436 raft_consensus.cc:1240] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:14.378715 26439 raft_consensus.cc:2468] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 15.
I20260709 12:25:14.386801 29802 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:14.348158 30715 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:14.393510 26433 raft_consensus.cc:1275] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:25:14.322466 30660 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:14.435048 30660 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:14.436353 26438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 1232) took 1051 ms. Trace:
I20260709 12:25:14.436738 26438 rpcz_store.cc:276] 0709 12:25:13.384443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.384824 (+   381us) service_pool.cc:224] Handling call
0709 12:25:13.399249 (+ 14425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:13.998067 (+598818us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:14.436140 (+438073us) spinlock_profiling.cc:243] Waited 584 ms on lock 0x7b5400333954. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:14.436297 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1342267648}
I20260709 12:25:14.438898 30252 raft_consensus.cc:3055] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:14.259521 30755 consensus_queue.cc:237] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:14.399564 29802 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:14.406111 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 140415us
I20260709 12:25:14.406665 30720 raft_consensus.cc:2804] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:14.406878 30548 raft_consensus.cc:3055] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:25:14.412474 30788 log.cc:927] Time spent T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:25:14.414912 30450 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:14.420655 30790 log.cc:927] Time spent T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:25:14.391376 30799 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
W20260709 12:25:14.427233 30704 consensus_meta.cc:287] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.611s	user 0.004s	sys 0.004s
I20260709 12:25:14.428668 30667 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:14.431592 30763 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:14.439343 30252 raft_consensus.cc:740] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:14.452395 26438 raft_consensus.cc:1240] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
W20260709 12:25:14.444416 30792 log.cc:927] Time spent T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 12:25:14.455528 26432 raft_consensus.cc:1240] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 14 LEADER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:14.441570 30548 raft_consensus.cc:740] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:14.445151 30720 raft_consensus.cc:697] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:14.450117 30657 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:14.440897 30715 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:14.489677 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 46068.3us
I20260709 12:25:14.495541 29802 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:14.497375 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:14.450776 30704 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:14.454797 30393 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:14.513696 30252 consensus_queue.cc:260] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:14.488770 30657 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:14.515240 30252 raft_consensus.cc:3060] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:14.460618 30799 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:14.527845 30704 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:14.528199 30720 consensus_queue.cc:237] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:13.471671 25761 rpcz_store.cc:276] 0709 12:25:12.399686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.414911 (+ 15225us) service_pool.cc:224] Handling call
0709 12:25:12.415285 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:12.423035 (+  7750us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:25:12.671312 (+248277us) log.cc:844] Serialized 14 byte log entry
0709 12:25:13.470055 (+798743us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:13.470126 (+    71us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:13.470182 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:13.470265 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:13.470418 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":220958,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":28,"raft.queue_time_us":1086,"thread_start_us":915826,"threads_started":2}
I20260709 12:25:14.502295 30548 consensus_queue.cc:260] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:14.501685 30798 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:14.556169 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:14.556913 25759 raft_consensus.cc:2393] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 11: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:14.558634 30668 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.534090 25758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 3114) took 2073 ms. Trace:
I20260709 12:25:14.560541 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:14.534577 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:14.556577 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:14.561818 26436 raft_consensus.cc:3060] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:14.562227 25685 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 14.
I20260709 12:25:14.540797 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:14.538736 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:14.555299 30798 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:14.535000 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:14.548419 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:14.540306 26430 raft_consensus.cc:1240] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:25:14.531306 25650 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:14.550868 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:14.541095 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:14.551219 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:14.551569 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:14.560462 25758 rpcz_store.cc:276] 0709 12:25:12.460888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.643865 (+182977us) service_pool.cc:224] Handling call
0709 12:25:12.766666 (+122801us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:12.769883 (+  3217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:14.533900 (+1764017us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b54001dabd0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b608ad 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:14.534034 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":281538432}
I20260709 12:25:14.561491 25726 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:14.576982 25650 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:14.577304 26437 raft_consensus.cc:1275] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:25:14.579142 26438 raft_consensus.cc:1275] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:25:14.583572 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:14.584125 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:14.584885 25834 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:14.586190 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:14.586884 25833 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:14.588269 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:13.877173 26434 rpcz_store.cc:276] 0709 12:25:11.995044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.995178 (+   134us) service_pool.cc:224] Handling call
0709 12:25:12.018333 (+ 23155us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:12.018533 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:25:12.132829 (+114296us) log.cc:844] Serialized 14 byte log entry
0709 12:25:13.619820 (+1486991us) spinlock_profiling.cc:243] Waited 21.5 ms on lock 0x7b1800371740. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d96a56e07 00007f5d9f8b19a9 00007f5d96a7369b 00007f5d96a7193f 00007f5d96a73c02 00007f5d996fb20b 00007f5d99700d23 00007f5d9970123a 00007f5d99b6ba2a
0709 12:25:13.846338 (+226518us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:13.846412 (+    74us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:13.846477 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:13.846685 (+   208us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:13.846849 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":128955,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":58,"raft.queue_time_us":7525,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":11890,"spinlock_wait_cycles":49474944,"thread_start_us":271232,"threads_started":2}
I20260709 12:25:14.529397 30657 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:14.529685 30393 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:14.595309 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:14.544585 30450 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:14.552955 30548 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:14.529079 30715 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:14.614934 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:14.616068 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:14.617025 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:14.617920 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:14.618484 26434 raft_consensus.cc:2468] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 12.
I20260709 12:25:14.619145 30801 raft_consensus.cc:2749] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:14.619503 25834 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 17.
I20260709 12:25:14.603587 25685 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:14.565558 30795 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.545449 30799 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:14.576608 30704 raft_consensus.cc:2749] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:14.636790 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:14.565719 30668 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:14.588497 30753 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.644788 25685 raft_consensus.cc:2468] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 14.
I20260709 12:25:14.543879 30764 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:14.641533 26436 raft_consensus.cc:2410] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:25:14.549839 30535 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:14.652747 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:14.656549 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:14.658705 25683 raft_consensus.cc:2393] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 10: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:14.658774 25685 raft_consensus.cc:3060] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:14.654394 30798 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:14.666667 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:14.667269 25683 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:14.644340 30763 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:14.643003 30796 raft_consensus.cc:2804] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:14.670135 30764 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:14.676065 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:14.697268 26436 raft_consensus.cc:2468] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 12.
I20260709 12:25:14.676160 25650 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:25:14.678036 30688 consensus_meta.cc:287] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.513s	user 0.007s	sys 0.002s
I20260709 12:25:14.658463 30704 consensus_queue.cc:1059] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:25:14.679018 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:14.611078 30561 consensus_queue.cc:1059] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:25:14.656085 30753 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:14.703467 26434 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 11.
I20260709 12:25:14.703483 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:14.704486 26437 raft_consensus.cc:2468] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 10.
I20260709 12:25:14.666432 25726 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:14.698671 25833 raft_consensus.cc:2468] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 13.
I20260709 12:25:14.687670 25683 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 17.
I20260709 12:25:14.705399 26433 raft_consensus.cc:1275] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:25:14.706971 25835 raft_consensus.cc:1240] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:25:14.709769 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:14.711951 25650 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:14.715504 29802 raft_consensus.cc:2804] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:14.715883 29802 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:14.716295 29802 raft_consensus.cc:3060] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:14.718467 30799 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.720531 30799 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:14.721786 30704 raft_consensus.cc:3055] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:14.722204 30704 raft_consensus.cc:740] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:14.722666 30799 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:14.723044 30704 consensus_queue.cc:260] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:14.724185 30720 raft_consensus.cc:3055] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:14.724566 30720 raft_consensus.cc:740] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:14.702916 30798 raft_consensus.cc:2804] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:14.725353 30798 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:14.725823 30798 raft_consensus.cc:3060] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:14.725365 30720 consensus_queue.cc:260] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:14.726924 30720 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:14.646107 30795 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:14.729550 30795 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:14.730119 30631 raft_consensus.cc:3055] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:14.730531 30631 raft_consensus.cc:740] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:14.731271 30753 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:14.707891 30688 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:14.732638 30378 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:14.733065 26435 raft_consensus.cc:2393] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 12: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:14.711135 30796 raft_consensus.cc:697] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 10 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
W20260709 12:25:14.738801 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 72487.7us
I20260709 12:25:14.739032 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:14.748358 30794 raft_consensus.cc:2804] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:14.753136 30794 raft_consensus.cc:697] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:14.754073 30794 consensus_queue.cc:237] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:14.749717 25726 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:14.755741 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:14.757447 26436 raft_consensus.cc:1240] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:14.750609 25685 raft_consensus.cc:2468] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 11.
I20260709 12:25:14.760507 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:14.765312 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:14.766134 26436 raft_consensus.cc:2376] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 14. Re-sending same reply.
I20260709 12:25:14.731375 30631 consensus_queue.cc:260] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:14.777076 25682 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40230 (request call id 1773) took 1785 ms (client timeout 2144 ms). Trace:
I20260709 12:25:14.777489 25830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44218 (request call id 1856) took 1133 ms. Trace:
I20260709 12:25:14.777889 25830 rpcz_store.cc:276] 0709 12:25:13.643963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.644087 (+   124us) service_pool.cc:224] Handling call
0709 12:25:14.777341 (+1133254us) spinlock_profiling.cc:243] Waited 673 ms on lock 0x7b5400387cd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:14.777439 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1549041536}
I20260709 12:25:14.778676 25680 raft_consensus.cc:1240] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 9. Current term is 10. Ops: []
W20260709 12:25:14.777530 25682 rpcz_store.cc:269] 0709 12:25:13.011085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.092342 (+ 81257us) service_pool.cc:224] Handling call
0709 12:25:14.776863 (+1684521us) spinlock_profiling.cc:243] Waited 328 ms on lock 0x7b5400159d54. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:14.777019 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":754094976}
I20260709 12:25:14.784482 25686 raft_consensus.cc:1275] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:25:14.760921 30561 raft_consensus.cc:2804] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:14.785706 30688 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:14.822474 30815 log.cc:927] Time spent T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:25:14.824296 30631 raft_consensus.cc:3060] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:14.824082 30796 consensus_queue.cc:237] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:14.783957 30378 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:14.826565 30378 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:14.783413 30252 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.828603 30378 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:14.828490 30252 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:14.829243 30561 raft_consensus.cc:697] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:14.830135 30561 consensus_queue.cc:237] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:14.830495 30252 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:14.783242 30704 raft_consensus.cc:3060] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:14.832075 25754 raft_consensus.cc:2468] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 12.
I20260709 12:25:14.780771 30799 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.833889 30799 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:14.841285 30808 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.841912 30808 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:14.845574 30535 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:14.847132 30753 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.847748 30753 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:14.850091 30753 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:14.862969 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:14.876865 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:14.878647 29802 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:14.900276 30799 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:14.908732 29802 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:14.912473 25686 raft_consensus.cc:1240] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 12. Current term is 13. Ops: []
W20260709 12:25:14.913838 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:14.914764 30808 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:14.919219 25682 raft_consensus.cc:1275] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 12:25:14.947221 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:14.980607 26436 raft_consensus.cc:1240] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:14.982542 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:14.983317 26436 raft_consensus.cc:3060] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:15.041038 25758 raft_consensus.cc:1275] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:25:15.043995 30631 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.044703 30631 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:15.047277 30631 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:14.986186 30798 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:15.086988 30798 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:15.118520 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:15.141273 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 383356us
I20260709 12:25:15.149840 26436 raft_consensus.cc:2468] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 13.
I20260709 12:25:15.153630 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:15.155403 25835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44218 (request call id 1861) took 1202 ms. Trace:
I20260709 12:25:15.155759 25835 rpcz_store.cc:276] 0709 12:25:13.952924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.953069 (+   145us) service_pool.cc:224] Handling call
0709 12:25:13.953386 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:14.713954 (+760568us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:15.155221 (+441267us) spinlock_profiling.cc:243] Waited 751 ms on lock 0x7b5400105254. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:15.155359 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1726722816}
I20260709 12:25:15.158674 25683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40230 (request call id 1783) took 1193 ms. Trace:
I20260709 12:25:15.159152 25683 rpcz_store.cc:276] 0709 12:25:13.965426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.711983 (+746557us) service_pool.cc:224] Handling call
0709 12:25:14.712365 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:14.712633 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:25:15.120209 (+407576us) log.cc:844] Serialized 14 byte log entry
0709 12:25:15.158013 (+ 37804us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:15.158082 (+    69us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:15.158294 (+   212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:15.158397 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:15.158601 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":108,"thread_start_us":421434,"threads_started":2}
I20260709 12:25:15.164196 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:15.165448 30704 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:15.166500 30704 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:15.167296 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:15.167816 26438 raft_consensus.cc:3060] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:15.168002 30674 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.168479 30704 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:15.168599 30674 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:15.170965 30674 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:15.174697 30722 raft_consensus.cc:3060] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:15.181327 25650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:15.184886 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:15.190717 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:15.191376 26438 raft_consensus.cc:2468] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 13.
I20260709 12:25:15.192750 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:15.193315 25761 raft_consensus.cc:2468] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 11.
I20260709 12:25:15.194042 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:15.191334 25756 raft_consensus.cc:2468] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 15.
I20260709 12:25:15.195385 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:15.194519 25761 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 14.
I20260709 12:25:15.198230 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:15.198463 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:15.199636 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:15.199940 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:15.201284 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:15.202092 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:15.191823 30548 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:15.200955 30561 consensus_queue.cc:1059] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 12:25:15.213521 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:15.215118 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:15.218488 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:15.215746 25758 raft_consensus.cc:2468] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 15.
I20260709 12:25:15.220191 26438 raft_consensus.cc:1240] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:15.219125 25756 raft_consensus.cc:2468] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 14.
I20260709 12:25:15.221441 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:15.221176 30548 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:15.257385 30796 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:15.276811 26432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 1224) took 1620 ms. Trace:
I20260709 12:25:15.277299 26432 rpcz_store.cc:276] 0709 12:25:13.656685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.661489 (+  4804us) service_pool.cc:224] Handling call
0709 12:25:13.661852 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:14.458274 (+796422us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:15.276456 (+818182us) spinlock_profiling.cc:243] Waited 793 ms on lock 0x7b5400600254. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:15.276744 (+   288us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1824725760}
I20260709 12:25:15.280838 30710 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:15.284188 30548 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:15.285895 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:15.287084 30808 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:15.288056 30764 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.288511 30764 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:15.289529 30801 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.290052 30801 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:15.290632 30764 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:15.281025 30796 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:15.287601 30808 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:15.304404 30794 consensus_queue.cc:1048] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:15.304653 30561 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:15.305404 30561 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:15.305997 25679 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51578 (request call id 956) took 4078 ms (client timeout 1561 ms). Trace:
W20260709 12:25:15.306396 25679 rpcz_store.cc:269] 0709 12:25:11.220178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.247349 (+ 27171us) service_pool.cc:224] Handling call
0709 12:25:15.297979 (+4050630us) spinlock_profiling.cc:243] Waited 2.32 s on lock 0x7b54002cf6d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:15.298105 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5345406720}
I20260709 12:25:15.307374 30561 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:15.307534 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:15.310176 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:15.308444 25683 raft_consensus.cc:1275] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:25:15.313661 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:15.314185 25683 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:15.316612 25684 raft_consensus.cc:1275] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:25:15.304648 30821 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:15.317830 25677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40230 (request call id 1784) took 1352 ms. Trace:
I20260709 12:25:15.318298 25677 rpcz_store.cc:276] 0709 12:25:13.965705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.736606 (+770901us) service_pool.cc:224] Handling call
0709 12:25:14.736933 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:14.742473 (+  5540us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:25:15.145288 (+402815us) log.cc:844] Serialized 14 byte log entry
0709 12:25:15.305587 (+160299us) log.cc:844] Serialized 14 byte log entry
0709 12:25:15.305762 (+   175us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:15.306186 (+   424us) log.cc:844] Serialized 26 byte log entry
0709 12:25:15.306302 (+   116us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:15.306344 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:15.306404 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:15.317556 (+ 11152us) raft_consensus.cc:1685] finished
0709 12:25:15.317593 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:15.317754 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37356,"prepare.queue_time_us":573327,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":58,"raft.queue_time_us":3235,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":7784,"thread_start_us":457883,"threads_started":2,"wal-append.queue_time_us":96299}
I20260709 12:25:15.323251 25726 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:15.323323 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:15.326606 25677 raft_consensus.cc:1275] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:25:15.326670 25726 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:15.332520 25683 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 15.
I20260709 12:25:15.293061 30764 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.321632 30561 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
W20260709 12:25:15.353802 25649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:15.334195 30794 raft_consensus.cc:2804] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:15.342262 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:15.349025 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:15.349563 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:15.350065 26402 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:15.350767 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:15.297859 30753 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:15.353153 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:15.354346 25649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:15.365444 25649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:15.321846 30581 consensus_queue.cc:1059] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:25:15.339505 30735 raft_consensus.cc:2804] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:15.358511 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:15.333436 30821 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:15.368958 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:15.369082 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:15.369683 25755 raft_consensus.cc:2468] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 12.
I20260709 12:25:15.367070 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:15.338925 25679 raft_consensus.cc:2468] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 9.
I20260709 12:25:15.370666 25760 raft_consensus.cc:2468] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 11.
I20260709 12:25:15.355001 30631 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.376549 25649 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:15.356462 30794 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:15.343204 30720 consensus_queue.cc:1059] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 12:25:15.343341 30674 consensus_queue.cc:1048] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:25:15.382038 25649 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:15.351599 30704 consensus_queue.cc:1059] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 12:25:15.382663 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:15.369449 30735 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:15.386941 25649 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:25:15.389150 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 47975.6us
I20260709 12:25:15.392200 25726 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:15.356220 30764 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:15.359259 30561 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:15.398828 25650 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:15.382485 30794 raft_consensus.cc:3060] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:15.382611 30722 raft_consensus.cc:2764] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:25:15.401266 25650 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:15.395032 25649 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:15.378926 30613 raft_consensus.cc:2749] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:15.375749 30717 consensus_queue.cc:1048] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:25:15.369307 30753 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:15.393240 30735 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:15.393034 30378 raft_consensus.cc:2804] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:15.380911 30111 consensus_queue.cc:1059] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 12:25:15.383900 30710 consensus_queue.cc:1048] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 12:25:15.413291 30834 raft_consensus.cc:2749] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:15.413620 25650 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:15.414041 30821 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:15.414232 30722 raft_consensus.cc:2749] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:15.415611 30668 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:15.415949 25649 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:15.416970 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:15.441165 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:15.441790 25679 raft_consensus.cc:2468] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 11.
I20260709 12:25:15.442612 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:15.394305 30252 raft_consensus.cc:2804] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:15.444180 30252 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:15.444572 30252 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:15.445256 30764 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:15.446686 30764 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:15.447166 30764 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:15.458284 30561 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:15.465731 30794 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:15.469556 30252 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:15.470417 25678 raft_consensus.cc:1275] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:15.477766 30706 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:15.478078 30674 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.478412 30706 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:15.383129 26402 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:15.381611 30669 consensus_queue.cc:1048] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 12:25:15.423195 30798 raft_consensus.cc:2804] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:15.428064 30378 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:15.478518 30674 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:15.479627 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:15.381680 30631 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:15.420099 30808 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:15.482860 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:15.484133 25678 raft_consensus.cc:1275] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
W20260709 12:25:15.487788 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 74226.9us
W20260709 12:25:15.497861 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 212850us
W20260709 12:25:15.487908 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 72042.9us
I20260709 12:25:15.500385 25649 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:15.489420 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:15.408957 30799 raft_consensus.cc:2804] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:15.490602 29802 raft_consensus.cc:2804] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:15.507519 29802 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:15.493145 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 100630us
I20260709 12:25:15.507899 29802 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:25:15.497402 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 115010us
I20260709 12:25:15.508903 26402 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:15.411895 30661 consensus_queue.cc:1048] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.082s
I20260709 12:25:15.515496 25761 raft_consensus.cc:1275] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:25:15.515702 25726 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:15.511878 26434 raft_consensus.cc:1240] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:25:15.516929 25726 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:15.513664 26401 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:15.467788 30794 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:15.492594 30378 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:15.492583 30657 raft_consensus.cc:2804] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:15.471813 30252 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:15.536168 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:15.537338 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:15.523305 30561 raft_consensus.cc:2749] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:15.540021 30695 raft_consensus.cc:2804] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:25:15.541383 30793 log.cc:927] Time spent T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 1.285s	user 0.008s	sys 0.005s
I20260709 12:25:15.541832 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:15.544447 30752 consensus_queue.cc:1059] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:25:15.546551 25686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40230 (request call id 1788) took 1052 ms. Trace:
I20260709 12:25:15.498647 30753 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:15.498811 30798 raft_consensus.cc:697] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 13 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:15.550541 25801 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:15.609344 26434 raft_consensus.cc:2468] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 12.
I20260709 12:25:15.609880 26436 raft_consensus.cc:3060] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:15.507289 30799 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:15.549059 30764 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:15.500885 30668 raft_consensus.cc:2804] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:15.556799 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:15.645107 26437 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 12.
I20260709 12:25:15.643564 25677 raft_consensus.cc:2468] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 12.
I20260709 12:25:15.515992 30717 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:15.553964 30631 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:15.520442 30613 raft_consensus.cc:2804] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:15.551136 30522 raft_consensus.cc:3055] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:15.547835 30787 raft_consensus.cc:2764] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:25:15.651746 26436 raft_consensus.cc:2468] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 14.
I20260709 12:25:15.633085 25686 rpcz_store.cc:276] 0709 12:25:14.493800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.787086 (+293286us) service_pool.cc:224] Handling call
0709 12:25:14.787476 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:14.913023 (+125547us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:15.546319 (+633296us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b54002648d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:15.546489 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":286868864}
I20260709 12:25:15.523583 30691 raft_consensus.cc:2749] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:15.608772 30794 consensus_queue.cc:1059] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 12:25:15.690662 30794 raft_consensus.cc:3055] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:15.691121 30794 raft_consensus.cc:740] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:15.692212 30535 raft_consensus.cc:3055] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:15.692714 30535 raft_consensus.cc:740] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:15.692140 30794 consensus_queue.cc:260] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:15.551467 30829 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.693630 30535 consensus_queue.cc:260] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:15.694097 30829 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:15.660780 30548 raft_consensus.cc:3055] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:15.661347 25680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2514) took 1168 ms. Trace:
I20260709 12:25:15.662106 25684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40230 (request call id 1775) took 1708 ms. Trace:
I20260709 12:25:15.699765 26435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36508 (request call id 1240) took 1144 ms. Trace:
I20260709 12:25:15.664268 30796 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:15.744764 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 244441us
I20260709 12:25:15.638963 29802 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:15.509891 30111 consensus_queue.cc:1059] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.132s
I20260709 12:25:15.550171 30706 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:15.677887 30764 raft_consensus.cc:2804] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:15.678407 30801 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:15.552696 30674 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:15.688450 30613 raft_consensus.cc:697] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 9 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:15.642656 30799 raft_consensus.cc:3060] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:15.701365 26433 raft_consensus.cc:1240] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:15.699975 30794 raft_consensus.cc:3060] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:15.699368 25684 rpcz_store.cc:276] 0709 12:25:13.954144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.958435 (+  4291us) service_pool.cc:224] Handling call
0709 12:25:15.298201 (+1339766us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:15.317075 (+ 18874us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:15.661867 (+344792us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54002cf6d0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b608ad 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:15.662036 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3080337280}
I20260709 12:25:15.699290 25680 rpcz_store.cc:276] 0709 12:25:14.493254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.779446 (+286192us) service_pool.cc:224] Handling call
0709 12:25:14.779745 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:14.788778 (+  9033us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:14.788809 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:14.840215 (+ 51406us) log.cc:844] Serialized 26 byte log entry
0709 12:25:15.434458 (+594243us) spinlock_profiling.cc:243] Waited 7.39 ms on lock 0x7b180036a360. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d96a56e07 00007f5d9f8b19a9 00007f5d96a7369b 00007f5d96a7193f 00007f5d96a73c02 00007f5d996fb20b 00007f5d99700d23 00007f5d997010d1 00007f5d99b1ca0f
0709 12:25:15.636108 (+201650us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:15.636159 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:15.636227 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:15.658345 (+ 22118us) raft_consensus.cc:1685] finished
0709 12:25:15.661074 (+  2729us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:15.661290 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3995,"raft.queue_time_us":10273,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":91,"spinlock_wait_cycles":16986880,"thread_start_us":199476,"threads_started":1,"wal-append.queue_time_us":816312}
I20260709 12:25:15.643168 30753 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.768850 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:15.768852 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:15.771049 25761 raft_consensus.cc:2410] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:25:15.712682 25650 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:15.700187 26435 rpcz_store.cc:276] 0709 12:25:14.555757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.560265 (+  4508us) service_pool.cc:224] Handling call
0709 12:25:15.699564 (+1139299us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b54005645d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:15.699708 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":394874240}
I20260709 12:25:15.737334 26430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36518 (request call id 1022) took 1385 ms. Trace:
W20260709 12:25:15.771883 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 59331.6us
I20260709 12:25:15.237401 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:15.743578 25754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48606 (request call id 1237) took 1207 ms. Trace:
I20260709 12:25:15.634140 30821 consensus_queue.cc:1059] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.081s
I20260709 12:25:15.771817 26430 rpcz_store.cc:276] 0709 12:25:14.352200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.376310 (+ 24110us) service_pool.cc:224] Handling call
0709 12:25:14.433325 (+ 57015us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:14.567384 (+134059us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:15.737059 (+1169675us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b54007cabd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:15.737261 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":245457792}
I20260709 12:25:15.757862 29802 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:15.695779 30762 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:15.670921 30522 raft_consensus.cc:740] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:15.673645 30668 raft_consensus.cc:697] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 15 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
W20260709 12:25:15.756551 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 229069us
I20260709 12:25:15.698503 30548 raft_consensus.cc:740] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:15.792687 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:15.757266 30111 consensus_queue.cc:1243] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer a866ff967d964388a6f0dff7fd43df89 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:25:15.796466 26437 raft_consensus.cc:1275] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:15.766774 25681 raft_consensus.cc:3055] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:15.797752 25681 raft_consensus.cc:740] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:15.798841 29802 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.799312 29802 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:15.799816 25649 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:15.774516 26402 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:15.773615 25754 rpcz_store.cc:276] 0709 12:25:14.536611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.540866 (+  4255us) service_pool.cc:224] Handling call
0709 12:25:15.743373 (+1202507us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b54001004d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:15.743502 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":606896000}
I20260709 12:25:15.695039 30535 raft_consensus.cc:3060] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:15.759330 30793 log.cc:927] Time spent T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:25:15.669905 30717 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:15.759516 30764 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:15.819234 29802 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:15.782711 30801 raft_consensus.cc:2804] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:15.824335 25649 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:15.820905 30764 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:15.826004 30522 consensus_queue.cc:260] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:15.827471 30522 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:15.787097 30670 consensus_queue.cc:1048] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 12:25:15.831444 30561 consensus_queue.cc:1048] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:15.834033 30720 raft_consensus.cc:3055] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:15.824697 30801 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:15.820447 30735 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:15.830804 30829 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:15.837742 30717 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:15.844525 30613 consensus_queue.cc:237] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:15.845954 30836 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:15.846942 30669 raft_consensus.cc:2749] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:15.846446 25681 consensus_queue.cc:260] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:15.824229 30667 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:15.830250 30111 raft_consensus.cc:2749] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:15.862483 25649 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
W20260709 12:25:15.865406 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:15.782910 30753 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:15.860788 30657 raft_consensus.cc:697] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 13 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:15.893594 25681 raft_consensus.cc:3060] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:15.794148 30661 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.822034 30706 consensus_queue.cc:1059] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 12:25:15.779572 30798 consensus_queue.cc:237] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:15.864854 30801 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:15.862365 30720 raft_consensus.cc:740] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:15.864583 30843 raft_consensus.cc:2804] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:15.907888 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:15.909072 25678 raft_consensus.cc:1275] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:25:15.913384 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:15.914611 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:15.914947 29802 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.916438 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
W20260709 12:25:15.916635 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 366199us
I20260709 12:25:15.919198 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:15.795239 30762 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:15.920302 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:15.915417 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:15.981752 25830 raft_consensus.cc:2468] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 11.
I20260709 12:25:15.905030 30695 raft_consensus.cc:697] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:15.924749 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:15.927331 25759 raft_consensus.cc:1240] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:25:15.904138 30836 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:15.928493 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:15.942942 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:15.891508 30829 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:15.977679 25801 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:15.947194 25835 raft_consensus.cc:1240] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:16.039397 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:15.924139 30796 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:16.049320 25649 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.23.245.190:45099, user_credentials={real_user=slave}} blocked reactor thread for 45595.1us
I20260709 12:25:15.977633 25677 raft_consensus.cc:2368] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 15. Current term is 16.
I20260709 12:25:15.982007 25756 raft_consensus.cc:2468] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 11.
I20260709 12:25:15.921469 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:15.983614 25762 raft_consensus.cc:1240] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 LEADER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:16.050711 25761 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:15.943017 25726 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:15.984294 25763 raft_consensus.cc:1275] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:15.905809 30667 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:15.918118 30717 raft_consensus.cc:2804] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:15.984246 29802 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:16.034827 25678 raft_consensus.cc:3055] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:16.036065 25681 raft_consensus.cc:1275] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 12:25:16.052584 25681 pending_rounds.cc:85] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc: Aborting all ops after (but not including) 10
I20260709 12:25:16.052901 25681 pending_rounds.cc:107] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 12:25:16.053194 25681 raft_consensus.cc:2889] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:16.054445 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:25:16.041294 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 63689.7us
I20260709 12:25:16.056464 25801 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:16.033867 25682 raft_consensus.cc:2468] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 11.
I20260709 12:25:16.048660 26437 raft_consensus.cc:2393] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 13: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:15.979619 25757 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:16.052513 25678 raft_consensus.cc:740] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:15.944687 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:15.981596 30787 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:16.058643 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:16.063978 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:16.058517 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:16.059762 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:25:16.062494 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 309449us
I20260709 12:25:15.957243 30845 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.065586 25835 raft_consensus.cc:1240] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 12. Current term is 13. Ops: []
W20260709 12:25:16.080776 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 299515us
I20260709 12:25:16.069090 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:15.925284 30661 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:16.040464 30669 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:15.977362 30843 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:16.080636 25678 consensus_queue.cc:260] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:16.089632 25678 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:16.088685 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:16.090708 25682 raft_consensus.cc:2468] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 11.
W20260709 12:25:16.065269 30722 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 12:25:16.079073 30581 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.056253 30753 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:16.092248 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:16.093261 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:16.096400 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:16.091145 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:16.057344 30717 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:16.097332 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:16.094724 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:16.079313 30787 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:16.106948 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:16.098037 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:16.102594 26434 raft_consensus.cc:2468] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 11.
W20260709 12:25:16.098795 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:15.923640 30668 consensus_queue.cc:237] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:16.103299 25835 raft_consensus.cc:2468] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 14.
I20260709 12:25:16.107889 26433 raft_consensus.cc:2468] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 12.
I20260709 12:25:16.002861 30657 consensus_queue.cc:237] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:16.105829 25712 heartbeater.cc:646] Failed to heartbeat to 127.23.245.190:45099 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.23.245.190:45099 timed out after 15.000s (SENT)
I20260709 12:25:16.129319 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:16.065416 30796 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:16.101730 30834 raft_consensus.cc:2804] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:16.132663 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:16.092437 30843 raft_consensus.cc:3060] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:16.107014 30717 raft_consensus.cc:3060] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:16.061553 30829 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:16.108800 30612 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.130055 25681 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:16.081003 30845 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:16.145648 26401 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:16.097090 30669 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:16.134438 30753 raft_consensus.cc:2749] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:16.121789 30851 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.146979 25686 raft_consensus.cc:1240] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:16.098363 30695 consensus_queue.cc:237] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:16.152055 25828 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 11.
I20260709 12:25:16.153517 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:16.108160 30581 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:16.133009 30834 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:16.196364 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:16.146329 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:16.126741 25678 raft_consensus.cc:1275] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:25:16.177310 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 111029us
I20260709 12:25:16.163342 25761 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 15.
W20260709 12:25:16.125365 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 350885us
I20260709 12:25:16.136236 30735 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:16.137028 30853 raft_consensus.cc:2749] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:16.206176 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:16.206321 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:16.206905 25830 raft_consensus.cc:2393] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 14: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:16.198758 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:16.198727 25835 raft_consensus.cc:3060] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:16.200001 25681 raft_consensus.cc:2410] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:25:16.199584 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:16.208632 25678 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:16.216580 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:16.217576 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:25:16.218218 30848 log.cc:927] Time spent T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
I20260709 12:25:16.218442 25832 raft_consensus.cc:2393] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 16: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:16.219357 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:25:16.219748 30844 log.cc:927] Time spent T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.238s	user 0.000s	sys 0.001s
I20260709 12:25:16.220265 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:16.221019 25837 raft_consensus.cc:2393] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 17: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:16.221371 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:16.221792 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:16.221936 25829 raft_consensus.cc:2468] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 11.
I20260709 12:25:16.222796 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:16.224468 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:16.224763 25685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40230 (request call id 1785) took 2258 ms. Trace:
I20260709 12:25:16.225034 25832 raft_consensus.cc:2468] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 11.
I20260709 12:25:16.225122 25685 rpcz_store.cc:276] 0709 12:25:13.966018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.761304 (+795286us) service_pool.cc:224] Handling call
0709 12:25:14.761580 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:14.763488 (+  1908us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:25:15.286621 (+523133us) spinlock_profiling.cc:243] Waited 1.39 ms on lock 0x7b18002b2700. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d969eec0a 00007f5da012e219 00007f5d96a76a40 00007f5d96a714e4 00007f5d96a71455 00007f5d9d5593c7 00007f5d99b6b9a7 00007f5d99b7b0bf 00007f5d99b7b038
0709 12:25:15.479835 (+193214us) log.cc:844] Serialized 14 byte log entry
0709 12:25:15.761374 (+281539us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:15.805865 (+ 44491us) log.cc:844] Serialized 26 byte log entry
0709 12:25:15.806585 (+   720us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:15.807000 (+   415us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:15.807543 (+   543us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:16.219218 (+411675us) spinlock_profiling.cc:243] Waited 49.2 ms on lock 0x7b4400022b4c. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db 00007f5d99708aaf 00007f5d996fc86e 00007f5d996fbbb6 00007f5d996fb7d8 00007f5d99705221 00007f5d997051d9 00007f5d99705169
0709 12:25:16.224568 (+  5350us) raft_consensus.cc:1685] finished
0709 12:25:16.224589 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:16.224711 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15643,"prepare.queue_time_us":530346,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":1809,"raft.queue_time_us":614,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":23155,"spinlock_wait_cycles":116411520,"thread_start_us":377436,"threads_started":2,"wal-append.queue_time_us":392796}
I20260709 12:25:16.227632 25685 raft_consensus.cc:1275] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:25:16.223845 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:16.229696 30674 raft_consensus.cc:3055] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:16.230108 30674 raft_consensus.cc:740] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:16.230892 30674 consensus_queue.cc:260] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:16.222817 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:16.232784 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:16.233212 25829 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:25:16.233568 25836 raft_consensus.cc:2468] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 13.
I20260709 12:25:16.193910 30794 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.237685 25835 raft_consensus.cc:2468] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 10.
I20260709 12:25:16.239526 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:16.240828 26402 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
W20260709 12:25:16.204907 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 148528us
I20260709 12:25:16.196301 30834 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:16.247938 25801 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:25:16.249413 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 192086us
W20260709 12:25:16.250545 25650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:16.251454 25678 raft_consensus.cc:2468] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 16.
I20260709 12:25:16.260095 25836 raft_consensus.cc:1275] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:25:16.245913 25679 raft_consensus.cc:1240] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:16.262382 25801 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:16.265447 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:16.145032 30612 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:16.270171 25801 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:16.122087 30720 consensus_queue.cc:260] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:16.253170 30674 raft_consensus.cc:3060] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:16.312641 25649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:16.277544 25650 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:16.242069 30726 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
W20260709 12:25:16.314911 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 372004us
I20260709 12:25:16.316212 25726 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:16.279347 26402 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:16.280649 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:16.281625 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:16.197957 30857 raft_consensus.cc:2804] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:16.275372 30752 raft_consensus.cc:2804] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:16.318943 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:16.319326 25726 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:16.322568 25835 raft_consensus.cc:1275] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:25:16.276839 30753 raft_consensus.cc:2749] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:16.283970 30799 consensus_meta.cc:287] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.502s	user 0.013s	sys 0.000s
I20260709 12:25:16.319703 25650 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:16.195809 30851 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:16.329190 25829 raft_consensus.cc:2468] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 16.
I20260709 12:25:16.266234 30860 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:16.332407 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:16.343262 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:25:16.309739 30378 consensus_meta.cc:287] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.665s	user 0.009s	sys 0.003s
I20260709 12:25:16.319705 25831 raft_consensus.cc:2468] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 12.
I20260709 12:25:16.278764 30850 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:16.284440 30853 raft_consensus.cc:2804] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:16.334719 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:16.320581 26402 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:16.336889 25679 raft_consensus.cc:1240] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:25:16.340114 25801 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:16.351661 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:16.316576 30668 raft_consensus.cc:2749] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:16.312805 30836 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:16.268038 30849 consensus_queue.cc:1048] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 12:25:16.369406 25837 raft_consensus.cc:2468] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 12.
I20260709 12:25:16.249802 30794 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:16.342293 30561 consensus_queue.cc:1059] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 12:25:16.336102 30720 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:16.363301 30710 raft_consensus.cc:2764] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:25:16.388849 30710 raft_consensus.cc:2749] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:16.388919 30612 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:16.323518 30857 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:16.389984 30857 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:16.391708 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:16.391902 30872 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:16.392047 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:16.392505 30872 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:16.392915 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:16.330153 30837 raft_consensus.cc:2804] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:16.393139 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:16.393502 26435 raft_consensus.cc:2468] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 10.
I20260709 12:25:16.393741 25828 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:16.394730 30872 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:16.394814 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:25:16.395596 30859 log.cc:927] Time spent T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:25:16.396168 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:16.354306 30378 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:16.396903 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:16.397619 25681 raft_consensus.cc:2368] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 15. Current term is 16.
I20260709 12:25:16.339258 30735 raft_consensus.cc:2804] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:16.382943 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:16.402493 25685 raft_consensus.cc:2468] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 10.
I20260709 12:25:16.338604 30762 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:16.318037 30854 raft_consensus.cc:2804] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:16.322494 30726 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:16.373612 25679 raft_consensus.cc:1240] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:16.399842 25649 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:16.373602 25757 raft_consensus.cc:2468] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 16.
W20260709 12:25:16.399909 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:16.346280 30752 raft_consensus.cc:697] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 14 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:16.377431 30856 raft_consensus.cc:2749] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:16.395718 25682 raft_consensus.cc:2393] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 9: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:16.348624 30852 raft_consensus.cc:2749] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:16.348029 30667 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:16.354235 30661 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:16.428635 30661 raft_consensus.cc:2804] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:16.429114 30661 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:16.429497 30661 raft_consensus.cc:3060] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:16.432842 30862 log.cc:927] Time spent T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 12:25:16.433393 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:16.435137 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:16.435755 25763 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 18.
I20260709 12:25:16.440047 30548 consensus_queue.cc:260] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:16.441423 30548 raft_consensus.cc:3060] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:16.443270 30667 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:16.443889 30667 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:16.400625 25726 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:16.447290 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:16.413422 25828 raft_consensus.cc:2468] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 12.
I20260709 12:25:16.343385 30799 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:16.393522 30837 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:16.375573 30780 consensus_queue.cc:1048] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:25:16.444337 30752 consensus_queue.cc:237] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:16.506630 30845 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:16.349073 30860 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:16.405092 30854 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:16.468756 26401 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:16.351235 30858 consensus_queue.cc:1048] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.103s
I20260709 12:25:16.509315 30854 raft_consensus.cc:3060] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:16.496665 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 96148.1us
I20260709 12:25:16.510861 25726 leader_election.cc:400] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 election: Vote denied by peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) with higher term. Message: Invalid argument: T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 15. Current term is 16.
I20260709 12:25:16.511142 25726 leader_election.cc:403] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:25:16.379392 30850 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:16.512070 25726 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:16.505177 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:16.513438 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:16.513701 30850 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:16.513935 30839 raft_consensus.cc:3055] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:16.514364 30839 raft_consensus.cc:740] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:16.514559 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:16.515213 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:16.505120 30871 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:16.515159 30794 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:16.494767 30837 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:16.516626 30794 raft_consensus.cc:2804] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:16.505285 30522 raft_consensus.cc:2749] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:16.517320 30794 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:16.406137 30463 consensus_queue.cc:1048] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 12:25:16.517730 30794 raft_consensus.cc:3060] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:16.411252 30676 consensus_queue.cc:1048] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.063s
W20260709 12:25:16.520021 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:16.516474 30871 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:16.522459 30871 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:16.515141 30839 consensus_queue.cc:260] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:16.511679 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:16.538909 25831 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 11.
I20260709 12:25:16.525044 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:16.515632 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:25:16.524720 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 56048.7us
I20260709 12:25:16.541004 25833 raft_consensus.cc:2393] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 12: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:16.422894 30378 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:16.417608 30735 raft_consensus.cc:697] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:16.556636 25677 raft_consensus.cc:1240] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:25:16.565508 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:16.567081 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:16.568612 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:16.513829 30838 raft_consensus.cc:2749] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) with higher term. Message: Invalid argument: T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 15. Current term is 16.
W20260709 12:25:16.572034 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 227380us
I20260709 12:25:16.572363 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:16.573988 25650 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:16.548007 30858 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.537722 30780 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:16.550805 30669 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:16.560659 30764 consensus_meta.cc:287] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.735s	user 0.012s	sys 0.000s
I20260709 12:25:16.587776 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:16.589582 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:16.592612 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:25:16.602671 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 282164us
I20260709 12:25:16.636871 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:16.643074 25829 raft_consensus.cc:2468] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 10.
I20260709 12:25:16.636236 29802 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:16.634009 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:16.631167 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 57273.9us
I20260709 12:25:16.644285 25650 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:16.644942 29802 raft_consensus.cc:2749] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:16.645995 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:16.646615 25756 raft_consensus.cc:2468] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 12.
I20260709 12:25:16.646700 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:16.581102 30839 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:16.647521 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:16.657879 25755 raft_consensus.cc:2368] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 15. Current term is 16.
I20260709 12:25:16.649904 25757 raft_consensus.cc:1240] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:16.650389 25756 raft_consensus.cc:1240] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:16.651576 25650 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:16.652196 25726 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:16.639286 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:16.659678 25650 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:16.660250 25828 raft_consensus.cc:2393] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 13: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:16.660619 25726 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:16.661098 25650 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:16.661397 29802 raft_consensus.cc:2749] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:16.666951 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 286494us
W20260709 12:25:16.667662 25800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:16.585980 30787 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:16.664687 25650 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:16.582965 30581 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:16.668859 25801 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:16.678333 25801 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:16.679986 25801 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:16.674321 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:16.676151 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:16.680797 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 281003us
I20260709 12:25:16.674242 25650 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:16.692104 25801 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:16.640074 30631 raft_consensus.cc:2749] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:16.693328 25801 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:16.694653 25650 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:16.704856 29802 raft_consensus.cc:2804] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:16.705371 29802 raft_consensus.cc:697] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 10 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:16.698573 25649 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
W20260709 12:25:16.673125 30706 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.013s	sys 0.014s
I20260709 12:25:16.666100 30378 raft_consensus.cc:2804] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:16.602191 30764 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:16.673020 30850 raft_consensus.cc:2749] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:16.630288 30853 raft_consensus.cc:697] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 11 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:16.667761 30561 raft_consensus.cc:2749] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:16.720686 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:16.666812 30855 raft_consensus.cc:2749] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:25:16.721946 25801 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:25:16.821059 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 99192.4us
I20260709 12:25:16.708598 30762 raft_consensus.cc:2749] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:25:16.727517 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 60250.2us
I20260709 12:25:16.600112 30780 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:16.691972 30869 raft_consensus.cc:2749] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:16.692232 30722 raft_consensus.cc:2804] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:16.724565 29802 consensus_queue.cc:237] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:16.677346 30535 consensus_queue.cc:1048] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.141s
I20260709 12:25:16.708657 30798 raft_consensus.cc:2804] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:16.700986 30856 raft_consensus.cc:2749] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:25:16.719735 25726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:16.856501 25726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:16.718729 30706 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.014s	sys 0.014s
I20260709 12:25:16.711578 30838 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:16.775908 25832 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 7.
I20260709 12:25:16.712854 30787 consensus_queue.cc:1048] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.117s
I20260709 12:25:16.787679 25650 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:16.700577 30865 raft_consensus.cc:2749] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:16.690953 30670 raft_consensus.cc:2804] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:25:16.903286 30883 log.cc:927] Time spent T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
I20260709 12:25:16.832476 25830 raft_consensus.cc:2393] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 15: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:16.585239 30858 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:16.854871 25828 raft_consensus.cc:1275] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:25:16.908743 25828 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:25:16.909360 25828 raft_consensus.cc:606] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 14 LEADER]: Received request to transfer leadership to TS 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:16.885911 30762 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.775309 25649 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:16.726397 30829 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:16.724786 30378 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:16.830869 30722 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
W20260709 12:25:16.851542 30843 consensus_meta.cc:287] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.707s	user 0.011s	sys 0.000s
I20260709 12:25:16.866250 30853 consensus_queue.cc:237] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:16.901343 30726 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:16.900396 30838 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:16.867039 30903 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.716964 30796 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:16.723489 30851 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:16.708636 30669 consensus_queue.cc:1048] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.144s
I20260709 12:25:16.868167 30860 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:16.869918 30861 consensus_queue.cc:1048] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:25:16.873458 30801 consensus_meta.cc:287] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.928s	user 0.005s	sys 0.006s
I20260709 12:25:16.873100 30854 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:16.917642 30720 consensus_meta.cc:287] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.532s	user 0.009s	sys 0.000s
I20260709 12:25:16.823736 30657 raft_consensus.cc:2804] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:16.692473 30735 consensus_queue.cc:237] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:16.882257 30834 consensus_meta.cc:287] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.597s	user 0.007s	sys 0.001s
I20260709 12:25:16.830996 30581 raft_consensus.cc:2804] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:16.957186 30852 raft_consensus.cc:2804] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:25:16.925355 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 137797us
I20260709 12:25:16.991696 25650 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:16.927448 25832 raft_consensus.cc:1275] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:25:16.856109 30798 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
W20260709 12:25:16.912652 30879 log.cc:927] Time spent T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.359s	user 0.001s	sys 0.000s
W20260709 12:25:16.964745 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 141770us
W20260709 12:25:16.918752 30717 consensus_meta.cc:287] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.771s	user 0.006s	sys 0.004s
I20260709 12:25:16.913714 30378 raft_consensus.cc:3060] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:16.876078 30764 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:16.916888 30726 raft_consensus.cc:2804] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:16.913870 30722 raft_consensus.cc:3060] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:16.911872 30780 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:16.924108 30794 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:16.917711 30674 consensus_meta.cc:287] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.600s	user 0.016s	sys 0.002s
W20260709 12:25:16.912756 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 137590us
I20260709 12:25:16.922140 30838 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:16.998801 26402 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:16.914088 30843 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:16.912916 30661 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:17.038828 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:17.000916 25650 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:25:16.996464 30894 log.cc:927] Time spent T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 12:25:16.997072 30535 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:16.912333 30762 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:16.986896 30581 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:16.964957 30903 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:16.919782 30837 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:17.032094 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:17.032883 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
W20260709 12:25:17.029487 26436 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.008s	sys 0.014s
I20260709 12:25:17.037604 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:17.044078 25801 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:16.998458 30798 raft_consensus.cc:3060] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:17.155589 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:17.156548 25678 raft_consensus.cc:2468] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 10.
I20260709 12:25:17.157742 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:17.158682 25678 raft_consensus.cc:2393] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 7: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:17.040400 25650 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:17.159597 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:25:17.165105 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 124815us
W20260709 12:25:17.166129 26436 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.008s	sys 0.023s
I20260709 12:25:17.041206 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:17.168784 26434 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 11.
I20260709 12:25:17.009344 25754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 3146) took 1098 ms. Trace:
I20260709 12:25:16.971398 30801 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:17.046571 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:17.046864 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:17.069470 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:17.046453 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:17.073341 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:17.172142 25677 raft_consensus.cc:2393] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 12: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:17.068713 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:17.172899 25759 raft_consensus.cc:2468] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 9.
I20260709 12:25:17.070307 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:16.999855 30657 raft_consensus.cc:697] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 15 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:17.072763 25726 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:16.999315 30852 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:16.993212 30892 raft_consensus.cc:2749] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:17.075026 30674 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.113209 25762 raft_consensus.cc:1240] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:25:16.991101 30834 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:17.193142 30674 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:17.194592 30561 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:17.194835 30834 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:17.195130 30561 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:17.196216 25649 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:17.147954 25755 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:17.146926 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:17.174381 25685 raft_consensus.cc:2468] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 11.
I20260709 12:25:17.172353 25758 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 15.
I20260709 12:25:17.170116 25754 rpcz_store.cc:276] 0709 12:25:15.911185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:15.921075 (+  9890us) service_pool.cc:224] Handling call
0709 12:25:15.926963 (+  5888us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:16.185782 (+258819us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:16.185827 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:16.189512 (+  3685us) log.cc:844] Serialized 26 byte log entry
0709 12:25:16.321924 (+132412us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:16.321960 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:16.322038 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:17.009132 (+687094us) raft_consensus.cc:1685] finished
0709 12:25:17.009154 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:17.009282 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":111169,"raft.queue_time_us":141965,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":4478,"thread_start_us":283099,"threads_started":2,"wal-append.queue_time_us":228181}
I20260709 12:25:17.070636 30850 raft_consensus.cc:2804] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:17.020479 30891 raft_consensus.cc:2804] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:17.192160 30852 raft_consensus.cc:3060] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:17.194756 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 122094us
I20260709 12:25:17.068234 30886 raft_consensus.cc:2804] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:17.189365 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:17.194223 25759 raft_consensus.cc:1275] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 12. (term mismatch)
I20260709 12:25:17.203256 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:17.211208 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:25:17.229199 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:17.230944 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:17.232131 26432 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 7.
I20260709 12:25:17.232544 26430 raft_consensus.cc:2393] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 13: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:17.231702 25759 pending_rounds.cc:85] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 11
I20260709 12:25:17.233523 25759 pending_rounds.cc:107] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 12:25:17.233771 25759 raft_consensus.cc:2889] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:17.231189 25828 raft_consensus.cc:1275] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:17.117074 30581 raft_consensus.cc:3060] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:17.020159 30717 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:17.036278 30726 raft_consensus.cc:697] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 16 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:17.217898 30561 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:17.221182 25726 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:17.184513 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:17.221501 25650 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.245.131:36237 timed out after 1.529s (SENT) [suppressed 20 similar messages]
I20260709 12:25:17.244024 25761 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 6.
I20260709 12:25:17.223062 26402 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:17.195777 30834 raft_consensus.cc:2749] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:17.076144 30787 consensus_queue.cc:1048] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.139s
I20260709 12:25:17.141336 30780 consensus_queue.cc:1059] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.083s
I20260709 12:25:17.254006 26402 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:17.235735 26434 raft_consensus.cc:2393] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 15: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:17.236794 25756 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 13.
I20260709 12:25:17.196903 30752 raft_consensus.cc:2804] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:25:17.190627 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 146597us
I20260709 12:25:17.112459 30706 consensus_queue.cc:1048] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.103s
I20260709 12:25:17.246255 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:17.192111 30907 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:17.214600 30850 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:17.248432 26435 raft_consensus.cc:1275] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:25:17.111783 30535 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:17.255682 26402 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:17.215879 30891 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
W20260709 12:25:17.253248 30548 consensus_meta.cc:287] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.811s	user 0.012s	sys 0.000s
I20260709 12:25:17.261241 25760 raft_consensus.cc:1240] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 LEADER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 13. Current term is 14. Ops: []
W20260709 12:25:17.304509 30857 consensus_meta.cc:287] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.914s	user 0.011s	sys 0.001s
I20260709 12:25:17.259966 25801 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
W20260709 12:25:17.367177 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 107338us
I20260709 12:25:17.313406 30850 raft_consensus.cc:3060] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:17.246083 30886 raft_consensus.cc:697] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 12 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:17.238224 30861 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:17.333884 25755 raft_consensus.cc:2468] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 16.
W20260709 12:25:17.330046 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 111416us
I20260709 12:25:17.386983 25649 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:17.317149 30891 raft_consensus.cc:3060] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:17.310213 30894 log.cc:927] Time spent T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:25:17.271991 30752 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:17.245893 30704 raft_consensus.cc:2749] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:17.273147 30908 raft_consensus.cc:2749] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:25:17.319088 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 63536.6us
W20260709 12:25:17.419899 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:17.313160 30796 raft_consensus.cc:2804] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:17.368209 25801 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:17.312407 30907 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:17.309885 30858 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:17.307094 30884 raft_consensus.cc:2749] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:17.243144 30613 consensus_queue.cc:1048] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.114s
I20260709 12:25:17.242584 30669 consensus_queue.cc:1048] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 12:25:17.358619 30902 raft_consensus.cc:2749] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:17.421294 26402 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:17.384680 30764 raft_consensus.cc:2749] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:25:17.425556 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 57635us
I20260709 12:25:17.404202 30854 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:17.429850 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:17.424716 30829 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:17.442252 25801 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:17.449544 25829 raft_consensus.cc:2393] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 13: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:17.450388 25801 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:25:17.369354 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 147879us
I20260709 12:25:17.415364 30752 raft_consensus.cc:3060] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:17.424401 30796 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:17.449023 26402 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:25:17.460906 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 73916us
I20260709 12:25:17.461776 26402 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:17.317560 30657 consensus_queue.cc:237] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:17.458107 25801 leader_election.cc:400] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Vote denied by peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) with higher term. Message: Invalid argument: T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 15. Current term is 16.
I20260709 12:25:17.464102 25801 leader_election.cc:403] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:17.389358 30857 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:17.431350 30851 raft_consensus.cc:2749] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:17.478506 25835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41782 (request call id 1038) took 1103 ms. Trace:
I20260709 12:25:17.472517 26402 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:17.433403 30843 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:17.463236 25649 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:17.455940 30829 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:17.508347 30843 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:17.508416 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 45242.4us
I20260709 12:25:17.509055 30843 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:17.509650 30829 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:17.485157 26402 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:17.510789 30704 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.511278 30704 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:17.452023 30794 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:17.388243 30726 consensus_queue.cc:237] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:17.443050 30661 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:17.397408 30861 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:17.479051 25835 rpcz_store.cc:276] 0709 12:25:16.375398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:16.375791 (+   393us) service_pool.cc:224] Handling call
0709 12:25:16.376132 (+   341us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:16.384761 (+  8629us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:16.384798 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:16.398087 (+ 13289us) log.cc:844] Serialized 52 byte log entry
0709 12:25:16.559993 (+161906us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:16.579873 (+ 19880us) log.cc:844] Serialized 14 byte log entry
0709 12:25:16.590836 (+ 10963us) log.cc:844] Serialized 14 byte log entry
0709 12:25:16.591309 (+   473us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:16.591411 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:17.478262 (+886851us) raft_consensus.cc:1685] finished
0709 12:25:17.478287 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:17.478429 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4200,"prepare.queue_time_us":91121,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":71,"raft.queue_time_us":34524,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":191,"spinlock_wait_cycles":66227712,"thread_start_us":161521,"threads_started":1,"wal-append.queue_time_us":276586}
I20260709 12:25:17.460455 30893 raft_consensus.cc:2749] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:25:17.518054 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:17.512629 26431 raft_consensus.cc:1240] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:25:17.539400 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:17.515426 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:17.535400 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:17.618659 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:17.455893 30908 raft_consensus.cc:2749] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:25:17.458134 30906 log.cc:927] Time spent T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.415s	user 0.000s	sys 0.001s
I20260709 12:25:17.716781 25759 raft_consensus.cc:3060] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:17.518415 30889 log.cc:927] Time spent T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.294s	user 0.000s	sys 0.001s
W20260709 12:25:17.516705 30914 log.cc:927] Time spent T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
I20260709 12:25:17.720443 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:17.469301 30796 raft_consensus.cc:3060] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:17.542613 30884 raft_consensus.cc:2804] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:17.687417 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:17.592931 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:17.732441 26434 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:17.626708 30801 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:17.592456 30561 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.741451 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:17.620893 26439 raft_consensus.cc:2468] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 12.
I20260709 12:25:17.744391 26434 raft_consensus.cc:2468] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 16.
I20260709 12:25:17.470304 30787 raft_consensus.cc:2804] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:17.528177 30903 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:17.538223 30902 raft_consensus.cc:2749] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:17.511711 30843 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:17.535123 30837 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:17.534651 30888 log.cc:927] Time spent T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.614s	user 0.003s	sys 0.000s
W20260709 12:25:17.687645 30378 consensus_meta.cc:287] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.652s	user 0.011s	sys 0.000s
I20260709 12:25:17.783362 30661 consensus_queue.cc:1048] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:25:17.783641 30378 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:17.786130 30378 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:17.786820 30378 raft_consensus.cc:2804] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:17.786587 30891 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:17.787359 30378 raft_consensus.cc:697] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 16 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:17.627152 30717 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:17.467111 30858 consensus_queue.cc:1048] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.273s
W20260709 12:25:17.528360 30839 consensus_meta.cc:287] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.862s	user 0.007s	sys 0.005s
I20260709 12:25:17.468885 30885 raft_consensus.cc:2749] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:17.789937 30931 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.790587 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:17.790464 30931 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:17.792084 30891 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:17.792515 30931 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:17.740872 30762 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:17.627272 30907 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:17.532032 30764 raft_consensus.cc:2749] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) with higher term. Message: Invalid argument: T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 15. Current term is 16.
I20260709 12:25:17.525573 30535 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:17.795743 30857 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:17.721694 26432 raft_consensus.cc:2468] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 10.
I20260709 12:25:17.520082 30886 consensus_queue.cc:237] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:17.796497 30900 log.cc:927] Time spent T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.875s	user 0.000s	sys 0.002s
I20260709 12:25:17.786116 30670 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:17.797453 30670 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:17.717571 25757 raft_consensus.cc:3060] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:17.514684 30909 log.cc:927] Time spent T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 12:25:17.800562 30872 raft_consensus.cc:3055] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:17.739152 30561 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:17.804358 30674 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:17.805289 26430 raft_consensus.cc:1240] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:17.512279 30904 raft_consensus.cc:2804] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:17.749436 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:17.524284 30710 consensus_queue.cc:1048] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.202s
I20260709 12:25:17.593461 30854 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.800963 30872 raft_consensus.cc:740] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:17.748770 30903 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.603883 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:17.818533 25837 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 15.
W20260709 12:25:17.515226 30915 log.cc:927] Time spent T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260709 12:25:17.813517 25761 raft_consensus.cc:1240] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:17.819802 25833 raft_consensus.cc:2468] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 11.
I20260709 12:25:17.820876 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:17.821151 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:17.821704 25761 raft_consensus.cc:2468] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 14.
I20260709 12:25:17.815076 25757 raft_consensus.cc:2468] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 12.
I20260709 12:25:17.808311 25829 raft_consensus.cc:2376] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 16. Re-sending same reply.
W20260709 12:25:17.822324 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:17.823730 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:17.806756 30854 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:17.828832 30872 consensus_queue.cc:260] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:17.467641 30853 raft_consensus.cc:2804] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:25:17.524366 30910 log.cc:927] Time spent T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.212s	user 0.000s	sys 0.001s
W20260709 12:25:17.517428 30920 log.cc:927] Time spent T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 12:25:17.822192 25833 raft_consensus.cc:2468] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 10.
I20260709 12:25:17.840078 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:17.840226 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:17.840873 25833 raft_consensus.cc:2393] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 10: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:17.832023 30854 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:17.806025 30378 consensus_queue.cc:237] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:17.841495 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:17.834235 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:17.842132 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:17.836054 25649 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:17.836771 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:17.844568 25835 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 7.
I20260709 12:25:17.845518 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:17.846272 25835 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:17.837460 25800 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:17.840811 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:17.847420 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:17.848006 25831 raft_consensus.cc:2468] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 11.
I20260709 12:25:17.838439 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:17.852583 25800 leader_election.cc:400] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Vote denied by peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267) with higher term. Message: Invalid argument: T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 15. Current term is 16.
I20260709 12:25:17.807240 30884 raft_consensus.cc:697] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 12 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:17.799872 30704 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:17.856588 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:17.856812 29802 raft_consensus.cc:2749] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:17.806063 30904 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:17.851613 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:17.863689 25683 raft_consensus.cc:1240] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:17.863965 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:17.864435 25679 raft_consensus.cc:1275] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:25:17.865336 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:25:17.850970 30722 consensus_meta.cc:287] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.776s	user 0.010s	sys 0.000s
I20260709 12:25:17.871487 25685 raft_consensus.cc:1240] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 11. Current term is 12. Ops: [11.12-11.12]
W20260709 12:25:17.862375 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 404406us
I20260709 12:25:17.872880 25801 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:17.755354 26431 raft_consensus.cc:2393] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 7: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:17.866947 30787 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:17.869407 25759 raft_consensus.cc:2468] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 13.
I20260709 12:25:17.851033 30631 raft_consensus.cc:2804] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:17.885720 25800 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:17.851616 30853 raft_consensus.cc:697] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 16 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:17.883867 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:17.889959 25835 raft_consensus.cc:2468] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 16.
I20260709 12:25:17.893147 25683 raft_consensus.cc:1240] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:25:17.894382 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:17.876005 25679 raft_consensus.cc:1275] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:25:17.860347 30762 raft_consensus.cc:2804] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:17.829908 30903 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:17.899834 25679 raft_consensus.cc:1240] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:17.900038 25831 raft_consensus.cc:2393] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 7: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:17.870355 30904 raft_consensus.cc:3060] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:17.907081 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:17.908437 25833 raft_consensus.cc:2410] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 15 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:25:17.875044 30561 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:17.915083 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:17.870110 30839 consensus_queue.cc:1059] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
I20260709 12:25:17.891729 30787 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:17.912523 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:17.922098 25759 raft_consensus.cc:1275] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:25:17.903224 25835 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25bd5658646b41608d707d196c6e0585"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "a866ff967d964388a6f0dff7fd43df89"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:25:17.925660 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:17.902525 30762 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:17.904506 30851 raft_consensus.cc:2804] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:17.904671 30829 raft_consensus.cc:2804] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:17.938350 25835 raft_consensus.cc:606] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 14 LEADER]: Received request to transfer leadership to TS a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:17.939443 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:17.944149 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:17.955487 26431 raft_consensus.cc:3060] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:17.887511 30722 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:17.894362 30858 consensus_queue.cc:1059] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:25:17.959216 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:17.921931 30932 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.954522 30829 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:17.942391 30851 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:17.942139 30762 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:17.904670 30935 consensus_queue.cc:1059] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 12:25:17.924556 30921 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.959316 30631 raft_consensus.cc:697] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 12 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:17.966159 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:17.967370 30667 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:17.969301 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:17.969609 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:25:17.970610 30901 log.cc:927] Time spent T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 1.057s	user 0.000s	sys 0.001s
I20260709 12:25:17.955145 30463 consensus_queue.cc:1048] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:25:17.971486 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:17.972213 30799 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:17.976742 30890 log.cc:927] Time spent T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.751s	user 0.001s	sys 0.000s
W20260709 12:25:17.979162 30798 consensus_meta.cc:287] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.830s	user 0.009s	sys 0.000s
I20260709 12:25:18.058315 30798 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:18.059650 25679 raft_consensus.cc:1240] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:18.060497 30667 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.060963 30798 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:17.971400 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:17.976976 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:18.062170 25835 raft_consensus.cc:2468] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 8.
I20260709 12:25:18.062726 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:18.016801 30853 consensus_queue.cc:237] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:17.981356 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:17.988034 25830 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44202 (request call id 3008) took 1772 ms (client timeout 1529 ms). Trace:
I20260709 12:25:17.988634 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:17.989634 25828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41782 (request call id 1051) took 1600 ms. Trace:
I20260709 12:25:17.990531 25760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 2748) took 1344 ms. Trace:
I20260709 12:25:18.067302 30861 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:18.067525 25829 raft_consensus.cc:3060] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:17.995146 30581 consensus_meta.cc:287] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.744s	user 0.008s	sys 0.001s
I20260709 12:25:18.017490 30851 raft_consensus.cc:3060] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:18.076215 30581 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:18.078451 30581 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:18.079104 30581 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:17.996543 30903 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:17.998453 30722 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:18.080781 25836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41782 (request call id 1039) took 1696 ms. Trace:
I20260709 12:25:17.958532 30836 consensus_queue.cc:1059] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
W20260709 12:25:17.958026 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 221412us
I20260709 12:25:18.002478 25680 raft_consensus.cc:1240] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:17.962867 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:18.004868 25650 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:25:18.012250 25726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:18.018640 26431 raft_consensus.cc:2468] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 12.
I20260709 12:25:18.007797 30829 raft_consensus.cc:3060] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:17.954363 30884 consensus_queue.cc:237] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:18.020856 30670 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:18.056610 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:25:18.098028 30669 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.000s	sys 0.031s
W20260709 12:25:18.098421 30669 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.000s	sys 0.031s
I20260709 12:25:18.098663 26437 raft_consensus.cc:1275] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:25:18.056815 30631 consensus_queue.cc:237] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:18.102767 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:25:18.103086 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 98315.8us
I20260709 12:25:18.103353 26432 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:18.104628 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:18.105011 25650 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:18.061090 30667 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:18.067860 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:18.110857 25650 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:18.067714 25760 rpcz_store.cc:276] 0709 12:25:16.646255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:16.647540 (+  1285us) service_pool.cc:224] Handling call
0709 12:25:16.647797 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:17.318215 (+670418us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.990311 (+672096us) spinlock_profiling.cc:243] Waited 613 ms on lock 0x7b54001dbad4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:17.990473 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1410194816}
I20260709 12:25:17.991858 25832 raft_consensus.cc:1240] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 14. Current term is 15. Ops: []
W20260709 12:25:18.067335 25830 rpcz_store.cc:269] 0709 12:25:16.216192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:16.216336 (+   144us) service_pool.cc:224] Handling call
0709 12:25:17.987800 (+1771464us) spinlock_profiling.cc:243] Waited 615 ms on lock 0x7b5400119254. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:17.987968 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1414253824}
I20260709 12:25:18.067467 25828 rpcz_store.cc:276] 0709 12:25:16.388981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:16.910192 (+521211us) service_pool.cc:224] Handling call
0709 12:25:16.910463 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:17.234340 (+323877us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.989372 (+755032us) spinlock_profiling.cc:243] Waited 308 ms on lock 0x7b5400116f54. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:17.989562 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":708962176}
I20260709 12:25:18.113242 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:25:18.071169 30752 consensus_meta.cc:287] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.592s	user 0.008s	sys 0.001s
I20260709 12:25:18.081200 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:18.081167 25836 rpcz_store.cc:276] 0709 12:25:16.384417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:16.385051 (+   634us) service_pool.cc:224] Handling call
0709 12:25:16.385381 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:16.400816 (+ 15435us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:16.400849 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:16.415695 (+ 14846us) log.cc:844] Serialized 26 byte log entry
0709 12:25:16.691473 (+275778us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:16.972189 (+280716us) log.cc:844] Serialized 14 byte log entry
0709 12:25:16.992520 (+ 20331us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:16.992624 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:17.970009 (+977385us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b4400022b4c. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db 00007f5d99708aaf 00007f5d996fc86e 00007f5d996fbbb6 00007f5d996fb7d8 00007f5d99705221 00007f5d997051d9 00007f5d99705169
0709 12:25:18.080468 (+110459us) raft_consensus.cc:1685] finished
0709 12:25:18.080559 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:18.080718 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43295,"prepare.queue_time_us":490199,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":1332,"raft.queue_time_us":24447,"raft.run_cpu_time_us":324,"raft.run_wall_time_us":21247,"spinlock_wait_cycles":28239232,"thread_start_us":413343,"threads_started":2,"wal-append.queue_time_us":459052}
I20260709 12:25:18.095465 25726 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:18.115679 25829 raft_consensus.cc:2468] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 12.
I20260709 12:25:18.118053 25760 raft_consensus.cc:1240] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:18.106000 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:18.113379 25650 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:18.113903 25759 raft_consensus.cc:2468] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 12.
I20260709 12:25:18.119189 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:18.120401 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:18.128087 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:18.128316 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:18.130668 25836 raft_consensus.cc:2468] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 13.
I20260709 12:25:18.131735 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:18.132403 25836 raft_consensus.cc:3060] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:18.117213 25726 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:18.136426 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:18.137063 25831 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 13.
I20260709 12:25:18.079602 30581 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:18.129189 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:18.137974 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
W20260709 12:25:18.114276 30923 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.024s	sys 0.013s
I20260709 12:25:18.144718 26437 raft_consensus.cc:2468] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 13.
I20260709 12:25:18.149502 25683 raft_consensus.cc:1240] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:18.150614 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:18.137871 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:18.151783 26432 raft_consensus.cc:2468] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 13.
I20260709 12:25:18.146682 30940 consensus_queue.cc:1059] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 12:25:18.153992 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:18.146520 30943 consensus_queue.cc:1048] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 12:25:18.155175 30930 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.114862 30722 raft_consensus.cc:2804] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:25:18.147190 30923 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.024s	sys 0.013s
I20260709 12:25:18.156205 30722 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:18.156610 30722 raft_consensus.cc:3060] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:18.158350 26402 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:18.142949 25836 raft_consensus.cc:2468] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 12.
I20260709 12:25:18.138691 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:18.159982 26431 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 13.
I20260709 12:25:18.116755 30799 raft_consensus.cc:2804] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:18.007969 30932 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:18.158735 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:18.206161 26437 raft_consensus.cc:2468] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 14.
I20260709 12:25:18.138206 30726 raft_consensus.cc:2749] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:25:18.213701 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 317105us
I20260709 12:25:18.214622 25801 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:18.215159 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:18.217224 25801 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:18.205771 30799 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:18.224401 30935 raft_consensus.cc:3060] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:18.145440 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:18.155676 30930 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:18.144133 30885 consensus_queue.cc:1059] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 12:25:18.137992 30903 consensus_queue.cc:1059] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:25:18.163209 30907 raft_consensus.cc:2749] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:18.163524 26431 raft_consensus.cc:1275] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:25:18.227849 30799 raft_consensus.cc:3060] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:18.166365 26402 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:18.166307 30904 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:18.137253 30704 raft_consensus.cc:2804] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:18.264813 26436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 1253) took 1884 ms. Trace:
W20260709 12:25:18.265288 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 100818us
I20260709 12:25:18.027719 30921 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:18.137626 30463 consensus_queue.cc:1059] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 12:25:18.148626 30674 raft_consensus.cc:2804] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:25:18.173705 30852 consensus_meta.cc:287] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.933s	user 0.008s	sys 0.003s
I20260709 12:25:18.174638 25831 raft_consensus.cc:1240] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:18.177292 30667 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:18.177713 25800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:18.288327 25831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44218 (request call id 1877) took 1898 ms. Trace:
I20260709 12:25:18.288650 25831 rpcz_store.cc:276] 0709 12:25:16.390043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:18.174147 (+1784104us) service_pool.cc:224] Handling call
0709 12:25:18.174474 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:18.288073 (+113599us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:18.288271 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:18.187011 30839 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:18.293576 30839 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:18.189554 30796 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:18.190910 30548 raft_consensus.cc:3055] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:18.297607 30548 raft_consensus.cc:740] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:18.298689 30548 consensus_queue.cc:260] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:18.143950 30613 consensus_queue.cc:1048] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 12:25:18.192044 30923 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:18.192282 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:18.300455 26432 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:18.300403 30923 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:18.301559 30796 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:18.302320 30548 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:18.181308 30722 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:18.303156 30923 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:18.304862 30722 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:18.197310 30881 log.cc:927] Time spent T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 1.524s	user 0.005s	sys 0.005s
I20260709 12:25:18.127853 30752 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:18.199604 30850 consensus_meta.cc:287] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.796s	user 0.004s	sys 0.004s
I20260709 12:25:18.127466 30798 raft_consensus.cc:2804] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:18.146553 30861 consensus_queue.cc:1059] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 12:25:18.307498 25834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 2997) took 2396 ms. Trace:
I20260709 12:25:18.231254 25830 raft_consensus.cc:3060] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:18.235774 30930 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:18.307844 30850 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:18.310083 30850 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:18.310745 25686 raft_consensus.cc:2393] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 13: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:18.311378 25829 raft_consensus.cc:2393] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 12: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:18.164049 25650 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:18.239195 30932 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:18.230573 30846 raft_consensus.cc:3055] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:18.265249 26436 rpcz_store.cc:276] 0709 12:25:16.380825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:16.380948 (+   123us) service_pool.cc:224] Handling call
0709 12:25:16.381257 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:16.522959 (+141702us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:16.522992 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:16.523444 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 12:25:17.166772 (+643328us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:17.166831 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:18.252720 (+1085889us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b5400474854. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:18.252789 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:18.252853 (+    64us) raft_consensus.cc:1685] finished
0709 12:25:18.252873 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:18.264650 (+ 11777us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":325319040,"thread_start_us":642948,"threads_started":1,"wal-append.queue_time_us":727922}
I20260709 12:25:18.278813 26431 raft_consensus.cc:1275] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:25:18.312325 30846 raft_consensus.cc:740] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:18.225766 30851 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:18.313167 30846 consensus_queue.cc:260] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:18.314188 30846 raft_consensus.cc:3060] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:18.314464 30851 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:18.315029 30851 consensus_queue.cc:1059] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:18.307498 30798 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
W20260709 12:25:18.281905 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:18.316404 30798 raft_consensus.cc:3060] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:18.315965 30851 raft_consensus.cc:2749] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:18.317673 30851 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.318086 30851 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:18.307879 25834 rpcz_store.cc:276] 0709 12:25:15.910332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:15.910437 (+   105us) service_pool.cc:224] Handling call
0709 12:25:15.942411 (+ 31974us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:16.148195 (+205784us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:16.148224 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:16.197187 (+ 48963us) log.cc:844] Serialized 26 byte log entry
0709 12:25:16.503464 (+306277us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:25:16.503503 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:16.503568 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:18.196620 (+1693052us) spinlock_profiling.cc:243] Waited 4.2 ms on lock 0x7b4400022b4c. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db 00007f5d99708aaf 00007f5d996fc86e 00007f5d996fbbb6 00007f5d996fb7d8 00007f5d99705221 00007f5d997051d9 00007f5d99705169
0709 12:25:18.306843 (+110223us) raft_consensus.cc:1685] finished
0709 12:25:18.306864 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:18.307048 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":185010,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":8141,"spinlock_wait_cycles":9655168,"thread_start_us":390533,"threads_started":2,"wal-append.queue_time_us":298812}
I20260709 12:25:18.160127 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:18.321997 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:18.322580 25834 raft_consensus.cc:2376] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 7. Re-sending same reply.
I20260709 12:25:18.323375 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:18.324937 25830 raft_consensus.cc:2468] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 14.
I20260709 12:25:18.325126 25834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44218 (request call id 1883) took 1885 ms. Trace:
I20260709 12:25:18.325589 25834 rpcz_store.cc:276] 0709 12:25:16.442129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:18.324378 (+1882249us) service_pool.cc:224] Handling call
0709 12:25:18.324658 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:18.324840 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:18.324867 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:18.324907 (+    40us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:18.324938 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:18.324990 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:18.325081 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:18.327041 30839 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:18.327296 25834 raft_consensus.cc:1240] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:18.328946 25834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44218 (request call id 1886) took 1881 ms. Trace:
I20260709 12:25:18.330998 25834 rpcz_store.cc:276] 0709 12:25:16.447701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:18.326865 (+1879164us) service_pool.cc:224] Handling call
0709 12:25:18.327129 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:18.328738 (+  1609us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:18.328901 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:18.332531 25834 raft_consensus.cc:1240] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:18.321964 30851 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:18.334856 30851 raft_consensus.cc:3055] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:18.335465 30851 raft_consensus.cc:740] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:18.336300 30851 consensus_queue.cc:260] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:18.337498 30851 raft_consensus.cc:3060] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:18.338967 25834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44218 (request call id 1888) took 1843 ms. Trace:
I20260709 12:25:18.344777 25834 rpcz_store.cc:276] 0709 12:25:16.495464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:18.331793 (+1836329us) service_pool.cc:224] Handling call
0709 12:25:18.332114 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:18.338731 (+  6617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:18.338918 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:18.334167 30548 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.340437 26432 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 13.
I20260709 12:25:18.343518 26435 raft_consensus.cc:1240] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:18.326303 25830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44218 (request call id 1885) took 1880 ms. Trace:
I20260709 12:25:18.367897 26402 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:18.367640 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:18.277428 30704 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:18.238418 30829 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:18.416976 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:18.349637 25830 rpcz_store.cc:276] 0709 12:25:16.447368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:18.325610 (+1878242us) service_pool.cc:224] Handling call
0709 12:25:18.325871 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:18.326020 (+   149us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:18.326043 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:18.326081 (+    38us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:18.326109 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:18.326152 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:18.326251 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:18.419564 25834 raft_consensus.cc:1240] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:18.364285 26439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36508 (request call id 1255) took 1982 ms. Trace:
I20260709 12:25:18.423362 26439 rpcz_store.cc:276] 0709 12:25:16.381394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:16.381503 (+   109us) service_pool.cc:224] Handling call
0709 12:25:18.364124 (+1982621us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b5400373f54. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:18.364228 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2815152896}
I20260709 12:25:18.422452 30704 raft_consensus.cc:3060] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:18.425119 25834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44218 (request call id 1889) took 1895 ms. Trace:
I20260709 12:25:18.425609 25834 rpcz_store.cc:276] 0709 12:25:16.530181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:18.346084 (+1815903us) service_pool.cc:224] Handling call
0709 12:25:18.419329 (+ 73245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:18.424810 (+  5481us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:18.425053 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:18.427798 25834 raft_consensus.cc:1275] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:25:18.349619 30852 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:18.428637 25834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44218 (request call id 1892) took 1864 ms. Trace:
I20260709 12:25:18.429057 25834 rpcz_store.cc:276] 0709 12:25:16.564538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:18.427037 (+1862499us) service_pool.cc:224] Handling call
0709 12:25:18.427404 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:18.428310 (+   906us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:18.428576 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:18.430532 30852 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:18.365718 25680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40230 (request call id 1808) took 1295 ms. Trace:
I20260709 12:25:18.431257 25680 rpcz_store.cc:276] 0709 12:25:17.070579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.171131 (+100552us) service_pool.cc:224] Handling call
0709 12:25:17.171443 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:18.093922 (+922479us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:18.365502 (+271580us) spinlock_profiling.cc:243] Waited 831 ms on lock 0x7b540007b2d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:18.365661 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1910786944}
I20260709 12:25:18.368520 25762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 2752) took 1716 ms. Trace:
I20260709 12:25:18.432400 30704 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:18.434715 30704 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:18.432205 25762 rpcz_store.cc:276] 0709 12:25:16.652629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:16.652805 (+   176us) service_pool.cc:224] Handling call
0709 12:25:16.653199 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:17.193109 (+539910us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:18.368218 (+1175109us) spinlock_profiling.cc:243] Waited 458 ms on lock 0x7b54001db0d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:18.368449 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1053225728}
I20260709 12:25:18.436604 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:18.437156 25762 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:25:18.440825 30949 log.cc:927] Time spent T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 12:25:18.444525 30581 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:18.448210 30932 raft_consensus.cc:2749] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:25:18.448457 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 284457us
I20260709 12:25:18.450615 30752 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:18.451272 25650 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:18.452975 30829 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:18.262293 30787 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:18.455184 30930 consensus_queue.cc:1048] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:18.456472 30891 raft_consensus.cc:2749] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:18.457188 30891 consensus_queue.cc:1048] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:25:18.457726 25650 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:18.458693 30852 raft_consensus.cc:2749] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:18.460099 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:18.460819 25758 raft_consensus.cc:3060] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:18.460047 25650 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
W20260709 12:25:18.469828 30946 log.cc:927] Time spent T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
I20260709 12:25:18.476619 25828 raft_consensus.cc:2468] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 14.
I20260709 12:25:18.443759 25761 raft_consensus.cc:1240] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:18.483528 25762 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 19.
I20260709 12:25:18.486932 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:18.281103 30710 consensus_queue.cc:1048] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.140s
I20260709 12:25:18.287765 30674 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:18.365094 25832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44218 (request call id 1875) took 1975 ms. Trace:
I20260709 12:25:18.491128 25833 raft_consensus.cc:1275] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:25:18.511497 25833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44218 (request call id 1890) took 1973 ms. Trace:
I20260709 12:25:18.511909 25833 rpcz_store.cc:276] 0709 12:25:16.538183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:18.363377 (+1825194us) service_pool.cc:224] Handling call
0709 12:25:18.490723 (+127346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:18.511183 (+ 20460us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:18.511432 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:18.455557 30787 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:18.347549 30907 raft_consensus.cc:2749] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:18.497891 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 130084us
I20260709 12:25:18.487425 25758 raft_consensus.cc:2468] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 11.
I20260709 12:25:18.514804 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:18.515236 25832 rpcz_store.cc:276] 0709 12:25:16.389523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.008689 (+619166us) service_pool.cc:224] Handling call
0709 12:25:17.991660 (+982971us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:18.111888 (+120228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:18.364914 (+253026us) spinlock_profiling.cc:243] Waited 983 ms on lock 0x7b5400119250. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b608ad 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:18.365039 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2259958528}
I20260709 12:25:18.516896 25758 raft_consensus.cc:1240] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:18.349428 30548 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:18.505302 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:18.522934 25800 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
W20260709 12:25:18.489729 30720 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.027s	sys 0.024s
I20260709 12:25:18.528389 26402 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:18.524230 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:18.532073 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:18.510329 30674 raft_consensus.cc:3060] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:18.502728 30861 raft_consensus.cc:2749] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:18.502565 30657 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:18.504808 30670 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:18.546622 30952 consensus_queue.cc:1059] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:25:18.551803 30762 consensus_meta.cc:287] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.526s	user 0.007s	sys 0.003s
I20260709 12:25:18.591356 30762 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:18.592983 30849 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:18.593746 30762 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:18.559677 30904 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:18.557880 30921 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:18.594947 25836 raft_consensus.cc:2368] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 12. Current term is 13.
I20260709 12:25:18.560142 30548 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:18.595058 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 377878us
I20260709 12:25:18.563721 30935 raft_consensus.cc:2749] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:18.564813 30581 raft_consensus.cc:2804] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:18.523115 30884 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.596306 25801 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:18.596535 30884 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:18.597047 25830 raft_consensus.cc:1275] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:25:18.597985 30762 raft_consensus.cc:2749] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:25:18.570161 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 433222us
I20260709 12:25:18.593503 30849 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:18.529675 30720 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.027s	sys 0.025s
I20260709 12:25:18.510422 30798 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:18.607367 25726 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:18.564106 25831 raft_consensus.cc:1240] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 16 LEADER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:18.534864 30752 consensus_queue.cc:1059] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:25:18.609683 26439 raft_consensus.cc:1240] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:18.611305 26432 raft_consensus.cc:1240] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 18. Current term is 19. Ops: []
I20260709 12:25:18.612847 30884 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:18.615065 25757 raft_consensus.cc:1275] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 5. (term mismatch)
I20260709 12:25:18.541973 30829 consensus_queue.cc:1059] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.055s
I20260709 12:25:18.596473 30581 raft_consensus.cc:697] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 11 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:18.630548 26439 raft_consensus.cc:1240] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 13. Current term is 14. Ops: [11.10-13.11]
I20260709 12:25:18.627945 25757 pending_rounds.cc:85] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 4
I20260709 12:25:18.634248 25757 pending_rounds.cc:107] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 12:25:18.634531 25757 raft_consensus.cc:2889] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:18.590804 30851 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:18.630761 25758 raft_consensus.cc:2468] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 14.
I20260709 12:25:18.641016 25684 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "819272169f6f4293b6e279793be58b49"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
mode: GRACEFUL
new_leader_uuid: "a866ff967d964388a6f0dff7fd43df89"
 from {username='slave'} at 127.0.0.1:49108
I20260709 12:25:18.667719 25684 raft_consensus.cc:606] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Received request to transfer leadership to TS a866ff967d964388a6f0dff7fd43df89
W20260709 12:25:18.641870 25837 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41782 (request call id 1041) took 2255 ms (client timeout 2184 ms). Trace:
I20260709 12:25:18.642660 25833 raft_consensus.cc:1275] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:25:18.668155 25685 raft_consensus.cc:1240] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:18.645135 30908 raft_consensus.cc:3055] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:18.645429 30695 raft_consensus.cc:3060] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:18.646021 30849 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:18.647161 30720 consensus_queue.cc:1059] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:18.647383 30613 raft_consensus.cc:3055] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:18.648182 30535 raft_consensus.cc:3055] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:18.652091 30935 raft_consensus.cc:3055] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:18.652199 30857 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:18.653231 30943 raft_consensus.cc:3055] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:18.772967 30943 raft_consensus.cc:740] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:18.773828 30943 consensus_queue.cc:260] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:18.657265 30798 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:18.659008 25801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:18.774552 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:18.772982 30857 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:18.776257 25801 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:18.777099 30857 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:18.661911 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
W20260709 12:25:18.668352 25837 rpcz_store.cc:269] 0709 12:25:16.386446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:16.552745 (+166299us) service_pool.cc:224] Handling call
0709 12:25:18.641671 (+2088926us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54002c15d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:18.641780 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2798471936}
I20260709 12:25:18.670212 25650 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:18.612138 30667 raft_consensus.cc:2804] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:18.798827 30667 raft_consensus.cc:697] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 7 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:18.790148 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:18.800112 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:18.799943 30667 consensus_queue.cc:237] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:18.801527 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:18.802179 25835 raft_consensus.cc:3060] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:18.668188 25684 raft_consensus.cc:614] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:18.633839 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:18.806294 26432 raft_consensus.cc:2393] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 14: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:18.807145 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:18.682808 30908 raft_consensus.cc:740] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:18.757288 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:18.678176 30851 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:18.808827 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:18.809545 26430 raft_consensus.cc:2393] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 15: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:18.809661 30851 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:18.759343 30613 raft_consensus.cc:740] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:18.764672 30899 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:18.810554 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:25:18.810874 30899 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:18.761727 30581 consensus_queue.cc:237] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:18.812970 30899 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:18.768220 25831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44218 (request call id 1879) took 2377 ms. Trace:
I20260709 12:25:18.813597 25831 rpcz_store.cc:276] 0709 12:25:16.390719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:18.289410 (+1898691us) service_pool.cc:224] Handling call
0709 12:25:18.342951 (+ 53541us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:18.617154 (+274203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:18.767971 (+150817us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x7b54004204d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:18.768152 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":508154112}
I20260709 12:25:18.769569 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:18.814916 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:18.772363 30535 raft_consensus.cc:740] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
W20260709 12:25:18.779887 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 109817us
I20260709 12:25:18.672585 30463 consensus_queue.cc:1243] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer 6e673265293d4e9a937dc45150aeb1b8 log is divergent from this leader: its last log entry 14.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:25:18.788619 26401 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
W20260709 12:25:18.788937 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:18.791093 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:18.798020 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:18.800277 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:18.645211 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:18.824025 26431 raft_consensus.cc:2468] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 14.
I20260709 12:25:18.826347 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:18.816643 25650 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:18.598654 30657 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:18.828253 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:18.779856 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:18.615604 30965 consensus_queue.cc:1048] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.159s
I20260709 12:25:18.809389 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:18.816427 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:18.839068 25831 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 15.
W20260709 12:25:18.839368 26437 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.050s	sys 0.058s
I20260709 12:25:18.828883 25800 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
W20260709 12:25:18.839740 26437 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.050s	sys 0.058s
I20260709 12:25:18.840415 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:18.841295 25683 raft_consensus.cc:2393] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 10: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:18.841961 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:18.829525 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:18.844285 25837 raft_consensus.cc:2468] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 11.
W20260709 12:25:18.848085 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 59548.5us
I20260709 12:25:18.849179 26401 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:18.832713 25830 raft_consensus.cc:2410] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for term 17 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:25:18.849749 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:18.856849 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:18.859844 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:18.864190 30787 raft_consensus.cc:2804] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:18.864463 30857 raft_consensus.cc:2749] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:18.864705 30787 raft_consensus.cc:697] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 12 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
W20260709 12:25:18.856673 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:18.856819 30941 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:18.865756 30787 consensus_queue.cc:237] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:18.866509 30941 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:18.868695 30829 raft_consensus.cc:2804] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:18.858006 25831 raft_consensus.cc:1275] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:25:18.869592 30829 raft_consensus.cc:697] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 14 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:18.870833 25831 raft_consensus.cc:1275] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:25:18.870635 30829 consensus_queue.cc:237] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:18.855692 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:18.872754 25683 raft_consensus.cc:2393] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 13: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:18.858220 25650 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:18.873152 26435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36518 (request call id 1045) took 1361 ms. Trace:
I20260709 12:25:18.864490 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:18.864460 25681 raft_consensus.cc:2393] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 12: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:18.874588 25650 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:18.873703 26435 rpcz_store.cc:276] 0709 12:25:17.511939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.512759 (+   820us) service_pool.cc:224] Handling call
0709 12:25:17.513032 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:18.348773 (+835741us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:18.872926 (+524153us) spinlock_profiling.cc:243] Waited 830 ms on lock 0x7b54006301d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:18.873100 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1909420928}
I20260709 12:25:18.875270 25831 raft_consensus.cc:1275] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:25:18.852392 25830 raft_consensus.cc:1240] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:25:18.876636 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:18.878857 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:25:18.830000 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:18.877785 25682 raft_consensus.cc:1275] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:25:18.781520 30935 raft_consensus.cc:740] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:18.781172 30902 consensus_queue.cc:1048] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.121s
I20260709 12:25:18.821585 30561 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.822299 30849 raft_consensus.cc:2749] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:18.852172 30945 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.880421 25830 raft_consensus.cc:3055] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:18.909205 25830 raft_consensus.cc:740] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:18.887512 26401 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:18.909958 25684 raft_consensus.cc:1275] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:25:18.910529 25830 consensus_queue.cc:260] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:18.911980 25681 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 13.
I20260709 12:25:18.868767 30941 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:18.863828 26432 raft_consensus.cc:2393] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 14: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:18.847570 30929 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:18.908756 25683 raft_consensus.cc:2393] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 13: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:18.863358 30930 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:18.859252 25837 raft_consensus.cc:3055] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:18.879590 25650 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:18.917505 25837 raft_consensus.cc:740] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:18.913146 25830 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:18.915023 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 386687us
I20260709 12:25:18.892215 25835 raft_consensus.cc:2468] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 13.
I20260709 12:25:18.916488 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:18.921339 26437 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:18.914045 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
W20260709 12:25:18.906697 30955 log.cc:927] Time spent T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260709 12:25:18.873044 30886 raft_consensus.cc:2749] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:18.919507 25837 consensus_queue.cc:260] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:18.929957 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:18.930817 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:18.931193 25837 raft_consensus.cc:3060] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:18.931612 25684 raft_consensus.cc:2468] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 11.
I20260709 12:25:18.940966 25681 raft_consensus.cc:1240] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 15 LEADER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 12:25:18.943342 25681 raft_consensus.cc:1240] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 10 LEADER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 12:25:18.915823 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:18.922298 26401 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:18.878588 30378 raft_consensus.cc:2749] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:18.881340 30899 raft_consensus.cc:2804] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:25:18.962837 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 83387.6us
I20260709 12:25:18.905803 30657 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:18.975530 25650 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:18.979394 26402 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:18.972076 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
W20260709 12:25:18.982295 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 60116.9us
I20260709 12:25:18.973210 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:18.972892 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:18.984743 26432 raft_consensus.cc:1240] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:18.984656 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:18.985603 25835 raft_consensus.cc:2468] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 11.
I20260709 12:25:18.986776 25835 raft_consensus.cc:1240] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:18.914063 30798 raft_consensus.cc:2804] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:18.994472 25682 raft_consensus.cc:2393] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 11: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:18.993196 25831 raft_consensus.cc:2393] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 11: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
W20260709 12:25:18.957245 30799 consensus_meta.cc:287] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.680s	user 0.005s	sys 0.005s
I20260709 12:25:19.001624 25650 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:18.983567 26401 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:18.924124 30940 raft_consensus.cc:2749] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:19.002761 26402 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:25:19.056182 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 53517.2us
I20260709 12:25:19.016600 30975 raft_consensus.cc:2749] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:19.017410 26401 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:19.003249 30463 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:19.011298 26437 raft_consensus.cc:2468] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 13.
W20260709 12:25:19.021063 30959 log.cc:927] Time spent T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:25:19.022498 29802 raft_consensus.cc:2804] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:18.972711 30843 raft_consensus.cc:2804] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:19.023182 25650 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:25:19.024756 30961 log.cc:927] Time spent T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.165s	user 0.000s	sys 0.000s
I20260709 12:25:18.994534 30849 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:19.045490 30892 raft_consensus.cc:3055] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:18.911834 30945 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:19.048465 30613 consensus_queue.cc:260] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:19.079367 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 62066.2us
I20260709 12:25:19.080246 26401 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:19.080490 25837 raft_consensus.cc:1275] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:25:18.894644 30710 consensus_queue.cc:1059] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.085s
I20260709 12:25:18.907110 30908 consensus_queue.cc:260] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:19.050642 30853 raft_consensus.cc:3055] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:18.929301 30930 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:19.052186 30657 raft_consensus.cc:2804] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:19.052654 30799 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:18.914573 30561 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:19.053578 30962 raft_consensus.cc:3055] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:19.064301 29802 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:19.100816 29802 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:18.982499 30899 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:19.069408 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 46317.5us
I20260709 12:25:19.079758 30843 raft_consensus.cc:697] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 12 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:19.070838 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:18.907738 30535 consensus_queue.cc:260] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:18.956851 30670 consensus_queue.cc:1059] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.104s
I20260709 12:25:18.927666 30907 consensus_queue.cc:1048] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.132s
I20260709 12:25:19.068512 25830 raft_consensus.cc:1275] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 12:25:19.124636 25830 pending_rounds.cc:85] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a: Aborting all ops after (but not including) 9
I20260709 12:25:19.124917 25830 pending_rounds.cc:107] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 12:25:19.125164 25830 raft_consensus.cc:2889] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:25:19.070079 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 441344us
I20260709 12:25:19.060110 30668 raft_consensus.cc:2764] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 12:25:18.928135 30929 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:19.064363 30857 raft_consensus.cc:2804] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:19.064817 30852 raft_consensus.cc:2749] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:19.140496 25759 raft_consensus.cc:1240] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:19.086619 30884 raft_consensus.cc:2804] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:25:19.095952 30752 consensus_queue.cc:1059] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:25:19.093097 30860 raft_consensus.cc:2749] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:19.097787 30710 raft_consensus.cc:3055] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:19.099162 30846 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:19.169366 30970 consensus_queue.cc:1059] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:25:19.169565 30846 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:19.170418 30780 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:19.170935 30780 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:19.169361 30710 raft_consensus.cc:740] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:19.171722 30846 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:19.089577 30853 raft_consensus.cc:740] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
W20260709 12:25:19.091250 30839 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 12:25:19.172776 30846 consensus_queue.cc:1059] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:19.068845 30463 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:19.173250 30853 consensus_queue.cc:260] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:19.175266 30463 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:19.076719 30892 raft_consensus.cc:740] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:19.065243 30861 consensus_queue.cc:1059] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:25:19.176558 30861 raft_consensus.cc:3055] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:19.176947 30861 raft_consensus.cc:740] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:19.176642 30892 consensus_queue.cc:260] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:19.177794 30861 consensus_queue.cc:260] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:19.106828 30899 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:19.060174 30935 consensus_queue.cc:260] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:19.100503 30962 raft_consensus.cc:740] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:19.081782 25837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44218 (request call id 1903) took 1063 ms. Trace:
I20260709 12:25:19.191712 25837 rpcz_store.cc:276] 0709 12:25:18.018142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:18.858688 (+840546us) service_pool.cc:224] Handling call
0709 12:25:18.859091 (+   403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:19.081471 (+222380us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:19.081719 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:19.106158 30908 raft_consensus.cc:3060] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:19.077576 30922 raft_consensus.cc:2804] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:19.105219 30657 raft_consensus.cc:697] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 14 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:19.140165 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:19.194183 25755 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:19.125600 30941 consensus_queue.cc:1048] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 12:25:19.144881 25758 raft_consensus.cc:1275] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 12:25:19.145360 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:19.146252 30929 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:19.140997 30857 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:19.146821 25756 raft_consensus.cc:1240] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:25:19.148088 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:19.168735 30884 raft_consensus.cc:697] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 19 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:19.077378 25834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 3030) took 1856 ms. Trace:
I20260709 12:25:19.231383 26438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36508 (request call id 1259) took 2178 ms. Trace:
I20260709 12:25:19.103335 30904 consensus_queue.cc:1059] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 12:25:19.230373 25834 rpcz_store.cc:276] 0709 12:25:17.220923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:18.430365 (+1209442us) service_pool.cc:224] Handling call
0709 12:25:18.430719 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:18.430963 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:25:18.432809 (+  1846us) log.cc:844] Serialized 14 byte log entry
0709 12:25:19.075450 (+642641us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:19.075844 (+   394us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:19.076272 (+   428us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:19.077173 (+   901us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:19.077314 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":154422,"prepare.queue_time_us":1478,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":174461,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":10806,"thread_start_us":487013,"threads_started":1,"wal-append.queue_time_us":662396}
I20260709 12:25:19.233904 30884 consensus_queue.cc:237] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:19.178310 30892 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:19.078788 30849 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:19.211823 30935 raft_consensus.cc:3060] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:19.236382 30674 consensus_meta.cc:287] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.646s	user 0.011s	sys 0.000s
I20260709 12:25:19.236780 30674 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:19.237615 30849 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:19.195477 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:19.237993 30858 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 12:25:19.213183 25754 raft_consensus.cc:1240] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 18. Current term is 19. Ops: []
W20260709 12:25:19.208802 26402 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:19.128962 30891 consensus_queue.cc:1048] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 12:25:19.240586 30945 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:19.241139 30930 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:19.241561 25761 raft_consensus.cc:1240] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:19.197312 30861 raft_consensus.cc:3060] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:19.244828 30780 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:19.249816 30695 raft_consensus.cc:2749] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:19.250579 30843 consensus_queue.cc:237] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:19.252216 30798 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:19.252657 30798 raft_consensus.cc:3060] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:19.230294 30857 raft_consensus.cc:3060] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:19.256659 30799 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:19.257455 25832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41782 (request call id 1059) took 1429 ms. Trace:
I20260709 12:25:19.257834 25832 rpcz_store.cc:276] 0709 12:25:17.827597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:18.564785 (+737188us) service_pool.cc:224] Handling call
0709 12:25:18.565135 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:18.565619 (+   484us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:25:18.591207 (+ 25588us) log.cc:844] Serialized 14 byte log entry
0709 12:25:18.965610 (+374403us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:18.978619 (+ 13009us) log.cc:844] Serialized 26 byte log entry
0709 12:25:18.978769 (+   150us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:18.978802 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:18.978871 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:19.257247 (+278376us) raft_consensus.cc:1685] finished
0709 12:25:19.257267 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:19.257399 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48848,"prepare.queue_time_us":28586,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":49906,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":36176,"thread_start_us":325087,"threads_started":1,"wal-append.queue_time_us":550162}
I20260709 12:25:19.195456 30922 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:19.136965 29802 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:19.130528 30886 consensus_queue.cc:1059] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 12:25:19.231904 26438 rpcz_store.cc:276] 0709 12:25:17.038494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.038617 (+   123us) service_pool.cc:224] Handling call
0709 12:25:19.216961 (+2178344us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b5400227254. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:19.217087 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2858209024}
W20260709 12:25:19.232924 25569 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 5aae9f34f7154346afd482b3183ee180 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5cccf20a8bff46dba6601f241d172b8a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:25:19.233421 25759 raft_consensus.cc:1240] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:19.216167 25758 pending_rounds.cc:85] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 8
I20260709 12:25:19.269779 25758 pending_rounds.cc:107] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 12:25:19.270114 25758 raft_consensus.cc:2889] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:25:19.269008 25569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 53411.8us
W20260709 12:25:19.276798 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:19.279217 25800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:19.280984 29802 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:19.283262 25755 raft_consensus.cc:2468] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 13.
I20260709 12:25:19.264010 30965 raft_consensus.cc:2749] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:19.267549 30922 raft_consensus.cc:3060] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:19.310897 30548 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:19.311497 30548 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:19.326752 25755 pending_rounds.cc:85] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 10
I20260709 12:25:19.327093 25755 pending_rounds.cc:107] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 12:25:19.327719 25755 raft_consensus.cc:2889] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:19.327771 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:25:19.330730 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:19.337266 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:19.338402 25754 raft_consensus.cc:2393] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 12: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:19.337375 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:19.342304 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:19.343302 25754 raft_consensus.cc:2393] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 11: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:19.327515 30780 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:19.331614 30561 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:19.331842 30985 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:19.359014 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:19.363171 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
W20260709 12:25:19.382853 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 308914us
W20260709 12:25:19.385504 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 305337us
I20260709 12:25:19.389298 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:19.389108 25801 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
W20260709 12:25:19.420153 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 277570us
I20260709 12:25:19.424338 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:19.320528 30962 consensus_queue.cc:260] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:19.428452 25801 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:25:19.430653 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 292563us
W20260709 12:25:19.436131 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:19.336498 30657 consensus_queue.cc:237] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:19.500851 25650 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:25:19.661458 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 160752us
I20260709 12:25:19.358227 30780 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:19.426072 30849 raft_consensus.cc:2749] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:19.506503 25801 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:19.666456 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:19.670109 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:19.693029 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:19.693775 25837 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 17.
I20260709 12:25:19.694509 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:19.694975 25837 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:19.675462 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:19.677330 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:19.677502 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:19.684976 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:19.427222 30674 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:19.696703 26432 raft_consensus.cc:2468] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 13.
I20260709 12:25:19.430397 30975 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:19.363590 30985 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:19.713913 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:19.699977 25650 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:19.754164 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:25:19.754751 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 54901.9us
I20260709 12:25:19.757242 25650 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:19.717512 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
W20260709 12:25:19.719512 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 285260us
I20260709 12:25:19.719687 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:19.704564 25833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41782 (request call id 1057) took 1877 ms. Trace:
I20260709 12:25:19.750626 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:19.760988 25833 rpcz_store.cc:276] 0709 12:25:17.827057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:18.512901 (+685844us) service_pool.cc:224] Handling call
0709 12:25:18.642318 (+129417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:18.668419 (+ 26101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:19.704306 (+1035887us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b54002c15d0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b608ad 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:19.704490 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":296742656}
I20260709 12:25:19.764366 25837 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 16.
I20260709 12:25:19.769116 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:19.661128 30839 raft_consensus.cc:2804] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:19.779875 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:19.660596 30843 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:19.768901 25650 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:19.787881 29802 raft_consensus.cc:2804] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:19.788336 29802 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:19.788772 29802 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:19.665865 30581 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:19.688244 30787 raft_consensus.cc:2804] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:19.817903 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:19.438774 30851 consensus_queue.cc:1059] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.343s
W20260709 12:25:19.769287 30979 log.cc:927] Time spent T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.330s	user 0.000s	sys 0.000s
I20260709 12:25:19.782008 30975 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:19.855540 25686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 2535) took 2786 ms. Trace:
I20260709 12:25:19.817265 30843 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:19.856288 30885 raft_consensus.cc:3055] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:19.856040 25686 rpcz_store.cc:276] 0709 12:25:17.069056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.069192 (+   136us) service_pool.cc:224] Handling call
0709 12:25:19.855303 (+2786111us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54002652d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:19.855467 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2618370944}
I20260709 12:25:19.856865 30885 raft_consensus.cc:740] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
W20260709 12:25:19.857676 25828 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44218 (request call id 1904) took 1839 ms (client timeout 1725 ms). Trace:
I20260709 12:25:19.858088 30843 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:19.857788 30885 consensus_queue.cc:260] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:19.858223 25828 rpcz_store.cc:269] 0709 12:25:18.018388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:18.113006 (+ 94618us) service_pool.cc:224] Handling call
0709 12:25:19.857494 (+1744488us) spinlock_profiling.cc:243] Waited 363 ms on lock 0x7b5400246654. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:19.857604 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":834205440}
W20260709 12:25:19.859313 30987 log.cc:927] Time spent T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.439s	user 0.000s	sys 0.000s
I20260709 12:25:19.859754 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:19.862155 30885 raft_consensus.cc:3060] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:19.862699 30982 log.cc:927] Time spent T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.200s	user 0.000s	sys 0.000s
I20260709 12:25:19.863544 30855 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:19.863884 26430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 1276) took 1081 ms. Trace:
I20260709 12:25:19.864185 30855 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:19.864337 26430 rpcz_store.cc:276] 0709 12:25:18.782323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:18.810118 (+ 27795us) service_pool.cc:224] Handling call
0709 12:25:18.810479 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:18.810847 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:18.810870 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:18.811360 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 12:25:19.263784 (+452424us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:19.263829 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:19.263907 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:19.863692 (+599785us) raft_consensus.cc:1685] finished
0709 12:25:19.863710 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:19.863829 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":209,"raft.run_cpu_time_us":63,"raft.run_wall_time_us":65,"thread_start_us":452059,"threads_started":1,"wal-append.queue_time_us":551966}
I20260709 12:25:19.866575 30855 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:19.867218 30855 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:19.868251 30872 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:19.874385 30710 consensus_queue.cc:260] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:19.878342 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:19.878674 25649 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:19.879801 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:19.880102 30893 raft_consensus.cc:3055] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:25:19.826687 30674 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:19.880792 30893 raft_consensus.cc:740] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:19.881006 30674 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:19.867748 30855 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:19.881904 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:19.882614 25681 raft_consensus.cc:2368] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 10. Current term is 11.
I20260709 12:25:19.883246 30674 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:19.883430 30855 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:19.830744 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:19.884441 25677 raft_consensus.cc:2410] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:25:19.832334 25685 raft_consensus.cc:1240] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 11. Current term is 12. Ops: [11.12-11.12]
W20260709 12:25:19.885988 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:19.886397 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:19.886874 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:19.886934 30935 consensus_meta.cc:287] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.650s	user 0.008s	sys 0.000s
I20260709 12:25:19.891395 30843 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:19.892249 30548 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:19.904924 25836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41782 (request call id 1061) took 1810 ms. Trace:
I20260709 12:25:19.905507 25836 rpcz_store.cc:276] 0709 12:25:18.094951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:18.159884 (+ 64933us) service_pool.cc:224] Handling call
0709 12:25:19.904681 (+1744797us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b5400246b54. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:19.904848 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":627847552}
I20260709 12:25:19.907068 25757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 3173) took 2094 ms. Trace:
I20260709 12:25:19.907528 25757 rpcz_store.cc:276] 0709 12:25:17.812315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.842816 (+ 30501us) service_pool.cc:224] Handling call
0709 12:25:17.843137 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:18.634923 (+791786us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:19.906785 (+1271862us) spinlock_profiling.cc:243] Waited 771 ms on lock 0x7b54003976d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:19.907010 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1774407040}
I20260709 12:25:19.915460 30971 raft_consensus.cc:993] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a: : Instructing follower a866ff967d964388a6f0dff7fd43df89 to start an election
I20260709 12:25:19.916143 30971 raft_consensus.cc:1081] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 14 LEADER]: Signalling peer a866ff967d964388a6f0dff7fd43df89 to start an election
I20260709 12:25:19.918694 30780 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:19.835593 30989 log.cc:927] Time spent T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 12:25:19.790992 30945 raft_consensus.cc:2749] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:25:19.880712 30986 log.cc:927] Time spent T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:25:19.880228 25763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 2762) took 1507 ms. Trace:
I20260709 12:25:19.956995 25763 rpcz_store.cc:276] 0709 12:25:18.373088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:18.373227 (+   139us) service_pool.cc:224] Handling call
0709 12:25:18.424146 (+ 50919us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:18.817680 (+393534us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:18.817713 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:18.818100 (+   387us) log.cc:844] Serialized 26 byte log entry
0709 12:25:19.298255 (+480155us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:19.298307 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:19.298402 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:19.879990 (+581588us) raft_consensus.cc:1685] finished
0709 12:25:19.880008 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:19.880141 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":171109,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":102,"thread_start_us":804837,"threads_started":2,"wal-append.queue_time_us":501879}
I20260709 12:25:19.893484 25829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44202 (request call id 3035) took 1971 ms. Trace:
I20260709 12:25:19.892023 30843 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:19.895008 25649 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:19.895659 30998 raft_consensus.cc:2804] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:25:19.896677 30857 consensus_meta.cc:287] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.640s	user 0.009s	sys 0.001s
I20260709 12:25:19.898792 25835 raft_consensus.cc:1240] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 11. Current term is 12. Ops: [11.12-11.12]
I20260709 12:25:19.905120 25685 raft_consensus.cc:1240] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 12 LEADER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:25:19.779147 30849 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:19.782390 30930 raft_consensus.cc:2749] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:25:19.827008 30984 log.cc:927] Time spent T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.466s	user 0.000s	sys 0.000s
W20260709 12:25:19.826016 30988 log.cc:927] Time spent T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.443s	user 0.000s	sys 0.000s
W20260709 12:25:19.921774 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:19.921880 25650 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:25:19.926556 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 420119us
I20260709 12:25:19.791996 30839 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:19.846699 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:19.992991 25682 raft_consensus.cc:2393] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 11: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:19.709911 30799 consensus_queue.cc:1048] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.119s
W20260709 12:25:19.866494 30983 log.cc:927] Time spent T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.526s	user 0.000s	sys 0.000s
I20260709 12:25:19.854354 30762 raft_consensus.cc:2804] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:19.709441 30980 consensus_queue.cc:1059] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.228s
W20260709 12:25:19.953460 30798 consensus_meta.cc:287] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.700s	user 0.008s	sys 0.000s
I20260709 12:25:19.955297 30985 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:19.836050 30997 consensus_queue.cc:1048] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.120s
I20260709 12:25:19.958426 25829 rpcz_store.cc:276] 0709 12:25:17.922276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:18.159459 (+237183us) service_pool.cc:224] Handling call
0709 12:25:19.893285 (+1733826us) spinlock_profiling.cc:243] Waited 94.2 ms on lock 0x7b54002c10d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:19.893430 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":216666880}
I20260709 12:25:19.840080 29802 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:19.768707 30884 consensus_queue.cc:1059] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.170s
W20260709 12:25:19.981216 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 86294.4us
I20260709 12:25:19.994081 25801 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
W20260709 12:25:20.121820 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 127818us
W20260709 12:25:19.995102 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:19.921386 30787 raft_consensus.cc:697] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 13 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:19.996028 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:20.026104 30839 raft_consensus.cc:3060] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:20.026669 30843 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:19.984027 30998 raft_consensus.cc:697] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 13 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:20.132279 30861 raft_consensus.cc:3055] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:20.132740 30861 raft_consensus.cc:740] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:20.132814 30998 consensus_queue.cc:237] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:20.133661 30861 consensus_queue.cc:260] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:20.030411 25678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2541) took 1191 ms. Trace:
I20260709 12:25:20.031400 30764 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:20.136053 25678 rpcz_store.cc:276] 0709 12:25:18.839184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:18.843280 (+  4096us) service_pool.cc:224] Handling call
0709 12:25:18.843675 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:18.853922 (+ 10247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:18.853968 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:18.877093 (+ 23125us) log.cc:844] Serialized 26 byte log entry
0709 12:25:19.191523 (+314430us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:19.191565 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:19.191634 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:20.030198 (+838564us) raft_consensus.cc:1685] finished
0709 12:25:20.030219 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:20.030353 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9768,"raft.queue_time_us":14330,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":75,"thread_start_us":232444,"threads_started":1,"wal-append.queue_time_us":419940}
I20260709 12:25:20.137332 30764 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:20.061309 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 139490us
I20260709 12:25:20.033768 30852 raft_consensus.cc:2749] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:25:20.141803 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:20.114246 30799 raft_consensus.cc:2804] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:25:20.142230 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:19.925194 30581 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:20.128355 29802 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:20.160466 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:20.161572 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:20.128309 25801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:20.162334 25801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:19.980437 30849 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:20.032711 26436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 1277) took 1250 ms. Trace:
W20260709 12:25:19.942685 30899 consensus_meta.cc:287] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.749s	user 0.005s	sys 0.005s
I20260709 12:25:20.140202 25650 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:20.168021 25650 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:20.140506 25649 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:20.143512 25754 raft_consensus.cc:1275] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 12:25:20.147943 30922 consensus_meta.cc:287] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.827s	user 0.008s	sys 0.001s
I20260709 12:25:20.148406 30787 consensus_queue.cc:237] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:20.113425 30762 raft_consensus.cc:697] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 13 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:19.988108 30857 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:20.152328 30853 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:20.153594 30975 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:20.152374 30799 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:20.117842 30798 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:20.156319 30764 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:20.163060 26401 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:20.138303 30463 raft_consensus.cc:2749] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:20.170465 29802 raft_consensus.cc:2749] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:20.171375 25756 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 15.
I20260709 12:25:20.171808 25680 raft_consensus.cc:1240] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:20.133661 31005 raft_consensus.cc:3055] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:20.165390 26436 rpcz_store.cc:276] 0709 12:25:18.782553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:18.815389 (+ 32836us) service_pool.cc:224] Handling call
0709 12:25:18.815737 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:18.836857 (+ 21120us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:18.836911 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:18.860893 (+ 23982us) log.cc:844] Serialized 26 byte log entry
0709 12:25:19.277444 (+416551us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:19.277501 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:19.277577 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:20.032458 (+754881us) raft_consensus.cc:1685] finished
0709 12:25:20.032479 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:20.032639 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5612,"raft.queue_time_us":5177,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":26149,"thread_start_us":372959,"threads_started":1,"wal-append.queue_time_us":521326}
I20260709 12:25:20.176816 25760 raft_consensus.cc:1240] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 18. Current term is 19. Ops: []
W20260709 12:25:20.183139 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 423117us
I20260709 12:25:20.178135 25650 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:20.252835 25762 raft_consensus.cc:2468] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 12.
W20260709 12:25:20.260859 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:20.176919 25649 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:25:20.365252 25728 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.009s	sys 0.010s
I20260709 12:25:20.213999 25833 raft_consensus.cc:3060] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:20.340907 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:19.955297 30908 consensus_meta.cc:287] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.756s	user 0.007s	sys 0.000s
I20260709 12:25:20.320705 25832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41782 (request call id 1073) took 1052 ms. Trace:
W20260709 12:25:20.419521 25834 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.003s	sys 0.007s
W20260709 12:25:20.435043 25834 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.003s	sys 0.008s
W20260709 12:25:20.419464 25758 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.007s	sys 0.001s
W20260709 12:25:20.417435 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 239394us
W20260709 12:25:20.419589 26402 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.001s	sys 0.010s
W20260709 12:25:20.435696 25758 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.007s	sys 0.001s
W20260709 12:25:20.417717 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 254789us
W20260709 12:25:20.438445 26402 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.001s	sys 0.010s
W20260709 12:25:20.439229 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 770885us
W20260709 12:25:20.417028 25728 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.009s	sys 0.013s
W20260709 12:25:20.434715 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 257890us
I20260709 12:25:20.435257 25832 rpcz_store.cc:276] 0709 12:25:19.268587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:19.268764 (+   177us) service_pool.cc:224] Handling call
0709 12:25:19.269084 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:19.269407 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:19.269434 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:19.269963 (+   529us) log.cc:844] Serialized 26 byte log entry
0709 12:25:19.664779 (+394816us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:19.664823 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:19.664891 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:20.320465 (+655574us) raft_consensus.cc:1685] finished
0709 12:25:20.320499 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:20.320641 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":556,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":12509,"spinlock_wait_cycles":159104,"thread_start_us":374576,"threads_started":1,"wal-append.queue_time_us":1045083}
I20260709 12:25:20.462219 25758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 3178) took 1135 ms. Trace:
I20260709 12:25:20.465160 25761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 2776) took 1317 ms. Trace:
I20260709 12:25:20.465770 25761 rpcz_store.cc:276] 0709 12:25:19.147344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:19.172044 (+ 24700us) service_pool.cc:224] Handling call
0709 12:25:19.172354 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:19.241953 (+ 69599us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:20.464911 (+1222958us) spinlock_profiling.cc:243] Waited 69 ms on lock 0x7b54001db5d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:20.465102 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":158742912}
W20260709 12:25:20.330658 31009 log.cc:927] Time spent T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 12:25:20.171556 30921 raft_consensus.cc:2804] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:20.184765 30852 raft_consensus.cc:3060] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:20.476517 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:20.175879 30970 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:20.316928 31008 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:20.416817 30799 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:20.437813 30996 raft_consensus.cc:2749] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:20.433557 30930 raft_consensus.cc:2749] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:20.433420 30860 raft_consensus.cc:2749] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:20.431984 30561 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.306413 30990 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:20.415678 31005 raft_consensus.cc:740] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:20.487818 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:25:20.486191 26402 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:20.188727 30922 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:20.433836 30839 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:20.490162 31014 log.cc:927] Time spent T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:25:20.463737 30780 consensus_queue.cc:1048] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:25:20.483330 30764 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.435590 30899 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:20.483937 30921 raft_consensus.cc:697] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 16 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:20.513772 31016 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:20.484949 30872 consensus_queue.cc:1048] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 12:25:20.488497 31004 consensus_queue.cc:1048] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 12:25:20.487406 30970 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:20.534319 30940 raft_consensus.cc:3055] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:20.534911 30940 raft_consensus.cc:740] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:20.536049 30940 consensus_queue.cc:260] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:20.484045 31012 consensus_queue.cc:1059] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 12:25:20.487927 31008 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:20.510776 30990 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:20.528470 31016 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:20.549487 31010 log.cc:927] Time spent T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 12:25:20.547278 30940 raft_consensus.cc:3060] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:20.549846 30922 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:20.549353 31005 consensus_queue.cc:260] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:20.553030 31005 raft_consensus.cc:3060] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:20.555022 31008 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:20.557701 30943 raft_consensus.cc:3060] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:20.558545 30962 raft_consensus.cc:3060] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:20.560740 31004 raft_consensus.cc:3055] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:25:20.555840 30993 log.cc:927] Time spent T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.728s	user 0.002s	sys 0.004s
I20260709 12:25:20.568418 31004 raft_consensus.cc:740] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:19.912771 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:20.634191 25679 raft_consensus.cc:1240] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 13 LEADER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:20.636601 25683 raft_consensus.cc:1240] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:20.638285 25684 raft_consensus.cc:1240] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:25:20.478907 25726 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
W20260709 12:25:20.641198 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 162224us
W20260709 12:25:20.643330 25800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:20.643102 25649 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:25:20.644119 25800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:20.645279 25762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53460 (request call id 2781) took 1126 ms. Trace:
W20260709 12:25:20.478718 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:20.645934 25762 rpcz_store.cc:276] 0709 12:25:19.518929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:19.768857 (+249928us) service_pool.cc:224] Handling call
0709 12:25:20.644682 (+875825us) spinlock_profiling.cc:243] Waited 483 ms on lock 0x7b54001a77d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:20.644978 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1110776192}
I20260709 12:25:20.462654 25758 rpcz_store.cc:276] 0709 12:25:19.326387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:19.326498 (+   111us) service_pool.cc:224] Handling call
0709 12:25:19.326741 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:19.326908 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:25:19.684059 (+357151us) log.cc:844] Serialized 14 byte log entry
0709 12:25:20.438723 (+754664us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:20.461920 (+ 23197us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:20.461962 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:20.462026 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:20.462160 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2146,"prepare.queue_time_us":665858,"prepare.run_cpu_time_us":126,"prepare.run_wall_time_us":126,"raft.queue_time_us":136385,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"thread_start_us":1060437,"threads_started":3,"wal-append.queue_time_us":365489}
I20260709 12:25:20.651262 25678 raft_consensus.cc:1240] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 12:25:20.656457 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:20.657248 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:20.657922 25678 raft_consensus.cc:1240] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:20.660923 25762 raft_consensus.cc:1240] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:20.661501 25758 raft_consensus.cc:1275] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 12:25:20.661876 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:20.663334 25683 raft_consensus.cc:2393] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 12: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:20.501611 25833 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 8.
I20260709 12:25:20.669854 25726 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:20.672276 25835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41782 (request call id 1070) took 1699 ms. Trace:
I20260709 12:25:20.672883 25835 rpcz_store.cc:276] 0709 12:25:18.972433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:18.988483 (+ 16050us) service_pool.cc:224] Handling call
0709 12:25:19.898541 (+910058us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:19.962153 (+ 63612us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:20.671674 (+709521us) spinlock_profiling.cc:243] Waited 909 ms on lock 0x7b54002c10d0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b608ad 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:20.672005 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2091607296}
I20260709 12:25:20.673389 25726 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:20.660688 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:20.676054 26402 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:20.676206 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:20.676609 26402 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:20.677623 25684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40230 (request call id 1816) took 1815 ms. Trace:
I20260709 12:25:20.678078 25684 rpcz_store.cc:276] 0709 12:25:18.862634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:18.932423 (+ 69789us) service_pool.cc:224] Handling call
0709 12:25:18.978673 (+ 46250us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:20.638939 (+1660266us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:20.677265 (+ 38326us) spinlock_profiling.cc:243] Waited 1.66 s on lock 0x7b54002486d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:20.677531 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3815073024}
I20260709 12:25:20.682798 26402 leader_election.cc:400] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 election: Vote denied by peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237) with higher term. Message: Invalid argument: T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 12. Current term is 13.
I20260709 12:25:20.661012 25678 raft_consensus.cc:1240] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 14 LEADER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 13. Current term is 14. Ops: []
W20260709 12:25:20.686635 26404 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.718s	user 0.012s	sys 0.008s
W20260709 12:25:20.687086 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:20.687232 26404 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.904s	user 0.012s	sys 0.008s
I20260709 12:25:20.546048 30970 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:20.559471 30990 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:20.563385 31016 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:20.682469 25581 catalog_manager.cc:5697] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 6 to 7, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 7 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:20.726861 30581 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:25:20.720249 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 44423.7us
I20260709 12:25:20.746719 30985 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.487077 30669 consensus_queue.cc:1048] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:25:20.514724 26436 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:20.545393 30861 raft_consensus.cc:3060] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:20.776189 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 107907us
I20260709 12:25:20.541026 30899 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:20.793460 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 108664us
W20260709 12:25:20.801843 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 147869us
W20260709 12:25:20.805408 26430 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.010s	sys 0.018s
I20260709 12:25:20.506095 30561 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:20.811825 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:20.814850 26430 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.010s	sys 0.018s
I20260709 12:25:20.816960 30940 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.818363 30899 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.818570 30969 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.819052 30940 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:20.819540 30969 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:20.823081 30940 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:20.823215 30997 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.825213 30975 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
W20260709 12:25:20.825474 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 55304.4us
I20260709 12:25:20.850580 31007 raft_consensus.cc:2749] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:20.819404 30899 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:20.828183 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:20.853960 30977 consensus_queue.cc:1048] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.050s
I20260709 12:25:20.851624 30994 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.854912 30996 raft_consensus.cc:2749] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:20.844370 30857 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:20.855540 31005 raft_consensus.cc:2749] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:20.856169 31013 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.856276 25649 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:20.859970 31008 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:20.851781 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 72003.3us
I20260709 12:25:20.828749 30980 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.812314 30885 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:20.884939 30885 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:20.888206 30885 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:20.824127 30903 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.889163 30903 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:20.891479 30903 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349)
I20260709 12:25:20.892233 30980 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:20.896513 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:20.897102 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:20.897446 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:20.898818 30975 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:20.899148 31013 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:20.901324 30975 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:20.905485 30839 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:20.823127 30969 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:20.906934 30855 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.907773 30855 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:20.910197 30855 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:20.912621 30893 consensus_queue.cc:260] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:20.914304 30893 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:20.918162 31004 consensus_queue.cc:260] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:20.921262 30535 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:20.928463 30613 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:20.932596 25763 raft_consensus.cc:1275] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:20.936252 31008 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:20.881510 25726 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
W20260709 12:25:20.942266 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 143413us
W20260709 12:25:20.942806 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:20.823861 30971 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.519174 30762 consensus_queue.cc:237] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:20.815646 30860 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:20.844210 31019 consensus_queue.cc:1048] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.108s
I20260709 12:25:20.815864 30935 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:20.828522 30972 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.832055 30985 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:20.523767 30764 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:20.828969 30921 consensus_queue.cc:237] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:20.943821 25726 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:20.828656 30794 raft_consensus.cc:2804] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:25:20.957222 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 151615us
I20260709 12:25:20.828401 30849 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:20.944116 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:20.963671 25763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48606 (request call id 1281) took 1536 ms. Trace:
W20260709 12:25:21.016566 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:21.013953 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 135588us
I20260709 12:25:20.961351 30798 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:20.956584 30872 raft_consensus.cc:2804] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:20.944775 30899 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:20.960232 30851 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:21.027534 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.013160 30794 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:20.901319 31013 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:20.954219 30710 raft_consensus.cc:3060] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:21.028460 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.028934 25763 rpcz_store.cc:276] 0709 12:25:19.427051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:19.982556 (+555505us) service_pool.cc:224] Handling call
0709 12:25:20.648934 (+666378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:20.933043 (+284109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:20.962971 (+ 29928us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b54001a77d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:20.963423 (+   452us) spinlock_profiling.cc:243] Waited 666 ms on lock 0x7b54001a77d0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b608ad 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:20.963596 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2182238336}
W20260709 12:25:21.033758 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.012821 30855 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:21.033478 25757 raft_consensus.cc:2468] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 16.
I20260709 12:25:20.906854 31025 consensus_queue.cc:1048] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.146s
I20260709 12:25:21.025506 31008 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:20.961997 30997 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:20.957123 30994 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:21.050050 30985 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:21.007501 30972 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:21.055090 25584 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41232 (request call id 391) took 22790 ms (client timeout 15000 ms). Trace:
I20260709 12:25:21.058300 25800 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:21.061400 31025 consensus_queue.cc:1059] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:21.066429 25581 catalog_manager.cc:5697] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } }
W20260709 12:25:21.045552 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 163219us
I20260709 12:25:21.032768 30872 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:21.040720 31004 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:21.038395 30794 raft_consensus.cc:3060] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:21.039225 30980 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:21.042905 31005 raft_consensus.cc:2804] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:21.078208 30855 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:21.079361 30977 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.081656 26431 raft_consensus.cc:2468] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 13.
I20260709 12:25:21.081964 30378 raft_consensus.cc:2749] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:21.104118 25830 raft_consensus.cc:1275] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 12:25:21.082659 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.105291 30884 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.105952 30884 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:21.026930 30860 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:21.073889 30872 raft_consensus.cc:3060] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:21.110932 26430 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "25bd5658646b41608d707d196c6e0585"
dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
 from {username='slave'} at 127.0.0.1:36508
I20260709 12:25:21.085546 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:21.103227 30977 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:21.087345 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:21.088282 26402 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:21.088469 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:21.088682 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:21.090641 25828 raft_consensus.cc:1275] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 12:25:21.091692 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 235619us
I20260709 12:25:21.116758 31005 raft_consensus.cc:697] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:21.117708 25649 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:21.118559 25831 raft_consensus.cc:3060] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:21.118220 31005 consensus_queue.cc:237] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:21.121150 30997 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:21.124163 25834 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:21.125803 30764 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:21.126695 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 183021us
I20260709 12:25:21.092724 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:21.094179 31041 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.128454 31041 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:21.129130 25726 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:21.130064 25833 raft_consensus.cc:2393] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 15: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:21.094741 30669 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.099303 26439 raft_consensus.cc:1240] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:21.099300 30670 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
W20260709 12:25:21.112304 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 54133.2us
I20260709 12:25:21.086903 30972 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:21.111872 26430 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:21.111861 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:21.131842 26430 raft_consensus.cc:3060] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:21.038218 30935 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:21.156059 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:21.168751 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 61109.8us
I20260709 12:25:21.174079 25831 raft_consensus.cc:2468] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 12.
W20260709 12:25:21.182824 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 94701.8us
W20260709 12:25:21.183408 30962 consensus_meta.cc:287] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.549s	user 0.008s	sys 0.009s
I20260709 12:25:21.184216 30669 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:21.188203 26436 raft_consensus.cc:2468] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 14.
I20260709 12:25:21.076159 30851 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:21.172797 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:21.067996 30971 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:21.191828 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:21.129446 30998 consensus_queue.cc:1048] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 12:25:21.177991 31013 raft_consensus.cc:2804] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:21.208180 30668 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.208658 30561 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:21.209462 30851 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:21.210040 30943 raft_consensus.cc:2749] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:21.210496 25726 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a
W20260709 12:25:21.211021 30853 consensus_meta.cc:287] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.777s	user 0.014s	sys 0.000s
I20260709 12:25:21.218832 30977 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:25:21.219071 26431 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36508 (request call id 1271) took 2399 ms (client timeout 2046 ms). Trace:
I20260709 12:25:21.220829 30884 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:21.222473 31041 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:21.223428 25758 raft_consensus.cc:2468] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 13.
I20260709 12:25:21.227113 30994 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:21.227550 30971 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:21.227958 30908 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:21.228693 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 111186us
I20260709 12:25:21.281107 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:21.229528 25832 raft_consensus.cc:1275] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:25:21.281877 30908 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:21.283134 31041 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:21.229677 30857 consensus_queue.cc:1048] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:21.283808 31041 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:21.233125 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:21.234072 25581 catalog_manager.cc:5697] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:21.286022 31041 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:21.193711 30670 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:21.236081 30885 consensus_queue.cc:1059] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:21.236745 30972 consensus_queue.cc:1059] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:21.293596 30972 raft_consensus.cc:3055] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:21.293967 30972 raft_consensus.cc:740] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:21.294994 30535 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:21.240217 25759 raft_consensus.cc:2468] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 12.
I20260709 12:25:21.231704 26402 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:21.295841 30535 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:21.296806 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 65204us
I20260709 12:25:21.298235 30535 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:21.299037 31011 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.242030 25834 raft_consensus.cc:2468] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 14.
I20260709 12:25:21.242549 25763 raft_consensus.cc:2468] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 14.
W20260709 12:25:21.300252 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.244778 31037 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.244874 26439 raft_consensus.cc:1240] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 19 LEADER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 18. Current term is 19. Ops: []
I20260709 12:25:21.245383 30945 raft_consensus.cc:2804] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:21.246999 30935 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:21.253319 30860 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:21.254056 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:21.205250 30997 raft_consensus.cc:2804] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:21.258571 26430 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:21.260444 30852 consensus_meta.cc:287] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.779s	user 0.008s	sys 0.008s
I20260709 12:25:21.224603 26401 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:21.260915 31013 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:21.275831 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.280972 30561 raft_consensus.cc:2804] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:21.284193 30952 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.237380 30975 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
W20260709 12:25:21.281921 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 89762.6us
W20260709 12:25:21.274614 26431 rpcz_store.cc:269] 0709 12:25:18.819610 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:18.824834 (+  5224us) service_pool.cc:224] Handling call
0709 12:25:21.218787 (+2393953us) spinlock_profiling.cc:243] Waited 2.21 s on lock 0x7b5400604fd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:21.218960 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5076725504}
W20260709 12:25:21.292845 30799 consensus_meta.cc:287] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.782s	user 0.014s	sys 0.003s
I20260709 12:25:21.306057 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:21.287715 25581 catalog_manager.cc:5697] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 7 to 8, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 8 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:21.295055 30972 consensus_queue.cc:260] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:21.315076 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:21.322146 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:21.322729 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:21.326666 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 120344us
I20260709 12:25:21.327550 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:21.331043 30852 raft_consensus.cc:2749] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:21.299613 31011 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:21.317243 30997 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:21.338908 26438 raft_consensus.cc:1240] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:21.335539 30561 raft_consensus.cc:697] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 13 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
W20260709 12:25:21.070132 25584 rpcz_store.cc:269] 0709 12:24:58.277187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.285392 (+  8205us) service_pool.cc:224] Handling call
0709 12:24:59.188261 (+902869us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b5400078854. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99acb090 00007f5d99b69f3a 00007f5d9f91fe9c 00007f5d9fa1e04e 00007f5d9dedf2a4 00007f5d9dedf232 00007f5d9dedf161 00007f5d9dedf0dc 00007f5d9dede392 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:21.054841 (+21866580us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:09.004102 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:09.004830 (+   728us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:09.004884 (+    54us) write_op.cc:435] Acquired schema lock
0709 12:25:09.004908 (+    24us) tablet.cc:662] Decoding operations
0709 12:25:09.011742 (+  6834us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:09.011854 (+   112us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:09.011890 (+    36us) tablet.cc:685] Acquiring locks for 24 operations
0709 12:25:09.014185 (+  2295us) tablet.cc:701] Row locks acquired
0709 12:25:09.014236 (+    51us) write_op.cc:260] PREPARE: finished
0709 12:25:09.014435 (+   199us) write_op.cc:270] Start()
0709 12:25:09.014614 (+   179us) write_op.cc:276] Timestamp: P: 1783599909014348 usec, L: 0
0709 12:25:09.014637 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:25:09.040208 (+ 25571us) log.cc:844] Serialized 9586 byte log entry
0709 12:25:10.262917 (+1222709us) spinlock_profiling.cc:243] Waited 2.31 ms on lock 0x7b4400022b4c. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db 00007f5d99708aaf 00007f5d996fc86e 00007f5d996fbbb6 00007f5d996fb7d8 00007f5d99705221 00007f5d997051d9 00007f5d99705169
0709 12:25:10.463909 (+200992us) op_driver.cc:464] REPLICATION: finished
0709 12:25:10.705188 (+241279us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b4400022b4c. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db 00007f5d99708aaf 00007f5d96a570ac 00007f5d9f8b19a9 00007f5d96a7369b 00007f5d96a7193f 00007f5d96a73c02 00007f5d9d597ef0
0709 12:25:11.100510 (+395322us) write_op.cc:301] APPLY: starting
0709 12:25:11.100670 (+   160us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:11.417270 (+316600us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:11.437392 (+ 20122us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:13.550561 (+2113169us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:13.551204 (+   643us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=48,key_file_lookups=48,delta_file_lookups=48,mrs_lookups=0
0709 12:25:13.551302 (+    98us) write_op.cc:312] APPLY: finished
0709 12:25:13.552146 (+   844us) log.cc:844] Serialized 212 byte log entry
0709 12:25:13.667688 (+115542us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:13.672775 (+  5087us) write_op.cc:454] Released schema lock
0709 12:25:13.672861 (+    86us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:13.782940 (+110079us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:13.785766 (+  2826us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":60322,"reported_tablets":46,"spinlock_wait_cycles":622974336,"child_traces":[["op",{"apply.queue_time_us":616466,"apply.run_cpu_time_us":75494,"apply.run_wall_time_us":2649151,"cfile_cache_hit":98,"cfile_cache_hit_bytes":104447,"num_ops":24,"prepare.queue_time_us":321165,"prepare.run_cpu_time_us":108108,"prepare.run_wall_time_us":208155,"raft.queue_time_us":152250,"raft.run_cpu_time_us":48334,"raft.run_wall_time_us":518120,"replication_time_us":1449025,"spinlock_wait_cycles":31798912,"thread_start_us":899472,"threads_started":5,"wal-append.queue_time_us":631896,"wal-append.run_cpu_time_us":51263,"wal-append.run_wall_time_us":3039684}]]}
I20260709 12:25:21.336325 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:25:21.348475 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.325701 31013 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:21.346887 25726 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:21.350710 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:21.289319 30668 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:21.353672 30972 raft_consensus.cc:3060] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:21.354173 25831 raft_consensus.cc:1240] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:21.334498 30857 raft_consensus.cc:3060] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:21.357421 25830 raft_consensus.cc:1275] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 12:25:21.377650 25828 raft_consensus.cc:2410] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:25:21.360008 30971 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.361518 30975 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:21.275298 30872 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:21.352723 26435 raft_consensus.cc:1240] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:21.331383 30885 raft_consensus.cc:2804] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:21.329671 30945 raft_consensus.cc:697] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 15 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:21.377132 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:21.384021 26439 raft_consensus.cc:3060] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:21.348644 30997 raft_consensus.cc:3060] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:21.389042 25834 raft_consensus.cc:1240] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:25:21.387799 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:21.396157 25762 raft_consensus.cc:1275] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:25:21.386001 25758 raft_consensus.cc:2468] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 16.
I20260709 12:25:21.344085 30952 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:21.392486 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:25:21.400077 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.387503 30971 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:21.402541 30975 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:21.403136 30971 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:21.403396 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:21.319078 31037 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:21.384208 30885 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:21.404561 26435 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 13.
I20260709 12:25:21.409578 26401 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:21.397197 25581 catalog_manager.cc:5697] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 3 to 7, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 7 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:25:21.412999 26401 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:21.419862 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:21.396013 30994 raft_consensus.cc:2804] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:21.362762 30799 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:21.411041 30885 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:21.430181 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:21.430349 30945 consensus_queue.cc:237] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:21.431493 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:21.432121 26432 raft_consensus.cc:2468] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 13.
I20260709 12:25:21.433003 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:21.433543 26432 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 13.
I20260709 12:25:21.434302 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:21.434834 30872 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:21.436636 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:21.437685 26437 raft_consensus.cc:2410] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:25:21.438933 26437 raft_consensus.cc:1275] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:25:21.439445 30799 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:21.440685 25754 raft_consensus.cc:1240] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 LEADER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:21.442113 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:21.444576 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:21.415789 30943 raft_consensus.cc:2804] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:21.445684 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:21.434828 26432 raft_consensus.cc:2468] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 12.
I20260709 12:25:21.455057 26431 raft_consensus.cc:2468] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 14.
I20260709 12:25:21.425969 30884 raft_consensus.cc:2764] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:25:21.427222 30994 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:21.454224 25837 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 11.
I20260709 12:25:21.460189 26439 raft_consensus.cc:2468] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 15.
I20260709 12:25:21.462394 30799 consensus_queue.cc:1048] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:21.452845 30943 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:21.471583 25801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.456799 30971 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:21.477528 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.478437 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: true dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:21.479030 25758 raft_consensus.cc:3060] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:21.479873 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:21.470072 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:21.481353 25830 raft_consensus.cc:2468] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 16.
I20260709 12:25:21.468427 30994 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:21.482456 25762 raft_consensus.cc:2468] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 12.
W20260709 12:25:21.491633 25801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:21.492165 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 95451.2us
I20260709 12:25:21.477198 30943 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:21.498561 26431 raft_consensus.cc:1275] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 12. (term mismatch)
I20260709 12:25:21.499753 30855 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:21.500080 30561 consensus_queue.cc:237] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:21.501818 26437 raft_consensus.cc:1275] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:25:21.480216 30853 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.505743 30853 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:21.506891 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:21.486582 30971 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:21.508941 25650 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:21.510016 30971 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:21.510337 30921 raft_consensus.cc:2804] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:21.510843 25650 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:21.510964 30921 raft_consensus.cc:697] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 12 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:21.514631 30787 raft_consensus.cc:2804] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:21.515100 25650 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:21.512609 30998 consensus_queue.cc:1048] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:21.516523 30670 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:21.515259 30787 raft_consensus.cc:697] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 14 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:21.512492 31008 raft_consensus.cc:3055] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:21.517912 31008 raft_consensus.cc:740] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:21.518290 30787 consensus_queue.cc:237] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:21.518905 31008 consensus_queue.cc:260] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:21.520328 31008 raft_consensus.cc:3060] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:21.510054 30378 consensus_queue.cc:1048] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 12:25:21.515228 30921 consensus_queue.cc:237] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:21.500628 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:21.499011 26431 pending_rounds.cc:85] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89: Aborting all ops after (but not including) 11
I20260709 12:25:21.532768 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:21.533259 26430 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:21.533542 25835 raft_consensus.cc:2468] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 12.
W20260709 12:25:21.534824 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:21.535220 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.537345 31013 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:21.537971 31041 raft_consensus.cc:3055] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:21.538414 31041 raft_consensus.cc:740] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:21.538621 25832 raft_consensus.cc:1240] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:21.540182 30971 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:21.540822 30971 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:21.541846 25759 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53474 (request call id 3179) took 2213 ms (client timeout 1614 ms). Trace:
W20260709 12:25:21.542209 25759 rpcz_store.cc:269] 0709 12:25:19.328245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:19.328680 (+   435us) service_pool.cc:224] Handling call
0709 12:25:21.541629 (+2212949us) spinlock_profiling.cc:243] Waited 1.84 s on lock 0x7b5400396cd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:21.541764 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4239400064}
I20260709 12:25:21.542943 30971 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:21.543277 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:21.544275 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:25:21.544752 31052 log.cc:927] Time spent T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:25:21.544947 25834 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 20.
I20260709 12:25:21.492707 30668 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:21.545758 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:21.547013 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:21.547179 30962 consensus_queue.cc:1048] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:21.547538 25756 raft_consensus.cc:2468] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 12.
I20260709 12:25:21.548928 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:21.549118 30855 consensus_queue.cc:1048] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:21.549872 25726 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:21.550107 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:21.550714 25761 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 13.
I20260709 12:25:21.551215 30872 raft_consensus.cc:2804] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:21.551703 30872 raft_consensus.cc:697] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 13 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:21.552688 30872 consensus_queue.cc:237] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:21.563328 31011 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:21.565265 30952 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:21.567829 30669 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:21.568477 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:21.569265 25757 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 15.
I20260709 12:25:21.551586 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:21.576602 25650 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:21.577756 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:21.580112 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:21.528739 26431 pending_rounds.cc:107] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 12:25:21.581223 26431 raft_consensus.cc:2889] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:21.570509 25801 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:21.585064 26401 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:21.587227 25828 raft_consensus.cc:2468] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 11.
I20260709 12:25:21.590022 25760 raft_consensus.cc:2410] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:25:21.592150 26401 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:21.603986 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:21.605386 30908 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:21.606578 31037 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:21.609225 26434 raft_consensus.cc:2410] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:25:21.608496 30885 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:21.621055 25758 raft_consensus.cc:2468] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 15.
I20260709 12:25:21.603603 30857 raft_consensus.cc:2749] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:25:21.643065 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.654805 25650 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:21.645872 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:21.584451 30378 raft_consensus.cc:2804] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:21.590353 30799 raft_consensus.cc:2749] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:21.589599 30670 raft_consensus.cc:2804] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:25:21.658337 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 66281us
I20260709 12:25:21.539503 31041 consensus_queue.cc:260] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:21.663729 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.567765 30794 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:21.625013 31054 log.cc:927] Time spent T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.104s	user 0.000s	sys 0.002s
W20260709 12:25:21.670329 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 99897.5us
I20260709 12:25:21.594133 30853 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:21.624747 30952 raft_consensus.cc:2749] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:21.664042 30884 raft_consensus.cc:2804] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:21.686285 26401 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:21.696408 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:21.697420 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:21.694646 26433 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 12.
I20260709 12:25:21.701537 26401 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:21.711429 25763 raft_consensus.cc:1240] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:21.690445 30670 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:21.716588 25760 raft_consensus.cc:2393] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 12: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:21.717638 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:21.712554 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:21.729929 25836 raft_consensus.cc:1240] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:25:21.730067 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:21.730242 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:21.730873 25683 raft_consensus.cc:2468] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 12.
I20260709 12:25:21.731464 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:21.698661 30922 consensus_queue.cc:1048] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:25:21.732758 31013 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:21.733273 30885 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:21.710719 30857 raft_consensus.cc:2804] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:21.736052 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:21.737905 30945 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
W20260709 12:25:21.738669 25649 connection.cc:256] RPC call timeout handler was delayed by -1.0610082870002771s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16140000000000002s for a response
I20260709 12:25:21.739789 26431 raft_consensus.cc:1275] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 12:25:21.759879 26431 pending_rounds.cc:85] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89: Aborting all ops after (but not including) 9
I20260709 12:25:21.760236 26431 pending_rounds.cc:107] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 12:25:21.760533 26431 raft_consensus.cc:2889] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:21.740192 30930 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.741302 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:21.697115 30378 raft_consensus.cc:697] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 14 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:21.703938 30884 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:21.743729 25835 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:21.715459 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:21.745357 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:21.750771 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:21.771719 25828 raft_consensus.cc:2468] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 13.
I20260709 12:25:21.751148 29802 raft_consensus.cc:2749] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:21.752059 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:21.753149 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:21.754228 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:21.755568 25682 raft_consensus.cc:1240] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 16 LEADER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:21.718487 31037 raft_consensus.cc:2804] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:21.742499 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:21.722954 30670 raft_consensus.cc:3060] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:21.757947 30997 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:21.746941 30799 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.746940 31041 raft_consensus.cc:3060] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:21.797011 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:21.797619 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:21.797869 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.768872 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:21.759447 30857 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:21.785338 25801 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:21.773463 30884 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:21.806496 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:21.809413 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:21.766290 30535 consensus_queue.cc:1059] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 12:25:21.861090 25835 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 18.
I20260709 12:25:21.815469 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:21.816176 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:21.820003 30799 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:21.821966 30903 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:21.824776 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:21.813417 30668 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.825524 25759 raft_consensus.cc:2393] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 14: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:21.814087 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:21.825655 30997 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:21.826807 25680 raft_consensus.cc:1240] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:21.832568 25678 raft_consensus.cc:2393] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 11: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:21.833353 30952 raft_consensus.cc:2804] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:21.834041 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:21.836560 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: true dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:21.838555 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:21.840044 25801 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:21.840904 25676 tablet_service.cc:1558] Processing DeleteTablet for tablet 237622cb71464b3ca091560bd9d8c06b with delete_type TABLET_DATA_TOMBSTONED (TS f82778701b464892aab92a752ed7ffdc not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:40214
W20260709 12:25:21.842818 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.854502 30884 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:21.810276 25760 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 15.
I20260709 12:25:21.858613 25684 raft_consensus.cc:2468] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 9.
I20260709 12:25:21.805447 30857 raft_consensus.cc:3060] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:21.796382 31037 raft_consensus.cc:697] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 15 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:21.766359 30945 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:21.874364 29802 consensus_queue.cc:1048] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:25:21.884231 25836 raft_consensus.cc:3055] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:21.884997 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:21.885963 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:21.887451 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.907589 25758 raft_consensus.cc:2468] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 16.
I20260709 12:25:21.889452 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:21.892185 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:25:21.893577 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 80168.3us
I20260709 12:25:21.906853 25836 raft_consensus.cc:740] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
W20260709 12:25:21.875032 31056 log.cc:927] Time spent T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.150s	user 0.003s	sys 0.000s
W20260709 12:25:21.894325 25800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.895800 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:21.892727 25679 raft_consensus.cc:2468] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 10.
I20260709 12:25:21.921161 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:21.900395 31055 log.cc:927] Time spent T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 12:25:21.904852 25828 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 13.
I20260709 12:25:21.905539 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:21.911821 25650 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:21.910802 25801 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:21.902557 25682 raft_consensus.cc:2468] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 14.
I20260709 12:25:21.926800 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:21.886518 30952 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:21.935045 26438 raft_consensus.cc:1240] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 12 LEADER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:21.876395 30922 consensus_queue.cc:1048] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 12:25:21.938338 25836 consensus_queue.cc:260] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:21.940465 26435 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 15.
I20260709 12:25:21.943305 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:21.945051 29802 raft_consensus.cc:2804] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:21.949882 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:21.950040 29802 raft_consensus.cc:697] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 18 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:21.901654 30971 raft_consensus.cc:2804] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:21.954260 25835 raft_consensus.cc:2468] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 9.
I20260709 12:25:21.919864 30853 raft_consensus.cc:3055] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:21.944025 25686 raft_consensus.cc:2468] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 11.
I20260709 12:25:21.955624 25682 raft_consensus.cc:2410] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:25:21.973121 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:21.951211 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:21.956638 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:21.978339 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:25:21.961190 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.968242 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:21.807476 30930 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:21.975399 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:21.976404 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:21.980368 25828 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:21.959858 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:21.979285 25760 raft_consensus.cc:2468] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 12.
I20260709 12:25:21.974696 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:21.982213 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:21.983541 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:21.884879 30668 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:21.988476 26439 raft_consensus.cc:3055] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:21.950613 30952 raft_consensus.cc:3060] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:21.996032 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:21.996670 25682 raft_consensus.cc:2468] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 12.
I20260709 12:25:21.991658 26439 raft_consensus.cc:740] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:21.989758 25681 raft_consensus.cc:2393] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 12: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:21.895406 30903 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:21.993232 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:21.956163 30971 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:22.006274 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:22.012667 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:25:22.015789 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:22.007700 25763 raft_consensus.cc:2468] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 13.
I20260709 12:25:22.000766 29802 consensus_queue.cc:237] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:22.023059 25684 raft_consensus.cc:2393] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 12: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:22.014385 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:22.023998 25755 raft_consensus.cc:2468] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 11.
I20260709 12:25:21.977553 30853 raft_consensus.cc:740] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
W20260709 12:25:22.035229 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:22.036266 25681 raft_consensus.cc:2393] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 12: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:22.039366 25685 raft_consensus.cc:2410] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:25:22.044452 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:22.050279 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:22.040901 26439 consensus_queue.cc:260] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:22.051626 26439 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:22.002769 30794 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:22.009469 30885 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.010558 30971 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:22.055455 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:22.055608 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:22.071056 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:22.047987 30935 raft_consensus.cc:2804] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:22.090762 25683 raft_consensus.cc:2393] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 13: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:22.081943 25682 raft_consensus.cc:2393] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 8: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:22.088582 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:22.103466 25828 raft_consensus.cc:2468] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 17.
W20260709 12:25:22.078863 30943 consensus_meta.cc:287] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.505s	user 0.011s	sys 0.000s
I20260709 12:25:22.001343 30378 consensus_queue.cc:237] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:22.094108 30935 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:22.141776 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:25:22.170040 25569 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet c87d777e7d64471f988b07272bf2441c with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica f82778701b464892aab92a752ed7ffdc is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:25:22.177047 30799 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:22.179219 30884 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:22.182533 25756 raft_consensus.cc:1240] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:22.183971 25756 raft_consensus.cc:1275] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:25:22.185758 25756 raft_consensus.cc:1275] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 12:25:22.188789 31059 log.cc:927] Time spent T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.233s	user 0.001s	sys 0.000s
W20260709 12:25:22.190331 31061 log.cc:927] Time spent T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.249s	user 0.000s	sys 0.001s
W20260709 12:25:22.191761 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:22.191689 30853 consensus_queue.cc:260] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:22.193049 30853 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:22.136409 30935 raft_consensus.cc:3060] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:22.211144 26432 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.062s	sys 0.086s
W20260709 12:25:22.213567 26432 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.062s	sys 0.086s
I20260709 12:25:22.214706 25680 raft_consensus.cc:1275] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:25:22.216660 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:22.218367 25760 raft_consensus.cc:1275] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:25:22.093384 30885 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:22.226848 25679 raft_consensus.cc:2393] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 12: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:22.123276 30669 consensus_queue.cc:1048] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.089s
I20260709 12:25:22.083283 31037 consensus_queue.cc:237] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:22.125077 30943 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:22.247212 26439 raft_consensus.cc:1275] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260709 12:25:22.249008 31062 log.cc:927] Time spent T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
W20260709 12:25:22.223428 25649 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.245.130:37267 timed out after 1.614s (SENT) [suppressed 9 similar messages]
I20260709 12:25:22.263764 30930 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:22.273607 30885 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:22.274519 30903 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:25:22.276502 30994 consensus_meta.cc:287] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.720s	user 0.011s	sys 0.000s
I20260709 12:25:22.279187 25681 raft_consensus.cc:1275] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:25:22.281883 30668 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:22.277621 30945 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:22.315948 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 405175us
I20260709 12:25:22.330451 25801 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:22.331629 31013 raft_consensus.cc:2804] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:22.332276 31013 raft_consensus.cc:697] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 15 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:22.333360 25801 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:22.325958 30930 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:22.357890 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 437597us
W20260709 12:25:22.361020 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:22.347487 30668 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.368158 25800 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:22.333465 30994 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:22.380373 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 290314us
I20260709 12:25:22.378682 25801 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
W20260709 12:25:22.378295 31008 consensus_meta.cc:287] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.857s	user 0.006s	sys 0.006s
W20260709 12:25:22.393671 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:22.424063 25754 raft_consensus.cc:2393] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 14: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:22.425230 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:22.384668 31075 raft_consensus.cc:2804] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:22.429888 26431 raft_consensus.cc:2393] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 14: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
W20260709 12:25:22.432753 31065 log.cc:927] Time spent T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 12:25:22.433478 30670 consensus_meta.cc:287] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.620s	user 0.005s	sys 0.006s
I20260709 12:25:22.418581 31013 consensus_queue.cc:237] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:22.433864 30670 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:22.437148 25836 raft_consensus.cc:3060] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:22.437415 30994 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:22.393220 30903 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.438295 30903 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:22.440342 30903 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:22.442031 30857 consensus_meta.cc:287] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.514s	user 0.003s	sys 0.006s
I20260709 12:25:22.442402 30857 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:22.442548 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:22.444169 26434 raft_consensus.cc:1240] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:22.444295 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:22.445308 26432 raft_consensus.cc:2393] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 17: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:22.448334 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:22.381713 30930 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:22.455577 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:22.456604 26435 raft_consensus.cc:2468] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 11.
I20260709 12:25:22.457573 26436 raft_consensus.cc:1240] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:22.384852 30668 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:22.460644 25726 connection.cc:256] RPC call timeout handler was delayed by -3.0233385980000094s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16040000000000001s for a response
W20260709 12:25:22.460973 25726 connection.cc:256] RPC call timeout handler was delayed by -3.0080385979999846s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16210000000000002s for a response
W20260709 12:25:22.461233 25726 connection.cc:256] RPC call timeout handler was delayed by -2.9594385979999061s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1675s for a response
W20260709 12:25:22.463364 25762 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.000s	sys 0.029s
W20260709 12:25:22.463775 25762 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.000s	sys 0.029s
I20260709 12:25:22.430922 31075 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
W20260709 12:25:22.465761 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 242345us
I20260709 12:25:22.419306 31076 consensus_queue.cc:1048] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 12:25:22.476219 25762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 2797) took 1041 ms. Trace:
I20260709 12:25:22.459401 31008 raft_consensus.cc:2804] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:22.459021 31074 tablet_replica.cc:333] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
W20260709 12:25:22.503202 25726 connection.cc:256] RPC call timeout handler was delayed by -2.5364385980001316s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21450000000000002s for a response
W20260709 12:25:22.503948 25726 connection.cc:256] RPC call timeout handler was delayed by -1.6135610629999064s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16770000000000002s for a response
I20260709 12:25:22.477456 25762 rpcz_store.cc:276] 0709 12:25:21.435040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:21.610165 (+175125us) service_pool.cc:224] Handling call
0709 12:25:21.610574 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:21.610850 (+   276us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:25:21.807936 (+197086us) log.cc:844] Serialized 14 byte log entry
0709 12:25:22.469643 (+661707us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:22.469715 (+    72us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:22.469776 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:22.476047 (+  6271us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:22.476169 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":340889,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":41,"raft.queue_time_us":26312,"thread_start_us":802342,"threads_started":2}
W20260709 12:25:22.505270 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 140252us
I20260709 12:25:22.498430 26402 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:22.466104 30943 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:22.524852 25678 raft_consensus.cc:1240] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:22.525772 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:22.468432 31075 raft_consensus.cc:3060] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:22.528227 25836 raft_consensus.cc:2468] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 15.
I20260709 12:25:22.470278 30857 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:25:22.531438 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 99124.4us
I20260709 12:25:22.531906 25679 raft_consensus.cc:1240] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:22.532244 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:22.532812 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:22.536257 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:22.537032 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:22.538769 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:22.493285 31008 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:22.546641 25684 raft_consensus.cc:2468] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 14.
I20260709 12:25:22.466418 30952 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:22.550462 25677 raft_consensus.cc:1240] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 14 LEADER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:22.546659 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:22.552099 26402 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:22.554764 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:22.556250 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:22.513489 31083 raft_consensus.cc:2749] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:22.558192 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:22.556186 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:25:22.561066 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:22.561589 26402 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:22.553893 25683 raft_consensus.cc:3060] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:22.564404 31013 consensus_queue.cc:1048] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:22.566926 30952 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:22.567687 30668 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:22.570704 31085 log.cc:927] Time spent T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:25:22.561794 30857 consensus_queue.cc:1059] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 12:25:22.572925 30857 raft_consensus.cc:3055] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:22.573312 30857 raft_consensus.cc:740] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:22.574204 30857 consensus_queue.cc:260] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:22.575557 30857 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:22.531188 31079 raft_consensus.cc:2804] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:22.580636 31079 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:22.581073 31079 raft_consensus.cc:3060] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:22.583232 31077 log.cc:927] Time spent T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.219s	user 0.001s	sys 0.000s
I20260709 12:25:22.538295 30670 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:22.551937 31008 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:22.589535 25678 raft_consensus.cc:2393] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 12: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:22.550771 25800 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:22.594041 31037 raft_consensus.cc:2804] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:22.594270 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:22.594712 31037 raft_consensus.cc:697] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 11 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:22.595635 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:22.596333 25680 raft_consensus.cc:2468] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 16.
W20260709 12:25:22.599185 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:22.599664 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:22.589030 30884 raft_consensus.cc:2804] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:25:22.600654 30884 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:22.601022 30884 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:25:22.604017 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:22.604234 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:22.605348 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:22.595847 31037 consensus_queue.cc:237] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:22.608263 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:22.608965 25756 raft_consensus.cc:2393] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 15: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:22.609930 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:22.610811 25757 raft_consensus.cc:2468] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 13.
I20260709 12:25:22.612421 25726 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:22.613368 25754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53460 (request call id 2798) took 1178 ms. Trace:
I20260709 12:25:22.613945 30794 raft_consensus.cc:2749] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:22.613798 25754 rpcz_store.cc:276] 0709 12:25:21.435390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:21.441752 (+  6362us) service_pool.cc:224] Handling call
0709 12:25:22.613130 (+1171378us) spinlock_profiling.cc:243] Waited 977 ms on lock 0x7b54003a70d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:22.613264 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2247102336}
I20260709 12:25:22.615257 26401 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:22.616600 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:22.613883 25726 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:22.617624 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:22.592036 25649 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:22.626379 30853 raft_consensus.cc:2749] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:22.626601 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:22.627442 25754 raft_consensus.cc:2393] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 11: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:22.627770 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:22.628464 25756 raft_consensus.cc:2468] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 11.
I20260709 12:25:22.629386 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:22.629985 25762 raft_consensus.cc:3060] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:22.632246 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
W20260709 12:25:22.635227 30971 consensus_meta.cc:287] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.514s	user 0.008s	sys 0.001s
I20260709 12:25:22.637519 25726 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:22.637959 30935 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:22.638926 30794 raft_consensus.cc:2749] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:22.639118 30669 raft_consensus.cc:2804] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:22.623432 30908 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.650604 25758 raft_consensus.cc:1275] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 12:25:22.654837 31090 log.cc:927] Time spent T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.087s	user 0.001s	sys 0.001s
I20260709 12:25:22.657630 30930 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:22.661334 25683 raft_consensus.cc:2468] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 12.
W20260709 12:25:22.660393 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 66995.1us
I20260709 12:25:22.665199 25757 raft_consensus.cc:1240] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 10. Current term is 11. Ops: []
W20260709 12:25:22.626525 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 75854us
I20260709 12:25:22.671386 25836 raft_consensus.cc:1275] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:25:22.673396 30669 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:22.635689 30971 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:22.679860 25762 raft_consensus.cc:2468] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 13.
I20260709 12:25:22.680341 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:22.706995 25834 raft_consensus.cc:2410] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:25:22.694244 25754 raft_consensus.cc:3055] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:22.708027 26401 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:22.696013 25800 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:22.685986 25835 raft_consensus.cc:1275] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:25:22.694659 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:22.715382 25828 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 13.
I20260709 12:25:22.692909 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:22.716406 31094 raft_consensus.cc:2804] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:22.718750 31094 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:22.719301 31094 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:22.720285 31096 consensus_queue.cc:1059] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:25:22.721748 31096 raft_consensus.cc:3055] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:22.722240 31096 raft_consensus.cc:740] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:22.723455 31096 consensus_queue.cc:260] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:22.725466 31096 raft_consensus.cc:3060] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:22.732827 30378 consensus_queue.cc:1048] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:25:22.735831 25800 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:22.739792 30378 consensus_queue.cc:1059] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:22.740991 29802 raft_consensus.cc:3055] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:22.741472 29802 raft_consensus.cc:740] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:22.742411 29802 consensus_queue.cc:260] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:22.743662 29802 raft_consensus.cc:3060] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:22.747078 25800 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:22.707701 25754 raft_consensus.cc:740] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:22.749629 25756 raft_consensus.cc:1240] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:22.745088 31076 raft_consensus.cc:2804] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:22.750584 31076 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
W20260709 12:25:22.750617 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 161991us
I20260709 12:25:22.751101 31076 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:22.751176 25831 raft_consensus.cc:1275] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:25:22.751557 25649 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
W20260709 12:25:22.752074 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 114686us
I20260709 12:25:22.752950 31074 raft_consensus.cc:2243] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:22.753150 30794 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:22.753798 30794 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:22.758734 25801 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
W20260709 12:25:22.760120 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 65357.2us
I20260709 12:25:22.760957 26402 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:22.762058 26401 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:22.762863 30943 raft_consensus.cc:2804] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:22.763311 30943 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:22.763659 30943 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:22.704821 30908 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:22.765157 31094 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:22.766743 30908 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:22.768342 30908 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.768831 30971 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:22.769057 30670 raft_consensus.cc:2804] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:22.769521 30670 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:22.769858 30670 raft_consensus.cc:3060] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:22.768613 25830 raft_consensus.cc:2393] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 14: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:22.770524 31079 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:22.767144 31083 raft_consensus.cc:2804] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:22.700332 30669 raft_consensus.cc:3060] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:22.705049 30872 raft_consensus.cc:2749] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:25:22.775259 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:22.770033 26401 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:22.691862 30852 raft_consensus.cc:2749] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:22.774919 25801 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:22.775846 25754 consensus_queue.cc:260] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:22.777598 25800 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
W20260709 12:25:22.823812 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 53840.9us
W20260709 12:25:22.774596 30972 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.023s	sys 0.015s
I20260709 12:25:22.776546 26402 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:22.752951 25726 leader_election.cc:400] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 election: Vote denied by peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) with higher term. Message: Invalid argument: T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 10. Current term is 11.
I20260709 12:25:22.774279 31083 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:22.828917 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:22.831264 26433 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 13.
I20260709 12:25:22.828328 25726 leader_election.cc:403] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:25:22.826530 25754 raft_consensus.cc:3060] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:22.828848 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 52384us
I20260709 12:25:22.776497 30860 raft_consensus.cc:3060] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:22.832504 26402 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:25:22.833209 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 81756.8us
W20260709 12:25:22.834312 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 56788.6us
I20260709 12:25:22.834105 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:22.835387 25763 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 7.
I20260709 12:25:22.792774 30535 raft_consensus.cc:2749] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:25:22.827741 30972 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.029s	sys 0.029s
I20260709 12:25:22.828006 31074 raft_consensus.cc:2272] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:22.838364 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:22.849365 26436 raft_consensus.cc:2468] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 11.
I20260709 12:25:22.836519 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:22.850798 26438 raft_consensus.cc:2410] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:25:22.839030 26430 raft_consensus.cc:1275] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:25:22.841374 25800 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:22.827521 30921 raft_consensus.cc:2749] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:22.827419 31037 raft_consensus.cc:2804] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:22.833871 31083 raft_consensus.cc:3060] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:22.775597 30853 consensus_queue.cc:1048] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 12:25:22.768867 30908 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:22.792948 30885 consensus_queue.cc:1059] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 12:25:22.840816 31100 raft_consensus.cc:3060] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:22.875005 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 100132us
I20260709 12:25:22.838048 30971 raft_consensus.cc:2804] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:22.872447 31108 raft_consensus.cc:2804] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:22.862411 30872 raft_consensus.cc:2749] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) with higher term. Message: Invalid argument: T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 10. Current term is 11.
I20260709 12:25:22.896958 25801 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:22.901578 31083 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:22.905630 31083 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:22.882107 31037 raft_consensus.cc:697] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 13 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:22.906248 30921 consensus_queue.cc:1048] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:22.874500 31079 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349)
I20260709 12:25:22.906935 29802 consensus_queue.cc:1048] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:25:22.889523 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 136732us
W20260709 12:25:22.908277 31072 log.cc:927] Time spent T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:25:22.849469 31102 raft_consensus.cc:2804] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:22.918139 31102 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:22.918565 31102 raft_consensus.cc:3060] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:22.882321 30794 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:22.920548 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:22.931010 26436 raft_consensus.cc:1240] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:22.908864 30535 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:22.888373 30971 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:22.935724 31105 log.cc:927] Time spent T 00000000000000000000000000000000 P 496fd6924b624e77b03ccfd15653d47b: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 12:25:22.935815 30952 raft_consensus.cc:3060] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:22.936527 30935 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:22.909938 31108 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
W20260709 12:25:22.941115 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 106208us
I20260709 12:25:22.955760 25649 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:22.938447 30908 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:22.960863 25650 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:25:22.961076 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 119734us
I20260709 12:25:22.940958 30971 raft_consensus.cc:3060] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:22.975414 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:22.915735 31107 consensus_queue.cc:1048] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
W20260709 12:25:22.976258 25800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:22.976961 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:22.957649 31108 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:22.965670 31075 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:22.982229 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:22.980862 25649 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:22.940653 30884 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:22.983501 25756 raft_consensus.cc:1275] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:25:22.982314 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:22.984797 25758 raft_consensus.cc:3060] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:22.986835 25650 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:22.994987 31076 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:22.996589 30670 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:22.980090 31094 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:23.023830 25650 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
W20260709 12:25:22.980489 31089 log.cc:927] Time spent T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.409s	user 0.003s	sys 0.000s
I20260709 12:25:22.975464 31074 ts_tablet_manager.cc:1916] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:25:22.975031 31008 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:22.999408 31037 consensus_queue.cc:237] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:23.005281 30908 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.979287 30852 raft_consensus.cc:2749] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:23.007108 31110 raft_consensus.cc:3055] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:23.007869 30945 raft_consensus.cc:2804] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:23.013491 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:23.016992 25760 raft_consensus.cc:1275] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:25:23.007733 31075 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:23.018079 31111 raft_consensus.cc:2749] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:23.017063 30921 raft_consensus.cc:2804] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:23.019382 25649 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:23.027534 26434 raft_consensus.cc:1240] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 21 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 20. Current term is 21. Ops: []
I20260709 12:25:23.029752 29802 consensus_queue.cc:1048] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:25:22.968992 30794 consensus_queue.cc:1059] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:25:23.048226 29802 consensus_queue.cc:1059] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:23.057402 25758 raft_consensus.cc:2468] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 13.
W20260709 12:25:23.060513 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 228036us
I20260709 12:25:23.022256 30670 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:23.065954 26402 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:23.080459 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:23.088312 25761 raft_consensus.cc:3060] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:23.005321 30860 raft_consensus.cc:2749] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:23.096334 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
W20260709 12:25:23.097285 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:23.098131 25832 raft_consensus.cc:2410] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:25:23.033892 31081 raft_consensus.cc:2749] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:23.036000 30945 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:23.036412 31110 raft_consensus.cc:740] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:23.040612 30921 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:23.087725 30799 raft_consensus.cc:3055] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:23.120821 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:23.105485 30885 raft_consensus.cc:2804] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:23.040827 30908 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:23.106964 30945 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:23.123206 25832 raft_consensus.cc:2393] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 13: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:23.117816 30799 raft_consensus.cc:740] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:23.111619 30921 raft_consensus.cc:3060] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:23.108148 30899 raft_consensus.cc:2749] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:25:23.144773 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 247869us
I20260709 12:25:23.091439 30669 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:23.162772 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 143524us
I20260709 12:25:23.159300 25801 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:23.138339 30885 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:23.106017 31079 consensus_queue.cc:1048] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.040s
I20260709 12:25:23.142292 31100 raft_consensus.cc:2749] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:23.174152 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:23.175940 30885 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:23.177515 30943 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:23.180518 30799 consensus_queue.cc:260] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:23.190188 31076 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:23.282347 25754 raft_consensus.cc:1275] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:25:23.191476 31008 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:23.204674 26438 raft_consensus.cc:1240] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:23.213874 25761 raft_consensus.cc:2468] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 12.
W20260709 12:25:23.225121 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 61186.6us
I20260709 12:25:23.286234 25649 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
W20260709 12:25:23.286953 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 184857us
I20260709 12:25:23.287881 26401 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:23.290889 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:23.293761 26402 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:23.291824 25832 raft_consensus.cc:2468] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 13.
I20260709 12:25:23.278654 31013 raft_consensus.cc:2749] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:25:23.303149 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 143803us
W20260709 12:25:23.287954 31067 log.cc:927] Time spent T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 12:25:23.306169 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:23.308943 25832 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 19.
I20260709 12:25:23.311455 25801 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:23.165339 31110 consensus_queue.cc:260] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:23.312558 30799 raft_consensus.cc:3060] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:23.325109 25800 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:23.312799 31128 raft_consensus.cc:2749] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:25:23.313177 31070 log.cc:927] Time spent T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:25:23.318717 30943 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:23.321226 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:23.333595 25755 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:23.323299 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:23.334182 29802 consensus_queue.cc:1059] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:25:23.327564 25830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41782 (request call id 1097) took 1476 ms. Trace:
I20260709 12:25:23.299841 31107 raft_consensus.cc:2804] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:23.336519 31118 raft_consensus.cc:2804] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:23.329095 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:23.337914 25762 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:23.326553 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:23.335590 25830 rpcz_store.cc:276] 0709 12:25:21.834502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:21.970686 (+136184us) service_pool.cc:224] Handling call
0709 12:25:23.310186 (+1339500us) spinlock_profiling.cc:243] Waited 770 ms on lock 0x7b54003c5354. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:23.310368 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1770340224}
I20260709 12:25:23.332636 26402 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:23.342356 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:23.309022 30972 raft_consensus.cc:2804] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:23.346009 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:23.337211 30798 consensus_queue.cc:1048] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 12:25:23.352610 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:23.336966 31107 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:23.360069 30857 raft_consensus.cc:2804] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:23.401492 30857 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:23.401919 30857 raft_consensus.cc:3060] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:23.362373 30952 raft_consensus.cc:2749] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:23.362516 30908 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:23.364035 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:23.407263 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:23.408061 25828 raft_consensus.cc:2393] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 8: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:23.409070 25828 raft_consensus.cc:1240] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:23.410365 25828 raft_consensus.cc:1240] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 17. Current term is 18. Ops: [17.9-17.9]
I20260709 12:25:23.365219 31108 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:23.342015 30853 raft_consensus.cc:2749] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:25:23.367245 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:23.414700 25831 raft_consensus.cc:2410] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for term 15 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 12:25:23.415709 25831 raft_consensus.cc:1240] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:23.416967 25831 raft_consensus.cc:1240] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:25:23.369705 30884 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 21 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:23.374279 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:23.419488 25836 raft_consensus.cc:1240] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:23.420720 25836 raft_consensus.cc:1240] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:23.357672 25801 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:23.374819 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:23.342042 31118 raft_consensus.cc:697] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 13 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:23.383149 25755 raft_consensus.cc:2468] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 14.
I20260709 12:25:23.383642 30669 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:25:23.384656 31123 log.cc:927] Time spent T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:25:23.385993 30930 raft_consensus.cc:3055] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:23.393013 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:23.444553 25757 raft_consensus.cc:3060] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:23.393102 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 53874.4us
I20260709 12:25:23.397194 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:23.400604 31102 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:23.413780 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:23.427255 25836 raft_consensus.cc:1275] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:25:23.446796 25834 raft_consensus.cc:2410] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for term 11 because replica has last-logged OpId of term: 10 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 4.
I20260709 12:25:23.427837 25831 raft_consensus.cc:1240] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 15 LEADER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 12:25:23.411585 25828 raft_consensus.cc:1240] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:25:23.430544 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:23.448189 26401 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:23.450528 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:23.451455 26430 raft_consensus.cc:2468] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 12.
I20260709 12:25:23.430958 25837 raft_consensus.cc:2393] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 17: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:23.457970 25762 raft_consensus.cc:2468] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 17.
W20260709 12:25:23.463199 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:23.328735 31076 consensus_queue.cc:1048] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.101s
I20260709 12:25:23.424203 31107 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:23.471263 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:25:23.471473 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 114767us
I20260709 12:25:23.428920 30535 raft_consensus.cc:2749] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:23.413803 31108 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:23.429695 30972 raft_consensus.cc:697] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 12 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:23.446779 30930 raft_consensus.cc:740] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:23.479506 25836 raft_consensus.cc:1240] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 13. Current term is 14. Ops: []
W20260709 12:25:23.481688 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 164188us
I20260709 12:25:23.482249 30378 consensus_queue.cc:1048] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:23.484822 29802 consensus_queue.cc:1059] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:23.488047 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:23.462479 30853 raft_consensus.cc:2749] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:23.475852 30908 raft_consensus.cc:2804] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:23.491564 25755 raft_consensus.cc:3055] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:25:23.493083 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:23.493474 25755 raft_consensus.cc:740] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
W20260709 12:25:23.492079 25726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:23.440099 30799 consensus_queue.cc:1048] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 12:25:23.496600 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:23.489524 30378 consensus_queue.cc:1243] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer 6e673265293d4e9a937dc45150aeb1b8 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:25:23.494221 25755 consensus_queue.cc:260] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:23.520628 25755 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:23.485245 30899 consensus_queue.cc:1048] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 12:25:23.459965 30945 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:23.501652 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:23.502590 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:23.474036 30971 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:23.495455 30852 raft_consensus.cc:3055] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:23.505285 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:23.493497 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:23.538595 25754 raft_consensus.cc:2393] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 14: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:23.509550 31109 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.510231 30798 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.510842 31111 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:23.511565 30930 consensus_queue.cc:260] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:23.513129 30921 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:23.500118 30908 raft_consensus.cc:697] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 14 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:23.513655 30885 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:23.494475 25801 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:23.534334 25755 raft_consensus.cc:1275] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:25:23.535574 25761 raft_consensus.cc:2376] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 12. Re-sending same reply.
I20260709 12:25:23.521468 25762 raft_consensus.cc:3055] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:23.554790 25762 raft_consensus.cc:740] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:23.490700 31112 consensus_queue.cc:1048] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:25:23.542137 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:23.548065 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:23.559341 26430 raft_consensus.cc:2410] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:25:23.538156 30852 raft_consensus.cc:740] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:23.565423 30908 consensus_queue.cc:237] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:23.580096 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:25:23.593546 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 99132.5us
I20260709 12:25:23.578752 30930 raft_consensus.cc:3060] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:23.600200 26435 raft_consensus.cc:1240] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:23.600421 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:23.600615 26433 raft_consensus.cc:1240] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:23.600970 26437 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:23.601406 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:23.601547 26402 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:23.602017 26435 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 8.
I20260709 12:25:23.603098 26435 raft_consensus.cc:1240] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:23.603271 26402 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:23.545584 30798 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:23.613039 26432 raft_consensus.cc:1240] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:23.570822 31076 raft_consensus.cc:2749] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:23.617170 30885 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:23.553210 31111 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:23.580596 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 73829.9us
I20260709 12:25:23.588423 26430 raft_consensus.cc:1240] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 14. Current term is 15. Ops: [12.10-14.11]
I20260709 12:25:23.590135 30921 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:23.591188 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:23.605809 26402 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:23.604092 30669 raft_consensus.cc:2749] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:23.555173 30972 consensus_queue.cc:237] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:23.609438 25800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:23.609583 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:23.632673 26439 raft_consensus.cc:3060] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:23.610334 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:23.544214 31109 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:23.615641 26435 raft_consensus.cc:1240] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:23.612545 31110 raft_consensus.cc:3060] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:23.517930 31118 consensus_queue.cc:237] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:23.626891 25801 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:23.593456 25726 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:23.642899 25763 raft_consensus.cc:1240] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:25:23.629591 25829 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 14.
I20260709 12:25:23.630239 30860 raft_consensus.cc:2804] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:25:23.653535 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 60126.6us
I20260709 12:25:23.604686 31102 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:23.655187 25800 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:23.664273 31111 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:23.659674 30794 raft_consensus.cc:2804] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:23.665307 30794 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:23.658512 30535 raft_consensus.cc:2749] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:23.668790 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:23.669613 25835 raft_consensus.cc:2410] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 15 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 12:25:23.670665 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:23.672029 30861 raft_consensus.cc:2749] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:23.672518 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:23.673329 25830 raft_consensus.cc:2393] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 14: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:23.665740 30794 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:25:23.678280 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 51464.9us
I20260709 12:25:23.680119 25801 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:23.681957 31013 raft_consensus.cc:2749] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:23.682862 31013 consensus_queue.cc:1048] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:23.687793 31109 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:23.697650 26439 raft_consensus.cc:2468] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 15.
I20260709 12:25:23.699007 25757 raft_consensus.cc:2468] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 14.
I20260709 12:25:23.705087 26431 raft_consensus.cc:2468] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 14.
I20260709 12:25:23.703410 26401 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:23.703660 26437 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 14.
I20260709 12:25:23.721938 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:25:23.702726 31139 log.cc:927] Time spent T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:25:23.692353 30952 raft_consensus.cc:2804] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:23.719440 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:23.731061 25836 raft_consensus.cc:2393] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 12: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:23.726100 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:23.660969 30860 raft_consensus.cc:697] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 17 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:23.704896 31106 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.704912 31141 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.731741 25831 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 8.
I20260709 12:25:23.704694 31111 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.702358 31117 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.702257 31140 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.729214 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
W20260709 12:25:23.735783 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 58183us
I20260709 12:25:23.620805 30852 consensus_queue.cc:260] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:23.738042 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:23.716593 31142 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.723907 30884 raft_consensus.cc:2804] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:25:23.740118 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:23.719872 31102 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.743286 25834 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:23.749802 25801 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:23.744645 25831 raft_consensus.cc:3060] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:23.716287 30857 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:23.757311 25832 raft_consensus.cc:1275] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:25:23.725804 31008 consensus_queue.cc:1048] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:25:23.736882 30952 raft_consensus.cc:697] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 17 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
W20260709 12:25:23.814990 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 65332.2us
I20260709 12:25:23.816078 25801 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:23.827906 25834 raft_consensus.cc:2468] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 14.
I20260709 12:25:23.841455 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:23.842100 25834 raft_consensus.cc:2468] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 14.
I20260709 12:25:23.828397 25801 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:23.845333 25801 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:23.744851 31117 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:23.850379 31117 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:23.854360 31153 consensus_queue.cc:1059] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:23.744284 30971 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:23.870354 26402 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:23.892724 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:23.859272 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:23.920463 25836 raft_consensus.cc:2393] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 12: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
W20260709 12:25:23.856416 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 196592us
I20260709 12:25:23.752319 31094 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.918473 25832 raft_consensus.cc:1275] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:25:23.923030 26433 raft_consensus.cc:1240] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:23.918578 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:23.927986 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:23.860255 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:23.929265 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:23.929765 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:23.813284 30884 raft_consensus.cc:697] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 14 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:23.932832 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:23.947177 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:23.738389 31106 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:23.929883 25836 raft_consensus.cc:2468] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 12.
W20260709 12:25:23.871567 25800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:23.956949 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 213375us
I20260709 12:25:23.934128 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:23.856478 31083 raft_consensus.cc:2749] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:23.933640 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:23.961551 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:23.941869 25754 raft_consensus.cc:1240] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:23.943413 25755 raft_consensus.cc:1240] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:25:23.947872 25832 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Advancing to term 11
W20260709 12:25:23.931876 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 61576.2us
I20260709 12:25:23.949877 26439 raft_consensus.cc:1240] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:23.864032 30852 raft_consensus.cc:3060] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:23.968812 26402 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:23.959499 31083 consensus_queue.cc:1059] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 12:25:23.955307 25760 raft_consensus.cc:1217] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Deduplicated request from leader. Original: 9.6->[11.7-16.9]   Dedup: 11.7->[14.8-16.9]
I20260709 12:25:23.971292 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:23.972486 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:23.971295 25760 raft_consensus.cc:1240] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 16. Current term is 17. Ops: [11.7-16.9]
I20260709 12:25:23.973734 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:23.973551 26402 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:23.978588 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:23.981029 25682 raft_consensus.cc:2393] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 11: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:23.983129 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:23.983355 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:23.984254 25684 raft_consensus.cc:2393] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 13: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:23.984730 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:23.985819 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:23.987036 26439 raft_consensus.cc:2468] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 13.
I20260709 12:25:23.988425 25683 raft_consensus.cc:2393] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 14: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:23.992600 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:23.993592 25757 raft_consensus.cc:2393] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 12: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:23.992370 26402 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:23.994189 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:23.856492 30935 raft_consensus.cc:2749] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:24.000273 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:24.002517 25683 raft_consensus.cc:1240] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:23.939116 31108 raft_consensus.cc:2749] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:23.743120 31111 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:23.757433 31142 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:23.972879 30971 raft_consensus.cc:2749] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:23.921813 31094 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:23.742415 31141 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:23.991250 30908 raft_consensus.cc:2749] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:23.808615 31102 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:24.003865 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:24.006429 25831 raft_consensus.cc:2468] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 13.
I20260709 12:25:24.010504 25686 raft_consensus.cc:3060] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:24.011878 25683 raft_consensus.cc:1240] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 18 LEADER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 17. Current term is 18. Ops: []
I20260709 12:25:24.015049 25832 raft_consensus.cc:2468] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 11.
I20260709 12:25:24.004556 25836 raft_consensus.cc:1275] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:25:23.758189 31140 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:24.025704 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:24.086229 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:24.086658 31140 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:24.009234 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:24.060879 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:24.010039 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:24.088828 25682 raft_consensus.cc:2393] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 8: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:24.067272 25685 raft_consensus.cc:2393] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 12: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:24.089504 31159 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.032923 31100 raft_consensus.cc:2749] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:25:24.013325 26402 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:25:24.096755 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 83500.1us
I20260709 12:25:24.068176 31109 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.070235 31141 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:24.004753 31130 raft_consensus.cc:2804] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:24.072055 30952 consensus_queue.cc:237] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:24.072667 31111 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:24.004845 31128 consensus_queue.cc:1048] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.069s
I20260709 12:25:23.985657 31107 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:24.075639 31106 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:24.025940 31117 raft_consensus.cc:2804] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:24.060942 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:24.017294 30945 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:24.088091 25755 raft_consensus.cc:2393] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 14: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:24.032423 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:24.106930 31156 consensus_queue.cc:1059] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:25:24.112479 31094 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:24.098717 31159 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:24.116184 31161 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.116688 30884 consensus_queue.cc:237] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:24.118644 30857 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:24.119475 31074 ts_tablet_manager.cc:1929] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 6.7
I20260709 12:25:24.126458 25762 consensus_queue.cc:260] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:24.139676 25686 raft_consensus.cc:2468] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 13.
I20260709 12:25:23.977203 30860 consensus_queue.cc:237] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:24.145293 25837 raft_consensus.cc:2468] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 13.
I20260709 12:25:24.099619 30971 raft_consensus.cc:3055] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:24.099555 31130 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:24.153400 25649 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:24.103191 30669 raft_consensus.cc:2804] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:24.158295 31117 raft_consensus.cc:697] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 14 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:24.199360 29802 consensus_queue.cc:1048] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:25:24.185830 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 227735us
I20260709 12:25:24.190235 25762 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:24.105129 31109 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:24.191767 30971 raft_consensus.cc:740] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:24.195218 31130 raft_consensus.cc:3060] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:24.194821 31074 log.cc:1199] T 237622cb71464b3ca091560bd9d8c06b P f82778701b464892aab92a752ed7ffdc: Deleting WAL directory at /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-0-root/wals/237622cb71464b3ca091560bd9d8c06b
I20260709 12:25:24.197302 30669 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:24.178911 31161 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:24.213740 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:24.204910 31156 raft_consensus.cc:3055] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 12:25:24.208690 30794 consensus_meta.cc:287] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.535s	user 0.012s	sys 0.000s
I20260709 12:25:24.193324 31153 consensus_queue.cc:1059] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 12:25:24.221252 26439 raft_consensus.cc:1240] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 14. Current term is 15. Ops: [14.13-14.13]
W20260709 12:25:24.234251 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:24.213524 30669 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:24.235877 30798 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:24.222772 31156 raft_consensus.cc:740] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
W20260709 12:25:24.293119 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 89551.6us
W20260709 12:25:24.306979 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 349177us
W20260709 12:25:24.346334 31134 log.cc:927] Time spent T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.793s	user 0.005s	sys 0.005s
I20260709 12:25:24.222860 25726 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:24.224189 31167 consensus_queue.cc:1059] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 12:25:24.300484 31117 consensus_queue.cc:237] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:24.232282 30971 consensus_queue.cc:260] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:24.389050 30971 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:24.338102 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:24.392361 31167 raft_consensus.cc:3055] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:24.392395 26431 raft_consensus.cc:2393] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 14: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
W20260709 12:25:24.387238 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:24.393314 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 170512us
I20260709 12:25:24.395331 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:24.395820 25726 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:24.396042 25754 raft_consensus.cc:2468] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 11.
I20260709 12:25:24.397517 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:24.398473 25755 raft_consensus.cc:2393] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 13: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:24.399148 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:24.277923 25762 raft_consensus.cc:1275] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 12:25:24.209786 30857 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.204489 30945 raft_consensus.cc:2749] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:25:24.403082 25800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:24.349611 26435 raft_consensus.cc:2468] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 13.
I20260709 12:25:24.353404 31109 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:24.374023 31162 log.cc:927] Time spent T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.153s	user 0.002s	sys 0.002s
W20260709 12:25:24.345114 31163 log.cc:927] Time spent T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.157s	user 0.002s	sys 0.002s
I20260709 12:25:24.354135 31168 consensus_queue.cc:1059] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:24.354188 31164 consensus_queue.cc:1059] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:25:24.372110 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:25:24.355094 30930 consensus_meta.cc:287] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.759s	user 0.003s	sys 0.011s
I20260709 12:25:24.377404 31170 raft_consensus.cc:3055] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:24.377480 26402 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:25:24.430742 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 53333.1us
I20260709 12:25:24.362253 30794 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:24.382982 26436 raft_consensus.cc:1240] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 14 LEADER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:24.383141 31040 consensus_queue.cc:1059] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:24.383553 30885 consensus_queue.cc:1048] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:24.384040 31172 consensus_queue.cc:1059] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:24.401170 25762 pending_rounds.cc:85] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 7
I20260709 12:25:24.392922 31167 raft_consensus.cc:740] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:24.387182 30669 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:24.404464 25649 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:24.361956 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:24.415411 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:24.437196 25762 pending_rounds.cc:107] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 12:25:24.438220 25762 raft_consensus.cc:2889] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:25:24.423026 25801 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.003s	sys 0.034s
I20260709 12:25:24.374774 31074 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40214 (request call id 99) took 2587 ms. Trace:
I20260709 12:25:24.387316 31130 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:24.393823 31142 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:24.378517 31102 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:24.377434 31156 consensus_queue.cc:260] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:24.434573 26402 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:25:24.438699 25801 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.003s	sys 0.034s
I20260709 12:25:24.430275 31094 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:24.461207 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 56869.6us
I20260709 12:25:24.431581 31175 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.468559 31175 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:24.469058 30669 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:24.470749 31175 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:24.467381 31156 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:25:24.476923 30852 consensus_meta.cc:287] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.508s	user 0.016s	sys 0.001s
I20260709 12:25:24.477499 31130 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:24.442773 31074 rpcz_store.cc:276] 0709 12:25:21.802827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:21.840614 (+ 37787us) service_pool.cc:224] Handling call
0709 12:25:22.366336 (+525722us) ts_tablet_manager.cc:1151] Deleting tablet 237622cb71464b3ca091560bd9d8c06b
0709 12:25:22.380031 (+ 13695us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:25:23.511052 (+1131021us) tablet_metadata.cc:665] Metadata flushed
0709 12:25:24.119285 (+608233us) tablet_metadata.cc:665] Metadata flushed
0709 12:25:24.364160 (+244875us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":206218,"tablet-delete.queue_time_us":447881,"thread_start_us":296294,"threads_started":1}
I20260709 12:25:24.481221 31040 consensus_queue.cc:1048] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:24.481977 31165 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.482554 31165 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:24.485498 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:24.455502 26439 raft_consensus.cc:2468] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 12.
I20260709 12:25:24.463371 26402 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:25:24.463411 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 618104us
I20260709 12:25:24.410609 30857 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:24.465880 25758 raft_consensus.cc:1240] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:25:24.466981 31109 raft_consensus.cc:2804] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:24.492379 31159 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:24.492902 31109 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:24.493345 31109 raft_consensus.cc:3060] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:24.467536 31094 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:24.467346 31167 consensus_queue.cc:260] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:24.504894 25757 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 15.
I20260709 12:25:24.430317 31170 raft_consensus.cc:740] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:24.492300 31156 raft_consensus.cc:2804] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:24.503125 25679 raft_consensus.cc:2468] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 14.
I20260709 12:25:24.460790 31172 consensus_queue.cc:1243] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer 6e673265293d4e9a937dc45150aeb1b8 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 12:25:24.505975 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 110208us
I20260709 12:25:24.505236 25801 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:24.511484 26433 raft_consensus.cc:1275] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:25:24.506491 25649 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:24.491122 30972 raft_consensus.cc:2804] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:24.467422 30903 raft_consensus.cc:2804] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:24.512491 25801 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:24.510914 31156 raft_consensus.cc:697] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
W20260709 12:25:24.518651 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:24.504439 31102 raft_consensus.cc:2804] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:24.504628 31165 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:24.526144 25801 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
W20260709 12:25:24.510952 31099 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 12:25:24.529582 25801 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:24.509596 31180 raft_consensus.cc:2804] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:24.516294 31076 raft_consensus.cc:2749] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:24.522203 31172 raft_consensus.cc:2804] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:24.541388 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:24.543777 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:24.544456 25685 raft_consensus.cc:2468] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 12.
I20260709 12:25:24.532526 30903 raft_consensus.cc:697] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 11 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:24.545478 31165 raft_consensus.cc:2804] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:24.530746 31179 raft_consensus.cc:2804] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:24.546293 30903 consensus_queue.cc:237] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:24.548295 31156 consensus_queue.cc:237] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:24.549103 30857 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:24.550148 30794 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:24.554615 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:24.530498 31175 raft_consensus.cc:2749] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:25:24.558477 25801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:24.568910 25801 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:24.536772 31167 raft_consensus.cc:3060] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:24.570503 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:24.570945 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:24.572767 25682 raft_consensus.cc:2468] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 11.
I20260709 12:25:24.540339 31161 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:24.542968 31102 raft_consensus.cc:697] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 13 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:24.581532 31165 raft_consensus.cc:697] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 12 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
W20260709 12:25:24.583449 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 70085.3us
I20260709 12:25:24.581120 31179 raft_consensus.cc:697] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 13 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:24.567528 31180 raft_consensus.cc:697] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:24.585723 25726 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:24.559080 31172 raft_consensus.cc:697] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 15 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:24.588814 25801 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
W20260709 12:25:24.593730 31178 log.cc:927] Time spent T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
W20260709 12:25:24.586812 31184 log.cc:927] Time spent T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:25:24.593765 31172 consensus_queue.cc:237] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:24.595448 25829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44218 (request call id 1927) took 1391 ms. Trace:
I20260709 12:25:24.595886 25829 rpcz_store.cc:276] 0709 12:25:23.204375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:23.396820 (+192445us) service_pool.cc:224] Handling call
0709 12:25:24.595275 (+1198455us) spinlock_profiling.cc:243] Waited 47.6 ms on lock 0x7b5400105254. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:24.595392 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":109447040}
I20260709 12:25:24.600876 31102 consensus_queue.cc:237] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:24.604689 25801 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:24.540041 31170 consensus_queue.cc:260] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:24.623520 31076 raft_consensus.cc:2749] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:24.640491 31094 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:24.676731 31160 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:24.630900 31165 consensus_queue.cc:237] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:24.677321 31160 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:24.679392 31160 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:24.680286 31193 raft_consensus.cc:2749] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:24.681025 31193 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.646596 31170 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:24.646065 31161 raft_consensus.cc:2804] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:25:24.694398 31161 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:24.694882 31161 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:24.689021 31180 consensus_queue.cc:237] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:24.700086 31195 consensus_queue.cc:1059] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:25:24.701366 31195 consensus_queue.cc:1048] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:24.702876 31195 raft_consensus.cc:3055] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:24.703274 31195 raft_consensus.cc:740] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
W20260709 12:25:24.693933 31186 log.cc:927] Time spent T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:25:24.705396 31195 consensus_queue.cc:260] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:24.707222 31195 raft_consensus.cc:3060] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:24.689467 31094 raft_consensus.cc:2749] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:25:24.681450 31193 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:24.709895 31156 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:24.710654 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:24.710472 31193 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:24.711321 25760 raft_consensus.cc:2468] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 12.
I20260709 12:25:24.712345 25828 raft_consensus.cc:1240] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 17 LEADER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:24.710429 31156 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:24.725117 31182 log.cc:927] Time spent T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 12:25:24.726200 31156 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:24.726894 31156 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:24.729133 30945 raft_consensus.cc:3055] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:24.729584 30945 raft_consensus.cc:740] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:24.730214 30930 raft_consensus.cc:3055] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:24.730751 30930 raft_consensus.cc:740] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:24.730456 30945 consensus_queue.cc:260] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:24.731742 30930 consensus_queue.cc:260] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:24.733191 30930 raft_consensus.cc:3060] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:24.739389 31107 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:24.740063 30945 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:25:24.742018 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 49296.2us
W20260709 12:25:24.745227 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 140604us
I20260709 12:25:24.748792 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:25:24.750578 25726 connection.cc:256] RPC call timeout handler was delayed by -1.212027494999802s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2006s for a response
W20260709 12:25:24.751012 25726 connection.cc:256] RPC call timeout handler was delayed by -1.1949274949997744s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2025s for a response
W20260709 12:25:24.751389 25726 connection.cc:256] RPC call timeout handler was delayed by -1.19222749499977s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2028s for a response
W20260709 12:25:24.751763 25726 connection.cc:256] RPC call timeout handler was delayed by -1.1886274950002189s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20320000000000002s for a response
W20260709 12:25:24.752099 25726 connection.cc:256] RPC call timeout handler was delayed by -1.1805274950002058s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2041s for a response
W20260709 12:25:24.752466 25726 connection.cc:256] RPC call timeout handler was delayed by -1.1031274950000807s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2127s for a response
I20260709 12:25:24.727486 31156 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:24.779949 25801 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:24.715970 31109 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:24.782112 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:24.787355 25684 raft_consensus.cc:1217] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 14 LEADER]: Deduplicated request from leader. Original: 12.7->[13.8-13.8]   Dedup: 13.8->[]
I20260709 12:25:24.782965 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:24.787864 25684 raft_consensus.cc:1240] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 14 LEADER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
W20260709 12:25:24.783804 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:24.675654 31179 consensus_queue.cc:237] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:24.786856 30971 raft_consensus.cc:2749] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:24.832839 25755 raft_consensus.cc:1275] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:25:24.746889 31164 consensus_queue.cc:1059] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 12:25:24.815771 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:24.840305 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:24.816077 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:24.830411 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:24.843326 25685 raft_consensus.cc:2468] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 11.
I20260709 12:25:24.831710 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:24.833568 25760 raft_consensus.cc:1275] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:25:24.833719 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:24.834841 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:24.815656 25683 raft_consensus.cc:2368] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 12. Current term is 13.
I20260709 12:25:24.843431 25828 raft_consensus.cc:2468] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 15.
W20260709 12:25:24.845968 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 66148.8us
I20260709 12:25:24.480227 25569 catalog_manager.cc:5028] TS f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): tablet 237622cb71464b3ca091560bd9d8c06b (table test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]) successfully deleted
I20260709 12:25:24.844915 25837 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 15.
I20260709 12:25:24.846423 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:24.866546 25830 raft_consensus.cc:2393] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 13: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:24.867520 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:24.864981 25757 raft_consensus.cc:1275] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:25:24.868630 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:24.869772 25760 raft_consensus.cc:2410] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:25:24.869948 25801 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:24.871668 25834 raft_consensus.cc:1240] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
W20260709 12:25:24.871810 25569 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 391573us
I20260709 12:25:24.873322 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:24.875598 25759 raft_consensus.cc:1275] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 12:25:24.876133 25759 pending_rounds.cc:85] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 10
I20260709 12:25:24.876442 25759 pending_rounds.cc:107] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 12:25:24.876729 25759 raft_consensus.cc:2889] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:24.865970 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:24.819897 31100 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:24.892376 25800 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:24.893087 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:24.832569 30935 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:24.898108 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:24.899369 25763 raft_consensus.cc:3060] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:25:24.900475 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:24.900723 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:24.901682 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:25:24.890200 31118 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.204s	user 0.024s	sys 0.045s
I20260709 12:25:24.901512 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:24.909842 25677 raft_consensus.cc:2410] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:25:24.908371 25685 raft_consensus.cc:2468] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 11.
I20260709 12:25:24.875039 30884 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.913966 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:24.878070 31107 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
W20260709 12:25:24.913295 31118 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.223s	user 0.024s	sys 0.045s
I20260709 12:25:24.895592 30885 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:24.929195 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:24.932209 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:24.920243 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:24.929579 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:24.932896 26436 raft_consensus.cc:2468] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 15.
I20260709 12:25:24.931537 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:24.933832 25837 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:24.935595 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:24.942159 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:24.943073 25834 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 12.
I20260709 12:25:24.904811 31201 raft_consensus.cc:2749] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:25:24.953562 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:24.954272 25830 raft_consensus.cc:3060] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:24.916299 30971 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:24.920397 31165 raft_consensus.cc:2804] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:24.931762 31150 raft_consensus.cc:3055] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:24.957923 25833 raft_consensus.cc:1275] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 12:25:24.962872 25833 pending_rounds.cc:85] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a: Aborting all ops after (but not including) 10
I20260709 12:25:24.907366 30935 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:24.963195 25833 pending_rounds.cc:107] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 12:25:24.918138 30861 consensus_queue.cc:1048] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:25:24.970424 25833 raft_consensus.cc:2889] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:25:24.971458 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 62795us
W20260709 12:25:24.965337 31203 log.cc:927] Time spent T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 12:25:24.905550 31100 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:24.973464 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:24.974133 25801 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:24.933818 31194 consensus_queue.cc:1048] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:25:24.921365 31107 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:24.982443 25801 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:24.929958 30857 consensus_queue.cc:1048] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
W20260709 12:25:24.971771 31199 log.cc:927] Time spent T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
W20260709 12:25:24.984176 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 68455.8us
I20260709 12:25:24.962082 31165 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:24.947041 30885 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:24.987519 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:24.919623 30884 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:24.968436 31150 raft_consensus.cc:740] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:24.991045 25801 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:25:24.991437 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:24.994781 25684 raft_consensus.cc:3060] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:24.984720 31201 raft_consensus.cc:2749] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:24.990684 31165 raft_consensus.cc:3060] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:24.969985 30971 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:24.992211 31200 raft_consensus.cc:2749] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:25:25.016309 31202 log.cc:927] Time spent T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:25:25.008023 25757 raft_consensus.cc:1275] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:25:25.019586 30885 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:25.011433 25761 raft_consensus.cc:1275] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 12:25:25.013273 31198 log.cc:927] Time spent T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 12:25:25.013495 31166 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:25.002702 31109 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:25.016076 31107 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:25.022955 30884 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:25.007309 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 254193us
W20260709 12:25:25.026819 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:24.996100 31156 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:24.995553 31204 raft_consensus.cc:2804] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:25.034162 31204 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.034633 31204 raft_consensus.cc:3060] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:25:25.034174 25726 connection.cc:256] RPC call timeout handler was delayed by -1.0590274950000094s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21760000000000002s for a response
W20260709 12:25:25.036433 25726 connection.cc:256] RPC call timeout handler was delayed by -1.0122274949999337s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22280000000000003s for a response
I20260709 12:25:25.036557 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:25.037212 25756 raft_consensus.cc:2468] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 12.
I20260709 12:25:25.049415 31161 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:25.036486 31207 log.cc:927] Time spent T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:25:25.058228 31194 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.061224 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:25.063021 25680 raft_consensus.cc:2468] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 13.
I20260709 12:25:25.037856 31166 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:25.064520 31100 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:25.097834 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:25.067976 31196 raft_consensus.cc:3055] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:25.069362 30971 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:25.075313 25830 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 9.
I20260709 12:25:25.077414 25837 raft_consensus.cc:2468] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 15.
I20260709 12:25:25.079602 25684 raft_consensus.cc:2468] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 10.
I20260709 12:25:25.080704 25677 raft_consensus.cc:2468] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 12.
I20260709 12:25:25.032552 30857 consensus_queue.cc:1048] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 12:25:25.051821 31161 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 20 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:25.112252 25763 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 9.
I20260709 12:25:25.114265 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:25.115059 25680 raft_consensus.cc:3060] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:25.107090 25650 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:25.120864 25650 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:25.127756 25650 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:25.132179 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:25.135996 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:25.101930 31196 raft_consensus.cc:740] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:25.079476 31013 consensus_queue.cc:1048] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.037s
W20260709 12:25:25.161901 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:25.138180 30799 raft_consensus.cc:2749] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:25.037192 31150 consensus_queue.cc:260] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:25.138471 31081 raft_consensus.cc:2749] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:25.141131 30921 raft_consensus.cc:2804] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:25.138723 31099 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:25.171631 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:25.173139 25677 raft_consensus.cc:2393] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 12: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:25.174158 31196 consensus_queue.cc:260] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:25.168897 30921 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.179461 30921 raft_consensus.cc:3060] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:25.182719 31117 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.183426 31117 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:25.195547 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:25.196708 26437 raft_consensus.cc:2393] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 14: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:25.126220 25726 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:25.102363 31107 consensus_queue.cc:1059] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.057s
I20260709 12:25:25.097618 31194 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:25.203830 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:25.207655 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:25.210700 26433 raft_consensus.cc:2468] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 14.
I20260709 12:25:25.211212 26436 raft_consensus.cc:2468] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 10.
W20260709 12:25:25.215951 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:25.199316 30884 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:25.224578 25837 raft_consensus.cc:2468] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 12.
I20260709 12:25:25.197729 31099 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:25.230834 25801 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:25.236020 25801 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:25.242631 30794 raft_consensus.cc:3055] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:25.243105 30794 raft_consensus.cc:740] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:25.247473 30971 raft_consensus.cc:2804] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:25.252647 30971 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:25.253185 30971 raft_consensus.cc:3060] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:25.248196 31100 raft_consensus.cc:2804] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:25.256654 31100 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:25.257141 31100 raft_consensus.cc:3060] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:25.290277 31194 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:25.314180 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:25.315124 25677 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:25.229044 30884 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:25.323359 31013 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:25.337510 31013 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:25.344516 30972 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.345212 30972 raft_consensus.cc:3060] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:25.317704 31166 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:25.312388 31130 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:25.320881 31189 raft_consensus.cc:2749] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:25:25.331470 31216 log.cc:927] Time spent T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.064s	user 0.002s	sys 0.000s
I20260709 12:25:25.301007 30794 consensus_queue.cc:260] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:25.392009 25686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 2575) took 1448 ms. Trace:
I20260709 12:25:25.396634 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:25.397506 25684 raft_consensus.cc:3060] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:25.399593 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:25.392656 25686 rpcz_store.cc:276] 0709 12:25:23.927888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:23.929482 (+  1594us) service_pool.cc:224] Handling call
0709 12:25:25.376100 (+1446618us) spinlock_profiling.cc:243] Waited 80.1 ms on lock 0x7b54000b2cd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:25.376252 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":184149376}
I20260709 12:25:25.412488 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:25.417232 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:25.429196 25801 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:25.333290 26402 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:25:25.430707 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 101404us
I20260709 12:25:25.437047 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:25.437635 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:25.438421 26439 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:25.440264 26435 raft_consensus.cc:1240] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:25.441457 25684 raft_consensus.cc:2468] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 13.
I20260709 12:25:25.448303 31099 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:25.449023 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:25.450178 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:25.450670 25686 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:25.452248 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:25.452843 26438 raft_consensus.cc:2468] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 12.
I20260709 12:25:25.453600 30860 consensus_queue.cc:1048] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:25.448189 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:25.456890 25682 raft_consensus.cc:2393] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 10: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:25.457727 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:25.458300 25682 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 12.
I20260709 12:25:25.459128 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:25.461777 31150 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:25.465670 26439 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 16.
I20260709 12:25:24.510999 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:25.473402 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:25.488003 26436 raft_consensus.cc:2410] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:25:25.476744 31165 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:25.490265 31165 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:25.491240 25677 raft_consensus.cc:2468] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 11.
I20260709 12:25:25.477635 31013 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:25.459651 25682 raft_consensus.cc:2468] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 12.
I20260709 12:25:25.479321 31200 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:25.494133 31200 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:25.496163 31200 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:25.497521 25682 raft_consensus.cc:1275] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:25:25.499720 25682 raft_consensus.cc:1275] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 12:25:25.501911 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:25.502569 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:25.502979 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:25.505824 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:25.509466 31153 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.510236 31153 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:25.521981 30899 raft_consensus.cc:3055] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:25:25.522680 30899 raft_consensus.cc:740] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 20 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:25.480152 30952 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
W20260709 12:25:25.480818 31195 consensus_meta.cc:287] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.773s	user 0.010s	sys 0.001s
I20260709 12:25:25.358577 31130 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:25.482015 30884 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:25.483268 30921 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:25.484462 31117 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:25.485664 30971 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:25.477237 25686 raft_consensus.cc:2468] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 15.
I20260709 12:25:25.493156 25680 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 9.
I20260709 12:25:25.528734 30935 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:25.589686 30971 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:25.533833 31196 raft_consensus.cc:3060] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:25.523876 30899 consensus_queue.cc:260] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:25.493638 25679 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40230 (request call id 1842) took 1556 ms (client timeout 1941 ms). Trace:
W20260709 12:25:25.590665 25679 rpcz_store.cc:269] 0709 12:25:23.936787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:23.961175 (+ 24388us) service_pool.cc:224] Handling call
0709 12:25:25.493471 (+1532296us) spinlock_profiling.cc:243] Waited 469 ms on lock 0x7b54000b36d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:25.493567 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1079222016}
I20260709 12:25:25.592065 30899 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:25:25.534803 30952 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:25.597512 30952 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:25.536911 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 107947us
I20260709 12:25:25.537168 31175 raft_consensus.cc:2804] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:25:25.540675 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:25.622258 25762 raft_consensus.cc:1240] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 13. Current term is 14. Ops: [13.11-13.11]
W20260709 12:25:25.622865 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:25.558733 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:25.575304 25829 raft_consensus.cc:1240] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 16. Current term is 17. Ops: []
W20260709 12:25:25.625607 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 499438us
I20260709 12:25:25.649668 25726 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:25.651145 25681 raft_consensus.cc:1275] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:25:25.653529 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:25.659704 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:25.668789 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:25.671092 25754 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.191s	sys 0.333s
W20260709 12:25:25.671437 25754 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.191s	sys 0.333s
I20260709 12:25:25.677592 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:25.674221 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:25.680502 25837 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 12.
I20260709 12:25:25.680735 25763 raft_consensus.cc:3060] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:25:25.675539 25685 raft_consensus.cc:2468] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 14.
W20260709 12:25:25.699618 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:25.700861 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:25.701723 25830 raft_consensus.cc:2468] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 10.
I20260709 12:25:25.443435 30794 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:25.729738 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:25.585153 31153 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:25.722988 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 44662.7us
I20260709 12:25:25.549386 31130 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:25:25.707242 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 62901.5us
I20260709 12:25:25.587050 30921 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:25.642915 31117 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:25.739440 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:25.673679 31156 raft_consensus.cc:2749] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:25.670305 31175 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:25.697739 31189 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.643450 30884 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
W20260709 12:25:25.737442 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 87900.5us
I20260709 12:25:25.739508 25801 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:25.742332 25726 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:25.743062 31194 raft_consensus.cc:2804] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:25.743402 31153 raft_consensus.cc:2804] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:25.743498 31194 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.743939 31153 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:25.744071 31194 raft_consensus.cc:3060] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:25.744371 31153 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:25.746536 30971 consensus_queue.cc:1048] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:25.752683 25726 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:25.754189 31099 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:25.761128 25726 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:25.771714 25829 raft_consensus.cc:2393] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 13: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:25.736123 31081 consensus_queue.cc:1059] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 12:25:25.779675 31081 raft_consensus.cc:3055] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:25.780143 31081 raft_consensus.cc:740] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:25.781030 31081 consensus_queue.cc:260] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:25.782379 31081 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:25.784081 31189 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:25.771425 31117 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:25.771005 31175 raft_consensus.cc:3060] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:25.792246 30884 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:25.775790 25835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41782 (request call id 1121) took 1363 ms. Trace:
I20260709 12:25:25.800212 25835 rpcz_store.cc:276] 0709 12:25:24.412533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:24.413218 (+   685us) service_pool.cc:224] Handling call
0709 12:25:24.427349 (+ 14131us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:24.483857 (+ 56508us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:24.483886 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:24.484344 (+   458us) log.cc:844] Serialized 26 byte log entry
0709 12:25:24.537578 (+ 53234us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:25:24.570397 (+ 32819us) log.cc:844] Serialized 14 byte log entry
0709 12:25:24.845777 (+275380us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:25.775356 (+929579us) spinlock_profiling.cc:243] Waited 56.2 ms on lock 0x7b5400116554. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:25.775408 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:25.775457 (+    49us) raft_consensus.cc:1685] finished
0709 12:25:25.775570 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:25.775719 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":31290,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"raft.queue_time_us":102551,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":7828,"spinlock_wait_cycles":129159552,"thread_start_us":327900,"threads_started":2,"wal-append.queue_time_us":150539,"wal-append.run_cpu_time_us":2014,"wal-append.run_wall_time_us":1064739}
I20260709 12:25:25.804653 25678 raft_consensus.cc:1240] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:25.810250 25678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2583) took 1268 ms. Trace:
I20260709 12:25:25.843431 25678 rpcz_store.cc:276] 0709 12:25:24.541730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:24.541883 (+   153us) service_pool.cc:224] Handling call
0709 12:25:25.804278 (+1262395us) spinlock_profiling.cc:243] Waited 1.31 ms on lock 0x7b5800003698. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d96a3cb71 00007f5d96a3ceee 000000000036eb39 00007f5d9eab01e0 00007f5d9eb790c4 00007f5d9eb79131 00007f5d9eb3afc0 00007f5d9eb25929 00007f5d9eb253d2 00007f5d9809cbd4
0709 12:25:25.804462 (+   184us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:25.809959 (+  5497us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:25.810188 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3020800}
I20260709 12:25:25.854480 25760 raft_consensus.cc:2468] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 15.
W20260709 12:25:25.858217 31204 consensus_meta.cc:287] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.823s	user 0.011s	sys 0.002s
I20260709 12:25:25.858781 31204 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:25.860812 25761 raft_consensus.cc:1240] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 19. Current term is 20. Ops: []
I20260709 12:25:25.859635 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:25.885988 25762 raft_consensus.cc:2393] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 16: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:25.863945 31117 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:25.865201 25758 raft_consensus.cc:1275] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 14. (term mismatch)
I20260709 12:25:25.893080 25758 pending_rounds.cc:85] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 13
I20260709 12:25:25.893335 25758 pending_rounds.cc:107] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 16.14
I20260709 12:25:25.893569 25758 raft_consensus.cc:2889] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:25.866084 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:25.894479 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 133511us
I20260709 12:25:25.894690 25760 raft_consensus.cc:2468] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 12.
W20260709 12:25:25.869858 31100 consensus_meta.cc:287] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.612s	user 0.009s	sys 0.002s
I20260709 12:25:25.870764 30884 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:25.873229 25800 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:25.761256 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:25.915772 26439 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 16.
W20260709 12:25:25.876255 30972 consensus_meta.cc:287] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.517s	user 0.005s	sys 0.005s
W20260709 12:25:25.877373 26401 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.23.245.190:45099, user_credentials={real_user=slave}} blocked reactor thread for 49863.7us
I20260709 12:25:25.895212 25726 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:25.897948 25828 raft_consensus.cc:1275] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:25:25.900689 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:25.922629 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:25.924908 25762 raft_consensus.cc:2468] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 12.
I20260709 12:25:25.902463 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:25.910504 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:25.911401 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:25.912252 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:25.927600 25758 raft_consensus.cc:3060] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:25.913060 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:25.928493 25760 raft_consensus.cc:2468] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 13.
I20260709 12:25:25.919152 25835 raft_consensus.cc:1240] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:25.922019 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:25.718341 25763 raft_consensus.cc:2468] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 13.
I20260709 12:25:25.925647 25800 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:25:26.004247 26401 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:25.892133 30952 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:26.031690 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:26.033427 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:26.034399 25760 raft_consensus.cc:1275] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:25:26.023815 26438 raft_consensus.cc:1240] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 9. Current term is 10. Ops: []
W20260709 12:25:25.995983 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:26.037837 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:26.038326 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:25.977438 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 82282.9us
I20260709 12:25:25.767372 31099 raft_consensus.cc:2749] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:25:26.025730 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:26.026301 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:26.054404 26435 raft_consensus.cc:1240] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:26.041265 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:26.054522 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:26.059322 26434 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 12.
I20260709 12:25:26.062431 25762 raft_consensus.cc:2468] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 15.
I20260709 12:25:25.903317 30971 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:26.003533 31172 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
W20260709 12:25:26.070236 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:26.072431 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:26.018893 31150 raft_consensus.cc:2804] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:25.917785 31200 raft_consensus.cc:2749] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:26.086457 26431 raft_consensus.cc:2468] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 12.
I20260709 12:25:25.919574 31100 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:26.088375 25758 raft_consensus.cc:2468] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 13.
W20260709 12:25:26.041581 25682 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.018s	sys 0.018s
I20260709 12:25:26.041512 25726 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
W20260709 12:25:26.112356 25682 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.018s	sys 0.018s
I20260709 12:25:25.913650 31212 raft_consensus.cc:2749] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:25:26.105438 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:26.106817 26436 raft_consensus.cc:2468] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 10.
I20260709 12:25:25.914554 31196 raft_consensus.cc:2749] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:25.918031 30935 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
W20260709 12:25:26.108736 25581 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41240 (request call id 370) took 45850 ms (client timeout 15000 ms). Trace:
I20260709 12:25:26.043094 31130 raft_consensus.cc:2804] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:26.107585 31189 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:26.010955 31118 consensus_queue.cc:1048] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 12:25:26.011809 30535 consensus_queue.cc:1048] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.080s
I20260709 12:25:26.004974 30972 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:26.143729 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:26.168632 31118 consensus_queue.cc:1243] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer 6e673265293d4e9a937dc45150aeb1b8 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:25:26.174759 31118 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.110116 30971 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:26.141687 25581 rpcz_store.cc:269] 0709 12:24:40.251606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.280470 (+ 28864us) service_pool.cc:224] Handling call
0709 12:25:26.091001 (+45810531us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:22.576121 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:22.576905 (+   784us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:22.576977 (+    72us) write_op.cc:435] Acquired schema lock
0709 12:25:22.576998 (+    21us) tablet.cc:662] Decoding operations
0709 12:25:22.577801 (+   803us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:22.577889 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:22.577918 (+    29us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:25:22.578583 (+   665us) tablet.cc:701] Row locks acquired
0709 12:25:22.578735 (+   152us) write_op.cc:260] PREPARE: finished
0709 12:25:22.579175 (+   440us) write_op.cc:270] Start()
0709 12:25:22.579350 (+   175us) write_op.cc:276] Timestamp: P: 1783599922579093 usec, L: 0
0709 12:25:22.579393 (+    43us) op_driver.cc:348] REPLICATION: starting
0709 12:25:22.646447 (+ 67054us) log.cc:844] Serialized 2090 byte log entry
0709 12:25:23.189827 (+543380us) op_driver.cc:464] REPLICATION: finished
0709 12:25:23.347542 (+157715us) write_op.cc:301] APPLY: starting
0709 12:25:23.347669 (+   127us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:23.397111 (+ 49442us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:23.397232 (+   121us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:23.409350 (+ 12118us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:23.409747 (+   397us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 12:25:23.409817 (+    70us) write_op.cc:312] APPLY: finished
0709 12:25:23.410218 (+   401us) log.cc:844] Serialized 57 byte log entry
0709 12:25:23.416696 (+  6478us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:23.416840 (+   144us) write_op.cc:454] Released schema lock
0709 12:25:23.416920 (+    80us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:23.428557 (+ 11637us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:23.428604 (+    47us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1209184,"reported_tablets":45,"spinlock_wait_cycles":37248,"child_traces":[["op",{"apply.queue_time_us":157336,"apply.run_cpu_time_us":10872,"apply.run_wall_time_us":69883,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25027,"num_ops":5,"prepare.queue_time_us":479441,"prepare.run_cpu_time_us":62774,"prepare.run_wall_time_us":285215,"raft.queue_time_us":162402,"raft.run_cpu_time_us":25918,"raft.run_wall_time_us":139845,"replication_time_us":610224,"thread_start_us":675843,"threads_started":4,"wal-append.queue_time_us":201927,"wal-append.run_cpu_time_us":24062,"wal-append.run_wall_time_us":1563496}]]}
I20260709 12:25:26.056046 31173 consensus_queue.cc:1048] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.097s
I20260709 12:25:26.092835 31150 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:26.156199 26431 raft_consensus.cc:1240] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:26.172385 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:26.174957 25754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48606 (request call id 1356) took 1149 ms. Trace:
I20260709 12:25:26.154608 25829 raft_consensus.cc:1240] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:26.184625 30535 raft_consensus.cc:2804] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:26.041307 30952 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:26.056278 30884 consensus_queue.cc:1048] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.094s
I20260709 12:25:26.111008 31165 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
W20260709 12:25:26.188951 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:26.188503 26437 raft_consensus.cc:1240] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:26.054733 31117 consensus_queue.cc:1059] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 19.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.104s
I20260709 12:25:26.196441 25754 rpcz_store.cc:276] 0709 12:25:25.025388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:25.025507 (+   119us) service_pool.cc:224] Handling call
0709 12:25:25.025830 (+   323us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:25.026314 (+   484us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:25.026377 (+    63us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:25.027074 (+   697us) log.cc:844] Serialized 52 byte log entry
0709 12:25:25.671793 (+644719us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:25.671837 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:25.671900 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:26.174727 (+502827us) raft_consensus.cc:1685] finished
0709 12:25:26.174748 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:26.174881 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1031,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":8113,"thread_start_us":626769,"threads_started":1,"wal-append.queue_time_us":1140196}
I20260709 12:25:26.108457 31172 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:26.199781 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 158352us
I20260709 12:25:26.238304 25726 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:26.210107 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:26.137349 31099 raft_consensus.cc:2749] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:26.154062 31130 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:26.241551 31130 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:26.200070 31150 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:26.153663 31194 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:26.200889 30535 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:26.252543 31156 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:26.227077 31204 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:26.237960 31179 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.022s	sys 0.017s
I20260709 12:25:26.249408 30885 raft_consensus.cc:3055] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:25:26.200947 31118 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:26.256301 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:26.168097 30935 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:26.237468 30972 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:26.254709 25726 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:26.251469 31189 raft_consensus.cc:2749] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:26.258021 30535 raft_consensus.cc:3060] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:26.274717 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:26.288678 25726 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:25:26.250967 26402 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.009s	sys 0.008s
W20260709 12:25:26.270153 31179 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.022s	sys 0.017s
I20260709 12:25:26.295547 26431 raft_consensus.cc:2393] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 15: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
W20260709 12:25:26.295750 26402 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.009s	sys 0.008s
W20260709 12:25:26.296267 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 663297us
I20260709 12:25:26.249661 31165 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:26.300554 25833 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.008s	sys 0.011s
I20260709 12:25:26.301028 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:26.303292 26436 raft_consensus.cc:3060] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:26.254001 31196 consensus_queue.cc:1059] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.036s
W20260709 12:25:26.303227 25833 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.008s	sys 0.011s
I20260709 12:25:26.274318 30885 raft_consensus.cc:740] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:26.290589 31099 raft_consensus.cc:2749] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:26.318538 25726 leader_election.cc:400] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Vote denied by peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) with higher term. Message: Invalid argument: T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 12. Current term is 13.
I20260709 12:25:26.322360 25726 leader_election.cc:403] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:25:26.276928 25649 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.011s	sys 0.008s
W20260709 12:25:26.323071 25649 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.011s	sys 0.008s
W20260709 12:25:26.323441 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 585430us
I20260709 12:25:26.329398 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:26.334445 26431 raft_consensus.cc:2393] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 10: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:26.269304 31156 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:26.316308 31153 consensus_meta.cc:287] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.571s	user 0.019s	sys 0.002s
I20260709 12:25:26.348244 31153 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:26.357154 25763 raft_consensus.cc:1240] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:26.357546 31165 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:26.358309 31153 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:26.359084 30952 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:26.360903 31081 consensus_meta.cc:287] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.578s	user 0.015s	sys 0.005s
I20260709 12:25:26.364836 30935 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:26.368230 31099 raft_consensus.cc:2749] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) with higher term. Message: Invalid argument: T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 12. Current term is 13.
W20260709 12:25:26.369876 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 51556.3us
I20260709 12:25:26.371651 25726 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:26.344866 31172 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:26.379344 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 453739us
W20260709 12:25:26.377569 31166 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.014s	sys 0.017s
I20260709 12:25:26.330425 31117 consensus_queue.cc:1048] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.048s
W20260709 12:25:26.353307 31221 log.cc:927] Time spent T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
W20260709 12:25:26.352531 30794 consensus_meta.cc:287] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.619s	user 0.013s	sys 0.004s
I20260709 12:25:26.375334 26436 raft_consensus.cc:2468] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 13.
I20260709 12:25:26.387315 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:25:26.390054 25756 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.005s	sys 0.026s
W20260709 12:25:26.390448 25756 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.005s	sys 0.026s
I20260709 12:25:26.378316 31100 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:26.393353 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:26.396166 25755 raft_consensus.cc:1275] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 12:25:26.380098 31196 raft_consensus.cc:2749] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:26.396582 25755 pending_rounds.cc:85] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 11
I20260709 12:25:26.400285 25755 pending_rounds.cc:107] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 12:25:26.400734 25755 raft_consensus.cc:2889] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:26.396710 25837 raft_consensus.cc:2468] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 13.
I20260709 12:25:26.397087 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:25:26.383090 31166 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.014s	sys 0.017s
I20260709 12:25:26.367142 31150 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:26.403018 25832 raft_consensus.cc:1275] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:25:26.383438 30857 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.403322 25828 raft_consensus.cc:2393] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 15: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:26.416507 30857 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:26.417039 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:26.353637 30885 consensus_queue.cc:260] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 17, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:26.418357 30885 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:26.419150 30857 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:26.405228 25832 raft_consensus.cc:1275] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:25:26.420354 31194 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:26.405247 25836 raft_consensus.cc:1275] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:25:26.407603 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:26.408656 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:26.409387 26433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 1316) took 1104 ms. Trace:
I20260709 12:25:26.409894 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:26.424476 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:26.411602 25762 raft_consensus.cc:1217] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Deduplicated request from leader. Original: 9.6->[11.7-17.10]   Dedup: 11.7->[14.8-17.10]
I20260709 12:25:26.413025 31156 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:26.427528 25726 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:25:26.430666 25837 raft_consensus.cc:2468] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 12.
I20260709 12:25:26.425923 25762 pending_rounds.cc:85] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 7
I20260709 12:25:26.431306 25762 pending_rounds.cc:107] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 12:25:26.431641 25762 raft_consensus.cc:2889] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:26.421918 26433 rpcz_store.cc:276] 0709 12:25:25.305291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:25.305698 (+   407us) service_pool.cc:224] Handling call
0709 12:25:25.312284 (+  6586us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:25.312768 (+   484us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:25.312811 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:25.487100 (+174289us) spinlock_profiling.cc:243] Waited 4.96 ms on lock 0x7b2c000d5dd8. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9845aa11 00007f5d9846a372 00007f5d99b9ca01 00007f5d99b6143a 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2
0709 12:25:25.487668 (+   568us) log.cc:844] Serialized 52 byte log entry
0709 12:25:25.906362 (+418694us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:25.906416 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:25.906529 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:26.409029 (+502500us) raft_consensus.cc:1685] finished
0709 12:25:26.409050 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:26.409294 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5318,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":6237,"spinlock_wait_cycles":11409280,"thread_start_us":418309,"threads_started":1,"wal-append.queue_time_us":762082}
I20260709 12:25:26.413707 31150 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:26.413894 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:26.386669 31099 consensus_queue.cc:1059] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 12:25:26.436744 26402 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:26.437328 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:26.438163 25758 raft_consensus.cc:2468] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 14.
W20260709 12:25:26.434855 25759 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.017s	sys 0.017s
I20260709 12:25:26.401176 30971 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:26.406030 25835 raft_consensus.cc:1275] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:25:26.446211 30857 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.443666 30935 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.447292 25801 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:25:26.446749 30857 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:26.448583 25801 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:26.446841 30952 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.449455 30952 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:26.430666 31013 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.394176 31130 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:26.431430 31100 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
W20260709 12:25:26.444289 25759 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.017s	sys 0.017s
I20260709 12:25:26.435031 31195 raft_consensus.cc:2804] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:25:26.448736 31222 log.cc:927] Time spent T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
W20260709 12:25:26.481281 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:26.460269 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:26.441857 25800 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:26.483098 25801 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:25:26.483902 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 433042us
I20260709 12:25:26.485585 25758 raft_consensus.cc:2393] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 20: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:26.473268 31165 raft_consensus.cc:2749] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:26.492291 30857 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:26.492575 31165 raft_consensus.cc:2804] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:26.493101 31165 raft_consensus.cc:697] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 10 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:26.453290 30935 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:26.493956 31165 consensus_queue.cc:237] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:26.454041 31195 raft_consensus.cc:697] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 16 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:26.495348 30935 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:26.495489 31195 consensus_queue.cc:237] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:26.504135 31117 raft_consensus.cc:2804] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:26.504791 31117 raft_consensus.cc:697] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 9 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:26.505753 31117 consensus_queue.cc:237] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:26.482103 25726 connection.cc:256] RPC call timeout handler was delayed by -1.5398467559998608s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21389999999999998s for a response
I20260709 12:25:26.453938 31100 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:26.508738 31179 consensus_queue.cc:1059] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:26.509382 31150 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.509886 31179 raft_consensus.cc:3055] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:26.509927 31150 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:26.510419 31179 raft_consensus.cc:740] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:26.511431 31179 consensus_queue.cc:260] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:26.511958 25682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2588) took 1518 ms. Trace:
I20260709 12:25:26.512669 31179 raft_consensus.cc:3060] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:26.513513 31130 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:26.516489 31168 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.089s	user 0.170s	sys 0.288s
W20260709 12:25:26.516987 31168 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.089s	user 0.170s	sys 0.288s
W20260709 12:25:26.454643 31175 consensus_meta.cc:287] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.667s	user 0.012s	sys 0.002s
I20260709 12:25:26.517563 31175 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:26.523089 31192 consensus_queue.cc:1059] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:26.524633 31180 consensus_queue.cc:1059] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:26.525491 31189 raft_consensus.cc:3055] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:26.525980 31189 raft_consensus.cc:740] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:26.529838 25579 catalog_manager.cc:5697] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 7 to 10, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 10 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } }
I20260709 12:25:26.494422 31204 raft_consensus.cc:2804] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:26.532752 31204 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:26.533308 31204 raft_consensus.cc:3060] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:26.483250 25800 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:26.512501 25682 rpcz_store.cc:276] 0709 12:25:24.993826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:25.500460 (+506634us) service_pool.cc:224] Handling call
0709 12:25:25.500721 (+   261us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:25.501276 (+   555us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:25.501312 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:25.501779 (+   467us) log.cc:844] Serialized 26 byte log entry
0709 12:25:26.113855 (+612076us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:26.473873 (+360018us) log.cc:844] Serialized 14 byte log entry
0709 12:25:26.474707 (+   834us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:26.474778 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:26.511641 (+ 36863us) raft_consensus.cc:1685] finished
0709 12:25:26.511676 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:26.511861 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":479,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":211,"thread_start_us":880346,"threads_started":2,"wal-append.queue_time_us":795934}
W20260709 12:25:26.541805 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 58649.9us
I20260709 12:25:26.490908 25650 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:26.473024 31118 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:26.544656 31185 raft_consensus.cc:3055] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:25:26.547838 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 57040.4us
I20260709 12:25:26.556761 25800 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:26.527180 31189 consensus_queue.cc:260] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:26.603802 25726 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:25:26.546482 30935 raft_consensus.cc:2804] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:26.453631 31013 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:26.626721 25726 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:25:26.664443 31180 raft_consensus.cc:2804] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:26.664858 25726 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:26.665144 31180 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:26.665606 31150 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:26.624249 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 299745us
I20260709 12:25:26.665848 31180 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:26.666195 31150 raft_consensus.cc:2749] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:26.667399 25649 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:25:26.668149 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:26.554457 31173 raft_consensus.cc:2749] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:25:26.670140 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 233463us
I20260709 12:25:26.670872 26402 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:26.647641 31189 raft_consensus.cc:3060] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:26.638011 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 81323.5us
I20260709 12:25:26.630861 31168 raft_consensus.cc:2804] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:26.625667 31192 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:26.688527 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:26.688797 25837 raft_consensus.cc:1240] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:25:26.532843 31179 consensus_queue.cc:1059] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.108s
I20260709 12:25:26.623585 31194 consensus_queue.cc:1059] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 14.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:25:26.559460 25650 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:26.690080 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
W20260709 12:25:26.690424 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 131056us
I20260709 12:25:26.691161 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:25:26.658576 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:26.662098 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:26.640936 31196 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.667438 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:25:26.697149 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:26.697276 26433 raft_consensus.cc:3060] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:25:26.629608 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 312717us
I20260709 12:25:26.644809 31118 raft_consensus.cc:2804] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:26.668888 25726 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:26.698002 26401 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:26.698832 25726 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:25:26.554868 31185 raft_consensus.cc:740] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:26.671240 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:26.711642 26437 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 20.
I20260709 12:25:26.674649 25649 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:26.648383 31175 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:26.719493 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:26.720383 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:26.667848 30971 raft_consensus.cc:2804] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:26.676476 30857 raft_consensus.cc:2804] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:26.686867 31081 raft_consensus.cc:2764] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:25:26.687544 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:26.730916 25758 raft_consensus.cc:3060] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:26.688289 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:26.692049 25834 raft_consensus.cc:2468] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 12.
W20260709 12:25:26.695834 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 44187.4us
I20260709 12:25:26.710615 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:26.712571 25650 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:26.651230 31230 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:26.717193 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:26.680797 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:26.721647 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:26.722781 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:26.726145 25836 raft_consensus.cc:1240] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:26.663467 30535 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:26.726959 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:26.728627 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:26.744076 25829 raft_consensus.cc:2468] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 15.
I20260709 12:25:26.730947 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:26.732743 26438 raft_consensus.cc:3060] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:26.724706 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:26.738097 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:26.738888 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:26.726670 26439 raft_consensus.cc:1275] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:25:26.714929 31168 raft_consensus.cc:697] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:26.725196 31150 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:26.711009 31118 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:26.723091 31156 raft_consensus.cc:2804] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:25:26.731844 31220 log.cc:927] Time spent T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.430s	user 0.004s	sys 0.000s
I20260709 12:25:26.746412 25837 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 14.
I20260709 12:25:26.725345 31172 raft_consensus.cc:2804] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:26.765322 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:26.713413 31192 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:26.648044 25579 catalog_manager.cc:5697] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:25:26.733603 31226 raft_consensus.cc:2804] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:26.766892 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:26.806679 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:26.807183 25649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:26.807595 25761 raft_consensus.cc:2410] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
W20260709 12:25:26.807874 25649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:26.802856 25758 raft_consensus.cc:2468] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 13.
I20260709 12:25:26.810364 25759 raft_consensus.cc:2393] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 15: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:26.811070 25758 raft_consensus.cc:1240] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:26.730705 31166 consensus_queue.cc:1059] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 12:25:26.719544 31196 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:26.776980 31156 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:26.814769 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 98546.4us
I20260709 12:25:26.772130 31118 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:26.778363 31172 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:26.774755 31218 raft_consensus.cc:2804] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:26.773339 31244 raft_consensus.cc:2804] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:26.803316 31099 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:26.743002 31230 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:26.818146 31156 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:26.815790 31173 raft_consensus.cc:2749] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:26.841948 25757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48606 (request call id 1357) took 1816 ms. Trace:
I20260709 12:25:26.815598 31226 raft_consensus.cc:697] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 13 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:26.822315 31172 raft_consensus.cc:3060] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:26.825850 31179 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.859127 31200 consensus_queue.cc:1048] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:26.827271 31244 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
W20260709 12:25:26.851682 31229 log.cc:927] Time spent T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
W20260709 12:25:26.857949 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 145451us
I20260709 12:25:26.863979 26402 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:26.846868 25757 rpcz_store.cc:276] 0709 12:25:25.025740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:25.025871 (+   131us) service_pool.cc:224] Handling call
0709 12:25:25.031903 (+  6032us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:25.038825 (+  6922us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:25.038862 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:25.044567 (+  5705us) log.cc:844] Serialized 26 byte log entry
0709 12:25:25.467994 (+423427us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b18003e8ae0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d96a56e07 00007f5d9f8b19a9 00007f5d96a7369b 00007f5d96a7193f 00007f5d96a73c02 00007f5d996fb20b 00007f5d99700d23 00007f5d997010d1 00007f5d99b1ca0f
0709 12:25:25.888149 (+420155us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:25.888215 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:25.888304 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:26.553822 (+665518us) spinlock_profiling.cc:243] Waited 5.62 ms on lock 0x7b4400022b4c. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db 00007f5d99708aaf 00007f5d996fc86e 00007f5d996fbbb6 00007f5d996fb7d8 00007f5d99705221 00007f5d997051d9 00007f5d99705169
0709 12:25:26.841742 (+287920us) raft_consensus.cc:1685] finished
0709 12:25:26.841762 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:26.841889 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":796,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":5223,"spinlock_wait_cycles":36592384,"thread_start_us":419909,"threads_started":1,"wal-append.queue_time_us":1205103}
I20260709 12:25:26.859932 25830 raft_consensus.cc:2393] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 15: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
W20260709 12:25:26.883029 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 140931us
I20260709 12:25:26.869895 31179 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:26.900223 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:26.901085 25831 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 18.
I20260709 12:25:26.901449 26438 raft_consensus.cc:2468] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 15.
I20260709 12:25:26.886966 30535 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:26.888942 31230 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:26.890749 31226 consensus_queue.cc:237] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:26.892915 25755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48606 (request call id 1361) took 1109 ms. Trace:
I20260709 12:25:26.892181 25579 catalog_manager.cc:5697] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 9 to 10, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 10 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } }
I20260709 12:25:26.894845 31196 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:26.896909 31254 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.932878 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:26.882395 31244 raft_consensus.cc:3060] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:26.928814 30857 raft_consensus.cc:697] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 15 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:26.875802 31168 consensus_queue.cc:237] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:26.967505 30857 consensus_queue.cc:237] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:26.857378 30885 consensus_queue.cc:1048] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 12:25:26.898038 31192 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:26.933651 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:26.934449 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:26.897024 31200 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.930408 25755 rpcz_store.cc:276] 0709 12:25:25.783031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:25.784019 (+   988us) service_pool.cc:224] Handling call
0709 12:25:25.784370 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:26.401304 (+616934us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:26.892628 (+491324us) spinlock_profiling.cc:243] Waited 611 ms on lock 0x7b54001e4e54. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:26.892827 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1406159104}
I20260709 12:25:26.835474 31099 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:26.999836 25684 raft_consensus.cc:1275] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:25:26.986037 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:26.971309 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:26.875569 31255 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
W20260709 12:25:26.974247 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 90751us
I20260709 12:25:26.975557 25682 raft_consensus.cc:2376] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 12. Re-sending same reply.
I20260709 12:25:27.007120 25650 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:27.007650 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:27.008996 25682 raft_consensus.cc:2410] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:25:26.976945 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:27.010278 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:26.977640 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:26.978022 25756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48606 (request call id 1359) took 1195 ms. Trace:
I20260709 12:25:26.978351 25686 raft_consensus.cc:1240] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:27.017835 25678 raft_consensus.cc:2393] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 13: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:27.020913 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:27.022539 25684 raft_consensus.cc:3060] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:27.010461 25681 raft_consensus.cc:2468] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 14.
I20260709 12:25:27.025962 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:27.027019 25686 raft_consensus.cc:2393] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 10: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:26.980391 25685 raft_consensus.cc:2410] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:25:27.011457 25756 rpcz_store.cc:276] 0709 12:25:25.782378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:25.786779 (+  4401us) service_pool.cc:224] Handling call
0709 12:25:25.856774 (+ 69995us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:25.857186 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:25.857215 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:25.876890 (+ 19675us) log.cc:844] Serialized 26 byte log entry
0709 12:25:26.390867 (+513977us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:26.390921 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:26.391006 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:26.977746 (+586740us) raft_consensus.cc:1685] finished
0709 12:25:26.977775 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:26.977947 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5183,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":90,"thread_start_us":513474,"threads_started":1,"wal-append.queue_time_us":669997}
I20260709 12:25:26.981849 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:26.977285 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
W20260709 12:25:26.973369 31250 log.cc:927] Time spent T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 12:25:26.962177 31230 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:26.974520 31256 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.978600 31013 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:26.980311 31173 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.964967 31241 consensus_queue.cc:1048] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.092s
I20260709 12:25:27.065661 25684 raft_consensus.cc:2468] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 13.
I20260709 12:25:27.005980 31200 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:27.002166 31260 consensus_queue.cc:1048] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.092s
I20260709 12:25:27.028543 31258 raft_consensus.cc:2804] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:27.034986 31081 raft_consensus.cc:2804] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:27.086485 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:26.974471 31254 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:27.093343 25726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:27.019731 30935 raft_consensus.cc:697] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 13 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:27.057540 31263 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:27.100867 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 216786us
I20260709 12:25:27.113090 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:27.034824 31252 consensus_queue.cc:1048] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.053s
W20260709 12:25:27.083464 31204 consensus_meta.cc:287] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.550s	user 0.010s	sys 0.000s
I20260709 12:25:27.080466 31249 raft_consensus.cc:3055] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:27.126425 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:27.075286 30972 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.128631 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:27.133883 25829 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 14.
I20260709 12:25:27.092149 25831 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:25:27.134850 25831 raft_consensus.cc:606] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 13 LEADER]: Received request to transfer leadership to TS 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:27.138238 25831 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:25:27.138921 25831 raft_consensus.cc:606] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Received request to transfer leadership to TS 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:27.139353 25831 raft_consensus.cc:614] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:27.132853 31240 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:27.142351 31243 log.cc:927] Time spent T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:25:27.142535 31240 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:27.143712 31251 log.cc:927] Time spent T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
I20260709 12:25:27.145125 31200 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:27.092346 31258 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:27.145689 31258 raft_consensus.cc:3060] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:27.131052 31249 raft_consensus.cc:740] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:27.146440 26433 raft_consensus.cc:2468] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 16.
I20260709 12:25:27.146807 31249 consensus_queue.cc:260] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:27.147656 25832 raft_consensus.cc:1275] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:25:27.148097 31249 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:27.148375 30952 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:27.149807 31179 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:27.150230 31247 log.cc:927] Time spent T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.324s	user 0.000s	sys 0.000s
I20260709 12:25:27.151748 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
W20260709 12:25:27.153162 31248 log.cc:927] Time spent T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.268s	user 0.000s	sys 0.001s
I20260709 12:25:27.152350 25579 catalog_manager.cc:5697] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 8 to 11, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 11 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } }
I20260709 12:25:27.100055 31081 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:27.156278 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 146326us
I20260709 12:25:27.086972 31173 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:27.159049 30935 consensus_queue.cc:237] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:27.160073 25579 catalog_manager.cc:5697] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:27.161335 31173 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:27.163444 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:27.028764 31255 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:27.164573 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:27.167071 25832 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "a866ff967d964388a6f0dff7fd43df89"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:25:27.161895 25579 catalog_manager.cc:5697] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:27.085747 31230 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:27.175148 25685 raft_consensus.cc:1240] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:27.174713 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:27.178619 25678 raft_consensus.cc:3060] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:27.176105 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:27.163189 31081 raft_consensus.cc:3060] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:27.181646 25680 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:27.063979 31256 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:27.117035 31156 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:27.182157 25800 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:27.192818 31255 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:27.168685 31272 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:27.193655 31272 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:27.132259 31263 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:27.197167 31244 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:27.198174 31263 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:27.134966 31204 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:27.200115 31204 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:25:27.201799 31261 log.cc:927] Time spent T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:25:27.203022 31259 raft_consensus.cc:3055] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:27.203397 31259 raft_consensus.cc:740] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:27.157285 30972 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:27.204161 31259 consensus_queue.cc:260] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:27.206015 30972 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:27.208071 31156 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:27.219480 25832 raft_consensus.cc:606] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Received request to transfer leadership to TS a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:27.220208 25832 raft_consensus.cc:614] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:27.195763 31272 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:27.222177 30899 consensus_queue.cc:1059] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:25:27.223490 30899 raft_consensus.cc:3055] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:27.223739 31150 raft_consensus.cc:2749] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:27.224069 30899 raft_consensus.cc:740] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:27.224720 25760 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:27.225029 31258 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:27.226979 25678 raft_consensus.cc:2468] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 12.
W20260709 12:25:27.228227 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 46181.4us
I20260709 12:25:27.231071 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:27.194862 25579 catalog_manager.cc:5697] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:27.235843 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:27.246763 26438 raft_consensus.cc:1240] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:25:27.242547 25801 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:27.239144 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:27.248741 25801 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:27.250011 25801 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:27.180079 31166 consensus_queue.cc:1048] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:25:27.253757 25680 raft_consensus.cc:2468] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 17.
I20260709 12:25:27.251653 25801 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:27.255292 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:27.264974 25837 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:27.256237 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:27.266470 25682 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 9.
I20260709 12:25:27.267601 25726 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:27.267740 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:27.269484 25726 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
W20260709 12:25:27.240762 31270 log.cc:927] Time spent T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:25:27.277055 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:27.277148 25801 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:27.277923 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:27.278815 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:27.243012 31257 raft_consensus.cc:2804] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:27.255043 30535 raft_consensus.cc:2749] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:27.263801 31272 raft_consensus.cc:2804] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:25:27.290639 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
W20260709 12:25:27.387600 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 110558us
I20260709 12:25:27.294152 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:27.388901 26437 raft_consensus.cc:3060] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:27.238485 31258 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:27.390383 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:27.391388 25835 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 20.
I20260709 12:25:27.254918 31266 raft_consensus.cc:2749] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:25:27.366235 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:27.279243 31150 raft_consensus.cc:2749] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:27.366202 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:27.368888 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:27.233585 30899 consensus_queue.cc:260] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:27.282805 31237 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.002s	sys 0.008s
W20260709 12:25:27.414992 31237 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.003s	sys 0.008s
I20260709 12:25:27.415386 30899 raft_consensus.cc:3060] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:27.235947 30952 consensus_queue.cc:1059] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 12:25:27.377543 25834 raft_consensus.cc:1240] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 12:25:27.229837 31275 consensus_queue.cc:1059] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.141s
I20260709 12:25:27.379742 26438 raft_consensus.cc:1240] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:27.369778 31013 raft_consensus.cc:2749] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:27.384599 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:27.283335 31204 raft_consensus.cc:2749] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:27.288168 31271 raft_consensus.cc:2764] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
I20260709 12:25:27.303776 31196 consensus_queue.cc:1059] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.095s
I20260709 12:25:27.282856 26432 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 14.
W20260709 12:25:27.386551 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 97110.4us
I20260709 12:25:27.287101 25726 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:27.300575 25837 raft_consensus.cc:2468] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 14.
W20260709 12:25:27.394778 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 227799us
I20260709 12:25:27.437861 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:25:27.438493 26402 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 1.758s (SENT) [suppressed 30 similar messages]
I20260709 12:25:27.392700 31272 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:27.396700 25801 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:25:27.442214 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 45596.2us
I20260709 12:25:27.443051 25801 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:27.281107 31156 consensus_queue.cc:1048] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.097s
I20260709 12:25:27.280330 31244 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:27.445647 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:27.446246 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:25:27.447525 31172 consensus_meta.cc:287] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.572s	user 0.009s	sys 0.001s
I20260709 12:25:27.448146 31013 raft_consensus.cc:2804] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:27.448226 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:27.448864 31013 raft_consensus.cc:697] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 16 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:27.449805 31013 consensus_queue.cc:237] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:27.450874 31194 consensus_queue.cc:1059] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:27.375141 31263 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.283234 31256 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:27.422654 26437 raft_consensus.cc:2468] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 14.
I20260709 12:25:27.378028 31257 raft_consensus.cc:697] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 13 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:27.452409 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:27.425550 26436 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 21.
I20260709 12:25:27.434749 25760 raft_consensus.cc:2468] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 14.
I20260709 12:25:27.453415 31256 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:27.452169 31263 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:27.453262 31257 consensus_queue.cc:237] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:27.454061 31256 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:27.456001 25579 catalog_manager.cc:5697] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 7 to 10, leader changed from a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 10 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:27.459682 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:27.460711 30971 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:27.419857 30952 raft_consensus.cc:3055] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:27.283471 26439 raft_consensus.cc:2410] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:25:27.464219 26434 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 20.
I20260709 12:25:27.407016 31240 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:27.453696 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:27.463249 26437 raft_consensus.cc:1240] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:27.452054 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:27.465288 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:27.467757 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:27.513443 26432 raft_consensus.cc:1240] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:27.518123 26436 raft_consensus.cc:1240] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 11. Current term is 12. Ops: []
W20260709 12:25:27.519001 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 231941us
I20260709 12:25:27.518116 26430 raft_consensus.cc:1275] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:25:27.516741 26434 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 14.
I20260709 12:25:27.521581 25726 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:27.464254 30971 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:25:27.526460 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:27.526288 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:25:27.464452 31277 log.cc:927] Time spent T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:25:27.458750 25579 catalog_manager.cc:5697] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 9 to 10, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 10 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:27.473528 25801 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:27.424078 31200 consensus_queue.cc:1048] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 12:25:27.466701 31172 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:27.443701 31272 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:27.514866 31168 raft_consensus.cc:2804] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:27.464480 30952 raft_consensus.cc:740] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:27.587754 26432 raft_consensus.cc:1240] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:27.466316 31204 raft_consensus.cc:2804] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:25:27.590781 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 117355us
I20260709 12:25:27.465752 31254 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:27.597473 25684 raft_consensus.cc:2393] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 13: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:27.595640 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:27.596403 31173 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.583716 31196 raft_consensus.cc:3060] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:27.598047 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 76555us
I20260709 12:25:27.585283 31230 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:27.589489 31232 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.532068 31258 consensus_queue.cc:1048] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 12:25:27.590129 31168 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:27.599381 31231 raft_consensus.cc:2804] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:27.621856 25726 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:27.591943 31264 consensus_queue.cc:1059] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 12:25:27.606319 31172 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:27.609673 31240 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:27.610983 31204 raft_consensus.cc:697] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 15 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
W20260709 12:25:27.631034 31118 consensus_meta.cc:287] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.804s	user 0.011s	sys 0.000s
I20260709 12:25:27.606405 31173 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:27.624261 31192 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:27.616561 31156 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
W20260709 12:25:27.632432 25649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:27.648211 25649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:27.627310 31231 raft_consensus.cc:697] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 12 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:27.637111 31263 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:27.637864 31280 log.cc:927] Time spent T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
I20260709 12:25:27.620683 31168 raft_consensus.cc:3060] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:27.620630 31230 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.642215 25726 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:27.624737 31266 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.640249 25579 catalog_manager.cc:5697] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:25:27.649586 31194 raft_consensus.cc:3055] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:27.649609 31204 consensus_queue.cc:237] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:27.651449 31180 consensus_meta.cc:287] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.985s	user 0.007s	sys 0.005s
W20260709 12:25:27.658053 31189 consensus_meta.cc:287] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.980s	user 0.007s	sys 0.004s
I20260709 12:25:27.691903 31189 raft_consensus.cc:2804] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:27.692447 31189 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:27.691812 31231 consensus_queue.cc:237] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:27.692783 31189 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:27.658170 31192 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:27.658799 31081 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:27.659047 31156 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:27.630385 31150 raft_consensus.cc:2804] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:25:27.617784 31232 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:27.660528 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:27.644809 31240 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:27.658054 31196 raft_consensus.cc:2749] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:27.669808 31266 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:27.670672 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:27.672724 25579 catalog_manager.cc:5697] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 8 to 10, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 10 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:27.715276 25579 catalog_manager.cc:5697] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 4 to 8, leader changed from a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 8 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:27.716305 31266 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:27.717188 25579 catalog_manager.cc:5697] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 10 to 13, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 13 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } }
I20260709 12:25:27.718708 25579 catalog_manager.cc:5697] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 6 to 9, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 9 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } }
I20260709 12:25:27.676038 31173 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:27.683068 31279 log.cc:927] Time spent T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.170s	user 0.002s	sys 0.000s
I20260709 12:25:27.684186 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:27.724287 25686 raft_consensus.cc:2468] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 13.
I20260709 12:25:27.647609 31118 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:27.684868 31194 raft_consensus.cc:740] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:27.700462 31240 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:27.710470 31249 consensus_meta.cc:287] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.562s	user 0.007s	sys 0.002s
I20260709 12:25:27.710738 31081 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:27.711400 25685 raft_consensus.cc:1240] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:27.647174 30952 consensus_queue.cc:260] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:27.717772 31232 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:27.668258 31230 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:27.700711 31221 log.cc:927] Time spent T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.411s	user 0.002s	sys 0.000s
I20260709 12:25:27.722705 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:27.725318 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:27.725914 25801 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:25:27.774984 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 49117.9us
I20260709 12:25:27.693440 31185 consensus_queue.cc:260] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:27.695590 31180 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:27.740933 25828 raft_consensus.cc:2393] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 15: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:27.728930 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:25:27.728072 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 85945.8us
I20260709 12:25:27.784982 25726 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:27.761130 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:27.761958 25833 raft_consensus.cc:2468] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 15.
I20260709 12:25:27.734290 31189 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:27.737133 31256 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:27.760690 31272 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:27.779351 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:27.782248 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:27.782735 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:27.787142 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:27.742182 31118 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:27.791046 26432 raft_consensus.cc:1275] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:25:27.744961 31100 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:27.737254 31192 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:27.793026 25837 raft_consensus.cc:2393] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 15: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
W20260709 12:25:27.803014 31302 log.cc:927] Time spent T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:25:27.803977 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:27.804390 31194 consensus_queue.cc:260] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:27.806377 31218 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:27.806897 31218 raft_consensus.cc:3060] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:27.787614 31301 consensus_queue.cc:1059] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 12:25:27.793733 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:27.809006 31301 raft_consensus.cc:3055] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:27.809403 31301 raft_consensus.cc:740] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:27.794519 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:27.810182 31301 consensus_queue.cc:260] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:27.810910 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:27.811457 31301 raft_consensus.cc:3060] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:27.813874 31180 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:27.814491 25761 raft_consensus.cc:1240] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:27.788780 31240 raft_consensus.cc:2749] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:27.815092 25679 raft_consensus.cc:1240] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:27.818074 25761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 3259) took 1097 ms. Trace:
I20260709 12:25:27.799130 31185 raft_consensus.cc:3060] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:27.782115 30884 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.799811 26435 raft_consensus.cc:2393] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 13: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:27.805104 25837 raft_consensus.cc:2393] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 16: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:27.780126 31150 raft_consensus.cc:697] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:27.852694 31150 consensus_queue.cc:237] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 17, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:27.855824 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:27.807613 25829 raft_consensus.cc:1240] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 12 LEADER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:27.823443 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:27.857755 25686 raft_consensus.cc:2468] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 12.
I20260709 12:25:27.828161 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:27.784078 31204 raft_consensus.cc:2804] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:27.829306 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:27.859175 25680 raft_consensus.cc:2468] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 11.
I20260709 12:25:27.797068 31230 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:27.818609 25761 rpcz_store.cc:276] 0709 12:25:26.720620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:26.849096 (+128476us) service_pool.cc:224] Handling call
0709 12:25:26.849464 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:27.815063 (+965599us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:27.817760 (+  2697us) spinlock_profiling.cc:243] Waited 965 ms on lock 0x7b5400040bd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:27.818000 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2218760064}
I20260709 12:25:27.834002 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:27.834501 31272 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:27.835443 25726 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:27.836444 31168 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:27.792734 31196 consensus_queue.cc:1048] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.056s
I20260709 12:25:27.848855 31156 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:27.793053 30952 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:27.849718 25579 catalog_manager.cc:5697] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 9 to 12, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 12 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:25:27.865016 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:27.866003 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:27.867771 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:27.870126 31305 raft_consensus.cc:2804] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:27.855355 31189 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:27.880863 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:27.881737 26439 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:27.874010 25726 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:27.879154 26435 raft_consensus.cc:2393] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 20: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:27.864727 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:25:27.872287 31308 log.cc:927] Time spent T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:25:27.887754 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:27.891372 25829 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:27.889640 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:27.904166 25837 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:27.864693 31204 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:27.915962 25650 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:27.877099 31180 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:27.878830 30971 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:27.878863 31156 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.925549 25650 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:27.928982 25650 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:27.930222 25650 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:27.930691 25837 raft_consensus.cc:2468] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 16.
I20260709 12:25:27.928926 25829 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 15.
I20260709 12:25:27.872529 31240 consensus_queue.cc:1048] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 12:25:27.865468 30884 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:27.939097 25650 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:27.915642 31275 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.918792 31204 raft_consensus.cc:3060] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:27.945349 25650 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:27.923848 31189 raft_consensus.cc:2804] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:27.940450 31232 raft_consensus.cc:2749] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:27.937433 31081 raft_consensus.cc:2749] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:27.960870 31295 raft_consensus.cc:2749] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:27.945089 31274 raft_consensus.cc:2749] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:25:28.004714 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 135538us
I20260709 12:25:27.935119 30899 consensus_queue.cc:1059] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 12:25:27.974823 31189 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:27.927836 31180 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:28.007427 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:28.000172 26439 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 15.
I20260709 12:25:27.936491 31309 raft_consensus.cc:2804] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:27.996879 31290 raft_consensus.cc:2749] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:27.937808 31156 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:28.018709 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 73614.4us
I20260709 12:25:28.021724 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:28.023773 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:28.024690 30884 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:28.024922 25677 raft_consensus.cc:2410] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:25:28.011133 31189 raft_consensus.cc:3060] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:28.014060 31309 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:28.030031 25686 raft_consensus.cc:1275] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:25:28.031075 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:28.031347 31156 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:28.033313 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:28.034718 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:28.036172 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:28.036790 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:28.037695 31168 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:28.038334 25686 raft_consensus.cc:1275] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:25:28.039685 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:28.040424 25686 raft_consensus.cc:2376] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 10. Re-sending same reply.
I20260709 12:25:28.041999 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:28.042639 25686 raft_consensus.cc:2468] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 11.
I20260709 12:25:28.043943 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:28.044916 25686 raft_consensus.cc:2410] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:25:28.047281 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
W20260709 12:25:28.047844 31286 log.cc:927] Time spent T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.460s	user 0.002s	sys 0.000s
I20260709 12:25:28.023741 31274 raft_consensus.cc:3055] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:28.047984 25686 raft_consensus.cc:2376] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 13. Re-sending same reply.
I20260709 12:25:28.048453 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:28.039630 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:28.052248 25681 raft_consensus.cc:2393] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 14: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:28.007884 31275 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:28.058518 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:28.064179 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
W20260709 12:25:28.064050 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 58538.2us
I20260709 12:25:28.062693 31175 raft_consensus.cc:3055] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:28.071185 31175 raft_consensus.cc:740] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:28.072296 31259 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:28.072840 31175 consensus_queue.cc:260] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:28.074133 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:28.074344 31175 raft_consensus.cc:3060] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:28.074512 31240 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:28.075124 31240 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:28.075507 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:28.061293 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:28.076185 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:28.076577 25679 raft_consensus.cc:2410] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:25:28.057777 31274 raft_consensus.cc:740] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:28.077425 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:28.077629 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:28.078470 25757 raft_consensus.cc:2393] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 13: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:28.078329 31274 consensus_queue.cc:260] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:28.080503 31179 raft_consensus.cc:993] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a: : Instructing follower 6e673265293d4e9a937dc45150aeb1b8 to start an election
I20260709 12:25:28.071209 31180 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:28.081142 31179 raft_consensus.cc:1081] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 13 LEADER]: Signalling peer 6e673265293d4e9a937dc45150aeb1b8 to start an election
I20260709 12:25:28.081388 31180 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.081480 25761 raft_consensus.cc:1240] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:28.082322 31156 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.082923 31156 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:28.027325 31150 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:28.083932 31150 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:28.085299 31156 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:28.085394 31204 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:28.086274 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:28.086651 31150 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:28.087229 25754 raft_consensus.cc:2410] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 12:25:28.087985 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:28.088301 25762 raft_consensus.cc:1240] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:28.089433 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:28.089960 25680 raft_consensus.cc:2376] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 13. Re-sending same reply.
I20260709 12:25:28.090605 25763 raft_consensus.cc:1240] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:28.091327 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:28.079658 31274 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:28.088785 25681 raft_consensus.cc:2376] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 9. Re-sending same reply.
I20260709 12:25:28.108804 25680 raft_consensus.cc:1275] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:25:28.029649 31309 raft_consensus.cc:3060] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:28.095341 31195 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:28.065213 31185 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:28.132228 31195 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:28.132743 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:28.133876 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:28.134611 31195 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:28.134851 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:28.135490 25755 raft_consensus.cc:2468] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 17.
I20260709 12:25:28.069443 25726 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:28.101702 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:28.092238 31168 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.094758 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:28.122553 26402 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:28.125818 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:28.159519 25756 raft_consensus.cc:2468] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 12.
I20260709 12:25:28.159762 25763 raft_consensus.cc:2468] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 13.
I20260709 12:25:28.129496 31204 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:28.130975 25761 raft_consensus.cc:2468] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 15.
I20260709 12:25:28.081993 31180 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:28.139525 25677 raft_consensus.cc:1275] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:25:28.141248 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:28.148079 25686 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 21.
I20260709 12:25:28.156404 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:28.165093 26402 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:28.187891 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:28.189985 25757 raft_consensus.cc:2410] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 18 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 12:25:28.190042 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:28.135529 31189 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:28.194308 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:28.195034 25758 raft_consensus.cc:2468] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 10.
I20260709 12:25:28.196014 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:28.191239 25686 raft_consensus.cc:2376] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 9. Re-sending same reply.
I20260709 12:25:28.188143 31195 raft_consensus.cc:2804] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:28.200178 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:28.160579 31185 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:28.201313 31240 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:28.202941 31185 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:28.186307 31258 raft_consensus.cc:2764] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:25:28.204073 31258 raft_consensus.cc:2804] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:28.204577 31258 raft_consensus.cc:697] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 14 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:28.205457 31258 consensus_queue.cc:237] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:28.186501 30884 consensus_queue.cc:1048] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:25:28.055850 31218 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:28.197958 25762 raft_consensus.cc:1275] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:25:28.195369 25649 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:28.209107 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:28.210089 25828 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44218 (request call id 1946) took 1493 ms (client timeout 1677 ms). Trace:
I20260709 12:25:28.210311 25836 raft_consensus.cc:1240] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 14. Current term is 15. Ops: []
W20260709 12:25:28.217235 25828 rpcz_store.cc:269] 0709 12:25:26.716223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:26.716953 (+   730us) service_pool.cc:224] Handling call
0709 12:25:28.209883 (+1492930us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b5400117454. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:28.210029 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2313900288}
I20260709 12:25:28.184566 31305 raft_consensus.cc:697] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:28.217329 25757 raft_consensus.cc:2410] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:25:28.225627 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:28.161229 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 91847.4us
I20260709 12:25:28.159451 31314 consensus_queue.cc:1059] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 15.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.093s
I20260709 12:25:28.223970 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:28.237637 25761 raft_consensus.cc:2393] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 16: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:28.203073 31275 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:28.161373 30921 consensus_queue.cc:1059] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
W20260709 12:25:28.241954 25649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:28.250226 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:28.184964 31168 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:28.251488 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:28.253453 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:28.218847 31195 raft_consensus.cc:697] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 15 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:28.254453 25828 raft_consensus.cc:2468] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 10.
I20260709 12:25:28.255509 25832 raft_consensus.cc:1275] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:25:28.228950 31255 raft_consensus.cc:2804] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:28.264057 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:28.265507 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:28.266299 25828 raft_consensus.cc:2468] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 14.
I20260709 12:25:28.256637 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:28.293515 25726 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:28.342025 25832 raft_consensus.cc:1240] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:28.344967 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:28.367862 25829 raft_consensus.cc:1240] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:28.268328 31204 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.271039 31255 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:28.370085 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 76670.8us
I20260709 12:25:28.371898 25835 raft_consensus.cc:1240] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:28.372718 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:28.372924 25726 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:28.377041 25726 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:25:28.381260 25829 raft_consensus.cc:1240] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:28.337191 31317 raft_consensus.cc:2749] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:28.394368 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:28.395387 25833 raft_consensus.cc:1240] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:28.409514 25726 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:28.375490 31255 raft_consensus.cc:3060] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:28.383303 31185 raft_consensus.cc:2804] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:28.425625 25726 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:28.433261 25800 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:28.434562 25800 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:28.438207 25800 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:25:28.441537 25726 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:28.427739 31240 raft_consensus.cc:2749] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:28.429090 31099 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:28.440733 31150 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:28.438596 31165 raft_consensus.cc:2749] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:28.443064 31150 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:28.438239 31100 raft_consensus.cc:2749] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:28.445325 25685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2612) took 1226 ms. Trace:
W20260709 12:25:28.445917 31321 log.cc:927] Time spent T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:25:28.446480 25684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 2604) took 1304 ms. Trace:
I20260709 12:25:28.446871 25684 rpcz_store.cc:276] 0709 12:25:27.142122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:27.164343 (+ 22221us) service_pool.cc:224] Handling call
0709 12:25:28.446288 (+1281945us) spinlock_profiling.cc:243] Waited 430 ms on lock 0x7b54002cecd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:28.446421 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":990108928}
I20260709 12:25:28.447803 31312 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.448308 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:28.448436 31312 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:28.449169 31309 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:28.449656 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:28.450603 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:28.452178 31189 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:28.418732 31195 consensus_queue.cc:237] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:28.452545 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:28.457229 25684 raft_consensus.cc:3060] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:28.458596 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:28.459156 25763 raft_consensus.cc:3060] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:28.453693 31180 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:28.426026 31185 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
W20260709 12:25:28.453974 25830 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44202 (request call id 3129) took 2557 ms (client timeout 2184 ms). Trace:
W20260709 12:25:28.462599 25830 rpcz_store.cc:269] 0709 12:25:25.896107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:25.896237 (+   130us) service_pool.cc:224] Handling call
0709 12:25:28.453727 (+2557490us) spinlock_profiling.cc:243] Waited 935 ms on lock 0x7b5400119254. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:28.453874 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2149931904}
I20260709 12:25:28.454393 25683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2600) took 1433 ms. Trace:
I20260709 12:25:28.455174 25831 raft_consensus.cc:1275] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:25:28.445755 25685 rpcz_store.cc:276] 0709 12:25:27.218717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:27.218886 (+   169us) service_pool.cc:224] Handling call
0709 12:25:27.221766 (+  2880us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:27.755640 (+533874us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:28.445088 (+689448us) spinlock_profiling.cc:243] Waited 489 ms on lock 0x7b54000b13d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:28.445265 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1125516672}
I20260709 12:25:28.417414 31317 raft_consensus.cc:2804] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:28.384651 31204 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:28.458122 25649 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:28.464840 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:28.429818 31271 raft_consensus.cc:2749] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:25:28.481552 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 54597.9us
I20260709 12:25:28.451685 31312 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:28.388103 31305 consensus_queue.cc:237] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:28.464053 25683 rpcz_store.cc:276] 0709 12:25:27.020852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:27.034844 (+ 13992us) service_pool.cc:224] Handling call
0709 12:25:27.035291 (+   447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:27.134639 (+ 99348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:27.134671 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:27.241218 (+106547us) spinlock_profiling.cc:243] Waited 19.9 ms on lock 0x7b2c00013008. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9845aa11 00007f5d9846a372 00007f5d99b9ca01 00007f5d99b6143a 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2
0709 12:25:27.241565 (+   347us) log.cc:844] Serialized 26 byte log entry
0709 12:25:27.367316 (+125751us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:27.367359 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:28.047287 (+679928us) spinlock_profiling.cc:243] Waited 2.62 ms on lock 0x7b4400022b4c. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db 00007f5d99708aaf 00007f5d996fc86e 00007f5d996fbbb6 00007f5d996fb7d8 00007f5d99705221 00007f5d997051d9 00007f5d99705169
0709 12:25:28.453956 (+406669us) spinlock_profiling.cc:243] Waited 99 ms on lock 0x7b5400159d54. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:28.454005 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:28.454066 (+    61us) raft_consensus.cc:1685] finished
0709 12:25:28.454079 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:28.454326 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":28260,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":3555,"spinlock_wait_cycles":279591936,"thread_start_us":125463,"threads_started":1,"wal-append.queue_time_us":222704}
I20260709 12:25:28.488294 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:28.484571 31259 raft_consensus.cc:2804] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:28.489003 25685 raft_consensus.cc:2468] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 15.
I20260709 12:25:28.489197 31259 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:28.489382 31309 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:28.463729 31165 raft_consensus.cc:2804] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:28.490051 31165 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:28.490509 31165 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:28.492463 31168 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:28.494550 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:28.489656 31259 raft_consensus.cc:3060] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:28.445389 31150 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:28.498726 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:28.500021 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:28.500255 25763 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 13.
I20260709 12:25:28.501381 25763 raft_consensus.cc:1240] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:28.502486 25763 raft_consensus.cc:1240] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:28.503552 25684 raft_consensus.cc:2468] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 15.
I20260709 12:25:28.504694 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:25:28.486064 30952 consensus_meta.cc:287] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.609s	user 0.012s	sys 0.000s
W20260709 12:25:28.506186 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 341200us
I20260709 12:25:28.482721 31317 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:28.481334 31180 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:28.464071 31185 raft_consensus.cc:3060] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:28.509174 25682 raft_consensus.cc:2393] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 11: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:28.493922 31204 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:28.514330 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:28.516708 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:28.517473 25684 raft_consensus.cc:2376] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 15. Re-sending same reply.
I20260709 12:25:28.518774 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:28.518987 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:28.520613 25684 raft_consensus.cc:2393] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 13: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:28.521222 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:28.541460 25763 raft_consensus.cc:1275] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:25:28.543773 25763 raft_consensus.cc:1275] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:25:28.544521 25684 pending_rounds.cc:85] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc: Aborting all ops after (but not including) 10
I20260709 12:25:28.544817 25684 pending_rounds.cc:107] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 12:25:28.544855 25763 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:53460
I20260709 12:25:28.545266 25684 raft_consensus.cc:2889] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:28.546605 25726 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:28.512256 31317 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:25:28.549320 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 202900us
I20260709 12:25:28.550335 25682 raft_consensus.cc:1240] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 11. Current term is 12. Ops: [10.9-11.10]
W20260709 12:25:28.550351 25650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:28.551111 31150 raft_consensus.cc:2749] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:28.552564 25726 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:28.553520 31150 raft_consensus.cc:2804] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:28.554003 31150 raft_consensus.cc:697] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:28.554880 31150 consensus_queue.cc:237] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.6, Last appended by leader: 6, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:28.518535 31218 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:28.562778 31322 log.cc:927] Time spent T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:25:28.566154 25650 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:28.568845 31265 raft_consensus.cc:2804] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:25:28.569298 31265 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:28.569631 31265 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:25:28.574791 25650 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:28.597599 25650 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:25:28.599267 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 220119us
W20260709 12:25:28.577589 31318 log.cc:927] Time spent T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
I20260709 12:25:28.583772 25726 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:28.578226 30921 raft_consensus.cc:2804] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:28.641316 30971 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:28.643330 25801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:28.644637 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:28.645561 31275 raft_consensus.cc:3055] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:25:28.645335 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 61587.8us
I20260709 12:25:28.646857 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:28.700626 25683 raft_consensus.cc:2376] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 11. Re-sending same reply.
I20260709 12:25:28.619262 31309 consensus_queue.cc:1059] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.082s
W20260709 12:25:28.647668 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 124895us
I20260709 12:25:28.652089 31238 consensus_queue.cc:1059] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:25:28.656587 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:28.702862 25726 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:28.657846 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:28.705958 25677 raft_consensus.cc:3060] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:28.698678 25801 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:25:28.707998 25760 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48606 (request call id 1376) took 1981 ms (client timeout 2117 ms). Trace:
I20260709 12:25:28.708676 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:28.710063 25836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 3141) took 1332 ms. Trace:
I20260709 12:25:28.707717 25726 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:28.621834 31173 raft_consensus.cc:2749] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:28.621420 31218 raft_consensus.cc:2804] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:25:28.708448 25760 rpcz_store.cc:269] 0709 12:25:26.726619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:26.764981 (+ 38362us) service_pool.cc:224] Handling call
0709 12:25:28.707809 (+1942828us) spinlock_profiling.cc:243] Waited 447 ms on lock 0x7b54001a77d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:28.707936 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1027015936}
I20260709 12:25:28.659937 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:28.714928 25680 raft_consensus.cc:2410] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 15 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:25:28.666527 31323 consensus_queue.cc:1048] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:25:28.668192 31212 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.669236 31303 raft_consensus.cc:3055] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:25:28.691393 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 91184.3us
I20260709 12:25:28.693926 30921 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:28.715860 31100 raft_consensus.cc:2764] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
W20260709 12:25:28.647641 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 209485us
I20260709 12:25:28.703887 25763 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:28.658172 25831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 3135) took 1424 ms. Trace:
I20260709 12:25:28.710462 25836 rpcz_store.cc:276] 0709 12:25:27.377645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:27.377909 (+   264us) service_pool.cc:224] Handling call
0709 12:25:28.210052 (+832143us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:28.217743 (+  7691us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:28.709874 (+492131us) spinlock_profiling.cc:243] Waited 825 ms on lock 0x7b5400117450. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b608ad 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:28.710005 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1898357120}
I20260709 12:25:28.571802 31185 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:28.712857 31099 raft_consensus.cc:2804] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:28.720675 25726 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:28.704320 31275 raft_consensus.cc:740] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:28.737458 25763 raft_consensus.cc:3060] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:28.708274 31200 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.716782 31218 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:28.720120 25801 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:28.750883 25801 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:28.737387 25831 rpcz_store.cc:276] 0709 12:25:27.233719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:27.233861 (+   142us) service_pool.cc:224] Handling call
0709 12:25:28.454824 (+1220963us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:28.464113 (+  9289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:28.657940 (+193827us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b5400119250. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b608ad 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:28.658104 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2807231232}
I20260709 12:25:28.743968 25762 raft_consensus.cc:1240] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 LEADER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:28.744277 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:25:28.729436 31274 consensus_meta.cc:287] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.599s	user 0.009s	sys 0.002s
I20260709 12:25:28.736269 25800 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:28.743180 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:28.756572 25801 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:28.769147 26433 raft_consensus.cc:1240] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 12. Current term is 13. Ops: [12.11-12.11]
W20260709 12:25:28.736385 25754 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.004s	sys 0.016s
W20260709 12:25:28.731058 31257 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.099s	user 0.000s	sys 0.022s
I20260709 12:25:28.749523 25726 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:25:28.774741 25754 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.005s	sys 0.017s
I20260709 12:25:28.780758 26439 raft_consensus.cc:1275] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:25:28.735162 30921 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:28.806564 25756 raft_consensus.cc:1240] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 15. Current term is 16. Ops: []
W20260709 12:25:28.786883 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 45491us
W20260709 12:25:28.792943 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 43531.7us
I20260709 12:25:28.798434 25763 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:28.808554 25726 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:28.727080 31303 raft_consensus.cc:740] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:28.709227 31312 consensus_queue.cc:1048] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 12:25:28.746251 31099 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:28.732824 31255 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:28.803210 25681 raft_consensus.cc:1275] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 12:25:28.835891 25681 pending_rounds.cc:85] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc: Aborting all ops after (but not including) 10
I20260709 12:25:28.836242 25681 pending_rounds.cc:107] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 12:25:28.836520 25681 raft_consensus.cc:2889] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:25:28.791993 31257 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.164s	user 0.002s	sys 0.022s
I20260709 12:25:28.780045 31150 raft_consensus.cc:2804] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:28.822746 31265 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:28.781919 30971 raft_consensus.cc:2749] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:28.769407 31218 raft_consensus.cc:3060] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:28.800549 25677 raft_consensus.cc:2468] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 14.
W20260709 12:25:28.833827 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 107228us
I20260709 12:25:28.803640 31240 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.806051 31156 raft_consensus.cc:2804] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:28.806360 31256 raft_consensus.cc:2749] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:28.803309 31230 raft_consensus.cc:2749] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:28.731520 31212 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:28.834111 31099 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:28.869894 25686 raft_consensus.cc:2368] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 12. Current term is 13.
I20260709 12:25:28.781746 31200 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:28.832736 31332 raft_consensus.cc:3060] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:28.843878 31313 raft_consensus.cc:2749] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:25:28.884184 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 53735us
I20260709 12:25:28.843521 31150 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:28.861008 31166 raft_consensus.cc:3055] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:28.901204 26432 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 14.
W20260709 12:25:28.908409 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 290039us
W20260709 12:25:28.905616 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 45295.1us
I20260709 12:25:28.854184 31338 consensus_queue.cc:1059] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 12:25:28.899822 31150 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:28.868055 31240 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:28.900063 31166 raft_consensus.cc:740] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
W20260709 12:25:29.032493 31345 log.cc:927] Time spent T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
W20260709 12:25:29.081707 31334 log.cc:927] Time spent T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
W20260709 12:25:29.097911 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:29.268877 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 512372us
W20260709 12:25:29.269944 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 533781us
I20260709 12:25:29.446775 25828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 3146) took 1107 ms. Trace:
I20260709 12:25:29.447350 25800 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:25:29.449308 31204 raft_consensus.cc:2804] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:29.449904 31204 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:29.450402 31204 raft_consensus.cc:3060] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:29.270570 31358 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.452311 31358 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:29.446806 25801 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:29.455276 31118 raft_consensus.cc:2804] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:29.455680 31118 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:29.456022 31118 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:29.270468 31240 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:29.272330 31357 consensus_queue.cc:1059] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:25:29.457768 31357 raft_consensus.cc:3055] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:29.458256 31357 raft_consensus.cc:740] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:29.271760 26401 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:29.459354 31357 consensus_queue.cc:260] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:29.461143 31357 raft_consensus.cc:3060] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:29.462294 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 190585us
I20260709 12:25:29.463889 31356 raft_consensus.cc:2804] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:29.464545 31356 raft_consensus.cc:697] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 15 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:29.465368 31343 consensus_queue.cc:1059] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:29.465644 31356 consensus_queue.cc:237] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:29.469228 31343 raft_consensus.cc:3055] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:29.469802 31343 raft_consensus.cc:740] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:29.470912 31343 consensus_queue.cc:260] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:29.472671 31343 raft_consensus.cc:3060] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:29.477352 31258 consensus_queue.cc:1048] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:25:29.510300 31317 consensus_meta.cc:287] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.950s	user 0.014s	sys 0.012s
I20260709 12:25:29.510915 31200 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:29.510818 31317 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:29.511943 25757 raft_consensus.cc:1240] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 18. Current term is 19. Ops: []
W20260709 12:25:29.512087 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 64836.7us
I20260709 12:25:29.513104 25757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 3275) took 1030 ms. Trace:
I20260709 12:25:29.513499 25757 rpcz_store.cc:276] 0709 12:25:28.482811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:28.707143 (+224332us) service_pool.cc:224] Handling call
0709 12:25:28.707462 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:29.512332 (+804870us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:29.512856 (+   524us) spinlock_profiling.cc:243] Waited 804 ms on lock 0x7b54001e6754. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:29.513036 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1849664256}
W20260709 12:25:29.513715 31180 consensus_meta.cc:287] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.999s	user 0.010s	sys 0.005s
I20260709 12:25:29.514971 31180 raft_consensus.cc:2749] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:29.515403 31317 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:29.274696 26402 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:29.520906 31358 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:29.521070 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 246478us
I20260709 12:25:29.521741 31194 raft_consensus.cc:3060] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:29.522487 25763 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:29.275507 31332 raft_consensus.cc:2749] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:29.536967 25650 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:28.885052 31303 consensus_queue.cc:260] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:29.540477 25763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:53460 (request call id 2868) took 1096 ms. Trace:
W20260709 12:25:29.277997 31175 consensus_meta.cc:287] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 1.203s	user 0.013s	sys 0.006s
I20260709 12:25:29.282399 31338 consensus_queue.cc:1243] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer 5cccf20a8bff46dba6601f241d172b8a log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:25:29.540884 25763 rpcz_store.cc:276] 0709 12:25:28.432230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:28.544747 (+112517us) service_pool.cc:224] Handling call
0709 12:25:29.298024 (+753277us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b54001db0d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b58a3d 00007f5d9eb28cd0 00007f5d980ad254 00007f5d980ad1e2 00007f5d980ad111 00007f5d980ad08c 00007f5d980ac342 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:29.523089 (+225065us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":363978112}
I20260709 12:25:29.289433 31265 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 22 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:29.552798 31328 raft_consensus.cc:3055] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:29.553395 31328 raft_consensus.cc:740] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:29.290606 25686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51578 (request call id 1095) took 1162 ms. Trace:
W20260709 12:25:29.556820 25649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:29.556293 25686 rpcz_store.cc:276] 0709 12:25:28.127829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:28.239559 (+111730us) service_pool.cc:224] Handling call
0709 12:25:29.290416 (+1050857us) spinlock_profiling.cc:243] Waited 619 ms on lock 0x7b54002cf6d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:29.290549 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1422873472}
I20260709 12:25:29.294236 31166 consensus_queue.cc:260] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:29.295581 31333 log.cc:927] Time spent T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.420s	user 0.000s	sys 0.010s
I20260709 12:25:29.579071 31348 consensus_queue.cc:1059] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:29.580032 31314 consensus_queue.cc:1059] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:29.581183 31314 raft_consensus.cc:3055] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:29.581527 31314 raft_consensus.cc:740] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:29.582315 31314 consensus_queue.cc:260] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:29.301738 31254 raft_consensus.cc:3055] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:29.585673 31254 raft_consensus.cc:740] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:29.586208 25650 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:29.586594 31254 consensus_queue.cc:260] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:29.304932 25755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53460 (request call id 2854) took 1167 ms. Trace:
I20260709 12:25:29.317728 31312 raft_consensus.cc:2749] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:29.318243 31156 raft_consensus.cc:697] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
W20260709 12:25:29.317852 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 509319us
I20260709 12:25:29.588167 25755 rpcz_store.cc:276] 0709 12:25:28.137805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:28.161250 (+ 23445us) service_pool.cc:224] Handling call
0709 12:25:29.304638 (+1143388us) spinlock_profiling.cc:243] Waited 692 ms on lock 0x7b5400002654. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:29.304834 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1592443264}
I20260709 12:25:29.589406 31156 consensus_queue.cc:237] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:29.590452 31255 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:29.591138 25686 raft_consensus.cc:1275] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 12:25:29.591058 31255 consensus_queue.cc:1059] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:29.591559 25686 pending_rounds.cc:85] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc: Aborting all ops after (but not including) 12
I20260709 12:25:29.591854 25686 pending_rounds.cc:107] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 12:25:29.592062 31255 raft_consensus.cc:2804] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:29.592182 25686 raft_consensus.cc:2889] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:29.320959 31313 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.592687 31255 raft_consensus.cc:697] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 14 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:29.593075 31313 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:29.593600 31255 consensus_queue.cc:237] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:29.594547 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:29.595139 25686 raft_consensus.cc:3060] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:29.595393 31313 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:29.321532 31301 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.596165 31301 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:29.596580 31173 raft_consensus.cc:3055] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:29.597050 31173 raft_consensus.cc:740] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:29.598287 31301 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:29.360525 31130 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.599179 31130 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:29.417667 31309 raft_consensus.cc:3055] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:29.420599 25756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48606 (request call id 1385) took 1317 ms. Trace:
I20260709 12:25:29.583674 31314 raft_consensus.cc:3060] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:29.611493 25756 rpcz_store.cc:276] 0709 12:25:28.102732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:28.509818 (+407086us) service_pool.cc:224] Handling call
0709 12:25:28.513301 (+  3483us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:28.816554 (+303253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:29.420235 (+603681us) spinlock_profiling.cc:243] Waited 291 ms on lock 0x7b5400002dd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:29.420513 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":668182784}
I20260709 12:25:29.431315 25759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53474 (request call id 3262) took 1356 ms. Trace:
I20260709 12:25:28.848320 31275 consensus_queue.cc:260] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.6, Last appended by leader: 6, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:29.448987 31100 consensus_queue.cc:1048] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:25:29.515671 25761 raft_consensus.cc:1240] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:29.516520 25800 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
W20260709 12:25:29.613612 25651 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.009s	sys 0.024s
W20260709 12:25:29.613946 25651 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.009s	sys 0.024s
W20260709 12:25:29.614066 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 97697.7us
I20260709 12:25:29.615067 25800 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
W20260709 12:25:29.518546 31150 consensus_meta.cc:287] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.522s	user 0.009s	sys 0.010s
I20260709 12:25:29.616806 25686 raft_consensus.cc:2468] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 13.
I20260709 12:25:29.617903 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:29.618551 25686 raft_consensus.cc:2468] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 13.
I20260709 12:25:29.620939 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:29.616452 25800 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:29.622356 25800 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:29.623734 25726 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:25:29.522435 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 75728.4us
I20260709 12:25:29.523418 26402 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
W20260709 12:25:29.625181 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 101851us
I20260709 12:25:29.274992 31230 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
W20260709 12:25:29.524318 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 55499.6us
I20260709 12:25:29.274608 31185 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:29.447268 25828 rpcz_store.cc:276] 0709 12:25:28.339547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:28.343311 (+  3764us) service_pool.cc:224] Handling call
0709 12:25:28.343784 (+   473us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:28.375114 (+ 31330us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:25:28.417141 (+ 42027us) log.cc:844] Serialized 14 byte log entry
0709 12:25:28.639980 (+222839us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:28.652558 (+ 12578us) log.cc:844] Serialized 52 byte log entry
0709 12:25:28.652906 (+   348us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:28.665024 (+ 12118us) log.cc:844] Serialized 14 byte log entry
0709 12:25:28.674631 (+  9607us) log.cc:844] Serialized 14 byte log entry
0709 12:25:28.678593 (+  3962us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:28.680129 (+  1536us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:29.446501 (+766372us) raft_consensus.cc:1685] finished
0709 12:25:29.446529 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:29.446702 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31136,"prepare.queue_time_us":43623,"prepare.run_cpu_time_us":113,"prepare.run_wall_time_us":114,"raft.queue_time_us":40982,"raft.run_cpu_time_us":421,"raft.run_wall_time_us":6998,"thread_start_us":178415,"threads_started":1,"wal-append.queue_time_us":309836}
I20260709 12:25:29.273552 31099 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:29.636374 25834 raft_consensus.cc:1240] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:29.636653 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:29.637400 25836 raft_consensus.cc:2393] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 15: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:29.538929 31350 raft_consensus.cc:2749] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:25:29.524061 31253 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.030s	sys 0.104s
I20260709 12:25:29.286347 25681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51578 (request call id 1092) took 1235 ms. Trace:
I20260709 12:25:29.551224 25754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48606 (request call id 1379) took 1462 ms. Trace:
I20260709 12:25:29.546659 31258 consensus_queue.cc:1048] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 12:25:29.611156 31332 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.546901 31238 raft_consensus.cc:2749] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:29.576017 31352 consensus_queue.cc:1059] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:25:29.577661 31165 consensus_meta.cc:287] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 1.087s	user 0.008s	sys 0.010s
I20260709 12:25:29.597922 31173 consensus_queue.cc:260] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:29.340407 30952 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:29.604326 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:29.606455 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:29.606976 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:29.607419 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:29.653594 25677 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 9.
I20260709 12:25:29.653707 25685 raft_consensus.cc:2393] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 13: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:29.654135 25683 raft_consensus.cc:2468] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 11.
I20260709 12:25:29.610409 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:29.623674 25800 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
W20260709 12:25:29.593108 30921 consensus_meta.cc:287] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.777s	user 0.007s	sys 0.004s
I20260709 12:25:29.548730 31358 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:29.612794 25759 rpcz_store.cc:276] 0709 12:25:28.075101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:28.075248 (+   147us) service_pool.cc:224] Handling call
0709 12:25:29.431021 (+1355773us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b540005fad4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:29.431227 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2706209536}
I20260709 12:25:29.627475 25679 raft_consensus.cc:1275] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:25:29.630031 26402 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
W20260709 12:25:29.518618 31218 consensus_meta.cc:287] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.644s	user 0.007s	sys 0.002s
I20260709 12:25:29.631691 25829 raft_consensus.cc:1240] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:29.676035 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:29.638623 25757 raft_consensus.cc:1275] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:25:29.554618 31328 consensus_queue.cc:260] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:29.640733 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:29.643378 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:29.684007 25830 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Advancing to term 22
I20260709 12:25:29.684226 25758 raft_consensus.cc:3060] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:29.642927 25686 raft_consensus.cc:1275] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:25:29.641172 25681 rpcz_store.cc:276] 0709 12:25:28.050471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:28.108659 (+ 58188us) service_pool.cc:224] Handling call
0709 12:25:28.108999 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:28.837041 (+728042us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:29.286016 (+448975us) spinlock_profiling.cc:243] Waited 683 ms on lock 0x7b54001c7ad4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:29.286281 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1571717504}
I20260709 12:25:29.641748 25754 rpcz_store.cc:276] 0709 12:25:28.088719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:28.089480 (+   761us) service_pool.cc:224] Handling call
0709 12:25:28.089744 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:28.089934 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:25:28.225100 (+135166us) log.cc:844] Serialized 14 byte log entry
0709 12:25:28.800272 (+575172us) log.cc:844] Serialized 14 byte log entry
0709 12:25:29.317047 (+516775us) spinlock_profiling.cc:243] Waited 3.57 ms on lock 0x7b1800424300. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d969eec0a 00007f5da012e219 00007f5d96a76a40 00007f5d96a714e4 00007f5d96a71455 00007f5d99b59060 00007f5d99b6b716 00007f5d99b7c287 00007f5d99b7c208
0709 12:25:29.550813 (+233766us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:29.550874 (+    61us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:29.550925 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:29.550993 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:29.551160 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":502658,"prepare.queue_time_us":327293,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":76,"raft.queue_time_us":544784,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":26346,"spinlock_wait_cycles":32336896,"thread_start_us":911328,"threads_started":3,"wal-append.queue_time_us":680551}
I20260709 12:25:29.686127 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:29.686913 25681 raft_consensus.cc:2468] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 13.
I20260709 12:25:29.548295 31226 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.613219 31301 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:29.649473 31317 raft_consensus.cc:2804] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:29.644913 31354 raft_consensus.cc:2749] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:29.611397 31309 raft_consensus.cc:740] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:29.621624 31313 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:29.655035 25831 raft_consensus.cc:3060] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:29.621116 31303 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:29.659701 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:25:29.660312 31344 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.739s	user 0.009s	sys 0.024s
I20260709 12:25:29.660689 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:29.717803 26436 raft_consensus.cc:2468] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 15.
I20260709 12:25:29.661409 25756 raft_consensus.cc:1240] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:29.628567 31200 raft_consensus.cc:2749] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:25:29.640928 31253 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.030s	sys 0.105s
I20260709 12:25:29.633945 31254 raft_consensus.cc:3060] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:29.664160 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:25:29.666733 25650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:29.745339 26437 raft_consensus.cc:3060] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:29.654166 31332 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:29.633682 31343 raft_consensus.cc:2749] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:29.637247 31175 raft_consensus.cc:2749] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:29.704596 31369 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.673264 26433 raft_consensus.cc:1240] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:29.653141 31165 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:29.717195 31344 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.802s	user 0.009s	sys 0.025s
I20260709 12:25:29.634092 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:29.678274 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:29.641640 25726 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:25:29.766230 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 124685us
I20260709 12:25:29.678274 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:29.766757 31348 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.767136 26438 raft_consensus.cc:3060] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:29.676153 30921 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:29.646646 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:29.638788 31355 raft_consensus.cc:2749] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:29.648658 31323 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:29.647037 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:29.641222 31338 consensus_queue.cc:1048] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 12:25:29.701794 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
W20260709 12:25:29.704144 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 76562.3us
I20260709 12:25:29.733551 31328 raft_consensus.cc:3060] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:29.683162 31358 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:29.726336 31317 raft_consensus.cc:697] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 13 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:29.716070 31367 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.746047 31354 raft_consensus.cc:2749] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:29.626993 31150 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:29.719702 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:29.638888 31230 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:29.695770 31226 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:29.682760 31238 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.737926 25831 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 13.
I20260709 12:25:29.742053 25758 raft_consensus.cc:2468] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 13.
I20260709 12:25:29.744473 25830 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 22.
I20260709 12:25:29.725340 31313 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:29.706746 31359 consensus_queue.cc:1059] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.070s
I20260709 12:25:29.708498 31350 raft_consensus.cc:2804] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:29.673239 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:25:29.763701 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 137658us
I20260709 12:25:29.625284 31274 consensus_queue.cc:1059] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 15.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:25:29.672763 30952 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:29.771488 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 147876us
I20260709 12:25:29.832878 25800 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:29.833029 31165 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:29.833765 30952 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:29.772692 26435 raft_consensus.cc:2468] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 13.
I20260709 12:25:29.837314 31313 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:29.840045 31342 log.cc:927] Time spent T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.873s	user 0.007s	sys 0.004s
I20260709 12:25:29.774587 26437 raft_consensus.cc:2468] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 13.
I20260709 12:25:29.843127 25680 raft_consensus.cc:2468] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 14.
W20260709 12:25:29.843950 31351 log.cc:927] Time spent T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.565s	user 0.002s	sys 0.000s
I20260709 12:25:29.775697 26432 raft_consensus.cc:3060] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:29.845566 31313 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.846086 31313 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:29.682354 31218 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:29.780339 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 150365us
I20260709 12:25:29.848764 31099 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:29.712580 26434 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:25:29.848995 26402 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:29.850070 31218 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:29.850288 26402 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:29.851416 25755 raft_consensus.cc:1240] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:29.852108 31258 raft_consensus.cc:2804] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:29.852509 31258 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:29.852854 31258 raft_consensus.cc:3060] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:29.853169 31230 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:29.783867 25726 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:29.775027 31369 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:29.853914 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 70118.8us
I20260709 12:25:29.854964 25726 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:29.855458 31373 raft_consensus.cc:2749] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:29.784616 31364 consensus_queue.cc:1048] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:29.856575 31317 consensus_queue.cc:237] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:29.857236 31156 raft_consensus.cc:2804] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:29.857784 31156 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:29.858186 31156 raft_consensus.cc:3060] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:29.644464 31312 consensus_queue.cc:1048] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 12:25:29.789896 25686 raft_consensus.cc:3060] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:29.798322 26438 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 13.
I20260709 12:25:29.703326 31301 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:29.766392 31200 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:29.765739 31212 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:29.770699 31196 raft_consensus.cc:2804] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:29.731540 31100 consensus_queue.cc:1059] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 12:25:29.809140 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:29.801244 25649 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:25:29.894884 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 93721.7us
I20260709 12:25:29.813189 25682 raft_consensus.cc:3060] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:29.799680 31259 consensus_meta.cc:287] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 1.296s	user 0.010s	sys 0.008s
W20260709 12:25:29.820402 31366 log.cc:927] Time spent T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
W20260709 12:25:29.821678 31365 log.cc:927] Time spent T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
I20260709 12:25:29.908747 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:29.909343 25755 raft_consensus.cc:2468] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 17.
I20260709 12:25:29.889356 31218 raft_consensus.cc:2804] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:29.923103 31218 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:29.923519 31218 raft_consensus.cc:3060] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:29.824787 31118 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:29.800181 31367 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:29.831178 31226 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:29.848148 31313 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:29.851593 26402 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:29.861558 25800 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:29.867285 26434 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 22.
I20260709 12:25:29.875027 26432 raft_consensus.cc:2468] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 11.
W20260709 12:25:29.876366 25650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:29.860937 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 45838.8us
I20260709 12:25:29.770982 31348 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:29.859830 31130 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:29.822748 31363 log.cc:927] Time spent T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
I20260709 12:25:29.911697 25649 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:29.813213 31238 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:29.889318 31099 consensus_queue.cc:1048] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 12:25:29.908402 31259 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:29.919268 31204 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:29.889235 30952 raft_consensus.cc:2749] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:25:29.928779 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 77245us
I20260709 12:25:29.894001 31200 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:29.785483 31309 consensus_queue.cc:260] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:29.893754 31196 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:29.931771 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:29.949626 25830 raft_consensus.cc:2393] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 18: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:29.905599 31254 consensus_queue.cc:1059] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:25:29.937057 31343 raft_consensus.cc:2804] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:29.934651 25682 raft_consensus.cc:2468] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 12.
I20260709 12:25:29.790489 31323 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:29.917577 25686 raft_consensus.cc:2468] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 14.
I20260709 12:25:29.936930 25801 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:29.933095 31226 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
W20260709 12:25:29.959951 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 285952us
I20260709 12:25:29.941743 25680 raft_consensus.cc:1240] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:29.947198 26402 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:29.961769 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:29.962352 26434 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:29.962867 26402 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
W20260709 12:25:29.933863 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 72382.7us
I20260709 12:25:29.902638 31370 raft_consensus.cc:2804] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:29.902315 31362 consensus_queue.cc:1059] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 15.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:25:29.937920 31355 raft_consensus.cc:2749] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:25:29.938681 25677 raft_consensus.cc:1240] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:29.948434 31376 raft_consensus.cc:3055] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:29.958640 25831 raft_consensus.cc:1240] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:29.964579 26432 raft_consensus.cc:1240] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:25:29.978989 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:29.964792 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:29.949971 31196 raft_consensus.cc:3060] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:29.970197 26402 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:29.971444 26434 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 17.
I20260709 12:25:30.007314 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:25:29.968058 31340 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.003s	sys 0.024s
W20260709 12:25:30.009872 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:30.020031 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:25:30.018095 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 84706.9us
W20260709 12:25:30.028944 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:29.964730 31130 raft_consensus.cc:2749] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:25:30.035358 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 53166.1us
W20260709 12:25:30.036227 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:29.968827 31230 raft_consensus.cc:2804] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:25:30.037993 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 67863.8us
I20260709 12:25:29.937574 31258 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:30.042712 26402 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:29.981701 31332 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:29.960541 31343 raft_consensus.cc:697] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 13 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
W20260709 12:25:30.035080 31340 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.003s	sys 0.025s
I20260709 12:25:29.978566 31376 raft_consensus.cc:740] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:29.986593 31338 raft_consensus.cc:2749] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:25:30.154989 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 112246us
I20260709 12:25:29.966914 31226 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:30.121821 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 72565.4us
I20260709 12:25:29.973042 31312 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.034755 31362 consensus_queue.cc:1243] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Peer 6e673265293d4e9a937dc45150aeb1b8 log is divergent from this leader: its last log entry 16.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 12:25:30.048718 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 137093us
W20260709 12:25:30.046306 31356 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.026s	sys 0.029s
I20260709 12:25:30.044834 31150 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:30.163388 31312 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:30.141323 31387 raft_consensus.cc:2749] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:30.147967 31099 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.186772 26438 raft_consensus.cc:1275] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:25:30.174790 31375 log.cc:927] Time spent T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 12:25:30.046370 30921 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:30.177752 31367 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:30.046042 31355 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.019719 31165 consensus_queue.cc:1059] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.142s
I20260709 12:25:30.201787 31355 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:30.202239 31165 raft_consensus.cc:3055] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:30.202679 31165 raft_consensus.cc:740] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:30.115864 31350 raft_consensus.cc:697] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 10 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:30.176935 31376 consensus_queue.cc:260] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:30.204366 31259 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:30.005309 31344 consensus_queue.cc:1048] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.136s
I20260709 12:25:30.019883 30952 consensus_queue.cc:1048] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.128s
I20260709 12:25:30.050091 31368 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.164884 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:30.237370 25760 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:30.166123 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:30.040833 31357 consensus_meta.cc:287] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.579s	user 0.016s	sys 0.006s
I20260709 12:25:30.037900 31194 consensus_queue.cc:1048] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.117s
W20260709 12:25:30.172454 31374 log.cc:927] Time spent T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
I20260709 12:25:30.164886 31255 raft_consensus.cc:3055] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:25:30.173075 31356 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.027s	sys 0.029s
I20260709 12:25:30.178383 31369 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:30.173965 31340 raft_consensus.cc:2749] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:30.184417 31099 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:30.169710 31212 raft_consensus.cc:2749] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:30.171826 31370 raft_consensus.cc:697] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 13 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:30.181798 31200 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:30.206264 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:30.156867 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:30.181134 31312 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:30.236465 31348 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:30.248212 31355 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:30.246868 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:30.301471 25686 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:30.247357 25649 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:25:30.303530 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 56274.6us
I20260709 12:25:30.251075 25685 raft_consensus.cc:1275] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:25:30.305649 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:30.306444 25685 raft_consensus.cc:2468] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 15.
I20260709 12:25:30.307422 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:30.205751 31301 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:30.261533 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 49895us
I20260709 12:25:30.248342 31194 consensus_queue.cc:1243] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer 6e673265293d4e9a937dc45150aeb1b8 log is divergent from this leader: its last log entry 15.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:25:30.204748 31350 consensus_queue.cc:237] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:30.262225 25678 raft_consensus.cc:1275] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:25:30.272967 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:30.255049 31204 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:30.258855 31238 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:30.261395 31259 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.261641 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:25:30.281564 31379 log.cc:927] Time spent T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:25:30.282920 31196 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:30.203629 31165 consensus_queue.cc:260] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:30.273006 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:30.263152 25760 raft_consensus.cc:2468] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 18.
I20260709 12:25:30.328540 25686 raft_consensus.cc:2468] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 18.
I20260709 12:25:30.329190 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:30.265270 31099 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:30.249377 31255 raft_consensus.cc:740] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:30.308707 25650 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:30.300110 31323 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:30.335081 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:30.319020 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 276366us
I20260709 12:25:30.335620 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:30.336179 25758 raft_consensus.cc:3060] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:30.336237 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:30.286952 31226 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:30.321923 31355 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.268524 31352 consensus_queue.cc:1059] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 12:25:30.323133 25680 raft_consensus.cc:2468] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 10.
I20260709 12:25:30.266582 25763 raft_consensus.cc:2468] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 15.
I20260709 12:25:30.264580 31393 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:30.264422 31200 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:30.310654 25685 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:30.316601 31387 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.336930 26402 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:30.354245 31156 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:30.264309 31314 consensus_meta.cc:287] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.630s	user 0.003s	sys 0.008s
I20260709 12:25:30.356303 31156 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:30.357213 31395 raft_consensus.cc:2764] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 22 FOLLOWER]: Leader election decision vote started in defunct term 21: won
W20260709 12:25:30.358114 31382 log.cc:927] Time spent T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:25:30.339094 25760 raft_consensus.cc:1240] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:30.338356 25650 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:30.205443 31391 consensus_queue.cc:1059] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.143s
I20260709 12:25:30.348706 31355 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:30.361166 31200 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:30.362514 31355 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:30.280642 31384 log.cc:927] Time spent T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:25:30.324010 31204 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:30.329077 31348 raft_consensus.cc:2764] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 12:25:30.255291 31343 consensus_queue.cc:237] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:30.323143 31230 raft_consensus.cc:697] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 14 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:30.363298 31200 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:30.330449 31259 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:30.385258 31230 consensus_queue.cc:237] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:30.385936 31259 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:30.386878 31218 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:30.388025 31255 consensus_queue.cc:260] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:30.388993 31218 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:30.365275 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:30.389225 31255 raft_consensus.cc:3060] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:30.366308 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:30.367817 25685 raft_consensus.cc:2468] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 12.
I20260709 12:25:30.368731 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:30.393362 25829 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 14.
I20260709 12:25:30.371546 25758 raft_consensus.cc:2468] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 14.
I20260709 12:25:30.376951 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:30.397578 26439 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 16.
I20260709 12:25:30.377159 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:30.398445 25834 raft_consensus.cc:2468] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 15.
I20260709 12:25:30.378607 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:30.379371 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:30.399669 25830 raft_consensus.cc:2468] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 10.
I20260709 12:25:30.379568 25762 raft_consensus.cc:1240] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 18. Current term is 19. Ops: []
I20260709 12:25:30.352743 31390 raft_consensus.cc:2804] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:30.399834 25833 raft_consensus.cc:2468] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 13.
I20260709 12:25:30.379992 26402 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:30.376642 31204 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:30.382232 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:30.382722 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:30.382788 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:30.383391 31196 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:30.390009 26434 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 14.
I20260709 12:25:30.365926 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:25:30.390241 31314 consensus_queue.cc:1175] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6e673265293d4e9a937dc45150aeb1b8" responder_term: 11 status { last_received { term: 10 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 10. Current term is 11. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:25:30.392161 26430 raft_consensus.cc:2393] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 13: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:30.361259 31370 consensus_queue.cc:237] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:30.448674 31390 raft_consensus.cc:697] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 13 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:30.452080 31399 raft_consensus.cc:2804] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:25:30.452698 31399 raft_consensus.cc:697] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 22 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:30.452517 31390 consensus_queue.cc:237] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:30.453557 31399 consensus_queue.cc:237] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:30.469836 31204 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:30.415501 25649 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:30.360558 31393 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:30.253082 31368 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:30.360044 31387 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:30.504441 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 89061.4us
W20260709 12:25:30.529381 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 149485us
I20260709 12:25:30.567425 25836 raft_consensus.cc:2468] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 15.
I20260709 12:25:30.569067 26402 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:30.553403 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:30.554257 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:30.555205 25832 raft_consensus.cc:1275] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 20 index: 18. (index mismatch)
I20260709 12:25:30.555157 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:30.570729 25829 raft_consensus.cc:2410] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:25:30.570840 25837 raft_consensus.cc:2393] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 13: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:30.560932 25828 raft_consensus.cc:1275] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 12:25:30.571238 25828 pending_rounds.cc:85] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a: Aborting all ops after (but not including) 10
I20260709 12:25:30.561183 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:30.571429 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:30.572245 25833 raft_consensus.cc:2393] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 15: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:30.572781 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:30.573066 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:30.573664 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:30.574373 25830 raft_consensus.cc:2393] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 15: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
W20260709 12:25:30.562422 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 195648us
I20260709 12:25:30.575464 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:30.575627 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:30.571512 25828 pending_rounds.cc:107] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 12:25:30.576856 25828 raft_consensus.cc:2889] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:25:30.576310 25650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:30.577648 25650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:30.579015 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:30.576062 25829 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 9.
I20260709 12:25:30.580428 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:30.580931 25834 raft_consensus.cc:3055] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:30.581188 25834 raft_consensus.cc:740] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:30.581274 25835 raft_consensus.cc:2393] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 14: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:30.582355 25833 raft_consensus.cc:1275] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:25:30.582644 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:30.583184 25830 raft_consensus.cc:3060] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:30.584020 26402 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:30.588680 25830 raft_consensus.cc:2468] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 16.
I20260709 12:25:30.582674 25832 raft_consensus.cc:1275] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 15 index: 6. Preceding OpId from leader: term: 16 index: 7. (index mismatch)
I20260709 12:25:30.589509 25650 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
W20260709 12:25:30.590045 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:30.568323 31204 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.592047 31204 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:30.594084 31204 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:30.595989 25758 raft_consensus.cc:1240] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:30.596124 25833 raft_consensus.cc:1275] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:25:30.596321 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:30.597514 25833 raft_consensus.cc:1275] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:25:30.597401 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:30.598645 25760 raft_consensus.cc:2393] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 11: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:30.600292 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:30.601217 31368 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:30.560632 31389 raft_consensus.cc:2804] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:30.601912 31389 raft_consensus.cc:697] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 14 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:30.602962 31389 consensus_queue.cc:237] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:30.605470 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:30.606694 31393 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:30.609093 25760 pending_rounds.cc:85] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 12
I20260709 12:25:30.609431 25760 pending_rounds.cc:107] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 12:25:30.609669 25760 raft_consensus.cc:2889] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:30.610837 31358 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:30.611527 31395 raft_consensus.cc:2749] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:30.605523 25762 raft_consensus.cc:1240] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 13. Current term is 14. Ops: [11.7-13.8]
I20260709 12:25:30.612246 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:30.560639 31212 raft_consensus.cc:2749] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:30.614248 25830 raft_consensus.cc:1240] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:25:30.615366 25650 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:30.614926 25800 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:30.618044 25800 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:30.618332 26402 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:30.619896 30884 raft_consensus.cc:2749] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:30.620867 31200 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.621192 26402 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:30.621537 31200 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:30.622260 30884 raft_consensus.cc:2804] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:30.622959 30884 raft_consensus.cc:697] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 15 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:30.624361 31200 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:30.624228 30884 consensus_queue.cc:237] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:30.581889 25834 consensus_queue.cc:260] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:30.618625 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:30.629529 25800 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:30.626413 26402 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:30.641160 25650 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:30.643698 26402 leader_election.cc:400] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 election: Vote denied by peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) with higher term. Message: Invalid argument: T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 12. Current term is 13.
I20260709 12:25:30.644084 26402 leader_election.cc:403] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:25:30.626353 31259 raft_consensus.cc:2749] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:30.645180 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:30.626183 31395 raft_consensus.cc:2749] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:30.646471 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:30.646780 25758 raft_consensus.cc:2393] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 16: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
W20260709 12:25:30.648564 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:30.660944 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:30.659873 25757 raft_consensus.cc:2468] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 12.
I20260709 12:25:30.663164 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:30.664129 25762 raft_consensus.cc:2393] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 16: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:30.643071 31350 raft_consensus.cc:2749] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:30.656293 31340 raft_consensus.cc:2749] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) with higher term. Message: Invalid argument: T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 12. Current term is 13.
I20260709 12:25:30.656817 31194 consensus_queue.cc:1059] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:30.657577 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:30.646890 31204 raft_consensus.cc:2804] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:30.658077 31401 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.630198 31200 raft_consensus.cc:2804] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:30.649499 25650 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:30.649938 25830 raft_consensus.cc:1240] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:30.665253 25800 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:30.643224 31255 raft_consensus.cc:2804] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:30.646744 31391 raft_consensus.cc:2804] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:30.642616 31212 consensus_queue.cc:1048] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:25:30.669598 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:30.668555 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:30.674491 25650 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:30.678328 26433 raft_consensus.cc:2393] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 13: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:30.645135 31130 consensus_queue.cc:1048] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 12:25:30.678505 25650 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:30.647241 31358 consensus_queue.cc:1059] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 12:25:30.681679 25650 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:30.682825 31200 raft_consensus.cc:697] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 18 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:30.683681 31200 consensus_queue.cc:237] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:30.685225 31275 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:30.670948 31204 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:30.695616 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:30.661633 31400 consensus_queue.cc:1059] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:25:30.677423 31391 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:30.665853 31323 consensus_queue.cc:1048] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 12:25:30.699469 25650 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:30.712458 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:25:30.713465 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:30.728489 26433 raft_consensus.cc:2393] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 13: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:30.680540 31194 raft_consensus.cc:2804] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:30.678934 31226 raft_consensus.cc:2804] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:30.738309 31194 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:30.738456 31226 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:30.738823 31194 raft_consensus.cc:3060] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:30.739069 31226 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:30.675889 31401 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:30.741997 31401 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:30.727020 25833 raft_consensus.cc:1240] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:30.745419 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:30.676120 31255 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:30.728914 25835 raft_consensus.cc:1240] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 14 LEADER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:30.746378 26436 raft_consensus.cc:2468] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 15.
W20260709 12:25:30.736515 31405 log.cc:927] Time spent T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:25:30.737756 31387 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:30.748116 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:30.696239 31259 raft_consensus.cc:2804] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:30.747769 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:30.751102 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 51754.2us
I20260709 12:25:30.698377 31204 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:30.764632 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:30.687208 31390 raft_consensus.cc:2804] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:30.776211 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:30.753050 25833 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 20.
I20260709 12:25:30.710681 31377 raft_consensus.cc:2804] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:30.755036 31259 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:30.754920 31344 consensus_queue.cc:1059] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.005s
I20260709 12:25:30.727965 31391 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:30.786001 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:30.758044 31380 raft_consensus.cc:2804] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:30.831697 25680 raft_consensus.cc:1240] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 11. Current term is 12. Ops: [9.9-11.10]
I20260709 12:25:30.820789 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:30.832907 25678 raft_consensus.cc:1240] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 13. Current term is 14. Ops: [11.12-13.13]
I20260709 12:25:30.750504 31340 consensus_queue.cc:1059] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 12:25:30.750298 31350 consensus_queue.cc:1048] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 12:25:30.748664 31255 raft_consensus.cc:3060] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:30.747980 31130 consensus_queue.cc:1048] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 12:25:30.756968 31401 raft_consensus.cc:3055] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:30.854707 31401 raft_consensus.cc:740] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:30.856807 25830 raft_consensus.cc:1275] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:25:30.836526 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:30.859086 25835 raft_consensus.cc:1275] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:25:30.859393 31361 raft_consensus.cc:3055] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:30.859808 31361 raft_consensus.cc:740] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:30.763738 31389 consensus_queue.cc:1059] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.075s
I20260709 12:25:30.861583 25756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48606 (request call id 1387) took 1225 ms. Trace:
I20260709 12:25:30.784642 31369 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.861951 25756 rpcz_store.cc:276] 0709 12:25:29.636021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:29.636214 (+   193us) service_pool.cc:224] Handling call
0709 12:25:29.652835 (+ 16621us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:29.719131 (+ 66296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:30.861373 (+1142242us) spinlock_profiling.cc:243] Waited 8.32 ms on lock 0x7b54001004d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:30.861528 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19142528}
I20260709 12:25:30.862234 31369 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:30.863468 31173 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:30.807524 31387 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.864292 31387 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:30.864614 31369 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:30.866643 25682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40230 (request call id 1883) took 1260 ms. Trace:
I20260709 12:25:30.867066 25682 rpcz_store.cc:276] 0709 12:25:29.606505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:29.606743 (+   238us) service_pool.cc:224] Handling call
0709 12:25:30.866464 (+1259721us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b5400233554. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:30.866580 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":365748608}
I20260709 12:25:30.764047 31357 consensus_queue.cc:1059] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.068s
I20260709 12:25:30.868551 31340 raft_consensus.cc:3055] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:30.868695 31357 consensus_queue.cc:1243] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer 5cccf20a8bff46dba6601f241d172b8a log is divergent from this leader: its last log entry 14.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:25:30.868984 31340 raft_consensus.cc:740] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:30.869344 31357 raft_consensus.cc:3055] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:30.869736 31357 raft_consensus.cc:740] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:30.869969 31361 consensus_queue.cc:260] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:30.870613 31357 consensus_queue.cc:260] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:30.871495 31361 raft_consensus.cc:3060] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:30.789147 31377 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:30.849519 31253 raft_consensus.cc:3055] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:30.862615 25761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 3281) took 1948 ms. Trace:
I20260709 12:25:30.891163 25761 rpcz_store.cc:276] 0709 12:25:28.914201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:28.914437 (+   236us) service_pool.cc:224] Handling call
0709 12:25:28.914842 (+   405us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:29.613649 (+698807us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:30.862384 (+1248735us) spinlock_profiling.cc:243] Waited 601 ms on lock 0x7b54000983d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:30.862556 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1381351168}
I20260709 12:25:30.892584 26433 raft_consensus.cc:2468] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 13.
W20260709 12:25:30.848119 31339 log.cc:927] Time spent T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 1.554s	user 0.008s	sys 0.012s
I20260709 12:25:30.846163 25754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48606 (request call id 1392) took 1201 ms. Trace:
I20260709 12:25:30.896381 25754 rpcz_store.cc:276] 0709 12:25:29.645147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:29.685781 (+ 40634us) service_pool.cc:224] Handling call
0709 12:25:29.686112 (+   331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:29.903589 (+217477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:29.903618 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:29.903665 (+    47us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:29.903694 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:30.845859 (+942165us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b54001dbfd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:30.845924 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:30.846100 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":499707776}
I20260709 12:25:30.809849 31259 raft_consensus.cc:3060] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:30.883136 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:30.866447 31387 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:30.893349 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:30.871706 31357 raft_consensus.cc:3060] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:30.833515 31390 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:30.934067 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:30.903611 25677 raft_consensus.cc:2468] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 11.
I20260709 12:25:30.937597 26433 raft_consensus.cc:2376] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 11. Re-sending same reply.
I20260709 12:25:30.843811 31380 raft_consensus.cc:697] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 15 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
W20260709 12:25:30.895308 31335 log.cc:927] Time spent T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 1.619s	user 0.006s	sys 0.016s
I20260709 12:25:30.926944 25681 raft_consensus.cc:1275] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 15 index: 6. Preceding OpId from leader: term: 16 index: 7. (index mismatch)
I20260709 12:25:30.944420 25832 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 15.
W20260709 12:25:30.895218 31347 log.cc:927] Time spent T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 1.626s	user 0.017s	sys 0.019s
W20260709 12:25:30.898432 31360 log.cc:927] Time spent T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 1.597s	user 0.020s	sys 0.010s
I20260709 12:25:30.891098 31253 raft_consensus.cc:740] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:30.891255 31377 raft_consensus.cc:3060] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:30.895169 31409 log.cc:927] Time spent T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.080s	user 0.000s	sys 0.003s
I20260709 12:25:30.966183 31204 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:30.869926 31340 consensus_queue.cc:260] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:30.957592 31401 consensus_queue.cc:260] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:30.972240 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:30.953711 31390 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:30.930523 31358 consensus_queue.cc:1059] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.074s
I20260709 12:25:30.973348 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:30.976099 31226 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:30.957989 31391 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:30.981303 31380 consensus_queue.cc:237] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:30.957166 31303 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.988736 31253 consensus_queue.cc:260] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:30.894815 31314 consensus_queue.cc:1059] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 12:25:31.013020 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:25:31.004015 31320 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.558s	user 0.017s	sys 0.077s
I20260709 12:25:31.016880 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:31.018069 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:31.022460 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:31.024375 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:25:31.020437 31320 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.576s	user 0.017s	sys 0.078s
I20260709 12:25:31.025324 26434 raft_consensus.cc:2468] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 11.
I20260709 12:25:31.014652 31368 raft_consensus.cc:2749] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:31.019862 31340 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:31.032436 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:31.026113 31253 raft_consensus.cc:3060] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:31.008054 31259 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:31.012557 31303 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:31.020503 31194 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:31.049347 31391 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:31.049764 31411 log.cc:927] Time spent T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.289s	user 0.001s	sys 0.000s
I20260709 12:25:31.016098 31255 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:31.053442 31255 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:31.054440 31259 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:31.054802 31341 log.cc:927] Time spent T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 2.128s	user 0.003s	sys 0.023s
I20260709 12:25:31.069794 31376 raft_consensus.cc:3060] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:31.072736 31346 log.cc:927] Time spent T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 1.777s	user 0.009s	sys 0.023s
I20260709 12:25:31.074692 31226 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:31.082316 31377 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:31.085434 31390 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:31.088027 31330 log.cc:927] Time spent T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 1.808s	user 0.006s	sys 0.021s
I20260709 12:25:31.089360 31390 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:31.090447 31378 log.cc:927] Time spent T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 1.310s	user 0.009s	sys 0.007s
I20260709 12:25:31.091337 31355 raft_consensus.cc:3055] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:31.091603 31377 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:31.091882 31355 raft_consensus.cc:740] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:31.093079 31355 consensus_queue.cc:260] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:31.094695 31355 raft_consensus.cc:3060] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:31.086803 31265 raft_consensus.cc:3055] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:25:31.097826 31265 raft_consensus.cc:740] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:31.098855 31265 consensus_queue.cc:260] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:31.101454 31337 log.cc:927] Time spent T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 1.824s	user 0.008s	sys 0.025s
W20260709 12:25:31.102949 31372 log.cc:927] Time spent T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 1.346s	user 0.000s	sys 0.012s
I20260709 12:25:31.153470 25684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51578 (request call id 1093) took 3026 ms. Trace:
I20260709 12:25:31.154608 25684 rpcz_store.cc:276] 0709 12:25:28.127026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:28.544064 (+417038us) service_pool.cc:224] Handling call
0709 12:25:28.544337 (+   273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:28.560554 (+ 16217us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:28.560595 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:28.561061 (+   466us) log.cc:844] Serialized 26 byte log entry
0709 12:25:28.742046 (+180985us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:28.870801 (+128755us) log.cc:844] Serialized 14 byte log entry
0709 12:25:28.872679 (+  1878us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:28.872783 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:31.038382 (+2165599us) spinlock_profiling.cc:243] Waited 4.28 ms on lock 0x7b4400022b4c. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db 00007f5d99708aaf 00007f5d996fc86e 00007f5d996fbbb6 00007f5d996fb7d8 00007f5d99705221 00007f5d997051d9 00007f5d99705169
0709 12:25:31.152294 (+113912us) raft_consensus.cc:1685] finished
0709 12:25:31.152553 (+   259us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:31.153093 (+   540us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":553796,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":11219,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":13572,"spinlock_wait_cycles":9840000,"thread_start_us":264252,"threads_started":2,"wal-append.queue_time_us":307845}
I20260709 12:25:31.160629 25685 raft_consensus.cc:2393] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 15: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
W20260709 12:25:31.172659 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:31.181351 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:31.181473 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:31.183811 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:31.183840 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:31.185057 26433 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:31.186094 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:31.187002 26434 raft_consensus.cc:3060] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:25:31.192167 25650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:31.034099 26439 raft_consensus.cc:2468] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 15.
I20260709 12:25:31.194572 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:31.196580 31194 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:31.199904 31303 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:31.200335 31196 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:31.201123 31303 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.201349 31196 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:31.202119 31303 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:31.205837 31204 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:31.195745 26439 raft_consensus.cc:2393] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 13: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:31.085317 31258 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:31.244395 31265 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:31.246052 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:31.247502 25760 raft_consensus.cc:2393] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 16: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:31.243464 26430 raft_consensus.cc:2468] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 16.
W20260709 12:25:31.266682 31349 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.961s	user 0.016s	sys 0.016s
I20260709 12:25:31.267028 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:25:31.267356 31349 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.975s	user 0.017s	sys 0.017s
I20260709 12:25:31.268589 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:31.268702 31196 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:31.269366 26439 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:31.272485 25831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 3164) took 1341 ms. Trace:
I20260709 12:25:31.272946 25831 rpcz_store.cc:276] 0709 12:25:29.931340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:29.931446 (+   106us) service_pool.cc:224] Handling call
0709 12:25:29.931807 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:29.978700 (+ 46893us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:31.271940 (+1293240us) spinlock_profiling.cc:243] Waited 26.6 ms on lock 0x7b54002f5654. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:31.272286 (+   346us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61139456}
I20260709 12:25:31.276981 31303 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:31.287099 25801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:31.287453 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:31.292124 31274 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:31.293195 31274 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:31.296335 31364 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.297187 31364 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:31.297349 31196 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.298480 31196 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:31.299130 26436 raft_consensus.cc:1275] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 20 index: 18. (index mismatch)
I20260709 12:25:31.304194 31118 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:31.310738 26434 raft_consensus.cc:2468] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 16.
I20260709 12:25:31.315101 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:31.317142 25761 raft_consensus.cc:2393] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 12: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:31.318572 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:31.319518 25759 raft_consensus.cc:2468] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 15.
I20260709 12:25:31.325826 31196 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:31.328665 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:31.329414 25756 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 16.
I20260709 12:25:31.330907 25834 raft_consensus.cc:3060] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:31.328538 25828 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "819272169f6f4293b6e279793be58b49"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "f82778701b464892aab92a752ed7ffdc"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:25:31.337992 25828 raft_consensus.cc:606] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 15 LEADER]: Received request to transfer leadership to TS f82778701b464892aab92a752ed7ffdc
I20260709 12:25:31.338093 25650 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:31.340503 31255 raft_consensus.cc:2804] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:31.341048 31255 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:31.341496 31255 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:31.345988 25763 raft_consensus.cc:1275] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:25:31.348423 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:31.359730 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:31.364568 25681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40230 (request call id 1888) took 1744 ms. Trace:
I20260709 12:25:31.365002 25681 rpcz_store.cc:276] 0709 12:25:29.620460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:29.687685 (+ 67225us) service_pool.cc:224] Handling call
0709 12:25:29.690151 (+  2466us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:30.954771 (+1264620us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:31.364090 (+409319us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b5400232654. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:31.364375 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2843526528}
I20260709 12:25:31.365474 25763 raft_consensus.cc:1240] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:31.350660 31274 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:31.369040 31309 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:31.369690 26434 raft_consensus.cc:1275] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:25:31.370249 26433 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 17.
I20260709 12:25:31.371101 26432 raft_consensus.cc:1240] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:31.371207 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:31.372198 26434 raft_consensus.cc:2468] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 13.
I20260709 12:25:31.394441 26438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 1349) took 1432 ms. Trace:
I20260709 12:25:31.394920 26438 rpcz_store.cc:276] 0709 12:25:29.962177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:29.969656 (+  7479us) service_pool.cc:224] Handling call
0709 12:25:29.970034 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:30.188251 (+218217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:31.393962 (+1205711us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b540078ebd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:31.394256 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":497359744}
I20260709 12:25:31.395494 26434 raft_consensus.cc:1240] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:31.398054 31165 raft_consensus.cc:3060] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:31.372347 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:31.402037 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:31.402242 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:31.402809 25829 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:31.373653 25758 raft_consensus.cc:1275] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:25:31.374107 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:31.404330 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:31.405030 25828 raft_consensus.cc:3060] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:31.405356 26430 raft_consensus.cc:2410] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:25:31.376843 26437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 1350) took 1414 ms. Trace:
I20260709 12:25:31.406374 26437 rpcz_store.cc:276] 0709 12:25:29.962482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:29.964034 (+  1552us) service_pool.cc:224] Handling call
0709 12:25:29.964414 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:29.982080 (+ 17666us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:29.982140 (+    60us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:29.982201 (+    61us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:29.982247 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:31.376365 (+1394118us) spinlock_profiling.cc:243] Waited 17.4 ms on lock 0x7b54006f3bd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:31.376451 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:31.376652 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40068736}
I20260709 12:25:31.377810 31166 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:31.382802 31196 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.408295 31196 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:31.411473 31196 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:31.412299 26432 raft_consensus.cc:1275] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 22 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:25:31.418524 31361 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.403708 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:31.388468 31364 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:31.419225 31361 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:31.419263 25829 raft_consensus.cc:2468] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 16.
I20260709 12:25:31.433578 31255 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:31.435205 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:31.436849 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:31.437565 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 117637us
I20260709 12:25:31.462729 31255 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:31.463052 26438 raft_consensus.cc:1275] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:25:31.464653 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:31.390681 31401 raft_consensus.cc:3060] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:31.440593 31329 consensus_queue.cc:1059] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:31.467447 26438 raft_consensus.cc:1275] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:25:31.469198 26438 raft_consensus.cc:1275] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:25:31.444482 25683 raft_consensus.cc:1240] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 12:25:31.446748 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:31.447954 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:31.448180 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:31.473349 26430 raft_consensus.cc:2468] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 14.
I20260709 12:25:31.449486 25837 raft_consensus.cc:2468] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 12.
I20260709 12:25:31.446796 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:25:31.452932 26435 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36508 (request call id 1351) took 1490 ms (client timeout 1820 ms). Trace:
I20260709 12:25:31.475127 25650 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
W20260709 12:25:31.475394 26435 rpcz_store.cc:269] 0709 12:25:29.962793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:29.964583 (+  1790us) service_pool.cc:224] Handling call
0709 12:25:31.452372 (+1487789us) spinlock_profiling.cc:243] Waited 400 ms on lock 0x7b54007d5ad4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:31.452665 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":920781696}
I20260709 12:25:31.449642 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:31.476282 31255 raft_consensus.cc:2804] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:31.476739 26434 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 15.
I20260709 12:25:31.473531 26433 raft_consensus.cc:2393] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 16: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:31.477226 31255 raft_consensus.cc:697] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 11 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:31.477306 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:31.478922 31255 consensus_queue.cc:237] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:31.480883 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:31.481711 25837 raft_consensus.cc:2468] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 16.
I20260709 12:25:31.481884 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:31.482558 25833 raft_consensus.cc:2468] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 15.
I20260709 12:25:31.483058 25829 raft_consensus.cc:1275] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:25:31.487123 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:31.488040 25833 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:25:31.501971 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:31.503015 25755 raft_consensus.cc:3060] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:25:31.505728 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:31.506716 25763 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:31.525480 31166 consensus_queue.cc:1048] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:31.528869 25650 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:31.545120 31361 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:31.556529 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:31.560258 25761 raft_consensus.cc:2468] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 14.
I20260709 12:25:31.559404 25758 raft_consensus.cc:1275] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:25:31.558097 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:31.565148 25679 raft_consensus.cc:1275] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:25:31.568573 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:31.572422 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:31.573588 25683 raft_consensus.cc:2468] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 17.
I20260709 12:25:31.575237 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:31.576275 25681 raft_consensus.cc:2468] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 13.
I20260709 12:25:31.604681 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:31.606068 25678 raft_consensus.cc:2368] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 16. Current term is 17.
I20260709 12:25:31.608420 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:25:31.620448 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 91758.3us
I20260709 12:25:31.621656 25650 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:31.543256 25834 raft_consensus.cc:2468] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 14.
I20260709 12:25:31.641703 26439 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 15.
I20260709 12:25:31.651652 25755 raft_consensus.cc:2468] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 14.
I20260709 12:25:31.653493 25828 raft_consensus.cc:2468] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 11.
I20260709 12:25:31.654254 25650 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:31.653733 25830 raft_consensus.cc:2468] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 13.
I20260709 12:25:31.661196 25679 raft_consensus.cc:2468] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 11.
I20260709 12:25:31.664517 25834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44218 (request call id 1977) took 1097 ms. Trace:
I20260709 12:25:31.664958 25834 rpcz_store.cc:276] 0709 12:25:30.558324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:30.575242 (+ 16918us) service_pool.cc:224] Handling call
0709 12:25:31.275764 (+700522us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b58007de7d0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99abd0aa 00007f5d99b3f447 00007f5d99b57fe7 00007f5d99b597de 00007f5d99b6527c 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c
0709 12:25:31.655174 (+379410us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":551913856}
I20260709 12:25:31.646318 31166 raft_consensus.cc:2804] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:31.680227 31265 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.681216 31265 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:31.688063 25726 connection.cc:256] RPC call timeout handler was delayed by -1.7022310790002848s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18460000000000001s for a response
I20260709 12:25:31.655216 31364 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:31.692034 31230 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.692505 31364 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:31.692095 31254 consensus_queue.cc:1048] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.021s
I20260709 12:25:31.692711 31230 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:31.695211 31230 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:31.696318 31361 raft_consensus.cc:2804] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:31.696822 31361 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:31.697222 31361 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:31.700277 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:25:31.701208 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:31.683706 26431 raft_consensus.cc:1240] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 14. Current term is 15. Ops: [12.10-14.11]
I20260709 12:25:31.703420 25833 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 17.
I20260709 12:25:31.712287 31393 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.712488 31371 consensus_queue.cc:1048] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:31.712957 31393 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:31.714188 25763 raft_consensus.cc:2468] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 16.
I20260709 12:25:31.714725 31371 consensus_queue.cc:1048] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:25:31.715297 31393 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:31.720098 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:31.720819 25830 raft_consensus.cc:2368] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 13. Current term is 14.
I20260709 12:25:31.722051 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:31.722853 25834 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 16.
I20260709 12:25:31.722308 25679 raft_consensus.cc:1240] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:31.728545 25678 raft_consensus.cc:2468] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 13.
I20260709 12:25:31.728696 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:31.695703 31364 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:31.723273 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:31.734380 25650 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:31.738433 25763 raft_consensus.cc:2368] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 11. Current term is 12.
I20260709 12:25:31.740041 25650 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:31.740322 31391 raft_consensus.cc:2804] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:31.740769 31226 raft_consensus.cc:2804] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:31.741040 25650 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:31.741381 31226 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:31.741894 31226 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:31.742013 31377 raft_consensus.cc:2804] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:31.742638 31377 raft_consensus.cc:697] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 17 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:31.743687 31377 consensus_queue.cc:237] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:31.744640 31253 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:31.746166 25650 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:31.729487 31230 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.750890 26401 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a
W20260709 12:25:31.736325 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 47404.5us
I20260709 12:25:31.733595 31166 raft_consensus.cc:697] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 16 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:31.752450 31329 raft_consensus.cc:3055] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:31.752880 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:31.753511 31265 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:31.752486 25679 raft_consensus.cc:1275] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
W20260709 12:25:31.770054 25726 connection.cc:256] RPC call timeout handler was delayed by -1.6455310790001931s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19090000000000001s for a response
I20260709 12:25:31.740854 31391 raft_consensus.cc:697] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 11 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:31.756832 26439 raft_consensus.cc:1275] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:25:31.773226 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
W20260709 12:25:31.758347 26402 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:31.741349 31420 raft_consensus.cc:2804] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:31.758802 31371 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.745376 31253 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:31.752076 25801 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:31.794631 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:31.795522 25837 raft_consensus.cc:2468] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 14.
I20260709 12:25:31.796861 25830 raft_consensus.cc:2393] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 11: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
W20260709 12:25:31.802000 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 61592.5us
I20260709 12:25:31.768798 31254 raft_consensus.cc:2804] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:31.772449 31329 raft_consensus.cc:740] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:31.803573 25679 raft_consensus.cc:1275] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:25:31.858311 31253 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:31.858996 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:31.860215 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:31.860859 25678 raft_consensus.cc:3060] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:31.805361 31401 raft_consensus.cc:2764] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
W20260709 12:25:31.863093 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 128039us
I20260709 12:25:31.865407 26401 leader_election.cc:400] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 election: Vote denied by peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267) with higher term. Message: Invalid argument: T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 11. Current term is 12.
I20260709 12:25:31.865736 26401 leader_election.cc:403] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:25:31.866061 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:31.805934 31254 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:31.867399 31254 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:31.868021 31258 raft_consensus.cc:3060] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:31.869457 31166 consensus_queue.cc:237] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:31.802743 31230 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:31.872673 25831 raft_consensus.cc:2468] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 14.
I20260709 12:25:31.873926 31230 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:31.875094 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:31.875664 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:31.876145 25836 raft_consensus.cc:2393] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 17: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:31.876353 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:31.876745 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:31.875094 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:31.876364 25835 raft_consensus.cc:2468] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 14.
I20260709 12:25:31.877848 25837 raft_consensus.cc:2410] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:25:31.877875 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:31.878729 25830 raft_consensus.cc:2468] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 15.
W20260709 12:25:31.878875 25726 connection.cc:256] RPC call timeout handler was delayed by -1.5879310790001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19730000000000003s for a response
W20260709 12:25:31.879416 25726 connection.cc:256] RPC call timeout handler was delayed by -1.5024310790004165s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2068s for a response
I20260709 12:25:31.877378 25832 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 16.
I20260709 12:25:31.883984 26436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36518 (request call id 1122) took 1195 ms. Trace:
I20260709 12:25:31.884449 26436 rpcz_store.cc:276] 0709 12:25:30.688771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:31.300999 (+612228us) service_pool.cc:224] Handling call
0709 12:25:31.301580 (+   581us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:31.302461 (+   881us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:31.302512 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:31.303484 (+   972us) log.cc:844] Serialized 26 byte log entry
0709 12:25:31.716680 (+413196us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:25:31.732746 (+ 16066us) log.cc:844] Serialized 14 byte log entry
0709 12:25:31.770514 (+ 37768us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:31.770625 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:31.883713 (+113088us) raft_consensus.cc:1685] finished
0709 12:25:31.883734 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:31.883870 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41422,"prepare.queue_time_us":15796,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":48,"raft.queue_time_us":40515,"raft.run_cpu_time_us":329,"raft.run_wall_time_us":19089,"thread_start_us":398781,"threads_started":1,"wal-append.queue_time_us":577750}
I20260709 12:25:31.886598 25726 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:31.888064 31196 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:31.888685 31196 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:31.890322 31433 raft_consensus.cc:2749] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:31.890849 31196 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:31.891580 31258 raft_consensus.cc:2749] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267) with higher term. Message: Invalid argument: T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 11. Current term is 12.
I20260709 12:25:31.877666 31356 raft_consensus.cc:2804] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:31.900295 31356 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:31.832518 31391 consensus_queue.cc:237] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:31.804454 31371 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:31.904760 31371 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:31.896615 25650 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
W20260709 12:25:31.907406 31430 log.cc:927] Time spent T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.228s	user 0.001s	sys 0.003s
I20260709 12:25:31.900790 31356 raft_consensus.cc:3060] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:31.908537 31265 raft_consensus.cc:2749] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:31.909204 26431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36518 (request call id 1111) took 1239 ms. Trace:
I20260709 12:25:31.909866 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:31.910068 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
W20260709 12:25:31.911396 31436 log.cc:927] Time spent T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.232s	user 0.001s	sys 0.001s
I20260709 12:25:31.911284 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:31.912230 25681 raft_consensus.cc:2393] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 11: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:31.912307 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:31.912693 25684 raft_consensus.cc:1240] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:25:31.912997 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:31.913468 25683 raft_consensus.cc:1240] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 12:25:31.877287 25834 raft_consensus.cc:2410] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:25:31.907470 25650 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:31.913597 25677 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:31.909577 26431 rpcz_store.cc:276] 0709 12:25:30.669646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:31.294967 (+625321us) service_pool.cc:224] Handling call
0709 12:25:31.646036 (+351069us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:31.701948 (+ 55912us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:31.908980 (+207032us) spinlock_profiling.cc:243] Waited 349 ms on lock 0x7b54007cabd0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b608ad 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:31.909146 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":801791744}
I20260709 12:25:31.920688 25682 raft_consensus.cc:1275] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:25:31.920897 25763 raft_consensus.cc:1275] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:25:31.922722 25761 raft_consensus.cc:1240] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:31.924124 25680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51578 (request call id 1111) took 1135 ms. Trace:
I20260709 12:25:31.925894 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:31.924603 25680 rpcz_store.cc:276] 0709 12:25:30.788697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:30.844347 (+ 55650us) service_pool.cc:224] Handling call
0709 12:25:30.844849 (+   502us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:31.149383 (+304534us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:31.149487 (+   104us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:31.150708 (+  1221us) log.cc:844] Serialized 26 byte log entry
0709 12:25:31.265145 (+114437us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:25:31.717005 (+451860us) log.cc:844] Serialized 14 byte log entry
0709 12:25:31.724913 (+  7908us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:31.736154 (+ 11241us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:31.906433 (+170279us) spinlock_profiling.cc:243] Waited 22.5 ms on lock 0x7b4400022b4c. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db 00007f5d99708aaf 00007f5d996fc86e 00007f5d996fbbb6 00007f5d996fb7d8 00007f5d99705221 00007f5d997051d9 00007f5d99705169
0709 12:25:31.913934 (+  7501us) raft_consensus.cc:1685] finished
0709 12:25:31.923778 (+  9844us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:31.923941 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":966,"prepare.queue_time_us":513229,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":3408,"raft.queue_time_us":31248,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":14048,"spinlock_wait_cycles":51763968,"thread_start_us":517758,"threads_started":3,"wal-append.queue_time_us":522550}
I20260709 12:25:31.927520 25758 raft_consensus.cc:1240] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:31.927625 25800 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:31.929122 31401 raft_consensus.cc:2804] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:31.929764 31401 raft_consensus.cc:697] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 14 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
W20260709 12:25:31.932539 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 56719.3us
I20260709 12:25:31.934432 31371 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:31.935123 31371 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:31.937878 25650 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:31.938239 31371 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:31.931095 31401 consensus_queue.cc:237] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:31.940129 31309 raft_consensus.cc:2804] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:31.940647 31309 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:31.941067 31309 raft_consensus.cc:3060] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:31.933557 25800 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:31.944478 25801 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:31.939484 25650 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:31.900298 31420 raft_consensus.cc:697] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 13 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:31.961052 31422 raft_consensus.cc:2804] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:31.966349 31422 raft_consensus.cc:697] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 17 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
W20260709 12:25:31.967483 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 137900us
I20260709 12:25:31.919741 25678 raft_consensus.cc:2468] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 14.
I20260709 12:25:31.973312 31422 consensus_queue.cc:237] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:31.981309 31230 raft_consensus.cc:2804] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:31.984927 31361 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:31.986397 31420 consensus_queue.cc:237] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:31.996856 25755 raft_consensus.cc:1240] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:32.003531 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:31.964612 31371 raft_consensus.cc:2804] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:31.997695 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:32.003579 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:32.003903 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:32.004731 25677 raft_consensus.cc:2468] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 16.
I20260709 12:25:32.010166 25756 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 16.
I20260709 12:25:31.969861 31265 raft_consensus.cc:2804] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:32.003754 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:32.024505 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:25:32.020980 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 45924.5us
W20260709 12:25:32.027396 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 49962.4us
I20260709 12:25:32.027388 25680 raft_consensus.cc:3060] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:32.027482 25682 raft_consensus.cc:3060] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:32.031960 25758 raft_consensus.cc:1275] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 12:25:32.069051 25800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:32.070693 25683 raft_consensus.cc:3060] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:32.070916 25800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:32.009385 31230 raft_consensus.cc:697] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 12 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:32.082408 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:32.082406 26402 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:32.087487 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:32.022740 31371 raft_consensus.cc:697] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 16 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:32.001374 31254 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:31.999887 31226 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:32.048682 31165 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.089505 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:32.094558 25677 raft_consensus.cc:2468] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 14.
W20260709 12:25:32.096243 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 76384us
I20260709 12:25:32.073348 31118 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.090296 25801 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:25:32.099040 25800 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:32.021287 31349 consensus_queue.cc:1059] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 12:25:32.052443 31274 consensus_queue.cc:1048] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.064s
I20260709 12:25:32.107043 31118 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:32.111935 31118 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:32.112397 31175 raft_consensus.cc:2804] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:32.112812 31175 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.113134 31175 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:32.115964 31340 consensus_queue.cc:1048] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.096s
I20260709 12:25:32.103577 31165 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:32.120434 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:32.121253 25755 raft_consensus.cc:2393] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 19: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:32.121387 31274 consensus_queue.cc:1048] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:32.122053 31118 consensus_queue.cc:1048] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:32.122715 31349 raft_consensus.cc:3055] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:32.123276 31349 raft_consensus.cc:740] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:32.122975 31175 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:32.124419 31349 consensus_queue.cc:260] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:32.125974 31349 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:32.126231 31175 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:32.126996 31175 raft_consensus.cc:2804] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:32.127493 31175 raft_consensus.cc:697] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 17 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:32.128037 31350 consensus_queue.cc:1059] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.100s
I20260709 12:25:32.129231 31350 raft_consensus.cc:3055] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:32.129616 31350 raft_consensus.cc:740] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:32.130692 31350 consensus_queue.cc:260] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:32.132266 25649 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:32.134025 25649 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:32.071372 31255 consensus_queue.cc:1048] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:25:32.150035 31364 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.152143 31390 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.153641 31254 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:32.153954 31226 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:32.155587 31361 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:32.155072 31371 consensus_queue.cc:237] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:32.158416 31175 consensus_queue.cc:237] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:32.136654 31230 consensus_queue.cc:237] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:32.003700 31329 consensus_queue.cc:260] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:32.182677 31329 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:32.105898 31253 raft_consensus.cc:2749] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:32.162302 25684 raft_consensus.cc:2393] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 17: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:32.136070 31425 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.141628 31323 consensus_queue.cc:1059] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 12:25:32.116011 31259 consensus_queue.cc:1048] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.082s
I20260709 12:25:32.165391 25683 raft_consensus.cc:2468] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 12.
I20260709 12:25:32.174377 25680 raft_consensus.cc:2468] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 14.
W20260709 12:25:32.184525 31130 consensus_queue.cc:1175] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6e673265293d4e9a937dc45150aeb1b8" responder_term: 15 status { last_received { term: 14 index: 11 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 14. Current term is 15. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:25:32.199891 31259 raft_consensus.cc:2749] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:25:32.202180 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:32.202163 30884 raft_consensus.cc:3055] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:32.202899 30884 raft_consensus.cc:740] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:32.204097 30884 consensus_queue.cc:260] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:32.204913 31390 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:32.185894 31350 raft_consensus.cc:3060] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:32.214497 25682 raft_consensus.cc:2468] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 14.
I20260709 12:25:32.196815 31425 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:32.185357 31364 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:32.207684 31390 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:32.213603 31226 raft_consensus.cc:2749] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:32.239645 31356 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:32.242280 31309 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:32.281749 25760 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.013s	sys 0.023s
W20260709 12:25:32.289553 25760 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.014s	sys 0.023s
I20260709 12:25:32.254142 31165 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:32.361339 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:32.362412 25754 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.009s	sys 0.029s
W20260709 12:25:32.362883 25754 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.009s	sys 0.029s
I20260709 12:25:32.363843 25754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 3298) took 1119 ms. Trace:
I20260709 12:25:32.364308 25754 rpcz_store.cc:276] 0709 12:25:31.244358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:31.248144 (+  3786us) service_pool.cc:224] Handling call
0709 12:25:31.282437 (+ 34293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:31.296473 (+ 14036us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:25:31.645403 (+348930us) log.cc:844] Serialized 14 byte log entry
0709 12:25:32.363366 (+717963us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:32.363439 (+    73us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:32.363499 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:32.363600 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:32.363750 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":404658,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":51,"raft.queue_time_us":651,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":103,"thread_start_us":1049679,"threads_started":2}
I20260709 12:25:32.373366 31309 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:32.379963 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:32.390911 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:32.392814 31356 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:32.373250 31364 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:32.428364 31425 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:32.350835 31253 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:32.432471 31253 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:32.433353 31343 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.434029 31343 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:32.435138 31253 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:25:32.442574 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:32.446622 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:32.449787 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 314235us
W20260709 12:25:32.457258 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:32.468134 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 415627us
W20260709 12:25:32.446326 31401 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.011s	sys 0.006s
W20260709 12:25:32.470194 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 583757us
W20260709 12:25:32.471521 31401 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.011s	sys 0.006s
I20260709 12:25:32.487766 31343 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:32.492472 31391 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.011s	sys 0.030s
I20260709 12:25:32.497786 25726 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:32.543583 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:32.544337 25832 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:25:32.544684 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 472538us
I20260709 12:25:32.545569 25801 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:32.548170 25801 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
W20260709 12:25:32.548624 31443 log.cc:927] Time spent T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:25:32.548740 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:32.549574 26434 raft_consensus.cc:3060] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:25:32.533862 31391 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.012s	sys 0.030s
I20260709 12:25:32.524140 31130 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.555544 25833 raft_consensus.cc:1275] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 12:25:32.564337 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:32.566080 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:32.566869 25834 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:32.569026 31425 raft_consensus.cc:2749] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:25:32.571592 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 82307.5us
I20260709 12:25:32.576241 31448 raft_consensus.cc:2749] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:32.581162 31401 raft_consensus.cc:2749] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:32.582616 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:32.583588 25828 raft_consensus.cc:2393] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 17: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:32.584403 31130 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:32.587083 31130 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:32.534960 31166 consensus_queue.cc:1048] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 12:25:32.556443 25833 pending_rounds.cc:85] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a: Aborting all ops after (but not including) 10
I20260709 12:25:32.591342 25649 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:32.593197 25650 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:32.589802 25833 pending_rounds.cc:107] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 12:25:32.599599 25833 raft_consensus.cc:2889] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:25:32.589486 31265 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.017s	sys 0.051s
I20260709 12:25:32.614302 31259 raft_consensus.cc:2804] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:32.614039 31422 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:32.614553 31425 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
W20260709 12:25:32.662228 26402 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.014s	sys 0.018s
W20260709 12:25:32.664268 26402 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.014s	sys 0.018s
W20260709 12:25:32.664604 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 567512us
I20260709 12:25:32.665071 25832 raft_consensus.cc:2468] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 17.
W20260709 12:25:32.661803 25652 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.027s	sys 0.033s
W20260709 12:25:32.668188 25652 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.027s	sys 0.033s
W20260709 12:25:32.667047 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 119081us
I20260709 12:25:32.599220 31391 consensus_queue.cc:1048] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 12:25:32.679416 26434 raft_consensus.cc:2468] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 16.
W20260709 12:25:32.640949 31265 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.017s	sys 0.052s
I20260709 12:25:32.660219 31259 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:32.681360 25800 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.006s	sys 0.028s
I20260709 12:25:32.699621 26435 raft_consensus.cc:1275] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:25:32.684010 25650 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:25:32.702824 25686 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.771s	user 0.021s	sys 0.020s
I20260709 12:25:32.701561 25834 raft_consensus.cc:2468] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 16.
W20260709 12:25:32.703820 25800 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.006s	sys 0.028s
W20260709 12:25:32.706430 25685 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.726s	user 0.025s	sys 0.027s
W20260709 12:25:32.706784 25685 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.025s	sys 0.027s
W20260709 12:25:32.705320 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 601244us
I20260709 12:25:32.706008 25801 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:25:32.713981 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 122749us
W20260709 12:25:32.703755 25686 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.021s	sys 0.020s
I20260709 12:25:32.662886 31254 consensus_queue.cc:1048] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 12:25:32.700383 31274 raft_consensus.cc:2749] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:32.701593 31265 raft_consensus.cc:697] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 16 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:32.721495 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:32.724073 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 126076us
I20260709 12:25:32.704094 31259 raft_consensus.cc:3060] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:32.729203 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:32.734007 25759 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:32.702842 31349 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.673305 31425 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:32.680614 31422 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:32.735713 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:32.739377 25762 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 13.
W20260709 12:25:32.737963 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:32.738211 25763 raft_consensus.cc:2468] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 14.
I20260709 12:25:32.738647 31165 raft_consensus.cc:2804] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:25:32.744671 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 62291.5us
I20260709 12:25:32.748081 31130 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:32.756032 25761 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.017s	sys 0.021s
I20260709 12:25:32.752007 25685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2637) took 1318 ms. Trace:
I20260709 12:25:32.744789 31165 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:32.761399 25761 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.017s	sys 0.021s
I20260709 12:25:32.761634 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:32.762320 26402 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:32.758579 25685 rpcz_store.cc:276] 0709 12:25:31.433379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:31.433864 (+   485us) service_pool.cc:224] Handling call
0709 12:25:31.434272 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:31.434573 (+   301us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:25:31.971605 (+537032us) log.cc:844] Serialized 14 byte log entry
0709 12:25:32.751510 (+779905us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:32.751588 (+    78us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:32.751652 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:32.751743 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:32.751900 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":220197,"prepare.queue_time_us":421584,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"thread_start_us":1091143,"threads_started":2}
I20260709 12:25:32.781590 25649 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
W20260709 12:25:32.784762 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:32.769062 31165 raft_consensus.cc:3060] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:32.793987 25756 raft_consensus.cc:2468] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 13.
I20260709 12:25:32.748113 31349 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:32.823902 31349 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:32.781303 31455 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.824930 31455 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:32.826596 31425 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:32.827070 31455 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:32.797274 31343 raft_consensus.cc:2804] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:25:32.828162 31343 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.828593 31343 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:25:32.799499 31274 raft_consensus.cc:2804] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:32.832091 31265 consensus_queue.cc:237] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:32.832962 31274 raft_consensus.cc:697] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 17 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:32.833999 31274 consensus_queue.cc:237] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.6, Last appended by leader: 6, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:32.836231 31453 log.cc:927] Time spent T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
W20260709 12:25:32.836669 31350 consensus_meta.cc:287] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.602s	user 0.013s	sys 0.000s
I20260709 12:25:32.800971 31458 consensus_queue.cc:1048] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 12:25:32.803131 31226 raft_consensus.cc:2749] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:25:32.804593 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 69131.7us
I20260709 12:25:32.805796 31329 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:32.806308 30884 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:32.762220 31130 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:32.825168 31422 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:32.801749 31166 consensus_queue.cc:1048] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:25:32.838428 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 154539us
W20260709 12:25:32.857662 25800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:32.860165 25800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:32.867785 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 108999us
I20260709 12:25:32.866178 25650 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:32.871672 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:32.872654 25650 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:25:32.879117 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 120225us
I20260709 12:25:32.795552 31371 consensus_queue.cc:1059] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.070s
I20260709 12:25:32.885408 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:32.890513 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:32.898092 25832 raft_consensus.cc:2468] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 13.
I20260709 12:25:32.892405 26434 raft_consensus.cc:2468] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 13.
I20260709 12:25:32.886610 25801 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:32.891063 25800 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:32.898264 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:32.900085 25726 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:32.900599 25754 raft_consensus.cc:1275] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:25:32.877372 31425 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:32.903831 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 122326us
I20260709 12:25:32.864399 31329 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:32.899573 31226 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.884976 31422 consensus_queue.cc:1048] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 12:25:32.912068 31448 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:32.938407 25800 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:32.931989 25650 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:32.944263 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:32.944932 25763 raft_consensus.cc:2468] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 14.
I20260709 12:25:32.942708 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:32.945869 25758 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:25:32.923877 31265 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.953823 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:32.954303 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:32.928774 31364 raft_consensus.cc:2749] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:25:32.972278 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:32.982295 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:32.984764 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:32.985378 25762 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:32.914915 31425 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:32.940830 31401 raft_consensus.cc:2749] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:25:32.997994 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 122535us
W20260709 12:25:32.989962 31471 log.cc:927] Time spent T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:25:32.954890 31361 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:33.012526 31361 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:33.013002 31465 log.cc:927] Time spent T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 12:25:33.014672 31361 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:33.015085 31466 log.cc:927] Time spent T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 12:25:32.961856 31371 raft_consensus.cc:2804] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:33.016263 31371 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:33.016701 31371 raft_consensus.cc:3060] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:32.955668 31479 raft_consensus.cc:2804] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:33.022210 31329 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:33.024680 25760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48606 (request call id 1400) took 1710 ms. Trace:
I20260709 12:25:32.990240 31323 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:32.931288 31226 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:33.036959 31130 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:33.037891 31477 raft_consensus.cc:2804] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:33.038316 31477 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:33.038632 31477 raft_consensus.cc:3060] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:33.043131 25801 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:33.024185 31461 raft_consensus.cc:2804] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:33.029393 25760 rpcz_store.cc:276] 0709 12:25:31.314313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:31.316482 (+  2169us) service_pool.cc:224] Handling call
0709 12:25:31.316958 (+   476us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:31.644970 (+328012us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:25:32.291437 (+646467us) log.cc:844] Serialized 14 byte log entry
0709 12:25:32.721296 (+429859us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:32.728923 (+  7627us) log.cc:844] Serialized 26 byte log entry
0709 12:25:32.729074 (+   151us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:32.729119 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:32.729217 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:33.024463 (+295246us) raft_consensus.cc:1685] finished
0709 12:25:33.024484 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:33.024617 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":122792,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":9459,"raft.run_cpu_time_us":371,"raft.run_wall_time_us":2957,"thread_start_us":1332406,"threads_started":3,"wal-append.queue_time_us":511158}
I20260709 12:25:32.986971 31265 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:33.075928 31118 raft_consensus.cc:2749] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:33.076586 31487 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:33.077490 31487 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:33.080900 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 203184us
I20260709 12:25:32.987975 31448 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:33.009196 31350 consensus_queue.cc:1048] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 12:25:33.019718 31165 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:33.038913 31226 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:33.097994 25758 raft_consensus.cc:2468] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 16.
I20260709 12:25:33.099354 31118 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.099478 25726 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
W20260709 12:25:33.100941 31485 log.cc:927] Time spent T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:25:33.076619 31460 raft_consensus.cc:2804] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:33.102514 31460 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:33.102934 31460 raft_consensus.cc:3060] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:33.054162 31401 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.107956 25726 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:33.059492 31479 raft_consensus.cc:697] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 16 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:33.110033 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:33.041857 31323 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:33.102934 31196 raft_consensus.cc:2749] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:33.121276 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
W20260709 12:25:33.122984 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:33.080291 31459 consensus_queue.cc:1048] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.179s
I20260709 12:25:33.141032 25649 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:33.130684 25759 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 17.
I20260709 12:25:33.132483 31165 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:33.132907 31118 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:33.133283 31425 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:33.137051 31274 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.137521 31361 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:33.140316 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 104560us
W20260709 12:25:33.075331 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 129445us
I20260709 12:25:33.167447 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:33.132529 31393 consensus_queue.cc:1048] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 12:25:33.156203 25800 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:33.117671 31461 raft_consensus.cc:697] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 16 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:33.179682 25761 raft_consensus.cc:2468] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 14.
I20260709 12:25:33.108606 31364 consensus_queue.cc:1048] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.058s
I20260709 12:25:33.145210 31254 raft_consensus.cc:2749] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:25:33.185775 31425 raft_consensus.cc:2804] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:33.188235 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:33.111680 31401 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:33.181452 25801 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:33.200407 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:33.195986 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:33.198341 25800 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:33.207692 25759 raft_consensus.cc:3055] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:33.208424 25759 raft_consensus.cc:740] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:33.210285 25756 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 19.
I20260709 12:25:33.210400 25801 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:33.212131 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:33.212374 31425 raft_consensus.cc:697] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 17 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:33.212827 25832 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 18.
I20260709 12:25:33.215807 25834 raft_consensus.cc:1275] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:25:33.180940 31274 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:33.195990 31476 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:33.224027 26434 raft_consensus.cc:1275] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:25:33.224524 25832 raft_consensus.cc:1240] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 12:25:33.223651 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:33.222651 31475 raft_consensus.cc:2804] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:33.227641 31476 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:33.229681 31475 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:33.230082 31475 raft_consensus.cc:3060] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:33.232565 25837 raft_consensus.cc:1240] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 16 LEADER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:33.220119 31118 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:33.222855 31165 raft_consensus.cc:2804] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:33.236310 31165 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:33.236737 31165 raft_consensus.cc:3060] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:33.241170 25801 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:33.242540 25801 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:33.243194 31230 raft_consensus.cc:2749] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:33.244102 26432 raft_consensus.cc:1275] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 12:25:33.244467 26432 pending_rounds.cc:85] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89: Aborting all ops after (but not including) 11
I20260709 12:25:33.244680 26432 pending_rounds.cc:107] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 12:25:33.244904 26432 raft_consensus.cc:2889] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:25:33.251336 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:33.128415 31470 log.cc:927] Time spent T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260709 12:25:33.262624 25760 raft_consensus.cc:1240] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:33.199033 31361 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:33.270473 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:33.269361 31502 raft_consensus.cc:2749] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:33.261983 31118 raft_consensus.cc:2749] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:33.265496 25759 consensus_queue.cc:260] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:33.270764 26436 raft_consensus.cc:1275] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 12:25:33.273464 25830 raft_consensus.cc:1275] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:25:33.275698 26436 pending_rounds.cc:85] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89: Aborting all ops after (but not including) 10
I20260709 12:25:33.276029 26436 pending_rounds.cc:107] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 12:25:33.276271 26436 raft_consensus.cc:2889] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:33.277294 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:33.235153 31477 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:33.188330 31479 consensus_queue.cc:237] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:33.284806 31130 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.297436 31130 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:33.285245 31329 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.289675 31477 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:33.292224 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 49789.3us
I20260709 12:25:33.292855 31274 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:33.294231 31323 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:33.296113 31361 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:33.296197 31425 consensus_queue.cc:237] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:33.273223 31480 raft_consensus.cc:2804] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:33.317332 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:33.299786 31130 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:33.321686 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:33.324322 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:33.325002 25678 raft_consensus.cc:2468] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 14.
I20260709 12:25:33.312819 25759 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:33.305742 30884 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.270550 31343 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:33.325939 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:33.332917 25686 raft_consensus.cc:1275] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:25:33.336403 25679 raft_consensus.cc:2393] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 17: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:33.332785 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:33.337507 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:33.338627 25762 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 17.
I20260709 12:25:33.333158 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:25:33.339581 25763 raft_consensus.cc:1275] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:25:33.339829 25680 raft_consensus.cc:1240] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 16 LEADER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:25:33.318065 31323 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.333567 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:33.333735 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:33.355871 25682 raft_consensus.cc:2393] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 14: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:33.334178 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:33.334640 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:33.335335 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:33.333853 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:33.356388 25677 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 19.
I20260709 12:25:33.358842 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:33.359604 26430 raft_consensus.cc:2468] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 13.
I20260709 12:25:33.364300 25677 raft_consensus.cc:1275] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:25:33.355032 26438 raft_consensus.cc:2468] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 11.
I20260709 12:25:33.366194 25685 raft_consensus.cc:2393] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 17: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:33.315088 31460 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:33.327854 31480 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:33.311578 31448 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:33.388037 25801 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:33.390645 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:33.421334 25682 raft_consensus.cc:2468] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 14.
I20260709 12:25:33.424597 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:25:33.387071 31259 consensus_meta.cc:287] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.617s	user 0.011s	sys 0.001s
I20260709 12:25:33.425472 26437 raft_consensus.cc:2410] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 12:25:33.420734 31480 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:33.354708 30884 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:33.365803 31323 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:33.385764 31175 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:33.306041 31461 consensus_queue.cc:237] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:33.333979 31118 consensus_queue.cc:1048] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.090s
I20260709 12:25:33.494987 31175 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:33.500049 31401 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:33.470412 31130 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.501314 31130 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:33.511675 31460 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:33.459187 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:33.462865 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:33.318089 31329 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:33.481736 31393 raft_consensus.cc:2804] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:33.482882 25759 raft_consensus.cc:1275] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 12:25:33.471269 31259 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:33.515614 25759 pending_rounds.cc:85] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 12
I20260709 12:25:33.517963 25759 pending_rounds.cc:107] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 12:25:33.518249 25759 raft_consensus.cc:2889] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:33.516837 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:33.518787 26432 raft_consensus.cc:2468] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 14.
I20260709 12:25:33.522598 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:33.525568 31458 raft_consensus.cc:3055] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:25:33.536486 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 148541us
W20260709 12:25:33.536862 31504 log.cc:927] Time spent T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:25:33.538000 25801 leader_election.cc:400] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 pre-election: Vote denied by peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) with higher term. Message: Invalid argument: T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 16. Current term is 17.
I20260709 12:25:33.538342 25801 leader_election.cc:403] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:25:33.539062 31499 log.cc:927] Time spent T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 12:25:33.391290 31371 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:33.544646 31460 raft_consensus.cc:2749] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) with higher term. Message: Invalid argument: T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 16. Current term is 17.
I20260709 12:25:33.545418 25801 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:33.549747 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:33.552929 26437 raft_consensus.cc:2393] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 21: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:33.553881 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:33.554057 31165 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:33.554901 31472 log.cc:927] Time spent T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.539s	user 0.001s	sys 0.001s
I20260709 12:25:33.555133 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:33.516218 31393 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:33.556661 26439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 1379) took 1012 ms. Trace:
I20260709 12:25:33.557053 26439 rpcz_store.cc:276] 0709 12:25:32.544687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:32.550202 (+  5515us) service_pool.cc:224] Handling call
0709 12:25:32.576415 (+ 26213us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:32.576933 (+   518us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:32.576989 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:32.577690 (+   701us) log.cc:844] Serialized 26 byte log entry
0709 12:25:32.900043 (+322353us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:32.900086 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:32.900155 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:33.554232 (+654077us) spinlock_profiling.cc:243] Waited 4.37 ms on lock 0x7b4400022b4c. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db 00007f5d99708aaf 00007f5d996fc86e 00007f5d996fbbb6 00007f5d996fb7d8 00007f5d99705221 00007f5d997051d9 00007f5d99705169
0709 12:25:33.556342 (+  2110us) raft_consensus.cc:1685] finished
0709 12:25:33.556366 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:33.556600 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3984,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"spinlock_wait_cycles":10049792,"thread_start_us":313660,"threads_started":1,"wal-append.queue_time_us":437671}
I20260709 12:25:33.560490 31460 raft_consensus.cc:2804] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:33.561017 31460 raft_consensus.cc:697] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 11 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:33.561888 31460 consensus_queue.cc:237] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:33.565260 31487 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:33.565742 31175 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:33.567422 31371 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:33.556569 31393 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:33.572064 26436 raft_consensus.cc:1275] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 12:25:33.572448 26436 pending_rounds.cc:85] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89: Aborting all ops after (but not including) 9
I20260709 12:25:33.572638 26436 pending_rounds.cc:107] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 12:25:33.573024 26436 raft_consensus.cc:2889] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:33.573056 26438 raft_consensus.cc:2468] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 15.
I20260709 12:25:33.574203 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:33.579661 26438 raft_consensus.cc:1275] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:25:33.543419 31458 raft_consensus.cc:740] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:33.598984 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:25:33.597414 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 57514.3us
I20260709 12:25:33.600374 26439 raft_consensus.cc:3060] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:33.596030 31480 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:33.601128 26437 raft_consensus.cc:1240] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 15. Current term is 16. Ops: []
W20260709 12:25:33.606096 26402 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:33.610463 31492 log.cc:927] Time spent T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.479s	user 0.003s	sys 0.000s
I20260709 12:25:33.615762 25834 raft_consensus.cc:1240] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:33.616500 31476 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:33.620759 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:33.625669 25649 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:33.626581 31476 raft_consensus.cc:2804] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:25:33.627074 31476 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:33.627499 31476 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:25:33.627811 31473 log.cc:927] Time spent T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.666s	user 0.001s	sys 0.003s
I20260709 12:25:33.628556 31255 consensus_queue.cc:1059] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:33.629400 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:33.631765 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:33.632020 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:33.632310 26431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 1377) took 1088 ms. Trace:
I20260709 12:25:33.632607 25755 raft_consensus.cc:2468] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 13.
I20260709 12:25:33.632751 26431 rpcz_store.cc:276] 0709 12:25:32.544034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:32.545621 (+  1587us) service_pool.cc:224] Handling call
0709 12:25:32.545926 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:32.546457 (+   531us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:32.546486 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:32.558024 (+ 11538us) log.cc:844] Serialized 26 byte log entry
0709 12:25:32.853541 (+295517us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:25:32.853584 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:32.853654 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:33.627153 (+773499us) spinlock_profiling.cc:243] Waited 2.74 ms on lock 0x7b4400022b4c. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db 00007f5d99708aaf 00007f5d996fc86e 00007f5d996fbbb6 00007f5d996fb7d8 00007f5d99705221 00007f5d997051d9 00007f5d99705169
0709 12:25:33.631987 (+  4834us) raft_consensus.cc:1685] finished
0709 12:25:33.632027 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:33.632245 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":104,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":94,"spinlock_wait_cycles":6301056,"thread_start_us":220341,"threads_started":1,"wal-append.queue_time_us":307374}
I20260709 12:25:33.634570 31166 consensus_queue.cc:1048] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:33.635224 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:33.632887 31274 consensus_queue.cc:1048] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 12:25:33.635864 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:33.637763 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:33.636969 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:33.638373 25755 raft_consensus.cc:2468] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 12.
I20260709 12:25:33.638525 25759 raft_consensus.cc:3060] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:25:33.639417 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:33.640058 25763 raft_consensus.cc:3060] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:33.637334 31255 raft_consensus.cc:3055] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:33.644032 31255 raft_consensus.cc:740] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:33.645040 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:33.645174 31255 consensus_queue.cc:260] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:33.647329 31255 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:33.649678 31323 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349)
I20260709 12:25:33.650503 31475 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:33.652429 31343 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 21 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:33.653215 31329 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:33.654202 31475 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:33.654387 30884 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:33.654989 25686 raft_consensus.cc:2468] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 14.
W20260709 12:25:33.656373 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 56288.5us
I20260709 12:25:33.656667 25650 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:33.657627 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:33.658579 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:33.658861 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:33.659988 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:33.660192 25650 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:33.660395 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:33.661099 31391 raft_consensus.cc:2749] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:33.661641 31259 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:33.662321 31259 consensus_queue.cc:1048] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:33.662818 31391 raft_consensus.cc:2749] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:33.664412 31165 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:25:33.665285 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 561376us
W20260709 12:25:33.668354 25649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:33.668285 25763 raft_consensus.cc:2468] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 15.
I20260709 12:25:33.673818 25759 raft_consensus.cc:2468] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 15.
I20260709 12:25:33.669371 25649 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:33.684872 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:33.685748 31265 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:33.687325 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:33.687939 25755 raft_consensus.cc:3060] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:33.702574 25801 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:33.699317 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:33.709862 31118 raft_consensus.cc:2804] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:33.710350 31118 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:33.710640 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:33.711323 26435 raft_consensus.cc:3060] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:33.713878 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:33.678369 31274 consensus_queue.cc:1048] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 12:25:33.710721 31118 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:33.716822 26439 raft_consensus.cc:2468] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 14.
I20260709 12:25:33.717896 26436 raft_consensus.cc:1275] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:25:33.707595 31371 consensus_queue.cc:1048] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 12:25:33.722746 31513 consensus_queue.cc:1048] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:25:33.723537 31480 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:33.689895 31130 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:33.723606 26436 raft_consensus.cc:1240] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 13. Current term is 14. Ops: [12.11-13.12]
I20260709 12:25:33.728579 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:33.731623 25759 raft_consensus.cc:1275] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:25:33.736021 25757 raft_consensus.cc:3055] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:33.736263 26435 raft_consensus.cc:2468] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 14.
I20260709 12:25:33.736440 25757 raft_consensus.cc:740] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:33.738467 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:33.744011 26433 raft_consensus.cc:2468] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 13.
W20260709 12:25:33.744237 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:33.648226 31458 consensus_queue.cc:260] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:33.729187 26437 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 17.
I20260709 12:25:33.753618 25726 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:33.762912 31393 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:33.752962 31253 consensus_queue.cc:1059] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 12:25:33.765219 31476 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:33.767386 31476 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 20 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:33.768463 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 61247.9us
I20260709 12:25:33.769277 25726 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:33.770669 25726 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:33.758653 31475 consensus_queue.cc:1059] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 12:25:33.776979 31475 consensus_queue.cc:1243] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Peer f82778701b464892aab92a752ed7ffdc log is divergent from this leader: its last log entry 16.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
W20260709 12:25:33.784861 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:33.785589 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:33.690644 31165 consensus_queue.cc:1048] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 12:25:33.729519 31265 raft_consensus.cc:2804] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:33.696460 31390 consensus_queue.cc:1048] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 12:25:33.795892 25755 raft_consensus.cc:2468] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 15.
I20260709 12:25:33.798734 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:33.811519 25762 raft_consensus.cc:2468] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 13.
I20260709 12:25:33.686662 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:33.815891 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:33.812731 25757 consensus_queue.cc:260] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 16.7, Last appended by leader: 7, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:33.800621 31502 raft_consensus.cc:2749] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:33.869586 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:33.799580 31175 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:33.811883 31448 raft_consensus.cc:2749] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:33.801215 31265 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:33.855595 31309 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:33.872605 25683 raft_consensus.cc:1240] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 14 LEADER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:33.875121 25684 raft_consensus.cc:1240] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:33.814487 31259 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.868983 25686 raft_consensus.cc:1240] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 11 LEADER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:33.878424 25757 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:33.881115 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:33.814261 31510 raft_consensus.cc:2749] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:25:33.882095 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 127252us
W20260709 12:25:33.872773 31511 log.cc:927] Time spent T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
W20260709 12:25:33.888209 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 170985us
W20260709 12:25:33.889437 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 118811us
I20260709 12:25:33.895447 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:33.879748 31265 raft_consensus.cc:3060] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:33.926308 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:33.927977 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:33.928939 26439 raft_consensus.cc:2393] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 15: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:33.929299 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:33.929461 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:33.930161 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:33.930738 25683 raft_consensus.cc:3060] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:33.931492 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:33.931577 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:33.932221 25681 raft_consensus.cc:3060] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:33.932626 25684 raft_consensus.cc:2393] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 15: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:33.932915 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:33.933569 26435 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:33.928970 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:33.936790 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:33.928081 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:33.948378 25682 raft_consensus.cc:2468] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 12.
I20260709 12:25:33.886336 31309 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:33.956300 25686 raft_consensus.cc:2468] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 12.
I20260709 12:25:33.962244 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:33.880350 31175 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:33.891497 31259 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:33.919349 31361 consensus_queue.cc:1048] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
W20260709 12:25:33.970355 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 48101.4us
I20260709 12:25:33.971853 26435 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 16.
I20260709 12:25:33.977550 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:33.980518 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:33.981276 25686 raft_consensus.cc:2468] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 14.
I20260709 12:25:33.983384 25801 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:33.989203 25726 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:33.990626 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:33.994256 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:33.975584 31130 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.002617 25801 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:34.005924 26432 raft_consensus.cc:2468] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 12.
I20260709 12:25:34.009758 25683 raft_consensus.cc:2468] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 15.
I20260709 12:25:34.010982 25801 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:25:33.984576 31393 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:34.015374 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 21 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:34.016053 25834 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:25:34.016181 25801 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:34.018270 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:34.001585 31510 raft_consensus.cc:2804] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:34.029986 25726 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:34.036291 31502 raft_consensus.cc:2749] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:34.008605 31130 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:34.040637 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:34.041916 31130 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:34.041747 31476 consensus_queue.cc:1048] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:34.043592 31390 consensus_queue.cc:1048] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:34.044262 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:34.045579 25685 raft_consensus.cc:2468] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 13.
I20260709 12:25:34.048260 25801 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:25:34.047219 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:34.052642 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:34.059386 25834 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 21.
I20260709 12:25:34.064164 25650 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:34.051831 25685 raft_consensus.cc:2468] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 14.
I20260709 12:25:34.066001 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:34.060704 31514 log.cc:927] Time spent T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
I20260709 12:25:34.030498 31510 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:34.079213 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:34.070770 25760 raft_consensus.cc:2468] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 16.
W20260709 12:25:34.060628 31518 log.cc:927] Time spent T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:25:34.034811 31393 raft_consensus.cc:2749] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:34.097191 26402 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:34.099100 26402 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:25:34.076457 31515 log.cc:927] Time spent T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 12:25:34.103063 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:34.103906 25833 raft_consensus.cc:2468] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 16.
W20260709 12:25:34.100402 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 62402.9us
I20260709 12:25:34.061029 31476 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:34.091503 31519 log.cc:927] Time spent T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 12:25:34.101895 26402 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:34.124027 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:34.125339 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:34.126106 25760 raft_consensus.cc:3060] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:34.126434 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 64157.6us
I20260709 12:25:34.128306 25801 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:34.130184 25801 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:25:34.137085 31425 raft_consensus.cc:2749] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:25:34.137961 31425 consensus_queue.cc:1048] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:34.139430 31425 raft_consensus.cc:2804] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:34.140254 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:34.185781 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
W20260709 12:25:34.187501 31521 log.cc:927] Time spent T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:25:34.188388 31309 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:34.188529 31259 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:34.116182 31528 raft_consensus.cc:2804] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:34.189015 31501 consensus_queue.cc:1059] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.081s
I20260709 12:25:34.194836 25681 raft_consensus.cc:2468] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 15.
I20260709 12:25:34.139900 31425 raft_consensus.cc:697] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 14 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:34.206722 25760 raft_consensus.cc:2468] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 15.
I20260709 12:25:34.388479 26433 raft_consensus.cc:1275] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:25:34.215301 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:34.389639 25761 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:25:34.217481 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:34.236089 31520 raft_consensus.cc:2749] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:34.243050 25726 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:34.243849 31502 consensus_queue.cc:1048] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:25:34.104040 30884 raft_consensus.cc:2749] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:34.102523 31329 raft_consensus.cc:2804] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:25:34.256767 31472 log.cc:927] Time spent T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 12:25:34.258970 31175 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:34.261644 31522 log.cc:927] Time spent T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 12:25:34.100533 31510 raft_consensus.cc:3060] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:34.265662 31255 consensus_meta.cc:287] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.618s	user 0.006s	sys 0.003s
W20260709 12:25:34.276204 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 85921.1us
I20260709 12:25:34.277712 31513 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.118608 31476 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:34.280534 31518 log.cc:927] Time spent T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
I20260709 12:25:34.186923 31481 raft_consensus.cc:2749] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:34.283957 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 165604us
I20260709 12:25:34.294998 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:34.297385 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:34.300346 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:25:34.319901 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 218062us
I20260709 12:25:34.466440 25836 raft_consensus.cc:2393] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 15: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:34.467371 26402 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:34.101794 31165 raft_consensus.cc:2804] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:34.360316 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:34.471421 26401 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:25:34.370693 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:34.374699 26430 raft_consensus.cc:1240] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 15. Current term is 16. Ops: []
W20260709 12:25:34.375804 31536 log.cc:927] Time spent T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:25:34.376961 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:34.370219 31500 raft_consensus.cc:2804] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:34.391958 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:34.483012 25762 raft_consensus.cc:2468] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 11.
I20260709 12:25:34.383450 31528 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:34.338868 25649 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:34.342451 26438 raft_consensus.cc:3055] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:25:34.484200 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:34.484419 26438 raft_consensus.cc:740] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
W20260709 12:25:34.484831 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:34.399168 25757 raft_consensus.cc:1275] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 16 index: 7. Preceding OpId from leader: term: 17 index: 7. (term mismatch)
W20260709 12:25:34.401711 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:34.398324 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 155427us
I20260709 12:25:34.459210 25801 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:34.255686 31118 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:34.400257 31329 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:34.468586 26402 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:34.393963 31501 consensus_queue.cc:1243] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer f82778701b464892aab92a752ed7ffdc log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:25:34.367743 25683 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:34.482030 25680 raft_consensus.cc:1275] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
I20260709 12:25:34.498482 25680 pending_rounds.cc:85] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc: Aborting all ops after (but not including) 7
I20260709 12:25:34.498989 25680 pending_rounds.cc:107] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 12:25:34.499279 25680 raft_consensus.cc:2889] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:34.485375 25757 pending_rounds.cc:85] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 6
I20260709 12:25:34.404156 31448 raft_consensus.cc:2804] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:34.492545 25758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 3325) took 1352 ms. Trace:
W20260709 12:25:34.492977 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 154245us
W20260709 12:25:34.447484 31521 log.cc:927] Time spent T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:25:34.500089 25757 pending_rounds.cc:107] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 16.7
I20260709 12:25:34.502170 25757 raft_consensus.cc:2889] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:34.492311 31528 raft_consensus.cc:3060] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:34.457306 31175 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:34.503363 25760 raft_consensus.cc:1275] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:25:34.500444 25801 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:34.500982 25758 rpcz_store.cc:276] 0709 12:25:33.140379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:33.140960 (+   581us) service_pool.cc:224] Handling call
0709 12:25:33.141354 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:33.266856 (+125502us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:33.266888 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:33.279402 (+ 12514us) log.cc:844] Serialized 26 byte log entry
0709 12:25:33.666551 (+387149us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:33.666588 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:33.666648 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:34.492300 (+825652us) raft_consensus.cc:1685] finished
0709 12:25:34.492324 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:34.492477 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":139993,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"thread_start_us":438712,"threads_started":2,"wal-append.queue_time_us":552711}
I20260709 12:25:34.501358 25649 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:34.513365 25801 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:34.520430 25681 raft_consensus.cc:1275] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:34.487176 30884 raft_consensus.cc:2804] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:34.493315 31130 raft_consensus.cc:2804] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:34.482540 31165 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:34.497051 31461 raft_consensus.cc:2749] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:25:34.528434 25758 raft_consensus.cc:3055] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:34.574765 25758 raft_consensus.cc:740] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:34.483157 31500 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:34.528985 25681 raft_consensus.cc:1275] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:25:34.531354 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:34.465837 31513 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:34.573913 25801 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:34.539294 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:34.501601 31329 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:34.604138 25801 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:34.595723 25800 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:34.520555 31255 raft_consensus.cc:2804] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:34.527225 30884 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:34.674377 25763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 3335) took 1004 ms. Trace:
I20260709 12:25:34.609457 31253 raft_consensus.cc:2804] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:34.609375 31165 raft_consensus.cc:3060] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:34.581498 31118 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:34.608695 25686 raft_consensus.cc:1275] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 12:25:34.662081 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 58069.9us
W20260709 12:25:34.662202 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 66578.7us
I20260709 12:25:34.524569 31371 raft_consensus.cc:2804] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:34.660027 25758 consensus_queue.cc:260] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:34.667850 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 58963.6us
I20260709 12:25:34.672235 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:34.698376 25830 raft_consensus.cc:3060] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:34.673904 31401 raft_consensus.cc:2804] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:34.525583 31175 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:34.529628 31130 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:34.674939 25763 rpcz_store.cc:276] 0709 12:25:33.669689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:33.669813 (+   124us) service_pool.cc:224] Handling call
0709 12:25:33.670126 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:33.699679 (+ 29553us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:25:33.699725 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:33.700323 (+   598us) log.cc:844] Serialized 26 byte log entry
0709 12:25:33.776632 (+ 76309us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b4800002dd8. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9ea8aaa1 00007f5d9ea81b37 00007f5d9ea819ca 00007f5d9eb7926f 00007f5d9eb78f37 00007f5d9eb8d55c 00007f5d9eb8d508 00007f5d9eb8d488 00007f5d9eb8d443 00007f5d9eb8c6ec 00007f5d9dab6a96
0709 12:25:34.094890 (+318258us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:34.094951 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:34.095043 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:34.664031 (+568988us) raft_consensus.cc:1685] finished
0709 12:25:34.664057 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:34.674291 (+ 10234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35351,"raft.queue_time_us":21736,"raft.run_cpu_time_us":2393,"raft.run_wall_time_us":71150,"spinlock_wait_cycles":26559744,"thread_start_us":363307,"threads_started":1,"wal-append.queue_time_us":563514}
I20260709 12:25:34.501482 31520 raft_consensus.cc:2804] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:25:34.723013 31538 log.cc:927] Time spent T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:25:34.723117 31520 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:34.723649 31520 raft_consensus.cc:3060] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:34.722683 25726 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:34.726526 25726 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:34.727465 25726 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:34.601418 31533 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:34.731381 25726 leader_election.cc:400] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237) with higher term. Message: Invalid argument: T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 13. Current term is 14.
I20260709 12:25:34.609706 31500 raft_consensus.cc:3060] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:34.732856 25726 leader_election.cc:403] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:34.735702 25830 raft_consensus.cc:2468] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 15.
I20260709 12:25:34.679947 30884 raft_consensus.cc:3060] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:34.678313 31475 raft_consensus.cc:2804] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:34.713943 31461 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.747026 31461 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:34.749315 31461 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:34.749496 25830 raft_consensus.cc:1275] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 15 index: 6. Preceding OpId from leader: term: 17 index: 7. (index mismatch)
I20260709 12:25:34.712527 31259 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.756433 31520 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:34.756822 31259 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:34.751680 31500 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:34.757756 30884 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:34.665297 31393 raft_consensus.cc:2749] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:34.716221 25650 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:34.722631 31130 raft_consensus.cc:3060] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:34.682152 31255 raft_consensus.cc:697] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 15 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:34.660791 25683 raft_consensus.cc:2410] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 12:25:34.736410 25758 raft_consensus.cc:3060] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:34.689754 31253 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:34.740629 25761 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 20.
I20260709 12:25:34.720772 31422 consensus_queue.cc:1048] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
W20260709 12:25:34.762809 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 46685.7us
I20260709 12:25:34.767344 25650 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:25:34.764449 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 283325us
I20260709 12:25:34.577808 31425 consensus_queue.cc:237] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:34.775013 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:34.775635 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:34.778059 25830 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:34.785336 31259 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:34.773697 31253 raft_consensus.cc:3060] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:34.788795 31255 consensus_queue.cc:237] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:34.791409 31458 raft_consensus.cc:3060] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:34.803886 25830 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 20.
W20260709 12:25:34.814325 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 345710us
W20260709 12:25:34.815984 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:34.768517 31274 raft_consensus.cc:2804] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:34.721326 31166 consensus_queue.cc:1059] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.088s
I20260709 12:25:34.773787 31502 raft_consensus.cc:2749] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:25:34.819993 25835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41782 (request call id 1188) took 1005 ms. Trace:
I20260709 12:25:34.823485 26438 consensus_queue.cc:260] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:34.826584 26438 raft_consensus.cc:3060] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:34.824193 25835 rpcz_store.cc:276] 0709 12:25:33.814553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:33.814689 (+   136us) service_pool.cc:224] Handling call
0709 12:25:33.814995 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:33.982527 (+167532us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:25:34.289963 (+307436us) log.cc:844] Serialized 14 byte log entry
0709 12:25:34.376808 (+ 86845us) spinlock_profiling.cc:243] Waited 5.17 ms on lock 0x7b180040a980. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d96a56e07 00007f5d9f8b19a9 00007f5d96a7369b 00007f5d96a7193f 00007f5d96a73c02 00007f5d996fb20b 00007f5d99700d23 00007f5d9970123a 00007f5d99b6ba2a
0709 12:25:34.658801 (+281993us) log.cc:844] Serialized 14 byte log entry
0709 12:25:34.672722 (+ 13921us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:34.672798 (+    76us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:34.672864 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:34.816444 (+143580us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b54002f6054. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:34.816501 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:34.819897 (+  3396us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15368,"prepare.queue_time_us":299265,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":46167,"raft.run_cpu_time_us":307,"raft.run_wall_time_us":20855,"spinlock_wait_cycles":429838592,"thread_start_us":523455,"threads_started":2}
I20260709 12:25:34.794757 31461 raft_consensus.cc:2804] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:34.844636 26438 raft_consensus.cc:1275] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 12:25:34.845304 26438 pending_rounds.cc:85] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89: Aborting all ops after (but not including) 10
I20260709 12:25:34.845670 26438 pending_rounds.cc:107] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 12:25:34.846323 25758 raft_consensus.cc:1275] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 12:25:34.847342 25758 pending_rounds.cc:85] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 11
I20260709 12:25:34.847731 25758 pending_rounds.cc:107] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 12:25:34.848030 25758 raft_consensus.cc:2889] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:34.846331 26438 raft_consensus.cc:2889] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:34.816103 31165 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:34.843780 31461 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:34.864898 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:34.843566 31274 raft_consensus.cc:697] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 14 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:34.866060 26438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 1398) took 1151 ms. Trace:
I20260709 12:25:34.849529 31456 raft_consensus.cc:3055] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:34.868412 26438 rpcz_store.cc:276] 0709 12:25:33.713502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:33.730707 (+ 17205us) service_pool.cc:224] Handling call
0709 12:25:33.756059 (+ 25352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:34.144129 (+388070us) spinlock_profiling.cc:243] Waited 30.8 ms on lock 0x7b54007d5da0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99ad8dc0 00007f5d99b631c0 00007f5d99b64231 00007f5d99b60d8f 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c
0709 12:25:34.823167 (+679038us) spinlock_profiling.cc:243] Waited 19.7 ms on lock 0x7b54007d5da0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99adf06f 00007f5d99b57f60 00007f5d99b597de 00007f5d99b63b49 00007f5d99b64416 00007f5d99b60d8f 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62
0709 12:25:34.864345 (+ 41178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:34.864546 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":116180608}
I20260709 12:25:34.869302 31456 raft_consensus.cc:740] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
W20260709 12:25:34.870285 31540 log.cc:927] Time spent T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:25:34.871023 31456 consensus_queue.cc:260] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:34.871448 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:34.872017 25686 raft_consensus.cc:3060] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:34.872296 31456 raft_consensus.cc:3060] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:34.854723 31476 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:34.877017 31528 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:34.878595 31541 log.cc:927] Time spent T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:25:34.880654 31550 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.881337 31550 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:34.884500 25650 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:34.886854 31476 raft_consensus.cc:2749] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:34.887115 31494 consensus_queue.cc:1048] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:34.889412 25650 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:34.890184 31494 raft_consensus.cc:2804] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:25:34.890679 31494 raft_consensus.cc:697] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 20 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:34.891571 31494 consensus_queue.cc:237] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:34.884637 31548 raft_consensus.cc:2804] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:34.892633 31548 raft_consensus.cc:697] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 12 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:34.893613 31253 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:34.893688 31548 consensus_queue.cc:237] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:34.869772 31513 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:25:34.894753 31343 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
W20260709 12:25:34.898276 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:34.900450 25828 raft_consensus.cc:1240] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 11. Current term is 12. Ops: []
W20260709 12:25:34.901746 31543 log.cc:927] Time spent T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:25:34.902827 31165 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:34.864109 31265 consensus_meta.cc:287] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.925s	user 0.009s	sys 0.004s
I20260709 12:25:34.905860 31265 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:34.908339 25678 raft_consensus.cc:2393] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 15: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:34.909164 31175 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:34.863863 31500 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:34.909821 31528 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:34.910813 31550 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:34.912441 31533 raft_consensus.cc:2749] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:34.909106 31329 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:34.854786 30884 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:34.866004 31461 raft_consensus.cc:3060] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:34.913750 26430 raft_consensus.cc:1240] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:25:34.914398 25833 raft_consensus.cc:1240] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:34.878629 25831 raft_consensus.cc:2393] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 14: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:34.917162 31274 consensus_queue.cc:237] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:34.919036 31329 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:34.920614 25680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2662) took 1566 ms. Trace:
I20260709 12:25:34.921000 25680 rpcz_store.cc:276] 0709 12:25:33.354423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:33.786461 (+432038us) service_pool.cc:224] Handling call
0709 12:25:33.786788 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:34.499813 (+713025us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:34.920329 (+420516us) spinlock_profiling.cc:243] Waited 677 ms on lock 0x7b5400264dd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:34.920547 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1557013248}
I20260709 12:25:34.923466 25834 raft_consensus.cc:2410] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:25:34.915654 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:25:34.925099 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:34.925065 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:34.926019 25833 raft_consensus.cc:2393] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 18: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:34.928205 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:34.928150 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:34.928962 25762 raft_consensus.cc:2468] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 16.
I20260709 12:25:34.930006 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:34.860100 31448 raft_consensus.cc:697] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:34.930644 25759 raft_consensus.cc:2468] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 12.
I20260709 12:25:34.935961 25686 raft_consensus.cc:2468] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 15.
I20260709 12:25:34.867659 26402 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:34.931126 25649 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:34.942543 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:34.943794 25833 raft_consensus.cc:2410] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:25:34.944905 25649 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:25:34.946028 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 78562.8us
I20260709 12:25:34.947021 26402 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:34.951476 26402 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:34.956578 26402 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:34.961572 26402 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:34.927579 31130 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:34.953452 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 180712us
I20260709 12:25:34.946811 31481 raft_consensus.cc:2804] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:34.949178 31329 raft_consensus.cc:2749] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:34.952884 31479 raft_consensus.cc:2804] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:34.955389 30884 raft_consensus.cc:2749] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:25:34.973716 31550 raft_consensus.cc:2749] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:25:34.973963 31500 raft_consensus.cc:2749] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:34.949502 31166 consensus_queue.cc:1048] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 12:25:35.020066 25830 raft_consensus.cc:1275] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 12:25:35.020606 25830 pending_rounds.cc:85] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a: Aborting all ops after (but not including) 12
I20260709 12:25:35.020888 25830 pending_rounds.cc:107] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 12:25:35.021158 25830 raft_consensus.cc:2889] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:35.009133 31481 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:34.953178 31456 consensus_queue.cc:1048] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 12:25:35.012965 31479 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:35.026383 25832 raft_consensus.cc:1275] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 12:25:35.031020 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 299805us
I20260709 12:25:35.025547 31479 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:35.026413 31481 raft_consensus.cc:3060] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:35.028856 30884 raft_consensus.cc:2749] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:35.052038 31552 raft_consensus.cc:2764] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 12:25:35.028362 31265 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:35.059161 31481 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:35.016609 31448 consensus_queue.cc:237] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:35.086491 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 392173us
I20260709 12:25:35.089455 31554 raft_consensus.cc:2749] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237) with higher term. Message: Invalid argument: T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 13. Current term is 14.
I20260709 12:25:35.089769 31481 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:35.092793 25726 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:35.090771 31554 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.099970 25726 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:35.118995 25726 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:35.120165 25726 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:35.121521 31494 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.096666 31265 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.093920 31475 raft_consensus.cc:697] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 15 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:35.093964 31520 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:35.135828 25684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51578 (request call id 1126) took 1096 ms. Trace:
I20260709 12:25:35.120926 31552 raft_consensus.cc:2804] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:35.149848 25678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 2669) took 1227 ms. Trace:
W20260709 12:25:35.146646 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 197775us
W20260709 12:25:35.165176 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 470636us
I20260709 12:25:35.159273 25678 rpcz_store.cc:276] 0709 12:25:33.908588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:33.909451 (+   863us) service_pool.cc:224] Handling call
0709 12:25:35.135799 (+1226348us) spinlock_profiling.cc:243] Waited 972 ms on lock 0x7b54002cfbd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:35.135990 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2235346304}
I20260709 12:25:35.124183 31253 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349)
I20260709 12:25:35.167183 25800 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:35.158541 25684 rpcz_store.cc:276] 0709 12:25:34.039559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:34.069874 (+ 30315us) service_pool.cc:224] Handling call
0709 12:25:34.092781 (+ 22907us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:34.497050 (+404269us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:25:34.520556 (+ 23506us) log.cc:844] Serialized 14 byte log entry
0709 12:25:34.895990 (+375434us) log.cc:844] Serialized 14 byte log entry
0709 12:25:34.896592 (+   602us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:34.896644 (+    52us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:34.896685 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:35.135532 (+238847us) spinlock_profiling.cc:243] Waited 404 ms on lock 0x7b54002dee54. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:35.135595 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:35.135753 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":23821,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":77,"raft.queue_time_us":186,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":139,"spinlock_wait_cycles":929242496,"thread_start_us":374453,"threads_started":1,"wal-append.queue_time_us":403926}
W20260709 12:25:35.172350 31510 consensus_meta.cc:287] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.707s	user 0.012s	sys 0.000s
I20260709 12:25:35.172767 31510 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:35.174049 31475 consensus_queue.cc:237] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:35.175375 31510 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:35.200500 31527 raft_consensus.cc:2804] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:25:35.201020 31559 log.cc:927] Time spent T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:25:35.201320 31527 raft_consensus.cc:697] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 15 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:35.168651 31528 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.202430 31527 consensus_queue.cc:237] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:35.202898 31528 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:35.135879 31130 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:35.133496 31513 consensus_queue.cc:1059] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 12:25:35.222859 25726 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:35.167774 25649 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:25:35.227401 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 59702.6us
I20260709 12:25:35.151399 31265 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:35.232319 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:35.243062 25755 raft_consensus.cc:2393] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 15: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:35.234282 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:35.243662 25762 raft_consensus.cc:3060] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:35.230607 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 233136us
I20260709 12:25:35.223466 31557 raft_consensus.cc:2764] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:25:35.136165 31165 consensus_queue.cc:1059] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.087s
I20260709 12:25:35.133706 31545 consensus_queue.cc:1048] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.113s
I20260709 12:25:35.163095 31552 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
W20260709 12:25:35.299886 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 95023us
I20260709 12:25:35.227835 31476 raft_consensus.cc:2804] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:35.234741 31510 raft_consensus.cc:2804] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:35.121372 31554 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:35.239650 31562 raft_consensus.cc:2764] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:25:35.240736 31461 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:35.288457 25837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41782 (request call id 1189) took 1419 ms. Trace:
W20260709 12:25:35.270040 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 267800us
I20260709 12:25:35.149549 31479 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:35.146278 31494 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:35.328613 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 240082us
I20260709 12:25:35.298411 31460 raft_consensus.cc:2749] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:35.286916 31371 raft_consensus.cc:697] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 15 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:35.223790 31118 consensus_queue.cc:1048] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.105s
I20260709 12:25:35.301491 31253 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:35.322639 31552 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:35.373816 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:35.374622 26431 raft_consensus.cc:3060] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:35.375679 25683 raft_consensus.cc:2393] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 14: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:35.348863 25831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44202 (request call id 3216) took 1054 ms. Trace:
I20260709 12:25:35.376142 25831 rpcz_store.cc:276] 0709 12:25:34.294563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:34.294688 (+   125us) service_pool.cc:224] Handling call
0709 12:25:35.348659 (+1053971us) spinlock_profiling.cc:243] Waited 412 ms on lock 0x7b540035a054. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:35.348801 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":948519808}
I20260709 12:25:35.331861 26402 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:35.356519 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:35.378329 26438 raft_consensus.cc:2393] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 14: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:35.340510 25837 rpcz_store.cc:276] 0709 12:25:33.869205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:33.869477 (+   272us) service_pool.cc:224] Handling call
0709 12:25:33.878522 (+  9045us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:33.885034 (+  6512us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:33.885075 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:33.922257 (+ 37182us) log.cc:844] Serialized 52 byte log entry
0709 12:25:34.021702 (+ 99445us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:34.772038 (+750336us) log.cc:844] Serialized 14 byte log entry
0709 12:25:35.288032 (+515994us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:35.288132 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:35.288183 (+    51us) raft_consensus.cc:1685] finished
0709 12:25:35.288198 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:35.288386 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":580093,"prepare.queue_time_us":269985,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":442958,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":865,"spinlock_wait_cycles":31439232,"thread_start_us":740851,"threads_started":3,"wal-append.queue_time_us":152326}
W20260709 12:25:35.380085 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 53279.9us
I20260709 12:25:35.335258 31510 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:35.329584 31476 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:35.361151 26432 raft_consensus.cc:1240] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:35.400487 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:35.346771 26401 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:35.341532 31557 raft_consensus.cc:2764] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:25:35.418404 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:35.408279 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:35.408371 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:35.349450 31513 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
W20260709 12:25:35.401474 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:35.412165 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 80387.3us
I20260709 12:25:35.452309 26402 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:35.453941 25762 raft_consensus.cc:2468] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 12.
I20260709 12:25:35.419312 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:25:35.434806 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 88249.4us
I20260709 12:25:35.456915 26401 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:35.350274 31401 raft_consensus.cc:697] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 16 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:35.460942 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:35.461623 25685 raft_consensus.cc:3060] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:35.358918 31533 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:35.421222 31510 raft_consensus.cc:3060] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:35.418152 31520 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:35.446589 31476 raft_consensus.cc:3060] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:35.451159 31130 raft_consensus.cc:2749] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:35.442497 31569 raft_consensus.cc:2804] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:25:35.401255 31253 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:35.530229 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 127621us
I20260709 12:25:35.470377 31578 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.516040 30884 raft_consensus.cc:2804] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:25:35.547014 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:35.474344 31533 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:35.465804 31513 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:35.603865 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 146921us
W20260709 12:25:35.580358 31536 log.cc:927] Time spent T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 12:25:35.617775 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:35.620899 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:35.528343 31575 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:35.622897 25762 raft_consensus.cc:1240] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:35.510164 31520 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:35.628104 25763 raft_consensus.cc:1275] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:25:35.538174 31569 raft_consensus.cc:697] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 21 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:35.578840 30884 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:35.633014 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:35.632257 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:35.633955 25763 raft_consensus.cc:2368] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 19. Current term is 20.
I20260709 12:25:35.619638 31165 consensus_queue.cc:1048] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 12:25:35.620004 31401 consensus_queue.cc:237] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:35.639182 31563 log.cc:927] Time spent T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.308s	user 0.000s	sys 0.001s
I20260709 12:25:35.637229 25756 raft_consensus.cc:2393] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 10: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:35.634421 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:35.643468 25762 raft_consensus.cc:2393] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 15: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:35.644266 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:35.640478 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
W20260709 12:25:35.656209 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 125265us
W20260709 12:25:35.658429 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 143665us
I20260709 12:25:35.545519 31528 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:25:35.639215 31582 log.cc:927] Time spent T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:25:35.636370 30884 raft_consensus.cc:3060] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:35.577335 31578 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:35.667214 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:35.635882 31118 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:35.582883 31371 consensus_queue.cc:237] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:35.672825 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:35.650514 31265 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:35.717332 31513 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:35.668239 31593 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:35.718590 31593 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:35.720891 31593 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:35.721676 31479 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:35.723706 25757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 3346) took 1205 ms. Trace:
I20260709 12:25:35.642344 31580 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:35.732405 31580 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:35.734150 31253 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:35.734684 31580 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:35.723277 31118 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:35.738942 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:35.739256 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:35.739634 26439 raft_consensus.cc:2468] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 12.
I20260709 12:25:35.739902 26434 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 15.
I20260709 12:25:35.724117 25757 rpcz_store.cc:276] 0709 12:25:34.518685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:34.519157 (+   472us) service_pool.cc:224] Handling call
0709 12:25:34.519451 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:34.866550 (+347099us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:34.866578 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:34.869997 (+  3419us) log.cc:844] Serialized 26 byte log entry
0709 12:25:35.033161 (+163164us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:35.033210 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:35.033297 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:35.723505 (+690208us) raft_consensus.cc:1685] finished
0709 12:25:35.723525 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:35.723649 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1068,"raft.queue_time_us":139122,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":18803,"thread_start_us":508455,"threads_started":2,"wal-append.queue_time_us":307291}
I20260709 12:25:35.743899 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:35.753393 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:35.754277 26436 raft_consensus.cc:2410] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
W20260709 12:25:35.754630 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 70987.9us
I20260709 12:25:35.682715 25762 raft_consensus.cc:2468] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 16.
I20260709 12:25:35.685606 31584 consensus_queue.cc:1059] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:35.686635 31577 consensus_queue.cc:1048] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:25:35.687541 31576 log.cc:927] Time spent T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:25:35.688163 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:35.683959 31461 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:35.688539 31528 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:35.758975 31528 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:35.761243 31528 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:35.764226 31560 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.764938 31560 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:35.688827 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 12 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:35.689952 31520 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:35.636059 31575 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:35.769551 26438 raft_consensus.cc:1275] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:25:35.770115 31575 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:35.773924 31578 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:35.690711 25650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:35.692057 31569 consensus_queue.cc:237] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 17, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:35.694865 25801 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:35.697296 31537 raft_consensus.cc:3055] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:35.701779 31476 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:35.782320 25835 raft_consensus.cc:1275] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:25:35.783413 31476 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:35.780651 31537 raft_consensus.cc:740] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:35.784577 25837 raft_consensus.cc:1275] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:25:35.784813 25832 raft_consensus.cc:1275] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:25:35.784922 31537 consensus_queue.cc:260] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:35.786150 31537 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:35.786453 31130 raft_consensus.cc:2749] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:35.783691 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:25:35.788019 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 93233.1us
I20260709 12:25:35.789283 25650 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
W20260709 12:25:35.710711 31565 log.cc:927] Time spent T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.352s	user 0.001s	sys 0.000s
W20260709 12:25:35.712616 31583 log.cc:927] Time spent T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:25:35.713827 31554 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:35.739732 26437 raft_consensus.cc:1240] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:35.688360 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:35.738607 31118 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:35.796593 25726 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
W20260709 12:25:35.798729 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 127990us
I20260709 12:25:35.799834 25800 leader_election.cc:400] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 election: Vote denied by peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267) with higher term. Message: Invalid argument: T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 19. Current term is 20.
I20260709 12:25:35.801378 25800 leader_election.cc:403] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 12:25:35.803723 26431 raft_consensus.cc:2468] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 12.
I20260709 12:25:35.804648 26435 raft_consensus.cc:1240] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:25:35.780797 31175 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.805145 25801 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:35.767669 31560 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:35.811605 25685 raft_consensus.cc:2468] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 13.
I20260709 12:25:35.804136 31528 raft_consensus.cc:2749] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:35.795046 31461 raft_consensus.cc:2804] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:35.780916 31165 consensus_queue.cc:1048] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 12:25:35.818861 31166 consensus_queue.cc:1048] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:35.819350 25650 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:35.819832 31561 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.817821 26401 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:35.806890 31584 raft_consensus.cc:3055] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:35.828833 25650 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:35.834759 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:35.837666 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:25:35.838449 31564 log.cc:927] Time spent T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.390s	user 0.001s	sys 0.000s
I20260709 12:25:35.838711 25756 raft_consensus.cc:1240] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:35.814857 31175 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:35.840436 25759 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.047s	sys 0.056s
W20260709 12:25:35.841127 25759 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.047s	sys 0.056s
I20260709 12:25:35.818163 31461 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:35.838508 26437 raft_consensus.cc:2393] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 14: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:35.819075 31579 consensus_queue.cc:1048] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:25:35.828282 31422 raft_consensus.cc:2749] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:35.849579 26431 raft_consensus.cc:1275] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:25:35.836072 31596 raft_consensus.cc:2804] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:35.830876 31584 raft_consensus.cc:740] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:35.853101 26436 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:35.834394 31166 raft_consensus.cc:2749] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:25:35.847741 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 395518us
I20260709 12:25:35.859575 25801 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:35.846764 31528 raft_consensus.cc:2749] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 12:25:35.862078 25681 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.500s	user 0.003s	sys 0.002s
I20260709 12:25:35.865584 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:35.850975 31461 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:25:35.875563 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 75926us
I20260709 12:25:35.830020 31566 consensus_queue.cc:1059] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 12:25:35.879998 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:35.880774 25800 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:35.885377 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 15 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:35.893105 31175 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:35.905884 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 77152us
I20260709 12:25:35.907007 26402 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
W20260709 12:25:35.916563 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 120085us
I20260709 12:25:35.883703 31520 raft_consensus.cc:2804] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:35.921039 26402 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:35.926595 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:35.926611 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:35.927433 25762 raft_consensus.cc:2468] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 12.
I20260709 12:25:35.927703 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:35.928071 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:35.928674 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:35.874434 31118 consensus_queue.cc:1048] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:25:35.929318 25754 raft_consensus.cc:2468] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 14.
I20260709 12:25:35.930505 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:35.931964 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:35.933547 25828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 3214) took 1639 ms. Trace:
I20260709 12:25:35.934262 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:35.820387 31561 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:35.879060 31253 consensus_queue.cc:1059] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:25:35.937563 25762 raft_consensus.cc:2393] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 15: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:35.940567 25837 raft_consensus.cc:2393] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 15: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:35.933933 25828 rpcz_store.cc:276] 0709 12:25:34.293913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:34.294055 (+   142us) service_pool.cc:224] Handling call
0709 12:25:34.369113 (+ 75058us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:34.900980 (+531867us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:35.933340 (+1032360us) spinlock_profiling.cc:243] Waited 531 ms on lock 0x7b5400359654. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:35.933487 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1221383936}
I20260709 12:25:35.908344 31580 raft_consensus.cc:2749] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267) with higher term. Message: Invalid argument: T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 19. Current term is 20.
I20260709 12:25:35.916311 31560 raft_consensus.cc:2749] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:35.939060 25681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2682) took 1421 ms. Trace:
I20260709 12:25:35.917484 31528 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:35.907363 31597 raft_consensus.cc:2749] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:35.944993 25726 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:35.920931 31166 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:35.948791 25681 rpcz_store.cc:276] 0709 12:25:34.517923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:34.607366 (+ 89443us) service_pool.cc:224] Handling call
0709 12:25:34.666667 (+ 59301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:34.666961 (+   294us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:25:34.688605 (+ 21644us) log.cc:844] Serialized 14 byte log entry
0709 12:25:35.199111 (+510506us) spinlock_profiling.cc:243] Waited 4.01 ms on lock 0x7b18004bd060. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d96a56e07 00007f5d9f8b19a9 00007f5d96a7369b 00007f5d96a7193f 00007f5d96a73c02 00007f5d996fb20b 00007f5d99700d23 00007f5d9970123a 00007f5d99b6ba2a
0709 12:25:35.361748 (+162637us) log.cc:844] Serialized 14 byte log entry
0709 12:25:35.698805 (+337057us) spinlock_profiling.cc:243] Waited 5.12 ms on lock 0x7b18004bd060. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d96a743f3 00007f5d96a767c1 00007f5d96a76779 00007f5d96a76709 00007f5d96a766d1 00007f5d96a759cd 0000000000388634 0000000000388479 00007f5d96a5783a
0709 12:25:35.701963 (+  3158us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b18004bd060. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d96a422a6 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d96a74522 00007f5d96a767c1
0709 12:25:35.702806 (+   843us) spinlock_profiling.cc:243] Waited 7.17 ms on lock 0x7b18004bd060. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d96a74522 00007f5d96a767c1 00007f5d96a76779 00007f5d96a76709 00007f5d96a766d1 00007f5d96a759cd 0000000000388634 0000000000388479 00007f5d96a5783a
0709 12:25:35.884662 (+181856us) log.cc:844] Serialized 14 byte log entry
0709 12:25:35.938739 (+ 54077us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:35.938787 (+    48us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:35.938828 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:35.938887 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:35.939009 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46747,"prepare.queue_time_us":36035,"prepare.run_cpu_time_us":150,"prepare.run_wall_time_us":3017,"raft.queue_time_us":247536,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":3933,"spinlock_wait_cycles":89487872,"thread_start_us":674055,"threads_started":2,"wal-append.queue_time_us":848152}
I20260709 12:25:35.952212 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:35.955952 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:35.956840 25801 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:35.957026 25686 raft_consensus.cc:1240] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 11. Current term is 12. Ops: [11.6-11.6]
I20260709 12:25:35.930655 31575 raft_consensus.cc:2749] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:35.961586 26433 raft_consensus.cc:1275] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:25:35.960105 25759 raft_consensus.cc:1275] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:25:35.932576 31569 raft_consensus.cc:2804] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:35.974839 25726 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:35.926049 31567 consensus_queue.cc:1048] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 12:25:35.943992 31520 raft_consensus.cc:697] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 13 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
W20260709 12:25:35.993348 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:36.015131 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:35.935667 31481 consensus_queue.cc:1048] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:25:35.935417 31457 consensus_queue.cc:1048] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:25:35.963554 31502 raft_consensus.cc:2749] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:25:36.022845 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 98642.8us
I20260709 12:25:36.022921 25726 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:36.021241 31593 raft_consensus.cc:2804] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:35.963615 31554 consensus_queue.cc:1048] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 12:25:35.962231 31422 consensus_queue.cc:1048] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 12:25:35.963409 31528 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:35.980667 31569 raft_consensus.cc:697] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 15 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:36.062351 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:36.104503 26437 raft_consensus.cc:3060] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:35.921345 31584 consensus_queue.cc:260] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:35.965240 31166 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:36.030777 31593 raft_consensus.cc:697] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 16 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
W20260709 12:25:36.090867 25651 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.009s	sys 0.019s
W20260709 12:25:36.135488 25651 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.013s	sys 0.023s
I20260709 12:25:35.965512 31594 consensus_queue.cc:1059] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.074s
W20260709 12:25:36.092363 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 72710.1us
I20260709 12:25:36.140213 25726 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:36.142457 26436 raft_consensus.cc:2410] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
W20260709 12:25:36.175684 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:36.064561 31502 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:36.109759 31597 raft_consensus.cc:2804] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:36.270366 31527 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.278429 31456 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:36.277990 31596 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:36.299185 31594 raft_consensus.cc:2764] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
I20260709 12:25:36.285300 31274 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:36.354663 31481 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.395561 31596 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:36.297464 31619 consensus_queue.cc:1059] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.144s
I20260709 12:25:36.363461 31597 raft_consensus.cc:697] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 12 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
W20260709 12:25:36.442320 31510 consensus_meta.cc:287] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.898s	user 0.009s	sys 0.004s
W20260709 12:25:36.354563 31371 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.013s	sys 0.021s
I20260709 12:25:36.423307 31166 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:36.447878 31610 log.cc:927] Time spent T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.314s	user 0.001s	sys 0.000s
I20260709 12:25:36.400015 31527 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:36.403745 31456 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:36.447453 31561 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:25:36.508131 31371 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.014s	sys 0.021s
I20260709 12:25:36.451252 31598 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:36.441941 31274 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:36.355724 31520 consensus_queue.cc:237] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:36.508957 31552 consensus_meta.cc:287] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 1.065s	user 0.010s	sys 0.003s
I20260709 12:25:36.290474 31502 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:36.448423 31481 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:36.541148 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:36.510179 31510 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:36.546607 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 406467us
I20260709 12:25:36.549823 25726 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
W20260709 12:25:36.538444 31615 log.cc:927] Time spent T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.516s	user 0.000s	sys 0.001s
I20260709 12:25:36.446623 31569 consensus_queue.cc:237] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:36.506440 31593 consensus_queue.cc:237] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:36.559725 25758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 3360) took 1328 ms. Trace:
W20260709 12:25:36.560985 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:36.560376 25758 rpcz_store.cc:276] 0709 12:25:35.230870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:35.233076 (+  2206us) service_pool.cc:224] Handling call
0709 12:25:35.233494 (+   418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:35.537998 (+304504us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:35.538032 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:35.538513 (+   481us) log.cc:844] Serialized 26 byte log entry
0709 12:25:35.861838 (+323325us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:35.861884 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:35.861962 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:36.559501 (+697539us) raft_consensus.cc:1685] finished
0709 12:25:36.559522 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:36.559651 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":92899,"raft.queue_time_us":168570,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":29532,"thread_start_us":465016,"threads_started":2,"wal-append.queue_time_us":441002}
I20260709 12:25:36.532613 31552 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:36.567871 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:36.563396 31554 raft_consensus.cc:2764] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
W20260709 12:25:36.563553 31614 log.cc:927] Time spent T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.472s	user 0.000s	sys 0.001s
W20260709 12:25:36.564543 31618 log.cc:927] Time spent T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.273s	user 0.001s	sys 0.000s
I20260709 12:25:36.580334 25681 raft_consensus.cc:1240] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 16 LEADER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:36.589339 31510 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:36.593930 31611 log.cc:927] Time spent T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.325s	user 0.000s	sys 0.000s
I20260709 12:25:36.596768 31480 raft_consensus.cc:3055] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:36.599658 31460 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
W20260709 12:25:36.597640 31617 log.cc:927] Time spent T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.319s	user 0.001s	sys 0.000s
I20260709 12:25:36.597955 31597 consensus_queue.cc:237] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:36.600781 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:36.602936 31528 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:36.604948 25836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 3219) took 2145 ms. Trace:
I20260709 12:25:36.605407 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:36.640480 25682 raft_consensus.cc:3060] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:36.612226 31621 log.cc:927] Time spent T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
I20260709 12:25:36.527530 31598 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:36.606510 31329 raft_consensus.cc:3055] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:36.606851 31274 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:36.587502 25726 connection.cc:256] RPC call timeout handler was delayed by -4.9257006429998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1996s for a response
I20260709 12:25:36.596982 31527 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:36.624015 26437 consensus_meta.cc:287] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.501s	user 0.008s	sys 0.002s
W20260709 12:25:36.635031 25801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:36.687065 26437 raft_consensus.cc:2468] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 13.
I20260709 12:25:36.605564 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:36.659036 25759 raft_consensus.cc:1240] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:36.639175 25836 rpcz_store.cc:276] 0709 12:25:34.459167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:35.535845 (+1076678us) service_pool.cc:224] Handling call
0709 12:25:35.575285 (+ 39440us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:35.627383 (+ 52098us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:35.627426 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:35.627470 (+    44us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:25:35.627499 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:36.604773 (+977274us) spinlock_profiling.cc:243] Waited 51.9 ms on lock 0x7b54001b1554. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:36.604815 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:36.604902 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":119357696}
I20260709 12:25:36.676141 25762 raft_consensus.cc:1240] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:36.681066 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:25:36.683734 25726 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.245.132:35611 timed out after 1.673s (SENT) [suppressed 15 similar messages]
I20260709 12:25:36.614212 31480 raft_consensus.cc:740] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:36.608893 31476 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:36.701817 25677 raft_consensus.cc:1240] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 12. Current term is 13. Ops: []
W20260709 12:25:36.682816 30884 consensus_meta.cc:287] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.999s	user 0.007s	sys 0.006s
W20260709 12:25:36.704228 31627 log.cc:927] Time spent T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:25:36.705478 25677 raft_consensus.cc:1275] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:25:36.702840 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 44626.8us
I20260709 12:25:36.680364 31329 raft_consensus.cc:740] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:36.712801 25682 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 10.
I20260709 12:25:36.715106 31253 consensus_queue.cc:1059] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:25:36.715827 31598 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:36.716217 31253 raft_consensus.cc:3055] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:36.716733 31253 raft_consensus.cc:740] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:36.717679 31456 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:36.717799 31253 consensus_queue.cc:260] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:36.719230 31253 raft_consensus.cc:3060] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:25:36.721360 31537 consensus_meta.cc:287] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.935s	user 0.011s	sys 0.002s
I20260709 12:25:36.722506 25833 raft_consensus.cc:2410] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
W20260709 12:25:36.723330 31616 log.cc:927] Time spent T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.660s	user 0.001s	sys 0.001s
W20260709 12:25:36.725458 31624 log.cc:927] Time spent T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 12:25:36.726290 31550 consensus_queue.cc:1059] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:36.733947 31502 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:36.736517 31552 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:36.738145 31548 raft_consensus.cc:3055] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:36.738710 31548 raft_consensus.cc:740] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:36.743942 25649 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:36.748627 25649 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
W20260709 12:25:36.707656 31461 consensus_meta.cc:287] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.802s	user 0.008s	sys 0.004s
I20260709 12:25:36.759657 31456 raft_consensus.cc:2749] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:36.778733 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
W20260709 12:25:36.783245 25680 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 2686) took 1430 ms (client timeout 1773 ms). Trace:
W20260709 12:25:36.783792 25680 rpcz_store.cc:269] 0709 12:25:35.352655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:35.352787 (+   132us) service_pool.cc:224] Handling call
0709 12:25:36.766968 (+1414181us) spinlock_profiling.cc:243] Waited 6.82 ms on lock 0x7b5800003698. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d96a3cb71 00007f5d96a3ca22 00007f5d9f9558d9 00007f5d9eaafee0 00007f5d9eb790ab 00007f5d9eb79131 00007f5d9eb270a0 00007f5d9eb26984 00007f5d980a16d4 00007f5d980a1662
0709 12:25:36.783168 (+ 16200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15686016}
I20260709 12:25:36.779804 26435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 1413) took 1040 ms. Trace:
I20260709 12:25:36.786000 26435 rpcz_store.cc:276] 0709 12:25:35.739421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:35.753076 (+ 13655us) service_pool.cc:224] Handling call
0709 12:25:35.804385 (+ 51309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:35.805083 (+   698us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:36.764725 (+959642us) spinlock_profiling.cc:243] Waited 33.8 ms on lock 0x7b54003cb4d0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b608ad 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:36.779728 (+ 15003us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":77651328}
I20260709 12:25:36.638507 31460 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:36.702497 31494 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:36.813200 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:36.813993 25833 raft_consensus.cc:2468] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 12.
I20260709 12:25:36.815440 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:36.818372 25835 raft_consensus.cc:1240] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 20. Current term is 21. Ops: [20.18-20.18]
I20260709 12:25:36.698711 31476 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:36.782965 31274 raft_consensus.cc:2804] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:36.816149 25833 raft_consensus.cc:2468] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 14.
I20260709 12:25:36.822379 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:36.713536 30884 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:36.822669 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:36.828337 25830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 3226) took 2008 ms. Trace:
I20260709 12:25:36.828508 25836 raft_consensus.cc:1240] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 17. Current term is 18. Ops: []
I20260709 12:25:36.829412 25837 raft_consensus.cc:3060] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:36.833220 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 22 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:36.829917 25830 rpcz_store.cc:276] 0709 12:25:34.820202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:34.820905 (+   703us) service_pool.cc:224] Handling call
0709 12:25:35.019580 (+198675us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:35.030102 (+ 10522us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:36.828138 (+1798036us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b54002f5b50. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b608ad 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:36.828277 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":455457664}
I20260709 12:25:36.834976 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:36.835179 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:36.835582 25830 raft_consensus.cc:2468] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 17.
I20260709 12:25:36.823971 31510 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:36.836828 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:36.837613 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:36.841358 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:36.791759 31461 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:36.818243 31502 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:36.828101 31448 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.830173 31481 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:36.870174 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 178713us
I20260709 12:25:36.871014 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:36.940941 25760 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 17.
I20260709 12:25:36.867735 31476 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:36.882786 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:36.883677 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:36.882951 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:36.858767 25757 raft_consensus.cc:1275] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 11. (index mismatch)
I20260709 12:25:36.739841 31548 consensus_queue.cc:260] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:36.903574 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:25:36.884872 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 201153us
I20260709 12:25:36.936827 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:36.944334 26436 raft_consensus.cc:2393] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 14: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:36.944492 26430 raft_consensus.cc:2368] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 15. Current term is 16.
I20260709 12:25:36.937024 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:36.841526 31635 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:36.937964 25684 raft_consensus.cc:1240] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 17. Current term is 18. Ops: []
I20260709 12:25:36.939405 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:36.945628 25837 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 10.
I20260709 12:25:36.796674 31480 consensus_queue.cc:260] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:36.955940 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:36.956765 25686 raft_consensus.cc:2393] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 17: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:36.885350 31274 raft_consensus.cc:697] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 12 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:36.957702 31636 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.958401 31636 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:36.958603 31274 consensus_queue.cc:237] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:36.961423 31635 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:36.844130 31329 consensus_queue.cc:260] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:36.968819 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:36.972086 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:36.974699 25757 raft_consensus.cc:1275] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:25:36.975700 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:36.978209 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:36.978399 25760 raft_consensus.cc:1275] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:25:36.881788 31550 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:36.984511 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:36.986454 25680 raft_consensus.cc:3060] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:36.985723 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:36.996933 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:36.843453 31510 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:37.002978 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:36.938895 31570 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.902967 31502 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:36.929476 31448 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:36.996574 31458 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.996136 31622 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:37.031704 25726 connection.cc:256] RPC call timeout handler was delayed by -4.6926006429998779s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2255s for a response
I20260709 12:25:36.996352 31481 consensus_queue.cc:1048] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
W20260709 12:25:37.036134 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:37.039373 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:37.034106 25726 connection.cc:256] RPC call timeout handler was delayed by -4.2354006430000481s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2763s for a response
W20260709 12:25:37.040581 25726 connection.cc:256] RPC call timeout handler was delayed by -3.8790006429999266s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3159s for a response
W20260709 12:25:37.040993 25726 connection.cc:256] RPC call timeout handler was delayed by -3.2226382409999133s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.196s for a response
I20260709 12:25:37.041680 25680 raft_consensus.cc:2468] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 15.
I20260709 12:25:37.018762 31537 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:37.004549 31550 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:37.054319 25829 raft_consensus.cc:1240] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 14 LEADER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:37.054895 25761 raft_consensus.cc:1275] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:25:37.106633 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:37.120491 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:37.047896 31635 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:37.160843 25754 raft_consensus.cc:2468] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 14.
I20260709 12:25:37.025209 31476 consensus_queue.cc:1048] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 12:25:37.014173 31570 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:37.040001 31458 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:37.161761 31460 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:37.106426 31537 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:37.025008 31479 consensus_queue.cc:1059] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 12:25:37.107563 31597 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.033514 31596 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:37.190323 31636 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:37.015591 31630 consensus_queue.cc:1048] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:25:37.206264 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:37.208189 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:37.208817 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:37.048960 31622 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:37.208765 31520 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.216490 31554 consensus_queue.cc:1048] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.005s
I20260709 12:25:37.222205 31502 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:37.223268 31448 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:37.225801 31649 log.cc:927] Time spent T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 12:25:37.226428 31637 log.cc:927] Time spent T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.251s	user 0.000s	sys 0.001s
I20260709 12:25:37.203717 31461 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:37.232296 25758 raft_consensus.cc:2410] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
W20260709 12:25:37.201795 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 186597us
W20260709 12:25:37.257927 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 52181.2us
I20260709 12:25:37.220687 31597 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:37.294697 31253 consensus_meta.cc:287] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.575s	user 0.011s	sys 0.004s
I20260709 12:25:37.234218 31631 consensus_queue.cc:1048] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 12:25:37.295589 31533 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:37.297734 31537 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:37.301280 25726 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:37.302531 25726 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:37.296805 31550 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:37.304252 31502 raft_consensus.cc:2749] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:37.304540 31659 raft_consensus.cc:2804] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:37.305124 31659 raft_consensus.cc:697] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:37.304987 31502 consensus_queue.cc:1048] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:37.305712 26434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 1421) took 1279 ms. Trace:
I20260709 12:25:37.306041 31659 consensus_queue.cc:237] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:37.306082 26434 rpcz_store.cc:276] 0709 12:25:36.026801 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:36.060076 (+ 33275us) service_pool.cc:224] Handling call
0709 12:25:36.061262 (+  1186us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:36.505271 (+444009us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:36.505304 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:36.505788 (+   484us) log.cc:844] Serialized 26 byte log entry
0709 12:25:36.660147 (+154359us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:36.682744 (+ 22597us) log.cc:844] Serialized 14 byte log entry
0709 12:25:36.704121 (+ 21377us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:36.704228 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:37.305510 (+601282us) raft_consensus.cc:1685] finished
0709 12:25:37.305528 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:37.305658 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29693,"prepare.queue_time_us":26723,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":60513,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":31023,"thread_start_us":584760,"threads_started":2,"wal-append.queue_time_us":313482}
I20260709 12:25:37.308858 31570 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:37.273784 25650 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:37.309713 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:37.261418 31510 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:37.311476 31622 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:37.312227 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:37.312826 25757 raft_consensus.cc:2468] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 15.
I20260709 12:25:37.313655 31597 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:37.313997 26401 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:37.248135 31520 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:37.315232 31635 raft_consensus.cc:2804] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:37.315615 31635 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:37.315991 31635 raft_consensus.cc:3060] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:37.317278 31520 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:37.304261 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:37.321137 31651 log.cc:927] Time spent T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
W20260709 12:25:37.321074 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 48224.6us
I20260709 12:25:37.321928 31494 consensus_queue.cc:1048] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:25:37.322495 31658 log.cc:927] Time spent T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
W20260709 12:25:37.322916 31654 log.cc:927] Time spent T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 12:25:37.324056 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:37.324937 31481 consensus_queue.cc:1059] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:37.324111 31166 raft_consensus.cc:2804] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:37.326035 31166 raft_consensus.cc:697] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 13 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:37.326152 31461 raft_consensus.cc:3055] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:37.326627 31461 raft_consensus.cc:740] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:37.327035 31166 consensus_queue.cc:237] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:37.327376 31461 consensus_queue.cc:260] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:37.328405 31461 raft_consensus.cc:3060] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:37.328806 25758 raft_consensus.cc:3055] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:37.329139 25758 raft_consensus.cc:740] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:37.329785 25758 consensus_queue.cc:260] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:37.330755 25758 raft_consensus.cc:3060] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:37.336535 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:25:37.338085 25650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:37.338207 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:37.339022 26437 raft_consensus.cc:2393] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 15: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:37.342288 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:37.343392 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:37.343778 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:37.344373 26433 raft_consensus.cc:2468] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 14.
I20260709 12:25:37.345363 31569 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.345779 31265 raft_consensus.cc:3055] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:37.346206 31265 raft_consensus.cc:740] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:37.346940 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:37.347101 31265 consensus_queue.cc:260] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:37.352499 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:37.353117 25756 raft_consensus.cc:1240] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:37.352589 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:37.354159 26434 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:37.363758 26430 raft_consensus.cc:1240] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:37.363931 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:37.365124 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:37.367987 25582 catalog_manager.cc:5697] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 8 to 12, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 12 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:25:37.345811 31569 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:37.372280 31265 raft_consensus.cc:3060] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:37.373447 25684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2694) took 1421 ms. Trace:
I20260709 12:25:37.374240 31579 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:37.375130 25681 raft_consensus.cc:1240] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
W20260709 12:25:37.375564 25683 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51578 (request call id 1132) took 2511 ms (client timeout 1663 ms). Trace:
I20260709 12:25:37.380230 25582 catalog_manager.cc:5697] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 4 to 11, leader changed from a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 11 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:25:37.375603 31481 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.376838 31569 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:37.396606 25832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41782 (request call id 1201) took 1463 ms. Trace:
I20260709 12:25:37.378646 25650 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:37.374152 25801 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:37.382300 25758 raft_consensus.cc:1275] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 12:25:37.379734 25684 rpcz_store.cc:276] 0709 12:25:35.951687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:35.951847 (+   160us) service_pool.cc:224] Handling call
0709 12:25:35.966093 (+ 14246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:36.964076 (+997983us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:37.373235 (+409159us) spinlock_profiling.cc:243] Waited 972 ms on lock 0x7b54002cf1d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:37.373392 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2234706816}
I20260709 12:25:37.400368 25758 pending_rounds.cc:85] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 6
I20260709 12:25:37.400738 25758 pending_rounds.cc:107] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 12:25:37.401049 25758 raft_consensus.cc:2889] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:25:37.401669 25726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:37.380225 25683 rpcz_store.cc:269] 0709 12:25:34.864003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:34.864125 (+   122us) service_pool.cc:224] Handling call
0709 12:25:37.374800 (+2510675us) spinlock_profiling.cc:243] Waited 510 ms on lock 0x7b54002a0154. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:37.375458 (+   658us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1172625152}
I20260709 12:25:37.404789 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:37.398391 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:37.407423 26430 raft_consensus.cc:1240] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 12. Current term is 13. Ops: [12.10-12.10]
W20260709 12:25:37.410872 25801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:37.399549 25832 rpcz_store.cc:276] 0709 12:25:35.933661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:35.933769 (+   108us) service_pool.cc:224] Handling call
0709 12:25:35.949351 (+ 15582us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:36.468739 (+519388us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:36.468788 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:36.468846 (+    58us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:36.468893 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:37.396308 (+927415us) spinlock_profiling.cc:243] Waited 519 ms on lock 0x7b54002f4754. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:37.396373 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:37.396537 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1193797504}
I20260709 12:25:37.404083 25800 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:37.402400 25726 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:37.415421 25726 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:37.419649 25726 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:37.419885 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:37.421090 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:37.416231 31537 raft_consensus.cc:2749] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:37.421216 26434 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 18.
I20260709 12:25:37.468051 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:37.468990 26437 raft_consensus.cc:1240] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 17. Current term is 18. Ops: [17.15-17.15]
I20260709 12:25:37.423732 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:25:37.470350 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 46053.6us
I20260709 12:25:37.471484 25800 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:37.482913 25831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 3235) took 1795 ms. Trace:
I20260709 12:25:37.483450 25831 rpcz_store.cc:276] 0709 12:25:35.687114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:35.688906 (+  1792us) service_pool.cc:224] Handling call
0709 12:25:35.689206 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:35.689523 (+   317us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:35.689551 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:37.341056 (+1651505us) spinlock_profiling.cc:243] Waited 31.5 ms on lock 0x7b2c00105e78. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9845aa11 00007f5d9846a372 00007f5d99b9ca01 00007f5d99b6143a 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2
0709 12:25:37.341447 (+   391us) log.cc:844] Serialized 26 byte log entry
0709 12:25:37.472728 (+131281us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:37.472760 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:37.472834 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:37.482532 (+  9698us) raft_consensus.cc:1685] finished
0709 12:25:37.482560 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:37.482834 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5890,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"spinlock_wait_cycles":72382848,"thread_start_us":130913,"threads_started":1,"wal-append.queue_time_us":138993}
W20260709 12:25:37.475893 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 59210.1us
I20260709 12:25:37.408630 31481 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:37.419061 31422 consensus_queue.cc:1059] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.071s
I20260709 12:25:37.426631 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:25:37.489060 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 69482.8us
I20260709 12:25:37.490971 31481 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:37.474006 26430 raft_consensus.cc:2393] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 17: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:37.490428 25832 raft_consensus.cc:2468] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 15.
I20260709 12:25:37.418165 31460 consensus_queue.cc:1059] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.14, Next index: 15, Last known committed idx: 11, Time since last communication: 0.075s
I20260709 12:25:37.488952 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:37.377910 31253 consensus_queue.cc:1059] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.090s
I20260709 12:25:37.495739 26434 raft_consensus.cc:2393] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 15: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:37.495945 25726 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:37.418622 31597 raft_consensus.cc:2804] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:37.501109 31597 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:37.501546 31597 raft_consensus.cc:3060] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:37.406500 31579 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:37.503669 31579 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:37.495096 31619 consensus_queue.cc:1048] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 12:25:37.506100 31635 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:37.495184 31636 raft_consensus.cc:2804] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:37.416550 31655 raft_consensus.cc:2804] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:37.423296 31554 raft_consensus.cc:2804] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:37.418442 31510 consensus_queue.cc:1059] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 19.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.092s
I20260709 12:25:37.508242 31636 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:37.511250 31636 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:37.511310 31510 raft_consensus.cc:3055] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:25:37.511855 31510 raft_consensus.cc:740] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:37.426329 31502 consensus_queue.cc:1059] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 12:25:37.498266 31592 raft_consensus.cc:2804] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:37.515141 25726 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:37.500295 31539 consensus_queue.cc:1048] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 12:25:37.497517 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 22 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:37.509299 25650 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:37.498771 31605 raft_consensus.cc:2749] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:37.536265 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:37.508836 31655 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:37.508423 31660 raft_consensus.cc:2804] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:37.507634 31458 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:37.510650 31166 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.509212 31554 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
W20260709 12:25:37.573935 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 64715.8us
I20260709 12:25:37.575393 31579 consensus_queue.cc:1059] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:25:37.515210 31592 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:37.580260 25680 raft_consensus.cc:1240] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 13 LEADER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:37.579427 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:37.581159 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:25:37.584434 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 104815us
I20260709 12:25:37.495086 31513 consensus_queue.cc:1048] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:25:37.590745 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:37.590927 25684 raft_consensus.cc:1240] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:37.590821 25686 raft_consensus.cc:2468] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 15.
I20260709 12:25:37.592248 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:37.559159 31655 raft_consensus.cc:3060] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:37.594954 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:37.598661 25649 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:37.603302 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:37.610136 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:37.586891 31457 raft_consensus.cc:2804] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:37.612336 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:37.614218 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:37.574084 31660 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:37.587088 31554 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:37.589550 31592 raft_consensus.cc:3060] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:37.619853 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:37.619264 25832 raft_consensus.cc:3060] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:37.623744 25680 raft_consensus.cc:1275] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:25:37.631191 26430 raft_consensus.cc:1275] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:25:37.596910 31510 consensus_queue.cc:260] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.18, Last appended by leader: 18, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:37.632344 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:37.633121 31510 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:25:37.634305 31620 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.634835 31620 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:37.636471 31526 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:37.636982 31526 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:37.588464 31456 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:37.639597 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:37.593380 31458 raft_consensus.cc:3055] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:25:37.637269 31635 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:37.643592 31461 raft_consensus.cc:2749] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:25:37.643688 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 45155.2us
W20260709 12:25:37.644492 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 61991.1us
W20260709 12:25:37.652480 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:37.652047 25649 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:37.623766 31660 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:37.649434 25801 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:37.588369 31166 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:37.638856 31457 raft_consensus.cc:697] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 18 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:37.608918 31579 consensus_queue.cc:1048] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:25:37.660223 25649 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:37.633486 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:37.664312 31668 raft_consensus.cc:2749] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:25:37.664885 25801 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:37.645676 31458 raft_consensus.cc:740] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:37.650600 31539 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.712201 31539 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:37.713737 31457 consensus_queue.cc:237] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:37.714805 31458 consensus_queue.cc:260] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:37.715339 30884 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:37.715900 31458 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:37.721189 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:37.721822 25830 raft_consensus.cc:2468] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 16.
I20260709 12:25:37.722278 31118 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:37.722618 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:37.722819 31118 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:37.723225 25830 raft_consensus.cc:2468] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 14.
W20260709 12:25:37.727845 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 63032.6us
I20260709 12:25:37.728828 25801 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:37.730041 31422 raft_consensus.cc:2749] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:25:37.731067 31671 raft_consensus.cc:2749] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:37.730973 31461 consensus_queue.cc:1048] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 12:25:37.709925 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:25:37.728878 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 68774.1us
W20260709 12:25:37.730225 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:37.749627 26437 raft_consensus.cc:2410] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for term 14 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:25:37.692514 25829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 3218) took 3269 ms. Trace:
I20260709 12:25:37.731850 31671 raft_consensus.cc:2749] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:37.668453 31513 raft_consensus.cc:2749] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:37.648965 31456 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:37.733268 31166 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:37.733572 25801 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:37.734169 25683 raft_consensus.cc:1240] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 17. Current term is 18. Ops: []
I20260709 12:25:37.735209 31539 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:37.673451 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:37.736413 25650 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:37.736734 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:37.737188 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:37.738135 31274 raft_consensus.cc:3055] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:37.740020 31660 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:37.701530 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:37.668867 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:37.745081 25832 raft_consensus.cc:2468] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 17.
I20260709 12:25:37.745604 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:37.665846 31494 raft_consensus.cc:2804] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:37.666350 31561 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.750380 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:37.768467 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:37.788734 26436 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 15.
I20260709 12:25:37.789196 25681 raft_consensus.cc:1240] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 14. Current term is 15. Ops: []
W20260709 12:25:37.790241 25650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:37.784716 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:37.750113 25829 rpcz_store.cc:276] 0709 12:25:34.396784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:34.396960 (+   176us) service_pool.cc:224] Handling call
0709 12:25:34.400222 (+  3262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:37.106479 (+2706257us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:37.665395 (+558916us) spinlock_profiling.cc:243] Waited 2.65 s on lock 0x7b5400116a54. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:37.665561 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6103397632}
W20260709 12:25:37.783737 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 50242.6us
I20260709 12:25:37.793663 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:37.786877 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:37.756408 31274 raft_consensus.cc:740] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:37.810086 31274 consensus_queue.cc:260] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:37.794791 26437 raft_consensus.cc:2368] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 16. Current term is 18.
I20260709 12:25:37.811286 31274 raft_consensus.cc:3060] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:37.812330 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:37.812697 31166 consensus_queue.cc:1048] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:25:37.796818 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:37.797247 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:37.814975 26435 raft_consensus.cc:2468] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 14.
I20260709 12:25:37.797561 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:37.815840 26433 raft_consensus.cc:2368] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 16. Current term is 17.
I20260709 12:25:37.816040 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:37.817021 26435 raft_consensus.cc:2368] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 16. Current term is 17.
I20260709 12:25:37.818325 26435 raft_consensus.cc:1240] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 15. Current term is 16. Ops: [13.12-15.13]
I20260709 12:25:37.800767 26402 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:37.801462 31620 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:37.796213 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:37.748581 31596 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:37.802024 31118 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:37.804566 31526 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:37.805737 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:37.806133 31456 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:37.808167 31642 log.cc:927] Time spent T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.872s	user 0.000s	sys 0.004s
I20260709 12:25:37.810392 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:37.799347 25680 raft_consensus.cc:1275] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:25:37.821593 26435 raft_consensus.cc:1240] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:25:37.821996 25650 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:37.822510 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:37.813745 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:37.802487 31597 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:37.794966 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:37.823186 25801 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:37.784308 31537 raft_consensus.cc:2749] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:37.826014 26402 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:37.835497 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:37.835893 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:37.837440 26402 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:37.840093 26402 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:37.788144 31494 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:37.788419 31479 raft_consensus.cc:2749] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:37.842182 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:37.842770 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:37.847808 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:37.847971 26402 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:37.848810 26433 raft_consensus.cc:1240] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 21 LEADER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 20. Current term is 21. Ops: [20.18-20.18]
I20260709 12:25:37.849608 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:37.853200 25832 raft_consensus.cc:2468] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 18.
I20260709 12:25:37.833266 30884 raft_consensus.cc:2749] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:37.839278 31596 raft_consensus.cc:2749] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:37.842453 31118 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:37.863868 25677 raft_consensus.cc:1275] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260709 12:25:37.872269 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 357158us
I20260709 12:25:37.875602 25726 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:37.849040 31494 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:37.885047 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:37.816838 31561 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:37.889429 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:37.861080 31623 raft_consensus.cc:2804] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:37.890331 25681 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 15.
I20260709 12:25:37.895934 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:37.858992 25801 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:37.847007 31551 raft_consensus.cc:3060] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:37.846824 31526 raft_consensus.cc:2749] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:37.866994 26402 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:37.994853 26430 raft_consensus.cc:2468] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 16.
W20260709 12:25:38.040266 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 181396us
I20260709 12:25:38.041375 25801 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:38.046276 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:25:38.064898 25649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:38.070788 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:38.071691 25685 raft_consensus.cc:2468] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 15.
I20260709 12:25:37.863443 31570 consensus_queue.cc:1048] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.135s
I20260709 12:25:38.083420 25801 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:38.091657 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:25:38.109123 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:38.069834 31566 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:38.073860 31619 raft_consensus.cc:2749] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:38.133301 31510 raft_consensus.cc:2804] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:38.169514 31510 raft_consensus.cc:697] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:38.170769 31510 consensus_queue.cc:237] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:38.110440 31539 raft_consensus.cc:2749] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:25:38.129313 31537 raft_consensus.cc:2749] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:25:38.191339 31554 consensus_meta.cc:287] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.547s	user 0.009s	sys 0.000s
I20260709 12:25:38.191941 31554 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:38.187798 25582 catalog_manager.cc:5697] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 9 to 12, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 12 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:38.194612 31554 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:38.157948 31660 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:38.158927 31566 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:38.136658 31678 consensus_queue.cc:1059] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 12:25:38.135094 30884 raft_consensus.cc:2749] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:25:38.175697 31655 consensus_meta.cc:287] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.567s	user 0.013s	sys 0.001s
I20260709 12:25:38.207099 31655 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:38.211561 31655 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:38.212532 25686 raft_consensus.cc:1240] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 14. Current term is 15. Ops: []
W20260709 12:25:38.175873 31636 consensus_meta.cc:287] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.664s	user 0.011s	sys 0.000s
W20260709 12:25:38.177592 31592 consensus_meta.cc:287] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.533s	user 0.008s	sys 0.000s
I20260709 12:25:38.178448 31561 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:38.185081 31597 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:38.205397 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:38.218011 31660 raft_consensus.cc:3055] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:25:38.127431 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 44121.7us
I20260709 12:25:38.194633 25582 catalog_manager.cc:5697] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:25:38.245064 25650 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:38.245734 25829 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 18.
W20260709 12:25:38.246090 25800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:38.249279 25801 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:38.255312 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:38.254842 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
W20260709 12:25:38.271224 31457 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.027s	sys 0.036s
I20260709 12:25:38.272279 25835 raft_consensus.cc:1240] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 16 LEADER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 15. Current term is 16. Ops: [13.12-15.13]
W20260709 12:25:38.271956 31602 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.027s	sys 0.036s
W20260709 12:25:38.273670 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 396916us
I20260709 12:25:38.277056 25682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51578 (request call id 1139) took 1304 ms. Trace:
I20260709 12:25:38.277613 25682 rpcz_store.cc:276] 0709 12:25:36.972508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:36.972790 (+   282us) service_pool.cc:224] Handling call
0709 12:25:38.255180 (+1282390us) spinlock_profiling.cc:243] Waited 880 us on lock 0x7b5800003698. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d96a3cb71 00007f5d96a3ceee 000000000036eb39 00007f5d9eab01e0 00007f5d9eb790c4 00007f5d9eb79131 00007f5d9eb270a0 00007f5d9eb26984 00007f5d980a16d4 00007f5d980a1662
0709 12:25:38.276991 (+ 21811us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2036864}
I20260709 12:25:38.282124 25726 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
W20260709 12:25:38.286368 25759 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.017s	sys 0.022s
W20260709 12:25:38.287843 25759 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.018s	sys 0.023s
W20260709 12:25:38.286752 25761 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.009s	sys 0.031s
W20260709 12:25:38.290859 25761 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.009s	sys 0.031s
W20260709 12:25:38.296933 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 47731.1us
I20260709 12:25:38.298044 25801 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:38.212874 31623 raft_consensus.cc:697] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 15 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
W20260709 12:25:38.250069 31393 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.010s	sys 0.028s
I20260709 12:25:38.313874 25726 leader_election.cc:400] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 election: Vote denied by peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611) with higher term. Message: Invalid argument: T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 15. Current term is 16.
W20260709 12:25:38.314599 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:38.273641 31457 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.028s	sys 0.037s
I20260709 12:25:38.242758 31660 raft_consensus.cc:740] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
W20260709 12:25:38.302744 31602 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.027s	sys 0.036s
I20260709 12:25:38.247319 31655 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
W20260709 12:25:38.324738 25754 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.015s	sys 0.071s
W20260709 12:25:38.345721 25754 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.016s	sys 0.071s
W20260709 12:25:38.321798 31393 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.010s	sys 0.028s
I20260709 12:25:38.326969 25726 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:38.277272 31668 raft_consensus.cc:2749] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:38.254602 31259 raft_consensus.cc:2804] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:38.228734 31636 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:38.354468 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:38.320371 31130 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:38.240409 31592 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:38.279156 31458 consensus_queue.cc:1048] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.080s
I20260709 12:25:38.337702 31597 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:38.328678 31680 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:38.325551 31537 raft_consensus.cc:2749] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:38.405283 25831 raft_consensus.cc:1240] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:38.370172 31259 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:38.424846 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:38.432930 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:38.435379 25835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44218 (request call id 1996) took 1614 ms. Trace:
I20260709 12:25:38.447751 25835 rpcz_store.cc:276] 0709 12:25:36.820555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:36.820695 (+   140us) service_pool.cc:224] Handling call
0709 12:25:36.821105 (+   410us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:38.273299 (+1452194us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:38.435013 (+161714us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b54003c5354. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:38.435305 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3336712576}
W20260709 12:25:38.431432 31684 log.cc:927] Time spent T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 12:25:38.489857 25725 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.006s	sys 0.024s
W20260709 12:25:38.490355 25725 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.006s	sys 0.024s
I20260709 12:25:38.491003 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:38.366393 31655 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:38.495182 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 628244us
I20260709 12:25:38.442239 31680 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:38.506170 31680 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:38.506949 31680 raft_consensus.cc:3060] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:38.431823 31591 raft_consensus.cc:3055] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:38.427410 31683 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:38.432776 31566 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:38.436045 31259 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:38.429044 31592 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:38.411310 31682 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:38.608120 31655 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:38.608570 31682 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:38.433040 31623 consensus_queue.cc:237] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.14, Last appended by leader: 14, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:38.611141 31682 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:38.436650 31676 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:38.430505 31636 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:38.401870 31597 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:38.450664 31371 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
W20260709 12:25:38.528748 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 230815us
W20260709 12:25:38.529518 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 296397us
I20260709 12:25:38.394212 31130 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:38.474788 31561 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:38.494446 31639 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:38.507843 31539 raft_consensus.cc:2749] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:38.435599 31660 consensus_queue.cc:260] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:38.564246 26402 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
W20260709 12:25:38.606208 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:38.694288 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 130136us
I20260709 12:25:38.695250 26402 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:25:38.633700 25649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:38.696503 25649 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:38.629516 25801 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:25:38.697562 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 68171.6us
I20260709 12:25:38.613732 31591 raft_consensus.cc:740] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
W20260709 12:25:38.708034 25758 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.023s	sys 0.042s
W20260709 12:25:38.718953 25758 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.023s	sys 0.042s
I20260709 12:25:38.720181 26430 raft_consensus.cc:1240] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:38.626714 31682 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:38.728583 31456 raft_consensus.cc:2749] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:38.734592 26437 raft_consensus.cc:1240] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 16. Current term is 18. Ops: []
I20260709 12:25:38.738737 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:38.743943 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:38.745213 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:38.751272 26436 raft_consensus.cc:1240] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 16. Current term is 17. Ops: []
W20260709 12:25:38.760769 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 433871us
I20260709 12:25:38.724402 31636 raft_consensus.cc:2804] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:38.617020 31683 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:38.736169 31606 raft_consensus.cc:2804] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:38.729033 31696 raft_consensus.cc:2804] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:38.647318 31371 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:38.652266 31561 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:38.820391 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:38.628497 31676 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:38.777040 31636 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:38.730029 31571 consensus_queue.cc:1048] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.084s
I20260709 12:25:38.784811 31606 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:38.840022 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:38.742949 31682 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:38.793565 31696 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:38.785756 31689 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
W20260709 12:25:38.840034 25800 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.019s	sys 0.025s
I20260709 12:25:38.833583 31636 raft_consensus.cc:3060] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:25:38.776420 31510 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.044s	sys 0.092s
I20260709 12:25:38.846680 31695 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:38.696679 31639 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:38.734599 31591 consensus_queue.cc:260] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:38.860934 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:38.864698 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:39.023473 31676 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:38.866580 25800 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.019s	sys 0.025s
W20260709 12:25:38.859048 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 96721us
I20260709 12:25:39.022553 25758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 2951) took 1410 ms. Trace:
W20260709 12:25:38.889119 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:39.039387 25726 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:38.962177 25828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 3250) took 1219 ms. Trace:
I20260709 12:25:39.040211 25828 rpcz_store.cc:276] 0709 12:25:37.743014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:38.948362 (+1205348us) service_pool.cc:224] Handling call
0709 12:25:38.961534 (+ 13172us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:38.961762 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:38.961799 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:38.961853 (+    54us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:25:38.961897 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:38.961967 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:38.962104 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:39.039170 25758 rpcz_store.cc:276] 0709 12:25:37.612065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:37.612247 (+   182us) service_pool.cc:224] Handling call
0709 12:25:37.612515 (+   268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:37.862821 (+250306us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:37.862858 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:37.888100 (+ 25242us) log.cc:844] Serialized 26 byte log entry
0709 12:25:38.731247 (+843147us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:38.731297 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:38.731397 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:39.022331 (+290934us) raft_consensus.cc:1685] finished
0709 12:25:39.022358 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:39.022492 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":280401,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":136532,"thread_start_us":931535,"threads_started":2,"wal-append.queue_time_us":974627}
W20260709 12:25:38.933696 25836 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.019s	sys 0.036s
I20260709 12:25:38.927687 31393 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:38.867826 31688 log.cc:927] Time spent T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:25:38.875335 31551 consensus_meta.cc:287] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.850s	user 0.009s	sys 0.004s
I20260709 12:25:38.860903 31606 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:25:39.122242 31494 consensus_meta.cc:287] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 1.226s	user 0.012s	sys 0.002s
W20260709 12:25:39.122673 31718 log.cc:927] Time spent T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:25:39.122736 31494 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:39.124151 25684 raft_consensus.cc:1240] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 17. Current term is 18. Ops: [17.11-17.11]
W20260709 12:25:39.124863 31707 log.cc:927] Time spent T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:25:39.126260 25759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 2952) took 1474 ms. Trace:
I20260709 12:25:38.873596 31689 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:39.157177 31708 log.cc:927] Time spent T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260709 12:25:39.158442 25832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 3245) took 1439 ms. Trace:
I20260709 12:25:39.158826 25832 rpcz_store.cc:276] 0709 12:25:37.719213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:38.309299 (+590086us) service_pool.cc:224] Handling call
0709 12:25:38.309694 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:38.310653 (+   959us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:38.310692 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:38.311186 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 12:25:38.782785 (+471599us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:38.782836 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:38.782923 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:39.158196 (+375273us) raft_consensus.cc:1685] finished
0709 12:25:39.158224 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:39.158384 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":586,"raft.queue_time_us":1349,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":12141,"thread_start_us":408437,"threads_started":1,"wal-append.queue_time_us":621097}
I20260709 12:25:39.161134 31623 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:39.161773 31623 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:39.164284 31729 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
W20260709 12:25:39.063333 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 187748us
I20260709 12:25:39.165334 31729 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:38.951606 31693 log.cc:927] Time spent T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
W20260709 12:25:38.988006 31687 log.cc:927] Time spent T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
W20260709 12:25:39.021020 31701 log.cc:927] Time spent T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 12:25:39.016908 31591 raft_consensus.cc:3060] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:39.011438 31118 consensus_meta.cc:287] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 1.127s	user 0.011s	sys 0.003s
I20260709 12:25:38.865753 31696 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:39.007264 31371 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:39.074652 25754 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.007s	sys 0.003s
I20260709 12:25:39.127362 31551 raft_consensus.cc:2749] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:38.999969 31561 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:25:39.077008 25836 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.858s	user 0.023s	sys 0.040s
W20260709 12:25:39.077307 25830 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.002s	sys 0.009s
W20260709 12:25:39.179574 25830 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.002s	sys 0.009s
I20260709 12:25:39.018661 31639 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:38.941255 31597 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:39.010550 31130 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:39.016155 31714 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:39.183125 31714 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:39.184922 25761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 2954) took 1451 ms. Trace:
I20260709 12:25:39.185746 31714 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:38.989071 31683 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:39.084900 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:39.050875 31676 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
W20260709 12:25:39.008749 31448 consensus_queue.cc:1175] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a866ff967d964388a6f0dff7fd43df89" responder_term: 15 status { last_received { term: 10 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 14. Current term is 15. Ops: [12.10-14.11]" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 12:25:39.135864 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:39.126631 25759 rpcz_store.cc:276] 0709 12:25:37.651931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:37.653162 (+  1231us) service_pool.cc:224] Handling call
0709 12:25:37.653560 (+   398us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:25:38.290161 (+636601us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:38.290192 (+    31us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:25:38.326022 (+ 35830us) log.cc:844] Serialized 78 byte log entry
0709 12:25:38.764954 (+438932us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:38.765008 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:38.765102 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:39.126031 (+360929us) raft_consensus.cc:1685] finished
0709 12:25:39.126052 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:39.126200 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":388924,"raft.run_cpu_time_us":69,"raft.run_wall_time_us":70,"thread_start_us":1020522,"threads_started":2,"wal-append.queue_time_us":647682}
I20260709 12:25:39.028615 31715 consensus_queue.cc:1059] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 12:25:39.164379 31623 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:39.009909 31695 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:39.038800 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 726210us
I20260709 12:25:39.174960 31118 raft_consensus.cc:2749] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:25:39.175350 25754 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.799s	user 0.007s	sys 0.003s
I20260709 12:25:38.924206 31692 raft_consensus.cc:2804] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:25:39.176745 31711 log.cc:927] Time spent T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:25:39.178131 25755 raft_consensus.cc:2468] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 14.
I20260709 12:25:39.126852 31494 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:39.188598 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:39.189443 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 150128us
I20260709 12:25:39.185369 25761 rpcz_store.cc:276] 0709 12:25:37.733960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:37.740230 (+  6270us) service_pool.cc:224] Handling call
0709 12:25:37.740602 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:38.291342 (+550740us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:38.291387 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:38.291973 (+   586us) log.cc:844] Serialized 26 byte log entry
0709 12:25:38.452512 (+160539us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:38.452546 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:38.452620 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:39.184542 (+731922us) raft_consensus.cc:1685] finished
0709 12:25:39.184565 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:39.184857 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":333553,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":40178,"thread_start_us":710491,"threads_started":2,"wal-append.queue_time_us":578260}
I20260709 12:25:39.203146 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:39.205194 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:39.007717 31510 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.044s	sys 0.092s
I20260709 12:25:39.121258 31393 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:39.251078 25649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:39.280548 25681 raft_consensus.cc:1240] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:39.214054 31727 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:39.258772 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:39.202306 31676 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:39.263936 26402 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:39.208820 31714 raft_consensus.cc:2804] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:39.264432 25754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 2955) took 1525 ms. Trace:
I20260709 12:25:39.265726 25756 raft_consensus.cc:2468] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 18.
I20260709 12:25:39.268622 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:39.216001 31715 consensus_queue.cc:1243] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer f82778701b464892aab92a752ed7ffdc log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:25:39.216427 31692 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:39.273756 25763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 2953) took 1621 ms. Trace:
I20260709 12:25:39.282912 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:39.284754 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:25:39.263077 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:39.292608 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:39.292971 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:39.294902 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:39.295202 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:39.303848 26435 raft_consensus.cc:2468] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 16.
I20260709 12:25:39.297214 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:39.300244 25763 rpcz_store.cc:276] 0709 12:25:37.652278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:37.652412 (+   134us) service_pool.cc:224] Handling call
0709 12:25:37.652878 (+   466us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:38.043018 (+390140us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:38.043067 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:38.043823 (+   756us) log.cc:844] Serialized 52 byte log entry
0709 12:25:38.313539 (+269716us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:38.313587 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:38.313650 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:39.273509 (+959859us) raft_consensus.cc:1685] finished
0709 12:25:39.273533 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:39.273690 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":389900,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":119,"thread_start_us":658839,"threads_started":2,"wal-append.queue_time_us":497736}
I20260709 12:25:39.306612 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:39.307446 26432 raft_consensus.cc:2468] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 13.
W20260709 12:25:39.312855 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:39.293220 31714 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:39.313406 31714 raft_consensus.cc:3060] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:39.316356 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:39.294484 25754 rpcz_store.cc:276] 0709 12:25:37.739107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:37.742568 (+  3461us) service_pool.cc:224] Handling call
0709 12:25:37.742840 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:37.743015 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:25:38.357199 (+614184us) log.cc:844] Serialized 14 byte log entry
0709 12:25:39.263933 (+906734us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:39.264109 (+   176us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:39.264155 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:39.264220 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:39.264360 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56515,"prepare.queue_time_us":386094,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":38,"raft.queue_time_us":63734,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":88,"thread_start_us":1401937,"threads_started":2,"wal-append.queue_time_us":835783}
W20260709 12:25:39.319113 31719 log.cc:927] Time spent T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 12:25:39.320657 31717 log.cc:927] Time spent T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 12:25:39.320761 25837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 3249) took 1578 ms. Trace:
I20260709 12:25:39.321341 25837 rpcz_store.cc:276] 0709 12:25:37.742738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:38.559070 (+816332us) service_pool.cc:224] Handling call
0709 12:25:38.614408 (+ 55338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:38.614851 (+   443us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:38.614892 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:38.615435 (+   543us) log.cc:844] Serialized 26 byte log entry
0709 12:25:38.936255 (+320820us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:38.936314 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:38.936409 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:39.320499 (+384090us) raft_consensus.cc:1685] finished
0709 12:25:39.320518 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:39.320703 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1217,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":14753,"thread_start_us":229087,"threads_started":1,"wal-append.queue_time_us":393638}
I20260709 12:25:39.322997 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:25:39.324081 31726 log.cc:927] Time spent T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 12:25:39.324179 25835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 3247) took 1604 ms. Trace:
I20260709 12:25:39.324787 25835 rpcz_store.cc:276] 0709 12:25:37.719630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:38.464109 (+744479us) service_pool.cc:224] Handling call
0709 12:25:38.464554 (+   445us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:38.494879 (+ 30325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:38.494910 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:38.517594 (+ 22684us) log.cc:844] Serialized 26 byte log entry
0709 12:25:38.940563 (+422969us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:38.940621 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:38.940721 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:39.323982 (+383261us) raft_consensus.cc:1685] finished
0709 12:25:39.324002 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:39.324126 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17850,"raft.queue_time_us":22788,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"thread_start_us":370015,"threads_started":1,"wal-append.queue_time_us":467436}
I20260709 12:25:39.326414 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:39.332454 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:39.332973 31695 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:39.333562 25837 raft_consensus.cc:2393] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 13: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:39.334483 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:39.335816 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:39.310906 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:39.337561 26437 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 17.
I20260709 12:25:39.334514 31689 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:39.340675 31720 log.cc:927] Time spent T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 12:25:39.341388 31638 raft_consensus.cc:3055] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:39.383769 31638 raft_consensus.cc:740] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:39.384744 31638 consensus_queue.cc:260] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:39.386041 31638 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:39.344786 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:39.388195 25837 raft_consensus.cc:1275] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:25:39.388723 25837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44218 (request call id 2008) took 1076 ms. Trace:
I20260709 12:25:39.389022 25837 rpcz_store.cc:276] 0709 12:25:38.312183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:39.387544 (+1075361us) service_pool.cc:224] Handling call
0709 12:25:39.387853 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:39.388510 (+   657us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:39.388673 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:39.390196 31682 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:39.383519 25831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41782 (request call id 1210) took 1762 ms. Trace:
I20260709 12:25:39.392226 25831 rpcz_store.cc:276] 0709 12:25:37.620675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:37.620818 (+   143us) service_pool.cc:224] Handling call
0709 12:25:37.621096 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:38.420107 (+799011us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:39.383281 (+963174us) spinlock_profiling.cc:243] Waited 779 ms on lock 0x7b5400246154. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:39.383455 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1790614912}
W20260709 12:25:39.347415 31680 consensus_meta.cc:287] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.723s	user 0.012s	sys 0.000s
I20260709 12:25:39.347219 31714 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:39.352272 31733 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:39.402180 31716 log.cc:927] Time spent T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 12:25:39.402256 31733 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:39.378135 25680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2704) took 1544 ms. Trace:
I20260709 12:25:39.308421 31628 raft_consensus.cc:2749] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:25:39.383602 31725 log.cc:927] Time spent T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:25:39.403546 25680 rpcz_store.cc:276] 0709 12:25:37.833739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:37.833868 (+   129us) service_pool.cc:224] Handling call
0709 12:25:37.847031 (+ 13163us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:37.884957 (+ 37926us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:25:38.399319 (+514362us) log.cc:844] Serialized 14 byte log entry
0709 12:25:38.786778 (+387459us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:38.786833 (+    55us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:38.786890 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:39.377865 (+590975us) spinlock_profiling.cc:243] Waited 37.7 ms on lock 0x7b5400264dd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:39.377919 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:39.378071 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":897588,"prepare.run_wall_time_us":71,"raft.queue_time_us":5710,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":12103,"spinlock_wait_cycles":95395968,"thread_start_us":766390,"threads_started":2,"wal-append.queue_time_us":555820}
I20260709 12:25:39.404251 25830 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 3246) took 1684 ms. Trace:
I20260709 12:25:39.304337 31692 raft_consensus.cc:3060] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:39.408167 25830 rpcz_store.cc:276] 0709 12:25:37.719421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:38.453526 (+734105us) service_pool.cc:224] Handling call
0709 12:25:38.453961 (+   435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:38.454347 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:38.454388 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:38.454920 (+   532us) log.cc:844] Serialized 26 byte log entry
0709 12:25:39.180072 (+725152us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:39.180130 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:39.180228 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:39.404014 (+223786us) raft_consensus.cc:1685] finished
0709 12:25:39.404038 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:39.404183 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":28301,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":7158,"thread_start_us":661367,"threads_started":1,"wal-append.queue_time_us":704654}
I20260709 12:25:39.358520 31393 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:39.411660 25836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 3244) took 1692 ms. Trace:
I20260709 12:25:39.417476 25836 rpcz_store.cc:276] 0709 12:25:37.718983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:38.141716 (+422733us) service_pool.cc:224] Handling call
0709 12:25:38.218149 (+ 76433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:38.218413 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:25:38.218751 (+   338us) log.cc:844] Serialized 14 byte log entry
0709 12:25:39.410947 (+1192196us) log.cc:844] Serialized 14 byte log entry
0709 12:25:39.411351 (+   404us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:39.411400 (+    49us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:39.411442 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:39.411504 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:39.411609 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":107930,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":71,"raft.queue_time_us":7545,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":11579,"spinlock_wait_cycles":36224,"thread_start_us":1191417,"threads_started":2,"wal-append.queue_time_us":807766}
I20260709 12:25:39.400142 31571 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:39.407137 31680 raft_consensus.cc:2749] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:39.409365 31714 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:39.436277 31584 raft_consensus.cc:3060] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:39.438076 31698 log.cc:927] Time spent T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.477s	user 0.004s	sys 0.000s
I20260709 12:25:39.439453 25677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2709) took 1557 ms. Trace:
I20260709 12:25:39.439843 25677 rpcz_store.cc:276] 0709 12:25:37.881758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:37.881882 (+   124us) service_pool.cc:224] Handling call
0709 12:25:37.896114 (+ 14232us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:37.994197 (+ 98083us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:37.994229 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:38.119003 (+124774us) log.cc:844] Serialized 52 byte log entry
0709 12:25:38.542129 (+423126us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:38.542190 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:38.542288 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:39.362602 (+820314us) spinlock_profiling.cc:243] Waited 3.41 ms on lock 0x7b4400022b4c. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db 00007f5d99708aaf 00007f5d996fc86e 00007f5d996fbbb6 00007f5d996fb7d8 00007f5d99705221 00007f5d997051d9 00007f5d99705169
0709 12:25:39.439124 (+ 76522us) raft_consensus.cc:1685] finished
0709 12:25:39.439145 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:39.439384 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64828,"raft.queue_time_us":97863,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":11733,"spinlock_wait_cycles":7848704,"thread_start_us":366902,"threads_started":1,"wal-append.queue_time_us":660178}
I20260709 12:25:39.450224 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:39.451617 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:39.454124 25831 raft_consensus.cc:1275] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 12:25:39.456707 25649 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:39.460227 25763 raft_consensus.cc:1240] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:39.426846 31550 consensus_queue.cc:1059] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 12:25:39.301497 31727 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:39.482296 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:39.508270 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:39.461498 31481 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.469477 31620 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.463341 31676 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:39.433490 31571 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:39.466971 31494 raft_consensus.cc:2749] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:39.499174 31274 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:39.523399 31679 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
W20260709 12:25:39.581779 25800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:39.582229 25800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:39.523087 31481 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:39.590771 25832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 3263) took 1724 ms. Trace:
I20260709 12:25:39.544770 31733 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:39.612625 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 152627us
I20260709 12:25:39.615356 25649 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:39.591210 25832 rpcz_store.cc:276] 0709 12:25:37.866740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:39.160516 (+1293776us) service_pool.cc:224] Handling call
0709 12:25:39.160867 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:39.161132 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:25:39.250041 (+ 88909us) log.cc:844] Serialized 14 byte log entry
0709 12:25:39.590427 (+340386us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:39.590480 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:39.590526 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:39.590589 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:39.590712 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":125321,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"thread_start_us":394398,"threads_started":2}
I20260709 12:25:39.619876 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:39.621814 25683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40230 (request call id 1915) took 2043 ms. Trace:
I20260709 12:25:39.622247 25683 rpcz_store.cc:276] 0709 12:25:37.578806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:37.578957 (+   151us) service_pool.cc:224] Handling call
0709 12:25:37.591780 (+ 12823us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:37.754435 (+162655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:39.621504 (+1867069us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b54003d9ad4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:39.621740 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":327044480}
I20260709 12:25:39.625694 26401 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:39.553885 31274 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:39.629640 31274 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:39.631287 31659 raft_consensus.cc:3055] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:25:39.580513 31533 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:39.631850 31659 raft_consensus.cc:740] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:39.632222 31533 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:39.633199 31659 consensus_queue.cc:260] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:39.634500 31533 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:39.636389 25686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2714) took 1599 ms. Trace:
I20260709 12:25:39.652969 25686 rpcz_store.cc:276] 0709 12:25:38.037343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:38.039207 (+  1864us) service_pool.cc:224] Handling call
0709 12:25:38.039595 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:38.228927 (+189332us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:39.636151 (+1407224us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b54002a58d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:39.636332 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":397129088}
I20260709 12:25:39.651292 31630 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:39.654286 31630 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:39.646303 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:39.660849 31659 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:39.663049 25759 raft_consensus.cc:1275] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
W20260709 12:25:39.663906 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:39.666318 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:39.672174 26435 raft_consensus.cc:1240] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 13. Current term is 14. Ops: []
W20260709 12:25:39.677835 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:39.681023 25649 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:39.546162 31620 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:39.679688 31550 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:39.686547 31481 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:39.686726 31550 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:39.688045 31481 raft_consensus.cc:2804] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:39.688472 31481 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:39.688864 31481 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:39.688915 31550 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:39.679517 31274 raft_consensus.cc:2749] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:39.664309 31641 raft_consensus.cc:2749] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:25:39.717958 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:39.718562 26430 raft_consensus.cc:3060] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:39.719686 31480 raft_consensus.cc:3060] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:25:39.727696 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:39.683076 31740 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.692526 31274 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.593580 31679 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:39.737169 25758 raft_consensus.cc:2468] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 14.
W20260709 12:25:39.755520 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 473585us
I20260709 12:25:39.760813 25726 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:39.732740 31697 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.771462 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:39.771492 31659 raft_consensus.cc:2749] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:39.772248 25686 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:39.773504 25834 raft_consensus.cc:2468] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 16.
I20260709 12:25:39.767177 26430 raft_consensus.cc:2468] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 15.
I20260709 12:25:39.775496 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:39.776072 26430 raft_consensus.cc:2468] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 12.
I20260709 12:25:39.738855 31740 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:39.776813 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:39.777920 31740 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:39.779850 25828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 3262) took 1940 ms. Trace:
I20260709 12:25:39.780359 25828 rpcz_store.cc:276] 0709 12:25:37.839417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:39.041412 (+1201995us) service_pool.cc:224] Handling call
0709 12:25:39.071262 (+ 29850us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:39.071635 (+   373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:39.071662 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:39.073586 (+  1924us) log.cc:844] Serialized 26 byte log entry
0709 12:25:39.661665 (+588079us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:25:39.700693 (+ 39028us) log.cc:844] Serialized 14 byte log entry
0709 12:25:39.708508 (+  7815us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:39.708615 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:39.779631 (+ 71016us) raft_consensus.cc:1685] finished
0709 12:25:39.779653 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:39.779789 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":38850,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":33,"raft.queue_time_us":13955,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":17246,"thread_start_us":493196,"threads_started":1,"wal-append.queue_time_us":622334}
I20260709 12:25:39.782100 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:39.790437 25686 raft_consensus.cc:2468] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 18.
I20260709 12:25:39.779985 26430 raft_consensus.cc:1275] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:25:39.764765 31630 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:39.735626 31274 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:39.812628 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:39.829025 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
W20260709 12:25:39.805977 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 45232.4us
W20260709 12:25:39.807075 25727 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.004s	sys 0.017s
W20260709 12:25:39.836071 25727 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.005s	sys 0.017s
W20260709 12:25:39.793931 31259 consensus_meta.cc:287] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 1.184s	user 0.014s	sys 0.001s
I20260709 12:25:39.791937 31480 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:39.840114 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:39.836894 25726 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
W20260709 12:25:39.806578 31705 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.735s	user 0.008s	sys 0.011s
I20260709 12:25:39.793643 31631 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
W20260709 12:25:39.858630 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:39.834013 31571 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:39.836774 31641 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.838850 31731 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:39.901669 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 220734us
W20260709 12:25:39.904918 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:39.862227 25685 raft_consensus.cc:2393] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 14: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
W20260709 12:25:39.890930 31737 log.cc:927] Time spent T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.235s	user 0.001s	sys 0.001s
I20260709 12:25:39.862205 26430 raft_consensus.cc:1275] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:25:39.862345 31659 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:39.905865 26434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 1438) took 2303 ms. Trace:
W20260709 12:25:39.906980 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:39.894652 31638 consensus_meta.cc:287] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.508s	user 0.008s	sys 0.003s
I20260709 12:25:39.862843 31597 raft_consensus.cc:2749] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:39.844861 25726 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:39.792960 31697 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:39.886746 31705 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.821s	user 0.011s	sys 0.021s
I20260709 12:25:39.925197 26434 rpcz_store.cc:276] 0709 12:25:37.598232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:37.601459 (+  3227us) service_pool.cc:224] Handling call
0709 12:25:37.601746 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:37.609497 (+  7751us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:37.609526 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:37.621132 (+ 11606us) log.cc:844] Serialized 26 byte log entry
0709 12:25:39.440288 (+1819156us) spinlock_profiling.cc:243] Waited 7.58 ms on lock 0x7b180048aae0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d96a56e07 00007f5d9f8b19a9 00007f5d96a7369b 00007f5d96a7193f 00007f5d96a73c02 00007f5d996fb20b 00007f5d99700d23 00007f5d997010d1 00007f5d99b1ca0f
0709 12:25:39.612312 (+172024us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:25:39.640960 (+ 28648us) spinlock_profiling.cc:243] Waited 1.22 ms on lock 0x7b180048aae0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d96a74557 00007f5d96a767c1 00007f5d96a76779 00007f5d96a76709 00007f5d96a766d1 00007f5d96a759cd 0000000000388634 0000000000388479 00007f5d96a5783a
0709 12:25:39.839310 (+198350us) log.cc:844] Serialized 14 byte log entry
0709 12:25:39.901030 (+ 61720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:39.901114 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:39.901158 (+    44us) raft_consensus.cc:1685] finished
0709 12:25:39.901169 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:39.901288 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7400,"prepare.queue_time_us":289978,"raft.queue_time_us":73111,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":15369,"spinlock_wait_cycles":20228736,"thread_start_us":341097,"threads_started":2,"wal-append.queue_time_us":2050904}
I20260709 12:25:39.939153 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:39.902009 31560 raft_consensus.cc:2749] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:39.841434 31259 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:39.937175 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 92438.1us
I20260709 12:25:39.946841 25726 leader_election.cc:400] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 election: Vote denied by peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611) with higher term. Message: Invalid argument: T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 16. Current term is 18.
I20260709 12:25:39.947896 25726 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:39.910808 31727 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:39.841733 31480 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:39.892697 31631 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:39.954939 31606 consensus_meta.cc:287] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.787s	user 0.010s	sys 0.001s
I20260709 12:25:39.955605 31631 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:39.951295 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:39.956600 26430 raft_consensus.cc:2393] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 17: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:39.956663 31697 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:39.957530 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:39.958504 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:39.933187 31659 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:39.961117 31481 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:39.961580 31659 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:39.962106 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:39.953877 31480 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:39.963227 31481 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 19 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:39.963651 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:39.964445 31679 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:39.964811 26430 raft_consensus.cc:2393] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 16: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:39.965590 31274 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:39.966457 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:39.967104 31274 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:39.968971 25800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:39.969751 31584 consensus_meta.cc:287] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.533s	user 0.007s	sys 0.002s
I20260709 12:25:39.970444 25829 raft_consensus.cc:1275] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 6. (term mismatch)
I20260709 12:25:39.970762 25829 pending_rounds.cc:85] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a: Aborting all ops after (but not including) 5
I20260709 12:25:39.970963 25829 pending_rounds.cc:107] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a: Aborting uncommitted NO_OP operation due to leader change: 11.6
I20260709 12:25:39.971171 25829 raft_consensus.cc:2889] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:39.971756 31175 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.972230 31175 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:39.915642 31731 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:39.973503 31620 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:39.975008 31731 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:39.913427 31641 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:39.976229 26434 raft_consensus.cc:2468] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 13.
I20260709 12:25:39.976881 25761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 3390) took 1123 ms. Trace:
I20260709 12:25:39.977285 25761 rpcz_store.cc:276] 0709 12:25:38.853662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:39.297979 (+444317us) service_pool.cc:224] Handling call
0709 12:25:39.312014 (+ 14035us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:39.312331 (+   317us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:39.312358 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:39.318058 (+  5700us) log.cc:844] Serialized 26 byte log entry
0709 12:25:39.457470 (+139412us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:39.457525 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:39.457630 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:39.976669 (+519039us) raft_consensus.cc:1685] finished
0709 12:25:39.976690 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:39.976821 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":549,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":5544,"thread_start_us":139032,"threads_started":1,"wal-append.queue_time_us":221824}
I20260709 12:25:39.944700 31741 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.943372 31745 raft_consensus.cc:2749] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:39.981508 31741 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:39.980962 31641 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:39.955354 31606 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:39.987946 25726 leader_election.cc:400] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Vote denied by peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611) with higher term. Message: Invalid argument: T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 16. Current term is 17.
I20260709 12:25:39.988341 25726 leader_election.cc:403] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:39.989549 25801 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:39.993549 25801 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:39.950984 31638 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.967645 31274 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:39.985093 31631 raft_consensus.cc:2749] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:39.950320 31533 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:40.004366 25726 leader_election.cc:400] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 election: Vote denied by peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611) with higher term. Message: Invalid argument: T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 16. Current term is 17.
W20260709 12:25:40.033206 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 173777us
I20260709 12:25:40.037727 25726 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:40.005170 25801 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
W20260709 12:25:40.010866 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 105409us
I20260709 12:25:40.013895 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:40.032055 31575 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:39.949584 31678 consensus_queue.cc:1059] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.049s
I20260709 12:25:39.980970 31259 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 19 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:39.985241 31480 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:40.043385 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:38.495781 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:40.054502 25582 catalog_manager.cc:5697] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:25:40.039486 25726 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:40.003093 31230 raft_consensus.cc:2749] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:25:40.061375 25756 raft_consensus.cc:3055] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:40.061836 25756 raft_consensus.cc:740] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:40.062733 25756 consensus_queue.cc:260] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:40.069305 31741 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:40.074071 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:40.075505 25763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 3391) took 1221 ms. Trace:
I20260709 12:25:40.075898 25763 rpcz_store.cc:276] 0709 12:25:38.853947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:39.305528 (+451581us) service_pool.cc:224] Handling call
0709 12:25:39.305813 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:39.460638 (+154825us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:40.075292 (+614654us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b54001a6dd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:40.075449 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":354710400}
I20260709 12:25:40.077246 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:40.047106 31727 raft_consensus.cc:2749] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:40.085070 31628 raft_consensus.cc:3055] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:40.010259 31645 raft_consensus.cc:2749] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:40.085521 31628 raft_consensus.cc:740] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:40.035254 31638 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:40.086370 31628 consensus_queue.cc:260] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:40.087584 31628 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:40.087795 31638 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:40.088918 26437 raft_consensus.cc:1240] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 15. Current term is 17. Ops: []
I20260709 12:25:40.090080 26437 raft_consensus.cc:1240] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 15 LEADER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:40.092338 31704 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:40.035022 31597 raft_consensus.cc:3060] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:25:40.086731 26430 raft_consensus.cc:2376] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 12. Re-sending same reply.
W20260709 12:25:40.096206 25834 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44218 (request call id 2002) took 2737 ms (client timeout 1635 ms). Trace:
W20260709 12:25:40.096630 25834 rpcz_store.cc:269] 0709 12:25:37.358986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:37.364882 (+  5896us) service_pool.cc:224] Handling call
0709 12:25:40.096021 (+2731139us) spinlock_profiling.cc:243] Waited 2.41 s on lock 0x7b5400387cd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:40.096113 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5537437440}
I20260709 12:25:40.099080 31329 raft_consensus.cc:3060] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:40.092849 31704 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:40.100921 25684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2711) took 2207 ms. Trace:
I20260709 12:25:40.101279 25684 rpcz_store.cc:276] 0709 12:25:37.893582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:37.894897 (+  1315us) service_pool.cc:224] Handling call
0709 12:25:38.036818 (+141921us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:39.124603 (+1087785us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:40.100699 (+976096us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400263ed4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:40.100869 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2500017536}
W20260709 12:25:40.102015 31696 consensus_meta.cc:287] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.926s	user 0.010s	sys 0.000s
I20260709 12:25:40.102437 31696 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:40.103085 31729 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:40.103446 26435 raft_consensus.cc:1240] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:40.046766 31745 consensus_queue.cc:1059] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.058s
W20260709 12:25:40.046952 31636 consensus_meta.cc:287] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 1.165s	user 0.012s	sys 0.002s
I20260709 12:25:40.105031 31636 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:40.107096 31636 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:40.108767 31274 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:40.109153 31548 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:39.994908 31584 consensus_queue.cc:1048] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.116s
I20260709 12:25:40.112361 31480 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:40.113806 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:40.114460 31480 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:25:40.117563 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:40.050558 31575 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:40.119867 31575 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:40.120484 25833 raft_consensus.cc:1240] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 14. Current term is 16. Ops: []
W20260709 12:25:40.122153 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:40.053486 31630 raft_consensus.cc:2749] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:25:40.124686 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:40.085376 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:25:40.128235 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 69144.1us
I20260709 12:25:40.124647 25755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53474 (request call id 3393) took 1270 ms. Trace:
I20260709 12:25:40.129586 26437 raft_consensus.cc:1240] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 14. Current term is 15. Ops: [12.11-14.12]
W20260709 12:25:40.129755 25649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:40.053329 31533 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:40.129853 25755 rpcz_store.cc:276] 0709 12:25:38.854606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:38.860697 (+  6091us) service_pool.cc:224] Handling call
0709 12:25:40.124372 (+1263675us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b5400396cd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:40.124511 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":346117888}
W20260709 12:25:40.134334 25800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:40.134667 25686 raft_consensus.cc:1275] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:25:40.136274 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:40.136817 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:40.137131 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:40.136848 25686 raft_consensus.cc:2468] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 12.
I20260709 12:25:40.138478 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:40.138787 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:40.140543 25649 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:40.137414 25835 raft_consensus.cc:2376] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 17. Re-sending same reply.
W20260709 12:25:40.127942 31692 consensus_meta.cc:287] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.717s	user 0.000s	sys 0.010s
I20260709 12:25:40.139199 25679 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 10.
I20260709 12:25:40.144083 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:40.148578 25755 raft_consensus.cc:2393] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 15: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
W20260709 12:25:40.150085 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 108338us
I20260709 12:25:40.150391 25681 raft_consensus.cc:1240] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 18 LEADER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 17. Current term is 18. Ops: []
I20260709 12:25:40.153209 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:40.153189 25684 raft_consensus.cc:1240] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 18. Current term is 19. Ops: []
I20260709 12:25:40.156363 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:40.157351 25649 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:40.157462 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:40.133083 31741 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.210177 25761 raft_consensus.cc:3060] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:40.142168 31659 raft_consensus.cc:2804] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:25:40.158619 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:40.151310 31692 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:40.101864 31704 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:40.159891 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:40.204142 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 45092.5us
W20260709 12:25:40.217283 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 84592.5us
I20260709 12:25:40.159111 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:40.219234 25761 raft_consensus.cc:2468] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 13.
I20260709 12:25:40.221917 25686 raft_consensus.cc:2468] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 12.
I20260709 12:25:40.144981 31502 consensus_queue.cc:1059] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 12:25:40.224900 25726 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:40.152890 31752 raft_consensus.cc:2804] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:40.234153 25762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 3377) took 1395 ms. Trace:
I20260709 12:25:40.236325 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:40.238288 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:40.238320 25726 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:40.238937 25828 raft_consensus.cc:2468] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 16.
I20260709 12:25:40.239357 25726 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:40.209534 31675 raft_consensus.cc:3055] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:40.240913 25835 raft_consensus.cc:2410] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 19 because replica has last-logged OpId of term: 17 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 12:25:40.233302 31659 raft_consensus.cc:697] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:40.234650 25762 rpcz_store.cc:276] 0709 12:25:38.839255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:38.839401 (+   146us) service_pool.cc:224] Handling call
0709 12:25:38.839780 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:38.863957 (+ 24177us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:25:38.873934 (+  9977us) log.cc:844] Serialized 14 byte log entry
0709 12:25:39.038630 (+164696us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:39.038703 (+    73us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:25:39.038765 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:40.233859 (+1195094us) spinlock_profiling.cc:243] Waited 24 ms on lock 0x7b54001dabd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:40.233921 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:40.234085 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9747,"prepare.queue_time_us":12193,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":171468,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":29499,"spinlock_wait_cycles":55102208,"thread_start_us":155223,"threads_started":1,"wal-append.queue_time_us":246733,"wal-append.run_cpu_time_us":1183,"wal-append.run_wall_time_us":1082274}
I20260709 12:25:40.243017 31554 raft_consensus.cc:2804] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:40.243467 31554 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:40.244099 31554 raft_consensus.cc:3060] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:40.243544 31659 consensus_queue.cc:237] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:40.233605 31253 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.248085 31745 raft_consensus.cc:2804] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:40.248525 31745 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:40.248960 31745 raft_consensus.cc:3060] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:40.249274 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:40.243548 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:40.251101 25726 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:40.251519 25754 raft_consensus.cc:1240] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:25:40.253463 31679 raft_consensus.cc:2804] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:40.253909 31679 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:40.254276 31679 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:40.254590 31274 raft_consensus.cc:2804] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:40.254979 31274 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:40.149634 31705 consensus_queue.cc:1059] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.082s
I20260709 12:25:40.251569 25762 raft_consensus.cc:2468] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 13.
I20260709 12:25:40.258167 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:40.258452 26432 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.006s	sys 0.010s
W20260709 12:25:40.258745 26432 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.006s	sys 0.010s
I20260709 12:25:40.258965 25761 raft_consensus.cc:2393] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 18: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:40.227634 31723 raft_consensus.cc:3055] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:40.256115 25726 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:40.260063 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:40.208514 31259 consensus_queue.cc:1048] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.042s
I20260709 12:25:40.263805 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:40.263818 25835 raft_consensus.cc:1240] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:40.243403 31533 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:40.231837 31752 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:40.267410 25762 raft_consensus.cc:2468] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 16.
I20260709 12:25:40.275156 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:40.275806 25762 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:40.279647 25726 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:40.225917 31706 consensus_queue.cc:1059] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.040s
I20260709 12:25:40.250674 31675 raft_consensus.cc:740] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:40.290124 25757 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 15.
I20260709 12:25:40.287832 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:40.226605 31741 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:40.261790 31274 raft_consensus.cc:3060] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:40.291512 25835 raft_consensus.cc:2468] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 15.
I20260709 12:25:40.289551 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:40.267040 31723 raft_consensus.cc:740] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:40.294941 25832 raft_consensus.cc:1275] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
I20260709 12:25:40.296902 25834 raft_consensus.cc:2468] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 11.
I20260709 12:25:40.262151 31502 raft_consensus.cc:2749] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:40.262154 31329 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.303288 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:40.280718 31752 raft_consensus.cc:3060] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:40.304255 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:40.307404 25828 raft_consensus.cc:2410] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:25:40.285207 31705 consensus_queue.cc:1243] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer a866ff967d964388a6f0dff7fd43df89 log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:25:40.286491 31631 raft_consensus.cc:2749] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:25:40.311125 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:40.311266 25829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 3264) took 2200 ms. Trace:
I20260709 12:25:40.311704 25761 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:40.311698 25829 rpcz_store.cc:276] 0709 12:25:38.110855 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:39.379625 (+1268770us) service_pool.cc:224] Handling call
0709 12:25:39.393355 (+ 13730us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:39.971587 (+578232us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:40.311038 (+339451us) spinlock_profiling.cc:243] Waited 577 ms on lock 0x7b54002f5654. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:40.311208 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1326449920}
I20260709 12:25:40.313376 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:40.313974 25828 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:40.306406 25832 raft_consensus.cc:1275] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 12:25:40.287722 31696 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:40.248132 31253 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:40.289060 31510 raft_consensus.cc:2749] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:25:40.329758 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 324669us
I20260709 12:25:40.293670 31731 consensus_queue.cc:1059] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 12:25:40.316346 26402 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:40.323212 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:40.338621 25834 raft_consensus.cc:2410] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 13 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 12:25:40.292927 31676 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.323568 25800 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:40.297511 31744 consensus_queue.cc:1048] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 12:25:40.330892 25759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 3386) took 1482 ms. Trace:
I20260709 12:25:40.341454 25759 rpcz_store.cc:276] 0709 12:25:38.852355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:39.289844 (+437489us) service_pool.cc:224] Handling call
0709 12:25:39.290087 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:39.663620 (+373533us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:40.330676 (+667056us) spinlock_profiling.cc:243] Waited 372 ms on lock 0x7b54003976d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:40.330837 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":856606592}
W20260709 12:25:40.333097 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:40.315860 31568 raft_consensus.cc:3055] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 12:25:40.335232 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 110519us
I20260709 12:25:40.335134 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:40.340039 25800 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:40.319635 25762 raft_consensus.cc:2468] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 19.
I20260709 12:25:40.353160 25761 raft_consensus.cc:2410] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 12:25:40.349443 25828 raft_consensus.cc:2468] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 17.
I20260709 12:25:40.352604 25801 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:40.356480 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:40.358054 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:40.358732 25828 raft_consensus.cc:2468] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 13.
I20260709 12:25:40.361837 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:40.361562 26431 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 10.
I20260709 12:25:40.364282 25763 raft_consensus.cc:2410] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:25:40.357584 26402 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:40.362381 25801 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:40.368630 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:40.369714 25763 raft_consensus.cc:2410] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 12:25:40.369581 26402 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:40.367502 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:40.360486 31425 raft_consensus.cc:2804] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:40.372978 31761 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.373413 31692 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:40.373868 31761 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:40.376294 31761 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:40.376446 31533 raft_consensus.cc:2749] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:40.373023 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:40.315078 31329 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:40.387204 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:40.385390 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:40.384214 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:40.341501 31606 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:40.387435 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:40.353041 31696 raft_consensus.cc:2804] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:40.398808 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:40.389506 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:40.350853 31568 raft_consensus.cc:740] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
W20260709 12:25:40.390445 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 233199us
I20260709 12:25:40.352658 31731 consensus_queue.cc:1243] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer 5cccf20a8bff46dba6601f241d172b8a log is divergent from this leader: its last log entry 16.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:25:40.354038 31704 raft_consensus.cc:2804] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:40.391980 25760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 3381) took 1546 ms. Trace:
I20260709 12:25:40.391844 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:40.395991 31580 consensus_queue.cc:1059] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:40.396806 31579 consensus_queue.cc:1059] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:25:40.421250 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 50455.6us
I20260709 12:25:40.350546 31630 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:40.399641 25761 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:40.398844 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:40.426105 26438 raft_consensus.cc:2468] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 12.
I20260709 12:25:40.394085 25837 raft_consensus.cc:2468] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 12.
I20260709 12:25:40.388176 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:40.390120 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:40.368559 31575 raft_consensus.cc:2804] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:40.397261 25801 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:40.420125 26439 raft_consensus.cc:2468] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 14.
I20260709 12:25:40.419461 25760 rpcz_store.cc:276] 0709 12:25:38.845482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:38.846366 (+   884us) service_pool.cc:224] Handling call
0709 12:25:38.846669 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:38.878063 (+ 31394us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:25:39.074295 (+196232us) log.cc:844] Serialized 14 byte log entry
0709 12:25:39.282259 (+207964us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:39.282311 (+    52us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:39.282351 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:40.391717 (+1109366us) spinlock_profiling.cc:243] Waited 31.1 ms on lock 0x7b5400298954. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:40.391765 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:40.391893 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73265,"prepare.queue_time_us":11132,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":69,"raft.queue_time_us":83046,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":6100,"spinlock_wait_cycles":71584512,"thread_start_us":316140,"threads_started":2,"wal-append.queue_time_us":213224,"wal-append.run_cpu_time_us":1650,"wal-append.run_wall_time_us":1047527}
I20260709 12:25:40.373445 31425 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:40.351025 31460 consensus_queue.cc:1048] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:25:40.421903 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:40.397619 31480 consensus_queue.cc:1048] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:40.365518 31620 consensus_queue.cc:1048] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:25:40.429181 31575 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:40.440878 31575 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:40.429330 25763 raft_consensus.cc:2393] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 15: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:40.360767 31638 consensus_queue.cc:1059] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
W20260709 12:25:40.444888 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:40.400485 31550 raft_consensus.cc:2804] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:40.445405 31638 raft_consensus.cc:3055] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:40.445562 31550 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:40.445917 31638 raft_consensus.cc:740] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:40.446094 31550 raft_consensus.cc:3060] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:40.446960 31638 consensus_queue.cc:260] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:40.386355 31641 raft_consensus.cc:2804] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:40.448117 31641 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:40.448550 31641 raft_consensus.cc:3060] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:40.448731 31638 raft_consensus.cc:3060] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:40.434322 31533 raft_consensus.cc:3055] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:25:40.453214 31329 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:40.408566 31635 consensus_queue.cc:1048] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.038s
I20260709 12:25:40.461483 25761 raft_consensus.cc:2468] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 19.
I20260709 12:25:40.462695 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:40.464629 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:40.434497 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:40.465811 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:40.430992 25649 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:40.435250 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:40.436462 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:40.473330 25836 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:40.466092 25829 raft_consensus.cc:2468] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 15.
I20260709 12:25:40.434660 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:40.476081 25761 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 12.
I20260709 12:25:40.477387 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:40.478562 25761 raft_consensus.cc:2410] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:25:40.432294 31425 raft_consensus.cc:3060] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:40.486316 31741 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:40.488301 25760 raft_consensus.cc:2393] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 13: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:40.489002 31763 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:40.489307 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:40.489539 31763 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:40.386350 31733 consensus_queue.cc:1048] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.043s
W20260709 12:25:40.491178 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 60272.3us
W20260709 12:25:40.505156 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 216309us
W20260709 12:25:40.507256 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:40.355027 31676 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:40.423061 31696 raft_consensus.cc:697] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 17 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
W20260709 12:25:40.540256 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 143166us
I20260709 12:25:40.566152 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:40.566359 25829 raft_consensus.cc:1240] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:40.567057 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:40.439127 26402 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:40.570278 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:40.571142 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 22 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:40.572470 25761 raft_consensus.cc:2410] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 22 because replica has last-logged OpId of term: 20 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 17.
I20260709 12:25:40.572791 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:40.574308 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:25:40.575628 31750 log.cc:927] Time spent T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.220s	user 0.000s	sys 0.000s
I20260709 12:25:40.576974 31175 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:25:40.578820 26431 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36518 (request call id 1140) took 3695 ms (client timeout 1641 ms). Trace:
W20260709 12:25:40.581166 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:40.581974 25801 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:40.583230 31513 raft_consensus.cc:2749] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:40.583345 25801 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:40.361042 31723 consensus_queue.cc:260] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:40.582056 31520 consensus_queue.cc:1059] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 12:25:40.584434 31723 raft_consensus.cc:3060] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:40.579208 26431 rpcz_store.cc:269] 0709 12:25:36.883242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:36.883383 (+   141us) service_pool.cc:224] Handling call
0709 12:25:40.578640 (+3695257us) spinlock_profiling.cc:243] Waited 3.4 s on lock 0x7b54006126d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:40.578734 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7817117440}
I20260709 12:25:40.584815 31520 raft_consensus.cc:3055] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:25:40.585238 31520 raft_consensus.cc:740] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:40.586071 31520 consensus_queue.cc:260] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:40.587304 31520 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:40.586958 31575 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:40.589838 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:40.591310 25582 catalog_manager.cc:5697] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 9 to 11, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 11 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:25:40.594949 25762 raft_consensus.cc:1240] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 17. Current term is 18. Ops: []
I20260709 12:25:40.569721 31460 raft_consensus.cc:2804] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:40.596565 31460 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:40.596985 31460 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:40.600739 25757 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53460 (request call id 2945) took 3277 ms (client timeout 2107 ms). Trace:
I20260709 12:25:40.601325 31763 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:40.601161 25757 rpcz_store.cc:269] 0709 12:25:37.323632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:37.323792 (+   160us) service_pool.cc:224] Handling call
0709 12:25:40.600545 (+3276753us) spinlock_profiling.cc:243] Waited 2.97 s on lock 0x7b54003a70d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:40.600639 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6819535616}
I20260709 12:25:40.492852 31580 consensus_queue.cc:1243] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer f82778701b464892aab92a752ed7ffdc log is divergent from this leader: its last log entry 13.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:25:40.433624 31630 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:40.602537 25757 raft_consensus.cc:1240] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 LEADER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:40.603686 31630 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:40.604763 25758 raft_consensus.cc:1240] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:40.535648 31704 raft_consensus.cc:697] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 13 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:40.606904 25758 raft_consensus.cc:1240] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:40.593063 25756 raft_consensus.cc:3060] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:40.592981 25582 catalog_manager.cc:5697] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 5 to 8, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 8 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
W20260709 12:25:40.609632 25800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:40.610558 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:40.611279 25758 raft_consensus.cc:1240] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:40.614636 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:40.615017 25758 raft_consensus.cc:1275] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 20 index: 18. Preceding OpId from leader: term: 21 index: 18. (term mismatch)
I20260709 12:25:40.463838 31533 raft_consensus.cc:740] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:40.617575 25761 raft_consensus.cc:1240] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:40.621016 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:40.625818 25801 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:40.628300 25758 pending_rounds.cc:85] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 17
I20260709 12:25:40.634742 25758 pending_rounds.cc:107] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 20.18
I20260709 12:25:40.635428 25758 raft_consensus.cc:2889] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:40.579161 31641 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:40.631837 25832 raft_consensus.cc:1240] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 14. Current term is 16. Ops: []
I20260709 12:25:40.630172 25837 raft_consensus.cc:1240] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:40.607162 31704 consensus_queue.cc:237] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:40.641113 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 203155us
I20260709 12:25:40.642362 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:40.644462 26432 raft_consensus.cc:3060] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:40.644358 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:40.647121 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 22 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:40.643558 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:40.643661 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 22 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:40.649461 25830 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 21.
I20260709 12:25:40.650411 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:40.651015 25830 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:40.642616 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:40.563697 31753 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.658726 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:40.659070 25801 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:40.663131 25682 raft_consensus.cc:2393] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 19: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:40.659530 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:40.660674 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:40.661278 25758 raft_consensus.cc:1240] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 18. Current term is 19. Ops: []
I20260709 12:25:40.664295 26438 raft_consensus.cc:2468] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 15.
I20260709 12:25:40.663745 25677 raft_consensus.cc:3060] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:25:40.627323 31597 consensus_meta.cc:287] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.534s	user 0.009s	sys 0.001s
I20260709 12:25:40.610147 31741 raft_consensus.cc:2804] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:40.680816 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:40.682490 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:40.683234 25828 raft_consensus.cc:2468] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 12.
I20260709 12:25:40.684782 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:40.633742 31592 raft_consensus.cc:2804] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:40.685647 25828 raft_consensus.cc:3060] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:40.627576 31632 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
W20260709 12:25:40.697206 25649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:40.696290 25801 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:40.698921 25830 raft_consensus.cc:2468] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 16.
I20260709 12:25:40.691601 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:40.703079 25801 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:40.670640 31745 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:40.667510 31628 raft_consensus.cc:2804] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:40.672552 31580 raft_consensus.cc:2749] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:40.765331 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:40.684711 31741 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:40.686488 31597 raft_consensus.cc:2749] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611) with higher term. Message: Invalid argument: T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 16. Current term is 17.
I20260709 12:25:40.758667 25828 raft_consensus.cc:2410] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:25:40.615751 31568 consensus_queue.cc:260] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:40.678602 31480 raft_consensus.cc:2749] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:40.780755 26432 raft_consensus.cc:2468] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 16.
I20260709 12:25:40.784973 25830 raft_consensus.cc:1240] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 12:25:40.705696 31592 raft_consensus.cc:697] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 12 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:40.767650 31580 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:40.787812 25758 raft_consensus.cc:1240] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:40.794344 25677 raft_consensus.cc:2468] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 16.
I20260709 12:25:40.770134 31568 raft_consensus.cc:3060] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:40.809502 25829 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 17.
I20260709 12:25:40.797161 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:25:40.827344 26402 leader_election.cc:336] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 1.663s (SENT)
I20260709 12:25:40.836486 26402 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:40.827963 31676 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:40.783020 31741 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:40.829233 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:40.829484 25800 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:40.699828 31554 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:40.819768 25754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 3399) took 1310 ms. Trace:
I20260709 12:25:40.840979 25685 raft_consensus.cc:2393] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 18: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:40.841917 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:40.840698 25754 rpcz_store.cc:276] 0709 12:25:39.509440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:39.511249 (+  1809us) service_pool.cc:224] Handling call
0709 12:25:39.511648 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:40.252099 (+740451us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:40.819499 (+567400us) spinlock_profiling.cc:243] Waited 740 ms on lock 0x7b54001db0d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:40.819703 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1701029760}
I20260709 12:25:40.846499 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:40.848984 26432 raft_consensus.cc:1240] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:40.772446 31630 raft_consensus.cc:2749] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:40.685180 31753 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:40.706225 31632 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:40.781523 31628 raft_consensus.cc:697] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 17 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:40.868026 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:40.867370 25836 raft_consensus.cc:2468] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 19.
I20260709 12:25:40.870983 26437 raft_consensus.cc:1240] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 15 LEADER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:40.874356 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 22 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:40.853443 31480 raft_consensus.cc:2804] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:40.877645 26402 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:40.880605 26437 raft_consensus.cc:1240] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 15. Current term is 16. Ops: [13.12-15.13]
I20260709 12:25:40.881969 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:40.882246 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:40.883685 25686 raft_consensus.cc:3060] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:40.884848 31772 raft_consensus.cc:2749] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:40.886952 31753 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:40.890174 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:40.891305 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:40.877857 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 244329us
I20260709 12:25:40.893662 25759 raft_consensus.cc:1240] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:40.894418 25650 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:40.858546 31660 raft_consensus.cc:3060] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:40.853150 30884 raft_consensus.cc:2749] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:40.875634 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:40.914201 31550 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:40.768209 31696 consensus_queue.cc:237] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:40.922840 25686 raft_consensus.cc:2468] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 16.
I20260709 12:25:40.767894 31533 consensus_queue.cc:260] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:40.896417 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:40.923506 25650 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
W20260709 12:25:40.924096 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:40.921878 25833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 3251) took 3178 ms. Trace:
I20260709 12:25:40.891816 25758 raft_consensus.cc:2468] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 12.
I20260709 12:25:40.872831 31761 raft_consensus.cc:2749] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:25:40.937204 25800 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:25:40.924667 25833 rpcz_store.cc:276] 0709 12:25:37.743270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:39.027586 (+1284316us) service_pool.cc:224] Handling call
0709 12:25:39.027856 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:40.120878 (+1093022us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:40.921600 (+800722us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b540010a754. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:40.921806 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2512384768}
I20260709 12:25:40.892916 26402 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:40.842770 31580 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:40.958225 25758 raft_consensus.cc:1240] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 17. Current term is 18. Ops: []
I20260709 12:25:40.957088 25650 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
W20260709 12:25:40.961333 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:40.970821 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 78161.2us
I20260709 12:25:41.001861 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:41.002842 26432 raft_consensus.cc:2393] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 16: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:40.877951 31480 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:41.023432 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:25:41.023871 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 52119us
I20260709 12:25:41.029345 26402 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:41.001137 31636 raft_consensus.cc:2804] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:40.953467 31606 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.953269 31620 raft_consensus.cc:2804] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:25:41.071452 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:40.969380 31457 raft_consensus.cc:2804] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:25:41.008040 31274 consensus_meta.cc:287] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.698s	user 0.010s	sys 0.000s
I20260709 12:25:41.108650 25760 raft_consensus.cc:2410] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:25:41.001952 31747 raft_consensus.cc:2749] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:41.029003 31480 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:41.026943 31622 raft_consensus.cc:2804] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:41.036584 31533 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:25:41.122993 25756 consensus_meta.cc:287] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.514s	user 0.009s	sys 0.001s
I20260709 12:25:40.953780 31640 consensus_queue.cc:1059] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.143s
I20260709 12:25:40.958127 31537 consensus_queue.cc:1059] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.138s
I20260709 12:25:41.127059 25756 raft_consensus.cc:1275] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 12:25:41.071247 31636 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:41.071780 31772 raft_consensus.cc:2804] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:41.131811 25756 pending_rounds.cc:85] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 10
I20260709 12:25:41.132244 25756 pending_rounds.cc:107] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 12:25:41.072855 31641 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:41.132709 25756 raft_consensus.cc:2889] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:41.134253 25756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 3388) took 2281 ms. Trace:
I20260709 12:25:41.110739 31457 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
W20260709 12:25:41.125761 31679 consensus_meta.cc:287] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.869s	user 0.013s	sys 0.000s
I20260709 12:25:41.134753 25756 rpcz_store.cc:276] 0709 12:25:38.853027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:39.293702 (+440675us) service_pool.cc:224] Handling call
0709 12:25:39.293954 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:40.061255 (+767301us) spinlock_profiling.cc:243] Waited 4.78 ms on lock 0x7b5400199720. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99ad8dc0 00007f5d99b631c0 00007f5d99b64231 00007f5d99b60d8f 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c
0709 12:25:40.592637 (+531382us) spinlock_profiling.cc:243] Waited 65.1 ms on lock 0x7b5800627ed0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99abd0aa 00007f5d99b3f447 00007f5d99b57fe7 00007f5d99b597de 00007f5d99b63b49 00007f5d99b64416 00007f5d99b60d8f 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4
0709 12:25:41.133923 (+541286us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:41.134188 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":160706560}
I20260709 12:25:41.110821 31606 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:41.134711 31636 raft_consensus.cc:3060] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:41.158105 31730 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 12:25:41.045593 31592 consensus_queue.cc:237] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:41.156693 31457 raft_consensus.cc:3060] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:41.122017 31274 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:41.109926 31628 consensus_queue.cc:237] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:41.166513 31772 raft_consensus.cc:697] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 16 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:41.171972 31602 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:41.176080 31640 raft_consensus.cc:3055] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:41.158286 31765 consensus_queue.cc:1048] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.030s
I20260709 12:25:41.175761 31550 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:41.200147 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:41.181978 31745 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:41.171459 31679 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:41.188598 31778 consensus_queue.cc:1059] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 12:25:41.218046 25683 raft_consensus.cc:2393] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 15: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:41.171159 31777 consensus_queue.cc:1048] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 12:25:41.198416 31640 raft_consensus.cc:740] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:41.200886 31641 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:41.236420 31741 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:41.238613 31741 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:41.241818 31520 consensus_meta.cc:287] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.654s	user 0.012s	sys 0.000s
I20260709 12:25:41.244151 31772 consensus_queue.cc:237] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:41.245182 31274 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:41.249145 31679 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:41.250650 31253 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:41.258802 26434 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36508 (request call id 1410) took 1340 ms (client timeout 1571 ms). Trace:
I20260709 12:25:41.201048 31602 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:41.213765 31554 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:41.247825 31752 consensus_meta.cc:287] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.925s	user 0.010s	sys 0.000s
W20260709 12:25:41.259349 26434 rpcz_store.cc:269] 0709 12:25:39.918449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:39.938869 (+ 20420us) service_pool.cc:224] Handling call
0709 12:25:41.258640 (+1319771us) spinlock_profiling.cc:243] Waited 36.5 ms on lock 0x7b540078b754. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:41.258746 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":83905920}
I20260709 12:25:41.231986 31580 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:41.234277 31641 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:41.289050 31638 consensus_meta.cc:287] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.840s	user 0.008s	sys 0.002s
W20260709 12:25:41.292577 31723 consensus_meta.cc:287] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.708s	user 0.010s	sys 0.000s
I20260709 12:25:41.295611 31475 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:41.303817 26433 raft_consensus.cc:2468] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 13.
I20260709 12:25:41.307075 25757 raft_consensus.cc:1275] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
W20260709 12:25:41.219228 25652 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.005s	sys 0.013s
W20260709 12:25:41.310865 25652 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.005s	sys 0.013s
W20260709 12:25:41.311884 25801 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.006s	sys 0.020s
W20260709 12:25:41.312417 25801 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.007s	sys 0.020s
W20260709 12:25:41.312819 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 536508us
I20260709 12:25:41.320356 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:41.321192 25756 raft_consensus.cc:2468] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 17.
W20260709 12:25:41.327000 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 286388us
I20260709 12:25:41.279948 31752 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:41.342378 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 312537us
I20260709 12:25:41.358721 25685 raft_consensus.cc:1240] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 13 LEADER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:25:41.367638 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:41.368468 25833 raft_consensus.cc:3060] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:25:41.371760 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:41.376609 25801 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:41.372632 25835 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 10.
I20260709 12:25:41.360194 25754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 2972) took 1356 ms. Trace:
W20260709 12:25:41.355759 31425 consensus_meta.cc:287] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.867s	user 0.010s	sys 0.001s
I20260709 12:25:41.391860 25650 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:41.394683 25677 raft_consensus.cc:2393] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 15: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:41.394690 25650 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:41.397281 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:41.341166 31638 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
W20260709 12:25:41.425438 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 109566us
I20260709 12:25:41.426561 25801 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:41.427734 25801 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:41.298442 31640 consensus_queue.cc:260] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:41.404286 25833 raft_consensus.cc:2468] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 17.
I20260709 12:25:41.392730 25800 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:41.382647 31622 raft_consensus.cc:697] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 18 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:41.310105 31475 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:41.439852 25801 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:41.410496 31777 raft_consensus.cc:2804] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:41.436194 31537 raft_consensus.cc:2749] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:25:41.470007 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:41.465210 31695 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:41.476557 31622 consensus_queue.cc:237] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:41.477213 31695 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:41.479355 31695 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:41.445488 31790 raft_consensus.cc:2804] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:41.397444 31425 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:41.485886 31480 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:41.462055 31777 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:41.432979 31638 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:41.464005 31794 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:41.494211 31537 raft_consensus.cc:2804] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:41.471767 31606 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:25:41.495028 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:41.451200 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 58523.7us
I20260709 12:25:41.475068 31704 raft_consensus.cc:3060] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:41.515681 26402 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:41.491845 31790 raft_consensus.cc:697] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 16 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:41.515450 31788 raft_consensus.cc:2749] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:41.495780 31798 consensus_queue.cc:1059] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 12:25:41.522161 31641 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:41.522356 31776 raft_consensus.cc:3055] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:41.522732 31776 raft_consensus.cc:740] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:41.523257 31577 raft_consensus.cc:3055] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:41.523625 31577 raft_consensus.cc:740] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:41.524544 31577 consensus_queue.cc:260] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:41.525722 31577 raft_consensus.cc:3060] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:41.527036 31729 raft_consensus.cc:3055] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:41.527417 31729 raft_consensus.cc:740] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:41.528262 31729 consensus_queue.cc:260] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:41.529552 31729 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:25:41.522742 31641 raft_consensus.cc:2804] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:41.539228 31641 raft_consensus.cc:697] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 17 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:41.540148 31641 consensus_queue.cc:237] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:41.523545 31776 consensus_queue.cc:260] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:41.544493 31776 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:25:41.538626 31774 log.cc:927] Time spent T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.513s	user 0.000s	sys 0.001s
I20260709 12:25:41.553356 31632 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:41.498152 31777 raft_consensus.cc:3060] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:41.574644 31425 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:41.579752 25837 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 18.
I20260709 12:25:41.580538 31584 raft_consensus.cc:3055] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:41.581027 31584 raft_consensus.cc:740] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:41.581991 31584 consensus_queue.cc:260] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:41.583518 31584 raft_consensus.cc:3060] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:41.591888 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:41.592478 31752 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:41.510440 31779 log.cc:927] Time spent T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.229s	user 0.001s	sys 0.001s
W20260709 12:25:41.597767 31787 log.cc:927] Time spent T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 12:25:41.598825 31790 consensus_queue.cc:237] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:41.602661 31696 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:41.559095 25831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 3285) took 1119 ms. Trace:
I20260709 12:25:41.603242 31696 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:41.604907 25831 rpcz_store.cc:276] 0709 12:25:40.439727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:40.439897 (+   170us) service_pool.cc:224] Handling call
0709 12:25:40.440267 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:40.604392 (+164125us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:25:40.888794 (+284402us) log.cc:844] Serialized 14 byte log entry
0709 12:25:41.235705 (+346911us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:41.235761 (+    56us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:41.235805 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:41.558815 (+323010us) spinlock_profiling.cc:243] Waited 164 ms on lock 0x7b5400118854. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:41.558862 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:41.559026 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":284064,"prepare.queue_time_us":284642,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":3437,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":100,"spinlock_wait_cycles":376928000,"thread_start_us":342883,"threads_started":1,"wal-append.queue_time_us":555614}
I20260709 12:25:41.497793 31602 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:41.498965 25828 raft_consensus.cc:1240] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 13. Current term is 14. Ops: []
W20260709 12:25:41.498740 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 293493us
I20260709 12:25:41.619405 25833 raft_consensus.cc:1275] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:25:41.512195 31537 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
W20260709 12:25:41.624866 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:41.626045 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:41.625344 31537 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:41.618098 31620 raft_consensus.cc:697] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 15 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:41.649051 31560 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:41.673313 31640 raft_consensus.cc:3060] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:41.673518 31560 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:41.671536 31675 consensus_queue.cc:260] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:41.511847 31794 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:41.679047 31675 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:41.679741 31560 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:41.681092 31638 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:41.682607 31575 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:41.682950 31636 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:41.683776 31696 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:41.690613 31636 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:41.695902 31777 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:41.704144 31620 consensus_queue.cc:237] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:41.706705 31777 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:41.686474 31794 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:41.652071 31733 consensus_queue.cc:1048] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.028s
I20260709 12:25:41.708791 31704 raft_consensus.cc:2749] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:25:41.740818 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:41.740621 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 345769us
I20260709 12:25:41.742671 25650 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
W20260709 12:25:41.745872 25679 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.001s	sys 0.009s
W20260709 12:25:41.746470 25679 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.001s	sys 0.009s
W20260709 12:25:41.747056 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:41.748849 25680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2730) took 1124 ms. Trace:
I20260709 12:25:41.749276 25680 rpcz_store.cc:276] 0709 12:25:40.624075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:40.624273 (+   198us) service_pool.cc:224] Handling call
0709 12:25:40.646265 (+ 21992us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:25:40.954115 (+307850us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:40.954169 (+    54us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:25:40.955037 (+   868us) log.cc:844] Serialized 78 byte log entry
0709 12:25:41.428847 (+473810us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:41.448051 (+ 19204us) log.cc:844] Serialized 14 byte log entry
0709 12:25:41.452874 (+  4823us) log.cc:844] Serialized 14 byte log entry
0709 12:25:41.453442 (+   568us) log.cc:844] Serialized 14 byte log entry
0709 12:25:41.453645 (+   203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:41.453744 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:41.555456 (+101712us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b18004909c0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d96a74522 00007f5d96a767c1 00007f5d96a76779 00007f5d96a76709 00007f5d96a766d1 00007f5d96a759cd 0000000000388634 0000000000388479 00007f5d96a5783a
0709 12:25:41.556585 (+  1129us) spinlock_profiling.cc:243] Waited 8.61 ms on lock 0x7b18004909c0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d969eec0a 00007f5da012e219 00007f5d9da3558f 00007f5d96a74571 00007f5d96a767c1 00007f5d96a76779 00007f5d96a76709 00007f5d96a766d1 00007f5d96a759cd
0709 12:25:41.562896 (+  6311us) spinlock_profiling.cc:243] Waited 8.68 ms on lock 0x7b18004909c0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d96a74522 00007f5d96a767c1 00007f5d96a76779 00007f5d96a76709 00007f5d96a766d1 00007f5d96a759cd 0000000000388634 0000000000388479 00007f5d96a5783a
0709 12:25:41.748127 (+185231us) raft_consensus.cc:1685] finished
0709 12:25:41.748182 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:41.748605 (+   423us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85134,"prepare.queue_time_us":478542,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":59,"raft.queue_time_us":57037,"raft.run_cpu_time_us":2344,"raft.run_wall_time_us":58694,"spinlock_wait_cycles":73715072,"thread_start_us":614392,"threads_started":2,"wal-append.queue_time_us":585595}
I20260709 12:25:41.752866 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:41.762389 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:41.764443 25679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2729) took 1140 ms. Trace:
I20260709 12:25:41.765007 25679 rpcz_store.cc:276] 0709 12:25:40.623788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:40.623890 (+   102us) service_pool.cc:224] Handling call
0709 12:25:40.624205 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:40.624534 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:40.624561 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:40.633533 (+  8972us) log.cc:844] Serialized 26 byte log entry
0709 12:25:41.116333 (+482800us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:41.747108 (+630775us) log.cc:844] Serialized 14 byte log entry
0709 12:25:41.747556 (+   448us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:41.747696 (+   140us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:41.747787 (+    91us) raft_consensus.cc:1685] finished
0709 12:25:41.747824 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:41.764350 (+ 16526us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":16884,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":10245,"raft.queue_time_us":195,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":9557,"thread_start_us":1034851,"threads_started":2,"wal-append.queue_time_us":560678}
I20260709 12:25:41.776770 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:41.779242 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:41.782296 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:25:41.783089 26402 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 1.605s (SENT) [suppressed 21 similar messages]
I20260709 12:25:41.684760 31475 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:41.784668 31274 raft_consensus.cc:2804] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:25:41.660593 31460 consensus_meta.cc:287] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 1.063s	user 0.011s	sys 0.002s
I20260709 12:25:41.687885 31480 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:41.804400 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:41.805583 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:41.805830 31747 raft_consensus.cc:2749] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:41.800202 31274 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:41.834010 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:41.825512 31274 raft_consensus.cc:3060] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:41.846660 31554 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:41.848258 31554 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:41.852047 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:41.852984 25758 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.031s	sys 0.031s
W20260709 12:25:41.853492 25758 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.031s	sys 0.031s
W20260709 12:25:41.860098 25763 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.020s	sys 0.039s
W20260709 12:25:41.860756 25763 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.020s	sys 0.039s
I20260709 12:25:41.864846 25758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 3410) took 1715 ms. Trace:
I20260709 12:25:41.865420 25758 rpcz_store.cc:276] 0709 12:25:40.149131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:40.960463 (+811332us) service_pool.cc:224] Handling call
0709 12:25:40.960731 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:40.960940 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:25:41.311215 (+350275us) log.cc:844] Serialized 14 byte log entry
0709 12:25:41.864029 (+552814us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:41.864116 (+    87us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:41.864239 (+   123us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:41.864352 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:41.864709 (+   357us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73114,"prepare.queue_time_us":430235,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":47,"thread_start_us":780001,"threads_started":2}
I20260709 12:25:41.864902 31460 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:41.871657 31460 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:41.867535 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:41.879760 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:41.880242 31622 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:41.880839 25758 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 13.
I20260709 12:25:41.881342 31622 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:41.882061 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:41.883117 25758 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:41.875715 25763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 2973) took 1865 ms. Trace:
I20260709 12:25:41.884094 25763 rpcz_store.cc:276] 0709 12:25:40.010525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:40.850045 (+839520us) service_pool.cc:224] Handling call
0709 12:25:40.850341 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:40.850552 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:25:41.327880 (+477328us) log.cc:844] Serialized 14 byte log entry
0709 12:25:41.874088 (+546208us) log.cc:844] Serialized 14 byte log entry
0709 12:25:41.874741 (+   653us) log.cc:844] Serialized 14 byte log entry
0709 12:25:41.874973 (+   232us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:41.875048 (+    75us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:41.875178 (+   130us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:41.875326 (+   148us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:41.875619 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27371,"prepare.queue_time_us":460713,"prepare.run_cpu_time_us":125,"prepare.run_wall_time_us":126,"raft.queue_time_us":19360,"raft.run_cpu_time_us":377,"raft.run_wall_time_us":371,"thread_start_us":969708,"threads_started":2}
I20260709 12:25:41.886535 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:41.887221 25763 raft_consensus.cc:1275] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:25:41.888311 31680 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:41.889137 31680 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:41.894025 25762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48606 (request call id 1482) took 2228 ms. Trace:
I20260709 12:25:41.894542 25762 rpcz_store.cc:276] 0709 12:25:39.665895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:40.609027 (+943132us) service_pool.cc:224] Handling call
0709 12:25:40.609274 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:41.754051 (+1144777us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:41.754116 (+    65us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:41.754181 (+    65us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:41.754220 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:41.893485 (+139265us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54003a6bd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:41.893546 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:41.893781 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2631189888}
I20260709 12:25:41.904613 25756 raft_consensus.cc:3060] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:41.383069 25754 rpcz_store.cc:276] 0709 12:25:40.003609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:40.843102 (+839493us) service_pool.cc:224] Handling call
0709 12:25:40.843363 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:40.843577 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:25:41.159623 (+316046us) log.cc:844] Serialized 14 byte log entry
0709 12:25:41.359722 (+200099us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:41.359793 (+    71us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:41.359853 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:41.359955 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:41.360124 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":438543,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":2053,"raft.queue_time_us":20901,"thread_start_us":492226,"threads_started":2,"wal-append.queue_time_us":185306}
W20260709 12:25:41.904609 25759 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.051s	sys 0.081s
W20260709 12:25:41.912891 25759 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.052s	sys 0.081s
W20260709 12:25:41.916301 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:41.922345 31636 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:41.923756 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:41.923493 31460 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:41.923326 31636 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:41.925704 31460 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:41.927224 25686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40230 (request call id 1929) took 1354 ms. Trace:
I20260709 12:25:41.927498 31636 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:41.918759 31729 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:41.929883 25757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48606 (request call id 1484) took 2263 ms. Trace:
I20260709 12:25:41.926064 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:41.928700 31640 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:41.937012 25684 raft_consensus.cc:1240] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:25:41.936615 31640 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:41.927618 25686 rpcz_store.cc:276] 0709 12:25:40.572300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:40.572466 (+   166us) service_pool.cc:224] Handling call
0709 12:25:41.926813 (+1354347us) spinlock_profiling.cc:243] Waited 310 ms on lock 0x7b54002cfbd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:41.927021 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":713386240}
I20260709 12:25:41.933344 25760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53474 (request call id 3408) took 1805 ms. Trace:
I20260709 12:25:41.939038 25684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2726) took 1316 ms. Trace:
I20260709 12:25:41.935266 25758 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 16.
W20260709 12:25:41.937033 25755 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53460 (request call id 2961) took 2038 ms (client timeout 1687 ms). Trace:
I20260709 12:25:41.930425 25757 rpcz_store.cc:276] 0709 12:25:39.666586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:40.603274 (+936688us) service_pool.cc:224] Handling call
0709 12:25:40.603524 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:41.307608 (+704084us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:41.929259 (+621651us) spinlock_profiling.cc:243] Waited 701 ms on lock 0x7b54003a61d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:41.929621 (+   362us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1612140800}
I20260709 12:25:41.930904 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:25:41.933584 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 493672us
I20260709 12:25:41.939172 25760 rpcz_store.cc:276] 0709 12:25:40.128106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:40.489024 (+360918us) service_pool.cc:224] Handling call
0709 12:25:41.932846 (+1443822us) spinlock_profiling.cc:243] Waited 618 ms on lock 0x7b5400041fd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:41.933084 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1421710592}
I20260709 12:25:41.942076 25829 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44218 (request call id 2018) took 1327 ms. Trace:
I20260709 12:25:41.942250 31640 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:41.940083 25755 rpcz_store.cc:269] 0709 12:25:39.898623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:40.159672 (+261049us) service_pool.cc:224] Handling call
0709 12:25:41.936499 (+1776827us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b54001dbad4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:41.936782 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":433033600}
I20260709 12:25:41.938758 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:41.945262 25759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 2975) took 1817 ms. Trace:
I20260709 12:25:41.945384 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:41.945770 25759 rpcz_store.cc:276] 0709 12:25:40.127703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:40.927840 (+800137us) service_pool.cc:224] Handling call
0709 12:25:40.928180 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:40.928409 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:25:41.273753 (+345344us) log.cc:844] Serialized 14 byte log entry
0709 12:25:41.944456 (+670703us) log.cc:844] Serialized 14 byte log entry
0709 12:25:41.944776 (+   320us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:41.944840 (+    64us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:41.944913 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:41.945007 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:41.945213 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6953,"prepare.queue_time_us":452453,"prepare.run_cpu_time_us":111,"prepare.run_wall_time_us":115,"thread_start_us":891264,"threads_started":2,"wal-append.queue_time_us":654549}
I20260709 12:25:41.948137 25761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 2966) took 2031 ms. Trace:
I20260709 12:25:41.948572 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:41.942587 25829 rpcz_store.cc:276] 0709 12:25:40.614299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:40.614437 (+   138us) service_pool.cc:224] Handling call
0709 12:25:41.941694 (+1327257us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b5400119254. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:41.941869 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":417259264}
I20260709 12:25:41.939895 25684 rpcz_store.cc:276] 0709 12:25:40.622991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:40.623115 (+   124us) service_pool.cc:224] Handling call
0709 12:25:41.936242 (+1313127us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:41.937674 (+  1432us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:41.938770 (+  1096us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54002cfbd0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b608ad 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:41.938981 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2922309888}
I20260709 12:25:41.929903 31729 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:41.952857 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:41.953881 25678 raft_consensus.cc:2468] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 14.
I20260709 12:25:41.954941 31729 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:41.955173 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:41.948629 25761 rpcz_store.cc:276] 0709 12:25:39.916496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:40.660492 (+743996us) service_pool.cc:224] Handling call
0709 12:25:40.660715 (+   223us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:41.752958 (+1092243us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:25:41.753018 (+    60us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:41.753071 (+    53us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:41.753099 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:41.943802 (+190703us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400002654. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:41.943844 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:41.947940 (+  4096us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33316,"raft.queue_time_us":61246,"raft.run_cpu_time_us":495,"raft.run_wall_time_us":13143,"spinlock_wait_cycles":2510222080}
I20260709 12:25:41.957463 31794 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:41.958184 31704 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:41.958451 31794 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:41.959203 31704 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:41.960240 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:41.959677 31460 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:41.961676 31733 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:41.962566 31733 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:41.963191 31794 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:41.949105 25801 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:41.923125 31622 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:41.968407 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:41.969676 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:41.971202 25684 raft_consensus.cc:2410] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:25:41.992437 31704 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:41.994364 25677 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40230 (request call id 1934) took 1322 ms (client timeout 1750 ms). Trace:
I20260709 12:25:41.994936 25683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40230 (request call id 1928) took 1429 ms. Trace:
W20260709 12:25:41.994870 25677 rpcz_store.cc:269] 0709 12:25:40.671931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:40.828953 (+157022us) service_pool.cc:224] Handling call
0709 12:25:41.993902 (+1164949us) spinlock_profiling.cc:243] Waited 557 ms on lock 0x7b5400265cd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:41.994193 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1280357760}
I20260709 12:25:41.996737 25681 raft_consensus.cc:1240] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 14. Current term is 15. Ops: []
W20260709 12:25:42.001545 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 53248us
I20260709 12:25:41.995428 25683 rpcz_store.cc:276] 0709 12:25:40.565743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:40.565891 (+   148us) service_pool.cc:224] Handling call
0709 12:25:41.994494 (+1428603us) spinlock_profiling.cc:243] Waited 648 ms on lock 0x7b540007b2d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:41.994749 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1491054976}
I20260709 12:25:42.007977 25678 raft_consensus.cc:1240] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:42.008157 25686 raft_consensus.cc:2393] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 13: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:42.008749 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:42.013624 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:42.015091 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:25:42.015276 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:42.015940 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.016371 31729 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.017055 31729 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:42.017468 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:42.019091 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:42.019411 31729 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:42.007669 31175 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:42.013571 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:42.005179 31733 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:42.025082 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:25:42.024369 31457 consensus_meta.cc:287] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.725s	user 0.015s	sys 0.006s
I20260709 12:25:42.006814 31554 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:42.028612 31457 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:42.033087 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:42.027621 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:42.034314 25685 raft_consensus.cc:2393] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 13: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:42.034884 25755 raft_consensus.cc:2468] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 13.
I20260709 12:25:42.047313 25680 raft_consensus.cc:1275] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
I20260709 12:25:42.049511 25677 raft_consensus.cc:1275] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:25:42.049994 25801 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:42.054216 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:42.047572 25800 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:42.059506 25682 raft_consensus.cc:2468] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 17.
I20260709 12:25:42.061514 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:42.050856 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:42.064406 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:42.063584 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:42.066658 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 47517us
W20260709 12:25:42.068178 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.068668 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:42.069329 25759 raft_consensus.cc:2468] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 14.
I20260709 12:25:42.069454 31733 consensus_queue.cc:1059] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:25:42.070827 30884 raft_consensus.cc:3055] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:25:42.071249 30884 raft_consensus.cc:740] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:42.075093 30884 consensus_queue.cc:260] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:42.077803 25755 raft_consensus.cc:2468] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 13.
I20260709 12:25:42.078461 31554 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:42.080668 25833 raft_consensus.cc:1240] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 12:25:42.068754 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:42.080449 31554 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:42.079039 25758 raft_consensus.cc:3055] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:42.083827 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:42.084501 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.084779 25829 raft_consensus.cc:1240] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:42.085175 25762 raft_consensus.cc:2393] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 17: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:42.083103 25758 raft_consensus.cc:740] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:42.083894 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:42.088223 25831 raft_consensus.cc:2410] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:25:42.079712 31584 raft_consensus.cc:2749] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:25:42.082638 31457 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:42.097070 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:42.097630 25760 raft_consensus.cc:2468] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 14.
I20260709 12:25:42.060113 31274 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:42.093514 25763 raft_consensus.cc:2468] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 16.
I20260709 12:25:42.095100 25758 consensus_queue.cc:260] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:42.098827 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:42.103751 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.105783 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:42.104360 31811 log.cc:927] Time spent T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 12:25:42.104204 25726 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:42.107177 25763 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 13.
I20260709 12:25:42.108163 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:42.105684 31584 raft_consensus.cc:2749] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:42.097941 31680 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:42.108166 30884 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:42.120530 25754 raft_consensus.cc:2393] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 18: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
W20260709 12:25:42.115324 31819 log.cc:927] Time spent T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
W20260709 12:25:42.121284 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 94047.1us
I20260709 12:25:42.121707 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:42.125890 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:42.129709 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:42.119035 31680 raft_consensus.cc:2749] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:42.130555 25758 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:42.133244 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:42.136701 25681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2728) took 1513 ms. Trace:
I20260709 12:25:42.137234 25801 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:42.137172 25681 rpcz_store.cc:276] 0709 12:25:40.623529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:40.623677 (+   148us) service_pool.cc:224] Handling call
0709 12:25:41.996296 (+1372619us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:41.997208 (+   912us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:42.136449 (+139241us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b540007b2d0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b608ad 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:42.136624 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3155819776}
I20260709 12:25:42.134259 25755 raft_consensus.cc:2468] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 15.
I20260709 12:25:42.142207 25762 raft_consensus.cc:2393] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 16: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:42.140175 26402 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:42.148897 31175 raft_consensus.cc:2749] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:42.152552 25760 raft_consensus.cc:2393] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 16: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:42.156327 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:42.158937 31274 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:42.158296 25582 catalog_manager.cc:5697] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 9 to 11, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 11 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
W20260709 12:25:42.160588 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 246175us
I20260709 12:25:42.164021 31584 raft_consensus.cc:2804] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:42.164718 25763 raft_consensus.cc:2410] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 12:25:42.164960 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:42.167667 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 63741.3us
I20260709 12:25:42.165522 31584 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:42.173135 31641 raft_consensus.cc:2749] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:42.169094 31584 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:42.178679 31813 log.cc:927] Time spent T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.138s	user 0.004s	sys 0.000s
I20260709 12:25:42.180622 31641 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.188297 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:42.187124 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:42.192173 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:42.196180 25757 raft_consensus.cc:2393] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 14: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
W20260709 12:25:42.193068 31818 log.cc:927] Time spent T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 12:25:42.195613 31606 consensus_queue.cc:1059] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:25:42.227293 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.227239 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:42.227679 31606 raft_consensus.cc:3055] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:42.228121 26430 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:42.229838 25758 raft_consensus.cc:1275] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 12:25:42.230228 25758 pending_rounds.cc:85] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 11
I20260709 12:25:42.230505 25758 pending_rounds.cc:107] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 12:25:42.230793 25758 raft_consensus.cc:2889] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:42.231958 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:42.197849 25757 raft_consensus.cc:1275] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:25:42.238056 31175 consensus_queue.cc:1059] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:42.238718 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:42.239280 25761 raft_consensus.cc:3060] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:42.185611 31641 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:42.201045 25726 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
W20260709 12:25:42.240691 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 46363.6us
I20260709 12:25:42.241132 25726 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:42.203824 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:42.204172 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:42.204597 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:42.205962 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:42.206879 31620 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:42.208896 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:25:42.212253 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 72190.6us
I20260709 12:25:42.214118 25650 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:42.220767 31622 consensus_queue.cc:1048] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:25:42.221134 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:42.259071 26439 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:42.225031 26435 raft_consensus.cc:1275] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:25:42.260076 25756 raft_consensus.cc:2468] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 13.
I20260709 12:25:42.225754 26401 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:25:42.226089 31537 consensus_meta.cc:287] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.539s	user 0.004s	sys 0.012s
I20260709 12:25:42.226305 31733 consensus_queue.cc:1048] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:25:42.228128 31606 raft_consensus.cc:740] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:42.232800 31580 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:42.263351 26402 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:42.263440 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:42.197564 31554 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:42.236518 31822 log.cc:927] Time spent T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:25:42.239480 31812 raft_consensus.cc:3055] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:42.264926 31812 raft_consensus.cc:740] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:42.265156 31797 raft_consensus.cc:2749] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:42.266214 26434 raft_consensus.cc:2468] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 16.
I20260709 12:25:42.266080 31812 consensus_queue.cc:260] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:42.267419 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:42.245400 31704 consensus_queue.cc:1048] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:42.266032 31620 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:42.250398 25582 catalog_manager.cc:5697] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 5 to 8, leader changed from a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 8 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:25:42.251384 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:42.267859 31812 raft_consensus.cc:3060] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:42.268373 26438 raft_consensus.cc:2468] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 13.
W20260709 12:25:42.202281 25649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.251981 31729 raft_consensus.cc:2749] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:25:42.244736 31680 raft_consensus.cc:2749] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:42.258396 25762 raft_consensus.cc:1240] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 17. Current term is 18. Ops: []
I20260709 12:25:42.274756 26438 raft_consensus.cc:1275] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:25:42.222711 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:42.262552 26436 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 13.
I20260709 12:25:42.276348 31457 consensus_queue.cc:1048] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:42.269747 31537 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:42.279021 25831 raft_consensus.cc:1240] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 17. Current term is 18. Ops: []
I20260709 12:25:42.279523 25649 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:42.270608 31274 raft_consensus.cc:2804] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:42.311106 31274 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:42.271056 26433 raft_consensus.cc:2468] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 14.
I20260709 12:25:42.264417 26432 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 22.
I20260709 12:25:42.282562 26438 raft_consensus.cc:1275] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:25:42.283818 25582 catalog_manager.cc:5697] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 8 to 11, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 11 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:25:42.285620 26434 raft_consensus.cc:2393] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 12: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:42.287334 25757 raft_consensus.cc:1240] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 13. Current term is 14. Ops: []
W20260709 12:25:42.324429 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 74060.1us
I20260709 12:25:42.324606 26430 raft_consensus.cc:2468] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 14.
I20260709 12:25:42.326001 25726 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:25:42.326300 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 100830us
I20260709 12:25:42.302140 25761 raft_consensus.cc:2410] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:25:42.311700 31274 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:42.332046 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 68886.9us
I20260709 12:25:42.317191 25582 catalog_manager.cc:5697] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 6 to 11, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 11 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:25:42.332926 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 70732.1us
W20260709 12:25:42.337280 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 123350us
I20260709 12:25:42.338053 31622 raft_consensus.cc:2804] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:42.344261 31729 raft_consensus.cc:2804] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:42.344282 31776 raft_consensus.cc:2749] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:25:42.338587 31622 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:42.375896 25758 raft_consensus.cc:3060] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:42.353076 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.381995 31641 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:42.382781 31554 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:42.383459 31554 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:42.385527 31554 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:42.345196 31460 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.378342 31622 raft_consensus.cc:3060] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:42.399766 26402 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:42.345144 31729 raft_consensus.cc:697] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:42.346257 31537 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:42.326037 31606 consensus_queue.cc:260] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:42.335341 31580 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:42.413486 26439 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 16.
W20260709 12:25:42.415400 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 153012us
I20260709 12:25:42.418316 25800 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:42.409773 25582 catalog_manager.cc:5697] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 9 to 12, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 12 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:25:42.406963 31620 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:42.424613 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 145391us
I20260709 12:25:42.425462 25801 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
W20260709 12:25:42.429836 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 46287.2us
W20260709 12:25:42.419811 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 82584.1us
I20260709 12:25:42.424597 31606 raft_consensus.cc:3060] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:42.430756 25649 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:42.410755 31460 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:42.432039 31790 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.435848 31641 raft_consensus.cc:2804] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:42.441865 26402 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:42.442478 31577 raft_consensus.cc:2749] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:42.431825 31475 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.442003 31537 raft_consensus.cc:2804] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:42.443475 25582 catalog_manager.cc:5697] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 6 to 9, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 9 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:42.455550 31733 raft_consensus.cc:2749] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:25:42.455351 31475 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:42.446265 31641 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:42.436815 31584 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:42.461743 25801 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:42.459309 31641 raft_consensus.cc:3060] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:42.464463 25649 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:25:42.468595 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 47198.9us
I20260709 12:25:42.459213 31620 raft_consensus.cc:2804] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:25:42.458118 31790 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:42.461366 31537 raft_consensus.cc:697] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 13 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
W20260709 12:25:42.477715 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 69830.1us
I20260709 12:25:42.467803 31680 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:42.485553 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 45770.5us
I20260709 12:25:42.489029 31475 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:42.490701 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:42.491497 25761 raft_consensus.cc:2468] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 16.
I20260709 12:25:42.504144 31776 raft_consensus.cc:2749] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:42.504745 25650 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:42.506561 31584 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:42.507414 25801 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:25:42.507830 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.503407 31537 consensus_queue.cc:237] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:42.508657 25801 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:42.509428 31577 raft_consensus.cc:2804] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:42.509819 25801 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:42.509821 31577 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:42.510573 31577 raft_consensus.cc:3060] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:42.511054 25801 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:42.507501 25650 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:42.511821 25801 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:42.480401 31620 raft_consensus.cc:697] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 19 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:42.524683 25758 raft_consensus.cc:2468] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 15.
I20260709 12:25:42.526944 31824 raft_consensus.cc:2749] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:42.527285 31460 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:42.527865 31460 raft_consensus.cc:2804] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:25:42.529873 31175 consensus_queue.cc:1048] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:42.520210 31640 consensus_queue.cc:1048] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 12:25:42.530905 31460 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:42.531363 31460 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:25:42.541090 31790 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:42.486142 31825 raft_consensus.cc:2804] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:42.541859 31825 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:42.542292 31825 raft_consensus.cc:3060] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:42.523661 31475 raft_consensus.cc:2804] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:42.518258 31776 raft_consensus.cc:2804] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:42.546231 31776 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:42.522330 31584 raft_consensus.cc:2804] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:42.552116 31675 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:42.553067 31675 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:42.554554 31641 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:42.552145 31584 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:42.521230 31636 raft_consensus.cc:2749] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:42.556689 31620 consensus_queue.cc:237] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:42.482904 31729 consensus_queue.cc:237] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:42.557781 31554 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:42.560642 31554 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:42.562503 26401 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:42.562906 31554 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:42.564095 26401 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:42.565619 26401 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:42.517951 31680 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:42.548074 31776 raft_consensus.cc:3060] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:25:42.574564 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.544902 31475 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:42.580090 26402 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
W20260709 12:25:42.522122 25579 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41240 (request call id 371) took 35529 ms (client timeout 15000 ms). Trace:
I20260709 12:25:42.588096 31577 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:42.589550 31641 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:42.590147 26401 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:42.556767 31584 raft_consensus.cc:3060] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:42.525491 31704 consensus_queue.cc:1048] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.064s
I20260709 12:25:42.544768 31580 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:42.583875 31675 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:42.600335 25726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.592379 31733 raft_consensus.cc:2804] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:42.594219 31475 raft_consensus.cc:3060] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:42.601300 30884 raft_consensus.cc:2804] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:25:42.603453 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 96028.7us
I20260709 12:25:42.603813 30884 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:42.604375 30884 raft_consensus.cc:3060] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:42.611660 25833 raft_consensus.cc:1275] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:25:42.612816 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:42.613600 25828 raft_consensus.cc:2468] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 15.
I20260709 12:25:42.615794 31577 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:42.618970 31622 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:42.620163 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:42.621095 31641 raft_consensus.cc:2749] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:42.621337 31680 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:42.621856 31812 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.622411 31812 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:42.600260 31797 raft_consensus.cc:2804] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:42.606801 31606 raft_consensus.cc:2749] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:42.624440 31797 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:42.625037 31797 raft_consensus.cc:3060] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:42.625293 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:42.626377 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:42.626796 25650 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:42.627071 25837 raft_consensus.cc:2468] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 17.
I20260709 12:25:42.628569 25834 raft_consensus.cc:1240] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 17. Current term is 18. Ops: []
I20260709 12:25:42.628787 31827 raft_consensus.cc:2804] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:25:42.629266 31827 raft_consensus.cc:697] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 19 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:42.630154 31827 consensus_queue.cc:237] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:42.633315 25832 raft_consensus.cc:1240] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:42.636161 25836 raft_consensus.cc:1240] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:42.624478 31812 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:42.641279 30884 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:42.642668 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.644958 25761 pending_rounds.cc:85] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 11
I20260709 12:25:42.645483 25761 pending_rounds.cc:107] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 12:25:42.645787 25761 raft_consensus.cc:2889] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:42.646157 25761 pending_rounds.cc:107] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 12:25:42.646435 25761 raft_consensus.cc:2889] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:42.603446 31733 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:42.649354 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:42.652390 30884 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:25:42.653903 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 131533us
I20260709 12:25:42.654786 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:42.688164 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:42.688714 31680 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.659027 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:42.661504 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:42.690230 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:42.659945 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:42.663416 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:25:42.669777 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:42.691258 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 203249us
I20260709 12:25:42.651124 31733 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:42.692972 25754 raft_consensus.cc:2410] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 18 because replica has last-logged OpId of term: 16 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 14.
I20260709 12:25:42.693087 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:42.695273 25832 raft_consensus.cc:1240] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:42.689313 31680 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:42.693956 25801 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:42.698113 25755 raft_consensus.cc:2468] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 19.
I20260709 12:25:42.664763 31729 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.649256 31825 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:42.702510 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.664906 31554 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.704712 25828 raft_consensus.cc:2393] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 16: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:42.705427 25757 raft_consensus.cc:2468] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 17.
W20260709 12:25:42.707095 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 117098us
I20260709 12:25:42.709210 26401 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:42.689981 31675 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:42.717841 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:42.705061 25801 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:25:42.723373 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 263795us
I20260709 12:25:42.724424 30884 raft_consensus.cc:3060] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:42.728503 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:42.732234 26402 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:42.721894 31537 raft_consensus.cc:2804] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:42.732635 31622 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:42.744231 26402 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:42.744448 31622 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.744935 31622 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:42.705451 31274 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:42.748154 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:42.756834 31577 raft_consensus.cc:2804] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:42.758435 31825 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:42.739760 31828 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.764052 31628 raft_consensus.cc:2749] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:42.764269 31828 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:42.750555 31641 raft_consensus.cc:3060] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:42.766584 31828 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:42.722167 31460 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 23 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:42.773013 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:42.777108 30884 raft_consensus.cc:2749] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:42.725270 31554 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:42.777906 30884 consensus_queue.cc:1048] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:42.739495 31729 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:42.779459 25800 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:42.749886 31537 raft_consensus.cc:697] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 14 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
W20260709 12:25:42.784776 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 99033.1us
I20260709 12:25:42.787431 31729 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:42.740748 31675 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:42.789387 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:42.789731 31680 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:42.790238 25762 raft_consensus.cc:2393] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 15: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:42.773021 31577 raft_consensus.cc:697] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 16 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:42.788300 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:42.802587 25831 raft_consensus.cc:2393] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 23: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:42.794572 25800 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:42.813082 25800 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:42.807220 25756 raft_consensus.cc:2410] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 20 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 12:25:42.823544 31776 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:42.824071 31636 raft_consensus.cc:2804] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:25:42.824390 25801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.824575 31636 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:42.824980 31636 raft_consensus.cc:3060] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:42.825810 31776 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:42.827548 31460 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 23 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:42.816493 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 46050.1us
I20260709 12:25:42.830205 26437 raft_consensus.cc:2393] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 17: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:42.831864 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:42.828769 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:42.830981 25837 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:25:42.835083 25837 raft_consensus.cc:606] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 13 LEADER]: Received request to transfer leadership to TS 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:42.835001 31537 consensus_queue.cc:237] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:42.835817 31554 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:42.837088 31577 consensus_queue.cc:237] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:42.828581 31475 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:42.840267 31475 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:42.840341 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:42.841097 25755 raft_consensus.cc:2468] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 16.
I20260709 12:25:42.807076 31584 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:42.846179 26430 raft_consensus.cc:2468] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 15.
I20260709 12:25:42.846702 31584 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:42.837363 31797 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:42.803157 31825 raft_consensus.cc:2804] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:42.862098 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:42.863087 26436 raft_consensus.cc:3060] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:42.864166 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:42.864955 26432 raft_consensus.cc:3060] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:42.870050 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 128396us
I20260709 12:25:42.869299 26438 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 18.
W20260709 12:25:42.871954 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 126291us
I20260709 12:25:42.832883 31175 raft_consensus.cc:2804] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:25:42.883435 25649 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:42.879048 25801 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:25:42.892740 26402 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.903952 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:42.905117 26434 raft_consensus.cc:3060] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:42.865639 31825 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:42.905946 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:42.908615 26437 raft_consensus.cc:3060] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:42.908892 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 105676us
I20260709 12:25:42.909565 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:42.910723 26438 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:25:42.917693 25758 raft_consensus.cc:3055] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:42.917770 25801 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:42.918267 25758 raft_consensus.cc:740] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:42.921069 25837 raft_consensus.cc:1275] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:25:42.921264 25801 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:42.923099 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:25:42.924746 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 178604us
W20260709 12:25:42.926386 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.928604 31827 consensus_queue.cc:1059] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 10.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:42.930317 31827 consensus_queue.cc:1059] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:42.884222 31175 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:42.936965 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:42.903441 31828 raft_consensus.cc:2804] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:42.942966 25763 raft_consensus.cc:1240] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:42.939755 25759 raft_consensus.cc:2468] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 15.
I20260709 12:25:42.941903 31175 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:42.912808 31825 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:25:42.948474 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 76309us
I20260709 12:25:42.921880 31776 raft_consensus.cc:2749] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:42.949087 25762 raft_consensus.cc:1275] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 15. (term mismatch)
I20260709 12:25:42.951372 25762 pending_rounds.cc:85] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 14
I20260709 12:25:42.951648 25762 pending_rounds.cc:107] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 16.15
I20260709 12:25:42.936616 31580 raft_consensus.cc:2804] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:42.932298 31790 raft_consensus.cc:2749] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:42.951889 25762 raft_consensus.cc:2889] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:42.958943 25758 consensus_queue.cc:260] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:42.948825 31641 raft_consensus.cc:2749] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:42.968286 25837 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3767151a5d4345659810a40ea7f44873"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:25:42.968614 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:42.969405 26431 raft_consensus.cc:2393] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 15: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
W20260709 12:25:42.973729 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.974335 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:42.969122 25837 raft_consensus.cc:606] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 17 LEADER]: Received request to transfer leadership to TS 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:42.976155 25758 raft_consensus.cc:3060] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:42.956137 31580 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:42.980726 31848 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.981240 31580 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:42.981372 31848 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:42.986889 31733 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:42.987737 31675 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:43.003121 26437 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 14.
I20260709 12:25:42.955780 31828 raft_consensus.cc:697] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 15 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:43.008700 26439 raft_consensus.cc:1240] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 12. Current term is 13. Ops: [11.11-12.12]
I20260709 12:25:43.006533 26432 raft_consensus.cc:2468] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 14.
I20260709 12:25:42.959952 31622 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:43.010986 25801 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:43.013266 31840 consensus_queue.cc:1048] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 12:25:43.004352 31776 raft_consensus.cc:3055] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:43.014824 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:43.016216 31620 consensus_queue.cc:1059] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:42.983744 31848 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:43.021493 25762 raft_consensus.cc:3060] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:43.018596 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:43.044761 25756 raft_consensus.cc:3060] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:43.010895 31274 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:43.044656 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:43.051476 25759 raft_consensus.cc:1240] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:43.055611 25726 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:43.057852 25726 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:43.045305 31584 raft_consensus.cc:2804] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:43.069747 25834 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "a866ff967d964388a6f0dff7fd43df89"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:25:43.062026 26436 raft_consensus.cc:2468] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 17.
I20260709 12:25:43.062592 31849 raft_consensus.cc:3055] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:43.073866 25834 raft_consensus.cc:606] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 12 LEADER]: Received request to transfer leadership to TS a866ff967d964388a6f0dff7fd43df89
W20260709 12:25:42.593745 25579 rpcz_store.cc:269] 0709 12:25:06.901532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:06.901758 (+   226us) service_pool.cc:224] Handling call
0709 12:25:42.427601 (+35525843us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:28.443745 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:28.490227 (+ 46482us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:28.490262 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:25:28.490279 (+    17us) tablet.cc:662] Decoding operations
0709 12:25:28.491750 (+  1471us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:28.491814 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:28.491839 (+    25us) tablet.cc:685] Acquiring locks for 15 operations
0709 12:25:28.844339 (+352500us) tablet.cc:701] Row locks acquired
0709 12:25:28.855092 (+ 10753us) write_op.cc:260] PREPARE: finished
0709 12:25:28.874787 (+ 19695us) write_op.cc:270] Start()
0709 12:25:28.889108 (+ 14321us) write_op.cc:276] Timestamp: P: 1783599928874718 usec, L: 0
0709 12:25:28.897269 (+  8161us) op_driver.cc:348] REPLICATION: starting
0709 12:25:29.004606 (+107337us) log.cc:844] Serialized 5966 byte log entry
0709 12:25:30.743591 (+1738985us) spinlock_profiling.cc:243] Waited 4.34 ms on lock 0x7b4400022b4c. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db 00007f5d99708aaf 00007f5d96a570ac 00007f5d9f8b19a9 00007f5d96a7369b 00007f5d96a7193f 00007f5d96a73c02 00007f5d996fb20b
0709 12:25:31.254895 (+511304us) op_driver.cc:464] REPLICATION: finished
0709 12:25:31.755672 (+500777us) write_op.cc:301] APPLY: starting
0709 12:25:31.755831 (+   159us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:32.191323 (+435492us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:32.202078 (+ 10755us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:32.483871 (+281793us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:32.543473 (+ 59602us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=30,mrs_lookups=0
0709 12:25:32.543562 (+    89us) write_op.cc:312] APPLY: finished
0709 12:25:32.544092 (+   530us) log.cc:844] Serialized 139 byte log entry
0709 12:25:32.838277 (+294185us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:32.914336 (+ 76059us) write_op.cc:454] Released schema lock
0709 12:25:32.930285 (+ 15949us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:33.016361 (+ 86076us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:33.016393 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":261144,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":500375,"apply.run_cpu_time_us":43666,"apply.run_wall_time_us":1260681,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66827,"num_ops":15,"prepare.queue_time_us":345920,"prepare.run_cpu_time_us":110815,"prepare.run_wall_time_us":2589792,"raft.queue_time_us":201559,"raft.run_cpu_time_us":232667,"raft.run_wall_time_us":398876,"replication_time_us":2357348,"spinlock_wait_cycles":9989504,"thread_start_us":2527375,"threads_started":5,"wal-append.queue_time_us":1866148,"wal-append.run_cpu_time_us":5959,"wal-append.run_wall_time_us":2245553}]]}
I20260709 12:25:43.019044 31790 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
W20260709 12:25:43.080021 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:43.121076 25758 raft_consensus.cc:1275] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 14. (term mismatch)
I20260709 12:25:43.121719 25758 pending_rounds.cc:85] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 13
I20260709 12:25:43.122256 25758 pending_rounds.cc:107] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 16.14
I20260709 12:25:43.122617 25758 raft_consensus.cc:2889] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:25:43.066219 31833 log.cc:927] Time spent T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.241s	user 0.000s	sys 0.002s
W20260709 12:25:43.081833 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 130432us
I20260709 12:25:43.082937 25756 raft_consensus.cc:2468] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 15.
I20260709 12:25:43.083339 25833 raft_consensus.cc:2468] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 17.
I20260709 12:25:43.084745 25801 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:43.061491 31554 raft_consensus.cc:2749] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:43.072353 31838 raft_consensus.cc:2764] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:25:43.080626 26436 raft_consensus.cc:1240] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 13. Current term is 14. Ops: []
W20260709 12:25:43.191895 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 107255us
I20260709 12:25:43.083425 31776 raft_consensus.cc:740] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:43.119227 26431 raft_consensus.cc:1240] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:25:43.076781 31849 raft_consensus.cc:740] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
W20260709 12:25:43.207443 31841 log.cc:927] Time spent T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.250s	user 0.000s	sys 0.000s
I20260709 12:25:43.209813 31733 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:43.116406 31584 raft_consensus.cc:697] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 14 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:43.214432 31636 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:43.220196 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:43.197863 31460 raft_consensus.cc:2804] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:43.120891 31274 consensus_queue.cc:1048] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.100s
I20260709 12:25:43.221982 31849 consensus_queue.cc:260] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:43.236333 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:43.241892 26436 raft_consensus.cc:2393] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 16: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:43.222817 26438 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 23.
I20260709 12:25:43.121397 31797 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:25:43.231271 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 173532us
I20260709 12:25:43.079370 31175 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:43.244473 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:25:43.248636 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:43.244028 25762 raft_consensus.cc:2468] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 14.
W20260709 12:25:43.243842 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 51656.2us
I20260709 12:25:43.247288 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:25:43.249270 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:43.252312 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:43.252830 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:43.245482 25800 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:43.118564 31840 consensus_queue.cc:1243] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer 6e673265293d4e9a937dc45150aeb1b8 log is divergent from this leader: its last log entry 16.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:25:43.252933 25762 raft_consensus.cc:3060] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:43.230203 31733 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.281164 31733 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:43.283361 31733 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:43.257087 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:43.284528 31680 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:43.285123 31680 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:43.287181 31680 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:43.245012 31460 raft_consensus.cc:697] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 17 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:43.289063 31460 consensus_queue.cc:237] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:43.293910 26432 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:43.299217 26438 raft_consensus.cc:2468] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 14.
W20260709 12:25:43.262565 31846 log.cc:927] Time spent T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 12:25:43.264943 31175 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:43.272372 31849 raft_consensus.cc:3060] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:43.274796 31636 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:43.275283 31826 raft_consensus.cc:2804] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:43.253281 31838 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.258567 25726 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
W20260709 12:25:43.300312 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:43.305905 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:43.334988 26430 raft_consensus.cc:2468] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 14.
I20260709 12:25:43.351733 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:25:43.308195 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 57945.5us
I20260709 12:25:43.309942 26438 raft_consensus.cc:1240] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:43.357738 31839 consensus_queue.cc:1059] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 17.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:43.342073 26439 raft_consensus.cc:2468] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 13.
I20260709 12:25:43.199352 31790 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:43.319161 26434 raft_consensus.cc:2468] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 15.
I20260709 12:25:43.360188 26436 raft_consensus.cc:1240] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:43.362875 26434 raft_consensus.cc:1240] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:43.364872 31584 consensus_queue.cc:237] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:43.366513 31790 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:43.259435 26431 raft_consensus.cc:3060] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:43.359258 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:43.367854 25685 raft_consensus.cc:2410] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 16 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
W20260709 12:25:43.312780 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 232864us
I20260709 12:25:43.369263 25649 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:43.371276 31274 raft_consensus.cc:2804] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:43.371732 31274 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:43.372123 31274 raft_consensus.cc:3060] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:43.314016 31843 log.cc:927] Time spent T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.234s	user 0.002s	sys 0.000s
I20260709 12:25:43.204134 31828 consensus_queue.cc:237] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:43.383347 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 124863us
I20260709 12:25:43.411432 25685 raft_consensus.cc:1275] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:25:43.411520 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:43.412616 25754 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:43.388437 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:43.247170 31580 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:43.320130 31537 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.392594 25755 raft_consensus.cc:1275] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 12:25:43.329221 31826 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:43.394651 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:43.394958 26439 raft_consensus.cc:1240] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:43.390900 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:43.399633 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:43.351801 31704 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.403198 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:43.403995 25649 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:43.399514 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:43.379626 31554 raft_consensus.cc:3060] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:43.409024 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:43.413873 26432 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 18.
I20260709 12:25:43.417462 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:43.420558 25832 raft_consensus.cc:1240] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 23 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 22. Current term is 23. Ops: []
I20260709 12:25:43.440653 26436 raft_consensus.cc:1240] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:43.420545 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:43.431664 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:43.434155 26401 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:43.435463 25833 raft_consensus.cc:1275] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:25:43.446636 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:43.447327 26438 raft_consensus.cc:1240] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 17. Current term is 18. Ops: []
I20260709 12:25:43.353542 31838 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:43.442279 25837 raft_consensus.cc:1240] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 18. Current term is 19. Ops: []
I20260709 12:25:43.435542 31826 raft_consensus.cc:3060] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:43.450875 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:43.489418 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:43.490025 25760 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:43.490368 26436 raft_consensus.cc:2393] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 14: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:43.403653 31776 consensus_queue.cc:260] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:43.440897 31704 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:43.493611 31852 log.cc:927] Time spent T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 12:25:43.494665 31704 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:43.497740 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:43.498723 31580 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:43.502679 31856 log.cc:927] Time spent T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:25:43.491717 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:43.450107 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:43.486922 31840 raft_consensus.cc:2804] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:43.488785 26434 raft_consensus.cc:1240] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 17 LEADER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 16. Current term is 17. Ops: []
W20260709 12:25:43.505980 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 69657.6us
I20260709 12:25:43.504385 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:43.507436 25756 raft_consensus.cc:2410] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:25:43.505394 25755 raft_consensus.cc:2468] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 18.
I20260709 12:25:43.508486 25762 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 14.
W20260709 12:25:43.534814 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 137871us
I20260709 12:25:43.535528 25830 raft_consensus.cc:3060] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:25:43.514725 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 68853.8us
I20260709 12:25:43.538542 25650 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:43.537724 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:43.539147 26401 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:25:43.540987 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 291095us
I20260709 12:25:43.542560 26436 raft_consensus.cc:2393] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 14: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:43.538189 25758 pending_rounds.cc:85] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 10
I20260709 12:25:43.543779 25758 pending_rounds.cc:107] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 12:25:43.544080 25758 raft_consensus.cc:2889] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:43.549479 25726 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
W20260709 12:25:43.534943 31835 log.cc:927] Time spent T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:25:43.554093 26401 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:43.554873 25836 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:25:43.512457 31840 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:43.560896 26432 raft_consensus.cc:1240] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:43.555516 25836 raft_consensus.cc:606] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Received request to transfer leadership to TS 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:43.556021 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:43.557431 26438 raft_consensus.cc:1240] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 23 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 22. Current term is 23. Ops: []
I20260709 12:25:43.504983 31860 raft_consensus.cc:2749] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:43.560288 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:43.569713 25800 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:43.570271 26430 raft_consensus.cc:2393] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 17: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:43.565665 25836 raft_consensus.cc:614] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:43.564198 26436 raft_consensus.cc:3060] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:43.440636 31537 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:43.569144 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:43.556273 25649 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:43.576440 31606 raft_consensus.cc:2804] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:43.577574 31853 consensus_queue.cc:1048] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.010s
I20260709 12:25:43.573268 31840 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:43.444224 31825 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:43.583959 26433 raft_consensus.cc:1240] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:43.584245 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:43.586575 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:43.589602 26438 raft_consensus.cc:2368] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for earlier term 13. Current term is 14.
I20260709 12:25:43.589670 26401 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:43.590654 26438 raft_consensus.cc:1275] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:25:43.554520 31628 raft_consensus.cc:2804] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:43.595860 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:43.596601 26434 raft_consensus.cc:1275] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:25:43.588817 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:43.538937 31641 consensus_queue.cc:1048] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.042s
I20260709 12:25:43.582671 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:25:43.595620 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 54406.2us
I20260709 12:25:43.598453 31606 raft_consensus.cc:697] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 14 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:43.599436 31869 raft_consensus.cc:2804] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:43.596562 25763 raft_consensus.cc:2468] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 13.
W20260709 12:25:43.601770 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 63376.2us
I20260709 12:25:43.583410 31680 raft_consensus.cc:2749] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:43.600718 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:43.605633 25832 raft_consensus.cc:1240] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:43.549150 31733 consensus_queue.cc:1059] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 12:25:43.611243 25829 raft_consensus.cc:1240] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:43.613426 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:43.615195 26433 raft_consensus.cc:2468] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 13.
I20260709 12:25:43.591967 31475 raft_consensus.cc:2804] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:43.596685 31824 raft_consensus.cc:2749] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:25:43.587527 31812 consensus_queue.cc:1048] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:25:43.620726 25649 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:43.608893 31869 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:43.609383 31628 raft_consensus.cc:697] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 15 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:43.620592 31457 raft_consensus.cc:3055] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:25:43.632005 31842 raft_consensus.cc:2749] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:43.632493 31457 raft_consensus.cc:740] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:43.633073 31475 raft_consensus.cc:697] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 14 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:43.633495 31457 consensus_queue.cc:260] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.7, Last appended by leader: 7, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:43.634227 31475 consensus_queue.cc:237] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:43.635066 31457 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:43.636330 31175 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:43.636956 31175 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:43.616820 31866 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.628728 31869 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:25:43.666179 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 72088.8us
I20260709 12:25:43.614284 31853 consensus_queue.cc:1059] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 12:25:43.668653 26402 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:43.670310 25726 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:43.627833 31636 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.682497 26436 raft_consensus.cc:2468] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 15.
I20260709 12:25:43.669523 31875 raft_consensus.cc:2749] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:43.689106 25760 raft_consensus.cc:2468] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 16.
W20260709 12:25:43.693444 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 103905us
I20260709 12:25:43.670188 31274 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:43.697428 25801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:43.640872 31628 consensus_queue.cc:237] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:43.692920 31675 raft_consensus.cc:2804] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:25:43.687001 31842 consensus_queue.cc:1059] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 12:25:43.701469 31825 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:43.701306 31872 consensus_queue.cc:1048] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 12:25:43.702411 31274 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:43.705421 31554 raft_consensus.cc:2749] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:43.708197 25681 raft_consensus.cc:2393] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 15: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
W20260709 12:25:43.734871 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:43.672538 31866 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:43.723153 26431 raft_consensus.cc:2468] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 17.
W20260709 12:25:43.723353 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 104537us
I20260709 12:25:43.675348 31824 consensus_queue.cc:1059] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:25:43.697903 31871 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:43.747258 31537 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:43.747191 31871 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:43.749647 31871 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:43.716845 25726 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:43.751302 25726 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:25:43.752666 25726 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:43.735908 25830 raft_consensus.cc:2410] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 16 because replica has last-logged OpId of term: 15 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 14.
I20260709 12:25:43.700583 31460 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.753986 25759 raft_consensus.cc:2468] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 17.
I20260709 12:25:43.713016 31675 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:43.758291 26402 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:43.698115 31636 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:43.714026 31606 consensus_queue.cc:237] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:43.761772 31460 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:43.764122 31460 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:43.756943 31554 raft_consensus.cc:2749] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:43.765478 31554 raft_consensus.cc:2749] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:25:43.767268 31704 raft_consensus.cc:993] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a: : Instructing follower 6e673265293d4e9a937dc45150aeb1b8 to start an election
I20260709 12:25:43.767781 31704 raft_consensus.cc:1081] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 17 LEADER]: Signalling peer 6e673265293d4e9a937dc45150aeb1b8 to start an election
I20260709 12:25:43.768682 31636 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:43.770948 31853 consensus_queue.cc:1059] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:43.772383 31797 raft_consensus.cc:3055] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:43.772660 31824 raft_consensus.cc:3055] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:43.772967 31797 raft_consensus.cc:740] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:43.773294 31824 raft_consensus.cc:740] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:43.774133 31824 consensus_queue.cc:260] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:43.775005 31827 raft_consensus.cc:3055] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:43.775449 31824 raft_consensus.cc:3060] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:43.779323 25756 raft_consensus.cc:1275] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:25:43.780558 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:43.781224 25756 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 18.
I20260709 12:25:43.782706 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:43.783383 25763 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 17.
I20260709 12:25:43.784227 25763 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3767151a5d4345659810a40ea7f44873"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:53460
I20260709 12:25:43.784796 25763 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:43.785140 25763 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:25:43.786578 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:43.775413 31827 raft_consensus.cc:740] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:43.725275 31838 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:43.771824 25800 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
W20260709 12:25:43.788780 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 45456.7us
I20260709 12:25:43.789952 26402 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:25:43.793753 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:43.794250 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:43.789233 25800 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
W20260709 12:25:43.822980 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 77143.9us
I20260709 12:25:43.824044 25801 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:43.829830 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:43.823529 25800 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:43.831724 25800 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:43.759325 31871 raft_consensus.cc:2764] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:25:43.787256 31675 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:25:43.789374 31853 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.836205 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:43.843191 25650 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:43.826825 31537 raft_consensus.cc:2804] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:43.822697 31636 raft_consensus.cc:2804] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:43.859498 25801 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:25:43.868808 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 251163us
I20260709 12:25:43.841681 31790 raft_consensus.cc:2804] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:43.850329 31475 raft_consensus.cc:2804] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:25:43.843289 31554 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
W20260709 12:25:43.876499 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 123944us
I20260709 12:25:43.833539 31704 consensus_queue.cc:1059] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 12:25:43.827124 31460 consensus_queue.cc:1048] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:25:43.774127 31797 consensus_queue.cc:260] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:43.835711 31842 consensus_queue.cc:1059] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
W20260709 12:25:43.877189 31849 consensus_meta.cc:287] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.525s	user 0.010s	sys 0.004s
I20260709 12:25:43.875082 31828 raft_consensus.cc:2804] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:43.874092 31875 raft_consensus.cc:2804] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:43.888383 25754 raft_consensus.cc:2468] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 20.
I20260709 12:25:43.876637 31636 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:43.896770 31636 raft_consensus.cc:3060] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:43.859189 31274 consensus_queue.cc:1059] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 12:25:43.858852 31853 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:43.877046 31790 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
W20260709 12:25:43.911509 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 77251.5us
I20260709 12:25:43.920338 31584 raft_consensus.cc:2804] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:25:43.920581 31870 log.cc:927] Time spent T 00000000000000000000000000000000 P 496fd6924b624e77b03ccfd15653d47b: Append to log took a long time: real 0.143s	user 0.000s	sys 0.002s
I20260709 12:25:43.921097 31866 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:43.895716 31606 raft_consensus.cc:2749] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:43.895612 31828 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:43.923789 26402 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:43.895063 31884 raft_consensus.cc:2749] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:43.883720 31554 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:43.930296 31881 log.cc:927] Time spent T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:25:43.930956 31883 raft_consensus.cc:3055] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:25:43.931150 31879 log.cc:927] Time spent T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:25:43.920157 31790 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:43.932734 31826 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:43.910655 31875 raft_consensus.cc:697] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 13 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:43.923451 31584 raft_consensus.cc:697] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 15 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:43.934458 31877 consensus_queue.cc:1059] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:25:43.937893 31884 raft_consensus.cc:2749] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:25:43.937755 25726 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:25:43.917738 31873 raft_consensus.cc:2764] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:25:43.923067 31880 consensus_queue.cc:1059] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.097s
W20260709 12:25:43.964145 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 85653.8us
I20260709 12:25:43.925150 31828 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:43.925390 31866 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.925168 31797 raft_consensus.cc:3060] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:43.984004 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 106072us
W20260709 12:25:43.988147 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:44.021126 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:43.918144 31628 consensus_queue.cc:1048] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.051s
I20260709 12:25:43.910969 31849 consensus_queue.cc:1059] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.052s
I20260709 12:25:43.981762 31883 raft_consensus.cc:740] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:44.051398 31849 raft_consensus.cc:3055] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:44.051932 31849 raft_consensus.cc:740] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:44.051719 31883 consensus_queue.cc:260] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:44.053189 31883 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:44.053273 31849 consensus_queue.cc:260] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:44.054996 31849 raft_consensus.cc:3060] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:44.000211 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 140789us
I20260709 12:25:44.057467 31848 raft_consensus.cc:3055] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:44.058034 31848 raft_consensus.cc:740] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:44.061163 31899 consensus_queue.cc:1048] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:43.997040 31620 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:44.067162 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:44.068163 25649 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:44.036212 31875 consensus_queue.cc:237] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:44.039243 31886 log.cc:927] Time spent T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:25:44.041754 31880 consensus_queue.cc:1059] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:25:43.925797 31827 consensus_queue.cc:260] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:44.044459 31554 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:44.049543 31853 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:44.050001 25755 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:44.050204 31885 raft_consensus.cc:2764] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 12:25:43.996351 31537 raft_consensus.cc:697] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 17 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:44.024928 25828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41782 (request call id 1261) took 1125 ms. Trace:
I20260709 12:25:44.065874 26431 raft_consensus.cc:1275] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 12:25:44.071552 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 201206us
W20260709 12:25:44.073562 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 135923us
I20260709 12:25:44.075310 26437 raft_consensus.cc:1275] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:25:44.055578 31824 raft_consensus.cc:3055] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:25:44.076803 25828 rpcz_store.cc:276] 0709 12:25:42.899465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:42.899683 (+   218us) service_pool.cc:224] Handling call
0709 12:25:44.012801 (+1113118us) spinlock_profiling.cc:243] Waited 811 ms on lock 0x7b54004218d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:44.024842 (+ 12041us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1865947008}
I20260709 12:25:44.085147 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:44.059150 31848 consensus_queue.cc:260] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:44.090236 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:44.098351 25758 raft_consensus.cc:3060] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:44.096222 25836 raft_consensus.cc:1240] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 17 LEADER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:44.097199 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:44.099352 25834 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:44.093392 26433 raft_consensus.cc:2468] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 15.
I20260709 12:25:44.109966 25833 raft_consensus.cc:1275] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:25:44.111745 25833 raft_consensus.cc:1240] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:44.061250 31826 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:44.114583 25834 raft_consensus.cc:2468] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 16.
I20260709 12:25:44.109582 25763 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:44.117756 25757 raft_consensus.cc:1240] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 17. Current term is 18. Ops: []
I20260709 12:25:44.118160 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:25:44.118477 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 50449us
I20260709 12:25:44.119086 25800 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:44.119751 25726 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:25:44.089174 31475 raft_consensus.cc:697] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 23 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:44.123642 25832 raft_consensus.cc:1240] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 17. Current term is 18. Ops: []
I20260709 12:25:44.117137 31860 consensus_queue.cc:1059] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.007s
I20260709 12:25:44.124681 31874 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.124920 25829 raft_consensus.cc:1275] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:25:44.125270 31874 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:44.126230 25837 raft_consensus.cc:1240] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 14 LEADER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:44.127523 31874 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:44.128742 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:44.097558 31824 raft_consensus.cc:740] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:44.070384 31866 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:44.132359 31175 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:44.044529 31584 consensus_queue.cc:237] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:44.138957 25755 raft_consensus.cc:2468] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 17.
I20260709 12:25:44.136902 25835 raft_consensus.cc:2468] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 18.
I20260709 12:25:44.154145 25763 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:44.111935 31877 raft_consensus.cc:2804] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:25:44.157848 25650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:44.163446 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 44440.3us
I20260709 12:25:44.167399 25758 raft_consensus.cc:2468] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 17.
I20260709 12:25:44.172895 25835 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "a866ff967d964388a6f0dff7fd43df89"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:25:44.173628 25835 raft_consensus.cc:606] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 14 LEADER]: Received request to transfer leadership to TS a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:44.182879 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:25:44.182966 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:44.183609 25800 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:44.184312 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:44.185158 25681 raft_consensus.cc:2393] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 15: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:44.186595 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:44.187516 25684 raft_consensus.cc:2468] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 18.
I20260709 12:25:44.097971 31840 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:44.196422 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:25:44.197631 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 77996.3us
I20260709 12:25:44.164170 31848 raft_consensus.cc:3060] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:44.161567 31554 raft_consensus.cc:2804] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:44.201316 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:44.163882 31827 raft_consensus.cc:3060] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:44.201895 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 179890us
I20260709 12:25:44.202664 25681 raft_consensus.cc:1240] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:44.203015 26402 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:44.114133 31620 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:44.213063 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:44.216447 31869 consensus_meta.cc:287] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.550s	user 0.012s	sys 0.000s
I20260709 12:25:44.216737 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:44.217046 31869 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:44.219421 31869 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:44.220114 31842 raft_consensus.cc:3055] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:44.220516 31842 raft_consensus.cc:740] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:44.221045 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:25:44.220628 31857 consensus_queue.cc:1175] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6e673265293d4e9a937dc45150aeb1b8" responder_term: 14 status { last_received { term: 13 index: 11 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 13. Current term is 14. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:25:44.221347 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:44.221961 25686 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:44.221611 31842 consensus_queue.cc:260] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:44.222289 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:44.222898 31890 consensus_queue.cc:1059] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.139s
I20260709 12:25:44.220530 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:44.226356 25680 raft_consensus.cc:2410] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 12:25:44.226637 31839 raft_consensus.cc:3055] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:44.227116 31839 raft_consensus.cc:740] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:44.227227 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:44.228073 31839 consensus_queue.cc:260] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:44.228641 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:44.229426 31839 raft_consensus.cc:3060] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:44.226657 31893 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:44.195037 31460 raft_consensus.cc:2804] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:44.203830 31554 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:44.234277 31893 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:44.232169 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:44.233682 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:44.220367 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:44.247848 25682 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:44.213733 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:44.251025 25685 raft_consensus.cc:1240] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 15 LEADER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:25:44.232936 31460 raft_consensus.cc:697] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 17 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
W20260709 12:25:44.254307 26401 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.004s	sys 0.008s
W20260709 12:25:44.254904 26401 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.004s	sys 0.008s
I20260709 12:25:44.254390 31460 consensus_queue.cc:237] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:44.255231 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 560802us
I20260709 12:25:44.255622 25759 raft_consensus.cc:1275] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:25:44.220412 31891 raft_consensus.cc:2804] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:25:44.256803 31891 raft_consensus.cc:697] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 20 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:44.257742 31891 consensus_queue.cc:237] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:44.232139 31475 consensus_queue.cc:237] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:44.260463 25681 raft_consensus.cc:1240] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:44.233768 31554 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:44.263667 25761 raft_consensus.cc:1275] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:25:44.255837 26401 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:44.289247 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:44.290534 25726 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:44.290494 25682 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 16.
I20260709 12:25:44.292886 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:44.294117 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:44.297188 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:44.298715 31893 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:44.299399 31868 consensus_queue.cc:1048] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 12:25:44.289760 31675 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:44.302695 31675 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 22 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:44.250306 31776 raft_consensus.cc:3060] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:25:44.309859 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:44.312682 25683 raft_consensus.cc:2468] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 18.
W20260709 12:25:44.316665 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 60889.6us
W20260709 12:25:44.318836 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 115921us
I20260709 12:25:44.329149 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:44.343401 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:25:44.348752 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:44.308872 31873 raft_consensus.cc:2749] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:25:44.355607 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:44.357682 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:44.361670 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:44.365602 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:25:44.365613 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 46068.5us
I20260709 12:25:44.367695 25801 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:44.369082 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:44.369678 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:25:44.383419 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 201596us
I20260709 12:25:44.327797 31675 raft_consensus.cc:2804] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:44.388572 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:44.327839 31797 raft_consensus.cc:2804] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:44.384383 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:44.327769 31877 raft_consensus.cc:697] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 15 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:44.388710 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:25:44.394001 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:44.368501 26402 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:44.206956 31537 consensus_queue.cc:237] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:44.405757 26438 raft_consensus.cc:1240] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 15. Current term is 16. Ops: []
W20260709 12:25:44.406778 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:44.384603 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:44.382727 25726 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:44.411317 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:44.412113 25756 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:25:44.425643 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:44.389686 25681 raft_consensus.cc:1275] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 13 index: 6. (term mismatch)
I20260709 12:25:44.429301 25681 pending_rounds.cc:85] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc: Aborting all ops after (but not including) 5
I20260709 12:25:44.429648 25681 pending_rounds.cc:107] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc: Aborting uncommitted NO_OP operation due to leader change: 12.6
I20260709 12:25:44.429970 25681 raft_consensus.cc:2889] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:44.322540 31641 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.392443 26434 raft_consensus.cc:1275] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:25:44.520349 25828 raft_consensus.cc:1275] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:25:44.395892 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:44.388787 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:44.393649 25829 raft_consensus.cc:2468] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 18.
I20260709 12:25:44.521513 25832 raft_consensus.cc:2468] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 19.
W20260709 12:25:44.526835 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 125369us
I20260709 12:25:44.531406 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:44.383574 31871 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:44.391043 31838 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:44.360759 31828 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:44.582027 25677 raft_consensus.cc:2468] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 14.
W20260709 12:25:44.528656 31790 consensus_meta.cc:287] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.516s	user 0.007s	sys 0.004s
I20260709 12:25:44.520485 31812 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.542287 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:44.393087 31584 raft_consensus.cc:2804] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:44.529012 25683 raft_consensus.cc:1275] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:25:44.553772 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:25:44.530681 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:44.645426 25680 raft_consensus.cc:2393] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 16: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:44.534879 31885 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:44.393710 31636 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:44.524958 31868 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:44.389534 31577 consensus_queue.cc:1048] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.186s
I20260709 12:25:44.527477 31457 raft_consensus.cc:3055] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:44.641286 25837 raft_consensus.cc:2393] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 18: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:44.647600 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:44.653726 25679 raft_consensus.cc:1240] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 13 LEADER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:44.653990 25835 raft_consensus.cc:3055] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:25:44.597577 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
W20260709 12:25:44.648815 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 266146us
I20260709 12:25:44.577452 31680 raft_consensus.cc:2749] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:44.659247 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:44.651364 25756 raft_consensus.cc:2468] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 19.
I20260709 12:25:44.569581 31866 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:44.656998 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 50163.2us
I20260709 12:25:44.663177 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:44.654394 25835 raft_consensus.cc:740] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:44.539270 31641 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:44.662024 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
W20260709 12:25:44.650648 31852 log.cc:927] Time spent T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 12:25:44.666229 25726 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:44.668313 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:44.667407 26401 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:44.647395 31584 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:44.679827 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:44.701315 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:44.700973 25831 raft_consensus.cc:2393] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 14: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
W20260709 12:25:44.703837 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 45687.9us
I20260709 12:25:44.705435 25726 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:44.656386 31457 raft_consensus.cc:740] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:44.579438 31838 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:44.614041 31790 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:44.711082 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 43798.6us
I20260709 12:25:44.653069 31675 raft_consensus.cc:697] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:44.646862 31871 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:44.714478 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:44.647244 31812 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:44.758538 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:44.761111 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:44.703437 31840 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:44.768836 25685 raft_consensus.cc:2468] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 16.
I20260709 12:25:44.703120 31584 raft_consensus.cc:3060] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:44.652361 31885 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:44.662606 31857 consensus_queue.cc:1059] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.088s
I20260709 12:25:44.774509 26433 raft_consensus.cc:1240] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 13. Current term is 14. Ops: []
W20260709 12:25:44.750566 31883 consensus_meta.cc:287] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.673s	user 0.009s	sys 0.011s
W20260709 12:25:44.802924 25686 consensus_meta.cc:287] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.580s	user 0.014s	sys 0.000s
I20260709 12:25:44.824079 25686 raft_consensus.cc:2468] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 14.
I20260709 12:25:44.820592 25830 raft_consensus.cc:1240] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 17. Current term is 18. Ops: []
I20260709 12:25:44.830861 25682 raft_consensus.cc:1275] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:25:44.833585 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:44.834285 25686 raft_consensus.cc:2376] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 18. Re-sending same reply.
I20260709 12:25:44.750087 31880 consensus_queue.cc:1048] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.102s
I20260709 12:25:44.681699 31868 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:44.707350 31875 consensus_queue.cc:1059] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.082s
I20260709 12:25:44.839455 31812 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:44.839639 31857 raft_consensus.cc:3055] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:44.841602 31790 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:44.841750 25650 leader_election.cc:400] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 election: Vote denied by peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611) with higher term. Message: Invalid argument: T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for earlier term 13. Current term is 14.
I20260709 12:25:44.919093 25650 leader_election.cc:403] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:25:44.861389 31871 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:44.865374 31641 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:44.872609 31457 consensus_queue.cc:260] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:44.882241 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:44.885370 31828 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:44.779485 31891 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:44.819164 31606 raft_consensus.cc:2804] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:25:44.939393 25829 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:25:44.871910 31554 consensus_meta.cc:287] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.609s	user 0.001s	sys 0.006s
W20260709 12:25:44.923980 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:44.879762 31839 consensus_meta.cc:287] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.650s	user 0.007s	sys 0.004s
I20260709 12:25:44.772290 31274 consensus_queue.cc:1059] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.063s
I20260709 12:25:44.918480 31640 raft_consensus.cc:3055] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:44.951148 31640 raft_consensus.cc:740] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:44.951220 31274 consensus_queue.cc:1243] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer 5cccf20a8bff46dba6601f241d172b8a log is divergent from this leader: its last log entry 14.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:25:44.771363 31877 consensus_queue.cc:237] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:44.946828 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:44.897490 31797 raft_consensus.cc:697] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 16 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:44.919094 31897 raft_consensus.cc:2749] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:44.922576 31883 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.953707 25686 raft_consensus.cc:2468] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 17.
W20260709 12:25:44.955489 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 587010us
W20260709 12:25:44.956269 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 250489us
I20260709 12:25:44.897660 31857 raft_consensus.cc:740] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:44.931357 31875 consensus_queue.cc:1243] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer 5cccf20a8bff46dba6601f241d172b8a log is divergent from this leader: its last log entry 17.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
W20260709 12:25:44.953918 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 112435us
I20260709 12:25:44.961087 25684 raft_consensus.cc:2468] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 15.
I20260709 12:25:44.969590 25726 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:44.936093 31871 raft_consensus.cc:2764] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:25:44.983127 31908 consensus_queue.cc:1059] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.409s
I20260709 12:25:44.918864 31906 consensus_queue.cc:1059] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 14, Time since last communication: 0.318s
I20260709 12:25:44.983970 31916 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.984076 25726 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:44.984004 31871 raft_consensus.cc:2749] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:44.984684 31916 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:44.985304 31871 raft_consensus.cc:2749] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:44.969326 31640 consensus_queue.cc:260] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:44.985322 25726 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:44.986399 31640 raft_consensus.cc:3060] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:44.986701 25726 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:44.987036 31916 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:44.987572 31913 log.cc:927] Time spent T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
W20260709 12:25:44.988059 31917 log.cc:927] Time spent T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 12:25:44.988168 31911 consensus_queue.cc:1059] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.116s
I20260709 12:25:44.988962 31922 raft_consensus.cc:2804] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:44.989511 31922 raft_consensus.cc:697] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:44.989689 31871 raft_consensus.cc:2804] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:44.990877 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:25:44.987672 31919 log.cc:927] Time spent T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:25:44.952548 31620 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:44.991825 25685 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 18.
I20260709 12:25:44.959295 31606 raft_consensus.cc:697] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 19 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:45.001472 25650 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:44.972231 31839 raft_consensus.cc:2749] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611) with higher term. Message: Invalid argument: T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for earlier term 13. Current term is 14.
I20260709 12:25:45.009225 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:44.934259 31912 consensus_queue.cc:1048] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.461s
W20260709 12:25:45.010965 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:44.934360 31903 consensus_queue.cc:1048] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.606s
I20260709 12:25:44.952329 31891 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:45.026212 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 59247.8us
I20260709 12:25:45.027174 26402 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:45.012868 31460 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.031611 31460 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:45.032517 31914 log.cc:927] Time spent T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 12:25:45.034111 31460 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:45.033816 31857 consensus_queue.cc:260] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:44.979282 31893 consensus_queue.cc:1059] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 12:25:45.036018 25758 raft_consensus.cc:1275] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:25:45.036926 31885 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:45.038010 25755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53460 (request call id 3026) took 1260 ms. Trace:
I20260709 12:25:45.038398 25755 rpcz_store.cc:276] 0709 12:25:43.777718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:43.822553 (+ 44835us) service_pool.cc:224] Handling call
0709 12:25:45.037839 (+1215286us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b5400298954. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:45.037943 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":482535168}
I20260709 12:25:45.040141 31910 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.040733 31910 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:45.042155 31890 raft_consensus.cc:3055] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:25:45.042619 31890 raft_consensus.cc:740] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 22 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:45.042917 31910 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:45.044126 31920 log.cc:927] Time spent T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:25:45.043511 31890 consensus_queue.cc:260] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:45.045746 31915 log.cc:927] Time spent T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
W20260709 12:25:45.047047 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 45713.3us
I20260709 12:25:45.047834 25650 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:45.002099 31875 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.006271 31636 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:44.973105 31883 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:45.019855 31912 consensus_queue.cc:1243] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer 5cccf20a8bff46dba6601f241d172b8a log is divergent from this leader: its last log entry 14.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:25:45.029690 31457 raft_consensus.cc:3060] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:45.086982 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 59879.1us
I20260709 12:25:44.995443 31554 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:45.028151 31620 raft_consensus.cc:3055] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:25:45.035815 31838 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:44.958950 31675 consensus_queue.cc:237] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:45.096560 25686 raft_consensus.cc:1275] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:25:45.091390 31935 raft_consensus.cc:2749] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:45.103780 31890 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:25:45.104386 31733 consensus_queue.cc:1048] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:45.105772 31554 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:45.106015 26402 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:45.106218 31733 consensus_queue.cc:1048] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:45.107501 31853 raft_consensus.cc:2749] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:25:45.083484 31880 raft_consensus.cc:2749] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:25:45.133376 26402 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:45.079831 31911 raft_consensus.cc:2749] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:25:45.101351 31776 consensus_meta.cc:287] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.792s	user 0.013s	sys 0.000s
I20260709 12:25:45.107733 31733 consensus_queue.cc:1048] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 12:25:45.140636 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
W20260709 12:25:45.140739 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 150824us
I20260709 12:25:45.012516 31922 consensus_queue.cc:237] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:45.091907 31620 raft_consensus.cc:740] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:45.072969 31875 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:45.150233 25678 raft_consensus.cc:2468] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 16.
W20260709 12:25:45.151054 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:45.089594 31916 consensus_queue.cc:1048] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 12:25:45.156104 25726 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:45.126955 31871 raft_consensus.cc:697] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 18 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:45.159075 25686 raft_consensus.cc:3055] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:45.161554 25686 raft_consensus.cc:740] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
W20260709 12:25:45.178958 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 70106us
I20260709 12:25:45.180065 31875 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:45.180790 26402 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:45.180891 31620 consensus_queue.cc:260] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:45.182984 25726 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:45.182860 31871 consensus_queue.cc:237] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:45.184692 31883 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:45.083088 31797 consensus_queue.cc:237] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:45.193117 26402 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:45.151021 31873 raft_consensus.cc:2749] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:45.185859 31921 raft_consensus.cc:2764] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 12:25:45.151453 31860 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.155781 31868 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:45.196852 31935 raft_consensus.cc:2804] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:25:45.196995 31942 consensus_queue.cc:1048] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 12:25:45.195106 31875 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.198168 31875 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:45.197434 31935 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:45.196904 31888 raft_consensus.cc:2749] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:45.202896 31935 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:25:45.207787 31849 consensus_meta.cc:287] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 1.152s	user 0.011s	sys 0.006s
I20260709 12:25:45.210877 25835 consensus_queue.cc:260] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:45.211932 25835 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:45.214766 31584 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:45.214790 31935 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:45.220758 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 171816us
I20260709 12:25:45.221076 25829 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 22.
I20260709 12:25:45.200843 25686 consensus_queue.cc:260] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:45.221517 25650 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:45.200255 31869 raft_consensus.cc:2749] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:45.238101 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:45.134240 31606 consensus_queue.cc:237] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:45.242166 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:45.223256 31935 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 20 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:45.243166 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:45.243825 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:45.244803 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:45.221968 31873 raft_consensus.cc:2804] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:45.250370 26436 raft_consensus.cc:2393] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 16: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:45.245127 25685 raft_consensus.cc:2376] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 18. Re-sending same reply.
I20260709 12:25:45.266631 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:45.253813 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:45.258270 26431 raft_consensus.cc:2468] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 13.
I20260709 12:25:45.258690 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:45.239442 25686 raft_consensus.cc:3060] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:45.258191 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:25:45.262240 25650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:45.270502 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:25:45.264441 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:45.272248 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:45.265056 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:45.263121 25835 raft_consensus.cc:2468] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 18.
I20260709 12:25:45.273483 25836 raft_consensus.cc:2410] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:25:45.273413 26433 raft_consensus.cc:2468] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 14.
I20260709 12:25:45.265149 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:45.273921 26430 raft_consensus.cc:2393] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 17: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:45.264320 26402 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:45.278865 25837 raft_consensus.cc:1275] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 12. (term mismatch)
I20260709 12:25:45.279479 25837 pending_rounds.cc:85] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a: Aborting all ops after (but not including) 11
I20260709 12:25:45.279701 25837 pending_rounds.cc:107] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 12:25:45.280455 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:45.281067 25683 raft_consensus.cc:2376] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 14. Re-sending same reply.
I20260709 12:25:45.281998 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:45.283212 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:45.283532 25761 raft_consensus.cc:1240] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:45.285115 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:45.286401 25761 raft_consensus.cc:1240] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:25:45.284762 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:45.255324 31926 consensus_queue.cc:1048] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 12:25:45.284360 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:45.290699 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:45.284704 25762 raft_consensus.cc:1240] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 12. Current term is 13. Ops: [12.6-12.6]
W20260709 12:25:45.291574 31827 consensus_meta.cc:287] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 1.079s	user 0.008s	sys 0.004s
I20260709 12:25:45.294358 31875 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:45.295961 31584 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:45.299909 31891 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:45.300027 25680 raft_consensus.cc:2468] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 13.
W20260709 12:25:45.304618 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:45.201835 31860 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:45.268774 31897 consensus_queue.cc:1059] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 15.15, Next index: 16, Last known committed idx: 13, Time since last communication: 0.044s
I20260709 12:25:45.245421 31888 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:45.313850 25837 raft_consensus.cc:2889] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:25:45.330883 25650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:45.259300 31941 raft_consensus.cc:2804] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:45.270533 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:45.332338 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:45.332991 25685 raft_consensus.cc:1275] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:25:45.333557 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:45.334075 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:45.318408 25686 raft_consensus.cc:1275] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:25:45.334513 25680 raft_consensus.cc:2393] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 13: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:45.335207 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:45.336402 25680 raft_consensus.cc:1275] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 12:25:45.336853 25680 pending_rounds.cc:85] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc: Aborting all ops after (but not including) 10
I20260709 12:25:45.337064 25685 raft_consensus.cc:1240] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 15. Current term is 16. Ops: [15.15-15.15]
I20260709 12:25:45.337168 25680 pending_rounds.cc:107] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 12:25:45.337774 25680 raft_consensus.cc:2889] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:45.333114 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:45.347872 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
W20260709 12:25:45.268380 31872 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.536s	user 0.015s	sys 0.039s
I20260709 12:25:45.355999 25762 raft_consensus.cc:1240] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 17. Current term is 18. Ops: []
I20260709 12:25:45.358989 25760 raft_consensus.cc:1240] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 19. Current term is 20. Ops: []
I20260709 12:25:45.361593 25761 raft_consensus.cc:2393] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 15: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:45.303196 31824 consensus_queue.cc:260] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:45.361899 31873 raft_consensus.cc:697] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 14 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
W20260709 12:25:45.370779 31918 log.cc:927] Time spent T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 12:25:45.373390 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:45.384826 25834 raft_consensus.cc:2393] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 14: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:45.331539 31935 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
W20260709 12:25:45.375547 25800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:45.377010 25681 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 23.
I20260709 12:25:45.376296 25726 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:45.391616 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:45.385432 25834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44218 (request call id 2039) took 1022 ms. Trace:
W20260709 12:25:45.362711 31872 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.630s	user 0.016s	sys 0.039s
W20260709 12:25:45.349189 31904 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
W20260709 12:25:45.384721 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 120492us
I20260709 12:25:45.386003 31840 raft_consensus.cc:2749] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:45.388173 31908 consensus_queue.cc:1048] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:45.389463 31911 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:45.394017 25834 rpcz_store.cc:276] 0709 12:25:44.362533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:45.373117 (+1010584us) service_pool.cc:224] Handling call
0709 12:25:45.385361 (+ 12244us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:45.412875 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:45.396229 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:45.362491 31776 consensus_queue.cc:1059] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 12:25:45.406450 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:45.404827 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:45.417528 25680 raft_consensus.cc:2393] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 16: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:45.417548 25830 raft_consensus.cc:2393] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 16: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:45.389866 31941 raft_consensus.cc:697] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 15 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:45.413867 25761 raft_consensus.cc:2468] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 15.
I20260709 12:25:45.419484 25726 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:45.424079 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:45.424706 25834 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:25:45.421628 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:45.394989 31860 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:45.447396 25760 raft_consensus.cc:1240] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 18 LEADER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 17. Current term is 18. Ops: []
I20260709 12:25:45.424592 25800 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:45.404973 31824 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:45.447512 25726 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:45.451714 25649 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:45.452631 25726 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:45.453863 31921 raft_consensus.cc:2804] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:45.454362 31921 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:45.454774 31921 raft_consensus.cc:3060] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:45.456369 31871 raft_consensus.cc:2804] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:45.456872 31871 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:45.457319 31871 raft_consensus.cc:3060] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:45.360427 31888 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:45.415064 31675 raft_consensus.cc:2804] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:45.474144 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:45.399418 31935 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:45.450524 31840 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.481197 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:45.482394 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:45.483225 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:45.450295 31554 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:45.466244 31866 raft_consensus.cc:2804] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:45.498958 26402 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:45.500911 25800 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:45.490901 25834 raft_consensus.cc:2468] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 19.
I20260709 12:25:45.497184 25761 raft_consensus.cc:2393] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 22: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:45.504341 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:45.416671 31584 consensus_queue.cc:1048] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 12:25:45.476559 31849 raft_consensus.cc:2749] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:45.509173 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:45.514428 25762 raft_consensus.cc:2468] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 15.
I20260709 12:25:45.514521 25726 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:45.510681 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:45.515893 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:45.519357 25832 raft_consensus.cc:2468] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 12.
I20260709 12:25:45.521821 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:45.522734 25830 raft_consensus.cc:2393] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 18: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:45.425786 31911 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:45.527115 25726 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:45.484015 31675 raft_consensus.cc:697] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:45.562672 25756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48606 (request call id 1538) took 1236 ms. Trace:
I20260709 12:25:45.528779 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:45.550746 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:45.560146 25679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2744) took 1343 ms. Trace:
I20260709 12:25:45.558154 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:45.574990 25758 raft_consensus.cc:2410] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 14 because replica has last-logged OpId of term: 13 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 5.
I20260709 12:25:45.577339 25760 raft_consensus.cc:2468] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 16.
I20260709 12:25:45.576849 25679 rpcz_store.cc:276] 0709 12:25:44.217047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:44.220607 (+  3560us) service_pool.cc:224] Handling call
0709 12:25:44.220868 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:44.654347 (+433479us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:45.559822 (+905475us) spinlock_profiling.cc:243] Waited 430 ms on lock 0x7b54000b13d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:45.560068 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":987910528}
I20260709 12:25:45.574528 25756 rpcz_store.cc:276] 0709 12:25:44.326729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:44.754689 (+427960us) service_pool.cc:224] Handling call
0709 12:25:44.755076 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:44.835419 (+ 80343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:44.835453 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:44.835495 (+    42us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:25:44.835527 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:45.562371 (+726844us) spinlock_profiling.cc:243] Waited 80.1 ms on lock 0x7b54003a61d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:45.562430 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:45.562592 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":184324992}
I20260709 12:25:45.583554 25682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2767) took 1029 ms. Trace:
I20260709 12:25:45.584190 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:45.584137 25682 rpcz_store.cc:276] 0709 12:25:44.536545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:44.536734 (+   189us) service_pool.cc:224] Handling call
0709 12:25:44.824685 (+287951us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:44.831394 (+  6709us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:45.565230 (+733836us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b54002a0650. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b608ad 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:45.565394 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":542060928}
I20260709 12:25:45.509429 31797 raft_consensus.cc:2749] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:25:45.543645 31935 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:45.517321 31838 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.596639 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
W20260709 12:25:45.540953 31923 log.cc:927] Time spent T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 12:25:45.600950 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:45.601982 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:45.525612 31866 raft_consensus.cc:697] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 17 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:45.530809 31680 raft_consensus.cc:2804] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:45.609112 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:45.529047 31922 raft_consensus.cc:3060] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:45.582607 31942 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.614862 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:45.640812 25761 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:45.530714 31891 raft_consensus.cc:2804] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:45.508080 31840 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:45.617882 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:45.618782 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:45.620524 31680 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:45.621439 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:45.485656 31873 consensus_queue.cc:237] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:45.614645 31457 consensus_meta.cc:287] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.523s	user 0.008s	sys 0.004s
I20260709 12:25:45.630134 26439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 1472) took 1270 ms. Trace:
I20260709 12:25:45.630867 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:45.632200 31675 consensus_queue.cc:237] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:45.633759 25758 raft_consensus.cc:2393] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 18: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
W20260709 12:25:45.638926 31949 log.cc:927] Time spent T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 12:25:45.651055 26402 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:45.656563 25756 raft_consensus.cc:2393] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 17: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:45.631680 31911 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:45.647864 25649 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:45.661005 26439 rpcz_store.cc:276] 0709 12:25:44.359853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:44.360336 (+   483us) service_pool.cc:224] Handling call
0709 12:25:44.388619 (+ 28283us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:44.568344 (+179725us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:25:44.568395 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:45.374796 (+806401us) spinlock_profiling.cc:243] Waited 1.62 ms on lock 0x7b2c000d5dd8. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9845aa11 00007f5d9846a372 00007f5d99b9ca01 00007f5d99b6143a 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2
0709 12:25:45.375356 (+   560us) log.cc:844] Serialized 52 byte log entry
0709 12:25:45.483660 (+108304us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:45.483693 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:45.483755 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:45.629816 (+146061us) raft_consensus.cc:1685] finished
0709 12:25:45.629836 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:45.630051 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":179244,"raft.queue_time_us":286265,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":25191,"spinlock_wait_cycles":3726080,"thread_start_us":107944,"threads_started":1,"wal-append.queue_time_us":252647}
I20260709 12:25:45.630154 31888 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:45.658576 31680 raft_consensus.cc:3060] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:45.603240 31928 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:45.667315 25682 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 14.
I20260709 12:25:45.615571 31935 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
W20260709 12:25:45.646426 31848 consensus_meta.cc:287] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 1.434s	user 0.013s	sys 0.001s
I20260709 12:25:45.677544 25831 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44218 (request call id 2035) took 1318 ms. Trace:
I20260709 12:25:45.679708 25757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 3030) took 1830 ms. Trace:
I20260709 12:25:45.694662 25757 rpcz_store.cc:276] 0709 12:25:43.849702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:43.849893 (+   191us) service_pool.cc:224] Handling call
0709 12:25:43.858946 (+  9053us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:44.122584 (+263638us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:45.679477 (+1556893us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b54001e7154. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:45.679653 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":594644736}
I20260709 12:25:45.681705 26402 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:45.644748 31891 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:45.696769 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:25:45.697270 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 49484.5us
I20260709 12:25:45.697927 26402 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:45.693889 25831 rpcz_store.cc:276] 0709 12:25:44.359487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:44.360270 (+   783us) service_pool.cc:224] Handling call
0709 12:25:45.677341 (+1317071us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b5400109d54. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:45.677478 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":616461056}
I20260709 12:25:45.699257 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:45.700277 25763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48606 (request call id 1535) took 1374 ms. Trace:
I20260709 12:25:45.701550 25754 raft_consensus.cc:1275] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:25:45.702736 25754 raft_consensus.cc:1240] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 19. Current term is 20. Ops: []
I20260709 12:25:45.704193 31890 raft_consensus.cc:2749] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:45.705538 31849 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.705369 31935 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:45.706001 31849 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:45.707535 31935 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:45.707944 31891 raft_consensus.cc:3060] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:45.709054 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:45.710198 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:45.699221 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:45.713248 25828 raft_consensus.cc:1240] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 17 LEADER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:45.699783 31797 raft_consensus.cc:2749] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:25:45.705397 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:45.715833 31911 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.716358 31911 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:45.717209 31880 raft_consensus.cc:3055] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:25:45.717656 31880 raft_consensus.cc:740] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:45.719383 25678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 2759) took 1391 ms. Trace:
I20260709 12:25:45.719717 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:45.719837 25678 rpcz_store.cc:276] 0709 12:25:44.328423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:44.353859 (+ 25436us) service_pool.cc:224] Handling call
0709 12:25:45.719208 (+1365349us) spinlock_profiling.cc:243] Waited 766 ms on lock 0x7b54000b2cd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:45.719321 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1762269952}
I20260709 12:25:45.720829 31890 consensus_queue.cc:1059] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:25:45.721295 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: true dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:45.721608 31890 consensus_queue.cc:1243] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer 5cccf20a8bff46dba6601f241d172b8a log is divergent from this leader: its last log entry 17.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:25:45.643379 31941 consensus_queue.cc:237] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:45.696532 31928 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:45.722458 25649 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:45.723405 25649 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:45.724081 31928 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:45.724663 31926 raft_consensus.cc:3060] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:45.674296 31884 raft_consensus.cc:3060] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:45.725793 26432 raft_consensus.cc:2468] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 14.
I20260709 12:25:45.700644 25763 rpcz_store.cc:276] 0709 12:25:44.325696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:44.343388 (+ 17692us) service_pool.cc:224] Handling call
0709 12:25:44.382541 (+ 39153us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:44.391530 (+  8989us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:44.391564 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:44.391992 (+   428us) log.cc:844] Serialized 26 byte log entry
0709 12:25:44.682966 (+290974us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:25:44.683004 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:44.683065 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:45.700075 (+1017010us) raft_consensus.cc:1685] finished
0709 12:25:45.700099 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:45.700222 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16165,"raft.queue_time_us":10659,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":6619,"thread_start_us":117555,"threads_started":1,"wal-append.queue_time_us":834716}
I20260709 12:25:45.728699 25649 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:45.721900 25678 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:45.737341 25761 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 19.
I20260709 12:25:45.614349 31838 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:45.740142 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:45.741065 31904 raft_consensus.cc:2749] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:45.744303 31838 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:45.749742 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 19 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:45.664572 31895 consensus_queue.cc:1059] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 12:25:45.670461 31860 consensus_queue.cc:1059] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.069s
I20260709 12:25:45.732443 31849 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:45.655366 31942 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:45.778921 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:45.788147 25754 raft_consensus.cc:2468] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 14.
I20260709 12:25:45.773105 31921 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:45.788249 25756 raft_consensus.cc:1275] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:25:45.789188 31942 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:45.777917 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:45.789942 25760 raft_consensus.cc:2393] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 14: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:45.692134 31888 consensus_queue.cc:1048] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.098s
I20260709 12:25:45.790658 31921 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:45.787774 25649 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:45.792035 31890 raft_consensus.cc:3060] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:45.793805 25678 raft_consensus.cc:2468] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 18.
I20260709 12:25:45.772826 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:45.794649 31895 raft_consensus.cc:3055] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:25:45.795018 31895 raft_consensus.cc:740] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 19 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:45.795372 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:45.796095 25681 raft_consensus.cc:2393] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 16: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:45.793826 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:45.797431 25836 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 13.
I20260709 12:25:45.787241 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:45.798493 25831 raft_consensus.cc:2393] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 19: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
W20260709 12:25:45.761503 25650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:45.735587 31928 consensus_queue.cc:1059] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 14.14, Next index: 15, Last known committed idx: 11, Time since last communication: 0.071s
I20260709 12:25:45.807204 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:45.798143 25649 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:45.735738 31935 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:45.734752 31875 raft_consensus.cc:2804] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:45.734858 31910 raft_consensus.cc:2749] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:45.848603 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
W20260709 12:25:45.841506 25801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:45.847590 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:45.850275 25678 raft_consensus.cc:2468] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 13.
I20260709 12:25:45.781924 31840 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:45.773293 31922 raft_consensus.cc:2749] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:25:45.853173 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:45.786103 31554 raft_consensus.cc:2749] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:25:45.856650 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 56923.5us
I20260709 12:25:45.870757 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:45.871613 25726 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:45.872769 25726 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:45.872905 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:45.840607 31908 raft_consensus.cc:2804] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:45.876649 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:45.884701 26435 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 13.
I20260709 12:25:45.887586 25726 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:45.892392 25831 raft_consensus.cc:1275] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:25:45.878410 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:45.897526 26433 raft_consensus.cc:3060] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:45.879179 26438 raft_consensus.cc:1275] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:25:45.879578 26436 raft_consensus.cc:1275] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:25:45.881937 26439 raft_consensus.cc:1240] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 12. Current term is 13. Ops: [11.11-12.12]
I20260709 12:25:45.848505 31875 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:45.734913 31606 consensus_queue.cc:1048] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.118s
I20260709 12:25:45.890129 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
W20260709 12:25:45.876921 25801 connection.cc:256] RPC call timeout handler was delayed by -1.3994639600000482s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17700000000000002s for a response
W20260709 12:25:45.963115 25801 connection.cc:256] RPC call timeout handler was delayed by -1.3013566710001214s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1968s for a response
W20260709 12:25:45.952276 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 50522.4us
I20260709 12:25:45.795852 31895 consensus_queue.cc:260] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:45.964941 31895 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:25:45.951687 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:45.776262 31871 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:45.852327 31839 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:46.004637 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:45.807562 31849 consensus_queue.cc:1059] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.067s
I20260709 12:25:45.786659 31866 consensus_queue.cc:237] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:45.889210 31838 raft_consensus.cc:2749] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:45.884265 31908 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:45.899343 31921 raft_consensus.cc:2804] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:45.950510 31875 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:46.018781 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:45.960671 31554 raft_consensus.cc:2749] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:25:46.024019 31839 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:46.022538 31931 log.cc:927] Time spent T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.889s	user 0.000s	sys 0.002s
I20260709 12:25:46.030484 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:46.030905 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:45.851836 31935 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:46.004691 31848 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:46.054522 31935 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:46.054412 31848 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:46.056826 31848 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:45.969628 31457 consensus_queue.cc:1175] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5cccf20a8bff46dba6601f241d172b8a" responder_term: 19 status { last_received { term: 19 index: 11 } last_committed_idx: 9 last_received_current_leader { term: 19 index: 11 } }
I20260709 12:25:46.017246 31908 raft_consensus.cc:3060] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:46.041560 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:46.042629 31839 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:46.042847 31909 log.cc:927] Time spent T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 1.287s	user 0.000s	sys 0.004s
I20260709 12:25:46.044061 31906 raft_consensus.cc:3055] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:46.025765 31921 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:46.053509 31871 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:46.077767 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:46.098577 25685 raft_consensus.cc:2468] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 15.
W20260709 12:25:46.077140 31824 consensus_meta.cc:287] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.614s	user 0.006s	sys 0.007s
I20260709 12:25:46.077229 31906 raft_consensus.cc:740] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:46.075206 31928 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:46.110251 31906 consensus_queue.cc:260] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:46.110773 31928 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:46.040337 31891 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:46.111641 31906 raft_consensus.cc:3060] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:46.097640 31921 raft_consensus.cc:3060] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:46.119602 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 155970us
W20260709 12:25:46.119974 25727 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.005s	sys 0.038s
W20260709 12:25:46.121404 25727 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.005s	sys 0.038s
I20260709 12:25:46.001247 25678 raft_consensus.cc:2468] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 14.
W20260709 12:25:46.143113 25801 connection.cc:256] RPC call timeout handler was delayed by -1.2422771190003914s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2717s for a response
W20260709 12:25:46.143805 25801 connection.cc:256] RPC call timeout handler was delayed by -1.2356639599997834s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1952s for a response
W20260709 12:25:46.144286 25801 connection.cc:256] RPC call timeout handler was delayed by -1.2329566710004656s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20440000000000003s for a response
W20260709 12:25:46.145134 25801 connection.cc:256] RPC call timeout handler was delayed by -1.063756671000192s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22320000000000004s for a response
I20260709 12:25:46.148761 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:46.149463 25678 raft_consensus.cc:2468] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 13.
W20260709 12:25:46.165068 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:46.118333 31890 raft_consensus.cc:2749] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:45.957532 31797 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:46.183279 25686 raft_consensus.cc:2410] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 12:25:46.183003 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:46.186841 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:46.198899 25726 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:46.201607 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:46.202445 25685 raft_consensus.cc:2468] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 15.
I20260709 12:25:46.206820 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:46.207235 25754 raft_consensus.cc:1240] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:46.207432 25678 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:46.208329 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:46.187458 31979 log.cc:927] Time spent T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 12:25:46.216682 25726 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:46.219336 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:46.184921 31970 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.187106 31871 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.225246 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:46.257282 25726 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:46.262428 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:46.263077 25685 raft_consensus.cc:2468] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 15.
I20260709 12:25:46.265568 25678 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 19.
I20260709 12:25:46.273211 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:46.274437 25726 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:46.287026 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:46.253314 31849 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.288714 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:46.260370 31838 raft_consensus.cc:2749] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:25:46.289589 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:46.261029 31675 raft_consensus.cc:2804] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:46.292505 25681 raft_consensus.cc:2468] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 14.
W20260709 12:25:46.307971 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:46.308115 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:46.295833 26433 raft_consensus.cc:2468] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 14.
I20260709 12:25:46.227430 31944 consensus_queue.cc:1059] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 12:25:46.266031 31853 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.260759 31895 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
W20260709 12:25:46.276494 31926 consensus_meta.cc:287] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.542s	user 0.011s	sys 0.000s
I20260709 12:25:46.265965 31942 raft_consensus.cc:2804] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:46.308516 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:46.286741 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:46.319459 25681 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 10.
I20260709 12:25:46.265534 31848 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:46.312839 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 43948.7us
I20260709 12:25:46.264361 31871 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:46.261292 31640 consensus_queue.cc:1059] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:25:46.219262 31797 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:46.284581 31922 raft_consensus.cc:2804] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:46.319643 25685 raft_consensus.cc:2468] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 16.
I20260709 12:25:46.321902 25801 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:46.322203 31926 raft_consensus.cc:2749] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:46.314278 31935 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:46.356913 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:46.311492 31675 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:46.360690 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:46.323858 31891 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:46.307260 31849 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:46.318818 31942 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:46.316812 31853 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:46.366400 25801 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:46.327801 31842 raft_consensus.cc:3060] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:46.378301 25754 raft_consensus.cc:1240] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:46.367198 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:46.358295 31973 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.369135 25763 raft_consensus.cc:1275] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:25:46.328260 31922 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:46.254201 31970 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:46.375310 25679 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 18.
I20260709 12:25:46.375869 31797 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:46.398453 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:46.399822 26433 raft_consensus.cc:2468] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 15.
I20260709 12:25:46.400919 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:46.364019 31975 raft_consensus.cc:2749] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:25:46.402072 25801 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:46.329169 31848 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:46.406558 31891 consensus_queue.cc:1048] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 12:25:46.407733 31849 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:46.408119 31981 log.cc:927] Time spent T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.195s	user 0.001s	sys 0.001s
I20260709 12:25:46.408789 31970 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:46.399179 31922 raft_consensus.cc:3060] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:46.399250 31640 raft_consensus.cc:2749] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:46.409616 31872 raft_consensus.cc:3055] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:46.410560 31972 raft_consensus.cc:3055] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 16 LEADER]: Stepping down as leader of term 16
W20260709 12:25:46.411410 31990 log.cc:927] Time spent T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:25:46.368546 31985 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:46.376897 31980 log.cc:927] Time spent T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 12:25:46.415350 25681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40230 (request call id 1955) took 1024 ms. Trace:
I20260709 12:25:46.428754 25801 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:25:46.417838 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:46.428891 25681 rpcz_store.cc:276] 0709 12:25:45.392442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:46.372086 (+979644us) service_pool.cc:224] Handling call
0709 12:25:46.415299 (+ 43213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:46.370682 31675 raft_consensus.cc:3060] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:46.404769 31973 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:46.397929 31942 raft_consensus.cc:3060] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:46.424080 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:46.369038 31636 consensus_queue.cc:1048] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:25:46.369490 31935 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:46.355803 31895 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:46.417708 31580 raft_consensus.cc:2749] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:25:46.425822 31680 consensus_meta.cc:287] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.701s	user 0.011s	sys 0.000s
I20260709 12:25:46.443955 31680 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:46.445256 25680 raft_consensus.cc:2468] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 17.
I20260709 12:25:46.446192 31680 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:46.448730 31875 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:46.451108 31875 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:46.451810 31884 consensus_meta.cc:287] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.700s	user 0.010s	sys 0.000s
I20260709 12:25:46.452340 31884 raft_consensus.cc:2749] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:46.458734 31908 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:46.461412 31908 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:46.438728 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:46.434273 31970 raft_consensus.cc:2804] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:46.475847 31970 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:46.476289 31970 raft_consensus.cc:3060] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:46.479439 25833 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41782 (request call id 1269) took 2368 ms. Trace:
I20260709 12:25:46.426003 31972 raft_consensus.cc:740] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:46.480772 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:46.479943 25833 rpcz_store.cc:276] 0709 12:25:44.111258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:44.789184 (+677926us) service_pool.cc:224] Handling call
0709 12:25:44.829065 (+ 39881us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:45.083511 (+254446us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 12:25:45.363069 (+279558us) log.cc:844] Serialized 14 byte log entry
0709 12:25:45.846358 (+483289us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:45.846414 (+    56us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:25:45.846458 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:46.479156 (+632698us) spinlock_profiling.cc:243] Waited 254 ms on lock 0x7b5400116554. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:46.479214 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:46.479354 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":519765,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":66715,"spinlock_wait_cycles":597728000,"thread_start_us":749255,"threads_started":3,"wal-append.queue_time_us":334416}
I20260709 12:25:46.480700 31972 consensus_queue.cc:260] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:46.482085 25677 raft_consensus.cc:3055] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 16 LEADER]: Stepping down as leader of term 16
W20260709 12:25:46.482347 31991 log.cc:927] Time spent T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 12:25:46.482487 25677 raft_consensus.cc:740] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:46.483294 25677 consensus_queue.cc:260] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:46.484278 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:46.484688 25677 raft_consensus.cc:3060] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:46.485424 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:46.485826 31970 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:46.486583 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:46.487201 26431 raft_consensus.cc:2468] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 14.
I20260709 12:25:46.481431 25681 raft_consensus.cc:2468] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 13.
I20260709 12:25:46.488837 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:46.438458 25801 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:46.425544 31872 raft_consensus.cc:740] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:46.490160 31880 consensus_queue.cc:260] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:46.441177 31873 consensus_queue.cc:1048] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 12:25:46.464164 31895 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:46.493420 31935 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:46.437652 31926 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:46.494099 31891 raft_consensus.cc:2804] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:46.494558 31891 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:46.435746 31983 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:46.495596 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 57212.9us
I20260709 12:25:46.494352 31926 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:46.469702 31871 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:46.470252 31853 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:46.474529 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:46.510747 26430 raft_consensus.cc:3060] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:46.514216 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:46.514660 31825 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.515898 31935 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.516512 31935 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:46.517742 25834 raft_consensus.cc:1240] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 17 LEADER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:46.518040 31857 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:46.515237 31825 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:46.518642 31935 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:46.507995 31554 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:46.520303 31825 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:46.520872 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:46.521486 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:46.522339 25755 raft_consensus.cc:1275] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:25:46.522910 31926 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:46.493573 25835 raft_consensus.cc:1240] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 21. Current term is 22. Ops: []
I20260709 12:25:46.523610 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:46.524776 25835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41782 (request call id 1271) took 1132 ms. Trace:
I20260709 12:25:46.525141 25835 rpcz_store.cc:276] 0709 12:25:45.392064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:45.392172 (+   108us) service_pool.cc:224] Handling call
0709 12:25:46.493388 (+1101216us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:46.523857 (+ 30469us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:46.524617 (+   760us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54001f3950. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b608ad 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:46.524725 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2498201984}
I20260709 12:25:46.525610 25833 raft_consensus.cc:1240] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 20 LEADER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 19. Current term is 20. Ops: []
I20260709 12:25:46.527096 31860 raft_consensus.cc:3055] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:25:46.527494 31860 raft_consensus.cc:740] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 19 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:46.461429 26437 raft_consensus.cc:2468] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 16.
I20260709 12:25:46.495458 31983 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:46.528498 31921 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:46.530797 31983 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:46.530910 31921 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:46.433724 31985 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:46.465693 31848 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:46.494987 31891 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:25:46.493441 25829 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44218 (request call id 2043) took 1846 ms (client timeout 2135 ms). Trace:
W20260709 12:25:46.540314 25829 rpcz_store.cc:269] 0709 12:25:44.646778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:44.646926 (+   148us) service_pool.cc:224] Handling call
0709 12:25:46.493251 (+1846325us) spinlock_profiling.cc:243] Waited 269 ms on lock 0x7b54001f3954. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:46.493382 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":618321152}
I20260709 12:25:46.440775 31973 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:46.543888 26401 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:46.544266 26430 raft_consensus.cc:2468] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 15.
I20260709 12:25:46.508671 25685 raft_consensus.cc:2393] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 15: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:46.509838 25754 raft_consensus.cc:1240] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 21. Current term is 22. Ops: []
I20260709 12:25:46.520363 31554 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:46.547749 31922 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:46.490348 31872 consensus_queue.cc:260] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 15.15, Last appended by leader: 15, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:46.500382 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:46.549454 26431 raft_consensus.cc:2393] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 14: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:46.549465 25686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40230 (request call id 1958) took 1156 ms. Trace:
I20260709 12:25:46.551200 25686 rpcz_store.cc:276] 0709 12:25:45.393187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:45.852410 (+459223us) service_pool.cc:224] Handling call
0709 12:25:46.549285 (+696875us) spinlock_profiling.cc:243] Waited 312 ms on lock 0x7b54003d9ad4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:46.549409 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":716634368}
I20260709 12:25:46.528319 31860 consensus_queue.cc:260] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:46.572348 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:46.541742 25681 raft_consensus.cc:2393] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 18: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:46.548154 31554 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:46.536494 25677 raft_consensus.cc:1275] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:25:46.487797 31970 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:46.594313 25677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2773) took 1840 ms. Trace:
I20260709 12:25:46.595103 25650 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:46.597020 25801 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:46.594808 25677 rpcz_store.cc:276] 0709 12:25:44.754334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:44.768494 (+ 14160us) service_pool.cc:224] Handling call
0709 12:25:44.820426 (+ 51932us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:46.481983 (+1661557us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b54003d2fa0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99ad8dc0 00007f5d99b631c0 00007f5d99b64231 00007f5d99b60d8f 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c
0709 12:25:46.594042 (+112059us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:46.594256 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":350962432}
I20260709 12:25:46.598302 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:46.599058 25677 raft_consensus.cc:2393] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 14: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:46.604377 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:46.606742 25650 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:46.606968 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:46.678345 25754 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 16.
I20260709 12:25:46.609005 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:46.679385 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:46.613699 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:46.576721 31872 raft_consensus.cc:3060] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:46.555374 31983 raft_consensus.cc:2749] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:46.614010 31922 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:46.614428 31929 raft_consensus.cc:2749] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:46.664047 31985 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:46.685094 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 19 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:25:46.677906 31906 consensus_meta.cc:287] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.558s	user 0.008s	sys 0.002s
I20260709 12:25:46.680483 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:46.681525 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 74911.8us
I20260709 12:25:46.682353 25686 raft_consensus.cc:2393] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 14: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:46.688524 25686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40230 (request call id 1943) took 1300 ms. Trace:
I20260709 12:25:46.577356 31848 consensus_queue.cc:1048] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.098s
W20260709 12:25:46.684290 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 87349.1us
I20260709 12:25:46.670034 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:25:46.611704 31274 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260709 12:25:46.608433 31825 consensus_queue.cc:1048] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 12:25:46.688860 25686 rpcz_store.cc:276] 0709 12:25:45.387966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:46.551952 (+1163986us) service_pool.cc:224] Handling call
0709 12:25:46.688458 (+136506us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:46.691591 26434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36518 (request call id 1186) took 1449 ms. Trace:
I20260709 12:25:46.701531 26433 raft_consensus.cc:2410] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 12:25:46.685989 31970 raft_consensus.cc:2804] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:46.685199 31895 raft_consensus.cc:2804] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:25:46.699131 25650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:46.699478 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 19 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:46.603475 31908 consensus_queue.cc:1059] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.092s
I20260709 12:25:46.703944 25801 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:46.701853 26434 rpcz_store.cc:276] 0709 12:25:45.242389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:45.242500 (+   111us) service_pool.cc:224] Handling call
0709 12:25:45.242783 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:45.515625 (+272842us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:45.515659 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:45.528131 (+ 12472us) log.cc:844] Serialized 26 byte log entry
0709 12:25:45.736140 (+208009us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:45.736191 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:46.691217 (+955026us) spinlock_profiling.cc:243] Waited 255 ms on lock 0x7b54006126d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:46.691262 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:46.691303 (+    41us) raft_consensus.cc:1685] finished
0709 12:25:46.691316 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:46.691534 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":585420672,"thread_start_us":191915,"threads_started":1,"wal-append.queue_time_us":534698}
I20260709 12:25:46.705080 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:46.709527 25755 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 12.
I20260709 12:25:46.710148 26434 raft_consensus.cc:1275] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:25:46.710414 26431 raft_consensus.cc:1275] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 23 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:25:46.705147 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:46.705633 25686 raft_consensus.cc:1275] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:25:46.711656 25686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40230 (request call id 1959) took 1318 ms. Trace:
I20260709 12:25:46.712110 25686 rpcz_store.cc:276] 0709 12:25:45.393443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:46.701909 (+1308466us) service_pool.cc:224] Handling call
0709 12:25:46.702323 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:46.711427 (+  9104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:46.711600 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:46.713132 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:46.714094 31908 consensus_queue.cc:1243] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Peer 5cccf20a8bff46dba6601f241d172b8a log is divergent from this leader: its last log entry 20.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:25:46.715530 25754 raft_consensus.cc:1275] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:25:46.715719 26434 raft_consensus.cc:1240] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 17. Current term is 18. Ops: []
I20260709 12:25:46.719231 26433 raft_consensus.cc:1275] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:25:46.721104 26434 raft_consensus.cc:1240] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:46.719877 25754 raft_consensus.cc:1275] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:25:46.723109 25686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51578 (request call id 1197) took 1048 ms. Trace:
I20260709 12:25:46.722785 26434 raft_consensus.cc:1240] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:46.723837 25754 raft_consensus.cc:3060] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:46.709242 31895 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:46.723515 25686 rpcz_store.cc:276] 0709 12:25:45.670447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:46.718171 (+1047724us) service_pool.cc:224] Handling call
0709 12:25:46.718413 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:46.718574 (+   161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:46.718601 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:46.718679 (+    78us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:25:46.718709 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:46.718756 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:46.718848 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:46.726621 31892 consensus_queue.cc:1048] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:25:46.731022 31892 consensus_queue.cc:1048] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:46.712441 31970 raft_consensus.cc:697] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 18 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:46.740561 26434 raft_consensus.cc:1240] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:46.742421 31640 consensus_queue.cc:1048] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:25:46.742705 31970 consensus_queue.cc:237] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 17.7, Last appended by leader: 7, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:46.746523 31922 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.747062 31922 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:46.747942 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:46.748653 26437 raft_consensus.cc:1275] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:25:46.749138 31922 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:46.751022 25679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40230 (request call id 1940) took 1363 ms. Trace:
I20260709 12:25:46.751416 25679 rpcz_store.cc:276] 0709 12:25:45.387143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:45.699046 (+311903us) service_pool.cc:224] Handling call
0709 12:25:46.750875 (+1051829us) spinlock_profiling.cc:243] Waited 413 ms on lock 0x7b54000b27d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:46.750966 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":949575040}
I20260709 12:25:46.752328 31620 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:46.754653 26434 raft_consensus.cc:1275] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:25:46.755498 26431 raft_consensus.cc:1275] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:25:46.720353 31580 raft_consensus.cc:3060] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:46.760763 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:46.756806 31892 consensus_queue.cc:1059] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 12:25:46.768476 31928 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:46.768708 31903 raft_consensus.cc:3055] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:46.769204 31903 raft_consensus.cc:740] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:46.770328 31903 consensus_queue.cc:260] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:46.772238 31903 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:46.725965 31895 raft_consensus.cc:3060] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:46.783468 31922 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.784124 31922 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:46.784768 25681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40230 (request call id 1952) took 1394 ms. Trace:
I20260709 12:25:46.785190 25681 rpcz_store.cc:276] 0709 12:25:45.390252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:46.488602 (+1098350us) service_pool.cc:224] Handling call
0709 12:25:46.784565 (+295963us) spinlock_profiling.cc:243] Waited 50.2 ms on lock 0x7b5400232654. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:46.784705 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":115475840}
I20260709 12:25:46.786617 31922 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:46.786849 25681 raft_consensus.cc:1275] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 23 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
W20260709 12:25:46.788398 25680 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40230 (request call id 1951) took 1398 ms (client timeout 1600 ms). Trace:
I20260709 12:25:46.789301 25801 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:46.789764 25682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40230 (request call id 1941) took 1402 ms. Trace:
I20260709 12:25:46.790194 25682 rpcz_store.cc:276] 0709 12:25:45.387412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:45.617564 (+230152us) service_pool.cc:224] Handling call
0709 12:25:46.789605 (+1172041us) spinlock_profiling.cc:243] Waited 22 ms on lock 0x7b5400159854. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:46.789703 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":50666752}
W20260709 12:25:46.792644 25762 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53474 (request call id 3436) took 1430 ms (client timeout 1553 ms). Trace:
I20260709 12:25:46.792930 31906 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.793576 31906 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:46.796788 25758 raft_consensus.cc:1240] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:46.797804 25683 raft_consensus.cc:2468] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 17.
W20260709 12:25:46.793229 25762 rpcz_store.cc:269] 0709 12:25:45.362373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:45.362598 (+   225us) service_pool.cc:224] Handling call
0709 12:25:46.792408 (+1429810us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b54001db5d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:46.792566 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":280941440}
W20260709 12:25:46.788962 25680 rpcz_store.cc:269] 0709 12:25:45.390023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:45.467547 (+ 77524us) service_pool.cc:224] Handling call
0709 12:25:46.788192 (+1320645us) spinlock_profiling.cc:243] Waited 956 ms on lock 0x7b54002a53d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:46.788328 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2198547328}
I20260709 12:25:46.156539 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:46.818209 26431 raft_consensus.cc:1240] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 15. Current term is 16. Ops: [12.11-15.13]
I20260709 12:25:46.828277 25679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51578 (request call id 1201) took 1024 ms. Trace:
I20260709 12:25:46.834250 25754 raft_consensus.cc:1275] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:25:46.831465 25679 rpcz_store.cc:276] 0709 12:25:45.803648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:46.752311 (+948663us) service_pool.cc:224] Handling call
0709 12:25:46.752599 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:46.752787 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:25:46.753070 (+   283us) log.cc:844] Serialized 14 byte log entry
0709 12:25:46.827750 (+ 74680us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:46.827827 (+    77us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:25:46.827894 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:46.828019 (+   125us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:46.828188 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2079,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":2210,"raft.queue_time_us":124,"thread_start_us":74251,"threads_started":1}
I20260709 12:25:46.835662 25801 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:46.840855 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:46.841459 25761 raft_consensus.cc:3060] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:25:46.844482 25684 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 2747) took 2599 ms (client timeout 1721 ms). Trace:
W20260709 12:25:46.844882 25684 rpcz_store.cc:269] 0709 12:25:44.217973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:44.240301 (+ 22328us) service_pool.cc:224] Handling call
0709 12:25:46.816916 (+2576615us) spinlock_profiling.cc:243] Waited 667 ms on lock 0x7b5400159354. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:46.817033 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1535098624}
I20260709 12:25:46.845535 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:46.855998 25650 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.245.132:35611 timed out after 1.509s (SENT) [suppressed 28 similar messages]
I20260709 12:25:46.836176 31554 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.833752 31975 raft_consensus.cc:2749] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:25:46.877086 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:46.876950 25761 raft_consensus.cc:2468] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 16.
I20260709 12:25:46.878391 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:46.879352 25761 raft_consensus.cc:2468] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 16.
I20260709 12:25:46.883564 25685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40230 (request call id 1967) took 1032 ms. Trace:
I20260709 12:25:46.883988 25756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 3445) took 1106 ms. Trace:
I20260709 12:25:46.887030 25756 rpcz_store.cc:276] 0709 12:25:45.777206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:45.781271 (+  4065us) service_pool.cc:224] Handling call
0709 12:25:45.781589 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:45.789380 (+  7791us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:46.883749 (+1094369us) spinlock_profiling.cc:243] Waited 6.33 ms on lock 0x7b54000415d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:46.883900 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14555008}
I20260709 12:25:46.885075 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:46.867990 31825 raft_consensus.cc:2804] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:46.886205 25685 rpcz_store.cc:276] 0709 12:25:45.851150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:46.360589 (+509439us) service_pool.cc:224] Handling call
0709 12:25:46.883374 (+522785us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54003fdc54. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:46.883509 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":254329600}
I20260709 12:25:46.900961 25801 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:46.866462 31933 consensus_queue.cc:1048] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 12:25:46.895792 31825 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:46.919900 26432 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36508 (request call id 1474) took 2550 ms (client timeout 3368 ms). Trace:
I20260709 12:25:46.873620 31554 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:46.924567 25760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53460 (request call id 3047) took 1551 ms. Trace:
I20260709 12:25:46.879191 31640 consensus_queue.cc:1048] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 12:25:46.926522 25760 rpcz_store.cc:276] 0709 12:25:45.373225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:45.596330 (+223105us) service_pool.cc:224] Handling call
0709 12:25:46.924367 (+1328037us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b5400297f54. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:46.924509 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":423447936}
W20260709 12:25:46.922122 26432 rpcz_store.cc:269] 0709 12:25:44.365236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:44.365360 (+   124us) service_pool.cc:224] Handling call
0709 12:25:46.915127 (+2549767us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54002e8bd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:46.915254 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3126371072}
I20260709 12:25:46.925529 25726 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:46.882498 31942 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:46.932911 26402 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:46.934580 25726 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:46.894315 31891 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:46.926663 31825 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:46.948787 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 92862.8us
I20260709 12:25:46.951190 25755 raft_consensus.cc:1240] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:46.961862 25837 raft_consensus.cc:1217] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Deduplicated request from leader. Original: 11.10->[12.11-15.13]   Dedup: 12.11->[13.12-15.13]
W20260709 12:25:46.968981 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:46.936556 31871 raft_consensus.cc:2804] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:25:46.943370 31675 consensus_meta.cc:287] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.504s	user 0.010s	sys 0.000s
I20260709 12:25:46.971251 25837 raft_consensus.cc:1240] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 15. Current term is 16. Ops: [12.11-15.13]
I20260709 12:25:46.977641 25684 raft_consensus.cc:1240] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 15. Current term is 16. Ops: [15.15-15.15]
I20260709 12:25:46.978374 25686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51578 (request call id 1200) took 1175 ms. Trace:
I20260709 12:25:46.978811 25686 rpcz_store.cc:276] 0709 12:25:45.803298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:46.725125 (+921827us) service_pool.cc:224] Handling call
0709 12:25:46.726463 (+  1338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:46.728496 (+  2033us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:46.728525 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:46.730904 (+  2379us) log.cc:844] Serialized 26 byte log entry
0709 12:25:46.866555 (+135651us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:46.866592 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:46.866703 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:46.978203 (+111500us) raft_consensus.cc:1685] finished
0709 12:25:46.978221 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:46.978328 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1583,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":72,"thread_start_us":135121,"threads_started":1,"wal-append.queue_time_us":212177}
I20260709 12:25:46.942579 31680 raft_consensus.cc:2804] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:46.978315 31457 consensus_queue.cc:1059] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 12:25:46.984891 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:46.985132 31457 consensus_queue.cc:1243] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer 5cccf20a8bff46dba6601f241d172b8a log is divergent from this leader: its last log entry 14.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:25:46.985397 25679 raft_consensus.cc:1275] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:25:46.985535 25684 raft_consensus.cc:2468] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 14.
I20260709 12:25:46.985724 31457 raft_consensus.cc:3055] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:46.986121 31457 raft_consensus.cc:740] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:46.986562 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:46.987154 25679 raft_consensus.cc:2468] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 15.
I20260709 12:25:46.988526 25685 raft_consensus.cc:1240] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 12:25:46.943799 31928 raft_consensus.cc:2804] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:46.993985 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:46.994760 25681 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 23.
I20260709 12:25:46.972002 31584 raft_consensus.cc:2749] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:25:46.952555 31921 consensus_queue.cc:1048] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 12:25:46.953310 31983 consensus_queue.cc:1048] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.046s
I20260709 12:25:46.976749 31871 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:46.997421 31928 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:47.017972 31911 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:47.020516 32001 log.cc:927] Time spent T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 12:25:47.012568 31926 consensus_queue.cc:1059] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 21.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.012s
W20260709 12:25:47.024545 31999 log.cc:927] Time spent T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:25:47.024899 31926 raft_consensus.cc:3055] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:25:47.025310 31926 raft_consensus.cc:740] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:47.026247 31926 consensus_queue.cc:260] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 21.18, Last appended by leader: 18, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:47.027577 31926 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:25:47.004765 31996 log.cc:927] Time spent T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 12:25:46.999696 31904 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.009968 26402 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:25:47.003353 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 102479us
I20260709 12:25:47.039192 25801 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:47.041079 25801 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:46.983779 31675 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:47.010926 31871 raft_consensus.cc:3060] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:47.013764 31928 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:47.043529 31853 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.062546 31580 raft_consensus.cc:2749] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:47.044610 31884 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.047482 31584 raft_consensus.cc:2749] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:47.051859 31640 raft_consensus.cc:2804] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:47.071949 31944 consensus_queue.cc:1048] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:25:47.057976 31891 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:47.069523 31680 raft_consensus.cc:697] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:47.062676 31853 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:47.075531 31680 consensus_queue.cc:237] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:47.076794 31853 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:47.077311 31640 raft_consensus.cc:697] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 14 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:47.078213 31640 consensus_queue.cc:237] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:47.078733 31853 raft_consensus.cc:2804] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:47.079144 31853 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:47.079488 31853 raft_consensus.cc:3060] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:47.049612 31457 consensus_queue.cc:260] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:47.080783 31457 raft_consensus.cc:3060] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:47.087177 31853 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:47.091269 25683 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 2786) took 1810 ms (client timeout 1836 ms). Trace:
I20260709 12:25:47.091390 25801 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:47.047314 31904 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:47.093609 31866 consensus_queue.cc:1048] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 12:25:47.105345 31825 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:47.067848 31884 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:47.124935 31824 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.125751 31860 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:47.157585 31857 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.158087 31857 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:47.161880 25678 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 19.
I20260709 12:25:47.163647 25678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51578 (request call id 1199) took 1429 ms. Trace:
I20260709 12:25:47.164117 25678 rpcz_store.cc:276] 0709 12:25:45.733970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:46.307849 (+573879us) service_pool.cc:224] Handling call
0709 12:25:47.163472 (+855623us) spinlock_profiling.cc:243] Waited 853 ms on lock 0x7b54002cf1d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:47.163589 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1961914624}
W20260709 12:25:47.130935 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:47.176092 31942 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:47.177947 31904 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:47.149228 32004 raft_consensus.cc:2804] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:47.179775 32004 raft_consensus.cc:697] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 16 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:47.180760 32004 consensus_queue.cc:237] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:47.183177 25800 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:47.183678 31853 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:47.151360 31776 consensus_queue.cc:1059] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 12:25:47.186476 31776 raft_consensus.cc:3055] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:47.186861 31776 raft_consensus.cc:740] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
W20260709 12:25:47.141587 25683 rpcz_store.cc:269] 0709 12:25:45.280636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:45.281755 (+  1119us) service_pool.cc:224] Handling call
0709 12:25:47.091113 (+1809358us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b54002486d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:47.091215 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3484631424}
I20260709 12:25:47.188758 31970 consensus_queue.cc:1048] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:25:47.190021 31554 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:47.194617 25763 raft_consensus.cc:1240] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:47.196619 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:47.196766 31824 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:47.199012 31824 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:47.203949 31884 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:47.205474 32009 log.cc:927] Time spent T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.112s	user 0.004s	sys 0.000s
I20260709 12:25:47.139762 25650 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
W20260709 12:25:47.206907 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 67235.3us
I20260709 12:25:47.146342 25649 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:47.152527 31974 raft_consensus.cc:3055] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:47.156004 31675 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:47.091508 31895 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:47.186579 26401 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:25:47.213825 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 67603us
W20260709 12:25:47.141991 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 50691us
I20260709 12:25:47.214334 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:25:47.151036 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 142585us
I20260709 12:25:47.217759 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:47.221509 25649 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:47.221590 25801 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:47.225028 26401 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:47.228070 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:47.230208 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:47.264746 25829 raft_consensus.cc:1275] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:25:47.264706 25682 raft_consensus.cc:1275] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 13. (term mismatch)
I20260709 12:25:47.258426 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:47.265826 25682 pending_rounds.cc:85] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc: Aborting all ops after (but not including) 12
I20260709 12:25:47.264585 26434 raft_consensus.cc:1240] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:47.265756 25754 raft_consensus.cc:1240] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 17. Current term is 18. Ops: []
I20260709 12:25:47.266312 25682 pending_rounds.cc:107] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc: Aborting uncommitted NO_OP operation due to leader change: 19.13
I20260709 12:25:47.266410 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:47.266702 25682 raft_consensus.cc:2889] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:25:47.243670 25801 connection.cc:256] RPC call timeout handler was delayed by -1.2550957000003109s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1836s for a response
W20260709 12:25:47.268687 25801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:47.240929 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:47.269438 25760 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:25:47.246922 25762 raft_consensus.cc:1240] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:47.242254 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:47.271826 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:47.256677 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:47.275348 25834 raft_consensus.cc:2468] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 17.
I20260709 12:25:47.247560 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:47.221256 31868 raft_consensus.cc:2804] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:25:47.281311 26431 raft_consensus.cc:1240] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:47.284283 25755 raft_consensus.cc:1275] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 12:25:47.220165 31274 raft_consensus.cc:2749] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:25:47.210773 31921 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:47.234509 31877 raft_consensus.cc:2749] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:47.299755 25801 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:47.273959 26439 raft_consensus.cc:2468] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 17.
I20260709 12:25:47.244622 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:47.290302 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:47.301481 25754 raft_consensus.cc:2468] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 20.
I20260709 12:25:47.292389 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:47.292593 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:47.302757 25758 raft_consensus.cc:2468] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 14.
W20260709 12:25:47.293031 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:47.213312 31974 raft_consensus.cc:740] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:47.294327 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:47.284771 25755 pending_rounds.cc:85] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 10
I20260709 12:25:47.341849 25755 pending_rounds.cc:107] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 12:25:47.342276 25755 raft_consensus.cc:2889] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:47.285392 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 19 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:47.236218 31926 raft_consensus.cc:2804] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:47.264231 31983 raft_consensus.cc:2749] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:47.264911 31970 raft_consensus.cc:2804] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:47.268967 31457 raft_consensus.cc:2804] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:47.342944 25761 raft_consensus.cc:2468] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 17.
W20260709 12:25:47.343989 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 44315.6us
I20260709 12:25:47.346290 25681 raft_consensus.cc:1275] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:25:47.348898 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:47.402112 25835 raft_consensus.cc:2468] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 19.
I20260709 12:25:47.350090 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:47.351423 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:47.233914 31912 consensus_queue.cc:1048] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.107s
I20260709 12:25:47.229902 31904 consensus_queue.cc:1048] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.118s
I20260709 12:25:47.366016 25683 raft_consensus.cc:1275] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:25:47.187690 31776 consensus_queue.cc:260] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:47.369203 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:47.264803 31824 consensus_queue.cc:1048] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.109s
I20260709 12:25:47.284988 31675 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:47.230119 31891 consensus_queue.cc:1048] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.077s
I20260709 12:25:47.345858 31926 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:47.403792 25836 raft_consensus.cc:2410] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 17 because replica has last-logged OpId of term: 15 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 14.
I20260709 12:25:47.382705 31970 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:47.433748 32011 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.594265 31970 raft_consensus.cc:3060] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:47.594424 32011 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:47.596720 32011 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:47.405115 25828 raft_consensus.cc:1275] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:25:47.600821 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:47.601579 25828 raft_consensus.cc:2368] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 13. Current term is 14.
I20260709 12:25:47.258667 31853 consensus_queue.cc:1048] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.085s
I20260709 12:25:47.400518 31457 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:47.383249 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:47.258857 32010 consensus_queue.cc:1048] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.109s
I20260709 12:25:47.604251 25686 raft_consensus.cc:3060] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:47.408092 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:47.415817 31620 consensus_queue.cc:1048] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:25:47.411680 31580 consensus_queue.cc:1048] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.009s
I20260709 12:25:47.420629 31776 raft_consensus.cc:3060] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:47.340658 31921 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:47.421649 31911 consensus_queue.cc:1175] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a866ff967d964388a6f0dff7fd43df89" responder_term: 15 status { last_received { term: 14 index: 12 } last_committed_idx: 12 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 14. Current term is 15. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:25:47.423173 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:47.280845 31848 consensus_queue.cc:1048] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.104s
I20260709 12:25:47.343400 31868 raft_consensus.cc:697] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 19 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:47.300063 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:47.365978 31636 raft_consensus.cc:2749] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:25:47.493973 25760 raft_consensus.cc:2468] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 18.
I20260709 12:25:47.293440 31908 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.605144 31926 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:47.587459 31675 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:47.588445 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:47.656245 25683 raft_consensus.cc:3060] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:25:47.590711 31871 consensus_meta.cc:287] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.523s	user 0.006s	sys 0.001s
I20260709 12:25:47.672211 31871 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:47.674290 31871 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:47.591183 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:47.592803 31895 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:47.593139 32009 log.cc:927] Time spent T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
I20260709 12:25:47.593398 31537 consensus_queue.cc:1048] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:25:47.413920 31983 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.421721 25678 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 14.
I20260709 12:25:47.684477 25680 raft_consensus.cc:1275] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 12:25:47.627251 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 395737us
I20260709 12:25:47.633289 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 22 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:47.586505 25677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40230 (request call id 1945) took 2198 ms. Trace:
I20260709 12:25:47.699654 25677 rpcz_store.cc:276] 0709 12:25:45.388448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:46.610333 (+1221885us) service_pool.cc:224] Handling call
0709 12:25:47.084816 (+474483us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b5800003698. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d96a3cb71 00007f5d96a3ca22 00007f5d9f9558d9 00007f5d9eaafee0 00007f5d9eb790ab 00007f5d9eb79131 00007f5d9eb3afc0 00007f5d9eb25929 00007f5d9eb253d2 00007f5d9809cbd4
0709 12:25:47.085026 (+   210us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:47.085272 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:47.085298 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:47.085756 (+   458us) log.cc:844] Serialized 26 byte log entry
0709 12:25:47.285223 (+199467us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:47.286053 (+   830us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:47.286144 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:47.433836 (+147692us) raft_consensus.cc:1685] finished
0709 12:25:47.433857 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:47.586434 (+152577us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44259712,"thread_start_us":199097,"threads_started":1,"wal-append.queue_time_us":346203}
I20260709 12:25:47.603981 31457 raft_consensus.cc:3060] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:25:47.657693 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 310196us
W20260709 12:25:47.723477 25650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:47.681282 25686 raft_consensus.cc:2468] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 16.
W20260709 12:25:47.702881 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:47.708566 25683 raft_consensus.cc:2468] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 17.
I20260709 12:25:47.721781 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:47.702364 25836 raft_consensus.cc:2376] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 22. Re-sending same reply.
I20260709 12:25:47.730196 25686 raft_consensus.cc:1275] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 12:25:47.734370 26401 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:47.734958 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:47.738518 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:47.739007 25831 raft_consensus.cc:1240] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 17. Current term is 18. Ops: []
W20260709 12:25:47.681752 31680 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.026s	sys 0.063s
W20260709 12:25:47.676847 31944 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.010s	sys 0.069s
W20260709 12:25:47.742347 26402 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.014s	sys 0.015s
I20260709 12:25:47.677336 31942 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:47.755038 26402 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.014s	sys 0.017s
W20260709 12:25:47.758138 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 533735us
I20260709 12:25:47.764074 31871 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:47.764240 31942 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:47.764779 31871 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:47.766873 31942 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:47.755052 32008 log.cc:927] Time spent T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
W20260709 12:25:47.754529 31944 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.011s	sys 0.070s
W20260709 12:25:47.752067 32016 log.cc:927] Time spent T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:25:47.676849 31908 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:47.785537 25835 raft_consensus.cc:1275] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:25:47.793937 31906 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:47.794953 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:47.795718 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:47.796779 25680 raft_consensus.cc:1240] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:47.809414 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:47.810595 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:47.796692 25829 raft_consensus.cc:1240] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 16. Current term is 17. Ops: []
W20260709 12:25:47.746668 31680 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.026s	sys 0.063s
I20260709 12:25:47.768131 31825 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:47.728781 31983 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:47.815577 25756 raft_consensus.cc:1275] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:25:47.815788 25758 raft_consensus.cc:1240] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 16. Current term is 18. Ops: []
I20260709 12:25:47.794308 31857 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:47.812983 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:47.800173 25760 raft_consensus.cc:1240] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:47.819497 25683 raft_consensus.cc:1275] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 12:25:47.813621 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 411307us
I20260709 12:25:47.815836 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:47.820637 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:47.825457 25686 raft_consensus.cc:1240] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:47.825619 25762 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:47.830809 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:47.831701 25683 raft_consensus.cc:2468] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 17.
I20260709 12:25:47.833349 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:47.833578 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:47.796834 31871 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:47.834215 25801 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:47.839308 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:47.835812 31825 consensus_queue.cc:1059] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.008s
I20260709 12:25:47.846499 31580 consensus_queue.cc:1059] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:25:47.850730 26432 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.017s	sys 0.017s
W20260709 12:25:47.851069 26432 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.017s	sys 0.017s
W20260709 12:25:47.851406 25801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:47.861408 25649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:47.862571 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
W20260709 12:25:47.841324 32021 log.cc:927] Time spent T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
W20260709 12:25:47.876506 25757 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.006s	sys 0.028s
W20260709 12:25:47.876816 25757 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.006s	sys 0.028s
I20260709 12:25:47.885012 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:47.885823 25758 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:25:47.838505 32012 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:47.856871 31636 raft_consensus.cc:2804] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:47.870597 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:47.867094 32014 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.896366 25801 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:47.836449 31848 consensus_queue.cc:1059] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.047s
I20260709 12:25:47.838641 32024 consensus_queue.cc:1059] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 12:25:47.900580 25762 raft_consensus.cc:1275] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 17 index: 7. Preceding OpId from leader: term: 18 index: 8. (index mismatch)
I20260709 12:25:47.875676 31895 consensus_queue.cc:1059] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 12:25:47.824851 31868 consensus_queue.cc:237] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:47.893409 31640 consensus_queue.cc:1048] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 12:25:47.900203 31636 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:47.942983 25801 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:47.875108 31857 consensus_queue.cc:1059] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 12:25:47.895105 32004 consensus_queue.cc:1048] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 12:25:47.869536 25649 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:47.973905 25801 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:47.900071 32012 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:47.975996 31636 raft_consensus.cc:3060] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:47.908641 31970 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:47.949544 32033 raft_consensus.cc:2804] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:48.000873 32033 raft_consensus.cc:697] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 16 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:48.001331 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:48.002172 25763 raft_consensus.cc:2468] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 17.
I20260709 12:25:48.001850 32033 consensus_queue.cc:237] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:48.004073 32011 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.952554 31580 consensus_queue.cc:1048] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:25:48.004573 32011 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:48.005847 31970 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:48.006881 31908 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:47.984298 26431 raft_consensus.cc:1275] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 12:25:48.017338 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 43547.4us
W20260709 12:25:48.020542 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 151112us
I20260709 12:25:47.909121 32014 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:47.962754 31921 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:47.989318 32020 log.cc:927] Time spent T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:25:47.989558 31895 raft_consensus.cc:2749] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:47.990542 31274 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.046267 31274 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:48.046844 32014 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:47.987244 31825 raft_consensus.cc:2749] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:25:48.049187 31274 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:48.049407 31972 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:48.052531 25682 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2796) took 2176 ms. Trace:
I20260709 12:25:48.052987 25682 rpcz_store.cc:276] 0709 12:25:45.876416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:46.791230 (+914814us) service_pool.cc:224] Handling call
0709 12:25:46.791631 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:47.267137 (+475506us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:48.052272 (+785135us) spinlock_profiling.cc:243] Waited 473 ms on lock 0x7b54003fe154. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:48.052462 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1087093632}
I20260709 12:25:48.021301 31983 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:48.020054 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:48.058132 26431 raft_consensus.cc:3060] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:47.983886 31892 raft_consensus.cc:2804] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:48.023995 32011 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:48.026082 31584 raft_consensus.cc:3055] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 16 LEADER]: Stepping down as leader of term 16
W20260709 12:25:48.026871 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 191663us
I20260709 12:25:47.976756 31675 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:48.021256 31640 consensus_queue.cc:1048] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:47.948129 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:48.035678 25649 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:48.083400 25800 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89
W20260709 12:25:48.049404 31928 consensus_meta.cc:287] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.980s	user 0.010s	sys 0.001s
I20260709 12:25:48.098927 31926 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:48.108304 25758 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 14.
W20260709 12:25:48.108162 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 72604.8us
I20260709 12:25:48.109377 25649 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:25:48.120713 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 361909us
I20260709 12:25:48.089646 31584 raft_consensus.cc:740] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:48.129514 25649 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:48.133066 26433 raft_consensus.cc:1240] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:48.104748 31892 raft_consensus.cc:697] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 17 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:48.137154 25649 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:48.137959 31908 raft_consensus.cc:2804] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:48.138358 31908 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:48.138698 31908 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:48.139477 25649 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:48.139750 31975 consensus_queue.cc:1059] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:48.140269 31860 raft_consensus.cc:2804] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:48.140389 25649 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:48.140802 31860 raft_consensus.cc:697] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 18 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:48.140903 31975 consensus_queue.cc:1048] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:48.141820 31860 consensus_queue.cc:237] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:48.143141 26431 raft_consensus.cc:2468] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 15.
I20260709 12:25:48.143549 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:48.121531 31970 raft_consensus.cc:2804] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:48.145402 31906 raft_consensus.cc:2804] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:48.145803 25682 raft_consensus.cc:1275] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:25:48.145638 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:25:48.116050 31853 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.004s	sys 0.011s
I20260709 12:25:48.146292 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:48.148152 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:48.134536 31895 raft_consensus.cc:2749] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:48.159606 25681 raft_consensus.cc:2410] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for term 18 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:25:48.162564 25762 raft_consensus.cc:1240] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 12. Current term is 13. Ops: []
W20260709 12:25:48.146106 32046 log.cc:927] Time spent T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:25:48.159822 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:48.178712 25682 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 14.
I20260709 12:25:48.122042 32039 raft_consensus.cc:2804] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:25:48.177827 31853 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.004s	sys 0.011s
I20260709 12:25:48.107666 31928 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:48.158337 31824 raft_consensus.cc:2804] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:48.157578 31970 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:48.173655 31906 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:48.192220 25681 raft_consensus.cc:1275] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 12:25:48.210963 25681 pending_rounds.cc:85] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc: Aborting all ops after (but not including) 12
I20260709 12:25:48.211236 25681 pending_rounds.cc:107] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 12:25:48.211496 25681 raft_consensus.cc:2889] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:25:48.196318 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 140440us
I20260709 12:25:48.196779 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:48.212805 26431 raft_consensus.cc:2393] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 17: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:48.199391 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:48.201803 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:48.132709 31457 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:48.172503 32030 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.238476 25726 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:48.238658 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:48.158140 31842 consensus_queue.cc:1048] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:25:48.213680 26438 raft_consensus.cc:2410] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 17 because replica has last-logged OpId of term: 15 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 14.
I20260709 12:25:48.213550 26434 raft_consensus.cc:3060] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:48.180634 32039 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:48.244050 26431 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 18.
I20260709 12:25:48.244310 26439 raft_consensus.cc:2393] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 14: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:48.244443 32039 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:25:48.244979 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:48.188118 31824 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:48.191001 31933 raft_consensus.cc:3055] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:48.245707 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:48.210597 31970 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:48.251401 31928 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:48.251577 25757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48606 (request call id 1560) took 1058 ms. Trace:
I20260709 12:25:48.257191 32034 raft_consensus.cc:3055] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:48.247581 31912 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:48.263054 26430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 1494) took 1024 ms. Trace:
I20260709 12:25:48.248814 31933 raft_consensus.cc:740] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:48.264112 31892 consensus_queue.cc:237] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:48.264768 26436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 1495) took 1025 ms. Trace:
I20260709 12:25:48.214226 31906 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:48.300776 31912 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:48.309019 26434 raft_consensus.cc:2468] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 15.
I20260709 12:25:48.249671 26438 raft_consensus.cc:2468] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 13.
W20260709 12:25:48.289438 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 161131us
I20260709 12:25:48.313760 31911 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.314478 31911 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:48.314961 31457 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:48.316128 31944 consensus_queue.cc:1048] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:48.284909 26430 rpcz_store.cc:276] 0709 12:25:47.238248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:47.238427 (+   179us) service_pool.cc:224] Handling call
0709 12:25:47.238770 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:47.640532 (+401762us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:47.640591 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:47.652625 (+ 12034us) log.cc:844] Serialized 26 byte log entry
0709 12:25:47.872857 (+220232us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:25:47.873255 (+   398us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:47.873325 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:48.262830 (+389505us) raft_consensus.cc:1685] finished
0709 12:25:48.262852 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:48.262988 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54350,"raft.queue_time_us":364266,"raft.run_cpu_time_us":57,"raft.run_wall_time_us":57,"thread_start_us":566714,"threads_started":2,"wal-append.queue_time_us":484033}
W20260709 12:25:48.316576 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 172269us
I20260709 12:25:48.282335 25757 rpcz_store.cc:276] 0709 12:25:47.193516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:47.204739 (+ 11223us) service_pool.cc:224] Handling call
0709 12:25:47.205100 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:47.205433 (+   333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:47.205460 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:47.205946 (+   486us) log.cc:844] Serialized 26 byte log entry
0709 12:25:47.877110 (+671164us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:47.877151 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:47.877215 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:48.251353 (+374138us) raft_consensus.cc:1685] finished
0709 12:25:48.251378 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:48.251513 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1213,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":10678,"thread_start_us":670809,"threads_started":1,"wal-append.queue_time_us":951694}
I20260709 12:25:48.248474 31824 raft_consensus.cc:3060] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:48.292434 26436 rpcz_store.cc:276] 0709 12:25:47.239728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:47.240009 (+   281us) service_pool.cc:224] Handling call
0709 12:25:47.240272 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:47.240473 (+   201us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:25:47.686991 (+446518us) log.cc:844] Serialized 14 byte log entry
0709 12:25:47.905193 (+218202us) log.cc:844] Serialized 14 byte log entry
0709 12:25:47.968443 (+ 63250us) log.cc:844] Serialized 14 byte log entry
0709 12:25:48.264403 (+295960us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:48.264460 (+    57us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:48.264514 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:48.264583 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:48.264711 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":654795,"prepare.queue_time_us":730257,"prepare.run_cpu_time_us":153,"prepare.run_wall_time_us":155,"raft.queue_time_us":353813,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":8014,"spinlock_wait_cycles":4848000,"thread_start_us":617059,"threads_started":2,"wal-append.queue_time_us":289059}
I20260709 12:25:48.284574 32034 raft_consensus.cc:740] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:48.265640 26437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 1502) took 1004 ms. Trace:
I20260709 12:25:48.247925 32030 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:48.322608 26437 rpcz_store.cc:276] 0709 12:25:47.261029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:47.280822 (+ 19793us) service_pool.cc:224] Handling call
0709 12:25:47.281150 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:47.281352 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:25:47.867192 (+585840us) log.cc:844] Serialized 14 byte log entry
0709 12:25:48.263793 (+396601us) spinlock_profiling.cc:243] Waited 6.06 ms on lock 0x7b1800132be0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d969eec0a 00007f5da012e219 00007f5d96a76a40 00007f5d96a714e4 00007f5d96a71455 00007f5d99b59060 00007f5d99b6b716 00007f5d99b7c287 00007f5d99b7c208
0709 12:25:48.265275 (+  1482us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:48.265340 (+    65us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:25:48.265385 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:48.265451 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:48.265574 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83251,"prepare.queue_time_us":680830,"prepare.run_cpu_time_us":93,"prepare.run_wall_time_us":3547,"raft.queue_time_us":307932,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":103,"spinlock_wait_cycles":13935360,"thread_start_us":555595,"threads_started":2,"wal-append.queue_time_us":176437}
I20260709 12:25:48.324429 32030 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:48.284736 31776 consensus_meta.cc:287] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.651s	user 0.011s	sys 0.000s
I20260709 12:25:48.266093 31895 consensus_queue.cc:1059] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 12:25:48.210356 31584 consensus_queue.cc:260] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:48.326185 31584 raft_consensus.cc:3060] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:48.292294 25679 raft_consensus.cc:1240] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:48.329599 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:48.330463 25761 raft_consensus.cc:2410] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 12:25:48.332378 31911 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:48.332795 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:48.333418 25761 raft_consensus.cc:2468] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 14.
I20260709 12:25:48.292412 32029 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.347867 25832 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:25:48.352063 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 172060us
W20260709 12:25:48.362749 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 203590us
W20260709 12:25:48.372591 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 59361us
I20260709 12:25:48.373345 26402 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:48.308099 31908 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:48.352180 31911 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:48.358897 31457 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.385885 26402 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:48.358928 31926 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:48.393915 25682 raft_consensus.cc:1240] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 18. Current term is 19. Ops: []
W20260709 12:25:48.391865 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 72699.6us
I20260709 12:25:48.342119 32039 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:48.396332 25800 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:48.402716 26432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 1504) took 1141 ms. Trace:
I20260709 12:25:48.403160 26432 rpcz_store.cc:276] 0709 12:25:47.261574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:47.267301 (+  5727us) service_pool.cc:224] Handling call
0709 12:25:47.267556 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:47.267780 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:25:47.851374 (+583594us) log.cc:844] Serialized 14 byte log entry
0709 12:25:48.349210 (+497836us) log.cc:844] Serialized 14 byte log entry
0709 12:25:48.379853 (+ 30643us) log.cc:844] Serialized 14 byte log entry
0709 12:25:48.402390 (+ 22537us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:48.402453 (+    63us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:25:48.402500 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:48.402563 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:48.402664 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":264315,"prepare.queue_time_us":606917,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":3700,"raft.queue_time_us":229014,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":10352,"spinlock_wait_cycles":43791488,"thread_start_us":826176,"threads_started":2,"wal-append.queue_time_us":488405}
I20260709 12:25:48.409588 31912 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:48.392990 31911 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:48.412397 31911 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:48.390555 31860 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.412838 26433 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 1496) took 1172 ms. Trace:
I20260709 12:25:48.413144 31860 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:48.413298 26433 rpcz_store.cc:276] 0709 12:25:47.240742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:47.240881 (+   139us) service_pool.cc:224] Handling call
0709 12:25:47.284137 (+ 43256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:48.135199 (+851062us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:48.412590 (+277391us) spinlock_profiling.cc:243] Waited 849 ms on lock 0x7b5400746154. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:48.412774 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1951901568}
I20260709 12:25:48.352805 32029 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:48.377233 32024 consensus_queue.cc:1048] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 12:25:48.395232 31457 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:48.424712 31908 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 19 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:48.425949 31457 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:48.407749 31848 raft_consensus.cc:2804] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:48.438405 31848 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
W20260709 12:25:48.438732 32060 log.cc:927] Time spent T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:25:48.438935 31848 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:48.394922 32063 consensus_queue.cc:1048] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 12:25:48.382292 32062 consensus_queue.cc:1059] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:25:48.419469 31928 raft_consensus.cc:2804] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:48.432991 26402 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:48.443053 32034 consensus_queue.cc:260] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:48.379940 31933 consensus_queue.cc:260] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:48.464445 26402 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
W20260709 12:25:48.471148 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 66975.7us
I20260709 12:25:48.472483 25832 raft_consensus.cc:2468] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 18.
I20260709 12:25:48.485309 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:48.486392 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:48.484650 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:25:48.535573 25650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:48.433758 31866 raft_consensus.cc:2804] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:48.536279 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:25:48.537145 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:48.538154 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:48.542495 25761 raft_consensus.cc:3060] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:48.543110 26436 raft_consensus.cc:1275] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:25:48.540738 26433 raft_consensus.cc:1275] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:25:48.462199 31824 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:48.447391 31880 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:48.534258 26401 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:48.418579 31636 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:48.485646 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:48.491056 25760 raft_consensus.cc:1275] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:25:48.549023 31983 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.465920 32039 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 21 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:48.613994 31983 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:48.615960 31636 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:48.616405 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:48.617787 31983 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:48.618062 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:48.619040 26432 raft_consensus.cc:2468] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 12.
I20260709 12:25:48.619769 31824 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:48.464728 32027 raft_consensus.cc:2804] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:25:48.620800 32027 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:48.600109 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:48.632694 32029 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349)
I20260709 12:25:48.541754 32030 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.633600 32030 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:48.449445 31911 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.537017 32034 raft_consensus.cc:3060] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:48.604794 26433 raft_consensus.cc:1240] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:25:48.601452 32036 raft_consensus.cc:2764] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:25:48.657047 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:48.621160 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:48.469002 31906 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:48.683604 31906 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:48.552245 32048 raft_consensus.cc:2804] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:48.626309 32012 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:48.687763 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:25:48.629315 25832 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44202 (request call id 3335) took 2114 ms (client timeout 2107 ms). Trace:
I20260709 12:25:48.629598 31970 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:48.598582 25650 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:48.637965 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:48.690109 26430 raft_consensus.cc:2468] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 16.
I20260709 12:25:48.639107 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:48.639278 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:48.638707 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:48.447296 31926 consensus_queue.cc:1059] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.149s
I20260709 12:25:48.638453 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:48.597672 31868 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.610093 25761 raft_consensus.cc:2468] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 15.
I20260709 12:25:48.601775 31776 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:48.623169 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:48.662878 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:48.697890 26433 raft_consensus.cc:3060] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:48.667423 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:48.669046 31848 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:48.671942 31866 raft_consensus.cc:697] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 14 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:48.651391 31911 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:48.715903 25834 raft_consensus.cc:1240] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:25:48.672719 32030 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:48.642076 32027 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:25:48.678649 25680 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 18.
I20260709 12:25:48.686650 32048 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:48.684679 25678 raft_consensus.cc:1240] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 12:25:48.661408 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:48.687542 25686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2812) took 1039 ms. Trace:
I20260709 12:25:48.721217 25686 rpcz_store.cc:276] 0709 12:25:47.648666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:47.743387 (+ 94721us) service_pool.cc:224] Handling call
0709 12:25:47.743733 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:47.825857 (+ 82124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:48.687301 (+861444us) spinlock_profiling.cc:243] Waited 81.5 ms on lock 0x7b54002661d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:48.687465 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":187556096}
I20260709 12:25:48.626120 31974 consensus_queue.cc:260] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:48.700495 31868 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:48.727339 31868 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:48.727849 32062 consensus_queue.cc:1059] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:48.728461 31866 consensus_queue.cc:237] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:48.730861 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:48.731621 25828 raft_consensus.cc:2393] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 15: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:48.732393 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:48.732935 25828 raft_consensus.cc:2468] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 16.
I20260709 12:25:48.733160 31848 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:48.734754 31970 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:48.688330 25832 rpcz_store.cc:269] 0709 12:25:46.514459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:46.521228 (+  6769us) service_pool.cc:224] Handling call
0709 12:25:48.629109 (+2107881us) spinlock_profiling.cc:243] Waited 1.83 s on lock 0x7b54001b1054. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:48.629218 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4198734720}
I20260709 12:25:48.688830 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:48.696398 31906 raft_consensus.cc:3060] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:48.719116 31857 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.699155 25833 raft_consensus.cc:2468] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 16.
I20260709 12:25:48.704934 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:48.706265 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:48.707262 25830 raft_consensus.cc:1240] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 17. Current term is 18. Ops: []
W20260709 12:25:48.712251 26402 connection.cc:256] RPC call timeout handler was delayed by -1.0609600430002502s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17450000000000002s for a response
I20260709 12:25:48.713856 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:48.715106 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:48.681272 32079 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.718369 25761 raft_consensus.cc:1275] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:25:48.725411 32077 consensus_queue.cc:1048] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
W20260709 12:25:48.691743 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 93974us
I20260709 12:25:48.692044 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:48.736027 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:48.695627 25831 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 18.
I20260709 12:25:48.696025 31972 consensus_queue.cc:1048] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 12:25:48.748629 25836 raft_consensus.cc:2410] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 12:25:48.749009 31911 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:48.716956 31776 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:48.751686 31857 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:48.736479 31872 raft_consensus.cc:3055] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:48.763121 25650 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:48.723352 32048 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:48.780978 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:48.794493 26402 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:48.796116 25831 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 22.
W20260709 12:25:48.774115 32070 log.cc:927] Time spent T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:25:48.797425 25650 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:48.798179 26402 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:48.800740 25650 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:48.719521 31537 consensus_queue.cc:1048] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.074s
I20260709 12:25:48.804844 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:48.802991 25650 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:48.787209 31895 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:48.793869 31872 raft_consensus.cc:740] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:48.811583 26433 raft_consensus.cc:2468] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 16.
I20260709 12:25:48.810206 25650 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:48.802086 31911 raft_consensus.cc:2804] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:25:48.774616 32079 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:48.799980 32036 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:48.805645 31537 consensus_queue.cc:1243] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer f82778701b464892aab92a752ed7ffdc log is divergent from this leader: its last log entry 13.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:25:48.807933 25800 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:48.804191 31884 raft_consensus.cc:2804] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:48.803859 31880 raft_consensus.cc:2749] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:48.800159 32014 consensus_queue.cc:1048] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.014s
I20260709 12:25:48.812588 31824 raft_consensus.cc:2804] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:48.807210 31904 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:48.807485 32072 raft_consensus.cc:2804] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:48.818763 31911 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:48.814917 32010 raft_consensus.cc:2749] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:25:48.831488 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 107117us
I20260709 12:25:48.818730 32030 raft_consensus.cc:2804] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:25:48.823865 32071 log.cc:927] Time spent T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:25:48.824355 31884 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:48.812846 31895 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:48.828994 31824 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:48.854691 32072 raft_consensus.cc:697] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 15 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:48.881116 32072 consensus_queue.cc:237] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:48.888545 32082 log.cc:927] Time spent T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 12:25:48.852373 31911 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:48.852213 32030 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:48.858147 31884 raft_consensus.cc:3060] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:48.824039 32036 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:48.893524 31824 raft_consensus.cc:3060] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:48.849681 31904 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:48.964499 31904 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:48.965512 26439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36508 (request call id 1507) took 1113 ms. Trace:
I20260709 12:25:48.966041 26439 rpcz_store.cc:276] 0709 12:25:47.852274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:47.852784 (+   510us) service_pool.cc:224] Handling call
0709 12:25:48.965219 (+1112435us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b540012f554. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:48.965394 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":779318144}
I20260709 12:25:48.968859 32079 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:48.970659 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:48.858640 31457 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.940768 25837 raft_consensus.cc:2468] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 17.
I20260709 12:25:48.935734 32030 raft_consensus.cc:3060] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:48.941963 32077 consensus_queue.cc:1059] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:48.947232 31944 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:48.951458 32027 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:48.952339 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 127314us
W20260709 12:25:48.955037 32076 log.cc:927] Time spent T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.284s	user 0.002s	sys 0.000s
I20260709 12:25:48.995080 25682 raft_consensus.cc:1240] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
W20260709 12:25:48.960608 32086 log.cc:927] Time spent T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 12:25:48.910559 32091 raft_consensus.cc:2804] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:25:48.987406 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 748982us
W20260709 12:25:48.987532 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 135076us
W20260709 12:25:48.986680 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 160111us
I20260709 12:25:48.992511 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:48.992769 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:48.958773 32023 raft_consensus.cc:3055] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:48.995896 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:49.006527 26436 raft_consensus.cc:2468] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 16.
I20260709 12:25:49.009388 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:48.910104 31872 consensus_queue.cc:260] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:49.023181 25685 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 18.
I20260709 12:25:48.980895 32039 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:49.030797 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:49.009682 31554 raft_consensus.cc:2749] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:49.021656 31921 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:49.034134 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:49.035740 25761 raft_consensus.cc:2393] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 14: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:49.036175 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:49.027575 25726 leader_election.cc:400] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237) with higher term. Message: Invalid argument: T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 13. Current term is 14.
I20260709 12:25:49.020818 32011 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:49.162148 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
W20260709 12:25:49.163668 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 110914us
I20260709 12:25:49.021874 32023 raft_consensus.cc:740] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:48.987056 31457 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:49.033532 25754 raft_consensus.cc:1240] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 15. Current term is 16. Ops: []
W20260709 12:25:49.052702 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:49.045475 26402 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:25:49.173077 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 127668us
W20260709 12:25:49.173349 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:49.174319 26402 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:49.035210 31675 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:49.179576 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:49.172344 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:49.055022 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:49.184443 26402 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:49.189947 26401 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:49.165055 31872 raft_consensus.cc:3060] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:49.162999 31880 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:48.996837 31944 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:49.047428 32014 consensus_queue.cc:1059] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:25:49.049566 31584 consensus_queue.cc:1048] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.117s
I20260709 12:25:49.167657 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:49.263787 25835 raft_consensus.cc:2468] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 12.
I20260709 12:25:49.194736 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:49.161744 32062 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:49.055483 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:25:49.177143 32005 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.998s	user 0.021s	sys 0.063s
I20260709 12:25:49.055823 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:49.200124 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:49.196441 26402 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:49.260282 25726 leader_election.cc:403] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:49.260596 25684 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:49.229584 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:49.054162 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:49.261412 25686 raft_consensus.cc:2468] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 16.
I20260709 12:25:49.184531 31983 raft_consensus.cc:2804] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:49.186594 32010 raft_consensus.cc:2749] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:49.268146 25763 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 22.
I20260709 12:25:49.198218 32029 raft_consensus.cc:2749] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:49.038838 32091 raft_consensus.cc:697] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 15 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
W20260709 12:25:49.288446 32005 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.109s	user 0.022s	sys 0.064s
I20260709 12:25:49.168968 32098 consensus_queue.cc:1059] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.208s
I20260709 12:25:49.195588 32028 raft_consensus.cc:2749] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:25:49.309405 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 281961us
I20260709 12:25:49.357013 25726 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:49.175166 32011 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:49.300822 31983 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:49.184134 32033 consensus_queue.cc:1059] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.117s
I20260709 12:25:49.323753 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:49.192287 32034 consensus_queue.cc:1059] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.115s
I20260709 12:25:49.257627 31776 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:49.262879 32102 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
W20260709 12:25:49.361008 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:49.189229 31675 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:49.050987 32013 consensus_queue.cc:1048] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.318s
I20260709 12:25:49.357004 32037 raft_consensus.cc:3055] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:49.379015 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
W20260709 12:25:49.360040 32045 log.cc:927] Time spent T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:25:49.359694 32029 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:49.264973 31880 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:49.197238 31921 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:49.375793 25760 raft_consensus.cc:2393] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 16: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:49.438239 25683 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
mode: GRACEFUL
new_leader_uuid: "a866ff967d964388a6f0dff7fd43df89"
 from {username='slave'} at 127.0.0.1:49108
I20260709 12:25:49.439070 25683 raft_consensus.cc:606] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Received request to transfer leadership to TS a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:49.439153 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:49.439577 25683 raft_consensus.cc:614] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:49.402877 25756 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:49.440937 25760 raft_consensus.cc:2393] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 14: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:49.443655 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:49.402905 32037 raft_consensus.cc:740] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:49.448585 32037 consensus_queue.cc:260] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:49.449548 32037 raft_consensus.cc:3060] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:49.452776 31906 consensus_meta.cc:287] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.705s	user 0.005s	sys 0.004s
I20260709 12:25:49.453230 31906 raft_consensus.cc:2749] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:49.453769 31921 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:49.400683 32036 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:49.374514 32023 consensus_queue.cc:260] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:49.455363 32023 raft_consensus.cc:3060] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:49.402487 31776 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:49.460269 31776 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:49.444056 32029 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:49.465785 32029 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:49.459666 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 19 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:49.468945 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:49.469915 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:49.470253 31457 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:49.425642 31895 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:49.471386 25684 raft_consensus.cc:2468] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 15.
I20260709 12:25:49.471746 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:49.473868 32011 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:49.474449 32011 raft_consensus.cc:2749] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:49.462926 31776 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:49.476293 32017 log.cc:927] Time spent T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 1.632s	user 0.000s	sys 0.004s
I20260709 12:25:49.477778 31908 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:49.478369 31908 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:49.483450 31911 consensus_meta.cc:287] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.542s	user 0.001s	sys 0.006s
I20260709 12:25:49.485867 31944 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:49.445030 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:49.487749 25760 raft_consensus.cc:2410] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 21 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 12:25:49.472576 25759 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:25:49.488148 25649 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
W20260709 12:25:49.491717 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:49.054394 32039 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:49.323393 31554 raft_consensus.cc:2749] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237) with higher term. Message: Invalid argument: T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 13. Current term is 14.
I20260709 12:25:49.304458 32062 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:49.374250 31983 raft_consensus.cc:3060] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:25:49.495281 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 298868us
I20260709 12:25:49.509347 25756 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 17.
I20260709 12:25:49.494530 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:49.536523 25760 raft_consensus.cc:2393] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 16: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:49.532325 26402 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:49.557961 26401 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:25:49.562083 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:49.573189 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 215614us
I20260709 12:25:49.574925 25726 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:49.578382 25649 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:49.496263 32034 raft_consensus.cc:2804] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:25:49.490628 32027 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 24 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:49.586992 25831 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 19.
I20260709 12:25:49.512590 31457 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:49.531826 32107 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:49.597751 25726 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:49.483876 31911 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:49.624313 32013 raft_consensus.cc:2804] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:49.624845 32013 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:49.625278 32013 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:49.625478 31911 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 20 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:49.510291 31776 raft_consensus.cc:3060] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:49.633525 32062 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:49.495471 32036 raft_consensus.cc:3055] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:25:49.635537 31928 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:49.576615 32095 raft_consensus.cc:3055] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:25:49.602720 25726 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:49.636333 31928 raft_consensus.cc:3060] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:49.636468 32095 raft_consensus.cc:740] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:49.636997 25726 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:49.637444 32095 consensus_queue.cc:260] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:49.582363 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:49.609342 32012 raft_consensus.cc:2804] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:49.638803 32095 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:49.638833 32012 raft_consensus.cc:697] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 17 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:49.574569 32029 raft_consensus.cc:2749] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:49.639864 32023 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:49.639993 32012 consensus_queue.cc:237] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:49.593766 31554 raft_consensus.cc:2804] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:25:49.640512 32023 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:49.641261 31554 raft_consensus.cc:697] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:49.642123 31554 consensus_queue.cc:237] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 21.18, Last appended by leader: 18, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:49.642604 32023 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:49.584403 32034 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:49.645970 32042 log.cc:927] Time spent T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.982s	user 0.000s	sys 0.005s
I20260709 12:25:49.646292 32034 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:25:49.647964 26436 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36518 (request call id 1209) took 1043 ms. Trace:
I20260709 12:25:49.636106 32036 raft_consensus.cc:740] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:49.648368 26436 rpcz_store.cc:276] 0709 12:25:48.605285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:48.616089 (+ 10804us) service_pool.cc:224] Handling call
0709 12:25:49.647782 (+1031693us) spinlock_profiling.cc:243] Waited 360 ms on lock 0x7b54006f4854. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:49.647886 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":828843264}
I20260709 12:25:49.649035 32036 consensus_queue.cc:260] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:49.650118 31884 consensus_meta.cc:287] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.710s	user 0.006s	sys 0.003s
I20260709 12:25:49.650162 32036 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:49.650664 31884 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:49.617477 32106 consensus_queue.cc:1048] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 12:25:49.653050 32106 raft_consensus.cc:2804] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:49.653355 31860 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:49.654187 25683 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
mode: GRACEFUL
new_leader_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:49108
I20260709 12:25:49.654743 25683 raft_consensus.cc:606] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 20 LEADER]: Received request to transfer leadership to TS 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:49.593525 31904 raft_consensus.cc:3060] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:49.619971 31457 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:49.660143 31983 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:49.662209 31457 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:49.620563 25757 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 3076) took 1080 ms. Trace:
I20260709 12:25:49.621807 31880 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:49.622506 32010 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:49.663264 32010 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:49.662806 25757 rpcz_store.cc:276] 0709 12:25:48.539846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:48.540023 (+   177us) service_pool.cc:224] Handling call
0709 12:25:48.540335 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:49.008268 (+467933us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:49.008297 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:49.021201 (+ 12904us) log.cc:844] Serialized 26 byte log entry
0709 12:25:49.364481 (+343280us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:49.364539 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:49.364631 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:49.620335 (+255704us) raft_consensus.cc:1685] finished
0709 12:25:49.620359 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:49.620504 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":467579,"raft.queue_time_us":472948,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":7594,"thread_start_us":312671,"threads_started":1,"wal-append.queue_time_us":560506}
I20260709 12:25:49.664906 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:49.665699 32010 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:49.666153 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 20 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:49.401503 32102 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:49.623009 32107 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:49.666923 26435 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 1498) took 2407 ms. Trace:
I20260709 12:25:49.667305 26435 rpcz_store.cc:276] 0709 12:25:47.259822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:47.263271 (+  3449us) service_pool.cc:224] Handling call
0709 12:25:47.263606 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:47.758792 (+495186us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:25:48.186783 (+427991us) log.cc:844] Serialized 14 byte log entry
0709 12:25:48.417878 (+231095us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:48.418376 (+   498us) log.cc:844] Serialized 26 byte log entry
0709 12:25:48.418511 (+   135us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:48.418556 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:48.418640 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:49.642602 (+1223962us) spinlock_profiling.cc:243] Waited 5.54 ms on lock 0x7b1800334b40. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d96a743f3 00007f5d96a767c1 00007f5d96a76779 00007f5d96a76709 00007f5d96a766d1 00007f5d96a759cd 0000000000388634 0000000000388479 00007f5d96a5783a
0709 12:25:49.666619 (+ 24017us) raft_consensus.cc:1685] finished
0709 12:25:49.666725 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:49.666837 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30458,"prepare.queue_time_us":211330,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":363564,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":2102,"spinlock_wait_cycles":12750208,"thread_start_us":1002966,"threads_started":3,"wal-append.queue_time_us":179283}
I20260709 12:25:49.668771 32107 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:49.669445 32107 raft_consensus.cc:3060] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:49.669987 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:25:49.672127 25726 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:49.672438 32039 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:49.579982 32091 consensus_queue.cc:237] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:49.673725 25726 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:49.674909 25726 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
W20260709 12:25:49.675905 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:49.617122 31921 consensus_queue.cc:1059] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 12:25:49.653403 32106 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:49.662441 32063 raft_consensus.cc:3055] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:25:49.617072 31824 consensus_meta.cc:287] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.652s	user 0.007s	sys 0.004s
I20260709 12:25:49.685204 25757 raft_consensus.cc:2410] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 20 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 12:25:49.688540 25759 raft_consensus.cc:2468] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 21.
I20260709 12:25:49.742705 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:49.706807 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:49.691112 25755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 3078) took 1004 ms. Trace:
I20260709 12:25:49.745262 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 19 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:49.745644 25755 rpcz_store.cc:276] 0709 12:25:48.686466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:48.686611 (+   145us) service_pool.cc:224] Handling call
0709 12:25:48.695514 (+  8903us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:49.321558 (+626044us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:49.321607 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:49.339079 (+ 17472us) log.cc:844] Serialized 52 byte log entry
0709 12:25:49.690642 (+351563us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:49.690696 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:49.690777 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:49.690834 (+    57us) raft_consensus.cc:1685] finished
0709 12:25:49.690852 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:49.691041 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":317791,"raft.queue_time_us":331321,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":3754,"thread_start_us":582509,"threads_started":2,"wal-append.queue_time_us":238550}
I20260709 12:25:49.706362 25649 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:49.750810 26436 raft_consensus.cc:1240] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:25:49.752305 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:49.763577 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:49.764503 25758 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.012s	sys 0.011s
W20260709 12:25:49.765172 25758 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.012s	sys 0.011s
W20260709 12:25:49.768153 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 61914.2us
W20260709 12:25:49.689152 32072 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.000s	sys 0.015s
I20260709 12:25:49.773293 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:49.769767 31680 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:49.779480 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:49.780287 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:49.780474 25833 raft_consensus.cc:2468] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 18.
I20260709 12:25:49.780911 26439 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 18.
I20260709 12:25:49.780303 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:49.782819 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:49.783377 25833 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:25:49.740273 32106 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:49.704321 32063 raft_consensus.cc:740] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:49.662230 31983 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349)
W20260709 12:25:49.794929 25801 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.007s	sys 0.018s
W20260709 12:25:49.775043 32072 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.000s	sys 0.016s
W20260709 12:25:49.795991 25801 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.008s	sys 0.018s
W20260709 12:25:49.821098 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 656565us
I20260709 12:25:49.797446 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:49.798108 25828 raft_consensus.cc:1275] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 12:25:49.771104 32039 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:49.817493 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:49.775233 31880 raft_consensus.cc:2804] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Leader election won for term 21
W20260709 12:25:49.791749 25762 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.814s	user 0.020s	sys 0.018s
W20260709 12:25:49.791735 32048 consensus_meta.cc:287] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.988s	user 0.009s	sys 0.002s
W20260709 12:25:49.861529 25762 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.884s	user 0.025s	sys 0.020s
I20260709 12:25:49.862881 26402 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:49.865952 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
W20260709 12:25:49.815099 32030 consensus_meta.cc:287] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.826s	user 0.007s	sys 0.004s
I20260709 12:25:49.763741 31824 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:49.873737 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 43618us
I20260709 12:25:49.862946 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:49.820900 25803 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.000s	sys 0.026s
I20260709 12:25:49.780817 31457 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:49.785830 32023 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:49.880800 26402 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:25:49.870963 25800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:49.914459 25803 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.000s	sys 0.029s
I20260709 12:25:49.924576 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 20 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:49.927176 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:49.928104 25756 raft_consensus.cc:2393] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 14: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:49.933945 32103 consensus_queue.cc:1059] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:25:49.936074 32005 raft_consensus.cc:3055] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:49.936503 32005 raft_consensus.cc:740] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:49.937357 25833 raft_consensus.cc:2468] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 21.
I20260709 12:25:49.937453 32005 consensus_queue.cc:260] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:49.939093 32005 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:49.944312 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:49.945159 25832 raft_consensus.cc:2393] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 18: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:49.948516 31857 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:49.963269 32109 log.cc:927] Time spent T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.490s	user 0.000s	sys 0.003s
I20260709 12:25:49.967069 31974 raft_consensus.cc:3060] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:49.969615 32119 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:49.970322 32119 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:49.881253 31860 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:49.971592 31860 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:49.973965 32011 raft_consensus.cc:2749] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:25:49.975181 31860 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:49.974205 31908 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:49.998942 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:50.007463 25832 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 10.
I20260709 12:25:50.008061 26434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 1507) took 1805 ms. Trace:
I20260709 12:25:50.015280 26434 rpcz_store.cc:276] 0709 12:25:48.202917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:48.311974 (+109057us) service_pool.cc:224] Handling call
0709 12:25:48.312424 (+   450us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:48.372491 (+ 60067us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:48.372523 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:48.377499 (+  4976us) log.cc:844] Serialized 52 byte log entry
0709 12:25:48.765806 (+388307us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:25:48.799039 (+ 33233us) log.cc:844] Serialized 14 byte log entry
0709 12:25:48.799367 (+   328us) log.cc:844] Serialized 14 byte log entry
0709 12:25:48.799527 (+   160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:48.799597 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:48.961964 (+162367us) spinlock_profiling.cc:243] Waited 3.9 ms on lock 0x7b1800130780. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d969eec0a 00007f5da012e219 00007f5d9ea8a328 00007f5d9ea81901 00007f5d9ea818a7 00007f5d9eb79288 00007f5d9eb78f37 00007f5d9eb8d55c 00007f5d9eb8d508
0709 12:25:49.644998 (+683034us) spinlock_profiling.cc:243] Waited 2.05 ms on lock 0x7b1800130780. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d96a74522 00007f5d96a767c1 00007f5d96a76779 00007f5d96a76709 00007f5d96a766d1 00007f5d96a759cd 0000000000388634 0000000000388479 00007f5d96a5783a
0709 12:25:49.957711 (+312713us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b1800130780. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d96a743f3 00007f5d96a767c1 00007f5d96a76779 00007f5d96a76709 00007f5d96a766d1 00007f5d96a759cd 0000000000388634 0000000000388479 00007f5d96a5783a
0709 12:25:50.007584 (+ 49873us) raft_consensus.cc:1685] finished
0709 12:25:50.007629 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:50.007812 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78069,"prepare.queue_time_us":879579,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":64,"raft.queue_time_us":63147,"raft.run_cpu_time_us":3974,"raft.run_wall_time_us":167930,"spinlock_wait_cycles":16527744,"thread_start_us":373034,"threads_started":1,"wal-append.queue_time_us":432599}
I20260709 12:25:49.886844 31880 raft_consensus.cc:697] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 21 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:50.029152 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:49.879669 32014 consensus_queue.cc:1059] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.136s
I20260709 12:25:49.792203 31680 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:50.055732 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:50.056540 25832 raft_consensus.cc:2376] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 18. Re-sending same reply.
I20260709 12:25:50.044427 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:50.059834 25756 raft_consensus.cc:2468] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 16.
W20260709 12:25:50.031216 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:50.063755 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 388886us
I20260709 12:25:50.064888 25726 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:50.068341 25726 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:50.077970 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:49.878101 32126 raft_consensus.cc:2749] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:25:49.883096 32039 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:49.834332 31983 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:49.999044 32090 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:49.999264 31970 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.028s	sys 0.044s
I20260709 12:25:49.925336 32072 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:50.078898 25684 raft_consensus.cc:2468] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 18.
I20260709 12:25:50.079947 26434 raft_consensus.cc:1240] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 24 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 23. Current term is 24. Ops: []
I20260709 12:25:50.081949 25678 pending_rounds.cc:85] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc: Aborting all ops after (but not including) 11
I20260709 12:25:50.108343 25678 pending_rounds.cc:107] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 12:25:50.108698 25678 raft_consensus.cc:2889] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:50.082834 25682 raft_consensus.cc:1275] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:25:50.001199 32023 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:49.919106 32030 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:50.034082 31675 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:50.091027 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:25:50.103353 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:50.105060 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:50.063175 31884 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:50.144095 26439 raft_consensus.cc:2393] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 18: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:50.070796 31554 raft_consensus.cc:2749] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:49.977276 31457 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:50.113603 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:50.122727 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:50.133201 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:50.134361 32102 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:50.136737 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:50.137121 32121 raft_consensus.cc:2804] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:50.137730 32118 raft_consensus.cc:2804] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:25:50.140538 31776 consensus_meta.cc:287] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.507s	user 0.009s	sys 0.000s
I20260709 12:25:50.106158 25679 raft_consensus.cc:1240] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 14. Current term is 15. Ops: []
W20260709 12:25:50.106719 31970 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.028s	sys 0.044s
W20260709 12:25:50.164709 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:50.177223 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:50.113082 32014 raft_consensus.cc:3055] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:25:50.196278 31872 consensus_meta.cc:287] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.942s	user 0.011s	sys 0.001s
I20260709 12:25:50.201081 26432 raft_consensus.cc:1275] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:25:49.889410 32048 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:50.204972 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:50.136816 32030 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:50.223775 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:50.225294 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:50.225394 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:50.186718 31675 raft_consensus.cc:3060] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:50.235535 25679 raft_consensus.cc:2393] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 20: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:50.237511 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:50.238260 25832 raft_consensus.cc:3060] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:50.238996 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:50.240547 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:50.257757 32136 raft_consensus.cc:2804] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:50.033545 32063 consensus_queue.cc:260] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:50.123857 31983 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:50.199688 32118 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:50.141187 32072 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:50.189944 32121 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
W20260709 12:25:50.280763 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 44732.5us
W20260709 12:25:50.226665 31975 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.723s	user 0.029s	sys 0.050s
I20260709 12:25:50.226599 31554 consensus_queue.cc:1059] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 12:25:50.197012 32062 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:50.279383 32048 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:50.293380 32128 log.cc:927] Time spent T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
W20260709 12:25:50.293896 32124 log.cc:927] Time spent T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 12:25:50.297205 32116 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:50.297784 32116 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:50.189013 31880 consensus_queue.cc:237] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:50.300153 32062 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:50.303750 32023 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:50.304000 25762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48606 (request call id 1566) took 2099 ms. Trace:
I20260709 12:25:50.304394 25762 rpcz_store.cc:276] 0709 12:25:48.204648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:48.204814 (+   166us) service_pool.cc:224] Handling call
0709 12:25:48.205242 (+   428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:48.976309 (+771067us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:48.976361 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:48.976975 (+   614us) log.cc:844] Serialized 26 byte log entry
0709 12:25:49.879283 (+902308us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:49.879346 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:49.879615 (+   269us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:50.302514 (+422899us) raft_consensus.cc:1685] finished
0709 12:25:50.302534 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:50.303884 (+  1350us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":771968,"raft.queue_time_us":774562,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":31688,"thread_start_us":901827,"threads_started":1,"wal-append.queue_time_us":1093262}
I20260709 12:25:50.306120 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:50.307487 25801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:50.308462 31824 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:50.309585 32101 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.042s	sys 0.042s
W20260709 12:25:50.309686 25680 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40230 (request call id 1989) took 2161 ms (client timeout 1627 ms). Trace:
W20260709 12:25:50.310103 32101 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.043s	sys 0.042s
W20260709 12:25:50.310150 25680 rpcz_store.cc:269] 0709 12:25:48.147809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:48.147936 (+   127us) service_pool.cc:224] Handling call
0709 12:25:50.309516 (+2161580us) spinlock_profiling.cc:243] Waited 506 ms on lock 0x7b54001b6cd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:50.309621 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1162780032}
W20260709 12:25:50.313491 32036 consensus_meta.cc:287] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.663s	user 0.007s	sys 0.003s
I20260709 12:25:50.314299 26430 raft_consensus.cc:2468] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 18.
I20260709 12:25:50.314865 25758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48606 (request call id 1567) took 2103 ms. Trace:
W20260709 12:25:50.316059 31904 consensus_meta.cc:287] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.660s	user 0.003s	sys 0.006s
I20260709 12:25:50.315213 25758 rpcz_store.cc:276] 0709 12:25:48.211255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:48.211417 (+   162us) service_pool.cc:224] Handling call
0709 12:25:48.245671 (+ 34254us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:48.980297 (+734626us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:48.980331 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:49.021477 (+ 41146us) log.cc:844] Serialized 26 byte log entry
0709 12:25:49.766002 (+744525us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:25:49.766064 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:49.766169 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:50.314658 (+548489us) raft_consensus.cc:1685] finished
0709 12:25:50.314677 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:50.314809 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":734252,"raft.queue_time_us":741932,"spinlock_wait_cycles":17034624,"thread_start_us":715264,"threads_started":1,"wal-append.queue_time_us":1204012}
I20260709 12:25:50.316437 31904 raft_consensus.cc:2749] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:50.316943 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:50.317394 32037 consensus_meta.cc:287] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.867s	user 0.013s	sys 0.000s
I20260709 12:25:50.317570 25758 raft_consensus.cc:2468] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 17.
I20260709 12:25:50.318159 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:50.319399 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:50.319952 25836 raft_consensus.cc:2468] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 13.
I20260709 12:25:50.321123 26434 raft_consensus.cc:1275] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:25:50.321367 25836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44202 (request call id 3350) took 1266 ms. Trace:
I20260709 12:25:50.321715 25836 rpcz_store.cc:276] 0709 12:25:49.054709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:49.054806 (+    97us) service_pool.cc:224] Handling call
0709 12:25:50.321217 (+1266411us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54002f6554. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:50.321315 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2613564672}
I20260709 12:25:50.322538 26434 raft_consensus.cc:1240] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:50.322927 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:50.324983 31580 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.325546 31580 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:50.326915 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:50.327239 25800 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:50.328233 32088 raft_consensus.cc:2804] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:50.328299 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:50.328701 32088 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:50.329119 32088 raft_consensus.cc:3060] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:25:50.330542 32104 log.cc:927] Time spent T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.946s	user 0.004s	sys 0.000s
W20260709 12:25:50.335896 32097 log.cc:927] Time spent T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 1.142s	user 0.000s	sys 0.002s
I20260709 12:25:50.336130 32039 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:50.339721 32034 consensus_meta.cc:287] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.693s	user 0.003s	sys 0.006s
I20260709 12:25:50.340181 32034 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:50.341684 25582 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52974 (request call id 257) took 39821 ms (client timeout 15000 ms). Trace:
I20260709 12:25:50.221236 31776 raft_consensus.cc:2749] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:50.273211 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:50.219468 32014 raft_consensus.cc:740] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:50.259096 26439 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 19.
I20260709 12:25:50.275898 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:50.277063 25761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48606 (request call id 1581) took 1096 ms. Trace:
W20260709 12:25:50.288338 31975 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.030s	sys 0.051s
I20260709 12:25:50.112916 32090 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:50.281239 32136 raft_consensus.cc:697] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 15 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:50.377512 31942 raft_consensus.cc:3055] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:50.344215 32063 raft_consensus.cc:3060] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:50.346352 31457 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:50.344260 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:25:50.350507 25582 rpcz_store.cc:269] 0709 12:25:10.520616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:10.520878 (+   262us) service_pool.cc:224] Handling call
0709 12:25:11.098498 (+577620us) spinlock_profiling.cc:243] Waited 452 ms on lock 0x7b5400078854. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99acb090 00007f5d99b69f3a 00007f5d9f91fe9c 00007f5d9fa1e04e 00007f5d9dedf2a4 00007f5d9dedf232 00007f5d9dedf161 00007f5d9dedf0dc 00007f5d9dede392 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:50.341596 (+39243098us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:42.924580 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:43.016403 (+ 91823us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:43.016455 (+    52us) write_op.cc:435] Acquired schema lock
0709 12:25:43.016487 (+    32us) tablet.cc:662] Decoding operations
0709 12:25:43.017750 (+  1263us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:43.017842 (+    92us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:43.017872 (+    30us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:25:43.377601 (+359729us) tablet.cc:701] Row locks acquired
0709 12:25:43.377647 (+    46us) write_op.cc:260] PREPARE: finished
0709 12:25:43.377830 (+   183us) write_op.cc:270] Start()
0709 12:25:43.377983 (+   153us) write_op.cc:276] Timestamp: P: 1783599943377767 usec, L: 0
0709 12:25:43.378024 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 12:25:43.487287 (+109263us) log.cc:844] Serialized 5236 byte log entry
0709 12:25:44.001619 (+514332us) op_driver.cc:464] REPLICATION: finished
0709 12:25:44.152453 (+150834us) write_op.cc:301] APPLY: starting
0709 12:25:44.160192 (+  7739us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:44.306025 (+145833us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:44.306138 (+   113us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:45.306999 (+1000861us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:45.307502 (+   503us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 12:25:45.307582 (+    80us) write_op.cc:312] APPLY: finished
0709 12:25:45.360284 (+ 52702us) log.cc:844] Serialized 121 byte log entry
0709 12:25:45.516639 (+156355us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:45.581778 (+ 65139us) write_op.cc:454] Released schema lock
0709 12:25:45.603531 (+ 21753us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:45.633245 (+ 29714us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:45.633275 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6858260,"reported_tablets":42,"spinlock_wait_cycles":1039191808,"child_traces":[["op",{"apply.queue_time_us":78274,"apply.run_cpu_time_us":39184,"apply.run_wall_time_us":1520252,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58467,"num_ops":13,"prepare.queue_time_us":220331,"prepare.run_cpu_time_us":17749,"prepare.run_wall_time_us":796834,"raft.queue_time_us":79434,"raft.run_cpu_time_us":8317,"raft.run_wall_time_us":25530,"replication_time_us":623316,"spinlock_wait_cycles":2304,"thread_start_us":349867,"threads_started":5,"wal-append.queue_time_us":333072,"wal-append.run_cpu_time_us":11953,"wal-append.run_wall_time_us":2293313}]]}
I20260709 12:25:50.311854 25680 raft_consensus.cc:1275] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:25:50.354259 25832 raft_consensus.cc:2468] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 17.
I20260709 12:25:50.354902 25833 raft_consensus.cc:2393] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 18: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:50.287492 32121 raft_consensus.cc:3060] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:50.343039 32034 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 23 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:50.356104 25761 rpcz_store.cc:276] 0709 12:25:49.181084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:50.258193 (+1077109us) service_pool.cc:224] Handling call
0709 12:25:50.276596 (+ 18403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:50.276763 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:50.276788 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:50.276827 (+    39us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:25:50.276857 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:50.276904 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:50.277001 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:50.234571 32012 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
W20260709 12:25:50.269656 25763 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.000s	sys 0.033s
W20260709 12:25:50.426826 25763 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.830s	user 0.000s	sys 0.033s
I20260709 12:25:50.222646 31972 consensus_queue.cc:1059] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.059s
I20260709 12:25:50.284847 32118 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:50.407186 32117 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.378057 32136 consensus_queue.cc:237] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:50.379976 32095 consensus_meta.cc:287] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.740s	user 0.010s	sys 0.000s
I20260709 12:25:50.409881 25679 raft_consensus.cc:1240] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 18. Current term is 19. Ops: [18.8-18.8]
I20260709 12:25:50.430199 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:50.433020 25833 raft_consensus.cc:1240] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 17. Current term is 18. Ops: []
I20260709 12:25:50.432782 25763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48606 (request call id 1580) took 1262 ms. Trace:
I20260709 12:25:50.378113 31942 raft_consensus.cc:740] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:50.441985 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:50.458304 25761 raft_consensus.cc:2468] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 16.
W20260709 12:25:50.431663 32106 consensus_meta.cc:287] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.569s	user 0.008s	sys 0.001s
I20260709 12:25:50.383610 32116 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:50.452509 25763 rpcz_store.cc:276] 0709 12:25:49.170633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:49.305414 (+134781us) service_pool.cc:224] Handling call
0709 12:25:49.305726 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:49.305921 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:25:49.596584 (+290663us) log.cc:844] Serialized 14 byte log entry
0709 12:25:50.432342 (+835758us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:50.432413 (+    71us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:25:50.432464 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:50.432557 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:50.432710 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45829,"prepare.queue_time_us":312225,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":24,"raft.queue_time_us":11729,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":95,"thread_start_us":1050349,"threads_started":2}
I20260709 12:25:50.456406 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:50.457593 25679 raft_consensus.cc:1275] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:25:50.458981 25829 raft_consensus.cc:2410] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 18 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
W20260709 12:25:50.450764 32013 consensus_meta.cc:287] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.823s	user 0.012s	sys 0.000s
I20260709 12:25:50.472822 25763 raft_consensus.cc:1240] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:25:50.473529 25763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 3465) took 1164 ms. Trace:
I20260709 12:25:50.474354 25763 rpcz_store.cc:276] 0709 12:25:49.309289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:50.467988 (+1158699us) service_pool.cc:224] Handling call
0709 12:25:50.468414 (+   426us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:50.473248 (+  4834us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:50.473481 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:50.476747 25763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 3474) took 1092 ms. Trace:
I20260709 12:25:50.477334 25763 rpcz_store.cc:276] 0709 12:25:49.384218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:50.475756 (+1091538us) service_pool.cc:224] Handling call
0709 12:25:50.476146 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:50.476361 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:50.476395 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:50.476450 (+    55us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:50.476494 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:50.476564 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:50.476682 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:50.480475 25763 raft_consensus.cc:1240] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:50.481019 25763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 3482) took 1034 ms. Trace:
I20260709 12:25:50.482529 25800 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
W20260709 12:25:50.474821 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 356703us
W20260709 12:25:50.486296 26402 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:50.489210 25726 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:50.481313 25763 rpcz_store.cc:276] 0709 12:25:49.446723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:50.480041 (+1033318us) service_pool.cc:224] Handling call
0709 12:25:50.480309 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:50.480822 (+   513us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:50.480973 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:50.491588 26402 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:50.522636 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:50.523954 25726 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
W20260709 12:25:50.481611 31921 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.022s	sys 0.035s
I20260709 12:25:50.477736 31972 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.526887 26402 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:50.434666 32012 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:50.524464 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:50.564318 25832 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:25:50.520512 32042 log.cc:927] Time spent T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:25:50.547827 25726 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:50.531167 25761 raft_consensus.cc:1275] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 9. (index mismatch)
I20260709 12:25:50.478128 32013 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:50.573704 32140 log.cc:927] Time spent T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:25:50.574954 32148 consensus_queue.cc:1048] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:25:50.575363 32013 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:50.576330 32148 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:50.577270 32148 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:50.565467 32141 raft_consensus.cc:2749] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:50.547295 31983 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:50.530261 32137 raft_consensus.cc:2804] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:50.477108 32106 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:50.580107 32148 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:50.526183 31921 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.755s	user 0.023s	sys 0.036s
I20260709 12:25:50.566051 31972 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:50.582211 25726 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:50.582723 32137 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:50.572947 25761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 3479) took 1127 ms. Trace:
I20260709 12:25:50.583666 25761 rpcz_store.cc:276] 0709 12:25:49.445840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:50.479234 (+1033394us) service_pool.cc:224] Handling call
0709 12:25:50.526553 (+ 47319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:50.572699 (+ 46146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:50.572894 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:50.584923 25761 raft_consensus.cc:3055] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:50.585227 25761 raft_consensus.cc:740] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:50.585958 25761 consensus_queue.cc:260] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:50.587018 25761 raft_consensus.cc:3060] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:50.583201 32137 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:50.582111 32106 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:50.518386 31884 raft_consensus.cc:2749] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:50.590286 25726 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:50.592862 25757 raft_consensus.cc:1275] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:25:50.450229 32117 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:50.529907 32134 raft_consensus.cc:2749] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:25:50.607008 25760 raft_consensus.cc:2393] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 19: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:50.518939 32090 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:50.608654 25757 raft_consensus.cc:1240] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:50.583045 31921 raft_consensus.cc:2749] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:25:50.589478 32029 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:50.596647 32107 consensus_meta.cc:287] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.927s	user 0.011s	sys 0.000s
I20260709 12:25:50.453414 32014 consensus_queue.cc:260] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:50.639650 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:50.616526 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:50.642864 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:50.685464 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:50.628156 25726 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:50.651660 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:25:50.611896 32144 log.cc:927] Time spent T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 12:25:50.661000 25800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:50.693275 25800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:50.571331 31872 raft_consensus.cc:2804] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:25:50.699159 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 71098.3us
I20260709 12:25:50.525264 31457 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:50.598482 32133 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.613353 32106 raft_consensus.cc:2804] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:50.599825 31972 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:50.651118 31554 raft_consensus.cc:2749] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:50.704653 25726 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:50.706791 25832 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 23.
I20260709 12:25:50.708532 25762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 3086) took 1510 ms. Trace:
I20260709 12:25:50.695509 32107 raft_consensus.cc:2749] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:50.705416 32106 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:50.703573 32134 raft_consensus.cc:2749] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:50.724376 25832 raft_consensus.cc:1240] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:25:50.713443 25762 rpcz_store.cc:276] 0709 12:25:49.197724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:50.307013 (+1109289us) service_pool.cc:224] Handling call
0709 12:25:50.307274 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:50.307462 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:25:50.325623 (+ 18161us) log.cc:844] Serialized 14 byte log entry
0709 12:25:50.702307 (+376684us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:50.702358 (+    51us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:25:50.702400 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:50.702504 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:50.708458 (+  5954us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":17719,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":708,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":2878,"thread_start_us":375546,"threads_started":1}
I20260709 12:25:50.722736 26402 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:50.726804 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:50.727993 25762 raft_consensus.cc:2393] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 17: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:50.678539 32029 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:50.739094 25755 raft_consensus.cc:2468] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 17.
W20260709 12:25:50.596400 32126 consensus_queue.cc:1175] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f82778701b464892aab92a752ed7ffdc" responder_term: 16 status { last_received { term: 13 index: 8 } last_committed_idx: 8 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:25:50.741223 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:50.710502 31457 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:50.709770 32013 consensus_queue.cc:1048] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 12:25:50.750864 31933 raft_consensus.cc:3060] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:50.757807 32029 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:50.762667 31680 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:50.764585 32146 log.cc:927] Time spent T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
W20260709 12:25:50.764567 31675 consensus_meta.cc:287] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.506s	user 0.007s	sys 0.004s
I20260709 12:25:50.719452 32148 raft_consensus.cc:2749] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:50.765726 31675 raft_consensus.cc:2749] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:50.737625 32106 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:25:50.768769 32093 log.cc:927] Time spent T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 1.788s	user 0.005s	sys 0.000s
I20260709 12:25:50.775465 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:50.776822 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:50.777849 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:50.778371 26433 raft_consensus.cc:2468] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 16.
I20260709 12:25:50.779193 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:50.785591 32034 raft_consensus.cc:2804] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:25:50.786485 32034 raft_consensus.cc:697] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 23 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:50.787194 32088 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:50.788305 32142 log.cc:927] Time spent T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.335s	user 0.000s	sys 0.000s
I20260709 12:25:50.787993 32034 consensus_queue.cc:237] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 21.18, Last appended by leader: 18, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:50.789625 25836 raft_consensus.cc:2468] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 14.
W20260709 12:25:50.790410 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 48749.2us
I20260709 12:25:50.791371 32026 consensus_queue.cc:1059] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:25:50.832111 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:50.792857 31457 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:50.794286 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:50.797124 32117 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:50.800499 32072 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:50.801646 32012 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:50.710752 31872 raft_consensus.cc:697] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 17 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:50.709787 32133 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:50.848968 31872 consensus_queue.cc:237] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 15.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:50.817129 25762 raft_consensus.cc:1275] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 12:25:50.779206 25831 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44202 (request call id 3348) took 1725 ms (client timeout 1504 ms). Trace:
W20260709 12:25:50.852382 25831 rpcz_store.cc:269] 0709 12:25:49.054112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:49.055255 (+  1143us) service_pool.cc:224] Handling call
0709 12:25:50.778994 (+1723739us) spinlock_profiling.cc:243] Waited 320 ms on lock 0x7b54002c15d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:50.779123 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":734994816}
I20260709 12:25:50.853763 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:50.820052 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:50.854897 25835 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 17.
I20260709 12:25:50.856267 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:50.775552 25801 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
W20260709 12:25:50.858294 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 82862.2us
I20260709 12:25:50.859314 25801 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:50.863091 31975 raft_consensus.cc:2749] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:25:50.862311 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:50.864434 25831 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:50.865324 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:50.866110 25835 raft_consensus.cc:1240] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 17. Current term is 18. Ops: [17.15-17.15]
I20260709 12:25:50.847649 32062 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:50.836795 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 371930us
I20260709 12:25:50.840317 26435 raft_consensus.cc:2393] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 17: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:50.873690 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:50.874578 25678 raft_consensus.cc:2468] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 17.
I20260709 12:25:50.851399 32029 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.875532 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:50.881141 26436 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:50.888255 25801 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:50.892604 25801 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
W20260709 12:25:50.887053 25726 connection.cc:256] RPC call timeout handler was delayed by -2.7042503769998802s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16870000000000002s for a response
I20260709 12:25:50.898227 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:50.878043 32133 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:25:50.895561 25726 connection.cc:256] RPC call timeout handler was delayed by -2.3303264800001671s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2042s for a response
W20260709 12:25:50.910934 25726 connection.cc:256] RPC call timeout handler was delayed by -2.2425503770000432s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22000000000000003s for a response
I20260709 12:25:50.913166 32088 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:50.907764 25801 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:25:50.912040 25726 connection.cc:256] RPC call timeout handler was delayed by -2.1090029910001249s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2062s for a response
I20260709 12:25:50.896621 31975 raft_consensus.cc:2749] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:25:50.925990 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:50.931284 25678 raft_consensus.cc:2368] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 18. Current term is 19.
W20260709 12:25:50.929412 25726 connection.cc:256] RPC call timeout handler was delayed by -1.4387786749998668s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2755s for a response
I20260709 12:25:50.896481 32062 raft_consensus.cc:2749] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:25:50.932071 25726 connection.cc:256] RPC call timeout handler was delayed by -1.2552790459999414s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1627s for a response
I20260709 12:25:50.943536 25726 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:50.934651 26436 raft_consensus.cc:2468] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 17.
I20260709 12:25:50.940030 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:50.946085 25684 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 19.
I20260709 12:25:50.948333 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:50.877404 32137 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:50.984769 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:50.886195 32029 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:51.015789 32162 log.cc:927] Time spent T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:25:51.011554 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:51.016799 25678 raft_consensus.cc:2468] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 16.
W20260709 12:25:51.015877 32156 log.cc:927] Time spent T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:25:51.020612 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:50.906499 32063 consensus_queue.cc:1048] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.107s
W20260709 12:25:51.032013 32105 log.cc:927] Time spent T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 1.545s	user 0.001s	sys 0.012s
W20260709 12:25:51.036371 32139 log.cc:927] Time spent T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.753s	user 0.003s	sys 0.000s
I20260709 12:25:51.037101 25649 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:51.040844 25801 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:51.043375 31942 consensus_queue.cc:260] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:51.044687 31942 raft_consensus.cc:3060] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:51.048286 32079 raft_consensus.cc:3055] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:25:51.048770 32079 raft_consensus.cc:740] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:51.049798 32079 consensus_queue.cc:260] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.8, Last appended by leader: 8, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:51.051156 32079 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:25:51.061246 26402 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:51.061285 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 109276us
I20260709 12:25:51.062391 25726 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:51.063194 26433 raft_consensus.cc:1240] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 15 LEADER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:50.894852 32106 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:50.929105 32026 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.951189 32126 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:51.011332 31680 raft_consensus.cc:2749] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:51.010850 26436 raft_consensus.cc:1240] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 24 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 23. Current term is 24. Ops: []
W20260709 12:25:51.143391 32163 log.cc:927] Time spent T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 12:25:51.061439 32141 consensus_queue.cc:1048] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.021s
I20260709 12:25:51.249897 31933 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:51.061472 32101 consensus_queue.cc:1048] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260709 12:25:51.148594 32028 raft_consensus.cc:3055] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:51.067438 32088 raft_consensus.cc:2804] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:25:51.080149 31675 raft_consensus.cc:2749] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:25:51.229193 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:51.102974 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:51.191252 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:51.192772 25686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2823) took 1114 ms. Trace:
W20260709 12:25:51.264396 25651 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:51.262728 25686 rpcz_store.cc:276] 0709 12:25:50.077861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:50.077979 (+   118us) service_pool.cc:224] Handling call
0709 12:25:50.078299 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:50.078527 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:25:50.370475 (+291948us) log.cc:844] Serialized 14 byte log entry
0709 12:25:50.825199 (+454724us) log.cc:844] Serialized 14 byte log entry
0709 12:25:51.191803 (+366604us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b180033b380. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d969eec0a 00007f5da012e219 00007f5d96a76a40 00007f5d96a714e4 00007f5d96a71455 00007f5d99b59060 00007f5d99b6b716 00007f5d99b7c287 00007f5d99b7c208
0709 12:25:51.192200 (+   397us) log.cc:844] Serialized 14 byte log entry
0709 12:25:51.192367 (+   167us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:51.192410 (+    43us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:25:51.192467 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:51.192532 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:51.192703 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":359723,"prepare.queue_time_us":539106,"prepare.run_cpu_time_us":124,"prepare.run_wall_time_us":128,"raft.queue_time_us":383152,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":15397,"spinlock_wait_cycles":34632832,"thread_start_us":692665,"threads_started":2,"wal-append.queue_time_us":549660}
I20260709 12:25:51.265750 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:51.266498 25686 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:51.191963 32137 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:51.153090 26401 connection.cc:256] RPC call timeout handler was delayed by -1.1909167179996984s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1564s for a response
I20260709 12:25:51.178102 25759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 3089) took 1302 ms. Trace:
I20260709 12:25:51.074843 32026 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:51.149498 26430 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36510 (request call id 1518) took 1397 ms. Trace:
I20260709 12:25:51.237483 31636 raft_consensus.cc:2749] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:25:51.189384 25760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53474 (request call id 3487) took 1419 ms. Trace:
I20260709 12:25:51.284166 25760 rpcz_store.cc:276] 0709 12:25:49.769625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:49.930141 (+160516us) service_pool.cc:224] Handling call
0709 12:25:51.189102 (+1258961us) spinlock_profiling.cc:243] Waited 556 ms on lock 0x7b54001e7654. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:51.189303 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1279810304}
I20260709 12:25:51.277710 26430 rpcz_store.cc:276] 0709 12:25:49.751734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:49.752002 (+   268us) service_pool.cc:224] Handling call
0709 12:25:51.149311 (+1397309us) spinlock_profiling.cc:243] Waited 561 ms on lock 0x7b5400474854. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:51.149429 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1290478464}
I20260709 12:25:51.276813 25759 rpcz_store.cc:276] 0709 12:25:49.875962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:50.590610 (+714648us) service_pool.cc:224] Handling call
0709 12:25:50.591067 (+   457us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:50.607787 (+ 16720us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:50.607838 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:50.690178 (+ 82340us) log.cc:844] Serialized 26 byte log entry
0709 12:25:51.083495 (+393317us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:51.083538 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:51.083606 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:51.177816 (+ 94210us) raft_consensus.cc:1685] finished
0709 12:25:51.177845 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:51.178018 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16266,"raft.queue_time_us":23891,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":7315,"thread_start_us":365791,"threads_started":1,"wal-append.queue_time_us":467127}
I20260709 12:25:51.289846 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:51.084807 32121 consensus_meta.cc:287] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.651s	user 0.012s	sys 0.000s
I20260709 12:25:51.170159 26433 raft_consensus.cc:1275] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:25:51.210556 25831 raft_consensus.cc:2468] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 17.
I20260709 12:25:51.256219 31880 raft_consensus.cc:2804] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:51.076710 32126 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:51.068593 32062 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:51.209242 32072 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:51.245283 25834 raft_consensus.cc:2468] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 16.
I20260709 12:25:51.191175 31580 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:51.276716 32029 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:51.012537 25684 raft_consensus.cc:2468] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 18.
I20260709 12:25:51.077086 25726 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:51.246745 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:25:51.256791 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:51.262148 25828 raft_consensus.cc:2393] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 17: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
W20260709 12:25:51.066797 31928 consensus_meta.cc:287] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 1.430s	user 0.023s	sys 0.000s
I20260709 12:25:51.267638 25833 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:25:51.192436 32118 consensus_meta.cc:287] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.746s	user 0.010s	sys 0.002s
I20260709 12:25:51.279166 31584 consensus_queue.cc:1059] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.017s
I20260709 12:25:51.285064 32027 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:51.296909 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:51.341917 25760 raft_consensus.cc:3060] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:51.342257 26438 raft_consensus.cc:1240] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 23 LEADER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 22. Current term is 23. Ops: []
I20260709 12:25:51.083299 31972 consensus_queue.cc:1059] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 12:25:51.069862 32134 consensus_queue.cc:1048] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.207s
W20260709 12:25:51.301337 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 202812us
I20260709 12:25:51.266203 32088 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:51.304841 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:51.307065 25831 raft_consensus.cc:1240] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 23 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 22. Current term is 23. Ops: []
I20260709 12:25:51.267731 32028 raft_consensus.cc:740] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
W20260709 12:25:51.358022 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 327716us
I20260709 12:25:51.277771 31884 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:51.259999 31933 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:51.299188 32068 raft_consensus.cc:2764] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:25:51.323267 25759 raft_consensus.cc:2468] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 18.
I20260709 12:25:51.301047 31880 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:51.336797 25686 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 19.
I20260709 12:25:51.307855 32121 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:51.305624 32106 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:51.343523 25762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 3093) took 1397 ms. Trace:
I20260709 12:25:51.305929 32048 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:51.362241 31972 consensus_queue.cc:1243] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer a866ff967d964388a6f0dff7fd43df89 log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:25:51.390635 32048 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:51.351406 32027 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:51.392123 32026 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:51.392782 32048 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:51.392951 26436 raft_consensus.cc:2468] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 13.
I20260709 12:25:51.305804 32114 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:51.349753 26401 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:51.394093 32027 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:51.394321 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 44712.2us
I20260709 12:25:51.309952 32103 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:51.310918 32005 raft_consensus.cc:3055] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:25:51.356907 25680 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2837) took 1075 ms. Trace:
I20260709 12:25:51.397838 25680 rpcz_store.cc:276] 0709 12:25:50.281994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:50.441197 (+159203us) service_pool.cc:224] Handling call
0709 12:25:50.441468 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:50.441673 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:25:50.838877 (+397204us) log.cc:844] Serialized 14 byte log entry
0709 12:25:51.356506 (+517629us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:51.356562 (+    56us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:51.356620 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:51.356701 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:51.356839 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64816,"prepare.queue_time_us":368233,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":154845,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":5068,"spinlock_wait_cycles":23726336,"thread_start_us":835867,"threads_started":3,"wal-append.queue_time_us":447590}
I20260709 12:25:51.361232 25831 raft_consensus.cc:1240] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:51.072279 32063 consensus_queue.cc:1048] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 12:25:51.405702 25760 raft_consensus.cc:2468] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 18.
I20260709 12:25:51.360780 25683 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2821) took 1284 ms. Trace:
I20260709 12:25:51.406661 25683 rpcz_store.cc:276] 0709 12:25:50.076122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:50.076283 (+   161us) service_pool.cc:224] Handling call
0709 12:25:50.076626 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:50.076990 (+   364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:50.077017 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:50.090086 (+ 13069us) log.cc:844] Serialized 26 byte log entry
0709 12:25:50.478056 (+387970us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:25:50.839081 (+361025us) log.cc:844] Serialized 14 byte log entry
0709 12:25:51.360470 (+521389us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:51.360545 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:51.360600 (+    55us) raft_consensus.cc:1685] finished
0709 12:25:51.360610 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:51.360727 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":353914,"prepare.queue_time_us":332091,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":368512,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":42757,"thread_start_us":762271,"threads_started":3,"wal-append.queue_time_us":592236}
W20260709 12:25:51.343227 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 266201us
I20260709 12:25:51.310096 32062 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:51.352687 31675 raft_consensus.cc:2749] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:51.372219 25762 rpcz_store.cc:276] 0709 12:25:49.946306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:50.851157 (+904851us) service_pool.cc:224] Handling call
0709 12:25:50.851582 (+   425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:50.851872 (+   290us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:25:51.208345 (+356473us) log.cc:844] Serialized 14 byte log entry
0709 12:25:51.343077 (+134732us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:51.343147 (+    70us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:25:51.343205 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:51.343288 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:51.343454 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14791,"prepare.queue_time_us":448392,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":2096,"raft.queue_time_us":20232,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":2330,"thread_start_us":466372,"threads_started":2}
I20260709 12:25:51.356942 32088 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:51.311815 32072 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:51.394702 32027 raft_consensus.cc:2804] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:51.404461 32005 raft_consensus.cc:740] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:51.410802 32103 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:51.366834 31884 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:51.381316 32126 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:51.381685 32014 raft_consensus.cc:3060] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:51.385439 25837 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41782 (request call id 1305) took 2006 ms. Trace:
I20260709 12:25:51.387120 32121 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:51.387595 25756 raft_consensus.cc:1240] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:51.444669 25836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44202 (request call id 3370) took 1164 ms. Trace:
I20260709 12:25:51.341218 32118 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:51.389807 26432 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 1513) took 1312 ms. Trace:
I20260709 12:25:51.452826 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:51.452960 26432 rpcz_store.cc:276] 0709 12:25:50.077184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:50.077306 (+   122us) service_pool.cc:224] Handling call
0709 12:25:50.077574 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:50.226294 (+148720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:51.389578 (+1163284us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b54006f54d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:51.389746 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":257574272}
I20260709 12:25:51.453817 26431 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 1516) took 1368 ms. Trace:
I20260709 12:25:51.454051 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:51.454288 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:51.455055 26432 raft_consensus.cc:2468] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 17.
I20260709 12:25:51.452272 25836 rpcz_store.cc:276] 0709 12:25:50.280418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:50.328032 (+ 47614us) service_pool.cc:224] Handling call
0709 12:25:51.444481 (+1116449us) spinlock_profiling.cc:243] Waited 460 ms on lock 0x7b5400086454. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:51.444600 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1058990976}
I20260709 12:25:51.393945 32114 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:51.356357 31872 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:51.400763 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:51.462365 26435 raft_consensus.cc:2468] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 16.
I20260709 12:25:51.401681 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:51.358938 25649 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:25:51.450085 32168 log.cc:927] Time spent T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
W20260709 12:25:51.404105 25800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:51.470306 25800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:51.409260 25726 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:51.324978 31928 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:51.412401 25762 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 3094) took 1125 ms. Trace:
I20260709 12:25:51.477463 25762 rpcz_store.cc:276] 0709 12:25:50.287523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:51.411318 (+1123795us) service_pool.cc:224] Handling call
0709 12:25:51.411720 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:51.411973 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:51.412015 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:51.412074 (+    59us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:25:51.412118 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:51.412193 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:51.412327 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:51.413491 32166 log.cc:927] Time spent T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:25:51.415127 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:51.480652 26433 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:25:51.480742 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 71604.9us
I20260709 12:25:51.370169 31880 raft_consensus.cc:3060] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:51.417742 25801 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:51.420012 31580 consensus_queue.cc:1048] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:25:51.423291 32062 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:51.413506 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:51.358304 32034 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:51.442531 25763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 3483) took 1864 ms. Trace:
I20260709 12:25:51.457928 26432 raft_consensus.cc:1240] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 24 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 23. Current term is 24. Ops: []
W20260709 12:25:51.443272 25755 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53474 (request call id 3486) took 1755 ms (client timeout 1949 ms). Trace:
W20260709 12:25:51.487753 25755 rpcz_store.cc:269] 0709 12:25:49.687450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:49.816592 (+129142us) service_pool.cc:224] Handling call
0709 12:25:51.443086 (+1626494us) spinlock_profiling.cc:243] Waited 890 ms on lock 0x7b54001dabd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:51.443211 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2048003968}
I20260709 12:25:51.487012 25763 rpcz_store.cc:276] 0709 12:25:49.577688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:50.525438 (+947750us) service_pool.cc:224] Handling call
0709 12:25:50.527871 (+  2433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:51.441156 (+913285us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:25:51.441194 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:51.441233 (+    39us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:51.441263 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:51.442301 (+  1038us) spinlock_profiling.cc:243] Waited 913 ms on lock 0x7b54000a9e54. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:51.442343 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:51.442462 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10115,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":7222,"spinlock_wait_cycles":2099620224}
I20260709 12:25:51.489115 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:51.489961 25755 raft_consensus.cc:2393] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 13: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:51.454300 26431 rpcz_store.cc:276] 0709 12:25:50.085285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:50.085600 (+   315us) service_pool.cc:224] Handling call
0709 12:25:50.085900 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:50.086108 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:25:50.128721 (+ 42613us) log.cc:844] Serialized 14 byte log entry
0709 12:25:51.283730 (+1155009us) spinlock_profiling.cc:243] Waited 3.03 ms on lock 0x7b1800118d20. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d96a56e07 00007f5d9f8b19a9 00007f5d96a7369b 00007f5d96a7193f 00007f5d96a73c02 00007f5d996fb20b 00007f5d99700d23 00007f5d9970123a 00007f5d99b6ba2a
0709 12:25:51.453375 (+169645us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:51.453459 (+    84us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:25:51.453520 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:51.453605 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:51.453750 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":40615,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"spinlock_wait_cycles":6978944,"thread_start_us":169352,"threads_started":1}
I20260709 12:25:51.459357 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:51.450682 25837 rpcz_store.cc:276] 0709 12:25:49.378575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:49.378752 (+   177us) service_pool.cc:224] Handling call
0709 12:25:49.379905 (+  1153us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:49.419702 (+ 39797us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:49.419748 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:50.850913 (+1431165us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b2c00105e78. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9845aa11 00007f5d9846a372 00007f5d99b9ca01 00007f5d99b6143a 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2
0709 12:25:50.866742 (+ 15829us) log.cc:844] Serialized 26 byte log entry
0709 12:25:51.223185 (+356443us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:25:51.223240 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:51.223343 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:51.385153 (+161810us) raft_consensus.cc:1685] finished
0709 12:25:51.385172 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:51.385380 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39323,"raft.queue_time_us":179995,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":14906,"spinlock_wait_cycles":39101824,"thread_start_us":338332,"threads_started":1,"wal-append.queue_time_us":446387}
I20260709 12:25:51.491799 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:25:51.464633 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 105836us
I20260709 12:25:51.362356 25832 raft_consensus.cc:1240] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:25:51.492547 26434 raft_consensus.cc:1240] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:51.478631 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:51.435976 31933 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:51.477178 32039 raft_consensus.cc:2749] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:51.482183 25726 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
W20260709 12:25:51.485603 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 67942.3us
I20260709 12:25:51.433688 32072 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:51.492161 25800 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:51.498684 26433 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 20.
I20260709 12:25:51.482571 31942 raft_consensus.cc:2749] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:51.499145 25833 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 19.
I20260709 12:25:51.501623 25726 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:51.490795 32090 raft_consensus.cc:2804] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:51.535702 25726 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:51.539172 25726 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:25:51.437959 32005 consensus_queue.cc:260] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:51.466328 31872 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:51.504336 25649 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:51.425519 32028 consensus_queue.cc:260] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:51.558991 25758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 3464) took 2250 ms. Trace:
I20260709 12:25:51.559485 25758 rpcz_store.cc:276] 0709 12:25:49.308921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:50.318338 (+1009417us) service_pool.cc:224] Handling call
0709 12:25:50.318654 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:50.378976 (+ 60322us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:50.379295 (+   319us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:50.779998 (+400703us) spinlock_profiling.cc:243] Waited 7.39 ms on lock 0x7b2c0005c228. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9845aa11 00007f5d9846a372 00007f5d99b9ca01 00007f5d99b6143a 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2
0709 12:25:50.780490 (+   492us) log.cc:844] Serialized 26 byte log entry
0709 12:25:51.227868 (+447378us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:51.230206 (+  2338us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:51.230320 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:51.558688 (+328368us) raft_consensus.cc:1685] finished
0709 12:25:51.558707 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:51.558926 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35539,"raft.queue_time_us":113299,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":1832,"spinlock_wait_cycles":16994048,"thread_start_us":446957,"threads_started":1,"wal-append.queue_time_us":502569}
I20260709 12:25:51.567324 25726 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
W20260709 12:25:51.572937 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 68697.4us
I20260709 12:25:51.530398 32126 raft_consensus.cc:2749] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:51.575053 25726 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:51.529657 32106 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:51.578912 32106 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:51.579993 31872 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:51.580687 32183 raft_consensus.cc:2804] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:51.581135 32183 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:51.581177 32106 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:51.529417 31866 raft_consensus.cc:2804] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:51.581532 32183 raft_consensus.cc:3060] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:51.582425 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:51.582974 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:51.583562 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:51.584004 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:51.584131 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:51.584792 25680 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:25:51.583053 25678 raft_consensus.cc:3060] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:51.585659 25682 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 16.
I20260709 12:25:51.529346 32033 consensus_queue.cc:1048] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 12:25:51.590529 31457 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
W20260709 12:25:51.592635 32123 log.cc:927] Time spent T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 1.312s	user 0.000s	sys 0.003s
I20260709 12:25:51.595728 31884 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:51.538084 32134 raft_consensus.cc:2749] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:51.548038 32141 raft_consensus.cc:2749] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:51.596344 32186 consensus_queue.cc:1048] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
W20260709 12:25:51.597666 32179 log.cc:927] Time spent T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260709 12:25:51.597769 25834 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44202 (request call id 3352) took 2436 ms (client timeout 1501 ms). Trace:
W20260709 12:25:51.598730 32158 log.cc:927] Time spent T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.669s	user 0.003s	sys 0.001s
W20260709 12:25:51.599495 32173 log.cc:927] Time spent T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:25:51.600054 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:51.582481 31680 raft_consensus.cc:2804] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:51.603801 25828 raft_consensus.cc:3055] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:51.605625 32114 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:51.538296 32090 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:51.494437 32034 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:51.614043 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:51.639567 25830 raft_consensus.cc:2468] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 19.
I20260709 12:25:51.615506 25754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 3084) took 2447 ms. Trace:
W20260709 12:25:51.617229 25834 rpcz_store.cc:269] 0709 12:25:49.161620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:49.161789 (+   169us) service_pool.cc:224] Handling call
0709 12:25:51.597606 (+2435817us) spinlock_profiling.cc:243] Waited 2.05 s on lock 0x7b5400117954. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:51.597704 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4704923904}
I20260709 12:25:51.534969 32072 consensus_queue.cc:1059] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.072s
I20260709 12:25:51.576324 32005 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:25:51.572502 31942 raft_consensus.cc:2804] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:51.619115 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:51.626008 25683 raft_consensus.cc:2393] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 14: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:51.602720 32119 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:51.606410 32028 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:51.629384 25680 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 24.
I20260709 12:25:51.629978 25828 raft_consensus.cc:740] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:51.635753 25678 raft_consensus.cc:2468] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 17.
I20260709 12:25:51.615108 32126 raft_consensus.cc:2804] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:25:51.624434 32175 log.cc:927] Time spent T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 12:25:51.640388 25754 rpcz_store.cc:276] 0709 12:25:49.167668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:49.295801 (+128133us) service_pool.cc:224] Handling call
0709 12:25:49.296174 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:49.325031 (+ 28857us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:49.325080 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:49.325677 (+   597us) log.cc:844] Serialized 26 byte log entry
0709 12:25:49.690085 (+364408us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:49.690144 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:49.690238 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:51.592058 (+1901820us) spinlock_profiling.cc:243] Waited 3.94 ms on lock 0x7b4400022b4c. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db 00007f5d99708aaf 00007f5d996fc86e 00007f5d996fbbb6 00007f5d996fb7d8 00007f5d99705221 00007f5d997051d9 00007f5d99705169
0709 12:25:51.615212 (+ 23154us) raft_consensus.cc:1685] finished
0709 12:25:51.615233 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:51.615447 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13354,"raft.queue_time_us":124935,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":64257,"spinlock_wait_cycles":9060736,"thread_start_us":293745,"threads_started":1,"wal-append.queue_time_us":809567}
I20260709 12:25:51.619346 31866 raft_consensus.cc:697] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 18 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:51.652820 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 20 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:51.639029 32090 raft_consensus.cc:3060] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:51.647257 25801 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:51.648525 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:51.657788 26437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 1517) took 1572 ms. Trace:
I20260709 12:25:51.658169 25683 raft_consensus.cc:2468] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 13.
I20260709 12:25:51.659132 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:51.658258 26437 rpcz_store.cc:276] 0709 12:25:50.085664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:50.086306 (+   642us) service_pool.cc:224] Handling call
0709 12:25:50.086628 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:50.347406 (+260778us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:50.347438 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:50.347889 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 12:25:50.722983 (+375094us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:50.723024 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:51.379679 (+656655us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b540060fc54. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:51.379731 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:51.598218 (+218487us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b4400022b4c. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db 00007f5d99708aaf 00007f5d996fc86e 00007f5d996fbbb6 00007f5d996fb7d8 00007f5d99705221 00007f5d997051d9 00007f5d99705169
0709 12:25:51.657550 (+ 59332us) raft_consensus.cc:1685] finished
0709 12:25:51.657577 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:51.657735 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71694,"raft.queue_time_us":67263,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":93,"spinlock_wait_cycles":469490816,"thread_start_us":298942,"threads_started":1,"wal-append.queue_time_us":514452}
I20260709 12:25:51.646584 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:51.660308 25680 raft_consensus.cc:2368] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 19. Current term is 20.
I20260709 12:25:51.661072 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:51.662098 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:51.663087 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:51.663251 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:51.664242 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:51.664870 25830 raft_consensus.cc:2468] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 18.
I20260709 12:25:51.650424 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:51.666723 25677 raft_consensus.cc:2410] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:25:51.667564 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:51.641511 31680 raft_consensus.cc:697] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:51.668172 25677 raft_consensus.cc:2468] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 14.
I20260709 12:25:51.668998 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:51.668798 31680 consensus_queue.cc:237] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:51.653667 25754 raft_consensus.cc:2410] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 20 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 12:25:51.674351 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:51.675529 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:51.676146 25754 raft_consensus.cc:2468] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 18.
I20260709 12:25:51.618014 31457 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:51.653630 25828 consensus_queue.cc:260] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:51.677042 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:51.677197 25828 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:51.677771 25754 raft_consensus.cc:2410] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:25:51.678099 31457 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:51.678891 25754 raft_consensus.cc:1275] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:25:51.649853 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:51.653790 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:51.681988 25678 raft_consensus.cc:2468] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 18.
I20260709 12:25:51.682349 32033 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:51.682832 32033 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:51.683094 25759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 3102) took 1328 ms. Trace:
I20260709 12:25:51.683547 25759 rpcz_store.cc:276] 0709 12:25:50.354396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:51.682302 (+1327906us) service_pool.cc:224] Handling call
0709 12:25:51.682607 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:51.682765 (+   158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:51.682790 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:51.682831 (+    41us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:51.682881 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:51.682933 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:51.683045 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:51.685021 32033 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:51.685597 32033 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:51.685796 25754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 3101) took 1358 ms. Trace:
I20260709 12:25:51.679385 25677 raft_consensus.cc:2468] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 15.
I20260709 12:25:51.681322 25834 raft_consensus.cc:2468] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 18.
I20260709 12:25:51.685120 25759 raft_consensus.cc:1275] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:25:51.688259 32118 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:51.688441 25759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 3103) took 1083 ms. Trace:
I20260709 12:25:51.688824 25759 rpcz_store.cc:276] 0709 12:25:50.604960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:51.684558 (+1079598us) service_pool.cc:224] Handling call
0709 12:25:51.684814 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:51.688206 (+  3392us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:51.688392 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:51.689265 32034 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:51.690438 25801 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:51.653597 31942 raft_consensus.cc:697] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:51.686040 32033 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:51.690526 31866 consensus_queue.cc:237] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:51.692377 31928 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:51.692312 31942 consensus_queue.cc:237] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:51.691176 32068 raft_consensus.cc:2804] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:51.701642 25828 raft_consensus.cc:1275] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:25:51.646528 25681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2827) took 1564 ms. Trace:
I20260709 12:25:51.703142 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 22 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:51.704212 25828 raft_consensus.cc:2410] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for term 22 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
W20260709 12:25:51.693581 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:51.682842 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:51.659705 25683 raft_consensus.cc:2468] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 15.
I20260709 12:25:51.706382 25678 raft_consensus.cc:2393] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 14: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:51.678568 31880 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:51.663641 25680 raft_consensus.cc:2468] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 16.
W20260709 12:25:51.655081 25829 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44202 (request call id 3362) took 1862 ms (client timeout 1504 ms). Trace:
W20260709 12:25:51.709685 25829 rpcz_store.cc:269] 0709 12:25:49.792653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:49.865631 (+ 72978us) service_pool.cc:224] Handling call
0709 12:25:51.654830 (+1789199us) spinlock_profiling.cc:243] Waited 577 ms on lock 0x7b5400117454. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:51.654995 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1327167232}
I20260709 12:25:51.703470 25681 rpcz_store.cc:276] 0709 12:25:50.081990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:50.082451 (+   461us) service_pool.cc:224] Handling call
0709 12:25:50.112410 (+ 29959us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:50.129456 (+ 17046us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:50.129503 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:50.696170 (+566667us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b18004bbbc0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d96a422a6 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9845aa11 00007f5d9846a372 00007f5d99b9ca01 00007f5d99b6143a
0709 12:25:50.696687 (+   517us) log.cc:844] Serialized 26 byte log entry
0709 12:25:50.911597 (+214910us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:25:51.010185 (+ 98588us) log.cc:844] Serialized 14 byte log entry
0709 12:25:51.640052 (+629867us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:51.640160 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:51.643046 (+  2886us) raft_consensus.cc:1685] finished
0709 12:25:51.646340 (+  3294us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:51.646474 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":234119,"prepare.queue_time_us":101012,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":2822,"raft.queue_time_us":326968,"raft.run_cpu_time_us":291,"raft.run_wall_time_us":49258,"spinlock_wait_cycles":37626624,"thread_start_us":643141,"threads_started":2,"wal-append.queue_time_us":452506}
I20260709 12:25:51.663494 25650 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
W20260709 12:25:51.712260 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 48827.3us
I20260709 12:25:51.713665 25650 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:51.715042 25650 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:51.717061 25650 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:51.628568 32027 raft_consensus.cc:697] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 17 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:51.719095 25680 raft_consensus.cc:1275] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:25:51.699378 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:51.721974 25680 raft_consensus.cc:1275] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:25:51.694315 25754 rpcz_store.cc:276] 0709 12:25:50.326897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:51.678328 (+1351431us) service_pool.cc:224] Handling call
0709 12:25:51.678584 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:51.681725 (+  3141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:51.685746 (+  4021us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:51.725322 25761 raft_consensus.cc:1275] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:25:51.726034 25761 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 3088) took 1856 ms. Trace:
I20260709 12:25:51.726502 25801 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:51.726397 25761 rpcz_store.cc:276] 0709 12:25:49.869589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:50.584477 (+714888us) service_pool.cc:224] Handling call
0709 12:25:50.584800 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:51.724991 (+1140191us) spinlock_profiling.cc:243] Waited 92.6 ms on lock 0x7b54000e86a0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99ad8dc0 00007f5d99b63d87 00007f5d99b64470 00007f5d99b60d8f 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c
0709 12:25:51.725779 (+   788us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:51.725968 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":212866432}
I20260709 12:25:51.723554 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:51.732739 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:51.735800 32011 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260709 12:25:51.683179 32088 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:51.708161 32068 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
W20260709 12:25:51.724618 31584 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 12:25:51.653756 32101 consensus_queue.cc:1048] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.079s
I20260709 12:25:51.708103 31825 raft_consensus.cc:2749] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:25:51.738669 25679 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.007s	sys 0.011s
W20260709 12:25:51.745675 25679 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.007s	sys 0.011s
I20260709 12:25:51.731478 32184 raft_consensus.cc:2804] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:51.739336 32068 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:51.736266 32089 raft_consensus.cc:2804] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:51.718366 32186 raft_consensus.cc:2749] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:51.718658 32072 raft_consensus.cc:2749] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:25:51.727840 32126 raft_consensus.cc:697] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:51.728556 31457 raft_consensus.cc:2749] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:25:51.750837 25763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 3096) took 1442 ms. Trace:
W20260709 12:25:51.752286 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:51.735574 25650 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:51.731997 31892 consensus_queue.cc:1048] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:25:51.741473 25801 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:51.754516 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:51.759627 25761 raft_consensus.cc:2468] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 21.
I20260709 12:25:51.729622 32062 consensus_queue.cc:1048] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 12:25:51.749372 32184 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:51.730926 32183 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:51.752727 32089 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:51.786567 32089 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:25:51.786700 32170 log.cc:927] Time spent T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.466s	user 0.006s	sys 0.003s
I20260709 12:25:51.788543 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:51.789937 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 23 candidate_status { last_received { term: 21 index: 18 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
W20260709 12:25:51.773433 32177 log.cc:927] Time spent T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.133s	user 0.001s	sys 0.001s
W20260709 12:25:51.778158 32181 log.cc:927] Time spent T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.235s	user 0.001s	sys 0.000s
I20260709 12:25:51.780010 32027 consensus_queue.cc:237] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:51.782286 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 46812.9us
I20260709 12:25:51.782938 31584 raft_consensus.cc:2804] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:51.749054 32182 consensus_queue.cc:1048] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:25:51.784031 25801 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:51.784972 32088 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:51.785033 32187 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:51.791595 25800 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:51.796512 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:51.767650 32184 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:51.758141 25763 rpcz_store.cc:276] 0709 12:25:50.308068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:51.495558 (+1187490us) service_pool.cc:224] Handling call
0709 12:25:51.495958 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:51.496220 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:25:51.532683 (+ 36463us) log.cc:844] Serialized 14 byte log entry
0709 12:25:51.750488 (+217805us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:51.750540 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:51.750580 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:51.750643 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:51.750769 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":38172,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":101,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":5729,"thread_start_us":217154,"threads_started":1}
I20260709 12:25:51.815567 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:51.783579 32157 log.cc:927] Time spent T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.877s	user 0.003s	sys 0.000s
I20260709 12:25:51.805302 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:51.809376 25684 raft_consensus.cc:2393] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 18: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:51.807512 25650 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:51.800360 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:51.816812 25755 raft_consensus.cc:2468] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 15.
I20260709 12:25:51.817852 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:51.818154 25650 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:51.811735 25761 raft_consensus.cc:2410] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:25:51.819713 25650 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:51.818497 25755 raft_consensus.cc:2468] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 14.
I20260709 12:25:51.802105 31457 raft_consensus.cc:2749] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:51.808454 31584 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:51.832201 25800 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:51.835979 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:51.837380 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:51.839942 31537 consensus_queue.cc:1048] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 12:25:51.842653 32182 raft_consensus.cc:2804] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:51.843205 32182 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:51.843660 32182 raft_consensus.cc:3060] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:51.826328 31825 raft_consensus.cc:2804] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:51.845765 31825 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:51.846279 31825 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:51.828056 32137 consensus_queue.cc:1048] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
W20260709 12:25:51.850499 32079 consensus_meta.cc:287] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.799s	user 0.013s	sys 0.000s
I20260709 12:25:51.822775 32187 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:51.853518 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:51.854667 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:51.854701 32187 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:51.856374 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:51.857643 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:51.863806 26401 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:51.865279 25685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2830) took 1773 ms. Trace:
I20260709 12:25:51.825912 31636 raft_consensus.cc:2804] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:51.866791 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:51.868186 26434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 1523) took 1552 ms. Trace:
I20260709 12:25:51.874786 26434 rpcz_store.cc:276] 0709 12:25:50.315567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:50.323254 (+  7687us) service_pool.cc:224] Handling call
0709 12:25:50.323506 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:51.492938 (+1169432us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:51.867961 (+375023us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54005d02d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:51.868127 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2688142592}
W20260709 12:25:51.875847 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 180771us
I20260709 12:25:51.872092 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:51.869177 26438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36518 (request call id 1218) took 1030 ms. Trace:
I20260709 12:25:51.880899 25726 leader_election.cc:400] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 pre-election: Vote denied by peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) with higher term. Message: Invalid argument: T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 18. Current term is 19.
I20260709 12:25:51.876588 26438 rpcz_store.cc:276] 0709 12:25:50.838626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:50.838747 (+   121us) service_pool.cc:224] Handling call
0709 12:25:50.853366 (+ 14619us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:51.348510 (+495144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:51.868965 (+520455us) spinlock_profiling.cc:243] Waited 489 ms on lock 0x7b54005a8554. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:51.869119 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1123757312}
I20260709 12:25:51.874845 25762 raft_consensus.cc:2468] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 15.
I20260709 12:25:51.830811 31584 raft_consensus.cc:3060] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:51.865911 25685 rpcz_store.cc:276] 0709 12:25:50.092098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:50.097481 (+  5383us) service_pool.cc:224] Handling call
0709 12:25:50.097792 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:50.226378 (+128586us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:25:50.707234 (+480856us) log.cc:844] Serialized 14 byte log entry
0709 12:25:51.356100 (+648866us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:51.356177 (+    77us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:25:51.356240 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:51.864954 (+508714us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b5400159354. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:51.865021 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:51.865198 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76527,"prepare.queue_time_us":481763,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":5161,"raft.queue_time_us":133096,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":5051,"spinlock_wait_cycles":295216896,"thread_start_us":1006114,"threads_started":3,"wal-append.queue_time_us":553525}
I20260709 12:25:51.881371 25726 leader_election.cc:403] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:51.879830 26401 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:51.887144 25762 raft_consensus.cc:1240] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 17. Current term is 18. Ops: []
I20260709 12:25:51.887054 25726 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:51.856422 32066 raft_consensus.cc:2804] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:25:51.865164 32193 raft_consensus.cc:2804] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:51.907712 32119 raft_consensus.cc:3055] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:51.908255 32119 raft_consensus.cc:740] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:51.909402 32121 raft_consensus.cc:2804] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:25:51.909089 32119 consensus_queue.cc:260] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:51.909936 32121 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:51.910375 32121 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:51.910444 32119 raft_consensus.cc:3060] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:25:51.912977 25800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:51.916115 32033 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:51.921838 25756 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 3085) took 2746 ms. Trace:
I20260709 12:25:51.922276 25756 rpcz_store.cc:276] 0709 12:25:49.175873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:50.192096 (+1016223us) service_pool.cc:224] Handling call
0709 12:25:50.225406 (+ 33310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:51.452227 (+1226821us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:51.921629 (+469402us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54003976d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:51.921780 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2672393088}
I20260709 12:25:51.857388 31972 consensus_queue.cc:1048] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 12:25:51.874030 31457 raft_consensus.cc:2749] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:25:51.926673 32183 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:51.873438 31636 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:51.930301 31636 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:51.932324 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:51.932905 25833 raft_consensus.cc:1275] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 15 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 12:25:51.933493 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:51.933985 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:51.935463 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:51.936244 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:51.929806 32187 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:51.880998 31880 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:51.936271 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:51.899657 32134 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:51.840876 32126 consensus_queue.cc:237] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:51.899410 26401 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:25:51.941359 26402 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:51.897481 25726 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:51.934089 25830 raft_consensus.cc:2468] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 13.
I20260709 12:25:51.943312 25801 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
W20260709 12:25:51.945302 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 45989.7us
W20260709 12:25:51.946549 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 49212.9us
I20260709 12:25:51.946882 26401 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:51.949999 31972 consensus_queue.cc:1059] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:51.939750 32187 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:51.951097 31972 raft_consensus.cc:3055] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:51.950199 32193 raft_consensus.cc:697] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 16 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:51.964636 32193 consensus_queue.cc:237] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:51.965317 32187 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:51.965965 32187 raft_consensus.cc:2804] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:51.966325 32187 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:51.966677 32187 raft_consensus.cc:3060] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:51.967553 26437 raft_consensus.cc:1240] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 17. Current term is 18. Ops: [17.15-17.15]
I20260709 12:25:51.951478 31972 raft_consensus.cc:740] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:51.971210 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:51.897608 32117 raft_consensus.cc:2749] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:52.004302 26432 raft_consensus.cc:1240] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 12:25:52.006366 25758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 3098) took 1697 ms. Trace:
I20260709 12:25:52.008711 25758 rpcz_store.cc:276] 0709 12:25:50.308624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:51.593488 (+1284864us) service_pool.cc:224] Handling call
0709 12:25:51.593838 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:51.607585 (+ 13747us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:51.607658 (+    73us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:51.607729 (+    71us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:51.607794 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:52.006152 (+398358us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b54001e6254. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:52.006195 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:52.006311 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30962048}
I20260709 12:25:52.007782 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:52.010548 26439 raft_consensus.cc:2393] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 20: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
W20260709 12:25:52.005544 25649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:52.011600 25649 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:52.013065 25649 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:51.984593 26401 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:51.995862 26437 raft_consensus.cc:1240] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 15 LEADER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:52.023834 31680 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:52.065084 26401 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:51.905138 32066 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:52.075794 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 105472us
I20260709 12:25:52.076630 26402 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:25:52.097986 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 84960.9us
I20260709 12:25:52.107622 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:51.941929 32189 raft_consensus.cc:2804] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:51.968068 32098 raft_consensus.cc:2749] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:25:51.954818 31675 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
W20260709 12:25:52.116612 26402 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 1.865s (SENT) [suppressed 8 similar messages]
I20260709 12:25:52.003744 32050 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:52.132282 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:25:52.135267 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 108772us
I20260709 12:25:52.136538 26401 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:52.076610 32039 raft_consensus.cc:2804] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:52.105212 31928 raft_consensus.cc:2749] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:25:52.076884 32066 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:25:52.130734 32079 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:52.109489 32029 raft_consensus.cc:2749] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:52.024628 31680 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:52.152879 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:52.143390 25828 raft_consensus.cc:1240] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 18 LEADER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 17. Current term is 18. Ops: []
I20260709 12:25:52.076764 31880 raft_consensus.cc:2749] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:25:52.104874 31892 consensus_queue.cc:1059] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 12:25:52.119383 32189 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:52.157375 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 337741us
I20260709 12:25:52.158306 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:52.129101 31848 raft_consensus.cc:2804] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:52.076254 32028 consensus_queue.cc:1059] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.114s
I20260709 12:25:52.165351 25685 raft_consensus.cc:2393] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 18: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:52.159907 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:52.105021 32026 consensus_queue.cc:1048] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 12:25:52.146190 32014 raft_consensus.cc:2749] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:52.144086 32106 raft_consensus.cc:2804] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:52.173655 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 22 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:52.173655 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:52.177886 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:52.178545 25681 raft_consensus.cc:3060] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:52.153558 32039 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:52.112576 32191 consensus_queue.cc:1048] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.065s
I20260709 12:25:52.187207 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:52.187840 25756 raft_consensus.cc:3060] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:52.167685 32189 raft_consensus.cc:3060] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:52.209649 32134 raft_consensus.cc:2749] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) with higher term. Message: Invalid argument: T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 18. Current term is 19.
I20260709 12:25:52.203653 31584 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:52.152379 32050 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:52.212076 26434 raft_consensus.cc:2468] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 12.
I20260709 12:25:52.194782 31636 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:52.196105 32090 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:52.169039 31848 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:52.201954 32121 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:52.155230 32010 consensus_queue.cc:1059] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.029s
I20260709 12:25:52.203868 31680 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:52.185159 32005 raft_consensus.cc:3055] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:52.208176 32068 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:52.153846 31675 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:52.162811 31972 consensus_queue.cc:260] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:52.154031 32184 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:52.158725 32079 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:52.210546 32103 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:52.186759 32039 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:52.206586 32089 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:52.217326 31848 raft_consensus.cc:3060] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:52.222393 32005 raft_consensus.cc:740] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:52.262688 32090 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:52.262959 31825 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:52.264953 32029 raft_consensus.cc:3055] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:52.265165 31636 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:52.265532 31884 raft_consensus.cc:3055] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:25:52.266170 31884 raft_consensus.cc:740] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:52.267365 31884 consensus_queue.cc:260] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:52.268843 31884 raft_consensus.cc:3060] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:52.269006 32068 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:25:52.268900 32196 log.cc:927] Time spent T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.116s	user 0.002s	sys 0.002s
I20260709 12:25:52.265584 32029 raft_consensus.cc:740] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:52.272302 32029 consensus_queue.cc:260] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:52.273111 31825 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:52.273569 32029 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:52.272295 32089 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:52.278204 32005 consensus_queue.cc:260] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:52.278803 32066 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:52.281137 32184 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 19 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:52.265328 31675 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:52.346390 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:52.347470 25679 raft_consensus.cc:1240] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 12:25:52.348238 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:52.405630 25678 raft_consensus.cc:2393] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 20: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:52.355480 25680 raft_consensus.cc:1240] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 12:25:52.355531 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:52.408762 25686 raft_consensus.cc:2393] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 13: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
W20260709 12:25:52.357461 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 409914us
I20260709 12:25:52.409377 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:52.410550 25726 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:52.360257 25758 raft_consensus.cc:1240] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 12:25:52.217607 25761 pending_rounds.cc:85] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 11
I20260709 12:25:52.413017 25761 pending_rounds.cc:107] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 12:25:52.413563 25761 raft_consensus.cc:2889] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:52.218014 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:52.421761 31825 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:52.422750 31825 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:52.362907 25801 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:52.374379 25836 raft_consensus.cc:2393] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 14: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:52.397919 32034 raft_consensus.cc:2804] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:25:52.424796 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 62278.3us
I20260709 12:25:52.430342 31537 raft_consensus.cc:2804] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:52.430914 31537 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:52.431399 31537 raft_consensus.cc:3060] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:52.434046 31675 raft_consensus.cc:2804] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:52.434697 31675 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:52.434823 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:52.435182 32005 raft_consensus.cc:3060] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:52.435230 31675 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:52.435796 25830 raft_consensus.cc:2468] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 15.
I20260709 12:25:52.438288 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:52.438622 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:52.439060 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:52.281857 32066 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 22 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:52.281198 32106 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:52.298859 32121 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 20 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:52.303202 32189 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:52.477705 31825 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:52.298143 32182 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:52.478677 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:52.481506 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:52.481837 32182 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:52.301918 32187 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:52.482797 25828 raft_consensus.cc:2393] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 19: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
W20260709 12:25:52.484239 25760 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.011s	sys 0.003s
I20260709 12:25:52.484776 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:52.485088 32187 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:52.486032 25760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 3097) took 2177 ms. Trace:
I20260709 12:25:52.488174 31584 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:25:52.488911 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:52.489501 25755 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.004s	sys 0.011s
I20260709 12:25:52.491173 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:52.491731 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:52.492074 26433 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:52.492681 26434 raft_consensus.cc:3060] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:52.496464 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:52.497849 32050 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:52.498265 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:52.500411 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:52.501883 32079 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:25:52.502101 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 91897.5us
I20260709 12:25:52.503255 25726 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:52.505964 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:52.507449 32126 raft_consensus.cc:2804] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:25:52.484007 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:52.501937 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:52.513159 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:52.517102 31972 raft_consensus.cc:3060] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:52.520820 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:52.524294 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:52.525405 26436 raft_consensus.cc:2393] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 16: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:52.526652 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:52.527596 26437 raft_consensus.cc:3060] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:52.486545 25760 rpcz_store.cc:276] 0709 12:25:50.308355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:51.530112 (+1221757us) service_pool.cc:224] Handling call
0709 12:25:51.542017 (+ 11905us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:51.542245 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:25:51.969001 (+426756us) log.cc:844] Serialized 14 byte log entry
0709 12:25:52.485310 (+516309us) log.cc:844] Serialized 14 byte log entry
0709 12:25:52.485552 (+   242us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:52.485610 (+    58us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:52.485688 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:52.485785 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:52.485965 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":64211,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"thread_start_us":905894,"threads_started":2}
I20260709 12:25:52.549796 32103 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:52.550714 32103 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:52.555898 31584 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:52.556782 31584 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:52.558094 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:52.559018 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:52.508004 32106 raft_consensus.cc:3060] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:52.478725 32189 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:25:52.578665 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 73353.4us
I20260709 12:25:52.584187 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:52.583395 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:52.542889 32126 raft_consensus.cc:697] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:52.604935 32126 consensus_queue.cc:237] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:52.606918 26402 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:52.610345 25726 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:52.612499 25726 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:52.615141 32141 raft_consensus.cc:2764] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:25:52.590721 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:52.616947 25679 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:52.594105 32095 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:52.625815 32095 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:52.594991 25836 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41782 (request call id 1326) took 1103 ms. Trace:
I20260709 12:25:52.628180 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:52.629392 25584 catalog_manager.cc:5697] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 11 to 14, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 14 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:52.600340 32034 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:52.616240 32141 raft_consensus.cc:2749] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:52.588799 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:52.592824 25830 raft_consensus.cc:1275] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 23 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 21 index: 18. Preceding OpId from leader: term: 23 index: 19. (index mismatch)
I20260709 12:25:52.624866 32121 consensus_queue.cc:1059] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:25:52.636111 25681 raft_consensus.cc:2468] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 14.
I20260709 12:25:52.629362 26432 raft_consensus.cc:2393] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 16: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:52.627816 25836 rpcz_store.cc:276] 0709 12:25:51.491357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:51.491546 (+   189us) service_pool.cc:224] Handling call
0709 12:25:52.594749 (+1103203us) spinlock_profiling.cc:243] Waited 743 ms on lock 0x7b54002f6554. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:52.594908 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1708606208}
I20260709 12:25:52.640314 26402 leader_election.cc:400] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 election: Vote denied by peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) with higher term. Message: Invalid argument: T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 19. Current term is 20.
I20260709 12:25:52.647387 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:52.663209 26402 leader_election.cc:403] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 12:25:52.645419 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:52.644407 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:52.644905 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:52.666988 26434 raft_consensus.cc:2468] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 14.
I20260709 12:25:52.674472 25686 raft_consensus.cc:2393] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 14: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:52.631886 25584 catalog_manager.cc:5697] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 11 to 12, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 12 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } }
I20260709 12:25:52.647270 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:52.633196 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:52.671501 25678 raft_consensus.cc:2468] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 13.
I20260709 12:25:52.632143 32034 raft_consensus.cc:3060] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:52.681919 25584 catalog_manager.cc:5697] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 11 to 15, leader changed from a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 15 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:25:52.683836 32141 raft_consensus.cc:3055] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:25:52.684448 32141 raft_consensus.cc:740] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:52.685662 32141 consensus_queue.cc:260] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:52.687242 32141 raft_consensus.cc:3060] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:52.683887 25584 catalog_manager.cc:5697] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 8 to 12, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 12 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:25:52.691095 25584 catalog_manager.cc:5697] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 6 to 7, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 7 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:25:52.696640 25759 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:25:52.695967 25584 catalog_manager.cc:5697] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 11 to 15, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 15 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } }
I20260709 12:25:52.699429 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:52.700987 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:52.701396 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:52.701970 25758 raft_consensus.cc:2393] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 14: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:52.702960 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:52.710273 25762 raft_consensus.cc:1275] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 12:25:52.712731 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:52.700383 25584 catalog_manager.cc:5697] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 12 to 16, leader changed from a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 16 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:52.715257 25584 catalog_manager.cc:5697] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 13 to 17, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 17 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:52.718511 25726 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:52.696439 26439 raft_consensus.cc:1275] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 12:25:52.719774 25584 catalog_manager.cc:5697] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:25:52.638185 32189 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:52.723979 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 83957.3us
I20260709 12:25:52.723750 32189 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:52.724960 26402 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:52.726358 32189 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:52.726579 26402 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:52.726974 32121 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:52.727232 32189 raft_consensus.cc:2749] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) with higher term. Message: Invalid argument: T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 19. Current term is 20.
I20260709 12:25:52.727968 31983 raft_consensus.cc:2749] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:52.729007 31584 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:52.729223 26401 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:52.730406 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:52.731221 25757 raft_consensus.cc:3060] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:52.732831 32152 raft_consensus.cc:2749] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:52.734311 32028 raft_consensus.cc:2749] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:52.725502 25584 catalog_manager.cc:5697] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 12 to 16, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 16 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } }
I20260709 12:25:52.741496 32088 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:52.742321 32088 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:52.710297 25649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:52.751906 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:52.752734 25685 raft_consensus.cc:2468] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 14.
I20260709 12:25:52.754459 26402 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:52.696328 25760 raft_consensus.cc:2468] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 16.
I20260709 12:25:52.758749 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:52.759136 31584 consensus_queue.cc:1059] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:52.755889 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:52.760449 31636 raft_consensus.cc:3055] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:25:52.760977 31636 raft_consensus.cc:740] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:52.682017 25679 raft_consensus.cc:2468] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 19.
I20260709 12:25:52.762156 31636 consensus_queue.cc:260] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:52.763372 31636 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:52.759388 25760 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 17.
I20260709 12:25:52.770952 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:52.771828 25686 raft_consensus.cc:2468] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 17.
I20260709 12:25:52.771692 31675 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:52.774273 31675 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:52.775168 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:52.775863 26439 raft_consensus.cc:2468] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 15.
I20260709 12:25:52.777861 25761 raft_consensus.cc:3055] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:25:52.778223 25761 raft_consensus.cc:740] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:52.779134 25761 consensus_queue.cc:260] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.19, Last appended by leader: 19, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:52.780489 25761 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:25:52.780591 32095 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:52.780934 31825 consensus_queue.cc:1048] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 12:25:52.782454 32220 log.cc:927] Time spent T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.187s	user 0.001s	sys 0.002s
I20260709 12:25:52.783242 25800 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:52.783847 25755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 3498) took 1062 ms. Trace:
I20260709 12:25:52.785068 31825 raft_consensus.cc:2804] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:52.784238 25755 rpcz_store.cc:276] 0709 12:25:51.721474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:51.858197 (+136723us) service_pool.cc:224] Handling call
0709 12:25:51.858540 (+   343us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:51.859033 (+   493us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:51.859074 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:51.859641 (+   567us) log.cc:844] Serialized 26 byte log entry
0709 12:25:52.490374 (+630733us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:52.490501 (+   127us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:52.490608 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:52.706784 (+216176us) spinlock_profiling.cc:243] Waited 56.8 ms on lock 0x7b4400022b4c. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db 00007f5d99708aaf 00007f5d996fc86e 00007f5d996fbbb6 00007f5d996fb7d8 00007f5d99705221 00007f5d997051d9 00007f5d99705169
0709 12:25:52.783550 (+ 76766us) raft_consensus.cc:1685] finished
0709 12:25:52.783570 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:52.783787 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":121,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":11451,"spinlock_wait_cycles":130614656,"thread_start_us":507180,"threads_started":1,"wal-append.queue_time_us":690089}
I20260709 12:25:52.785460 31825 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:52.785847 31825 raft_consensus.cc:3060] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:52.785763 26433 raft_consensus.cc:2468] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 19.
I20260709 12:25:52.786350 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:52.703791 25758 raft_consensus.cc:2393] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 13: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:52.787114 25755 raft_consensus.cc:2468] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 14.
I20260709 12:25:52.790028 25758 raft_consensus.cc:1275] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:25:52.649600 31848 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:52.796365 32114 consensus_queue.cc:1048] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 12:25:52.797492 31848 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:52.798741 25726 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:52.799171 25836 raft_consensus.cc:1275] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:25:52.799762 25726 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:52.792790 32189 raft_consensus.cc:2804] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:52.800552 32189 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:52.801126 32189 raft_consensus.cc:3060] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:52.803241 32215 raft_consensus.cc:2804] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:25:52.805192 32088 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:52.713477 25762 raft_consensus.cc:3060] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:52.794754 26402 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:52.726315 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:52.743341 25584 catalog_manager.cc:5697] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 12 to 15, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 15 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } }
I20260709 12:25:52.809480 25800 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:52.812724 26437 raft_consensus.cc:2468] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 13.
I20260709 12:25:52.803646 32215 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:52.830464 25757 raft_consensus.cc:2468] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 16.
I20260709 12:25:52.813344 25801 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:52.840109 32239 raft_consensus.cc:2804] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:52.841418 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:52.848731 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:52.857203 25757 raft_consensus.cc:2410] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 19 because replica has last-logged OpId of term: 17 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 12:25:52.853904 25755 raft_consensus.cc:2468] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 14.
I20260709 12:25:52.840711 32215 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:52.850245 32121 raft_consensus.cc:2749] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:52.851986 25584 catalog_manager.cc:5697] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 9 to 14, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 14 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } }
I20260709 12:25:52.847842 31636 raft_consensus.cc:2804] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:52.869270 25726 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
W20260709 12:25:52.874622 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 79938us
I20260709 12:25:52.851729 32239 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:52.836109 32106 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:52.945729 25760 raft_consensus.cc:1240] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:52.947158 32106 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:52.878494 31636 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:52.876899 32095 raft_consensus.cc:2749] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:25:52.948199 31636 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:52.849695 31537 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:52.950826 31537 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:52.884325 25584 catalog_manager.cc:5697] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 9 to 12, leader changed from a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 12 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:25:52.890018 25832 raft_consensus.cc:2468] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 16.
W20260709 12:25:52.884367 25756 consensus_meta.cc:287] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.696s	user 0.021s	sys 0.008s
I20260709 12:25:52.952240 25756 raft_consensus.cc:2468] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 18.
I20260709 12:25:52.952458 25584 catalog_manager.cc:5697] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 5 to 14, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 14 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:25:52.893471 25763 raft_consensus.cc:1275] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:25:52.953997 25584 catalog_manager.cc:5697] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } }
I20260709 12:25:52.895244 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:52.895548 25828 raft_consensus.cc:1240] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 18. Current term is 19. Ops: [18.9-18.9]
I20260709 12:25:52.896149 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:52.896855 31457 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:52.901170 31848 consensus_queue.cc:1048] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:25:52.901961 32028 consensus_queue.cc:1048] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:25:52.902638 26402 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:52.902870 32050 consensus_queue.cc:1048] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:25:52.960255 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 57789.8us
I20260709 12:25:52.960479 32028 raft_consensus.cc:2804] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:52.961123 32028 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:52.961263 26402 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:52.961580 26437 raft_consensus.cc:3060] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:52.961643 32028 raft_consensus.cc:3060] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:52.964356 25833 raft_consensus.cc:2393] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 13: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:52.966578 32034 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:52.967813 26432 raft_consensus.cc:1240] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:52.912469 32218 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:52.969012 32218 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:52.914249 32103 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:52.914819 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:52.944164 31884 raft_consensus.cc:2749] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:25:52.944752 32039 consensus_meta.cc:287] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.556s	user 0.015s	sys 0.009s
I20260709 12:25:52.958325 31457 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:52.971642 32218 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:52.971796 32028 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:52.989473 25584 catalog_manager.cc:5697] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 10 to 14, leader changed from a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 14 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:52.997700 25584 catalog_manager.cc:5697] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:25:52.998660 25649 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:25:52.977468 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 273624us
I20260709 12:25:53.003770 26437 raft_consensus.cc:2468] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 18.
I20260709 12:25:52.999671 25584 catalog_manager.cc:5697] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 10 to 11, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 11 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:53.017671 25762 raft_consensus.cc:2468] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 15.
I20260709 12:25:53.018878 32184 raft_consensus.cc:2804] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:53.019028 32028 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:53.019759 31457 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:53.013765 31848 raft_consensus.cc:2749] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:53.021154 32206 consensus_queue.cc:1048] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 12:25:53.008335 25800 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
W20260709 12:25:52.979202 32233 log.cc:927] Time spent T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 12:25:53.028051 25759 raft_consensus.cc:2468] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 22.
I20260709 12:25:52.883179 32239 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:53.021106 25584 catalog_manager.cc:5697] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 10 to 13, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 13 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:52.980460 31675 raft_consensus.cc:2804] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:53.041883 25800 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:53.033574 32218 raft_consensus.cc:2804] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:52.992717 31825 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:53.050212 25584 catalog_manager.cc:5697] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 9 to 11, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 11 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
W20260709 12:25:53.059459 25800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:53.062974 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:53.051996 32218 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:53.077849 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:53.054165 31675 raft_consensus.cc:697] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:53.085947 25761 raft_consensus.cc:1275] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 23 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 22 index: 19. Preceding OpId from leader: term: 23 index: 19. (term mismatch)
I20260709 12:25:53.086619 25761 pending_rounds.cc:85] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 18
I20260709 12:25:53.086987 25761 pending_rounds.cc:107] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 22.19
I20260709 12:25:53.079712 25584 catalog_manager.cc:5697] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 9 to 14, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 14 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:53.092674 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:53.034138 32039 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:53.094029 25761 raft_consensus.cc:2889] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:53.099400 25584 catalog_manager.cc:5697] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 8 to 9, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 9 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:53.109293 25584 catalog_manager.cc:5697] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 5 to 12, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 12 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
W20260709 12:25:53.110435 32235 log.cc:927] Time spent T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.273s	user 0.000s	sys 0.001s
I20260709 12:25:53.083753 31537 raft_consensus.cc:2804] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:25:53.111462 25584 catalog_manager.cc:5697] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 6 to 11, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 11 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:53.084551 32218 raft_consensus.cc:3060] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:53.072357 32005 consensus_queue.cc:1059] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:25:53.077629 32189 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:53.112564 32103 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.139780 31537 raft_consensus.cc:697] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 22 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:53.164894 25762 raft_consensus.cc:2468] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 19.
W20260709 12:25:53.147115 31972 consensus_meta.cc:287] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.629s	user 0.014s	sys 0.000s
W20260709 12:25:53.189779 32029 consensus_meta.cc:287] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.884s	user 0.004s	sys 0.019s
W20260709 12:25:53.192653 32234 log.cc:927] Time spent T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:25:53.195676 32039 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 19 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:53.186712 31825 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:53.196995 25834 raft_consensus.cc:2468] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 14.
I20260709 12:25:53.182284 31675 consensus_queue.cc:237] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:53.201148 31537 consensus_queue.cc:237] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:53.204818 32028 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:53.208587 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 86848.2us
I20260709 12:25:53.205720 32028 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:53.211195 25801 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:53.155191 32103 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:53.215785 25650 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:53.217644 25754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 3121) took 1202 ms. Trace:
I20260709 12:25:53.166855 32034 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:53.224592 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 162631us
I20260709 12:25:53.225570 25650 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:53.225944 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:53.227114 25650 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:53.229262 32103 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:53.230003 25800 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:53.230692 32103 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.231392 32103 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:53.219004 25754 rpcz_store.cc:276] 0709 12:25:51.942805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:52.207664 (+264859us) service_pool.cc:224] Handling call
0709 12:25:52.358753 (+151089us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:52.467296 (+108543us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:52.467316 (+    20us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:52.507544 (+ 40228us) log.cc:844] Serialized 26 byte log entry
0709 12:25:52.839527 (+331983us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:52.839590 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:52.839712 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:52.978309 (+138597us) spinlock_profiling.cc:243] Waited 27.2 ms on lock 0x7b4400022b4c. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db 00007f5d99708aaf 00007f5d996fc86e 00007f5d996fbbb6 00007f5d996fb7d8 00007f5d99705221 00007f5d997051d9 00007f5d99705169
0709 12:25:53.129689 (+151380us) raft_consensus.cc:1685] finished
0709 12:25:53.129710 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:53.145429 (+ 15719us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7706,"raft.queue_time_us":22552,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":61552,"spinlock_wait_cycles":62536448,"thread_start_us":331480,"threads_started":1,"wal-append.queue_time_us":331913}
I20260709 12:25:53.234483 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:53.239974 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:53.239283 31457 raft_consensus.cc:2804] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:53.214618 32079 consensus_queue.cc:1059] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 12:25:53.253535 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:53.242123 31972 raft_consensus.cc:2804] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:25:53.242997 32206 raft_consensus.cc:2749] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:53.257409 32239 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:53.264046 25756 raft_consensus.cc:1240] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 18. Current term is 19. Ops: []
W20260709 12:25:53.265273 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 54182.6us
I20260709 12:25:53.220765 32215 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:53.245787 32039 raft_consensus.cc:2749] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:53.249416 31457 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:53.258927 31972 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:53.250358 32005 raft_consensus.cc:2749] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:25:53.261816 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 402085us
I20260709 12:25:53.266450 32028 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:53.274611 31457 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:53.277307 31972 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:53.297823 25801 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:53.279196 32184 raft_consensus.cc:697] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 18 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:53.312091 25650 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:53.309098 32103 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:53.327098 31680 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
W20260709 12:25:53.339811 32231 log.cc:927] Time spent T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.466s	user 0.003s	sys 0.000s
I20260709 12:25:53.339672 31680 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:53.326417 32239 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:53.332180 32182 raft_consensus.cc:2804] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:25:53.345892 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:53.345053 32182 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:53.349120 31680 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:53.349754 32182 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:53.356258 26401 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:25:53.359977 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 55464.2us
I20260709 12:25:53.358660 26401 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:53.359346 31848 raft_consensus.cc:2804] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:53.356868 32215 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 20 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:53.366077 26401 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:53.370963 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:53.373615 25761 raft_consensus.cc:1240] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 18. Current term is 19. Ops: []
I20260709 12:25:53.360890 32089 raft_consensus.cc:2749] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:25:53.390988 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:53.369108 32029 raft_consensus.cc:2804] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:53.371035 31848 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:53.353543 32184 consensus_queue.cc:237] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:53.366770 32246 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.399333 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:53.368356 32050 consensus_queue.cc:1048] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 12:25:53.410859 25761 raft_consensus.cc:2468] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 17.
I20260709 12:25:53.416468 25754 raft_consensus.cc:1240] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 19. Current term is 20. Ops: []
I20260709 12:25:53.416500 26401 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:53.405450 31848 raft_consensus.cc:3060] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:53.419191 32114 raft_consensus.cc:2804] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:53.440389 25801 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:53.445269 32036 consensus_queue.cc:1048] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.051s
I20260709 12:25:53.447299 32036 raft_consensus.cc:2804] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:53.447729 32036 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:53.454748 26437 raft_consensus.cc:1240] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:25:53.426776 31884 consensus_queue.cc:1059] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 12:25:53.456804 26402 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:53.459182 25801 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:53.431998 31636 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:53.464589 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 75568.8us
I20260709 12:25:53.414032 32246 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:53.452965 32114 raft_consensus.cc:697] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 15 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:53.459870 32036 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:53.483978 25836 raft_consensus.cc:1240] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 12:25:53.481918 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:53.467641 32005 raft_consensus.cc:2804] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:53.487325 31457 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:53.489463 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:25:53.490792 32243 log.cc:927] Time spent T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:25:53.492401 32114 consensus_queue.cc:237] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:53.485643 25801 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:53.504079 32050 raft_consensus.cc:2749] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:25:53.504971 31636 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:53.505097 32050 raft_consensus.cc:3055] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:25:53.505386 25650 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:53.505681 32050 raft_consensus.cc:740] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:53.507148 32039 raft_consensus.cc:2804] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:53.507609 32039 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:53.545656 32039 raft_consensus.cc:3060] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:53.506934 32050 consensus_queue.cc:260] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:53.515630 32088 raft_consensus.cc:3055] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:53.548254 32088 raft_consensus.cc:740] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:53.548584 32050 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:53.549602 32088 consensus_queue.cc:260] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:53.551262 32088 raft_consensus.cc:3060] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:53.552143 31884 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:53.552922 31884 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:53.553869 32193 consensus_queue.cc:1059] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 18.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:53.521921 32189 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:53.525915 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:53.523459 32036 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:53.560333 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:53.562354 25677 raft_consensus.cc:2393] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 15: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:53.531081 32246 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:53.564051 32036 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:53.566323 25834 raft_consensus.cc:1240] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 18. Current term is 19. Ops: []
I20260709 12:25:53.567473 25829 raft_consensus.cc:1275] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:25:53.506965 25650 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:53.568584 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:53.568595 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
W20260709 12:25:53.569093 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 62279.2us
I20260709 12:25:53.569294 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:53.564193 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:53.569977 25835 raft_consensus.cc:2393] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 19: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:53.570093 25650 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:53.566182 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:53.502539 25684 raft_consensus.cc:2376] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 19. Re-sending same reply.
I20260709 12:25:53.540606 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:53.541692 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:53.571557 32193 raft_consensus.cc:2749] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:53.574386 32193 raft_consensus.cc:2749] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:53.542518 31584 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.575418 31584 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:53.577793 31584 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:25:53.544013 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 58495us
I20260709 12:25:53.578699 25801 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:53.504246 31825 raft_consensus.cc:2804] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:25:53.544235 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:53.579747 25760 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:53.544518 25837 raft_consensus.cc:2468] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 17.
I20260709 12:25:53.544845 32005 raft_consensus.cc:697] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 13 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:53.585702 32005 consensus_queue.cc:237] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:53.519474 32034 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.588160 32034 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:53.590790 32034 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:53.554970 32208 raft_consensus.cc:3055] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 18 LEADER]: Stepping down as leader of term 18
W20260709 12:25:53.592381 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:53.571636 25836 raft_consensus.cc:2410] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 12:25:53.591557 32208 raft_consensus.cc:740] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:53.594050 32208 consensus_queue.cc:260] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:53.595557 32208 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:53.598381 25686 raft_consensus.cc:1275] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 12:25:53.601338 25686 pending_rounds.cc:85] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc: Aborting all ops after (but not including) 12
I20260709 12:25:53.600733 32218 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:53.601604 25686 pending_rounds.cc:107] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 12:25:53.599471 25684 raft_consensus.cc:1275] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 12:25:53.604512 25679 raft_consensus.cc:1240] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 18. Current term is 19. Ops: []
I20260709 12:25:53.602478 25686 raft_consensus.cc:2889] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:53.607396 25832 raft_consensus.cc:2468] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 17.
I20260709 12:25:53.610476 32034 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:53.611151 32034 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:53.613142 31636 raft_consensus.cc:2804] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:53.613932 31636 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:53.615082 31636 raft_consensus.cc:3060] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:53.615700 31825 raft_consensus.cc:697] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 19 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:53.616767 31825 consensus_queue.cc:237] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:53.608579 25650 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:53.621985 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:53.613911 32034 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:53.564098 31884 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:53.628311 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:53.629022 26430 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 10.
I20260709 12:25:53.622766 32182 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:53.630995 32182 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:53.631086 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:53.631623 32182 raft_consensus.cc:2804] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:25:53.631793 26434 raft_consensus.cc:2468] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 18.
I20260709 12:25:53.637626 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:53.641947 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:53.642935 26437 raft_consensus.cc:2393] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 13: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:53.632331 32218 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:53.633581 25650 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
W20260709 12:25:53.662995 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 206254us
I20260709 12:25:53.481686 31537 raft_consensus.cc:2749] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:25:53.679042 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:53.683734 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:53.686643 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:53.689669 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:53.690313 25759 raft_consensus.cc:3060] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:53.690811 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 57388.9us
I20260709 12:25:53.701930 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:53.707075 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:53.707579 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:53.709645 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:53.709805 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:53.711086 25684 raft_consensus.cc:2393] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 17: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:53.711410 25679 raft_consensus.cc:2393] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 19: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:53.711990 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:53.708425 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:53.713620 25682 raft_consensus.cc:2393] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 13: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:53.715247 25683 raft_consensus.cc:2468] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 19.
I20260709 12:25:53.716167 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:53.719353 26434 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 24.
W20260709 12:25:53.718869 26402 leader_election.cc:336] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 1.532s (SENT)
W20260709 12:25:53.726603 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:53.721426 26437 raft_consensus.cc:2468] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 17.
I20260709 12:25:53.703516 31457 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 19 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:53.730017 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 313564us
I20260709 12:25:53.734161 25760 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 18.
I20260709 12:25:53.757128 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:53.760180 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:53.710757 32193 raft_consensus.cc:2749] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:53.763411 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:53.764508 25833 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 20.
I20260709 12:25:53.710465 32182 raft_consensus.cc:697] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 20 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:53.767226 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:53.769714 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:53.770470 25760 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:53.772228 25682 raft_consensus.cc:1240] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 12:25:53.771811 25761 raft_consensus.cc:1240] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 12:25:53.775111 25684 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 24.
I20260709 12:25:53.730150 32206 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.756343 32029 raft_consensus.cc:697] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 16 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:53.786756 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:53.787514 25679 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 19.
I20260709 12:25:53.788573 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:53.724591 32189 consensus_queue.cc:1059] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.050s
I20260709 12:25:53.788853 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:53.728025 31972 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:53.795213 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 76385.8us
W20260709 12:25:53.796233 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 104728us
I20260709 12:25:53.774940 31457 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.792321 25763 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 16.
I20260709 12:25:53.799302 25759 raft_consensus.cc:2468] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 15.
I20260709 12:25:53.800077 25801 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:25:53.825634 25650 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:53.833828 25800 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:53.842257 25726 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:53.792805 32206 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:53.789503 31675 consensus_queue.cc:1059] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.033s
I20260709 12:25:53.844296 25800 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:53.824131 32114 raft_consensus.cc:3055] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:25:53.847251 32114 raft_consensus.cc:740] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:53.848385 32114 consensus_queue.cc:260] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:53.849858 32114 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:53.850623 32218 raft_consensus.cc:2804] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:53.851207 32218 raft_consensus.cc:697] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 15 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:53.852547 32218 consensus_queue.cc:237] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:53.853824 32253 log.cc:927] Time spent T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:25:53.859823 32089 consensus_queue.cc:1048] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:25:53.860261 25758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 3141) took 1052 ms. Trace:
I20260709 12:25:53.860818 25758 rpcz_store.cc:276] 0709 12:25:52.807963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:52.916257 (+108294us) service_pool.cc:224] Handling call
0709 12:25:52.916579 (+   322us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:53.283864 (+367285us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:53.283909 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:53.306372 (+ 22463us) log.cc:844] Serialized 26 byte log entry
0709 12:25:53.471011 (+164639us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:25:53.471069 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:53.471143 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:53.859997 (+388854us) raft_consensus.cc:1685] finished
0709 12:25:53.860021 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:53.860179 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":80058,"raft.run_cpu_time_us":48,"raft.run_wall_time_us":48,"thread_start_us":518781,"threads_started":2,"wal-append.queue_time_us":387011}
I20260709 12:25:53.865593 25801 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:25:53.865403 32182 consensus_queue.cc:237] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:53.866647 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:53.867214 25836 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:25:53.868371 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:53.869428 32103 raft_consensus.cc:2804] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:53.872190 32248 raft_consensus.cc:2749] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:25:53.872746 32050 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.872890 32248 consensus_queue.cc:1059] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:53.873286 32050 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:53.873740 32248 raft_consensus.cc:3055] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:25:53.874125 32248 raft_consensus.cc:740] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:53.874941 32248 consensus_queue.cc:260] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:53.875496 25836 raft_consensus.cc:2468] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 18.
I20260709 12:25:53.824656 31457 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:53.873762 32189 consensus_queue.cc:1059] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.003s
I20260709 12:25:53.877108 32189 raft_consensus.cc:3055] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:25:53.877471 32189 raft_consensus.cc:740] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:53.877903 31457 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:53.878409 32189 consensus_queue.cc:260] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:53.879228 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:53.860296 32029 consensus_queue.cc:237] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:53.881986 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:53.878417 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:53.871794 25726 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:53.879715 32189 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:53.899111 25759 raft_consensus.cc:1275] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:25:53.899518 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:53.901590 25755 raft_consensus.cc:2468] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 16.
W20260709 12:25:53.917356 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:53.918179 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 52665us
W20260709 12:25:53.922772 25649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:53.897934 25760 raft_consensus.cc:2468] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 18.
I20260709 12:25:53.824285 32246 consensus_queue.cc:1059] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.073s
I20260709 12:25:53.845988 31537 raft_consensus.cc:2804] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:53.923813 26401 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:53.929410 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:53.892669 32103 raft_consensus.cc:697] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 14 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:53.941605 26401 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:25:53.945393 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 124051us
I20260709 12:25:53.925660 32089 raft_consensus.cc:2804] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:25:53.930923 32248 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:53.917091 32039 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:53.924111 31848 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:53.960918 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:25:53.961257 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 143425us
I20260709 12:25:53.938750 31457 raft_consensus.cc:3060] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:25:53.976320 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 104594us
I20260709 12:25:53.949151 31675 raft_consensus.cc:2804] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:53.946934 32258 raft_consensus.cc:2804] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:53.951074 32050 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:54.001942 25650 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:53.953366 32256 raft_consensus.cc:2804] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:54.029222 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
W20260709 12:25:54.005384 32260 log.cc:927] Time spent T 00000000000000000000000000000000 P 496fd6924b624e77b03ccfd15653d47b: Append to log took a long time: real 0.243s	user 0.003s	sys 0.000s
I20260709 12:25:54.006166 32269 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.016311 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:54.018808 32215 raft_consensus.cc:3055] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:54.022706 32103 consensus_queue.cc:237] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:54.023793 31675 raft_consensus.cc:697] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:54.025580 32206 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:54.027809 31848 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:53.996975 32258 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:54.030006 25760 raft_consensus.cc:3060] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:25:53.965060 32184 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:54.035038 26430 raft_consensus.cc:2368] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 15. Current term is 16.
I20260709 12:25:54.041638 26434 raft_consensus.cc:1240] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:54.077952 31680 raft_consensus.cc:3055] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:25:54.078212 32269 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:53.956573 31636 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:53.952845 32267 consensus_queue.cc:1059] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.091s
I20260709 12:25:54.081008 32241 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:54.098138 31972 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:54.098532 32206 raft_consensus.cc:2804] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:54.091842 32258 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:54.040797 32215 raft_consensus.cc:740] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:54.084286 32256 raft_consensus.cc:697] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 18 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
W20260709 12:25:54.101877 32208 consensus_meta.cc:287] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.501s	user 0.010s	sys 0.000s
I20260709 12:25:54.102697 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:54.091703 26437 raft_consensus.cc:1275] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 12:25:54.097919 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:54.138382 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:54.161759 26430 raft_consensus.cc:1275] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:25:54.096350 31680 raft_consensus.cc:740] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:54.155045 25832 raft_consensus.cc:1240] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 17. Current term is 18. Ops: []
W20260709 12:25:54.155884 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 165141us
I20260709 12:25:54.164311 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:54.168929 32089 raft_consensus.cc:697] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 19 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:54.144332 32206 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
W20260709 12:25:54.177148 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 202738us
I20260709 12:25:54.193282 25801 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:25:54.194145 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 203136us
I20260709 12:25:54.159148 31972 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
W20260709 12:25:54.208220 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:54.118587 32184 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:54.206348 25763 raft_consensus.cc:1275] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:25:54.168874 31537 raft_consensus.cc:697] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 18 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:54.208873 25801 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:25:54.213311 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 216583us
I20260709 12:25:54.244573 25758 raft_consensus.cc:1275] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:25:54.198536 32206 raft_consensus.cc:3060] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:54.241343 25650 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:25:54.254338 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 46020.5us
I20260709 12:25:54.259699 26402 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:54.159274 32241 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:54.274788 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 64673us
I20260709 12:25:54.312934 26402 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:54.246709 32088 raft_consensus.cc:2804] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:25:54.321033 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 64596.5us
I20260709 12:25:54.323777 25760 raft_consensus.cc:2468] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 16.
W20260709 12:25:54.325877 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 117098us
I20260709 12:25:54.326656 25801 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:54.317919 31848 raft_consensus.cc:2749] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:54.206284 31675 consensus_queue.cc:237] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:54.213838 31972 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:54.334225 26401 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:54.325265 32088 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:54.315840 32028 consensus_queue.cc:1048] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
W20260709 12:25:54.342495 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:54.328325 32039 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:54.246981 32215 consensus_queue.cc:260] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:54.350935 32288 raft_consensus.cc:2804] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:25:54.351528 32288 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:54.335093 32034 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:54.351972 32288 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:25:54.352284 32034 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:54.353799 32184 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:54.353996 32274 log.cc:927] Time spent T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
W20260709 12:25:54.360517 32279 log.cc:927] Time spent T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 12:25:54.361248 32292 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.361855 32292 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:54.364179 26439 raft_consensus.cc:2468] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 19.
I20260709 12:25:54.365213 32276 raft_consensus.cc:2804] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:54.346488 32088 raft_consensus.cc:3060] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:54.367625 31457 raft_consensus.cc:2749] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:54.368012 32276 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:54.376422 32276 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:54.377429 32241 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:54.378041 31537 consensus_queue.cc:237] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:54.378170 32258 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:54.381364 32284 consensus_queue.cc:1048] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 12:25:54.383322 32215 raft_consensus.cc:3060] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:54.373907 32088 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:54.342869 32029 raft_consensus.cc:2804] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:54.388347 32029 raft_consensus.cc:697] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 16 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:54.389642 32088 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:54.389278 32029 consensus_queue.cc:237] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:54.390203 32295 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.390690 32295 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:54.391220 32276 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:54.385632 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:54.392933 32295 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:54.393751 32276 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:54.394294 32269 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:54.337047 32259 raft_consensus.cc:2749] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:25:54.393613 32295 consensus_queue.cc:1048] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:25:54.381402 25801 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:54.269696 31680 consensus_queue.cc:260] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:54.407703 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:54.408427 25758 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:25:54.352200 32272 log.cc:927] Time spent T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:25:54.411846 32090 raft_consensus.cc:2749] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:25:54.413580 32088 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:54.414086 32088 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:54.414973 31972 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:54.416168 32088 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:54.314563 32256 consensus_queue.cc:237] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:54.408674 25801 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
W20260709 12:25:54.373234 32270 log.cc:927] Time spent T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
W20260709 12:25:54.375516 32277 log.cc:927] Time spent T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 12:25:54.368881 32005 raft_consensus.cc:3055] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:54.391575 32288 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 25 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:54.422032 31636 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:54.429854 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 101652us
I20260709 12:25:54.439491 32285 raft_consensus.cc:2749] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:54.441015 25801 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
W20260709 12:25:54.454522 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:54.456204 25801 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:54.409395 32292 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:54.425294 32005 raft_consensus.cc:740] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:54.346226 32089 consensus_queue.cc:237] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:54.446089 32208 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:54.458362 32090 raft_consensus.cc:2749] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:54.526026 25758 raft_consensus.cc:2468] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 20.
I20260709 12:25:54.504117 32276 raft_consensus.cc:2804] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:25:54.506618 32259 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.458534 32248 consensus_queue.cc:1059] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.074s
W20260709 12:25:54.529994 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 319789us
W20260709 12:25:54.534950 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 112671us
I20260709 12:25:54.536598 32276 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:54.537025 32182 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:54.580307 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:54.581739 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:54.582417 25760 raft_consensus.cc:2393] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 20: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:54.531546 31675 consensus_queue.cc:1048] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 12:25:54.580399 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:54.582927 25649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:54.586267 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:54.594020 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:54.594543 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:54.594882 25679 raft_consensus.cc:2468] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 13.
I20260709 12:25:54.557993 32184 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:54.559494 32281 raft_consensus.cc:2804] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:54.601109 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:54.617100 25685 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 16.
I20260709 12:25:54.598551 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:54.595198 25837 raft_consensus.cc:2468] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 17.
I20260709 12:25:54.609575 25681 raft_consensus.cc:3055] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:25:54.580382 32276 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:54.555688 32208 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:54.627584 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:54.614521 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:54.629014 25684 raft_consensus.cc:3060] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:54.619402 25681 raft_consensus.cc:740] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 21 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:54.611322 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 20 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:54.630142 25680 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:54.556994 32259 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:54.635908 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:54.584888 32034 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:54.648130 25837 raft_consensus.cc:1240] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 19 LEADER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 18. Current term is 19. Ops: []
I20260709 12:25:54.649520 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:54.584193 32273 consensus_queue.cc:1048] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.061s
I20260709 12:25:54.652962 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:54.650033 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:54.655506 25834 raft_consensus.cc:2393] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 19: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:54.656703 25685 raft_consensus.cc:3060] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:54.659261 25677 raft_consensus.cc:2468] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 19.
I20260709 12:25:54.610574 32182 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:54.583570 32005 consensus_queue.cc:260] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:54.652122 25681 consensus_queue.cc:260] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:54.688050 32296 log.cc:927] Time spent T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
W20260709 12:25:54.671051 32114 consensus_meta.cc:287] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.821s	user 0.011s	sys 0.002s
W20260709 12:25:54.684928 32301 log.cc:927] Time spent T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:25:54.694058 32206 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:54.663128 32189 consensus_meta.cc:287] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.739s	user 0.007s	sys 0.005s
I20260709 12:25:54.630908 32184 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:54.680961 32208 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:54.677556 32182 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:54.701360 25800 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:25:54.644255 32281 raft_consensus.cc:697] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 13 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:54.717177 32281 consensus_queue.cc:237] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:54.666201 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:54.720288 25678 raft_consensus.cc:3060] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:54.722219 25681 raft_consensus.cc:3060] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:25:54.695186 32259 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:54.671949 32288 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 25 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:54.724556 32288 raft_consensus.cc:2804] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:25:54.725045 32288 raft_consensus.cc:697] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 20 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:54.725896 32288 consensus_queue.cc:237] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 18.8, Last appended by leader: 8, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:54.728847 32271 log.cc:927] Time spent T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.473s	user 0.001s	sys 0.000s
I20260709 12:25:54.699029 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:54.730180 25756 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:25:54.734537 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:54.735716 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:54.736029 32184 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:54.691220 32258 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:54.734547 25684 raft_consensus.cc:2468] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 15.
I20260709 12:25:54.735657 25685 raft_consensus.cc:2468] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 18.
I20260709 12:25:54.740289 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:54.740804 25756 raft_consensus.cc:2468] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 18.
I20260709 12:25:54.736418 25682 raft_consensus.cc:2376] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 24 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 24. Re-sending same reply.
I20260709 12:25:54.744294 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 15 index: 15 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:54.745288 26433 raft_consensus.cc:2468] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 20.
I20260709 12:25:54.745584 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:54.746490 25682 raft_consensus.cc:2368] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 17. Current term is 18.
I20260709 12:25:54.747304 25680 raft_consensus.cc:2468] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 20.
I20260709 12:25:54.747720 26401 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:54.752054 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
W20260709 12:25:54.749017 32278 log.cc:927] Time spent T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.536s	user 0.004s	sys 0.000s
I20260709 12:25:54.747520 31584 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.754571 25678 raft_consensus.cc:2468] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 16.
I20260709 12:25:54.756343 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:54.756629 25681 raft_consensus.cc:1275] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 12. (term mismatch)
I20260709 12:25:54.757185 25681 pending_rounds.cc:85] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc: Aborting all ops after (but not including) 11
I20260709 12:25:54.757488 25681 pending_rounds.cc:107] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc: Aborting uncommitted NO_OP operation due to leader change: 21.12
I20260709 12:25:54.760447 25681 raft_consensus.cc:2889] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:54.761230 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:54.760371 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:54.762492 25680 raft_consensus.cc:3060] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:54.762516 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:54.751577 32184 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.762377 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:54.764163 32258 raft_consensus.cc:2804] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:54.761374 31584 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:54.770498 25685 raft_consensus.cc:2468] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 16.
I20260709 12:25:54.771157 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:25:54.773200 32299 log.cc:927] Time spent T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:25:54.822721 32258 raft_consensus.cc:697] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 18 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:54.826949 32258 consensus_queue.cc:237] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:54.828364 32005 raft_consensus.cc:3060] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:54.824590 31584 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:54.825062 25677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40230 (request call id 2015) took 1188 ms. Trace:
I20260709 12:25:54.831792 25677 rpcz_store.cc:276] 0709 12:25:53.637008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:53.671312 (+ 34304us) service_pool.cc:224] Handling call
0709 12:25:54.824834 (+1153522us) spinlock_profiling.cc:243] Waited 467 ms on lock 0x7b5400264dd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:54.824976 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1074703104}
I20260709 12:25:54.833257 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:54.834372 25677 raft_consensus.cc:2393] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 16: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
W20260709 12:25:54.834519 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 198386us
I20260709 12:25:54.834789 32307 consensus_queue.cc:1048] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:25:54.835405 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:54.780078 32184 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:54.782997 31680 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:54.836740 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:54.837368 25677 raft_consensus.cc:2376] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 16. Re-sending same reply.
I20260709 12:25:54.838207 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:54.839282 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:54.784984 32206 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:54.783630 32276 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:54.842911 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:54.843673 25759 raft_consensus.cc:3060] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:54.797783 25801 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:25:54.798419 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:54.800859 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:54.801152 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:54.848882 25681 raft_consensus.cc:2393] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 19: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:54.802127 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:54.804674 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:54.801167 25686 raft_consensus.cc:1240] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:54.807060 25680 raft_consensus.cc:2468] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 15.
W20260709 12:25:54.809301 26402 leader_election.cc:336] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 1.594s (SENT)
I20260709 12:25:54.791667 25683 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
mode: GRACEFUL
new_leader_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:49108
I20260709 12:25:54.814514 25679 raft_consensus.cc:1240] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 17. Current term is 18. Ops: []
I20260709 12:25:54.851699 25683 raft_consensus.cc:606] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Received request to transfer leadership to TS 5cccf20a8bff46dba6601f241d172b8a
W20260709 12:25:54.818647 32289 log.cc:927] Time spent T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.505s	user 0.000s	sys 0.002s
I20260709 12:25:54.804796 32050 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:54.846388 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:54.836117 25726 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:54.825347 25678 raft_consensus.cc:2468] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 15.
I20260709 12:25:54.825786 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:54.872063 25685 raft_consensus.cc:1275] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:25:54.822175 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:54.841297 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:54.873291 25682 raft_consensus.cc:2468] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 15.
I20260709 12:25:54.876780 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:54.879478 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:54.879993 31584 raft_consensus.cc:2804] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:54.880417 26434 raft_consensus.cc:2393] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 19: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:54.880657 31584 raft_consensus.cc:697] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 18 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:54.881771 31584 consensus_queue.cc:237] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.16, Last appended by leader: 16, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:54.857192 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:54.884271 25677 raft_consensus.cc:3060] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:54.857439 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:54.886291 26430 raft_consensus.cc:3060] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:54.858268 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:54.858738 32276 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:54.858942 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:54.859386 26402 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:54.859534 25832 raft_consensus.cc:1240] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 19. Current term is 20. Ops: []
I20260709 12:25:54.889463 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:54.888389 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:54.859586 25755 raft_consensus.cc:1275] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 12:25:54.861371 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 63666.8us
I20260709 12:25:54.873489 25763 raft_consensus.cc:2393] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 18: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:54.852231 25683 raft_consensus.cc:614] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:54.887053 25681 raft_consensus.cc:3060] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:54.892778 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:54.892978 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:54.894320 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:54.895116 25833 raft_consensus.cc:2393] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 19: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:54.896440 25829 raft_consensus.cc:1240] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 16. Current term is 17. Ops: []
W20260709 12:25:54.896513 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 87258us
W20260709 12:25:54.897344 26402 leader_election.cc:336] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 1.636s (SENT)
I20260709 12:25:54.897742 26402 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:54.897931 25757 raft_consensus.cc:1275] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:25:54.888386 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:54.898463 25684 raft_consensus.cc:1275] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:25:54.885782 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:54.898670 26433 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:54.890766 25836 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:54.904294 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:54.892426 25759 raft_consensus.cc:2410] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 19 because replica has last-logged OpId of term: 17 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 12:25:54.907330 25759 raft_consensus.cc:1275] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:25:54.916543 25761 raft_consensus.cc:2468] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 16.
I20260709 12:25:54.919092 25681 raft_consensus.cc:2468] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 16.
I20260709 12:25:54.920001 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:54.920589 25681 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:54.915740 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:54.923715 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:54.927228 25678 raft_consensus.cc:1275] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
W20260709 12:25:54.927430 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 91375.1us
I20260709 12:25:54.928335 25726 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:25:54.920506 25649 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:54.929893 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:54.932962 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:54.935446 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:54.935866 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:54.936664 26439 raft_consensus.cc:2368] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for earlier term 18. Current term is 19.
I20260709 12:25:54.944710 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:54.945001 25681 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 20.
I20260709 12:25:54.946249 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:54.945240 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:54.949309 25680 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 19.
I20260709 12:25:54.949970 25759 raft_consensus.cc:3055] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:25:54.946939 25833 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 20.
I20260709 12:25:54.944881 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:54.951252 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:54.945580 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:54.952504 26437 raft_consensus.cc:1240] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:54.952721 25726 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:54.953373 25759 raft_consensus.cc:740] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:54.953480 25686 raft_consensus.cc:2468] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 18.
I20260709 12:25:54.909237 32294 raft_consensus.cc:2749] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:25:54.955598 26433 raft_consensus.cc:2468] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 18.
I20260709 12:25:54.958488 25684 raft_consensus.cc:1240] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 18. Current term is 19. Ops: []
I20260709 12:25:54.960353 25684 raft_consensus.cc:1275] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:25:54.961360 26436 raft_consensus.cc:2393] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 19: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:54.961381 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:54.919875 32259 raft_consensus.cc:2749] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:54.967748 26439 raft_consensus.cc:2393] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 14: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
W20260709 12:25:54.968824 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:54.969873 25726 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:25:54.974794 25801 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:54.975708 25836 raft_consensus.cc:2468] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 18.
I20260709 12:25:54.977355 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:54.976491 25801 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:54.988027 25682 raft_consensus.cc:1275] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:25:54.956100 25759 consensus_queue.cc:260] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:54.981348 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:54.989401 25834 raft_consensus.cc:1275] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
W20260709 12:25:54.982038 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 84745.3us
I20260709 12:25:54.982776 25757 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 20.
W20260709 12:25:54.946452 25650 connection.cc:256] RPC call timeout handler was delayed by -1.2101090139999542s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16670000000000001s for a response
W20260709 12:25:54.990489 25650 connection.cc:256] RPC call timeout handler was delayed by -1.1831090139999105s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16970000000000002s for a response
W20260709 12:25:54.990804 25650 connection.cc:256] RPC call timeout handler was delayed by -1.1273090140002751s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1759s for a response
W20260709 12:25:54.991138 25650 connection.cc:256] RPC call timeout handler was delayed by -1.0211090140001033s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1877s for a response
I20260709 12:25:54.991765 25650 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:54.946843 32182 raft_consensus.cc:2804] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:54.946638 32028 raft_consensus.cc:2749] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:25:54.905278 32050 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:54.994282 25677 raft_consensus.cc:2468] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 17.
I20260709 12:25:55.000250 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:54.967221 32215 raft_consensus.cc:2804] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:54.950659 32283 consensus_queue.cc:1048] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 12:25:55.012800 25801 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:54.994717 25759 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:25:55.014856 32320 log.cc:927] Time spent T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 12:25:55.016089 26436 raft_consensus.cc:1240] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:54.992583 32248 raft_consensus.cc:2804] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:25:55.025575 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 55812.8us
I20260709 12:25:55.034852 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:55.035547 26439 raft_consensus.cc:2468] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 16.
I20260709 12:25:54.977613 32288 consensus_queue.cc:1048] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 12:25:54.995370 32090 raft_consensus.cc:2804] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:55.052476 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:55.052875 25726 leader_election.cc:400] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Vote denied by peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611) with higher term. Message: Invalid argument: T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 15. Current term is 16.
I20260709 12:25:55.053156 26438 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:25:55.053385 25726 leader_election.cc:403] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:55.026657 25677 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
mode: GRACEFUL
new_leader_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:49108
I20260709 12:25:55.054150 25677 raft_consensus.cc:606] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 20 LEADER]: Received request to transfer leadership to TS 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:54.992784 32286 consensus_queue.cc:1048] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:25:55.010540 32182 raft_consensus.cc:697] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 16 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:55.069243 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:55.070186 26439 raft_consensus.cc:2393] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 17: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:55.070533 25759 raft_consensus.cc:1275] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260709 12:25:55.071101 25650 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:55.072199 25759 pending_rounds.cc:85] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 10
I20260709 12:25:55.007483 32079 consensus_queue.cc:1048] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 12:25:54.995507 32292 consensus_queue.cc:1048] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 12:25:55.072877 25759 pending_rounds.cc:107] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260709 12:25:55.001880 32298 consensus_queue.cc:1059] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.057s
I20260709 12:25:55.074846 25726 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:25:55.036173 32215 raft_consensus.cc:697] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 17 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:55.073305 25759 raft_consensus.cc:2889] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:55.036538 32248 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:55.052713 32090 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:55.063686 32285 raft_consensus.cc:2804] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:25:55.097066 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 82848.3us
W20260709 12:25:55.077698 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 87258.7us
I20260709 12:25:55.045418 31636 raft_consensus.cc:2804] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Leader election won for term 20
W20260709 12:25:55.103686 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 59003us
I20260709 12:25:55.073248 32295 raft_consensus.cc:2749] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611) with higher term. Message: Invalid argument: T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 15. Current term is 16.
I20260709 12:25:55.106871 26436 raft_consensus.cc:1275] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:25:55.112494 26439 raft_consensus.cc:1275] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:25:55.060518 32294 consensus_queue.cc:1059] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 12:25:55.060213 32089 consensus_queue.cc:1048] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 12:25:55.095140 32248 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:25:55.098747 32090 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:55.075878 31675 consensus_queue.cc:1059] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.044s
W20260709 12:25:55.146728 26402 leader_election.cc:336] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 1.683s (SENT)
I20260709 12:25:55.147332 26402 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:55.133244 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:55.132638 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:25:55.100014 32285 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:55.107401 31636 raft_consensus.cc:697] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 20 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:55.149354 32285 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:25:55.149735 31636 consensus_queue.cc:237] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:55.115492 32208 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:55.151002 32208 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:55.088483 32307 consensus_queue.cc:1048] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.046s
I20260709 12:25:55.150234 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:55.104336 32311 raft_consensus.cc:2749] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:55.089205 32314 consensus_queue.cc:1048] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 12:25:55.091253 32268 consensus_queue.cc:1048] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
W20260709 12:25:55.162806 25649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:55.162793 25650 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:55.115876 32291 raft_consensus.cc:2749] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:55.138753 32246 raft_consensus.cc:2804] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:25:55.166615 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:55.169023 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:55.173460 25757 raft_consensus.cc:2410] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 20 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 12:25:55.155140 32184 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:55.158810 32029 raft_consensus.cc:2749] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:55.161509 32294 raft_consensus.cc:3055] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 LEADER]: Stepping down as leader of term 19
W20260709 12:25:55.192976 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 94473us
I20260709 12:25:55.176503 32282 raft_consensus.cc:2749] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:25:55.186309 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:55.205296 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:55.186391 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:55.182202 32208 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:55.181154 32246 raft_consensus.cc:697] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 19 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
W20260709 12:25:55.179842 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 105066us
W20260709 12:25:55.204731 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 63598.1us
I20260709 12:25:55.177251 31675 raft_consensus.cc:3055] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 12:25:55.185365 26402 leader_election.cc:336] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 1.865s (SENT)
I20260709 12:25:55.236315 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:55.219986 26430 raft_consensus.cc:2468] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 19.
I20260709 12:25:55.221053 25801 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:55.192852 32294 raft_consensus.cc:740] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:55.233353 25754 raft_consensus.cc:1275] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:25:55.230947 25757 raft_consensus.cc:1275] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:25:55.240629 25677 raft_consensus.cc:1240] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 19. Current term is 20. Ops: []
I20260709 12:25:55.243721 26433 raft_consensus.cc:2393] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 16: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:55.247614 25678 raft_consensus.cc:1240] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 18. Current term is 19. Ops: []
I20260709 12:25:55.249744 25726 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
W20260709 12:25:55.251211 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:55.252017 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 72926.5us
W20260709 12:25:55.252722 32318 log.cc:927] Time spent T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:25:55.253166 32259 consensus_queue.cc:1048] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:25:55.254667 32317 log.cc:927] Time spent T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:25:55.255240 32050 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:55.257263 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:55.259676 32285 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:55.260622 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:55.261689 32285 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 21 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:55.266337 32294 consensus_queue.cc:260] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:55.268473 32294 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:55.273039 32246 consensus_queue.cc:237] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:55.187237 32182 consensus_queue.cc:237] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:55.189859 32215 consensus_queue.cc:237] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:55.240346 31675 raft_consensus.cc:740] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:55.286754 31675 consensus_queue.cc:260] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:55.252748 26402 leader_election.cc:336] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Timed out: RequestConsensusVote RPC to 127.23.245.129:37349 timed out after 2.011s (SENT)
I20260709 12:25:55.288435 31675 raft_consensus.cc:3060] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:55.288746 26402 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:55.290387 32028 raft_consensus.cc:2749] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:55.291790 25650 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:25:55.295703 32321 log.cc:927] Time spent T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 12:25:55.297645 32327 log.cc:927] Time spent T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:25:55.301342 32285 raft_consensus.cc:2749] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:55.305883 25686 raft_consensus.cc:1240] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 16. Current term is 17. Ops: [16.15-16.15]
W20260709 12:25:55.305764 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 56121.5us
W20260709 12:25:55.305766 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 53065.1us
I20260709 12:25:55.306815 25726 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:55.311038 25726 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:55.305080 32307 raft_consensus.cc:2804] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:55.315510 25762 raft_consensus.cc:1275] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:25:55.314570 32295 raft_consensus.cc:2804] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:25:55.321278 32295 raft_consensus.cc:697] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:55.304370 32282 raft_consensus.cc:2749] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:55.322417 32050 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.322326 32295 consensus_queue.cc:237] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:55.323134 32050 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:55.314718 32297 raft_consensus.cc:2804] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:25:55.324483 32297 raft_consensus.cc:697] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:55.325289 32050 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:55.325881 32050 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.325462 32297 consensus_queue.cc:237] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:55.326377 32050 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:55.329439 32319 log.cc:927] Time spent T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
I20260709 12:25:55.252857 32029 consensus_queue.cc:1048] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.078s
I20260709 12:25:55.332190 32029 consensus_queue.cc:1048] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:55.338759 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:55.339052 26402 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
W20260709 12:25:55.341136 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 96545.3us
I20260709 12:25:55.345113 26438 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 25.
I20260709 12:25:55.344237 32050 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:55.316874 32307 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:55.367177 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 46646.2us
I20260709 12:25:55.368182 26402 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:55.386368 26402 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:55.362020 32028 raft_consensus.cc:2749] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:55.388849 25650 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:55.364895 32307 raft_consensus.cc:3060] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:55.401640 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 234131us
I20260709 12:25:55.388842 32304 raft_consensus.cc:2804] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:55.393226 32259 raft_consensus.cc:2749] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:25:55.398095 32089 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.397950 32331 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.402863 32029 raft_consensus.cc:2804] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:25:55.434151 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 45394us
I20260709 12:25:55.445184 25650 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
W20260709 12:25:55.449175 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 62912.2us
I20260709 12:25:55.458487 32208 raft_consensus.cc:2764] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:25:55.413962 32325 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:55.446620 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 208300us
I20260709 12:25:55.435124 32335 raft_consensus.cc:2749] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:25:55.468459 25801 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:55.472653 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:55.473268 25761 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:25:55.469491 32005 consensus_meta.cc:287] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.641s	user 0.014s	sys 0.000s
I20260709 12:25:55.495303 32005 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.495887 32005 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:55.498029 32005 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:55.451287 32029 raft_consensus.cc:697] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 16 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:55.499879 32029 consensus_queue.cc:237] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:55.507265 25760 raft_consensus.cc:1275] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:25:55.511061 32259 consensus_queue.cc:1048] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:25:55.479624 32332 consensus_queue.cc:1048] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 12:25:55.442313 32331 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:55.471271 32334 raft_consensus.cc:2804] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:55.488463 25650 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:55.489611 26402 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:55.492374 32028 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:55.436086 32089 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:55.533262 25761 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 21.
W20260709 12:25:55.534035 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 44512us
W20260709 12:25:55.566165 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:55.585052 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 45705.1us
I20260709 12:25:55.471868 32325 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:55.589196 26402 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:55.581956 32295 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.580647 32334 raft_consensus.cc:697] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 18 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:55.582170 32281 raft_consensus.cc:2764] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
W20260709 12:25:55.589221 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 118332us
I20260709 12:25:55.614240 25801 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:55.596836 25836 raft_consensus.cc:1275] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 12:25:55.605314 25726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:55.616194 25726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:55.586194 32215 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.617280 32331 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:55.616850 32215 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:55.611896 25829 raft_consensus.cc:1275] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:25:55.540141 32028 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:55.592847 32330 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.640413 25801 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:25:55.642525 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 154159us
I20260709 12:25:55.643862 25650 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:55.645430 25801 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:25:55.648124 25679 raft_consensus.cc:1275] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:25:55.627684 32050 raft_consensus.cc:2749] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:55.638098 31537 raft_consensus.cc:3055] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:55.637887 32332 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.642802 31825 raft_consensus.cc:3060] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:55.658811 25650 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:55.664608 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:55.669421 25681 raft_consensus.cc:1275] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 17 index: 7. Preceding OpId from leader: term: 20 index: 9. (index mismatch)
I20260709 12:25:55.669958 32356 raft_consensus.cc:2749] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:25:55.670389 32307 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:55.670953 25678 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:55.663546 32332 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:55.672629 32342 log.cc:927] Time spent T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 12:25:55.672446 32334 consensus_queue.cc:237] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:55.673569 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:55.674211 25677 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:25:55.660094 32103 raft_consensus.cc:2804] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:25:55.641021 32248 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:55.675004 32103 raft_consensus.cc:697] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 25 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:55.675881 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:55.675767 25759 raft_consensus.cc:1240] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 20. Current term is 21. Ops: []
I20260709 12:25:55.662387 32336 raft_consensus.cc:2749] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:25:55.676028 32103 consensus_queue.cc:237] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:55.676476 25679 raft_consensus.cc:2468] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 15.
I20260709 12:25:55.649037 32283 raft_consensus.cc:2804] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:25:55.676707 26439 raft_consensus.cc:1275] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:25:55.665217 26436 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 20.
I20260709 12:25:55.677309 32283 raft_consensus.cc:697] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 19 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:55.678223 25758 raft_consensus.cc:1240] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 13. Current term is 14. Ops: [13.10-13.10]
W20260709 12:25:55.674964 32090 consensus_meta.cc:287] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.517s	user 0.006s	sys 0.009s
I20260709 12:25:55.678347 32283 consensus_queue.cc:237] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:55.678795 32090 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:55.651468 32351 consensus_queue.cc:1048] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 12:25:55.681118 32028 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:55.681519 32215 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:55.697005 32340 log.cc:927] Time spent T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
I20260709 12:25:55.612102 32295 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:55.701931 25650 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:55.703235 25650 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:55.703784 32295 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:55.705132 32348 log.cc:927] Time spent T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:25:55.705498 32273 raft_consensus.cc:2749] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:55.706218 32273 raft_consensus.cc:2749] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:55.709522 25650 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:55.712268 25677 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 21.
I20260709 12:25:55.714723 25678 raft_consensus.cc:1275] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:25:55.727999 25650 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:55.653064 32259 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.740492 25680 raft_consensus.cc:1275] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:25:55.653887 31537 raft_consensus.cc:740] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:55.741827 25683 raft_consensus.cc:1275] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 12:25:55.745188 25726 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:55.748337 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:55.752944 25681 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 19.
I20260709 12:25:55.748716 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:25:55.738250 32321 log.cc:927] Time spent T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:25:55.761459 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 20 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:55.763047 25679 raft_consensus.cc:2410] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 20 because replica has last-logged OpId of term: 18 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
I20260709 12:25:55.728775 32273 raft_consensus.cc:2764] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 12:25:55.641774 32330 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:55.767573 25828 raft_consensus.cc:1275] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:25:55.769006 25650 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:55.660472 32314 consensus_queue.cc:1048] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.096s
W20260709 12:25:55.770365 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 196016us
I20260709 12:25:55.748821 32282 raft_consensus.cc:2749] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:55.779693 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:55.731556 32182 consensus_queue.cc:1059] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:25:55.781056 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:25:55.771721 32338 log.cc:927] Time spent T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
I20260709 12:25:55.769342 31457 raft_consensus.cc:2749] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:25:55.786413 25650 leader_election.cc:400] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 election: Vote denied by peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611) with higher term. Message: Invalid argument: T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for earlier term 18. Current term is 19.
I20260709 12:25:55.793426 25650 leader_election.cc:403] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 12:25:55.796494 26402 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:55.759462 32208 consensus_queue.cc:1048] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.026s
I20260709 12:25:55.750722 32259 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:55.776486 32089 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:55.785087 32206 raft_consensus.cc:2749] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:25:55.803141 25650 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:55.795591 32184 raft_consensus.cc:3055] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:55.796716 32354 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.809625 25650 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:55.811662 26430 raft_consensus.cc:1275] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 12:25:55.812762 26430 pending_rounds.cc:85] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89: Aborting all ops after (but not including) 12
I20260709 12:25:55.813079 26430 pending_rounds.cc:107] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 12:25:55.813397 26430 raft_consensus.cc:2889] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:55.815048 25650 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:55.815975 32354 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:55.804265 32182 raft_consensus.cc:2749] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611) with higher term. Message: Invalid argument: T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for earlier term 18. Current term is 19.
I20260709 12:25:55.805513 31825 raft_consensus.cc:2749] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:55.823146 26402 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:55.810527 32349 raft_consensus.cc:2749] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:55.809304 32184 raft_consensus.cc:740] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:55.827366 26402 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:55.812332 32206 raft_consensus.cc:2749] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:55.817328 31457 raft_consensus.cc:2749] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:25:55.849941 25832 raft_consensus.cc:1240] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:55.859841 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:55.854018 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
W20260709 12:25:55.881892 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 66907.2us
I20260709 12:25:55.884665 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:55.886044 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:55.886684 25684 raft_consensus.cc:2468] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 19.
I20260709 12:25:55.885627 25650 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:55.808660 32357 consensus_queue.cc:1059] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 12:25:55.885283 25683 raft_consensus.cc:2468] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 14.
I20260709 12:25:55.850831 32282 raft_consensus.cc:2804] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:55.916625 32282 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:55.916669 32357 raft_consensus.cc:3055] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:25:55.917224 32282 raft_consensus.cc:3060] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:55.917352 32357 raft_consensus.cc:740] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:55.918725 32357 consensus_queue.cc:260] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 17.16, Last appended by leader: 16, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:55.920553 32357 raft_consensus.cc:3060] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:55.878333 32028 raft_consensus.cc:2804] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:25:55.924252 32028 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:55.924773 32028 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:55.928345 26434 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 1538) took 1047 ms. Trace:
I20260709 12:25:55.851639 32298 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.823940 32336 consensus_queue.cc:1059] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.064s
I20260709 12:25:55.882910 32005 consensus_queue.cc:1048] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:25:55.879712 32288 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:55.855405 25801 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:55.812093 31537 consensus_queue.cc:260] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:55.909305 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 45621.8us
I20260709 12:25:55.852146 32337 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.882005 32050 consensus_queue.cc:1048] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
W20260709 12:25:55.931077 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 45539.7us
W20260709 12:25:55.933092 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 77785us
I20260709 12:25:55.928759 26434 rpcz_store.cc:276] 0709 12:25:54.881384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:54.883732 (+  2348us) service_pool.cc:224] Handling call
0709 12:25:54.894074 (+ 10342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:55.045074 (+151000us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:55.045106 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:55.068958 (+ 23852us) log.cc:844] Serialized 26 byte log entry
0709 12:25:55.409621 (+340663us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:25:55.532387 (+122766us) log.cc:844] Serialized 14 byte log entry
0709 12:25:55.586343 (+ 53956us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:55.927849 (+341506us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54004c8bd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:55.927939 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:55.927996 (+    57us) raft_consensus.cc:1685] finished
0709 12:25:55.928102 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:55.928284 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23262,"prepare.queue_time_us":261626,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":105615,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":3523,"spinlock_wait_cycles":346645760,"thread_start_us":416406,"threads_started":3,"wal-append.queue_time_us":389373}
I20260709 12:25:55.928041 32355 raft_consensus.cc:2749] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:55.881618 32356 consensus_queue.cc:1048] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 12:25:55.935068 26402 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:25:55.988785 32361 log.cc:927] Time spent T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 12:25:55.937733 31584 raft_consensus.cc:2804] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Leader election won for term 21
W20260709 12:25:55.989261 32350 log.cc:927] Time spent T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
W20260709 12:25:55.985129 32363 log.cc:927] Time spent T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
W20260709 12:25:56.048230 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 111282us
I20260709 12:25:55.934608 32369 raft_consensus.cc:2749] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:25:56.050387 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 115403us
I20260709 12:25:56.051608 32374 raft_consensus.cc:2804] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:55.936738 32330 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:56.059583 32079 consensus_queue.cc:1048] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:25:56.063686 32351 consensus_queue.cc:1048] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:25:56.065959 32292 consensus_queue.cc:1048] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:56.067348 32304 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:56.067767 25801 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:56.070752 32354 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:55.937734 32337 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:56.073400 32282 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:55.936292 32288 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:56.075904 32206 consensus_queue.cc:1048] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
I20260709 12:25:56.080281 31584 raft_consensus.cc:697] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 21 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:56.080403 32090 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:55.935010 32298 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:56.101120 32248 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 21 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:56.101504 32298 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:55.929168 32184 consensus_queue.cc:260] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:56.090620 32366 log.cc:927] Time spent T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.160s	user 0.001s	sys 0.006s
I20260709 12:25:56.095515 32259 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:56.084103 32028 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:56.105033 32362 log.cc:927] Time spent T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.204s	user 0.002s	sys 0.005s
I20260709 12:25:56.106463 32028 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:56.108604 32332 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:56.082583 25650 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:56.078405 31537 raft_consensus.cc:3060] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:56.111608 31584 consensus_queue.cc:237] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:56.089200 32304 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:56.115288 32337 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:56.092911 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:56.116247 26436 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 19.
I20260709 12:25:56.093442 32374 raft_consensus.cc:697] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 17 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:56.117811 32374 consensus_queue.cc:237] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:56.094184 32282 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:56.121661 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:56.122416 26434 raft_consensus.cc:2393] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 19: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
W20260709 12:25:56.129244 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 46761.7us
I20260709 12:25:56.130537 25650 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:56.089888 25801 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:56.094667 32089 raft_consensus.cc:2804] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:56.098516 26433 raft_consensus.cc:1240] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 17. Current term is 18. Ops: [15.12-17.13]
I20260709 12:25:56.098625 26402 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:56.088376 32103 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:56.161522 32356 raft_consensus.cc:2749] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:56.161607 32103 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:56.152678 32368 log.cc:927] Time spent T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 12:25:56.154542 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 55978us
W20260709 12:25:56.164052 32365 log.cc:927] Time spent T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.203s	user 0.005s	sys 0.002s
I20260709 12:25:56.152982 32282 raft_consensus.cc:2749] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:25:56.160403 32089 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:56.165140 32089 raft_consensus.cc:3060] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:56.155427 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:25:56.168617 32375 log.cc:927] Time spent T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:25:56.146303 32326 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:56.128379 32360 log.cc:927] Time spent T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.169s	user 0.000s	sys 0.007s
I20260709 12:25:56.169234 32326 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:56.171365 32326 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:56.161038 32324 raft_consensus.cc:2804] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:25:56.156546 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 66722.7us
I20260709 12:25:56.163791 25650 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:56.176257 26434 raft_consensus.cc:1275] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:25:56.177404 25650 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:56.183593 32288 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:56.197799 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:56.201043 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:56.201690 25681 raft_consensus.cc:2376] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 16. Re-sending same reply.
I20260709 12:25:56.203419 26433 raft_consensus.cc:1275] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:25:56.204564 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:56.205214 25684 raft_consensus.cc:2468] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 14.
I20260709 12:25:56.205470 32324 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:56.206135 32324 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:56.207181 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:56.208424 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:56.209527 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:56.210071 25680 raft_consensus.cc:2376] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 16. Re-sending same reply.
I20260709 12:25:56.216241 25679 raft_consensus.cc:1275] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:25:56.172416 32206 raft_consensus.cc:2749] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:56.217538 26430 raft_consensus.cc:1275] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 12:25:56.217743 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:56.218869 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:25:56.227375 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 482387us
I20260709 12:25:56.178597 32282 raft_consensus.cc:2749] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:25:56.227321 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 45767.2us
I20260709 12:25:56.221909 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:56.235337 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:56.212158 32208 raft_consensus.cc:2749] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:56.236747 25801 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:25:56.239593 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:56.240473 25680 raft_consensus.cc:2468] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 19.
I20260709 12:25:56.240957 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:56.241503 25681 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:56.241688 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:56.254135 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:56.254446 25650 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:56.257238 25758 raft_consensus.cc:1275] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:25:56.262701 25726 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:56.236521 32314 raft_consensus.cc:2804] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:56.272542 25681 raft_consensus.cc:2468] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 20.
I20260709 12:25:56.280366 25685 raft_consensus.cc:2376] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 15. Re-sending same reply.
I20260709 12:25:56.282858 25726 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:56.283367 26402 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:56.287132 26402 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:56.288542 25834 raft_consensus.cc:1240] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 18 LEADER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 12:25:56.269806 32335 raft_consensus.cc:2749] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:25:56.268504 32294 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.276701 31457 consensus_queue.cc:1059] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 12:25:56.278623 32314 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:56.288555 32282 consensus_queue.cc:1048] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.014s
I20260709 12:25:56.262105 32281 consensus_queue.cc:1048] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 12:25:56.301018 25650 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:56.313465 32273 consensus_queue.cc:1048] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:25:56.313759 32337 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.315883 32337 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:56.318125 32337 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:56.302685 31680 raft_consensus.cc:2749] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:25:56.324301 31457 raft_consensus.cc:2749] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:25:56.269155 32005 consensus_queue.cc:1048] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 12:25:56.293377 32373 raft_consensus.cc:2749] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:56.288975 32330 raft_consensus.cc:2804] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:25:56.305200 32314 raft_consensus.cc:3060] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:56.353314 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:56.355890 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:56.299835 32374 raft_consensus.cc:2804] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:56.301833 32294 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:56.305799 32206 consensus_queue.cc:1048] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.056s
I20260709 12:25:56.339870 32330 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:56.375487 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 92693.3us
W20260709 12:25:56.384619 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 94198.6us
I20260709 12:25:56.386561 26402 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:56.390401 32373 raft_consensus.cc:2804] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:25:56.390964 32373 raft_consensus.cc:697] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 20 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:56.391824 32373 consensus_queue.cc:237] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:56.387238 25726 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:56.364264 32374 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:56.401193 31680 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:56.403340 32374 raft_consensus.cc:3060] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:56.409250 31680 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:56.385100 32330 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:56.364365 32336 consensus_queue.cc:1048] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
W20260709 12:25:56.413173 32378 log.cc:927] Time spent T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:25:56.389549 32248 consensus_queue.cc:1059] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 12:25:56.428177 32384 raft_consensus.cc:2804] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:25:56.434890 32384 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:56.435381 32384 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:56.443039 31680 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:56.397719 32029 consensus_queue.cc:1048] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:25:56.445421 32103 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:56.452572 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 173367us
I20260709 12:25:56.456506 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:56.457530 25685 raft_consensus.cc:1275] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:25:56.465461 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:56.466666 25677 raft_consensus.cc:1240] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:56.468861 32297 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:56.469794 25678 raft_consensus.cc:1275] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:25:56.493093 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:56.493778 25678 raft_consensus.cc:2468] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 17.
I20260709 12:25:56.496878 25681 raft_consensus.cc:1240] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 12:25:56.500389 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:56.501082 25678 raft_consensus.cc:2468] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 16.
I20260709 12:25:56.458781 32089 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:56.515087 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 214129us
I20260709 12:25:56.517516 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:56.521603 25828 raft_consensus.cc:1240] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:56.478736 32297 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:56.511425 32248 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
W20260709 12:25:56.538859 32393 log.cc:927] Time spent T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:25:56.532408 32387 consensus_queue.cc:1059] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:25:56.533615 32335 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.533866 32294 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:56.534857 32374 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:56.536011 32396 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:56.513294 32373 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:56.538502 32089 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:56.522194 32215 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.547122 32294 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:56.553320 32005 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:56.580560 32403 consensus_queue.cc:1048] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:56.583837 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:56.587677 25828 raft_consensus.cc:2468] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 16.
I20260709 12:25:56.539177 32248 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:56.590834 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:56.555505 32385 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.594151 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:56.594251 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:56.599272 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:56.576488 32258 consensus_queue.cc:1048] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 12:25:56.559535 32373 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:56.604419 25836 raft_consensus.cc:1275] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:25:56.576960 32304 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:56.577828 32215 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:56.577198 32294 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:56.606983 32381 log.cc:927] Time spent T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 12:25:56.607342 32386 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:56.555444 32396 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:56.617717 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:56.618120 25828 raft_consensus.cc:1275] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:25:56.545828 32335 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:56.633055 25682 raft_consensus.cc:1240] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:56.633672 32335 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:56.635650 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:56.635998 31680 raft_consensus.cc:3055] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:25:56.636490 31680 raft_consensus.cc:740] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:56.637442 25685 raft_consensus.cc:1275] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:25:56.637339 31680 consensus_queue.cc:260] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:56.638691 31680 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:56.640209 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:56.640556 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:56.629860 32386 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:56.641016 32304 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:56.642700 25829 raft_consensus.cc:2393] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 16: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:56.642680 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:56.592964 32005 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:56.646266 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:56.648250 25678 raft_consensus.cc:2468] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 17.
I20260709 12:25:56.648161 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:56.596546 32385 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:56.662556 25834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44218 (request call id 2102) took 1068 ms. Trace:
I20260709 12:25:56.663170 25834 rpcz_store.cc:276] 0709 12:25:55.588485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:55.588659 (+   174us) service_pool.cc:224] Handling call
0709 12:25:55.599905 (+ 11246us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:56.290020 (+690115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:56.651858 (+361838us) spinlock_profiling.cc:243] Waited 685 ms on lock 0x7b54004218d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:56.656975 (+  5117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1576576256}
I20260709 12:25:56.651746 32005 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:56.693929 32371 raft_consensus.cc:3055] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:56.694420 32371 raft_consensus.cc:740] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:56.695060 32283 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:56.695647 32283 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:56.698585 32283 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:56.686995 32324 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:56.710508 25835 raft_consensus.cc:2393] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 20: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:56.711392 32324 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:56.712131 32384 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:56.714591 32330 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:56.717535 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:56.726730 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:56.728338 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:56.732861 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:56.733393 26437 raft_consensus.cc:1240] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 20 LEADER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 12:25:56.733485 26433 raft_consensus.cc:2468] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 16.
I20260709 12:25:56.734974 26430 raft_consensus.cc:1275] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 18 index: 17. (index mismatch)
I20260709 12:25:56.735136 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:56.737747 32184 raft_consensus.cc:3060] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:56.739526 26436 raft_consensus.cc:2393] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 20: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:56.744047 25763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 3196) took 1146 ms. Trace:
I20260709 12:25:56.744441 25763 rpcz_store.cc:276] 0709 12:25:55.597940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:55.598063 (+   123us) service_pool.cc:224] Handling call
0709 12:25:55.598322 (+   259us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:55.619760 (+ 21438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:55.619795 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:55.620376 (+   581us) log.cc:844] Serialized 26 byte log entry
0709 12:25:55.735399 (+115023us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:55.735456 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:56.743678 (+1008222us) spinlock_profiling.cc:243] Waited 21 ms on lock 0x7b5400298e54. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:56.743720 (+    42us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:56.743761 (+    41us) raft_consensus.cc:1685] finished
0709 12:25:56.743773 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:56.743975 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7795,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":9234,"spinlock_wait_cycles":48352256,"thread_start_us":114544,"threads_started":1,"wal-append.queue_time_us":178750}
I20260709 12:25:56.751215 32325 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:56.760385 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:56.760646 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:56.763720 26432 raft_consensus.cc:1275] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:25:56.763998 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:56.765869 25801 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:56.766132 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:56.768558 25801 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:56.778374 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:56.782302 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:56.786087 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:56.782141 32385 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:56.770810 32089 raft_consensus.cc:2749] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:25:56.825870 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:56.801461 32286 raft_consensus.cc:2804] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:56.771307 32324 consensus_queue.cc:1048] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 12:25:56.792659 32005 consensus_queue.cc:1059] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 12:25:56.827840 32351 consensus_queue.cc:1059] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 12:25:56.828459 32371 consensus_queue.cc:260] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:56.836683 32411 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:56.837090 32286 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:56.839947 32352 raft_consensus.cc:2804] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:25:56.855954 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:56.856923 25681 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:56.836755 31537 consensus_queue.cc:1048] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.017s
I20260709 12:25:56.866601 25683 raft_consensus.cc:1275] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:25:56.854715 32286 raft_consensus.cc:3060] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:56.867473 25679 raft_consensus.cc:2410] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260709 12:25:56.865410 32324 consensus_queue.cc:1048] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 12:25:56.856518 32351 consensus_queue.cc:1243] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer a866ff967d964388a6f0dff7fd43df89 log is divergent from this leader: its last log entry 20.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:25:56.866694 25801 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:56.864621 32371 raft_consensus.cc:3060] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:56.879587 25801 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:56.867671 32410 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.886646 25681 raft_consensus.cc:2468] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 20.
I20260709 12:25:56.878162 32324 raft_consensus.cc:2804] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:56.908818 32324 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:56.909307 32324 raft_consensus.cc:3060] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:56.887702 32416 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:56.910306 32416 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:56.911695 32373 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:56.868813 32415 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
W20260709 12:25:56.878342 32314 consensus_meta.cc:287] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.507s	user 0.011s	sys 0.001s
I20260709 12:25:56.912714 32416 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:56.912966 32314 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:56.914172 26402 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:56.914990 32357 raft_consensus.cc:2804] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:56.912905 32415 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:56.915410 32357 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:56.915846 32357 raft_consensus.cc:3060] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:56.917266 32415 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:56.854907 32411 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:56.919694 32411 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:56.906543 25833 raft_consensus.cc:1240] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:56.893155 32090 raft_consensus.cc:2804] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:56.906945 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:56.893308 32351 consensus_queue.cc:1059] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 12:25:56.915161 32314 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:56.893054 31680 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:56.901562 25759 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 3533) took 1733 ms. Trace:
I20260709 12:25:56.921109 25801 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:56.922019 32373 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.921742 31537 consensus_queue.cc:1048] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:25:56.943138 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:56.941267 32416 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:56.943959 26439 raft_consensus.cc:2393] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 25: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:56.944911 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:56.923779 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:56.941130 25759 rpcz_store.cc:276] 0709 12:25:55.167947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:55.168064 (+   117us) service_pool.cc:224] Handling call
0709 12:25:55.168320 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:55.676521 (+508201us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:56.901275 (+1224754us) spinlock_profiling.cc:243] Waited 507 ms on lock 0x7b54001e6754. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:56.901491 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1166608768}
I20260709 12:25:56.928479 32090 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:56.940352 32089 raft_consensus.cc:2804] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:56.940199 31680 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:56.942426 26432 raft_consensus.cc:1240] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:56.925191 26402 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:56.950502 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:56.954265 25754 raft_consensus.cc:1275] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 18 index: 8. Preceding OpId from leader: term: 20 index: 9. (index mismatch)
I20260709 12:25:56.957566 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 20 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:56.958460 32357 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:56.941735 32314 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.959481 32416 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:56.931264 32282 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:56.900403 32410 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:56.964116 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:56.965554 26401 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:56.960129 32090 raft_consensus.cc:3060] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:56.940896 32411 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.985112 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:56.992009 32282 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:56.994201 32282 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:56.994833 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:56.954667 32089 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:57.000149 32089 raft_consensus.cc:3060] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:57.005569 25677 raft_consensus.cc:1275] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:25:57.005733 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:57.007272 25757 raft_consensus.cc:2468] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 13.
I20260709 12:25:57.006537 25833 raft_consensus.cc:2468] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 19.
I20260709 12:25:57.009639 25726 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:57.010896 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:57.011998 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 86875us
I20260709 12:25:57.039680 25677 raft_consensus.cc:1275] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:25:57.042583 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:57.034081 25650 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:57.030907 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:57.039474 26402 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:57.057142 25726 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:56.960827 32373 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:56.980425 32314 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:56.999694 32324 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:57.062408 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:57.062069 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 96595.4us
I20260709 12:25:57.038884 32418 raft_consensus.cc:2749] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:57.004783 32411 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:57.039076 32415 consensus_queue.cc:1048] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.045s
I20260709 12:25:57.054042 32403 consensus_queue.cc:1059] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 12:25:57.061997 25726 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:57.103056 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:57.125790 25759 raft_consensus.cc:2468] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 15.
I20260709 12:25:57.056072 32184 raft_consensus.cc:2804] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:25:57.101138 32426 raft_consensus.cc:2749] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:25:57.155983 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:57.058430 32420 raft_consensus.cc:2749] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:57.064098 32414 raft_consensus.cc:2749] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:25:57.109197 32357 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:57.148865 32184 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.061084 32328 consensus_queue.cc:1048] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.103s
I20260709 12:25:57.064797 32397 consensus_queue.cc:1048] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.101s
I20260709 12:25:57.174835 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:57.175140 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:57.179648 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:57.180234 25678 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:57.141669 32408 consensus_queue.cc:1048] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 12:25:57.171867 32206 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.185386 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:57.173391 32184 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:57.183305 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:57.181627 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:57.190665 25685 raft_consensus.cc:2468] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 17.
W20260709 12:25:57.194017 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 132078us
I20260709 12:25:57.164743 32286 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:57.176446 31680 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:57.198082 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:57.181124 32414 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:57.201455 25683 raft_consensus.cc:2393] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 20: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:57.204247 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:57.189947 32416 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:57.205987 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:57.237470 25761 raft_consensus.cc:1275] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 12. (term mismatch)
I20260709 12:25:57.238901 25761 pending_rounds.cc:85] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 11
I20260709 12:25:57.241282 25761 pending_rounds.cc:107] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260709 12:25:57.241588 25761 raft_consensus.cc:2889] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:57.247404 25678 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 20.
I20260709 12:25:57.207960 32276 raft_consensus.cc:3055] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:57.202481 31680 raft_consensus.cc:2749] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:25:57.191890 32206 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:57.243347 32373 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:57.248692 32276 raft_consensus.cc:740] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:57.205900 32414 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:57.262755 32276 consensus_queue.cc:260] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:57.250284 32416 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:57.252321 32436 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:57.264231 32410 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:57.264236 32276 raft_consensus.cc:3060] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:57.266093 32206 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:57.206449 32208 consensus_queue.cc:1059] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 20.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.055s
I20260709 12:25:57.267292 32208 raft_consensus.cc:3055] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:25:57.267652 32208 raft_consensus.cc:740] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 20 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:57.268679 32208 consensus_queue.cc:260] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:57.263855 32414 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:57.264631 32416 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:57.273706 32352 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:57.274199 32352 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:25:57.275367 32416 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:57.256561 32314 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:57.265305 32436 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:57.279423 32330 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 20 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:57.252712 32328 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:57.280237 32436 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:57.280448 32328 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:57.282584 32328 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:57.260614 32324 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:57.208300 32298 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.260392 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:57.253299 32425 log.cc:927] Time spent T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
W20260709 12:25:57.303452 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 100202us
W20260709 12:25:57.252413 32421 log.cc:927] Time spent T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:25:57.308544 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:57.310901 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:25:57.378979 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 285899us
I20260709 12:25:57.295487 32208 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:25:57.254653 32286 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:57.387111 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:57.392632 25681 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 20.
I20260709 12:25:57.389853 32410 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:57.394678 32410 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:57.396944 32428 raft_consensus.cc:2749] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:25:57.301106 32298 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:57.397989 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:57.398742 25757 raft_consensus.cc:2393] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 20: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:57.399029 32298 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:57.399480 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
W20260709 12:25:57.390430 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 351052us
W20260709 12:25:57.391103 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 85858.4us
I20260709 12:25:57.401110 25650 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:57.404219 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:57.404829 25761 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 20.
I20260709 12:25:57.404105 25757 raft_consensus.cc:2393] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 20: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:57.260427 32411 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:57.405495 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:25:57.390269 32363 log.cc:927] Time spent T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 12:25:57.413091 25650 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:57.428906 25726 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:57.443382 25726 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:57.405014 32435 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:57.447894 25726 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:57.428054 32439 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:25:57.452255 32407 raft_consensus.cc:2804] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:57.436915 32436 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:57.436324 32413 consensus_queue.cc:1059] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 12:25:57.452589 32411 raft_consensus.cc:2804] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:25:57.489009 32386 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:57.489729 32386 raft_consensus.cc:2749] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:25:57.459729 32090 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:57.494071 32090 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:57.498600 32426 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.447240 32442 consensus_queue.cc:1048] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.053s
I20260709 12:25:57.451606 32435 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:57.504066 32435 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:57.513137 32445 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:57.505993 25649 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:57.514074 32410 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:57.469472 32407 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.472404 32415 raft_consensus.cc:2804] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:25:57.514958 32407 raft_consensus.cc:3060] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:57.515131 32415 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.515545 32415 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:25:57.520331 32418 raft_consensus.cc:3055] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 12:25:57.520644 32089 consensus_meta.cc:287] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.520s	user 0.011s	sys 0.000s
I20260709 12:25:57.520793 32418 raft_consensus.cc:740] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:57.521330 32089 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:57.521818 32418 consensus_queue.cc:260] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:57.523144 32418 raft_consensus.cc:3060] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:25:57.523411 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:57.513844 32445 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:57.575506 32304 raft_consensus.cc:2804] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:25:57.528496 32089 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:57.523983 32411 raft_consensus.cc:697] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 20 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:57.487502 32184 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:57.578632 25801 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.004s	sys 0.013s
W20260709 12:25:57.584767 25801 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.004s	sys 0.014s
W20260709 12:25:57.585566 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 540021us
W20260709 12:25:57.594856 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 169153us
I20260709 12:25:57.595690 25650 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:57.620085 26430 raft_consensus.cc:1275] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:25:57.620518 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:57.620158 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:57.622140 25677 raft_consensus.cc:1275] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:25:57.623476 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:57.626628 26430 raft_consensus.cc:1275] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:25:57.628782 25685 raft_consensus.cc:1240] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 19. Current term is 20. Ops: []
I20260709 12:25:57.630139 25801 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:57.613438 31680 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:57.581996 32304 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.480261 32436 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:57.523149 32357 consensus_queue.cc:1059] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.099s
I20260709 12:25:57.499130 32426 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:57.636780 31680 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:57.612190 32356 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.620285 32298 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:57.622491 32103 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.620061 32090 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.645017 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:25:57.647459 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 126853us
I20260709 12:25:57.620025 32410 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:57.648347 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:57.649637 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:57.634689 32304 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:25:57.651386 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:57.652083 32426 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:57.653059 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:57.655937 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:57.656015 32090 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:57.657473 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:57.658000 26437 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:57.658221 32090 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:57.659080 32294 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:57.636122 32089 consensus_queue.cc:1048] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 12:25:57.662639 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:57.664269 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:57.664326 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:57.664970 26432 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 18.
I20260709 12:25:57.667677 31680 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:57.668102 32443 raft_consensus.cc:2804] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:25:57.668733 32443 raft_consensus.cc:697] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 20 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:57.669658 32443 consensus_queue.cc:237] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:57.671185 32184 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 20 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:57.671797 32215 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:57.650458 32298 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:57.672739 32374 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:57.674762 32298 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:57.676052 32410 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:57.677270 26430 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 14.
I20260709 12:25:57.678473 32410 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:57.680405 32436 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:57.682578 32436 consensus_queue.cc:1048] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:25:57.683898 32445 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:57.649689 32356 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:57.690145 32356 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:57.691078 32411 consensus_queue.cc:237] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:57.697274 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:57.698931 32103 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:57.701669 32437 log.cc:927] Time spent T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.240s	user 0.000s	sys 0.002s
I20260709 12:25:57.702360 32307 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:57.703725 32396 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:57.705188 32304 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:57.701713 32103 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:57.706440 25685 raft_consensus.cc:1240] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 12:25:57.667645 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:57.707522 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:57.707525 26432 raft_consensus.cc:2468] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 17.
W20260709 12:25:57.708354 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:57.709106 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:57.705515 32352 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:57.711160 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:57.711752 25680 raft_consensus.cc:3060] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:57.708257 25683 raft_consensus.cc:2468] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 17.
I20260709 12:25:57.718418 26437 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 20.
I20260709 12:25:57.718631 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:57.719134 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:57.723141 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:57.659652 32439 raft_consensus.cc:2749] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:25:57.732983 25726 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:57.736716 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:57.716112 32281 raft_consensus.cc:2749] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:57.737632 26435 raft_consensus.cc:2393] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 17: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:57.738095 25679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40220 (request call id 2926) took 1221 ms. Trace:
I20260709 12:25:57.738499 25679 rpcz_store.cc:276] 0709 12:25:56.517108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:56.517250 (+   142us) service_pool.cc:224] Handling call
0709 12:25:57.737895 (+1220645us) spinlock_profiling.cc:243] Waited 349 ms on lock 0x7b5400203354. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:57.738042 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":802534656}
I20260709 12:25:57.723373 32311 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.739830 32311 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:57.740815 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:57.741452 26436 raft_consensus.cc:2468] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 16.
I20260709 12:25:57.742023 32311 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:57.742798 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:57.742733 32428 consensus_queue.cc:1048] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:25:57.743492 32325 raft_consensus.cc:3055] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:25:57.743882 32325 raft_consensus.cc:740] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:57.744880 26436 raft_consensus.cc:1275] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:25:57.741531 32384 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 20 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:57.798642 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 74147us
I20260709 12:25:57.806232 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:57.807029 25679 raft_consensus.cc:2468] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 17.
I20260709 12:25:57.809099 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:57.810442 25680 raft_consensus.cc:2468] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 17.
W20260709 12:25:57.811901 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 58206.5us
I20260709 12:25:57.813745 25801 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:57.817889 26437 raft_consensus.cc:1240] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:57.744748 32325 consensus_queue.cc:260] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:57.822799 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 90056.5us
I20260709 12:25:57.825351 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:57.836903 25726 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:57.719885 32396 consensus_queue.cc:1048] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.100s
I20260709 12:25:57.844993 32304 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 21 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:57.797873 32442 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.798098 32410 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:57.855350 25726 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:57.811203 32420 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:57.859683 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:57.824880 32433 raft_consensus.cc:2804] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:57.857765 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:57.880609 26437 raft_consensus.cc:2368] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 16. Current term is 17.
I20260709 12:25:57.872139 25726 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:57.832391 32384 raft_consensus.cc:2749] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:57.884670 25726 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:57.859177 32396 raft_consensus.cc:2749] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:57.881927 32246 raft_consensus.cc:2804] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:25:57.883718 32433 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.890931 32325 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:57.921926 25726 leader_election.cc:400] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Vote denied by peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611) with higher term. Message: Invalid argument: T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 16. Current term is 17.
I20260709 12:25:57.929814 25726 leader_election.cc:403] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:57.898972 32307 raft_consensus.cc:2804] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:57.931586 32311 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:57.872522 32415 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:57.881111 32407 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:57.865088 32442 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:57.879667 32410 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:57.925411 32246 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:57.934686 32433 raft_consensus.cc:3060] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:57.922724 32409 raft_consensus.cc:2804] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:57.879961 32420 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:57.951498 32246 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:57.934557 32307 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:57.939190 32396 raft_consensus.cc:3060] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:25:57.946921 32384 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:57.980298 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:57.986397 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:57.987349 25683 raft_consensus.cc:2468] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 14.
I20260709 12:25:57.941612 32311 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:57.973820 32352 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 21 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:57.959344 32436 consensus_queue.cc:1059] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:25:57.983058 32307 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:58.011085 25683 raft_consensus.cc:1240] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:25:58.017616 32407 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:58.020434 32420 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:58.020854 32410 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:58.022032 32415 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 21 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:58.022266 32442 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:57.974362 32409 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:58.029381 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:57.982023 32426 consensus_queue.cc:1048] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 12:25:58.004704 32384 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:58.036684 32409 raft_consensus.cc:3060] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:58.080912 25832 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44202 (request call id 3403) took 1885 ms. Trace:
I20260709 12:25:58.086838 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:58.034415 25650 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:58.033048 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:58.089349 25682 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 25.
I20260709 12:25:58.036674 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:58.022678 32215 raft_consensus.cc:3055] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 LEADER]: Stepping down as leader of term 19
W20260709 12:25:58.029186 32418 consensus_meta.cc:287] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.506s	user 0.013s	sys 0.001s
I20260709 12:25:58.045113 32311 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:58.033726 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:58.084827 25832 rpcz_store.cc:276] 0709 12:25:56.195586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:56.196222 (+   636us) service_pool.cc:224] Handling call
0709 12:25:56.196639 (+   417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:56.212931 (+ 16292us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 12:25:56.235534 (+ 22603us) log.cc:844] Serialized 14 byte log entry
0709 12:25:56.720607 (+485073us) spinlock_profiling.cc:243] Waited 6.54 ms on lock 0x7b18004b5200. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d96a56e07 00007f5d9f8b19a9 00007f5d96a7369b 00007f5d96a7193f 00007f5d96a73c02 00007f5d996fb20b 00007f5d99700d23 00007f5d9970123a 00007f5d99b6ba2a
0709 12:25:56.830029 (+109422us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:56.836417 (+  6388us) log.cc:844] Serialized 26 byte log entry
0709 12:25:56.836568 (+   151us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:25:56.836598 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:56.836677 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:58.065449 (+1228772us) spinlock_profiling.cc:243] Waited 3.06 ms on lock 0x7b18004b5200. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d96a743f3 00007f5d96a767c1 00007f5d96a76779 00007f5d96a76709 00007f5d96a766d1 00007f5d96a759cd 0000000000388634 0000000000388479 00007f5d96a5783a
0709 12:25:58.080659 (+ 15210us) raft_consensus.cc:1685] finished
0709 12:25:58.080687 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:58.080847 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58993,"prepare.queue_time_us":16262,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":5593,"raft.queue_time_us":40262,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":9842,"spinlock_wait_cycles":22069760,"thread_start_us":68741,"threads_started":1,"wal-append.queue_time_us":583013}
I20260709 12:25:58.101126 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:58.103467 25683 raft_consensus.cc:2393] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 17: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:58.104620 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:58.106822 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:25:58.114778 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:58.113175 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:58.153878 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:58.154608 25759 raft_consensus.cc:1275] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:25:58.154943 25832 raft_consensus.cc:2393] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 17: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:25:58.153972 25761 raft_consensus.cc:1240] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:25:58.157352 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:58.161475 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:58.162108 25837 raft_consensus.cc:2468] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 14.
I20260709 12:25:58.093190 32215 raft_consensus.cc:740] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:25:58.170397 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:58.173642 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:58.171298 25835 raft_consensus.cc:2468] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 19.
W20260709 12:25:58.176038 32435 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.011s	sys 0.007s
W20260709 12:25:58.189641 32435 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.011s	sys 0.007s
I20260709 12:25:58.224176 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:58.243988 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:58.247080 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:58.244095 25800 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:58.288661 25800 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:58.291352 25800 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:58.296345 32283 raft_consensus.cc:2749] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:25:58.296793 32466 log.cc:927] Time spent T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:25:58.219169 32396 raft_consensus.cc:2749] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611) with higher term. Message: Invalid argument: T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 16. Current term is 17.
I20260709 12:25:58.289737 32288 raft_consensus.cc:2749] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:25:58.299146 32352 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:58.290282 31537 consensus_queue.cc:1048] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 12:25:58.315398 32297 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:58.320700 26431 raft_consensus.cc:1275] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 25 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
W20260709 12:25:58.324838 32479 log.cc:927] Time spent T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 12:25:58.326017 25837 raft_consensus.cc:1240] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:58.293239 25726 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:58.331828 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:58.339485 25756 raft_consensus.cc:2393] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 21: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:25:58.345266 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:58.349263 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:58.342252 25800 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:58.353811 25800 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:58.355492 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:58.330655 32384 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:58.221030 32215 consensus_queue.cc:260] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:58.361063 26401 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.245.130:37267 timed out after 2.030s (SENT) [suppressed 10 similar messages]
I20260709 12:25:58.350584 32297 raft_consensus.cc:2804] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:58.365682 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:58.368661 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:58.355325 32103 raft_consensus.cc:2749] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:58.367990 25760 raft_consensus.cc:2468] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 16.
I20260709 12:25:58.379134 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:58.366818 32334 raft_consensus.cc:2749] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:58.384810 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:58.385829 32295 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:58.386382 32295 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:58.391527 32467 log.cc:927] Time spent T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 12:25:58.380530 32384 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.405745 32384 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:58.409112 32355 raft_consensus.cc:3055] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:58.409456 25834 raft_consensus.cc:1275] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 13. (term mismatch)
I20260709 12:25:58.409600 32355 raft_consensus.cc:740] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:58.409811 25834 pending_rounds.cc:85] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a: Aborting all ops after (but not including) 12
I20260709 12:25:58.410030 32352 raft_consensus.cc:2749] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:25:58.372659 32297 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:58.410593 32355 consensus_queue.cc:260] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:58.411231 32297 raft_consensus.cc:3060] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:25:58.412616 32482 log.cc:927] Time spent T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 12:25:58.410084 25834 pending_rounds.cc:107] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a: Aborting uncommitted NO_OP operation due to leader change: 19.13
I20260709 12:25:58.413640 25834 raft_consensus.cc:2889] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:58.414611 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:58.415563 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:58.415741 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:58.383980 32215 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:58.416193 25683 raft_consensus.cc:2468] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 14.
I20260709 12:25:58.416821 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:58.417898 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:58.418764 25763 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 3199) took 1476 ms. Trace:
I20260709 12:25:58.418879 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:58.424618 25801 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:58.425945 32295 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:58.419171 25763 rpcz_store.cc:276] 0709 12:25:56.942235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:56.942380 (+   145us) service_pool.cc:224] Handling call
0709 12:25:56.963223 (+ 20843us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:57.380234 (+417011us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:25:57.380262 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:57.380687 (+   425us) log.cc:844] Serialized 26 byte log entry
0709 12:25:57.450531 (+ 69844us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:57.450598 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:58.418421 (+967823us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b5400298954. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:58.418478 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:58.418522 (+    44us) raft_consensus.cc:1685] finished
0709 12:25:58.418535 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:58.418712 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":79025,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":14429,"spinlock_wait_cycles":447882112,"thread_start_us":291095,"threads_started":2,"wal-append.queue_time_us":132165}
I20260709 12:25:58.426525 32384 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:58.427846 26430 raft_consensus.cc:1275] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:25:58.428586 32276 raft_consensus.cc:2804] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:58.429248 32276 raft_consensus.cc:697] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 17 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:58.411756 32355 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:58.430276 32276 consensus_queue.cc:237] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:58.432390 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:58.435581 25754 raft_consensus.cc:2468] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 17.
I20260709 12:25:58.449445 32397 consensus_queue.cc:1048] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:25:58.453245 25756 raft_consensus.cc:1240] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 17. Current term is 18. Ops: []
I20260709 12:25:58.453915 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:25:58.463326 32455 log.cc:927] Time spent T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.813s	user 0.001s	sys 0.000s
I20260709 12:25:58.465446 26439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 1563) took 1061 ms. Trace:
W20260709 12:25:58.465750 32476 log.cc:927] Time spent T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.241s	user 0.000s	sys 0.000s
W20260709 12:25:58.467167 32471 log.cc:927] Time spent T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.282s	user 0.001s	sys 0.000s
I20260709 12:25:58.468700 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:58.470243 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:58.475641 32351 consensus_queue.cc:1048] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:25:58.476096 32325 consensus_queue.cc:1059] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:58.477087 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:58.475739 25801 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:58.465831 26439 rpcz_store.cc:276] 0709 12:25:57.403698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:57.403808 (+   110us) service_pool.cc:224] Handling call
0709 12:25:57.404123 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:57.408289 (+  4166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:57.408313 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:57.421793 (+ 13480us) log.cc:844] Serialized 26 byte log entry
0709 12:25:57.478372 (+ 56579us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:57.478412 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:57.478474 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:58.462702 (+984228us) spinlock_profiling.cc:243] Waited 31 ms on lock 0x7b4400022b4c. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db 00007f5d99708aaf 00007f5d996fc86e 00007f5d996fbbb6 00007f5d996fb7d8 00007f5d99705221 00007f5d997051d9 00007f5d99705169
0709 12:25:58.465056 (+  2354us) raft_consensus.cc:1685] finished
0709 12:25:58.465084 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:58.465337 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3829,"raft.queue_time_us":7412,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":7268,"spinlock_wait_cycles":71346432,"thread_start_us":25695,"threads_started":1,"wal-append.queue_time_us":170960}
I20260709 12:25:58.506129 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:58.506867 25832 raft_consensus.cc:2468] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 17.
I20260709 12:25:58.505964 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:58.477169 32325 raft_consensus.cc:3055] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:58.509668 26436 raft_consensus.cc:2468] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 14.
I20260709 12:25:58.512535 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 20 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:58.513114 25835 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:58.514851 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:58.502614 32089 raft_consensus.cc:2749] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 12:25:58.517454 32433 consensus_meta.cc:287] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.551s	user 0.010s	sys 0.002s
I20260709 12:25:58.511308 32325 raft_consensus.cc:740] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:58.507979 31825 consensus_queue.cc:1048] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.036s
W20260709 12:25:58.542550 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 188825us
I20260709 12:25:58.547905 25800 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:58.538154 32295 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:58.575591 32489 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.576388 32489 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:58.579144 32489 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:25:58.590477 32409 consensus_meta.cc:287] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.522s	user 0.003s	sys 0.006s
I20260709 12:25:58.590934 32409 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:58.598955 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 51183.5us
W20260709 12:25:58.600160 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 239106us
W20260709 12:25:58.596412 32307 consensus_meta.cc:287] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.561s	user 0.011s	sys 0.000s
I20260709 12:25:58.548202 32433 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:58.618270 25759 raft_consensus.cc:2410] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 20 because replica has last-logged OpId of term: 19 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 9.
I20260709 12:25:58.611413 32354 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
W20260709 12:25:58.618961 26402 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:58.618783 32354 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:58.595687 32297 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:58.618079 26401 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:58.603477 32334 raft_consensus.cc:2749] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:58.593928 32295 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:58.626421 32246 consensus_meta.cc:287] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8: Time spent flushing consensus metadata: real 0.636s	user 0.012s	sys 0.000s
I20260709 12:25:58.627040 32246 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:58.609486 32307 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:58.620265 25800 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:58.598728 32489 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:58.632278 25828 raft_consensus.cc:2368] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 17. Current term is 18.
W20260709 12:25:58.678417 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 58202.9us
I20260709 12:25:58.636240 25835 raft_consensus.cc:2468] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 20.
I20260709 12:25:58.683086 25755 raft_consensus.cc:1240] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 18. Current term is 19. Ops: []
I20260709 12:25:58.626466 32354 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:58.636508 32441 raft_consensus.cc:2749] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:25:58.605268 32325 consensus_queue.cc:260] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:58.713291 32325 raft_consensus.cc:3060] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:58.713483 32295 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:58.675482 32029 consensus_queue.cc:1059] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.039s
I20260709 12:25:58.714586 32029 consensus_queue.cc:1243] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer 6e673265293d4e9a937dc45150aeb1b8 log is divergent from this leader: its last log entry 16.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 12:25:58.715097 32029 raft_consensus.cc:3055] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:25:58.715440 32029 raft_consensus.cc:740] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:58.701608 32433 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:58.704512 32288 raft_consensus.cc:2749] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:25:58.716256 32029 consensus_queue.cc:260] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:58.718076 32029 raft_consensus.cc:3060] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:58.708523 32248 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:58.704504 32409 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:58.706046 32246 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:58.685799 32334 consensus_queue.cc:1048] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 12:25:58.681703 32489 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:58.748932 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:58.750072 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 165298us
I20260709 12:25:58.759898 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:58.769497 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:58.770619 25685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2943) took 1070 ms. Trace:
I20260709 12:25:58.755232 32396 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:58.770967 25685 rpcz_store.cc:276] 0709 12:25:57.694061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:57.694190 (+   129us) service_pool.cc:224] Handling call
0709 12:25:57.694517 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:57.707015 (+ 12498us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:58.764358 (+1057343us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b54001b6cd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:58.764642 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26830080}
W20260709 12:25:58.772578 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 288160us
I20260709 12:25:58.773600 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:58.782864 26436 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 16.
I20260709 12:25:58.775429 25681 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2950) took 1066 ms. Trace:
I20260709 12:25:58.786546 25681 rpcz_store.cc:276] 0709 12:25:57.709228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:57.709872 (+   644us) service_pool.cc:224] Handling call
0709 12:25:57.710156 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:57.710394 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:25:57.723288 (+ 12894us) log.cc:844] Serialized 14 byte log entry
0709 12:25:58.391019 (+667731us) spinlock_profiling.cc:243] Waited 22 ms on lock 0x7b4400022b4c. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db 00007f5d99708aaf 00007f5d996fc86e 00007f5d996fbbb6 00007f5d996fb7d8 00007f5d99705221 00007f5d997051d9 00007f5d99705169
0709 12:25:58.774793 (+383774us) log.cc:844] Serialized 14 byte log entry
0709 12:25:58.774989 (+   196us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:58.775049 (+    60us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:58.775109 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:58.775196 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:58.775346 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":745383,"prepare.queue_time_us":38214,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":40,"spinlock_wait_cycles":50590592,"thread_start_us":303247,"threads_started":1,"wal-append.queue_time_us":450677}
I20260709 12:25:58.791139 25801 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
W20260709 12:25:58.792941 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 758548us
I20260709 12:25:58.774593 32462 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:58.797057 25678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40230 (request call id 2049) took 1083 ms. Trace:
I20260709 12:25:58.803792 25678 rpcz_store.cc:276] 0709 12:25:57.713874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:57.714626 (+   752us) service_pool.cc:224] Handling call
0709 12:25:57.714893 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:57.715081 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:25:58.026625 (+311544us) log.cc:844] Serialized 14 byte log entry
0709 12:25:58.796698 (+770073us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:58.796755 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:58.796800 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:58.796868 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:58.796989 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":677201,"prepare.queue_time_us":125166,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":67,"thread_start_us":331479,"threads_started":2,"wal-append.queue_time_us":196203}
W20260709 12:25:58.800210 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:58.818207 32307 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:58.784878 32396 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:58.811108 32184 raft_consensus.cc:2749] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:25:58.826135 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 138695us
W20260709 12:25:58.933714 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 251622us
I20260709 12:25:58.858246 32400 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.957155 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:58.826576 32282 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:58.896883 32334 raft_consensus.cc:2749] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:58.815408 32462 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:58.966289 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 53301.7us
I20260709 12:25:58.956861 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:58.973235 25756 raft_consensus.cc:2468] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 13.
W20260709 12:25:58.972118 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 109520us
I20260709 12:25:58.974954 25650 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:58.991186 26401 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:58.992784 25684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51578 (request call id 1293) took 1015 ms. Trace:
I20260709 12:25:58.993883 25684 rpcz_store.cc:276] 0709 12:25:57.977659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:57.977783 (+   124us) service_pool.cc:224] Handling call
0709 12:25:57.978058 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:57.978242 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:25:58.025499 (+ 47257us) log.cc:844] Serialized 14 byte log entry
0709 12:25:58.837151 (+811652us) log.cc:844] Serialized 14 byte log entry
0709 12:25:58.991888 (+154737us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:58.991967 (+    79us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:58.992009 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:58.992079 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:58.992724 (+   645us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":472987,"prepare.queue_time_us":32126,"prepare.run_cpu_time_us":100,"prepare.run_wall_time_us":103,"raft.queue_time_us":589025,"thread_start_us":486255,"threads_started":3,"wal-append.queue_time_us":484145}
I20260709 12:25:58.991034 32460 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.964143 32400 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:58.992617 32489 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:58.967273 32282 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:59.018703 32282 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:59.001438 32511 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:59.021026 32511 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:58.995220 32427 raft_consensus.cc:2804] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:58.997524 32452 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:59.053140 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 78394us
I20260709 12:25:59.036212 32336 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
W20260709 12:25:59.010289 32494 log.cc:927] Time spent T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.221s	user 0.001s	sys 0.001s
W20260709 12:25:59.064844 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 49699.9us
I20260709 12:25:59.070597 25649 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:25:59.056499 25650 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:59.038946 32498 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.068342 32336 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:59.080751 32509 log.cc:927] Time spent T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 12:25:59.082448 32506 log.cc:927] Time spent T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:25:59.083021 32297 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:59.083845 32499 log.cc:927] Time spent T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 12:25:59.012220 32460 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:59.040303 32427 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:59.085767 32427 raft_consensus.cc:3060] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:59.086316 25754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53460 (request call id 3227) took 1004 ms. Trace:
I20260709 12:25:59.086916 32460 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:59.087936 25677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51578 (request call id 1294) took 1110 ms. Trace:
I20260709 12:25:59.088100 32498 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:25:59.089010 26402 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:59.089977 26402 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:59.090878 26402 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:59.068336 32409 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.092324 32498 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:59.093154 32507 raft_consensus.cc:2749] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:59.092693 32409 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:59.068740 32452 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:59.095060 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:59.095358 32409 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:59.095669 32452 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:59.102206 32427 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:59.088418 25677 rpcz_store.cc:276] 0709 12:25:57.977951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:57.982691 (+  4740us) service_pool.cc:224] Handling call
0709 12:25:58.002908 (+ 20217us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:58.832463 (+829555us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:58.832514 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:58.855951 (+ 23437us) log.cc:844] Serialized 26 byte log entry
0709 12:25:59.039030 (+183079us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:25:59.039072 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:59.039138 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:59.087683 (+ 48545us) raft_consensus.cc:1685] finished
0709 12:25:59.087707 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:59.087850 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":829023,"raft.queue_time_us":1034057,"thread_start_us":87541,"threads_started":1,"wal-append.queue_time_us":155488}
I20260709 12:25:59.086697 25754 rpcz_store.cc:276] 0709 12:25:58.082268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:58.082367 (+    99us) service_pool.cc:224] Handling call
0709 12:25:59.086130 (+1003763us) spinlock_profiling.cc:243] Waited 222 ms on lock 0x7b54001dbfd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:25:59.086251 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":511069056}
I20260709 12:25:59.034948 32511 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:59.113485 32462 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:59.091784 26402 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:59.114603 32349 raft_consensus.cc:2804] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:59.114952 32461 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:59.115571 32357 consensus_queue.cc:1059] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:25:59.115486 32461 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:59.116595 32357 raft_consensus.cc:3055] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:59.116966 32357 raft_consensus.cc:740] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:59.117017 32400 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:59.117609 32400 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.117748 32461 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:59.118060 32400 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:59.118534 26402 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:59.115005 32349 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:59.119736 26402 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:59.120173 32282 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:59.119787 32349 raft_consensus.cc:3060] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:59.121249 32282 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:59.123315 32396 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:59.117841 32357 consensus_queue.cc:260] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:59.124544 32357 raft_consensus.cc:3060] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:59.124655 32524 raft_consensus.cc:2804] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:59.125156 32524 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:59.125525 32524 raft_consensus.cc:3060] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:59.127084 32522 raft_consensus.cc:2749] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 12:25:59.120993 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 50507.5us
I20260709 12:25:59.128497 32282 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:59.130158 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:59.130416 32507 raft_consensus.cc:2804] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:25:59.130740 25754 raft_consensus.cc:3060] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:59.130834 32507 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:59.131299 32507 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:25:59.132563 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:59.132488 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:59.133349 25682 raft_consensus.cc:2393] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 21: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:59.135346 32441 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:59.136237 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:59.139794 32408 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:25:59.140784 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 22 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:59.141439 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:59.143133 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:59.143496 26435 raft_consensus.cc:1240] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:59.144562 32336 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:59.145129 32396 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:59.145653 32396 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:59.145941 32349 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:59.147688 25755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 3229) took 1064 ms. Trace:
I20260709 12:25:59.148200 25755 rpcz_store.cc:276] 0709 12:25:58.082934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:58.084160 (+  1226us) service_pool.cc:224] Handling call
0709 12:25:58.102532 (+ 18372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:58.693015 (+590483us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:59.147491 (+454476us) spinlock_profiling.cc:243] Waited 580 ms on lock 0x7b5400002654. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:25:59.147636 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1334695168}
I20260709 12:25:59.152451 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:59.158531 32349 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:59.119853 32355 raft_consensus.cc:2749] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:59.140496 32408 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:59.163355 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:59.163667 32408 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:59.147743 25679 raft_consensus.cc:1275] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:25:59.135844 32441 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:59.169307 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:59.170154 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:59.170228 32441 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:59.170809 25755 raft_consensus.cc:2468] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 17.
I20260709 12:25:59.171332 32273 raft_consensus.cc:2804] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:25:59.171854 32273 raft_consensus.cc:697] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 20 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:59.172652 32273 consensus_queue.cc:237] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 18.9, Last appended by leader: 9, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:59.171857 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 115467us
I20260709 12:25:59.176913 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:25:59.177536 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:59.177541 26436 raft_consensus.cc:3060] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:25:59.147850 32396 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:59.181428 32507 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:59.183305 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:59.186861 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:59.187553 25756 raft_consensus.cc:2468] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 14.
I20260709 12:25:59.188849 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:59.192401 32524 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:59.193178 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 199306us
I20260709 12:25:59.193796 25684 raft_consensus.cc:2368] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 17. Current term is 18.
I20260709 12:25:59.064765 32457 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:59.194036 25800 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:59.194293 32457 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:59.194798 32286 raft_consensus.cc:2749] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:59.194944 32524 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:59.195729 25800 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:59.200404 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:59.201334 25828 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 10.
I20260709 12:25:59.202572 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:59.204455 25754 raft_consensus.cc:2468] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 14.
I20260709 12:25:59.205407 32396 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:59.206478 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:59.206246 32396 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:59.205349 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:59.208287 25834 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 20.
I20260709 12:25:59.209249 32396 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:59.209863 25801 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:59.212306 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:59.213979 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:59.214241 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:59.214787 25835 raft_consensus.cc:3060] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:59.214907 26439 raft_consensus.cc:2468] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 16.
I20260709 12:25:59.216499 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:59.218477 25837 raft_consensus.cc:1240] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 20. Current term is 21. Ops: []
I20260709 12:25:59.219633 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:59.221328 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:59.221944 26439 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 16.
I20260709 12:25:59.222852 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:59.224081 26401 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:59.223693 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:59.228997 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:59.230602 32400 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:59.230674 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:59.232319 26436 raft_consensus.cc:2468] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 18.
W20260709 12:25:59.232479 32029 consensus_meta.cc:287] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.507s	user 0.003s	sys 0.009s
I20260709 12:25:59.233594 32286 raft_consensus.cc:2749] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:25:59.234097 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:59.234347 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:59.235031 25755 raft_consensus.cc:2468] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 17.
I20260709 12:25:59.234364 32286 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.236846 31825 raft_consensus.cc:2804] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:59.236716 32286 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:59.237274 31825 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:59.237684 31825 raft_consensus.cc:3060] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:59.244508 26437 raft_consensus.cc:1240] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 26 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 25. Current term is 26. Ops: [25.18-25.18]
I20260709 12:25:59.245563 32507 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 26 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:59.247471 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 51816.8us
I20260709 12:25:59.248835 32525 consensus_queue.cc:1048] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:59.249377 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:59.249465 25800 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:59.232331 25835 raft_consensus.cc:2468] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 18.
I20260709 12:25:59.250845 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:59.251420 25756 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 14.
I20260709 12:25:59.251886 25726 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:59.232694 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:59.252970 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:59.253523 25756 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 21.
I20260709 12:25:59.253685 25650 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:59.254968 32531 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:59.255525 32531 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:59.257400 31825 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:59.258625 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:59.258836 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:59.259500 25755 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 16.
I20260709 12:25:59.257573 32530 consensus_queue.cc:1059] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:59.260229 25835 raft_consensus.cc:1240] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 12:25:59.254362 25754 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 21.
I20260709 12:25:59.259596 31825 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:59.261330 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:59.261482 25686 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2955) took 1021 ms. Trace:
I20260709 12:25:59.262315 25828 raft_consensus.cc:2410] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 12:25:59.263221 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:59.263756 25834 raft_consensus.cc:2368] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 16. Current term is 17.
I20260709 12:25:59.260679 25801 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:59.270973 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:59.261667 26401 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:25:59.281724 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:59.282641 25684 raft_consensus.cc:3060] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:59.283280 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:59.283571 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:59.284407 25679 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 21.
I20260709 12:25:59.281690 25726 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:59.286820 25681 raft_consensus.cc:1275] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:25:59.289156 25678 raft_consensus.cc:1275] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 25 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 12:25:59.289337 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:59.290586 25680 raft_consensus.cc:1275] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:25:59.279062 32336 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:59.291257 32297 raft_consensus.cc:2749] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:59.291736 32530 raft_consensus.cc:3055] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:25:59.292239 32530 raft_consensus.cc:740] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:59.293087 32530 consensus_queue.cc:260] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:59.291793 32336 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:59.294353 32530 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:25:59.296293 32336 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:59.296491 32089 raft_consensus.cc:2749] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:25:59.272222 32029 raft_consensus.cc:2804] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:59.264673 32457 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:59.300006 32029 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:59.286993 32103 raft_consensus.cc:2804] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:59.300606 32029 raft_consensus.cc:3060] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:59.262485 25686 rpcz_store.cc:276] 0709 12:25:58.240457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:58.242269 (+  1812us) service_pool.cc:224] Handling call
0709 12:25:58.297172 (+ 54903us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:58.297395 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 12:25:58.297630 (+   235us) log.cc:844] Serialized 14 byte log entry
0709 12:25:58.952537 (+654907us) log.cc:844] Serialized 14 byte log entry
0709 12:25:59.108826 (+156289us) spinlock_profiling.cc:243] Waited 4.98 ms on lock 0x7b18004542a0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d969eec0a 00007f5da012e219 00007f5d9da3558f 00007f5d96a74571 00007f5d96a767c1 00007f5d96a76779 00007f5d96a76709 00007f5d96a766d1 00007f5d96a759cd
0709 12:25:59.261184 (+152358us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:59.261231 (+    47us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:25:59.261272 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:59.261333 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:59.261430 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":631960,"prepare.queue_time_us":823,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":305,"raft.queue_time_us":757549,"raft.run_cpu_time_us":349,"raft.run_wall_time_us":190614,"spinlock_wait_cycles":11456256,"thread_start_us":515069,"threads_started":3,"wal-append.queue_time_us":219165}
I20260709 12:25:59.301024 32103 raft_consensus.cc:697] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 17 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:59.308316 25684 raft_consensus.cc:2468] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 18.
I20260709 12:25:59.311580 32461 raft_consensus.cc:2749] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:59.311196 32103 consensus_queue.cc:237] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:59.316704 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:59.317480 25680 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 21.
I20260709 12:25:59.318308 32531 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:59.320016 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:59.320252 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:59.320775 25759 raft_consensus.cc:2468] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 20.
I20260709 12:25:59.321065 25686 raft_consensus.cc:2410] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for term 21 because replica has last-logged OpId of term: 20 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 8.
I20260709 12:25:59.318333 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:59.302929 32433 consensus_queue.cc:1059] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 12:25:59.278249 32286 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:59.322608 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
W20260709 12:25:59.323284 25584 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41232 (request call id 392) took 31242 ms (client timeout 15000 ms). Trace:
I20260709 12:25:59.323742 25755 raft_consensus.cc:3060] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:59.326239 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:59.326716 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:59.323683 25584 rpcz_store.cc:269] 0709 12:25:28.080419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:28.084295 (+  3876us) service_pool.cc:224] Handling call
0709 12:25:28.625152 (+540857us) spinlock_profiling.cc:243] Waited 5.6 ms on lock 0x7b5400002490. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d96a3cb71 00007f5d96a3d0b2 00007f5d9f9b6759 00007f5d9f94ea76 00007f5d9f91fd58 00007f5d9fa1e04e 00007f5d9dedf2a4 00007f5d9dedf232 00007f5d9dedf161 00007f5d9dedf0dc
0709 12:25:59.323196 (+30698044us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:53.444226 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:53.445091 (+   865us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:53.445181 (+    90us) write_op.cc:435] Acquired schema lock
0709 12:25:53.445224 (+    43us) tablet.cc:662] Decoding operations
0709 12:25:53.447746 (+  2522us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:53.447863 (+   117us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:53.447905 (+    42us) tablet.cc:685] Acquiring locks for 24 operations
0709 12:25:53.494167 (+ 46262us) tablet.cc:701] Row locks acquired
0709 12:25:53.494230 (+    63us) write_op.cc:260] PREPARE: finished
0709 12:25:53.494456 (+   226us) write_op.cc:270] Start()
0709 12:25:53.494618 (+   162us) write_op.cc:276] Timestamp: P: 1783599953494377 usec, L: 0
0709 12:25:53.494661 (+    43us) op_driver.cc:348] REPLICATION: starting
0709 12:25:53.495558 (+   897us) log.cc:844] Serialized 9532 byte log entry
0709 12:25:54.339072 (+843514us) op_driver.cc:464] REPLICATION: finished
0709 12:25:54.685247 (+346175us) write_op.cc:301] APPLY: starting
0709 12:25:54.685382 (+   135us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:55.020373 (+334991us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:55.020496 (+   123us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:55.330708 (+310212us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:55.332678 (+  1970us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=48,key_file_lookups=48,delta_file_lookups=48,mrs_lookups=0
0709 12:25:55.332740 (+    62us) write_op.cc:312] APPLY: finished
0709 12:25:55.333261 (+   521us) log.cc:844] Serialized 212 byte log entry
0709 12:25:55.474679 (+141418us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:55.481031 (+  6352us) write_op.cc:454] Released schema lock
0709 12:25:55.481135 (+   104us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:55.481619 (+   484us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:55.481661 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":15390,"reported_tablets":46,"spinlock_wait_cycles":12890880,"child_traces":[["op",{"apply.queue_time_us":309274,"apply.run_cpu_time_us":66197,"apply.run_wall_time_us":819625,"cfile_cache_hit":98,"cfile_cache_hit_bytes":104447,"num_ops":24,"prepare.queue_time_us":95221,"prepare.run_cpu_time_us":41829,"prepare.run_wall_time_us":257369,"raft.queue_time_us":177883,"raft.run_cpu_time_us":64692,"raft.run_wall_time_us":281150,"replication_time_us":823155,"thread_start_us":598328,"threads_started":5,"wal-append.queue_time_us":431073,"wal-append.run_cpu_time_us":38963,"wal-append.run_wall_time_us":2459970}]]}
I20260709 12:25:59.327441 25756 raft_consensus.cc:2468] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 19.
I20260709 12:25:59.304431 25650 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:59.331225 25649 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:59.335515 31457 raft_consensus.cc:2804] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:25:59.336059 31457 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:59.336416 31457 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:25:59.336841 32524 consensus_queue.cc:1059] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 20.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:25:59.337352 25649 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:59.337785 32524 raft_consensus.cc:2804] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:59.338093 32304 raft_consensus.cc:3055] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:25:59.338276 32461 raft_consensus.cc:2804] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:59.338553 32304 raft_consensus.cc:740] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 20 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:59.338738 32461 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:59.339190 32461 raft_consensus.cc:3060] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:59.339455 32304 consensus_queue.cc:260] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:59.338459 25649 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:59.340945 32304 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:25:59.342543 25649 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:59.338131 32524 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:59.343328 32457 raft_consensus.cc:2804] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:25:59.343408 32524 raft_consensus.cc:3060] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:59.344542 32336 raft_consensus.cc:2804] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:25:59.345077 25837 raft_consensus.cc:1275] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:25:59.346000 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:59.346093 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:59.346752 25834 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 23.
I20260709 12:25:59.347523 25836 raft_consensus.cc:1240] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 19. Current term is 20. Ops: [18.9-19.10]
I20260709 12:25:59.347606 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:59.344985 32336 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:59.348577 32336 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:25:59.348889 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:59.349478 25835 raft_consensus.cc:2468] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 18.
I20260709 12:25:59.350302 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:59.351444 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:59.352649 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:59.353905 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:59.355197 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:59.250303 32427 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:59.343811 32457 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:59.356041 25837 raft_consensus.cc:2410] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for term 21 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 12:25:59.356320 32457 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:25:59.336392 25650 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:25:59.359063 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 97464.8us
I20260709 12:25:59.366288 25834 raft_consensus.cc:1240] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 17. Current term is 18. Ops: []
I20260709 12:25:59.368364 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:59.369335 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:59.369822 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:59.370662 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:59.371366 26436 raft_consensus.cc:2393] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 15: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:59.371239 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:59.371800 25677 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:25:59.343428 25649 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:59.372632 25650 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:59.373579 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:59.369957 25832 raft_consensus.cc:2468] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 15.
I20260709 12:25:59.375730 25650 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:59.376902 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:59.379518 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:59.380149 25678 raft_consensus.cc:2468] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 13.
I20260709 12:25:59.381861 26432 raft_consensus.cc:2393] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 15: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:25:59.288846 32400 raft_consensus.cc:2749] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 12:25:59.383839 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:59.386752 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:59.386226 25726 leader_election.cc:400] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 election: Vote denied by peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) with higher term. Message: Invalid argument: T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 17. Current term is 18.
I20260709 12:25:59.387794 25726 leader_election.cc:403] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:25:59.389206 25801 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:59.390623 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:59.391651 25650 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:59.392938 26438 raft_consensus.cc:1275] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 12:25:59.393415 26438 pending_rounds.cc:85] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89: Aborting all ops after (but not including) 12
I20260709 12:25:59.393621 26438 pending_rounds.cc:107] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 12:25:59.393841 26438 raft_consensus.cc:2889] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:59.394120 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:59.394869 25678 raft_consensus.cc:3060] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:59.394997 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:25:59.403600 25650 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:59.404503 25580 catalog_manager.cc:5697] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:59.412075 32336 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:59.421370 32029 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:59.422991 32286 raft_consensus.cc:3055] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:25:59.374387 32427 raft_consensus.cc:2804] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:59.424484 31457 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:59.425292 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:59.388206 32206 raft_consensus.cc:2804] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:25:59.381224 32518 raft_consensus.cc:2749] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:59.431455 32526 raft_consensus.cc:2804] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:59.482198 32526 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:59.482615 32526 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:59.374032 32531 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.488210 32531 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:59.491417 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:59.492578 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:59.492776 32531 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:59.380558 32462 raft_consensus.cc:2804] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:59.493033 32029 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:59.435563 32528 raft_consensus.cc:2749] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:25:59.438012 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:59.493659 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:59.494223 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:59.494590 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:59.438956 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:59.495129 25759 raft_consensus.cc:3060] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:59.468710 32511 raft_consensus.cc:2749] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:59.495543 25835 raft_consensus.cc:2410] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for term 21 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 12:25:59.439141 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:59.437292 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:59.496876 32336 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 21 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:59.437769 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:59.497767 25829 raft_consensus.cc:2368] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 17. Current term is 18.
I20260709 12:25:59.439364 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 22 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:59.439817 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:59.499155 25828 raft_consensus.cc:2468] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 18.
I20260709 12:25:59.498739 25580 catalog_manager.cc:5697] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 5 to 11, leader changed from a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 11 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:25:59.444339 25677 raft_consensus.cc:2468] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 26.
W20260709 12:25:59.457501 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 169454us
I20260709 12:25:59.457660 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:59.458542 25755 raft_consensus.cc:2468] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 18.
I20260709 12:25:59.479498 25801 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:59.505095 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:59.491003 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:59.506620 25754 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:25:59.507156 25759 raft_consensus.cc:2468] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 15.
W20260709 12:25:59.463666 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 60141us
I20260709 12:25:59.511124 32295 raft_consensus.cc:2749] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) with higher term. Message: Invalid argument: T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 17. Current term is 18.
I20260709 12:25:59.471490 32286 raft_consensus.cc:740] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:59.517894 32286 consensus_queue.cc:260] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:59.476876 31537 consensus_queue.cc:1048] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.043s
I20260709 12:25:59.438081 32524 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:59.531241 32457 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:59.478475 31457 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 22 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:59.539981 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:59.390516 32409 consensus_queue.cc:1048] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.044s
I20260709 12:25:59.540473 25759 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:25:59.459420 31825 raft_consensus.cc:2804] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:25:59.541440 31825 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:59.541853 31825 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:25:59.388988 32461 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:59.546226 32461 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:59.480024 32505 consensus_queue.cc:1048] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 12:25:59.547499 25759 raft_consensus.cc:2468] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 21.
I20260709 12:25:59.479542 32206 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:59.549247 32206 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:25:59.459582 32503 consensus_queue.cc:1048] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.044s
W20260709 12:25:59.555130 26402 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:59.537122 32529 raft_consensus.cc:2804] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:59.510303 26401 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:25:59.562865 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 52685.8us
I20260709 12:25:59.537904 25801 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:59.539716 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:59.502286 32427 raft_consensus.cc:697] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 14 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
W20260709 12:25:59.565088 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 54400.9us
I20260709 12:25:59.550649 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:59.467296 25678 raft_consensus.cc:2468] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 15.
I20260709 12:25:59.400421 25726 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:59.534036 25754 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 22.
I20260709 12:25:59.563870 25756 raft_consensus.cc:3060] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:59.555887 25649 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:59.526111 32524 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:25:59.568688 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 170784us
I20260709 12:25:59.519093 32286 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:25:59.569489 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:59.571974 25759 raft_consensus.cc:3060] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:59.576756 25686 raft_consensus.cc:1240] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 21. Current term is 22. Ops: []
W20260709 12:25:59.565171 32534 log.cc:927] Time spent T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.082s	user 0.001s	sys 0.002s
I20260709 12:25:59.583560 25759 raft_consensus.cc:2468] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 18.
I20260709 12:25:59.552675 32409 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:59.551964 32462 raft_consensus.cc:697] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 18 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:59.587033 25677 raft_consensus.cc:1240] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 17. Current term is 18. Ops: []
I20260709 12:25:59.587836 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:59.588475 25681 raft_consensus.cc:1240] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 26 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 25. Current term is 26. Ops: [25.18-25.18]
I20260709 12:25:59.604883 25832 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 23.
I20260709 12:25:59.570497 32029 raft_consensus.cc:2804] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:59.571230 32295 raft_consensus.cc:2764] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 12:25:59.570829 32529 raft_consensus.cc:697] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 18 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:59.597048 32304 raft_consensus.cc:2804] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:25:59.597769 32457 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 22 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:59.574743 31537 raft_consensus.cc:2804] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:59.600502 25756 raft_consensus.cc:2468] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 18.
I20260709 12:25:59.589191 25649 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:59.602579 25726 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:59.596231 32518 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
W20260709 12:25:59.609952 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 43816.2us
I20260709 12:25:59.615799 32029 raft_consensus.cc:697] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 15 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:25:59.598838 32385 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:25:59.627547 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:59.623255 25649 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:59.621981 25726 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:59.620388 32295 raft_consensus.cc:2749] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:59.625690 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:59.626866 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:59.631531 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:59.628535 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:25:59.631830 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:59.634450 26432 raft_consensus.cc:3060] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:25:59.633359 25832 raft_consensus.cc:2368] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 17. Current term is 18.
I20260709 12:25:59.634167 31457 raft_consensus.cc:2804] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:59.636103 31457 raft_consensus.cc:697] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 18 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:59.633953 25650 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:59.632805 25649 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:59.639725 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:59.645840 32029 consensus_queue.cc:237] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:59.620817 31537 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:59.648154 31537 raft_consensus.cc:3060] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:59.628823 32514 raft_consensus.cc:2804] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:25:59.649389 32514 raft_consensus.cc:697] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 22 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:59.650345 32514 consensus_queue.cc:237] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:59.635829 32531 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:59.639117 32433 consensus_queue.cc:1059] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.014s
I20260709 12:25:59.652403 32531 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:59.625258 32518 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:59.654865 32531 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:59.655224 32518 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:59.655624 32462 consensus_queue.cc:237] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:59.656239 26432 raft_consensus.cc:2468] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 18.
I20260709 12:25:59.642110 25801 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:59.608301 32089 consensus_queue.cc:1059] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 12:25:59.607164 32409 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:59.662285 31457 consensus_queue.cc:237] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:59.666613 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:25:59.667428 25756 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:25:59.668632 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:59.669613 32511 raft_consensus.cc:2804] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:59.627429 32304 raft_consensus.cc:697] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 21 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:59.673158 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:59.675020 25754 raft_consensus.cc:2468] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 20.
I20260709 12:25:59.632247 32396 raft_consensus.cc:2749] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:59.679119 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:59.680184 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:25:59.685077 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 51266.6us
I20260709 12:25:59.685751 32409 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:59.688112 32457 raft_consensus.cc:2804] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:59.688539 32457 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:59.688704 32500 raft_consensus.cc:2749] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:25:59.688961 32457 raft_consensus.cc:3060] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:59.689528 32500 raft_consensus.cc:3055] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:59.689886 32500 raft_consensus.cc:740] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:59.690778 31825 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:59.692040 25828 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:25:59.695843 32511 raft_consensus.cc:697] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 18 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:25:59.696856 32511 consensus_queue.cc:237] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:59.690671 32500 consensus_queue.cc:260] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:59.698333 25649 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:25:59.705349 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 21 candidate_status { last_received { term: 18 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:59.709050 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:25:59.710289 25650 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:59.711983 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:59.632627 32385 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:59.716310 25828 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 22.
I20260709 12:25:59.724884 25801 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:59.727178 25756 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 22.
I20260709 12:25:59.729539 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:59.802526 25833 raft_consensus.cc:2410] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for term 21 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 12:25:59.730891 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:59.688552 32089 raft_consensus.cc:3055] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:25:59.741413 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:59.722473 32528 raft_consensus.cc:2804] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:25:59.739394 32505 raft_consensus.cc:2804] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:59.681866 32529 consensus_queue.cc:237] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:59.755865 32500 raft_consensus.cc:3060] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:59.758873 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:59.760994 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:59.763020 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:59.757861 32336 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.763813 32385 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:59.677868 32427 consensus_queue.cc:237] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:59.856729 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:59.857452 25833 raft_consensus.cc:2468] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 17.
I20260709 12:25:59.858317 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:59.859463 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:59.860286 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:59.860394 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:59.861536 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:59.861690 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 22 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:59.862497 25832 raft_consensus.cc:2393] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 22: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:25:59.766610 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:25:59.745805 32507 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:25:59.863796 32507 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:59.865919 32507 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:25:59.871981 25833 raft_consensus.cc:2468] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 14.
I20260709 12:25:59.731984 32530 consensus_queue.cc:1048] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 12:25:59.783767 32304 consensus_queue.cc:237] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:59.885715 32457 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:59.782931 32206 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:25:59.791534 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:59.892978 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:59.744540 32526 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:59.799347 25759 raft_consensus.cc:1275] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 20 index: 10. (term mismatch)
I20260709 12:25:59.895426 25759 pending_rounds.cc:85] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 9
I20260709 12:25:59.895725 25759 pending_rounds.cc:107] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 19.10
I20260709 12:25:59.895979 25759 raft_consensus.cc:2889] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:59.802980 25649 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:25:59.818511 26402 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:25:59.807173 32089 raft_consensus.cc:740] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:59.757177 31537 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:25:59.833226 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:25:59.843650 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:59.903074 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:59.832705 25650 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:25:59.849509 31825 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 21 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:25:59.849941 32336 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:25:59.850960 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:25:59.808959 32528 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:25:59.833849 32505 raft_consensus.cc:697] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 15 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:25:59.852141 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:59.804080 32503 consensus_queue.cc:1059] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 12:25:59.863201 25836 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 19.
I20260709 12:25:59.920174 25834 raft_consensus.cc:2368] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 14. Current term is 15.
W20260709 12:25:59.901113 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 98215.3us
I20260709 12:25:59.908351 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:25:59.925079 25828 raft_consensus.cc:2468] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 18.
I20260709 12:25:59.911434 25755 raft_consensus.cc:1240] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:59.902827 25829 raft_consensus.cc:2468] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 18.
I20260709 12:25:59.912330 25756 raft_consensus.cc:1275] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 12:25:59.911159 25759 raft_consensus.cc:1240] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:59.928663 25756 pending_rounds.cc:85] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 12
I20260709 12:25:59.929159 25756 pending_rounds.cc:107] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 12:25:59.929574 25756 raft_consensus.cc:2889] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:59.912729 32518 raft_consensus.cc:2804] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:25:59.917604 32528 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:25:59.937168 32457 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:25:59.946139 32507 raft_consensus.cc:2749] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:59.976938 25758 pending_rounds.cc:85] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 14
I20260709 12:25:59.977309 25758 pending_rounds.cc:107] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 17.15
I20260709 12:25:59.977401 25756 raft_consensus.cc:1275] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:25:59.977626 25758 raft_consensus.cc:2889] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:59.981146 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:25:59.981753 25762 raft_consensus.cc:1240] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 17. Current term is 18. Ops: []
I20260709 12:25:59.983126 25756 raft_consensus.cc:1240] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260709 12:25:59.987444 25755 raft_consensus.cc:1240] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 17. Current term is 18. Ops: []
I20260709 12:25:59.956159 32273 raft_consensus.cc:2749] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:00.003685 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:00.004252 25757 raft_consensus.cc:1240] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:00.004473 25760 raft_consensus.cc:2368] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 21. Current term is 22.
I20260709 12:26:00.005436 25763 raft_consensus.cc:1240] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 21. Current term is 22. Ops: [19.12-21.13]
I20260709 12:26:00.010109 31825 raft_consensus.cc:3055] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:25:59.950875 32089 consensus_queue.cc:260] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.18, Last appended by leader: 18, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:00.010655 31825 raft_consensus.cc:740] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:26:00.011608 32089 raft_consensus.cc:3060] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:26:00.006273 32246 consensus_queue.cc:1059] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:26:00.039739 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:26:00.041410 26437 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.004s	sys 0.022s
W20260709 12:26:00.041877 26437 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.004s	sys 0.022s
I20260709 12:26:00.038085 32409 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.041563 25756 raft_consensus.cc:2468] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 14.
I20260709 12:26:00.055684 25762 raft_consensus.cc:1240] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 18. Current term is 19. Ops: []
I20260709 12:26:00.012938 32295 consensus_queue.cc:1048] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.031s
I20260709 12:26:00.060950 32441 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:26:00.064767 32396 consensus_queue.cc:1059] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:00.065016 32441 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:00.025913 32505 consensus_queue.cc:237] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:26:00.068156 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:00.101583 25763 raft_consensus.cc:1240] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:00.011722 31825 consensus_queue.cc:260] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:00.104681 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:26:00.105515 25760 raft_consensus.cc:2368] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 21. Current term is 22.
I20260709 12:26:00.067767 32441 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:26:00.152974 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 416527us
I20260709 12:26:00.100332 31537 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:00.050664 32409 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:00.117892 32336 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:26:00.182052 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:00.163864 25800 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:00.156642 32206 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 20 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:00.207433 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:00.158092 32531 raft_consensus.cc:2749] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:26:00.209156 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:00.211033 25828 raft_consensus.cc:2393] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 18: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:26:00.217873 25828 raft_consensus.cc:1240] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:00.219712 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:00.223096 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:00.224385 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:00.211030 32295 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.226612 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:00.226516 32295 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:00.232525 25835 raft_consensus.cc:1240] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 17 LEADER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 16. Current term is 17. Ops: []
W20260709 12:26:00.239806 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 421343us
I20260709 12:26:00.241719 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:00.245726 26402 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:26:00.209199 32286 consensus_queue.cc:1059] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:26:00.240258 32526 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:00.265442 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:26:00.242307 32511 consensus_queue.cc:1048] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 12:26:00.243306 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:00.244149 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:00.272864 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:26:00.242164 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 409531us
I20260709 12:26:00.273700 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
W20260709 12:26:00.273589 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 227357us
I20260709 12:26:00.281688 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:26:00.267180 32433 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.284555 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:00.286538 25760 raft_consensus.cc:1275] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:26:00.289016 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:00.293269 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:00.294060 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:00.295010 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:00.395360 25832 raft_consensus.cc:2468] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 16.
W20260709 12:26:00.380530 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:00.382733 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:00.436308 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:26:00.436743 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:00.303561 25763 raft_consensus.cc:1275] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:26:00.280555 32518 raft_consensus.cc:697] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 22 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
W20260709 12:26:00.393067 32546 log.cc:927] Time spent T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
W20260709 12:26:00.393941 32545 log.cc:927] Time spent T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 12:26:00.294642 25837 raft_consensus.cc:3055] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:00.286592 32246 raft_consensus.cc:3055] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:00.284979 32550 raft_consensus.cc:2804] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:26:00.412020 25829 raft_consensus.cc:2468] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 14.
I20260709 12:26:00.417476 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:00.461274 25837 raft_consensus.cc:740] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:26:00.395205 32295 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:00.466884 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:00.467851 25829 raft_consensus.cc:2410] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for term 21 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 12:26:00.368276 32433 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:00.430511 31825 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:00.464463 25830 raft_consensus.cc:2368] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 17. Current term is 18.
I20260709 12:26:00.421780 32409 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:26:00.477129 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 231457us
I20260709 12:26:00.462774 26437 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36508 (request call id 1648) took 1212 ms. Trace:
I20260709 12:26:00.482429 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:26:00.483057 25763 raft_consensus.cc:3060] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:00.475170 25837 consensus_queue.cc:260] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:00.481302 26437 rpcz_store.cc:276] 0709 12:25:59.250786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:59.269614 (+ 18828us) service_pool.cc:224] Handling call
0709 12:25:59.304703 (+ 35089us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:59.304959 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:26:00.042285 (+737326us) log.cc:844] Serialized 14 byte log entry
0709 12:26:00.461578 (+419293us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:00.461626 (+    48us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:26:00.461665 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:00.462608 (+   943us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:00.462722 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27851,"prepare.queue_time_us":81512,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":28259,"thread_start_us":1067044,"threads_started":2}
I20260709 12:26:00.489679 25837 raft_consensus.cc:3060] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:00.492565 25835 raft_consensus.cc:2468] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 20.
I20260709 12:26:00.464684 32505 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:00.499073 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 298438us
I20260709 12:26:00.466166 32246 raft_consensus.cc:740] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:26:00.500037 25836 raft_consensus.cc:2468] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 15.
I20260709 12:26:00.503023 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 21 candidate_status { last_received { term: 20 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:26:00.506536 25677 raft_consensus.cc:1240] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 16. Current term is 17. Ops: []
I20260709 12:26:00.481964 32029 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:00.514036 26402 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:00.489794 32550 raft_consensus.cc:697] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 26 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:26:00.509653 32505 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:00.539680 26438 raft_consensus.cc:1275] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:26:00.511880 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:26:00.550773 32206 consensus_queue.cc:1048] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:26:00.554745 32283 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.545715 25677 raft_consensus.cc:3060] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Advancing to term 15
W20260709 12:26:00.555653 25801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:00.557091 25801 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:00.551126 25756 raft_consensus.cc:1275] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:26:00.559758 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:26:00.560663 26432 raft_consensus.cc:2393] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 15: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:26:00.562584 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:00.535564 32505 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:00.601773 25763 raft_consensus.cc:2468] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 15.
I20260709 12:26:00.606026 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:26:00.611953 26431 raft_consensus.cc:1275] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 12:26:00.564164 32547 log.cc:927] Time spent T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
W20260709 12:26:00.619580 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 113271us
I20260709 12:26:00.623584 25837 raft_consensus.cc:1275] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 12:26:00.631248 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 116241us
W20260709 12:26:00.677460 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:00.678053 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:00.678524 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 57469.3us
W20260709 12:26:00.684890 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 60291.3us
W20260709 12:26:00.612470 32548 log.cc:927] Time spent T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.319s	user 0.000s	sys 0.007s
I20260709 12:26:00.563876 32440 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
W20260709 12:26:00.613065 32089 consensus_meta.cc:287] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.568s	user 0.012s	sys 0.000s
I20260709 12:26:00.686533 25757 raft_consensus.cc:1275] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:26:00.612047 32560 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.720196 25828 raft_consensus.cc:2410] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 26 because replica has last-logged OpId of term: 25 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 17.
I20260709 12:26:00.565768 32283 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:00.565037 32029 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:00.676285 32304 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.616948 32206 consensus_queue.cc:1048] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.107s
I20260709 12:26:00.612285 32551 consensus_queue.cc:1059] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.216s
W20260709 12:26:00.734884 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 48899.7us
I20260709 12:26:00.735872 25677 raft_consensus.cc:2468] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 15.
I20260709 12:26:00.722988 32564 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
W20260709 12:26:00.764398 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 69068.7us
I20260709 12:26:00.765774 26433 raft_consensus.cc:2468] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 16.
I20260709 12:26:00.686533 32505 consensus_queue.cc:1059] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 12:26:00.755417 32304 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:00.767869 25677 raft_consensus.cc:1240] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:00.768852 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:00.770768 32503 consensus_queue.cc:1048] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:26:00.773547 25684 raft_consensus.cc:1240] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 21 LEADER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 20. Current term is 21. Ops: []
W20260709 12:26:00.789341 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 181523us
I20260709 12:26:00.712575 32286 consensus_queue.cc:1048] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 12:26:00.740486 32428 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:26:00.718592 32525 consensus_queue.cc:1059] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 12:26:00.720736 32440 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:26:00.800444 32554 log.cc:927] Time spent T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.236s	user 0.000s	sys 0.000s
I20260709 12:26:00.801555 32215 raft_consensus.cc:3055] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:26:00.802865 32542 log.cc:927] Time spent T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.567s	user 0.004s	sys 0.004s
I20260709 12:26:00.617535 32518 consensus_queue.cc:237] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:00.731735 32526 consensus_queue.cc:1048] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.060s
W20260709 12:26:00.820207 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:00.788445 32550 consensus_queue.cc:237] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:00.836429 26438 raft_consensus.cc:1240] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 15 LEADER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:00.706005 32246 consensus_queue.cc:260] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:26:00.840729 32558 log.cc:927] Time spent T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.223s	user 0.000s	sys 0.000s
W20260709 12:26:00.810266 32528 consensus_meta.cc:287] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.862s	user 0.011s	sys 0.003s
I20260709 12:26:00.853420 26402 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:00.730130 32560 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:26:00.870633 31537 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 18 current term: 18 is higher.
I20260709 12:26:00.874596 32357 consensus_queue.cc:1048] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:00.876497 25757 raft_consensus.cc:1275] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:26:00.812088 32428 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:00.824791 32215 raft_consensus.cc:740] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:26:00.887828 25650 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
W20260709 12:26:00.905509 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 52184.8us
I20260709 12:26:00.906844 32427 raft_consensus.cc:2749] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:00.882711 32286 raft_consensus.cc:3055] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:00.867524 32433 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:00.792301 32564 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:26:00.908567 32563 log.cc:927] Time spent T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.352s	user 0.001s	sys 0.001s
I20260709 12:26:00.936656 32427 consensus_queue.cc:1048] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
W20260709 12:26:00.942595 32565 log.cc:927] Time spent T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:26:00.942595 32029 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:00.945070 25679 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2985) took 1357 ms. Trace:
I20260709 12:26:00.945470 25679 rpcz_store.cc:276] 0709 12:25:59.588098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:59.588221 (+   123us) service_pool.cc:224] Handling call
0709 12:25:59.588502 (+   281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:59.610871 (+ 22369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:59.610995 (+   124us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:59.611589 (+   594us) log.cc:844] Serialized 26 byte log entry
0709 12:25:59.930999 (+319410us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:25:59.931042 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:59.931110 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:00.802225 (+871115us) spinlock_profiling.cc:243] Waited 1.77 ms on lock 0x7b4400022b4c. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db 00007f5d99708aaf 00007f5d996fc86e 00007f5d996fbbb6 00007f5d996fb7d8 00007f5d99705221 00007f5d997051d9 00007f5d99705169
0709 12:26:00.944790 (+142565us) raft_consensus.cc:1685] finished
0709 12:26:00.944820 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:00.945007 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25595,"raft.queue_time_us":25383,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":4157,"spinlock_wait_cycles":4490240,"thread_start_us":304425,"threads_started":1,"wal-append.queue_time_us":549220}
W20260709 12:26:00.946676 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 59027us
I20260709 12:26:00.907784 26402 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:00.958966 32206 raft_consensus.cc:3060] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:00.882229 32507 consensus_queue.cc:1059] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.050s
I20260709 12:26:00.896148 32528 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:26:01.018231 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 110536us
I20260709 12:26:00.925045 32286 raft_consensus.cc:740] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:26:01.018635 25758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 3239) took 1042 ms. Trace:
I20260709 12:26:01.019507 31825 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.930353 32577 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:00.997290 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:01.019438 32286 consensus_queue.cc:260] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:01.019192 25758 rpcz_store.cc:276] 0709 12:25:59.976209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:59.976361 (+   152us) service_pool.cc:224] Handling call
0709 12:25:59.976754 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:59.978348 (+  1594us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:59.978391 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:59.997403 (+ 19012us) log.cc:844] Serialized 26 byte log entry
0709 12:26:00.297708 (+300305us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:26:00.297753 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:00.297830 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:01.018322 (+720492us) raft_consensus.cc:1685] finished
0709 12:26:01.018352 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:01.018556 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":265824,"threads_started":1,"wal-append.queue_time_us":775028}
W20260709 12:26:01.021898 32576 log.cc:927] Time spent T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
I20260709 12:26:01.022567 26402 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:26:00.901153 32574 consensus_queue.cc:1048] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.072s
I20260709 12:26:01.022742 32581 raft_consensus.cc:2749] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:26:01.023526 32357 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:26:01.024420 32528 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 21 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:01.024575 32580 raft_consensus.cc:3055] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 12:26:00.954767 32570 log.cc:927] Time spent T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.191s	user 0.002s	sys 0.001s
I20260709 12:26:01.024935 25678 raft_consensus.cc:1240] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 20. Current term is 21. Ops: []
W20260709 12:26:01.028576 32579 log.cc:927] Time spent T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260709 12:26:01.060801 32580 raft_consensus.cc:740] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:26:01.031688 32428 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349)
I20260709 12:26:01.033594 31825 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:01.070297 31825 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:26:01.047812 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 47986.7us
I20260709 12:26:01.071350 25650 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
W20260709 12:26:01.041224 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 264983us
I20260709 12:26:01.017536 32427 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:01.028611 32283 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:01.043196 26402 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:26:01.075582 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 318881us
I20260709 12:26:01.046574 32507 raft_consensus.cc:2749] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:26:01.078435 25801 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:26:01.077409 25754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 3235) took 1169 ms. Trace:
I20260709 12:26:01.086880 25650 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:26:01.079051 25800 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:01.094415 25834 raft_consensus.cc:1275] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:26:01.082903 31825 consensus_queue.cc:1059] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:26:01.099447 25834 raft_consensus.cc:1275] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 20 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:26:01.086076 25754 rpcz_store.cc:276] 0709 12:25:59.909184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:59.909642 (+   458us) service_pool.cc:224] Handling call
0709 12:25:59.909952 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:59.910306 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:59.910337 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:59.918543 (+  8206us) log.cc:844] Serialized 26 byte log entry
0709 12:26:00.221068 (+302525us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:26:00.516181 (+295113us) log.cc:844] Serialized 14 byte log entry
0709 12:26:00.516760 (+   579us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:00.516835 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:00.880571 (+363736us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b4400022b4c. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db 00007f5d99708aaf 00007f5d996fc86e 00007f5d996fbbb6 00007f5d996fb7d8 00007f5d99705221 00007f5d997051d9 00007f5d99705169
0709 12:26:01.073254 (+192683us) raft_consensus.cc:1685] finished
0709 12:26:01.077204 (+  3950us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:01.077349 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2091,"prepare.queue_time_us":482833,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":3381,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":3731,"spinlock_wait_cycles":27033856,"thread_start_us":543103,"threads_started":2,"wal-append.queue_time_us":546234}
I20260709 12:26:01.102182 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:01.104609 25831 raft_consensus.cc:1275] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 20 index: 10. (index mismatch)
I20260709 12:26:01.105526 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:01.106287 25683 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 21.
I20260709 12:26:01.108922 31825 raft_consensus.cc:2749] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:01.109035 25800 leader_election.cc:400] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 21 pre-election: Vote denied by peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267) with higher term. Message: Invalid argument: T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 21. Current term is 22.
I20260709 12:26:01.109890 31825 consensus_queue.cc:1059] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:01.111135 31825 raft_consensus.cc:3055] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:26:01.111524 31825 raft_consensus.cc:740] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:26:01.076059 32286 raft_consensus.cc:3060] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:01.116930 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:01.125844 31825 consensus_queue.cc:260] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:01.116847 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:01.075409 32528 raft_consensus.cc:2749] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:26:01.129019 25831 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 21.
I20260709 12:26:01.130167 31825 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:01.135499 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:01.136567 25683 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 21.
I20260709 12:26:01.140769 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:01.046547 32577 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:01.112437 32283 raft_consensus.cc:2804] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:01.144467 32526 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:26:01.146826 32526 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:01.147971 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:01.148979 32514 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:26:01.149433 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:01.149982 25650 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:26:01.149713 32514 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:01.063108 32357 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:01.098491 32029 raft_consensus.cc:2749] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:01.114696 32531 raft_consensus.cc:2804] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:01.075382 32503 consensus_queue.cc:1048] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.055s
I20260709 12:26:01.052564 32215 consensus_queue.cc:260] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:01.130162 32585 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:26:01.131498 32304 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:01.144376 32551 raft_consensus.cc:3055] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:01.114526 32462 consensus_queue.cc:1048] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.048s
I20260709 12:26:01.082165 32427 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:01.148975 32526 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:26:01.195302 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 45390.1us
I20260709 12:26:01.174510 32528 raft_consensus.cc:2749] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:26:01.172696 32531 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:01.175621 32568 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.201385 25650 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:01.216344 32526 raft_consensus.cc:2804] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:01.216930 32564 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:01.195230 32215 raft_consensus.cc:3060] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:01.182932 32551 raft_consensus.cc:740] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:26:01.227171 32526 raft_consensus.cc:697] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 15 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:26:01.228605 32588 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.228317 32526 consensus_queue.cc:237] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:01.229107 32588 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:01.230652 32304 consensus_queue.cc:1048] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:01.231575 32588 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:26:01.220482 32584 log.cc:927] Time spent T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 12:26:01.239040 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:01.232579 32514 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:01.207715 32531 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:26:01.237874 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 81167.6us
I20260709 12:26:01.243005 32560 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:01.243131 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:01.243898 32357 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:01.185246 32585 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:01.177837 32586 consensus_queue.cc:1059] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 12:26:01.242134 32528 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
W20260709 12:26:01.250716 26402 leader_election.cc:336] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Timed out: RequestConsensusVote RPC to 127.23.245.131:36237 timed out after 1.686s (SENT)
I20260709 12:26:01.268173 26402 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:26:01.269080 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:01.269881 25754 raft_consensus.cc:2393] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 19: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:26:01.239812 32283 raft_consensus.cc:697] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 15 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:26:01.253094 32551 consensus_queue.cc:260] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:01.225653 32443 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:01.261484 25800 leader_election.cc:400] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 21 election: Vote denied by peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267) with higher term. Message: Invalid argument: T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 21. Current term is 22.
I20260709 12:26:01.274199 25800 leader_election.cc:403] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 12:26:01.262948 25759 raft_consensus.cc:2468] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 18.
I20260709 12:26:01.264866 26432 raft_consensus.cc:1275] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:26:01.265120 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:01.265662 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:01.274971 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:01.266889 26431 raft_consensus.cc:1275] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:26:01.270145 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:01.262666 32562 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.273131 25650 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:26:01.278083 26433 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 20.
I20260709 12:26:01.280155 25683 raft_consensus.cc:1240] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 16. Current term is 17. Ops: []
I20260709 12:26:01.255628 32427 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:01.222988 32568 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:26:01.295080 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:01.282343 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:26:01.306680 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 56005.4us
I20260709 12:26:01.308621 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:01.270136 32089 consensus_queue.cc:1059] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.021s
I20260709 12:26:01.309962 25761 raft_consensus.cc:1275] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:26:01.275641 32462 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:01.313133 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:01.277706 32529 raft_consensus.cc:2749] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267) with higher term. Message: Invalid argument: T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 21. Current term is 22.
I20260709 12:26:01.277276 32577 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:01.271741 32528 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:01.280268 32206 raft_consensus.cc:2749] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:01.325178 32462 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:01.326351 32585 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:01.313326 32574 raft_consensus.cc:2749] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:01.327492 32604 consensus_queue.cc:1048] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:26:01.311578 32560 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:01.271471 32561 consensus_queue.cc:1048] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 12:26:01.356895 32206 raft_consensus.cc:2804] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 12:26:01.357241 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 49406us
I20260709 12:26:01.357575 32610 consensus_queue.cc:1048] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:26:01.314750 32551 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:01.306428 32564 consensus_queue.cc:1048] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 12:26:01.370442 25801 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:26:01.279759 32443 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:01.328718 32524 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:01.303329 32602 consensus_queue.cc:1048] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.092s
I20260709 12:26:01.302836 32562 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:01.374362 32206 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:01.404935 32206 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:01.390687 32503 raft_consensus.cc:2804] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:01.414019 32503 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:01.414391 32503 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:26:01.422412 32591 log.cc:927] Time spent T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 12:26:01.427168 32462 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:01.373991 32560 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:01.446379 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:01.454509 32443 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:01.456825 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:01.459031 26431 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 10.
I20260709 12:26:01.361617 32283 consensus_queue.cc:237] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:01.407411 32518 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:26:01.392225 32524 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:01.495491 32574 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:26:01.447615 25726 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:01.558910 32295 raft_consensus.cc:2749] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:26:01.506577 32528 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:26:01.559056 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 111569us
I20260709 12:26:01.570860 25726 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:01.571825 32295 raft_consensus.cc:2749] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:01.572862 25726 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:01.574692 25726 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:01.576529 25726 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:01.580145 32607 raft_consensus.cc:2749] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:01.580789 25726 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:01.582018 32607 raft_consensus.cc:2749] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:26:01.583276 25726 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
W20260709 12:26:01.584273 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 311199us
I20260709 12:26:01.546344 32518 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:01.586794 26402 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:26:01.587525 32357 raft_consensus.cc:2804] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:01.587939 32357 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:01.588339 32357 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:01.588563 32518 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:01.578750 32613 raft_consensus.cc:2749] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:26:01.590777 32589 consensus_queue.cc:1059] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:26:01.591506 32589 consensus_queue.cc:1243] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer f82778701b464892aab92a752ed7ffdc log is divergent from this leader: its last log entry 21.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:26:01.597070 25726 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:01.601735 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:01.602509 32607 raft_consensus.cc:2749] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:26:01.598951 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:01.603888 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:26:01.604274 32568 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:26:01.604913 32615 log.cc:927] Time spent T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 12:26:01.605590 32562 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:01.606930 32560 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:26:01.578883 32597 log.cc:927] Time spent T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.262s	user 0.001s	sys 0.000s
I20260709 12:26:01.607725 25762 raft_consensus.cc:1240] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:01.609056 25760 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 3592) took 1005 ms. Trace:
I20260709 12:26:01.609403 25760 rpcz_store.cc:276] 0709 12:26:00.603558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:00.604468 (+   910us) service_pool.cc:224] Handling call
0709 12:26:00.604815 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:00.616273 (+ 11458us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:26:00.846517 (+230244us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b1800267ee0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d96a56e07 00007f5d9f8b19a9 00007f5d96a7369b 00007f5d96a7193f 00007f5d96a71455 00007f5d9d5593c7 00007f5d99b6b9a7 00007f5d99b7b0bf 00007f5d99b7b038
0709 12:26:01.089519 (+243002us) log.cc:844] Serialized 14 byte log entry
0709 12:26:01.273620 (+184101us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:01.274086 (+   466us) log.cc:844] Serialized 26 byte log entry
0709 12:26:01.274223 (+   137us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:26:01.274260 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:01.274324 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:01.608770 (+334446us) raft_consensus.cc:1685] finished
0709 12:26:01.608865 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:01.608983 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11000,"prepare.queue_time_us":113011,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":112627,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":60713,"spinlock_wait_cycles":32663296,"thread_start_us":426504,"threads_started":3,"wal-append.queue_time_us":184013}
I20260709 12:26:01.610919 32206 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:01.577144 32577 raft_consensus.cc:2749] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:01.612131 32613 raft_consensus.cc:2749] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:26:01.614034 32525 raft_consensus.cc:3055] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:26:01.614564 32525 raft_consensus.cc:740] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:26:01.564930 32574 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:01.618607 32574 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:01.611570 25760 raft_consensus.cc:1275] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:26:01.611510 25754 raft_consensus.cc:2410] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 16 because replica has last-logged OpId of term: 14 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 6.
I20260709 12:26:01.605293 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:01.620705 25757 raft_consensus.cc:2393] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 18: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:26:01.621095 25726 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:01.619745 25835 raft_consensus.cc:3055] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:26:01.621956 25835 raft_consensus.cc:740] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:26:01.625766 25726 leader_election.cc:400] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 election: Vote denied by peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237) with higher term. Message: Invalid argument: T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 17. Current term is 18.
I20260709 12:26:01.627286 25726 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:01.622802 25835 consensus_queue.cc:260] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:01.636561 25835 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:01.627318 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:01.607456 32531 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:01.641489 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:01.641978 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:01.642104 25684 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 10.
I20260709 12:26:01.641279 25726 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:01.642608 25683 raft_consensus.cc:2468] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 17.
I20260709 12:26:01.644443 32206 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 22 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:01.644830 32526 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:01.646138 32526 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:01.648249 32526 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:01.645114 32503 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:01.651747 32503 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 22 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:01.615679 32525 consensus_queue.cc:260] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:01.653391 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:01.656541 32524 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:01.661952 25835 raft_consensus.cc:1275] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:26:01.665210 25836 raft_consensus.cc:1275] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:26:01.667456 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:01.668273 25836 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 10.
I20260709 12:26:01.635547 32215 raft_consensus.cc:2804] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:26:01.673485 26402 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:26:01.639768 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:01.677310 25680 raft_consensus.cc:2393] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 17: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:26:01.659514 32562 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.682889 25649 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:26:01.680994 25726 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:01.688450 25726 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:01.688812 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:01.658345 32357 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:01.690336 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:01.713044 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:26:01.713128 25726 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:01.714246 25683 raft_consensus.cc:2393] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 22: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:26:01.676256 32524 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.672216 32567 raft_consensus.cc:2749] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:01.716075 25726 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:01.672152 32215 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 23 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:26:01.717716 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:01.723160 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:01.723593 25835 raft_consensus.cc:2468] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 20.
I20260709 12:26:01.719156 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 27 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:01.691666 32029 raft_consensus.cc:2804] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:01.717502 32607 raft_consensus.cc:2804] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:01.712054 32206 raft_consensus.cc:2749] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:26:01.717720 32295 raft_consensus.cc:2749] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:26:01.729270 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:01.734704 25757 raft_consensus.cc:2468] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 17.
I20260709 12:26:01.726353 32029 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:01.732300 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:01.735905 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:01.749936 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:01.691017 32568 raft_consensus.cc:2749] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:01.717381 32567 raft_consensus.cc:2749] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:01.736881 25649 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:26:01.747324 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:26:01.724304 32215 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:01.750000 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:01.752066 25757 raft_consensus.cc:2393] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 16: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:26:01.754268 25830 raft_consensus.cc:2393] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 22: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:26:01.768911 26432 raft_consensus.cc:3060] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:01.750974 25835 raft_consensus.cc:2393] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 15: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
W20260709 12:26:01.755013 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 81634.3us
I20260709 12:26:01.753630 25650 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:26:01.732729 32607 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:26:01.791013 25649 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:26:01.691329 32562 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:01.721514 32528 consensus_queue.cc:1048] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 12:26:01.796248 25650 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:26:01.799670 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:01.751973 32029 raft_consensus.cc:3060] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:01.869123 25760 raft_consensus.cc:1275] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 12:26:01.881356 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 90492.5us
I20260709 12:26:01.723887 32524 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:01.750885 32427 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:01.871935 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 117108us
I20260709 12:26:01.872433 26432 raft_consensus.cc:2468] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 22.
I20260709 12:26:01.808761 32206 raft_consensus.cc:2804] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:01.799891 32526 raft_consensus.cc:2749] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:01.884649 25828 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41782 (request call id 1401) took 1641 ms. Trace:
W20260709 12:26:01.885322 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 169380us
I20260709 12:26:01.773756 32462 consensus_queue.cc:1048] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.102s
I20260709 12:26:01.887691 25760 raft_consensus.cc:1275] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:26:01.886585 32561 raft_consensus.cc:3060] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:01.880142 32607 raft_consensus.cc:3060] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:26:01.885577 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:01.888001 32642 log.cc:927] Time spent T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:26:01.878314 32518 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:01.910470 32531 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:01.899670 32206 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:26:01.910923 32518 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:01.911612 32206 raft_consensus.cc:3060] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:01.868884 32567 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:01.901487 25726 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:01.875464 32283 consensus_queue.cc:1059] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 12:26:01.899250 25828 rpcz_store.cc:276] 0709 12:26:00.242779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:00.243003 (+   224us) service_pool.cc:224] Handling call
0709 12:26:01.884465 (+1641462us) spinlock_profiling.cc:243] Waited 445 ms on lock 0x7b540010c054. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:26:01.884593 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1024104192}
I20260709 12:26:01.924363 32357 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 21 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:01.895826 32609 consensus_queue.cc:1048] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
I20260709 12:26:01.895687 25801 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:26:01.890177 32295 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:01.898993 32526 raft_consensus.cc:2804] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:01.921159 25726 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:01.933733 25726 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:01.921860 32568 raft_consensus.cc:2749] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:01.940742 25726 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
W20260709 12:26:01.945174 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 68121.5us
W20260709 12:26:01.949388 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 53822.9us
I20260709 12:26:01.890297 32427 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:01.935443 32526 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:26:01.965320 32462 consensus_queue.cc:1048] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:26:01.969657 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 197618us
I20260709 12:26:01.971117 25650 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:26:01.948791 32637 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:01.982141 25726 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:01.959805 32598 raft_consensus.cc:2804] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:01.963116 32568 raft_consensus.cc:2749] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:01.970335 32526 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:01.997131 25726 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:01.944234 32295 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:01.936731 32567 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:01.978561 32644 raft_consensus.cc:2764] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:26:01.992059 32503 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:26:01.999598 32598 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:02.005828 32562 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:02.001940 32433 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:26:01.993104 32612 consensus_queue.cc:1048] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 12:26:02.011387 32650 raft_consensus.cc:3060] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:02.025219 32427 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:01.997368 32637 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:02.025349 32598 raft_consensus.cc:3060] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:02.021901 32568 raft_consensus.cc:2749] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:02.024667 32607 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:02.051478 32029 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:02.054432 32029 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:26:02.047159 32551 consensus_meta.cc:287] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.659s	user 0.015s	sys 0.003s
I20260709 12:26:02.039446 32644 raft_consensus.cc:2804] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:02.026919 32503 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:02.041783 32524 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:26:02.069396 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 67956.1us
I20260709 12:26:02.048722 32427 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
W20260709 12:26:02.071803 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 74782.4us
I20260709 12:26:02.073719 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:02.078635 25831 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:02.074923 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:02.032070 32433 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:02.081135 25726 leader_election.cc:400] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 election: Vote denied by peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237) with higher term. Message: Invalid argument: T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 14. Current term is 15.
I20260709 12:26:02.081574 25726 leader_election.cc:403] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:26:02.068261 32610 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.068027 32651 raft_consensus.cc:2804] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:02.086349 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:02.061375 32657 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.068655 32644 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:26:02.071262 32029 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:02.075403 32295 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:02.102624 32607 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:02.097255 32503 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:02.094858 32561 raft_consensus.cc:2749] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:02.092396 32568 raft_consensus.cc:2749] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237) with higher term. Message: Invalid argument: T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 14. Current term is 15.
I20260709 12:26:02.087873 32427 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:02.122242 32567 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:02.114627 32610 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:02.124269 32427 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:02.104090 32215 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:02.126875 32215 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 24 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:02.105054 32206 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:02.106047 25726 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
W20260709 12:26:02.106882 26402 leader_election.cc:336] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Timed out: RequestConsensusVote RPC to 127.23.245.131:36237 timed out after 1.543s (SENT)
I20260709 12:26:02.129861 26402 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:02.073259 32550 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:02.105011 25831 raft_consensus.cc:2468] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 17.
I20260709 12:26:02.112871 32651 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:26:02.131570 25650 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:26:02.135645 32637 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:02.136500 32433 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:02.137190 32550 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:02.117254 32657 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:02.125759 32610 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:02.117785 32644 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:02.141866 32651 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:02.164554 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 22 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:02.165249 25763 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 21.
I20260709 12:26:02.134516 32427 raft_consensus.cc:2749] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:02.144891 32580 consensus_queue.cc:260] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:02.171980 32580 raft_consensus.cc:3060] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:02.174819 25834 raft_consensus.cc:1275] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:26:02.175681 32524 raft_consensus.cc:2804] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:02.176460 32524 raft_consensus.cc:697] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 17 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:26:02.177063 25836 raft_consensus.cc:1275] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:26:02.177423 32524 consensus_queue.cc:237] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:02.178175 32246 raft_consensus.cc:3060] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:26:02.179114 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:02.180116 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:02.180384 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:02.180783 25829 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 15.
I20260709 12:26:02.181084 25832 raft_consensus.cc:2393] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 15: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
W20260709 12:26:02.181859 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 50434.7us
I20260709 12:26:02.183307 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:02.185251 32440 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:02.184370 25836 raft_consensus.cc:2393] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 17: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:26:02.186784 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:02.143790 32656 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:02.188787 32656 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:02.191095 32656 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:02.192370 32644 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:02.195350 32644 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:02.149464 32657 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:02.128990 32029 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:02.151494 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:02.146046 32550 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:02.156502 26438 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36510 (request call id 1595) took 1068 ms. Trace:
I20260709 12:26:02.245177 26438 rpcz_store.cc:276] 0709 12:26:01.088250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:01.088393 (+   143us) service_pool.cc:224] Handling call
0709 12:26:01.088655 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:01.221585 (+132930us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:01.221631 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:01.221691 (+    60us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:26:01.221738 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:02.156232 (+934494us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b54005c2454. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:26:02.156284 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:02.156438 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":305110272}
I20260709 12:26:02.152863 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:02.246802 25837 raft_consensus.cc:2368] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 21. Current term is 22.
I20260709 12:26:02.247052 25761 raft_consensus.cc:2410] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 12:26:02.162763 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:02.163671 32518 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:02.143210 32658 raft_consensus.cc:2749] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:26:02.248687 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:26:02.252018 32622 log.cc:927] Time spent T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.680s	user 0.004s	sys 0.001s
I20260709 12:26:02.253348 32650 raft_consensus.cc:2749] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:02.235100 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:02.256243 32029 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:02.236897 32206 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:26:02.239114 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:02.258554 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 152585us
I20260709 12:26:02.259311 25726 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:02.260082 32658 raft_consensus.cc:2749] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:02.240432 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:02.240697 25649 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:26:02.243094 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:02.261143 26432 raft_consensus.cc:2393] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 22: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:26:02.263103 32514 raft_consensus.cc:2804] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:02.263509 32514 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:02.263983 32514 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:02.267653 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:02.268977 32583 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.269541 32583 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:02.270102 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:02.270653 25800 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:02.271863 32583 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:02.276089 32651 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:02.276911 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 21 candidate_status { last_received { term: 18 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:02.277915 25759 raft_consensus.cc:2393] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 19: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:26:02.277789 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:02.261232 25726 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:02.279278 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:02.279474 32577 raft_consensus.cc:2749] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:26:02.280027 25726 leader_election.cc:400] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237) with higher term. Message: Invalid argument: T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for earlier term 17. Current term is 18.
W20260709 12:26:02.281466 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:02.281863 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:02.283270 25762 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 19.
I20260709 12:26:02.286736 25762 raft_consensus.cc:1240] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:02.289585 32577 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
W20260709 12:26:02.290594 32649 log.cc:927] Time spent T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.250s	user 0.000s	sys 0.003s
I20260709 12:26:02.290385 32577 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:02.243182 32598 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:02.244349 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:02.293905 26437 raft_consensus.cc:2368] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for earlier term 18. Current term is 19.
I20260709 12:26:02.293251 32577 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:02.157153 32526 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:02.298285 31537 consensus_queue.cc:1048] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:02.278317 32651 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:02.303607 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:02.304689 25686 raft_consensus.cc:1240] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:02.306509 25686 raft_consensus.cc:1240] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:02.307063 32573 raft_consensus.cc:3055] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:26:02.307497 32573 raft_consensus.cc:740] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:26:02.307549 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:02.307798 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:02.308408 32573 consensus_queue.cc:260] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:02.309559 32573 raft_consensus.cc:3060] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:02.309659 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:02.310473 25686 raft_consensus.cc:2468] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 19.
I20260709 12:26:02.313436 32562 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
W20260709 12:26:02.314096 25725 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:02.313946 32562 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:26:02.315670 32659 log.cc:927] Time spent T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.195s	user 0.000s	sys 0.002s
I20260709 12:26:02.316021 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:02.317468 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:02.317600 32588 raft_consensus.cc:3055] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:02.317523 32562 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:02.318246 32588 raft_consensus.cc:740] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:26:02.319326 32588 consensus_queue.cc:260] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:02.155261 32610 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.321475 32610 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:02.322860 32525 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:02.323944 32610 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:02.324756 32598 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:02.327009 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:02.327589 26437 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 10.
I20260709 12:26:02.330509 25836 raft_consensus.cc:1240] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:02.321858 25686 raft_consensus.cc:2410] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for term 19 because replica has last-logged OpId of term: 17 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 15.
I20260709 12:26:02.320665 32588 raft_consensus.cc:3060] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:02.334303 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:02.341442 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:02.342285 25762 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 16.
I20260709 12:26:02.343091 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:02.344724 32526 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 21 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:02.345275 25678 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 2988) took 1843 ms. Trace:
I20260709 12:26:02.345682 25678 rpcz_store.cc:276] 0709 12:26:00.501933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:00.502057 (+   124us) service_pool.cc:224] Handling call
0709 12:26:00.502312 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:01.065123 (+562811us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:02.345015 (+1279892us) spinlock_profiling.cc:243] Waited 522 ms on lock 0x7b5400232654. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:26:02.345216 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1201512192}
W20260709 12:26:02.346617 32628 log.cc:927] Time spent T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.774s	user 0.002s	sys 0.002s
I20260709 12:26:02.347654 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:02.348145 25754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53460 (request call id 3256) took 1066 ms. Trace:
I20260709 12:26:02.348428 26432 raft_consensus.cc:2393] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 19: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:26:02.348541 25754 rpcz_store.cc:276] 0709 12:26:01.281494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:01.281808 (+   314us) service_pool.cc:224] Handling call
0709 12:26:02.347907 (+1066099us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b54003976d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:26:02.348071 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":694642048}
I20260709 12:26:02.349925 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:02.350191 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:02.350880 26439 raft_consensus.cc:2468] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 18.
I20260709 12:26:02.350992 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:02.352124 26439 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36508 (request call id 1672) took 1087 ms. Trace:
I20260709 12:26:02.352463 26439 rpcz_store.cc:276] 0709 12:26:01.265208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:01.265356 (+   148us) service_pool.cc:224] Handling call
0709 12:26:02.351953 (+1086597us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b5400604fd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:26:02.352051 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2473006976}
I20260709 12:26:02.352988 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:02.353628 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:02.354049 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:02.335790 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:26:02.356927 25758 raft_consensus.cc:3060] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:02.357036 25754 raft_consensus.cc:1240] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 15. Current term is 16. Ops: []
I20260709 12:26:02.363528 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:02.365228 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:26:02.365808 25684 raft_consensus.cc:3060] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:26:02.368289 25757 raft_consensus.cc:1240] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 24 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 23. Current term is 24. Ops: []
I20260709 12:26:02.353936 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:02.373122 25684 raft_consensus.cc:2468] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 19.
I20260709 12:26:02.374207 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:26:02.374934 25686 raft_consensus.cc:2368] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 21. Current term is 22.
I20260709 12:26:02.378141 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:26:02.383177 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 345656us
I20260709 12:26:02.384100 25801 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:26:02.386363 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:02.392432 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:26:02.393338 25762 raft_consensus.cc:3060] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:02.397233 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:26:02.397529 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:02.398967 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:26:02.399847 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:02.400740 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:02.400889 25836 raft_consensus.cc:2393] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 18: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:26:02.404695 25684 raft_consensus.cc:2393] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 17: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:26:02.407981 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 22 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:02.371214 25834 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 19.
I20260709 12:26:02.409819 25831 raft_consensus.cc:2410] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 22 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 12:26:02.409850 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:02.410167 25801 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:26:02.410569 25683 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 20.
I20260709 12:26:02.413079 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:26:02.408764 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:02.415578 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 27 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:02.416724 25683 raft_consensus.cc:1240] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 15. Current term is 16. Ops: []
I20260709 12:26:02.418346 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:26:02.419559 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:02.421657 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:02.425660 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
W20260709 12:26:02.428270 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:02.430902 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:02.432753 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:02.433090 25650 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:26:02.435320 25679 raft_consensus.cc:1275] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:26:02.437371 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:02.436311 26402 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:26:02.442643 25754 raft_consensus.cc:1240] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 18. Current term is 19. Ops: []
I20260709 12:26:02.446053 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:02.448665 25680 raft_consensus.cc:1275] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:26:02.450222 25683 raft_consensus.cc:1240] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:02.450299 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:26:02.451428 26437 raft_consensus.cc:2393] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 22: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:26:02.452260 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:02.453454 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:02.454563 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:02.455348 25835 raft_consensus.cc:2410] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 26 because replica has last-logged OpId of term: 25 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 17.
I20260709 12:26:02.455403 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:02.456354 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:02.456449 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:02.457032 26432 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 18.
I20260709 12:26:02.457677 25726 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:02.458925 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:02.413331 32586 raft_consensus.cc:2804] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:26:02.408943 32658 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.459837 25726 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:02.470645 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:02.458546 25758 raft_consensus.cc:2468] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 19.
I20260709 12:26:02.458572 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:02.461405 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:02.462363 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:02.463238 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:02.478488 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:02.479233 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:26:02.479705 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:26:02.480769 26432 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:02.452829 26402 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:02.488489 32441 raft_consensus.cc:2749] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:26:02.489753 26402 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:02.492739 25755 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 3258) took 1208 ms. Trace:
I20260709 12:26:02.493062 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:26:02.492115 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 59107.1us
I20260709 12:26:02.498849 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:26:02.499441 26437 raft_consensus.cc:3060] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:02.493280 25755 rpcz_store.cc:276] 0709 12:26:01.284082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:01.284921 (+   839us) service_pool.cc:224] Handling call
0709 12:26:01.285340 (+   419us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:01.369364 (+ 84024us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:26:01.387755 (+ 18391us) log.cc:844] Serialized 14 byte log entry
0709 12:26:01.658990 (+271235us) spinlock_profiling.cc:243] Waited 5.93 ms on lock 0x7b1800439c60. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d96a56e07 00007f5d9f8b19a9 00007f5d96a7369b 00007f5d96a7193f 00007f5d96a73c02 00007f5d996fb20b 00007f5d99700d23 00007f5d9970123a 00007f5d99b6ba2a
0709 12:26:01.755610 (+ 96620us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:01.756286 (+   676us) log.cc:844] Serialized 26 byte log entry
0709 12:26:01.756485 (+   199us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:26:01.759008 (+  2523us) log.cc:844] Serialized 14 byte log entry
0709 12:26:02.274885 (+515877us) spinlock_profiling.cc:243] Waited 8.91 ms on lock 0x7b1800439c60. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d96a56e07 00007f5d9f8b19a9 00007f5d96a7369b 00007f5d96a7193f 00007f5d96a71455 00007f5d99b59060 00007f5d99b6b716 00007f5d99b7c287 00007f5d99b7c208
0709 12:26:02.464255 (+189370us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:02.492513 (+ 28258us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:02.492562 (+    49us) raft_consensus.cc:1685] finished
0709 12:26:02.492573 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:02.492689 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":16675,"prepare.run_cpu_time_us":92,"prepare.run_wall_time_us":4269,"raft.queue_time_us":108214,"raft.run_cpu_time_us":381,"raft.run_wall_time_us":61305,"spinlock_wait_cycles":34149120,"thread_start_us":369107,"threads_started":3,"wal-append.queue_time_us":359617}
I20260709 12:26:02.521772 25762 raft_consensus.cc:2468] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 18.
I20260709 12:26:02.459126 32624 raft_consensus.cc:2804] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:02.528824 25835 raft_consensus.cc:1275] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 12:26:02.529332 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:02.543447 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:02.545418 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 55735.3us
I20260709 12:26:02.571966 26402 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:02.438527 32580 consensus_queue.cc:1048] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.078s
I20260709 12:26:02.477576 32613 raft_consensus.cc:2749] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:02.491076 32601 raft_consensus.cc:2804] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:26:02.552049 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 45629us
I20260709 12:26:02.460095 32029 consensus_queue.cc:1048] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.078s
I20260709 12:26:02.505330 32215 raft_consensus.cc:2749] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:02.515245 32528 raft_consensus.cc:3060] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:02.556041 25650 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:26:02.558158 25800 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:02.589066 26402 leader_election.cc:400] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 21 pre-election: Vote denied by peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237) with higher term. Message: Invalid argument: T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 21. Current term is 22.
I20260709 12:26:02.558687 26432 raft_consensus.cc:2468] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 17.
I20260709 12:26:02.513610 32568 raft_consensus.cc:2749] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:26:02.531231 32634 log.cc:927] Time spent T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:26:02.562762 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:02.567301 25759 raft_consensus.cc:1240] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:02.564961 32643 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.568064 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:02.583721 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:02.601526 25835 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:02.560055 32610 raft_consensus.cc:493] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.560317 32586 raft_consensus.cc:697] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 22 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:26:02.568944 32624 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:02.565657 26437 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 11.
I20260709 12:26:02.593609 26402 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:26:02.577301 32601 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:26:02.505955 32658 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:02.592607 32441 raft_consensus.cc:2749] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:02.616137 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:02.604482 25762 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 21.
I20260709 12:26:02.593014 32571 raft_consensus.cc:2749] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:02.594388 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:02.601599 32588 consensus_queue.cc:1059] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 20.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 12:26:02.653666 26402 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:26:02.664770 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
W20260709 12:26:02.665836 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 107771us
W20260709 12:26:02.630472 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 74524.9us
I20260709 12:26:02.720249 25800 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:26:02.666035 26432 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 20.
W20260709 12:26:02.724144 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 211903us
W20260709 12:26:02.652840 32605 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 21 current term: 21 is higher.
W20260709 12:26:02.726440 32661 log.cc:927] Time spent T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
W20260709 12:26:02.736177 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 82526.4us
W20260709 12:26:02.727555 32666 log.cc:927] Time spent T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:26:02.727947 32654 consensus_queue.cc:1048] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.106s
I20260709 12:26:02.730037 32660 consensus_queue.cc:1059] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.064s
I20260709 12:26:02.735087 25835 raft_consensus.cc:2468] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 19.
W20260709 12:26:02.734375 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 50781.1us
I20260709 12:26:02.619768 32601 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:26:02.744089 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:02.652421 32428 raft_consensus.cc:2804] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:02.617215 32624 raft_consensus.cc:3060] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:02.753298 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:26:02.762403 25829 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 17.
I20260709 12:26:02.769639 26435 raft_consensus.cc:1275] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:26:02.619248 32514 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:02.775394 25649 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:26:02.666734 32637 consensus_queue.cc:1059] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.109s
I20260709 12:26:02.669975 32103 raft_consensus.cc:2749] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:02.776844 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:02.664762 32531 raft_consensus.cc:2749] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:02.784777 25650 leader_election.cc:400] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Vote denied by peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611) with higher term. Message: Invalid argument: T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for earlier term 18. Current term is 19.
I20260709 12:26:02.747130 32550 raft_consensus.cc:2804] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:02.790515 26401 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:26:02.664008 32530 consensus_queue.cc:1048] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.118s
I20260709 12:26:02.768436 32428 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:26:02.810122 32562 raft_consensus.cc:2804] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:26:02.810704 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:02.616936 32610 raft_consensus.cc:515] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:02.609386 32643 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:02.805217 32550 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:02.887822 32525 raft_consensus.cc:2804] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:02.812021 32608 consensus_queue.cc:1048] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.008s
I20260709 12:26:02.748229 32564 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:26:02.771270 32567 consensus_queue.cc:1059] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:26:02.925212 32574 raft_consensus.cc:3055] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:26:02.931602 32599 raft_consensus.cc:2749] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:02.936415 32626 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.814905 32586 consensus_queue.cc:237] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:02.937726 32550 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:02.938014 32525 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:02.940629 32562 raft_consensus.cc:697] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 18 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:26:02.941051 32564 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:26:02.948976 32664 log.cc:927] Time spent T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.335s	user 0.001s	sys 0.000s
I20260709 12:26:02.944046 32574 raft_consensus.cc:740] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
W20260709 12:26:02.958840 32671 log.cc:927] Time spent T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
I20260709 12:26:02.961522 32658 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:02.963199 32610 leader_election.cc:290] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:02.952888 32626 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:02.964810 32643 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:02.965544 32626 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:02.997177 25680 raft_consensus.cc:2393] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 22: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
W20260709 12:26:02.997061 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 212596us
I20260709 12:26:02.792886 25650 leader_election.cc:403] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:26:03.006677 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 221934us
W20260709 12:26:03.016644 25757 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.018s	sys 0.036s
W20260709 12:26:03.017319 25757 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.018s	sys 0.037s
I20260709 12:26:03.022470 25831 raft_consensus.cc:1240] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 12:26:03.024931 25760 raft_consensus.cc:1240] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 18. Current term is 19. Ops: []
I20260709 12:26:03.025506 25726 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:03.027956 25831 raft_consensus.cc:1240] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 12:26:03.031132 25755 raft_consensus.cc:1240] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:03.034757 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
W20260709 12:26:02.805330 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 85313.1us
I20260709 12:26:03.040390 25650 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
W20260709 12:26:02.913224 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 133451us
W20260709 12:26:02.805502 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 63987.5us
I20260709 12:26:03.046509 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 22 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:26:03.047271 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:03.048396 25757 raft_consensus.cc:2468] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 15.
W20260709 12:26:03.048609 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:03.047523 25763 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:03.045289 26402 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:26:03.049978 32246 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:26:03.050833 32246 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:03.061904 25800 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:03.051527 26402 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:26:03.053711 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 263241us
I20260709 12:26:03.060472 32029 raft_consensus.cc:2804] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:03.064673 32206 raft_consensus.cc:2749] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611) with higher term. Message: Invalid argument: T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for earlier term 18. Current term is 19.
I20260709 12:26:03.065466 32246 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:03.065673 32029 raft_consensus.cc:697] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 19 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:26:03.071764 25650 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:26:03.065739 26402 leader_election.cc:400] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 21 election: Vote denied by peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) with higher term. Message: Invalid argument: T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 21. Current term is 22.
I20260709 12:26:03.080979 26402 leader_election.cc:403] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260709 12:26:03.069437 32029 consensus_queue.cc:237] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:26:03.076188 25803 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:03.075567 26401 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:03.084636 25801 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:03.086380 26401 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
W20260709 12:26:03.079873 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 54870.6us
I20260709 12:26:03.088881 25726 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:03.090771 25800 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:03.091300 32246 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:26:03.092144 25726 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:03.095674 32206 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.105064 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:03.087633 25801 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:03.111377 25800 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:26:03.099646 32215 raft_consensus.cc:2749] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:03.117453 32283 raft_consensus.cc:2749] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:03.119979 32286 raft_consensus.cc:2749] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:26:02.923709 32428 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:03.121145 32396 raft_consensus.cc:2749] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:03.125527 32441 raft_consensus.cc:2804] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:03.236292 32441 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:03.236871 32441 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:03.130573 32462 raft_consensus.cc:2749] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:03.131515 32525 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:03.131960 32514 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 22 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:03.132680 32529 raft_consensus.cc:2749] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:03.137076 32526 raft_consensus.cc:2804] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:03.127725 25763 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 22.
I20260709 12:26:03.145364 32562 consensus_queue.cc:237] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:03.146610 32552 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:03.148838 32577 raft_consensus.cc:3055] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:26:03.150682 32599 raft_consensus.cc:2749] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) with higher term. Message: Invalid argument: T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 21. Current term is 22.
I20260709 12:26:03.151634 32600 raft_consensus.cc:2749] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:03.152482 32580 raft_consensus.cc:2749] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:03.152186 32574 consensus_queue.cc:260] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:03.264235 32574 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:03.264806 32656 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.265483 32656 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:03.225129 32589 raft_consensus.cc:3055] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:26:03.266793 32589 raft_consensus.cc:740] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
W20260709 12:26:03.267885 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 156695us
I20260709 12:26:03.229806 32594 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:03.245501 32526 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:03.249473 32644 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:03.260058 32577 raft_consensus.cc:740] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:26:03.262365 32215 raft_consensus.cc:2749] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:03.273828 25800 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
W20260709 12:26:03.284260 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 192405us
I20260709 12:26:03.284657 32656 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:03.285848 25726 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
W20260709 12:26:03.286926 32528 consensus_meta.cc:287] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc: Time spent flushing consensus metadata: real 0.686s	user 0.008s	sys 0.012s
I20260709 12:26:03.287024 32577 consensus_queue.cc:260] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:03.288240 32644 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:03.289557 32577 raft_consensus.cc:3060] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:03.276301 32526 raft_consensus.cc:3060] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:03.279685 32246 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:03.297457 32246 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:03.298177 32246 raft_consensus.cc:2749] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:03.299604 32594 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:03.302390 32594 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:26:03.305900 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 218511us
I20260709 12:26:03.307655 31537 raft_consensus.cc:2749] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:26:03.316448 32564 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:26:03.321768 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 270566us
I20260709 12:26:03.229710 32206 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:03.287700 32528 raft_consensus.cc:2749] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:26:03.325205 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 242045us
I20260709 12:26:03.288285 32103 raft_consensus.cc:2804] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:03.273594 32589 consensus_queue.cc:260] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.9, Last appended by leader: 9, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:26:03.329430 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 55848.3us
I20260709 12:26:03.330515 32103 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:03.352612 25726 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
W20260709 12:26:03.359122 32624 consensus_meta.cc:287] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.561s	user 0.007s	sys 0.006s
I20260709 12:26:03.366858 32604 consensus_queue.cc:1059] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:26:03.374266 32206 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:03.380059 32605 raft_consensus.cc:2749] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:26:03.381819 32589 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:03.341380 32103 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:26:03.385344 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 299134us
I20260709 12:26:03.395125 32588 raft_consensus.cc:3055] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:03.395794 32588 raft_consensus.cc:740] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:26:03.397295 32588 consensus_queue.cc:260] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:03.399492 32588 raft_consensus.cc:3060] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:03.384619 32246 raft_consensus.cc:2749] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:03.416755 26402 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:03.418021 25649 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:26:03.431375 26401 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
W20260709 12:26:03.532153 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 187716us
I20260709 12:26:03.359879 32624 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:26:03.544041 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:03.548801 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:03.546420 25649 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:26:03.540066 32246 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.550696 32246 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:03.544837 25726 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89
W20260709 12:26:03.557068 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 140664us
I20260709 12:26:03.543138 32029 raft_consensus.cc:2749] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:03.542768 32552 raft_consensus.cc:2749] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:26:03.570895 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 161636us
W20260709 12:26:03.571898 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:03.572175 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:03.554630 32215 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.540181 32692 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
W20260709 12:26:03.580309 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:03.579980 26439 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.008s	sys 0.030s
I20260709 12:26:03.568634 32206 raft_consensus.cc:2804] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:26:03.587317 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:03.560127 32644 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:03.549438 32526 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:26:03.589133 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 53965us
I20260709 12:26:03.577410 32577 raft_consensus.cc:2804] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:03.593508 25834 raft_consensus.cc:1240] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 17. Current term is 19. Ops: []
I20260709 12:26:03.561973 32428 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:03.557940 32525 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:03.589365 32206 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:03.601063 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 216637us
I20260709 12:26:03.594832 32528 raft_consensus.cc:2804] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Leader election won for term 22
W20260709 12:26:03.613195 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 76972.9us
W20260709 12:26:03.618886 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:03.620293 32651 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.620223 32286 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.621024 32651 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:03.622188 25726 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:03.623411 32651 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:03.623557 25726 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:03.624190 32283 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
W20260709 12:26:03.624325 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 45101.5us
I20260709 12:26:03.624715 32396 raft_consensus.cc:2749] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:26:03.624900 32283 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:03.625370 26401 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:26:03.626698 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 318770us
I20260709 12:26:03.621146 32286 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:03.590384 32608 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:26:03.627617 32283 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:26:03.630388 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 44004.9us
I20260709 12:26:03.597803 32029 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:26:03.633385 25650 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:03.597301 32692 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:03.638144 32286 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:03.628412 32577 raft_consensus.cc:697] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:26:03.639444 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:03.640305 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:26:03.641906 32550 consensus_meta.cc:287] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.635s	user 0.015s	sys 0.000s
I20260709 12:26:03.644239 32697 raft_consensus.cc:2749] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:03.614494 32206 raft_consensus.cc:3060] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:03.600395 32441 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:03.646095 25758 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53460 (request call id 3276) took 1149 ms. Trace:
I20260709 12:26:03.660264 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:03.649264 32582 raft_consensus.cc:2749] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:03.659456 25726 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:03.649137 32528 raft_consensus.cc:697] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 22 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:26:03.654857 32651 raft_consensus.cc:2749] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:26:03.671566 25761 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 16.
I20260709 12:26:03.680475 25835 raft_consensus.cc:1240] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 18. Current term is 19. Ops: []
I20260709 12:26:03.680862 25837 raft_consensus.cc:1275] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 26 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 26 index: 18. (term mismatch)
I20260709 12:26:03.681252 25837 pending_rounds.cc:85] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a: Aborting all ops after (but not including) 17
I20260709 12:26:03.681566 25837 pending_rounds.cc:107] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a: Aborting uncommitted NO_OP operation due to leader change: 25.18
I20260709 12:26:03.681849 25837 raft_consensus.cc:2889] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:26:03.681990 32670 log.cc:927] Time spent T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.761s	user 0.000s	sys 0.004s
I20260709 12:26:03.680357 32613 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:26:03.613780 32215 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:03.671821 32656 raft_consensus.cc:2749] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:26:03.662773 32550 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:03.684118 32574 consensus_queue.cc:1059] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.043s
I20260709 12:26:03.726951 32577 consensus_queue.cc:237] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:03.727572 32574 raft_consensus.cc:3055] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:26:03.728057 32574 raft_consensus.cc:740] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:26:03.729430 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:03.679750 32668 raft_consensus.cc:2749] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:26:03.672151 32246 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:03.731173 26402 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
W20260709 12:26:03.733254 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 82147.1us
I20260709 12:26:03.737193 25759 raft_consensus.cc:1275] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:26:03.677724 32564 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.729151 32574 consensus_queue.cc:260] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:03.740516 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:03.723204 32441 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 21 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:03.730374 32624 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:03.737664 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:03.750342 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:03.692986 32029 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:26:03.757243 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 124055us
I20260709 12:26:03.737680 32215 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:03.755834 25831 raft_consensus.cc:2468] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 18.
I20260709 12:26:03.721988 32695 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:26:03.691025 32608 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:26:03.771646 32601 consensus_meta.cc:287] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.965s	user 0.011s	sys 0.006s
I20260709 12:26:03.772255 32601 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:03.774055 32550 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:03.774405 32601 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:03.775279 32692 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:26:03.776486 32696 log.cc:927] Time spent T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
W20260709 12:26:03.778237 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 84310.1us
W20260709 12:26:03.787897 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 94586.9us
I20260709 12:26:03.788309 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:03.790535 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:03.791848 32651 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:26:03.792479 32651 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:03.793035 32571 consensus_queue.cc:1059] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:26:03.794587 32651 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:03.795737 32668 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:26:03.796569 32580 raft_consensus.cc:3055] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:26:03.747997 32246 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.768231 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:03.807493 31537 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:03.658524 25758 rpcz_store.cc:276] 0709 12:26:02.497021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:02.499997 (+  2976us) service_pool.cc:224] Handling call
0709 12:26:02.500406 (+   409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:03.100691 (+600285us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:03.100758 (+    67us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:03.101468 (+   710us) log.cc:844] Serialized 26 byte log entry
0709 12:26:03.322652 (+221184us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:26:03.330936 (+  8284us) log.cc:844] Serialized 14 byte log entry
0709 12:26:03.332355 (+  1419us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:03.645533 (+313178us) spinlock_profiling.cc:243] Waited 599 ms on lock 0x7b54001dbfd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:26:03.645580 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:03.645631 (+    51us) raft_consensus.cc:1685] finished
0709 12:26:03.645731 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:03.645867 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1526,"prepare.queue_time_us":7925,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":47953,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":2221,"spinlock_wait_cycles":1378744576,"thread_start_us":220686,"threads_started":1,"wal-append.queue_time_us":508313}
I20260709 12:26:03.808988 25680 raft_consensus.cc:2468] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 18.
W20260709 12:26:03.810842 32586 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.009s	sys 0.017s
I20260709 12:26:03.820462 32697 raft_consensus.cc:2804] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:26:03.820415 32586 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.009s	sys 0.018s
I20260709 12:26:03.820906 26435 raft_consensus.cc:1240] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 19. Current term is 20. Ops: []
W20260709 12:26:03.821887 32693 log.cc:927] Time spent T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:26:03.823342 25754 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53474 (request call id 3624) took 1508 ms. Trace:
I20260709 12:26:03.823697 25754 rpcz_store.cc:276] 0709 12:26:02.314631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:02.459908 (+145277us) service_pool.cc:224] Handling call
0709 12:26:02.503907 (+ 43999us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:02.724121 (+220214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:02.724151 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:02.762074 (+ 37923us) log.cc:844] Serialized 26 byte log entry
0709 12:26:03.071611 (+309537us) spinlock_profiling.cc:243] Waited 9.41 ms on lock 0x7b18003a6660. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d96a56e07 00007f5d9f8b19a9 00007f5d96a7369b 00007f5d96a7193f 00007f5d96a73c02 00007f5d996fb20b 00007f5d99700d23 00007f5d997010d1 00007f5d99b1ca0f
0709 12:26:03.392035 (+320424us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:26:03.392130 (+    95us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:03.392278 (+   148us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:03.822988 (+430710us) raft_consensus.cc:1685] finished
0709 12:26:03.823007 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:03.823187 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":330009,"raft.queue_time_us":233772,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":22532,"spinlock_wait_cycles":21643008,"thread_start_us":266162,"threads_started":1,"wal-append.queue_time_us":888611}
I20260709 12:26:03.820432 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:03.830099 25835 raft_consensus.cc:1240] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:03.812381 25755 raft_consensus.cc:2468] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 19.
I20260709 12:26:03.833113 25650 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:03.834570 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:26:03.840246 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:03.814806 32695 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:03.841730 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:03.804945 32580 raft_consensus.cc:740] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:26:03.794628 32571 consensus_queue.cc:1059] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.020s
I20260709 12:26:03.853243 32695 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:03.854133 25830 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 15.
I20260709 12:26:03.796800 32668 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:03.854871 32206 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:03.815989 32564 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:03.856001 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:03.867997 26438 raft_consensus.cc:3060] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:26:03.860771 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 105731us
I20260709 12:26:03.861243 25726 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:26:03.759745 32613 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:03.815388 32396 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:26:03.820540 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:03.820990 32697 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:26:03.866276 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:03.868947 25828 raft_consensus.cc:2468] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 18.
I20260709 12:26:03.810957 32637 consensus_queue.cc:1059] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 23.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.195s
I20260709 12:26:03.811308 32428 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:03.857975 31537 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:03.869226 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:03.874598 25835 raft_consensus.cc:2468] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 15.
I20260709 12:26:03.875229 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:03.879134 26439 raft_consensus.cc:1240] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 21 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:03.894296 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:26:03.893330 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:26:03.860116 32246 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:03.892939 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:03.903874 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:03.877637 32647 raft_consensus.cc:2749] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 12:26:03.911252 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 95583.1us
I20260709 12:26:03.876569 32651 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:26:03.912657 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:03.915037 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f979ddeb5c014d329931d4e2e035af60" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:03.919152 25757 raft_consensus.cc:2393] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 19: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:26:03.915194 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:03.877820 32697 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:03.901877 25686 raft_consensus.cc:2468] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 16.
I20260709 12:26:03.918416 26437 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 15.
I20260709 12:26:03.893532 32206 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:03.885174 32586 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.922709 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:26:03.915643 26402 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:03.860857 32528 consensus_queue.cc:237] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:03.893061 32662 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:26:03.936216 32611 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:03.936488 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:26:03.937155 26431 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:03.936978 32611 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:03.939208 32611 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:03.943389 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:03.948212 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:26:03.925400 32574 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:03.969687 32689 consensus_queue.cc:1048] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.025s
I20260709 12:26:03.980032 32651 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:03.982317 32651 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:03.982961 32651 raft_consensus.cc:2804] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:03.954694 31537 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:03.984798 25754 raft_consensus.cc:2393] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 15: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:26:03.924839 32605 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:03.924669 32692 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:26:03.964629 26432 raft_consensus.cc:2468] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 17.
I20260709 12:26:04.058951 25680 raft_consensus.cc:1240] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:04.072451 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:04.046289 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:04.057960 25834 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41782 (request call id 1422) took 1628 ms. Trace:
W20260709 12:26:04.030704 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:04.041841 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:26:04.042876 25755 raft_consensus.cc:1275] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:26:04.054406 25800 leader_election.cc:304] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:04.004345 25650 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:03.954663 25677 raft_consensus.cc:2468] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 16.
I20260709 12:26:04.023195 25683 raft_consensus.cc:1240] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:04.011544 25762 raft_consensus.cc:1275] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
W20260709 12:26:04.099746 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:03.991122 25802 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:04.050299 25684 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51578 (request call id 1338) took 1268 ms. Trace:
I20260709 12:26:04.058262 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:26:04.022015 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 106464us
I20260709 12:26:04.094085 25686 raft_consensus.cc:2468] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 20.
I20260709 12:26:04.069784 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:04.105509 26438 raft_consensus.cc:2468] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 19.
I20260709 12:26:04.103441 25684 rpcz_store.cc:276] 0709 12:26:02.782150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:02.783692 (+  1542us) service_pool.cc:224] Handling call
0709 12:26:02.784128 (+   436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:03.256680 (+472552us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:03.256729 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:03.256771 (+    42us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:26:03.256801 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:04.048202 (+791401us) spinlock_profiling.cc:243] Waited 456 ms on lock 0x7b54000b3bd4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:26:04.048260 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:04.050072 (+  1812us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1049732992}
I20260709 12:26:04.094156 25834 rpcz_store.cc:276] 0709 12:26:02.429577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:02.429722 (+   145us) service_pool.cc:224] Handling call
0709 12:26:02.430017 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:03.595308 (+1165291us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:04.057714 (+462406us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b540010a754. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b61e01 00007f5d99b6083e 00007f5d9eb25419 00007f5d9809cbd4 00007f5d9809cb62 00007f5d9809ca91 00007f5d9809ca0c 00007f5d9809bcc2 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:26:04.057891 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2580473216}
I20260709 12:26:03.908826 32396 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:04.061112 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:26:04.114290 25757 raft_consensus.cc:3060] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:04.056452 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:04.056916 32215 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
W20260709 12:26:04.018559 32700 log.cc:927] Time spent T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.354s	user 0.000s	sys 0.001s
W20260709 12:26:04.071481 32103 consensus_meta.cc:287] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a: Time spent flushing consensus metadata: real 0.652s	user 0.004s	sys 0.007s
W20260709 12:26:04.009121 32703 log.cc:927] Time spent T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.168s	user 0.002s	sys 0.000s
W20260709 12:26:04.067291 32702 log.cc:927] Time spent T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
W20260709 12:26:04.044713 32704 log.cc:927] Time spent T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
W20260709 12:26:04.028595 32705 log.cc:927] Time spent T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
W20260709 12:26:04.029369 25836 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41782 (request call id 1424) took 1583 ms (client timeout 1840 ms). Trace:
I20260709 12:26:04.054919 32601 raft_consensus.cc:3055] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:03.986630 32651 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:04.060784 32571 raft_consensus.cc:3055] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:26:03.994266 32690 raft_consensus.cc:2749] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:04.033259 32526 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:04.005435 32246 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:04.056263 32589 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:03.998275 32525 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:04.131865 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:04.004359 32608 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:26:04.134649 25836 rpcz_store.cc:269] 0709 12:26:02.445660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:02.445781 (+   121us) service_pool.cc:224] Handling call
0709 12:26:04.028894 (+1583113us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b54002c15d4. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99aca571 00007f5d99b652fa 00007f5d9eb26b17 00007f5d980a16d4 00007f5d980a1662 00007f5d980a1591 00007f5d980a150c 00007f5d980a07c2 00007f5d97e9c48c 00007f5d97e9b8c6 00007f5d97e9b26f
0709 12:26:04.029132 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3161685760}
I20260709 12:26:04.140568 25801 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:26:04.054948 32677 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:04.034766 32695 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:26:04.068727 32668 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:04.115458 32215 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:04.112200 32692 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:04.016795 32613 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:04.015357 32586 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:04.069221 32604 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:04.125331 32588 raft_consensus.cc:2749] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:04.181243 26431 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 20.
W20260709 12:26:04.160507 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 106241us
I20260709 12:26:04.136660 32601 raft_consensus.cc:740] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:26:04.144250 32651 raft_consensus.cc:3060] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:04.133713 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:26:04.188920 25762 raft_consensus.cc:3060] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:04.011104 32605 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:26:04.147924 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 296831us
I20260709 12:26:04.144515 32571 raft_consensus.cc:740] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:26:04.005581 32662 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:04.131426 32103 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:04.177515 32668 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
W20260709 12:26:04.186515 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 232067us
I20260709 12:26:04.167798 32286 raft_consensus.cc:2804] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:04.190469 25682 raft_consensus.cc:1240] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 15. Current term is 16. Ops: []
I20260709 12:26:04.183887 32029 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:04.159157 32589 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:04.198643 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:04.117362 32580 consensus_queue.cc:260] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:04.190819 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:26:04.202419 25726 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:26:04.213161 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:04.220404 25681 raft_consensus.cc:3060] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:04.182308 32689 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
W20260709 12:26:04.223541 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:04.166074 32677 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:04.221339 25726 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:26:04.231348 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:04.230217 25726 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:26:04.187433 32695 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:26:04.243180 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 57907.9us
I20260709 12:26:04.182971 32697 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:04.219846 32286 raft_consensus.cc:697] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 19 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
W20260709 12:26:04.249780 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 314228us
I20260709 12:26:04.193882 32604 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:04.250399 25763 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 11.
I20260709 12:26:04.245683 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:04.240579 32564 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:04.216097 32283 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:04.228520 32585 raft_consensus.cc:2749] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:04.240289 32246 raft_consensus.cc:2804] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:04.256534 25650 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:04.202307 32624 consensus_queue.cc:1048] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 12:26:04.258846 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:04.256045 25800 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:26:04.252544 32029 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:26:04.268648 32613 consensus_queue.cc:1059] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:26:04.269629 32613 raft_consensus.cc:3055] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:26:04.269881 32695 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:04.270008 32613 raft_consensus.cc:740] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:26:04.271766 32677 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:04.272696 32586 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:04.274031 32605 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:04.257233 32601 consensus_queue.cc:260] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:26:04.300647 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 54112.6us
I20260709 12:26:04.301424 32601 raft_consensus.cc:3060] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:04.301930 32697 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:04.302763 32529 raft_consensus.cc:2804] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:04.302829 25800 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:04.303401 32529 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:04.303853 32529 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:04.304044 32215 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:04.305240 31537 raft_consensus.cc:2749] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:04.304965 32286 consensus_queue.cc:237] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:04.280359 32582 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:04.306236 32582 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:04.241381 32689 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:04.308437 32582 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:04.274983 32692 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:04.309844 32689 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:04.309921 32677 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:04.280100 32550 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:04.315071 32550 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:04.277410 32714 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:04.317693 25760 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
mode: GRACEFUL
new_leader_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:47510
I20260709 12:26:04.318545 25760 raft_consensus.cc:606] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 24 FOLLOWER]: Received request to transfer leadership to TS 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:26:04.337182 25760 raft_consensus.cc:614] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 24 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:04.280901 25686 raft_consensus.cc:2468] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 15.
I20260709 12:26:04.281992 25726 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:04.290256 32283 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:04.290800 25830 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 15.
I20260709 12:26:04.291543 32669 raft_consensus.cc:2804] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:04.291894 25681 raft_consensus.cc:2468] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 19.
I20260709 12:26:04.308336 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:04.242856 32594 consensus_queue.cc:1059] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 12:26:04.275293 32662 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:04.275676 32707 raft_consensus.cc:2804] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:04.263002 32246 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:04.271188 32613 consensus_queue.cc:260] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:04.317373 32714 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:04.356539 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:04.245857 32668 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:26:04.320684 26402 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.23.245.131:36237 timed out after 1.840s (SENT) [suppressed 29 similar messages]
I20260709 12:26:04.324222 32396 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:04.324939 32677 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:04.299600 32651 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:04.358801 32396 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:04.362627 32396 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:04.363556 32651 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:04.318147 25801 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:26:04.333598 32029 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:04.333841 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:04.267050 32571 consensus_queue.cc:260] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 23.19, Last appended by leader: 19, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:04.334589 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:04.335487 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:26:04.336225 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:04.339036 26401 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:26:04.342340 25762 raft_consensus.cc:2468] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 20.
W20260709 12:26:04.344274 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 62367.1us
I20260709 12:26:04.348014 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:04.344705 26439 raft_consensus.cc:2468] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 17.
I20260709 12:26:04.331604 32103 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 22 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:04.348481 32604 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:04.336220 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:04.353183 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:04.319741 32589 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:04.355305 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:04.351044 32215 raft_consensus.cc:2749] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:04.278239 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:04.355966 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:04.352864 32707 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:04.266543 32577 consensus_queue.cc:1059] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.088s
I20260709 12:26:04.343852 32669 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:04.361646 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:04.354375 32246 raft_consensus.cc:3060] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:04.390476 25832 raft_consensus.cc:2468] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 16.
I20260709 12:26:04.365106 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:04.395272 25836 raft_consensus.cc:2468] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 21.
I20260709 12:26:04.402632 26431 raft_consensus.cc:2468] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 21.
I20260709 12:26:04.396291 25835 raft_consensus.cc:2368] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 19. Current term is 20.
W20260709 12:26:04.396867 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 78826.4us
W20260709 12:26:04.398648 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 59674.7us
I20260709 12:26:04.403213 25759 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:04.393584 32668 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:04.368598 32613 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:04.370594 32714 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:04.365790 32283 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:04.364728 32396 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:26:04.422371 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 101697us
I20260709 12:26:04.413079 25726 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:04.440163 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:04.426509 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:04.398190 32707 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:04.411103 26430 raft_consensus.cc:2468] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 15.
I20260709 12:26:04.400043 32574 raft_consensus.cc:2749] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:04.402024 32669 raft_consensus.cc:3060] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:04.436348 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:04.446226 25683 raft_consensus.cc:2393] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 21: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:26:04.446291 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:04.374130 32677 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:04.422567 32103 raft_consensus.cc:2804] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:26:04.438366 25801 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:26:04.443473 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:04.451745 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:04.453204 25686 raft_consensus.cc:2468] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 16.
I20260709 12:26:04.452778 25834 raft_consensus.cc:2468] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 17.
I20260709 12:26:04.447885 32577 raft_consensus.cc:2804] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:04.504127 32577 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:26:04.504662 32577 raft_consensus.cc:3060] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:04.460382 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:04.510351 32029 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:04.460471 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:04.511562 25829 raft_consensus.cc:2468] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 21.
I20260709 12:26:04.512207 25682 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
mode: GRACEFUL
new_leader_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:49108
I20260709 12:26:04.512773 25682 raft_consensus.cc:606] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 18 LEADER]: Received request to transfer leadership to TS 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:26:04.514580 32550 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:04.461143 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:04.458806 32103 raft_consensus.cc:697] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 20 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:26:04.516237 25726 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:26:04.516963 32103 consensus_queue.cc:237] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:04.517918 32396 raft_consensus.cc:2804] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:04.518321 32396 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:04.518658 32396 raft_consensus.cc:3060] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:04.465785 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:04.520794 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:04.521499 25801 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:04.522006 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:04.522562 25758 raft_consensus.cc:2468] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 19.
I20260709 12:26:04.522660 25801 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:04.523432 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:04.466498 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:04.468255 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:26:04.525046 25755 raft_consensus.cc:2393] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 22: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:26:04.524364 25576 catalog_manager.cc:5697] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:04.526604 25576 catalog_manager.cc:5697] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:04.469776 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:04.476193 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:04.528421 25837 raft_consensus.cc:3060] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:04.529664 32624 raft_consensus.cc:2749] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:04.479735 26402 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:26:04.495733 32580 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:26:04.531069 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 51410us
I20260709 12:26:04.482153 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:26:04.531908 26402 leader_election.cc:400] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 election: Vote denied by peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237) with higher term. Message: Invalid argument: T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 19. Current term is 20.
I20260709 12:26:04.532186 25681 raft_consensus.cc:3060] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:04.482952 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:04.533823 32550 raft_consensus.cc:2804] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:04.534062 25685 raft_consensus.cc:2468] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 15.
I20260709 12:26:04.534359 32550 raft_consensus.cc:697] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 15 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:26:04.472671 32529 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:04.536307 32529 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 21 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:04.537772 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:04.538384 26438 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 17.
I20260709 12:26:04.484290 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:04.523757 25801 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:04.491420 32283 raft_consensus.cc:2804] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:04.492034 25757 raft_consensus.cc:2468] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 16.
I20260709 12:26:04.485198 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:26:04.496738 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 264132us
I20260709 12:26:04.426496 32689 consensus_queue.cc:1048] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.026s
I20260709 12:26:04.498579 32571 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:04.526870 25726 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:26:04.501761 32585 raft_consensus.cc:2749] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:04.535303 32550 consensus_queue.cc:237] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:04.524137 32604 consensus_queue.cc:1059] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:04.529719 32716 raft_consensus.cc:2749] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:04.477288 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:04.532238 26402 leader_election.cc:403] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 12:26:04.493021 32644 raft_consensus.cc:3055] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:26:04.543776 25835 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 17.
I20260709 12:26:04.544199 25755 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
mode: GRACEFUL
new_leader_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:47510
I20260709 12:26:04.545658 25759 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 17.
I20260709 12:26:04.548063 25754 raft_consensus.cc:1240] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 15. Current term is 16. Ops: [13.10-15.11]
I20260709 12:26:04.554559 25726 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
W20260709 12:26:04.555114 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:04.499965 32669 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:04.544955 32283 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:04.563402 32283 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:04.563499 32585 consensus_queue.cc:1048] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:26:04.566071 32651 raft_consensus.cc:2749] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:04.567471 25726 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:26:04.558579 32215 raft_consensus.cc:2804] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:04.568310 32215 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:26:04.548563 32689 consensus_queue.cc:1243] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer 6e673265293d4e9a937dc45150aeb1b8 log is divergent from this leader: its last log entry 16.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 12:26:04.568691 32215 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:04.570834 25755 raft_consensus.cc:606] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Received request to transfer leadership to TS 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:26:04.571384 25755 raft_consensus.cc:614] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:04.573474 25762 pending_rounds.cc:85] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8: Aborting all ops after (but not including) 14
I20260709 12:26:04.573784 25762 pending_rounds.cc:107] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8: Aborting uncommitted NO_OP operation due to leader change: 16.15
I20260709 12:26:04.573973 25762 raft_consensus.cc:2889] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:04.574774 26402 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:26:04.574877 25726 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:04.578171 26402 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:26:04.552141 25576 catalog_manager.cc:5697] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 12 to 14, leader changed from a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 14 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
W20260709 12:26:04.581631 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 57949.2us
I20260709 12:26:04.583459 25757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:26:04.580093 25649 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:26:04.560837 32644 raft_consensus.cc:740] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:26:04.619254 25757 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:26:04.621519 25837 raft_consensus.cc:2468] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 19.
W20260709 12:26:04.634064 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 54055.3us
I20260709 12:26:04.623816 26402 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:26:04.635865 25649 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:26:04.582167 32029 raft_consensus.cc:2749] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:04.619968 32594 raft_consensus.cc:2804] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:04.592432 25681 raft_consensus.cc:2468] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 19.
I20260709 12:26:04.637231 32574 raft_consensus.cc:2804] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:04.637856 32574 raft_consensus.cc:697] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 17 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:26:04.638460 32585 raft_consensus.cc:2804] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:04.639034 32585 raft_consensus.cc:697] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 16 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:26:04.640364 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25bd5658646b41608d707d196c6e0585" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:04.640170 32585 consensus_queue.cc:237] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:04.637362 32594 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:04.641664 32594 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:26:04.642939 32721 log.cc:927] Time spent T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:26:04.581202 32611 raft_consensus.cc:3055] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:26:04.653479 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
W20260709 12:26:04.663349 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:04.664407 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 44253us
I20260709 12:26:04.664613 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:04.665328 25650 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:04.665932 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:04.580327 32577 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:04.643118 32644 consensus_queue.cc:260] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:04.576354 32689 raft_consensus.cc:2749] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237) with higher term. Message: Invalid argument: T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for earlier term 19. Current term is 20.
I20260709 12:26:04.646643 32611 raft_consensus.cc:740] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:26:04.668190 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:04.668061 32644 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:04.668931 32669 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:04.669364 26439 raft_consensus.cc:1240] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:04.669612 25681 raft_consensus.cc:1275] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 12:26:04.670823 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:04.672015 25763 raft_consensus.cc:1240] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 16. Current term is 17. Ops: []
I20260709 12:26:04.669620 32669 raft_consensus.cc:2804] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:04.675611 32669 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:26:04.647985 32526 raft_consensus.cc:2804] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:04.676148 32669 raft_consensus.cc:3060] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:04.676440 32526 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:04.676910 32526 raft_consensus.cc:3060] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:04.676011 32588 consensus_queue.cc:1059] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:04.668040 32577 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:04.679338 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:04.680599 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:04.676841 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:04.613727 32716 raft_consensus.cc:2749] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:26:04.638986 32574 consensus_queue.cc:237] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:04.696378 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:26:04.708151 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 133396us
I20260709 12:26:04.715170 25726 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:04.704275 25757 raft_consensus.cc:2468] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 21.
W20260709 12:26:04.716292 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 51111.4us
I20260709 12:26:04.721210 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:04.723647 25686 raft_consensus.cc:2393] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 21: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:26:04.720580 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:04.732307 25800 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:26:04.726140 25754 raft_consensus.cc:1275] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:26:04.725716 25801 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:04.727054 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:04.696099 32564 raft_consensus.cc:2749] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:04.733829 25801 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:04.737478 31537 raft_consensus.cc:2749] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:26:04.738025 25681 raft_consensus.cc:2468] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 16.
I20260709 12:26:04.738536 25801 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:04.732712 25683 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 17.
I20260709 12:26:04.754719 25757 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
mode: GRACEFUL
new_leader_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:47510
I20260709 12:26:04.758875 25726 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
W20260709 12:26:04.760360 25580 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52974 (request call id 256) took 79311 ms (client timeout 15000 ms). Trace:
I20260709 12:26:04.743523 32529 consensus_queue.cc:1048] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.018s
I20260709 12:26:04.716342 32689 consensus_queue.cc:1059] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 12:26:04.746580 32651 raft_consensus.cc:2804] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:04.748031 32668 raft_consensus.cc:2749] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:26:04.740492 32604 raft_consensus.cc:2804] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:26:04.740643 32588 raft_consensus.cc:2749] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:26:04.751112 32695 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:04.755784 32586 raft_consensus.cc:2749] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:04.765890 25726 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:26:04.756230 32662 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:04.746922 32246 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:04.768749 32725 raft_consensus.cc:2749] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:26:04.811054 32695 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:04.811741 32651 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:04.812237 32651 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:04.813405 32695 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:04.788759 25726 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
W20260709 12:26:04.760805 25580 rpcz_store.cc:269] 0709 12:24:45.268082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.268340 (+   258us) service_pool.cc:224] Handling call
0709 12:24:45.301090 (+ 32750us) spinlock_profiling.cc:243] Waited 21.8 ms on lock 0x7b5400078854. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99acb090 00007f5d99b69f3a 00007f5d9f91fe9c 00007f5d9fa1e04e 00007f5d9dedf2a4 00007f5d9dedf232 00007f5d9dedf161 00007f5d9dedf0dc 00007f5d9dede392 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:26:04.575315 (+79274225us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:00.828512 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:00.829067 (+   555us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:00.829109 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:26:00.829128 (+    19us) tablet.cc:662] Decoding operations
0709 12:26:00.829567 (+   439us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:00.829627 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:00.829655 (+    28us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:26:00.829963 (+   308us) tablet.cc:701] Row locks acquired
0709 12:26:00.829982 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:26:00.830126 (+   144us) write_op.cc:270] Start()
0709 12:26:00.830244 (+   118us) write_op.cc:276] Timestamp: P: 1783599960830076 usec, L: 0
0709 12:26:00.830263 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:26:00.830979 (+   716us) log.cc:844] Serialized 925 byte log entry
0709 12:26:01.412308 (+581329us) op_driver.cc:464] REPLICATION: finished
0709 12:26:01.505938 (+ 93630us) write_op.cc:301] APPLY: starting
0709 12:26:01.506023 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:02.357458 (+851435us) spinlock_profiling.cc:243] Waited 1.88 ms on lock 0x7b18003477a0. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d998a00ec 00007f5d998ecc0a 00007f5d998ec4f7 00007f5d998ec490 00007f5d998a3f48 00007f5d9d5b81bb 00007f5d9d5b8532 00007f5d9d5ffb93 00007f5d9d4acde3
0709 12:26:02.358623 (+  1165us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:02.358652 (+    29us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:02.420435 (+ 61783us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:02.465563 (+ 45128us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 12:26:02.490355 (+ 24792us) write_op.cc:312] APPLY: finished
0709 12:26:02.549290 (+ 58935us) log.cc:844] Serialized 33 byte log entry
0709 12:26:02.618864 (+ 69574us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:02.653382 (+ 34518us) write_op.cc:454] Released schema lock
0709 12:26:02.664214 (+ 10832us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:02.820707 (+156493us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:02.885381 (+ 64674us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":97682,"reported_tablets":41,"spinlock_wait_cycles":50206976,"child_traces":[["op",{"apply.queue_time_us":93229,"apply.run_cpu_time_us":34053,"apply.run_wall_time_us":1261545,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12487,"num_ops":2,"prepare.queue_time_us":1114514,"prepare.run_cpu_time_us":116220,"prepare.run_wall_time_us":322733,"raft.queue_time_us":83632,"raft.run_cpu_time_us":6332,"raft.run_wall_time_us":91183,"replication_time_us":581906,"spinlock_wait_cycles":4613248,"thread_start_us":995613,"threads_started":5,"wal-append.queue_time_us":627398,"wal-append.run_cpu_time_us":4780,"wal-append.run_wall_time_us":2159598}]]}
I20260709 12:26:04.817942 32613 raft_consensus.cc:2749] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:04.819949 25726 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:26:04.823122 32611 consensus_queue.cc:260] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:04.824026 32613 raft_consensus.cc:2804] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:04.824548 32613 raft_consensus.cc:697] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 19 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:26:04.765903 25576 catalog_manager.cc:5697] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 11 to 14, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 14 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:04.826386 32662 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:04.826864 32613 consensus_queue.cc:237] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:04.828048 25757 raft_consensus.cc:606] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Received request to transfer leadership to TS 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:26:04.828439 25757 raft_consensus.cc:614] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:04.828788 32662 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:04.833906 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:04.834496 25835 raft_consensus.cc:3060] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:04.842314 25726 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:04.784940 32604 raft_consensus.cc:697] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 21 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:26:04.824697 32611 raft_consensus.cc:3060] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:04.803422 32726 raft_consensus.cc:2804] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:04.856341 25836 raft_consensus.cc:1275] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:26:04.859678 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:26:04.784144 32707 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:04.800225 32396 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:04.874687 25760 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
mode: GRACEFUL
new_leader_uuid: "a866ff967d964388a6f0dff7fd43df89"
 from {username='slave'} at 127.0.0.1:47510
I20260709 12:26:04.875576 25760 raft_consensus.cc:606] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Received request to transfer leadership to TS a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:04.876063 25760 raft_consensus.cc:614] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:04.827157 25576 catalog_manager.cc:5697] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 7 to 10, leader changed from a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 10 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:04.878496 32594 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:04.871191 32727 raft_consensus.cc:2749] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:04.881439 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:26:04.881889 32594 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:04.884263 32396 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:04.884615 25576 catalog_manager.cc:5697] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 10 to 16, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 16 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:04.889215 32707 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:04.890416 32526 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:04.892556 32283 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:04.892879 32215 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:04.894667 32283 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:26:04.894829 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 129073us
I20260709 12:26:04.858682 32726 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:26:04.895515 32726 raft_consensus.cc:3060] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:04.895989 25650 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:26:04.897400 25650 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:04.899605 32651 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:04.900329 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:04.886715 25576 catalog_manager.cc:5697] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 12 to 18. New cstate: current_term: 18 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:04.908376 25756 raft_consensus.cc:2393] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 17: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:26:04.909533 25801 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:26:04.911562 25801 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:26:04.919834 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:26:04.923843 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 74960.5us
I20260709 12:26:04.910974 32692 raft_consensus.cc:2804] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:04.928387 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:04.930720 25834 raft_consensus.cc:3060] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:04.929746 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:04.931866 25830 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:04.932413 25835 raft_consensus.cc:2468] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 16.
I20260709 12:26:04.943819 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:26:04.972918 26438 raft_consensus.cc:1240] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:04.971881 25683 raft_consensus.cc:3060] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:04.975416 32246 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:04.944015 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:26:04.976845 25682 raft_consensus.cc:2393] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 21: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:26:04.944171 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:26:04.978080 25681 raft_consensus.cc:3060] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:04.924801 32605 raft_consensus.cc:2804] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:04.981861 32605 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:04.982299 32605 raft_consensus.cc:3060] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:04.985952 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:04.987046 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 22 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:04.987231 32669 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:04.988059 32441 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:04.988533 32441 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:04.990556 32441 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:04.992300 25836 raft_consensus.cc:1240] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:04.992624 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:04.987805 25833 raft_consensus.cc:2393] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 22: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:26:04.993911 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:04.994750 25837 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 17.
I20260709 12:26:04.995004 32582 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:04.995761 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:04.996281 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:04.996795 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:04.993980 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:04.995599 32582 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:04.998293 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:05.000084 32582 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:05.002780 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:04.997205 32697 raft_consensus.cc:3055] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:26:05.004304 32697 raft_consensus.cc:740] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:26:05.004731 25681 raft_consensus.cc:2468] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 16.
I20260709 12:26:05.008317 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:05.008908 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:04.996943 25760 raft_consensus.cc:2468] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 19.
I20260709 12:26:05.005244 32697 consensus_queue.cc:260] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:05.011101 32662 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.012292 32727 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.012617 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:05.012787 32727 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:05.012319 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:05.014129 25831 raft_consensus.cc:2393] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 18: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:26:05.010824 32697 raft_consensus.cc:3060] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:05.016759 26401 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:26:04.932753 32604 consensus_queue.cc:237] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:05.023352 25828 raft_consensus.cc:2468] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 21.
I20260709 12:26:05.027261 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:05.011677 32662 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:05.028393 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:05.013213 25837 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:04.945436 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:26:04.947681 32526 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 21 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:05.033254 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:05.034188 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:26:05.035065 26439 raft_consensus.cc:2393] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 18: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:26:05.015842 25758 raft_consensus.cc:1275] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:26:05.012617 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:05.014854 32727 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:04.946658 25576 catalog_manager.cc:5697] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 6 to 18. New cstate: current_term: 18 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:04.931804 32668 consensus_queue.cc:1048] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.093s
I20260709 12:26:05.038144 25576 catalog_manager.cc:5697] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 17 to 20, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 20 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } }
I20260709 12:26:05.024659 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:04.949571 32651 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 22 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:05.042083 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:05.015187 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:04.945844 32215 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 21 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:05.029019 26437 raft_consensus.cc:1275] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:26:05.043350 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:04.931881 32692 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:05.044399 32692 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:05.044775 25829 raft_consensus.cc:2410] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 12:26:05.047191 26430 raft_consensus.cc:1275] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:26:05.041998 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:05.036638 25834 raft_consensus.cc:2468] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 17.
I20260709 12:26:05.029840 32662 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:05.047470 25837 raft_consensus.cc:2468] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 22.
I20260709 12:26:05.034287 25835 raft_consensus.cc:2393] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 11: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:26:05.044876 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:26:05.048691 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:05.048022 25836 raft_consensus.cc:3060] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:05.050495 25830 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 16.
I20260709 12:26:05.043462 25831 raft_consensus.cc:2468] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 19.
I20260709 12:26:05.051496 25828 raft_consensus.cc:2410] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 12:26:04.929808 32585 raft_consensus.cc:2749] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:26:05.084805 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:26:05.085866 26438 raft_consensus.cc:3060] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:26:05.090297 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:05.091187 25755 raft_consensus.cc:1240] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 16. Current term is 17. Ops: []
I20260709 12:26:05.092016 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 23 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:05.092999 25835 raft_consensus.cc:2410] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for term 23 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 12:26:04.924151 32737 raft_consensus.cc:2804] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:04.919517 32206 consensus_queue.cc:1048] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.166s
I20260709 12:26:05.094954 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:05.094286 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:05.082696 32637 raft_consensus.cc:2804] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:05.031649 32605 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:05.100188 25801 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:05.053944 32662 consensus_queue.cc:1048] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.037s
W20260709 12:26:05.120321 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:05.097497 25726 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:26:05.121992 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:05.123055 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:26:05.091355 32283 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:05.100060 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 172925us
I20260709 12:26:05.098402 32526 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.096062 32737 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:26:05.130201 25801 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:26:05.134385 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:05.135183 25832 raft_consensus.cc:1240] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:26:05.106099 32637 raft_consensus.cc:493] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:05.135169 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:26:05.140388 25755 raft_consensus.cc:2393] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 21: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:26:05.137300 26439 raft_consensus.cc:2393] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 11: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:26:05.137670 25801 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:26:05.130505 25726 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:26:05.143251 25682 raft_consensus.cc:1240] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:05.126670 32552 raft_consensus.cc:2749] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:26:05.150681 26438 raft_consensus.cc:2468] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 19.
I20260709 12:26:05.152417 25726 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:26:05.141192 32589 raft_consensus.cc:2764] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:26:05.137524 32283 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:05.137614 32737 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:05.137887 32613 raft_consensus.cc:2804] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:05.195726 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:26:05.198720 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 46383.9us
I20260709 12:26:05.143110 32637 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:05.205000 25726 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:26:05.204675 26439 raft_consensus.cc:2468] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 19.
I20260709 12:26:05.207813 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:05.208398 25755 raft_consensus.cc:1240] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 15. Current term is 16. Ops: []
I20260709 12:26:05.151551 32716 raft_consensus.cc:2804] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:05.209327 25726 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:26:05.209589 32716 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:05.210041 32716 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:05.218044 32283 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:05.220049 32727 raft_consensus.cc:2804] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:05.220728 32727 raft_consensus.cc:697] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 17 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:26:05.221711 32727 consensus_queue.cc:237] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:05.224064 32613 raft_consensus.cc:697] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:26:05.224479 25832 raft_consensus.cc:1240] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 15. Current term is 16. Ops: []
I20260709 12:26:05.225425 32605 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:05.225031 32613 consensus_queue.cc:237] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:05.230163 32692 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:05.231791 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:26:05.136368 32564 consensus_queue.cc:1048] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.064s
I20260709 12:26:05.232475 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:26:05.193897 32215 raft_consensus.cc:2804] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:26:05.254093 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:26:05.204674 32745 log.cc:927] Time spent T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:26:05.255340 32215 raft_consensus.cc:697] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:26:05.203037 32668 raft_consensus.cc:2804] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:26:05.156375 32526 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:05.039754 25576 catalog_manager.cc:5697] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 11 to 16, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 16 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:05.245754 32725 raft_consensus.cc:2804] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:05.231523 32637 raft_consensus.cc:515] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:05.270411 25726 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:26:05.281795 25836 raft_consensus.cc:2468] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 19.
I20260709 12:26:05.283447 25682 raft_consensus.cc:1275] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:26:05.287036 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:26:05.288748 25685 raft_consensus.cc:2393] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 17: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:26:05.205812 32726 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:05.236905 32574 consensus_queue.cc:1059] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 12:26:05.251999 32740 consensus_queue.cc:1048] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 12:26:05.293859 32669 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:05.299185 32737 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:05.281814 32668 raft_consensus.cc:697] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:26:05.285112 32246 raft_consensus.cc:2804] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:05.307660 25683 raft_consensus.cc:2468] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 17.
I20260709 12:26:05.264909 32580 consensus_queue.cc:1059] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 12:26:05.319150 25686 raft_consensus.cc:1240] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 16. Current term is 17. Ops: []
I20260709 12:26:05.285581 32725 raft_consensus.cc:697] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 16 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:26:05.321992 25760 raft_consensus.cc:1240] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 15. Current term is 16. Ops: []
I20260709 12:26:05.333813 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:05.340723 32692 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 21 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:05.354979 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:26:05.347812 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 145940us
I20260709 12:26:05.319614 32717 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:26:05.322654 32246 raft_consensus.cc:697] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:26:05.456667 25801 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:26:05.365329 32668 consensus_queue.cc:237] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:05.344126 32215 consensus_queue.cc:237] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 20.9, Last appended by leader: 9, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:05.357388 32594 consensus_queue.cc:1059] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:26:05.458945 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:05.466060 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
W20260709 12:26:05.476553 32746 log.cc:927] Time spent T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
I20260709 12:26:05.480911 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:05.482991 25836 raft_consensus.cc:1275] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:26:05.468005 32613 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:05.485453 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 128573us
W20260709 12:26:05.527108 32753 log.cc:927] Time spent T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.174s	user 0.000s	sys 0.000s
I20260709 12:26:05.472239 32717 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:26:05.546495 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:05.568430 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:05.525790 32725 consensus_queue.cc:237] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:05.582099 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:26:05.582820 26438 raft_consensus.cc:3060] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:05.488579 32586 raft_consensus.cc:2804] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:05.458756 32552 consensus_queue.cc:1048] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 12:26:05.554129 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:05.611115 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:26:05.550748 32651 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:05.554183 32594 raft_consensus.cc:3055] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:26:05.544691 32246 consensus_queue.cc:237] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:05.642546 26438 raft_consensus.cc:2468] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 16.
I20260709 12:26:05.702778 32759 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:05.656059 26437 raft_consensus.cc:1275] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:26:05.615224 32283 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:26:05.611140 32644 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:05.579746 32669 consensus_queue.cc:1048] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 12:26:05.627265 32594 raft_consensus.cc:740] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:26:05.624270 32586 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:05.581691 32668 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.715646 32668 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:05.716205 25685 raft_consensus.cc:1275] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:26:05.718189 32668 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:05.720166 32586 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:05.701476 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:05.582226 32613 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:05.570503 32716 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:05.711781 32644 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:05.714331 32594 consensus_queue.cc:260] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:05.695376 32526 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:05.468060 25576 catalog_manager.cc:5697] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 13 to 15, leader changed from a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 15 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:05.688314 32574 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.656071 32651 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:05.699641 32029 consensus_queue.cc:1059] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 12:26:05.746151 32726 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:05.748512 32283 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:05.762563 32283 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:05.770802 32552 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.771409 32552 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:05.771827 32651 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:05.774061 32552 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:05.777036 32601 raft_consensus.cc:3055] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:26:05.777557 32601 raft_consensus.cc:740] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:26:05.778797 32601 consensus_queue.cc:260] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:05.780243 32601 raft_consensus.cc:3060] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:05.757323 32594 raft_consensus.cc:3060] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:05.746343 32759 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:05.810995 25650 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:26:05.783406 25576 catalog_manager.cc:5697] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 11 to 15, leader changed from a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 15 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:05.756307 32574 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:05.814148 25650 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:26:05.805944 32585 consensus_queue.cc:1059] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.012s
I20260709 12:26:05.819522 32585 raft_consensus.cc:3055] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:05.820016 32585 raft_consensus.cc:740] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:26:05.820945 32585 consensus_queue.cc:260] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:05.821420 32582 raft_consensus.cc:3055] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:26:05.821877 32582 raft_consensus.cc:740] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:26:05.822161 32585 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:05.822489 32637 leader_election.cc:290] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:05.822669 32582 consensus_queue.cc:260] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:05.826889 25801 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:26:05.841050 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:26:05.839248 32697 consensus_meta.cc:287] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89: Time spent flushing consensus metadata: real 0.820s	user 0.011s	sys 0.000s
I20260709 12:26:05.841813 26438 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 24.
I20260709 12:26:05.815896 32644 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:05.818465 32748 raft_consensus.cc:2749] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:05.832299 32582 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:05.844551 26436 raft_consensus.cc:2468] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 17.
I20260709 12:26:05.846647 25832 raft_consensus.cc:1275] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 12. (term mismatch)
I20260709 12:26:05.818066 32526 raft_consensus.cc:2804] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:05.848785 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:05.842250 32589 consensus_queue.cc:1048] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.007s
I20260709 12:26:05.848809 25832 pending_rounds.cc:85] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a: Aborting all ops after (but not including) 11
I20260709 12:26:05.836920 32651 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.863415 25832 pending_rounds.cc:107] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a: Aborting uncommitted NO_OP operation due to leader change: 20.12
I20260709 12:26:05.852311 32742 consensus_queue.cc:1059] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 12:26:05.839665 32103 raft_consensus.cc:2804] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:05.856624 32716 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:05.857262 26432 raft_consensus.cc:1240] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:26:05.873232 32103 raft_consensus.cc:697] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 16 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:26:05.859153 26438 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 11.
I20260709 12:26:05.859391 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:26:05.874503 32103 consensus_queue.cc:237] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:05.875238 25758 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:05.857926 32759 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:05.861698 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 21 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:26:05.877350 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:05.863306 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 23 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:05.863336 25760 raft_consensus.cc:1275] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:26:05.878525 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:26:05.863881 25832 raft_consensus.cc:2889] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:05.851812 32737 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 21 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:05.861058 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:26:05.880185 25686 raft_consensus.cc:3060] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:05.877578 25685 raft_consensus.cc:2393] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 21: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:26:05.862355 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:26:05.880748 25828 raft_consensus.cc:1275] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 12:26:05.881175 25828 pending_rounds.cc:85] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a: Aborting all ops after (but not including) 10
I20260709 12:26:05.879563 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:26:05.876720 25679 raft_consensus.cc:1275] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:26:05.881404 25828 pending_rounds.cc:107] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 12:26:05.881973 25828 raft_consensus.cc:2889] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:05.883097 25832 raft_consensus.cc:1275] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:26:05.884107 25835 raft_consensus.cc:1240] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 21. Current term is 22. Ops: []
I20260709 12:26:05.888784 25650 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:05.841884 32613 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:05.891508 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:26:05.893486 25685 raft_consensus.cc:2393] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 21: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:26:05.827877 32586 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:05.857127 25576 catalog_manager.cc:5697] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 16 to 20, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 20 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } }
I20260709 12:26:05.897061 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:26:05.897114 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:26:05.899047 26437 raft_consensus.cc:2393] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 21: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:26:05.896621 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:05.858762 32526 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:05.900681 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:05.897280 25801 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:26:05.899991 25833 raft_consensus.cc:2468] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 21.
I20260709 12:26:05.901386 25758 raft_consensus.cc:2468] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 20.
I20260709 12:26:05.908218 25760 raft_consensus.cc:1275] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:26:05.908200 25685 raft_consensus.cc:1275] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:26:05.907557 25726 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:05.910844 25680 raft_consensus.cc:2410] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 12:26:05.887087 32550 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.913931 25726 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:05.914343 25801 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:05.913520 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:05.914891 25679 raft_consensus.cc:1275] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:26:05.917668 25726 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:05.915692 25682 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 11.
I20260709 12:26:05.911239 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:26:05.928329 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:05.905719 32526 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:05.935388 26401 leader_election.cc:304] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:26:05.909755 32529 raft_consensus.cc:2804] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:26:05.912475 32585 raft_consensus.cc:2749] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:26:05.949347 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 50174us
I20260709 12:26:05.951114   302 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
W20260709 12:26:05.952291 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:05.917214 32613 raft_consensus.cc:2804] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:05.929340 32588 raft_consensus.cc:2749] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:05.925949 32246 raft_consensus.cc:2749] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:26:05.939270 32529 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 23 FOLLOWER]: Starting leader election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:26:05.909926 32651 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:05.951776   302 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:05.956287 32571 raft_consensus.cc:2804] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:26:05.929489 32550 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:05.980239 25650 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:05.937227 32727 consensus_queue.cc:1048] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 12:26:05.946692 32441 consensus_queue.cc:1048] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 12:26:05.968411 32529 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:05.987324 25650 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:05.967031 32613 raft_consensus.cc:697] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 17 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:26:05.990185 25576 catalog_manager.cc:5697] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:05.991847 25576 catalog_manager.cc:5697] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 12 to 15, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 15 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:05.997844 25650 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:05.998129 25755 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 21.
I20260709 12:26:06.004808 25650 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:05.993767 25576 catalog_manager.cc:5697] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 13 to 17, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 17 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } }
I20260709 12:26:06.009606 25650 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:06.012046 25650 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
W20260709 12:26:06.016849 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 88355.7us
I20260709 12:26:06.003162   303 raft_consensus.cc:2749] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:05.996889 32571 raft_consensus.cc:697] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 20 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:26:05.989590 32742 raft_consensus.cc:2749] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:06.010864   301 raft_consensus.cc:2749] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:06.011318 32644 raft_consensus.cc:2749] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:26:06.013264 32585 raft_consensus.cc:2749] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:06.023770 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:06.024959 25755 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 11.
I20260709 12:26:06.019826   307 raft_consensus.cc:2749] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:26:06.028393   307 raft_consensus.cc:2749] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:06.030498   302 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:06.032935 32550 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:06.042084 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:06.043159 25755 raft_consensus.cc:2468] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 18.
I20260709 12:26:06.044832 26401 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:26:06.053345 32550 raft_consensus.cc:2804] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:06.053956 32550 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:06.054569 32550 raft_consensus.cc:3060] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:06.051357 32613 consensus_queue.cc:237] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:06.068542 32651 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:06.018674 25576 catalog_manager.cc:5697] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 13 to 15, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 15 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
W20260709 12:26:06.080293 32749 log.cc:927] Time spent T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.611s	user 0.009s	sys 0.007s
I20260709 12:26:06.055406 32529 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 24 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:06.094905 25686 raft_consensus.cc:2468] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 17.
I20260709 12:26:06.058399 32586 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:06.101127 32286 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.102751 32286 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:06.105522 32286 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:26:06.108031 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:06.113626 32529 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 24 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:06.101395 25576 catalog_manager.cc:5697] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 11 to 18, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 18 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:06.134123 25576 catalog_manager.cc:5697] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 11 to 14, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 14 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:06.097962 32574 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:06.101714 32571 consensus_queue.cc:237] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:06.141899 32725 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:06.202613 26404 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:06.213195 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 195547us
I20260709 12:26:06.163870 32748 raft_consensus.cc:3055] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:26:06.216334 25649 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:26:06.224084 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 210962us
I20260709 12:26:06.230356 25650 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:26:06.235538 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:06.216938 32748 raft_consensus.cc:740] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
W20260709 12:26:06.321744 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 91452us
W20260709 12:26:06.320783 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 93406.1us
I20260709 12:26:06.331214 32717 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:06.135897 25576 catalog_manager.cc:5697] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 13 to 19, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 19 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:06.334110 25576 catalog_manager.cc:5697] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 10 to 17, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 17 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:06.337152 32526 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:06.221397 32725 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:06.341888 32725 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:06.344813 25576 catalog_manager.cc:5697] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 10 to 16. New cstate: current_term: 16 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:06.346716 25576 catalog_manager.cc:5697] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 14 to 17, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 17 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:06.348448 25576 catalog_manager.cc:5697] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 10 to 17, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 17 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } }
I20260709 12:26:06.350050 32526 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:06.352073   303 raft_consensus.cc:2764] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:26:06.353871 32764 raft_consensus.cc:493] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:26:06.362272 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:06.363076 25758 raft_consensus.cc:2393] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 24: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:26:06.366856 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:26:06.369477 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:26:06.369587 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 52944.5us
I20260709 12:26:06.231030   309 raft_consensus.cc:2749] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:26:06.373522 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:06.380213 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:06.353907 32571 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.383180 26437 raft_consensus.cc:2393] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 20: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:26:06.388113 25761 raft_consensus.cc:1275] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:26:06.384615 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:26:06.389415 26435 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:06.354583 32764 raft_consensus.cc:515] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:06.393713 32764 leader_election.cc:290] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:06.396015 26431 raft_consensus.cc:2468] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 21.
I20260709 12:26:06.310863 32742 consensus_queue.cc:1059] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.143s
I20260709 12:26:06.398577 31537 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:06.399232 31537 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:06.398509 25650 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:26:06.400561 26435 raft_consensus.cc:2468] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 20.
W20260709 12:26:06.404414 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 190882us
I20260709 12:26:06.408463 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:06.409125 25761 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 11.
I20260709 12:26:06.379739   302 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.413496 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:06.416308 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:26:06.420552   310 log.cc:927] Time spent T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:26:06.413008 32526 consensus_queue.cc:1048] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 12:26:06.425791 32742 consensus_queue.cc:1048] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:06.425729 32550 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:06.427136 26436 raft_consensus.cc:2368] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 18. Current term is 19.
I20260709 12:26:06.429171 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:06.429998 25761 raft_consensus.cc:2393] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 18: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:26:06.432781 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:06.433388 25835 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 24.
I20260709 12:26:06.436157 25828 raft_consensus.cc:1275] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:26:06.445564 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:26:06.448378 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:06.449254 25833 raft_consensus.cc:2468] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 17.
I20260709 12:26:06.451696 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:06.412765   309 consensus_queue.cc:1048] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 12:26:06.455695 26437 raft_consensus.cc:1240] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 12:26:06.457005 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:06.457618 25836 raft_consensus.cc:1275] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:26:06.426219 32732 consensus_queue.cc:1059] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 12:26:06.409983   307 consensus_queue.cc:1048] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 12:26:06.460920 31537 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:06.463053 25830 raft_consensus.cc:1275] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
W20260709 12:26:06.461921 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 60488.3us
I20260709 12:26:06.435907   305 raft_consensus.cc:2804] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:06.464730 25726 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:26:06.463277 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:06.464249 25831 raft_consensus.cc:1275] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:26:06.400452 32571 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:06.467119 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:06.472599 25836 raft_consensus.cc:2393] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 18: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:26:06.467729 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:26:06.473242 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:26:06.476997 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 153362us
I20260709 12:26:06.428123   302 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:06.480033 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:26:06.486019 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:06.486752 25761 raft_consensus.cc:2468] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 16.
I20260709 12:26:06.496300 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:06.497892 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:26:06.498901 26403 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:06.476111 32613 raft_consensus.cc:2804] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:26:06.500885 32613 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:06.501246 32613 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:06.501381 26437 raft_consensus.cc:1275] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 12:26:06.501766 26437 pending_rounds.cc:85] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89: Aborting all ops after (but not including) 12
I20260709 12:26:06.501993 26437 pending_rounds.cc:107] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 12:26:06.502245 26437 raft_consensus.cc:2889] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:06.503628 26437 raft_consensus.cc:1275] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:26:06.479674 32651 consensus_queue.cc:1048] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.025s
I20260709 12:26:06.507198   302 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:06.509027 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:26:06.515678 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47453d79f4484e7ea165be91f0269a2b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:06.516604 25828 raft_consensus.cc:3060] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:06.518947 26432 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 24.
I20260709 12:26:06.522423 26402 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:06.523984 26402 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:06.530050 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:06.530719 25678 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 11.
I20260709 12:26:06.532866 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:06.533775 25834 raft_consensus.cc:2468] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 17.
I20260709 12:26:06.535863 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:06.498664 26434 raft_consensus.cc:2468] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 20.
I20260709 12:26:06.473789   305 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:06.538667   305 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:06.539255 25830 raft_consensus.cc:1240] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:06.535030 25801 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:26:06.542220 26435 raft_consensus.cc:2468] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 16.
I20260709 12:26:06.538550 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:06.542973 26402 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:06.546952 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:06.547593 25829 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 11.
I20260709 12:26:06.557653 25801 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:26:06.559350 32286 raft_consensus.cc:2804] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:26:06.559875 32286 raft_consensus.cc:697] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 21 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:26:06.560073 31537 raft_consensus.cc:2804] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:26:06.560633 31537 raft_consensus.cc:697] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 20 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:26:06.560964 32286 consensus_queue.cc:237] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:06.561400 31537 consensus_queue.cc:237] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:06.565783 32526 raft_consensus.cc:3055] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:26:06.566409 32526 raft_consensus.cc:740] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 21 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:26:06.566860 32613 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:06.568524 25828 raft_consensus.cc:2468] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 20.
I20260709 12:26:06.569274 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:06.576551 25649 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:06.578802 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:06.579481 26433 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 21.
I20260709 12:26:06.582867 32585 raft_consensus.cc:2804] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:26:06.546242 32733 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:06.584344 25761 raft_consensus.cc:2368] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 24. Current term is 25.
I20260709 12:26:06.585564 26402 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:06.585736 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "870002623db3456699b2b970d066f356" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:06.587258 32441 raft_consensus.cc:2749] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:06.540315 32697 consensus_queue.cc:1048] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.048s
I20260709 12:26:06.548552 32755 raft_consensus.cc:2749] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:06.592290 26402 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:06.541838 32601 raft_consensus.cc:2749] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:06.576551 25726 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:26:06.600569 25829 raft_consensus.cc:1275] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:26:06.601836 26402 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:06.583554 32585 raft_consensus.cc:697] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 21 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:26:06.597682 25757 raft_consensus.cc:1240] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 LEADER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 21. Current term is 22. Ops: []
I20260709 12:26:06.616556 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:26:06.633885 25800 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:26:06.647183 25830 raft_consensus.cc:1275] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 20 index: 9. Preceding OpId from leader: term: 21 index: 10. (index mismatch)
I20260709 12:26:06.593628 32757 raft_consensus.cc:2749] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:06.613677 32582 raft_consensus.cc:2749] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:26:06.618733 32689 raft_consensus.cc:2749] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:06.651288 25800 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:06.624758 31537 consensus_queue.cc:1048] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 12:26:06.621194 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:06.619354 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:06.658985 25760 raft_consensus.cc:2468] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 20.
I20260709 12:26:06.567556 32526 consensus_queue.cc:260] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:06.618430 32725 raft_consensus.cc:2804] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:06.660377 31537 raft_consensus.cc:2749] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:26:06.593932 32733 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:06.661388 25800 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:26:06.660620 32651 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:06.680326 32651 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:06.682719 32651 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:06.683286 32651 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:06.653127 32215 consensus_queue.cc:1048] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:26:06.685724 32733 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:06.458636 25576 catalog_manager.cc:5697] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 12 to 16, leader changed from a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 16 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:06.659996 32604 raft_consensus.cc:2804] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:06.686690 32604 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:06.687065 32604 raft_consensus.cc:3060] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:06.653311 32740 consensus_queue.cc:1048] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:26:06.700171 32550 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:26:06.707202 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 45884us
I20260709 12:26:06.654593 32727 consensus_queue.cc:1048] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.050s
I20260709 12:26:06.666116 32725 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:06.705443 32526 raft_consensus.cc:3060] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:06.720760 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:06.721581 25829 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 22.
I20260709 12:26:06.722646 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:06.623389 32594 consensus_queue.cc:1048] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.094s
I20260709 12:26:06.723366 25830 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:06.715005 32740 consensus_queue.cc:1048] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 12:26:06.727106   305 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:26:06.713092 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 153229us
I20260709 12:26:06.730250 25801 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:26:06.683743 32651 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:06.738920 25830 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 25.
I20260709 12:26:06.741492 25801 leader_election.cc:400] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Vote denied by peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611) with higher term. Message: Invalid argument: T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 18. Current term is 19.
I20260709 12:26:06.741863 25801 leader_election.cc:403] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:06.744673 31537 raft_consensus.cc:3060] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:26:06.717115 32725 raft_consensus.cc:3060] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:06.748795 25831 raft_consensus.cc:1240] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 20 LEADER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:06.714740 32644 consensus_queue.cc:1048] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 12:26:06.740166 32716 raft_consensus.cc:2764] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 25 FOLLOWER]: Leader election decision vote started in defunct term 24: won
I20260709 12:26:06.740392 32215 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:06.768826 31537 raft_consensus.cc:2749] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611) with higher term. Message: Invalid argument: T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 18. Current term is 19.
I20260709 12:26:06.748447 32613 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 25 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:06.775656 25801 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:06.777315 31537 consensus_queue.cc:1048] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:26:06.687700 25576 catalog_manager.cc:5697] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 12 to 15, leader changed from a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 15 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:06.740599 32585 consensus_queue.cc:237] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:06.793588 25726 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:26:06.801710 26430 raft_consensus.cc:1275] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:26:06.787125 32286 consensus_queue.cc:1048] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 12:26:06.771710   322 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:26:06.772912   313 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:26:06.805728 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:06.802006 25726 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:26:06.810578 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:06.768096 32215 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:06.812251 25800 leader_election.cc:400] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 24 election: Vote denied by peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267) with higher term. Message: Invalid argument: T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 24. Current term is 25.
W20260709 12:26:06.815327 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 198640us
W20260709 12:26:06.813292 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 232556us
I20260709 12:26:06.804019 32550 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.805567 32759 raft_consensus.cc:2804] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:26:06.810381 32733 raft_consensus.cc:2804] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:06.828949 25650 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:06.817575 32644 raft_consensus.cc:2804] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 25 FOLLOWER]: Leader election won for term 25
W20260709 12:26:06.841274 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 65686.6us
I20260709 12:26:06.827148 26402 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:26:06.847385   332 raft_consensus.cc:2804] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:06.848065   332 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:06.858224   332 raft_consensus.cc:3060] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:06.858381 32733 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:06.858965 32733 raft_consensus.cc:3060] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:06.823673 32759 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
W20260709 12:26:06.857017   326 log.cc:927] Time spent T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:26:06.867339 32759 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:06.868582   303 raft_consensus.cc:2749] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:26:06.870389 25754 raft_consensus.cc:1275] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:26:06.855576 32604 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:06.873075 32748 consensus_queue.cc:260] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:06.874389 32748 raft_consensus.cc:3060] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:06.874446 32764 consensus_queue.cc:1048] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 12:26:06.862108 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 46120.4us
I20260709 12:26:06.865734 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:26:06.849040 32644 raft_consensus.cc:697] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 25 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:26:06.881090 25801 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:06.813755   322 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:06.822955 32550 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:06.828863 32613 consensus_queue.cc:1059] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 12:26:06.865134 25576 catalog_manager.cc:5697] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 14 to 22. New cstate: current_term: 22 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:06.896310   322 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:06.895702 25576 catalog_manager.cc:5697] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 10 to 17, leader changed from a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 17 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:06.897469 32604 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:06.897962 32215 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:06.820880   313 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:06.906114 32644 consensus_queue.cc:237] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 23.19, Last appended by leader: 19, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:06.907433 32571 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:06.885154 32677 raft_consensus.cc:2749] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:26:06.907863 32613 consensus_queue.cc:1243] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer 5cccf20a8bff46dba6601f241d172b8a log is divergent from this leader: its last log entry 20.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
W20260709 12:26:06.905280   328 log.cc:927] Time spent T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:26:06.918072 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:06.924053 32716 consensus_queue.cc:1048] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:06.931767 32550 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:06.937703   333 consensus_queue.cc:1059] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.022s
I20260709 12:26:06.945335   305 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 22 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:06.949199 25834 raft_consensus.cc:1240] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 16 LEADER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:26:06.949224 32651 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:06.939931 25576 catalog_manager.cc:5697] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 11 to 15, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 15 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } }
I20260709 12:26:06.952162 32759 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:06.952929   313 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:06.982359 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:26:06.988292 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:26:06.988927 25685 raft_consensus.cc:3060] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:07.005977 25678 raft_consensus.cc:2393] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 18: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:26:07.007195 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:07.008343 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:06.952804 25576 catalog_manager.cc:5697] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 12 to 14, leader changed from a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 14 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:07.009711 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:07.010462 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:26:07.011030 25682 raft_consensus.cc:3060] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:26:07.012301 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 195723us
I20260709 12:26:07.013898 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:07.014190 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:07.014226 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:26:07.013928 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:26:07.013665 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:07.006678 32552 raft_consensus.cc:2749] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:07.040122 26430 raft_consensus.cc:2393] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 16: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:26:07.041709 32759 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 23 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:07.035327 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:26:07.043315 25679 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:07.053850 25685 raft_consensus.cc:2468] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 16.
I20260709 12:26:06.939937 32733 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:26:07.011972 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 128654us
I20260709 12:26:07.036051 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:07.056176 25679 raft_consensus.cc:2468] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 20.
I20260709 12:26:07.034852 25762 raft_consensus.cc:3060] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:26:07.059463 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 47389.3us
I20260709 12:26:07.061851 25679 raft_consensus.cc:1240] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 12:26:07.070091 25678 raft_consensus.cc:1275] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:26:07.076588 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:26:07.006147 32725 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:07.075125 25726 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:26:07.081775 25726 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:26:07.088295 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:07.109773 25758 raft_consensus.cc:2393] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 19: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:26:07.110096 25726 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:26:07.116864 25762 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 12.
I20260709 12:26:07.117033 25829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:07.097015 32727 raft_consensus.cc:2804] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:07.079931 32740 consensus_queue.cc:1048] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 12:26:07.079697 32651 consensus_queue.cc:1048] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 12:26:07.130256 25830 raft_consensus.cc:1275] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:26:07.133802 25683 raft_consensus.cc:1275] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 12:26:07.134200 25683 pending_rounds.cc:85] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc: Aborting all ops after (but not including) 12
I20260709 12:26:07.134418 25683 pending_rounds.cc:107] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 12:26:07.134650 25683 raft_consensus.cc:2889] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:07.136528 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:07.138644 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:07.124480 32727 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:07.127228 32644 raft_consensus.cc:2804] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:07.144938 32725 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:07.151786 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:07.129161   348 raft_consensus.cc:2804] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:07.161475 25682 raft_consensus.cc:2468] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 12.
I20260709 12:26:07.148474 32727 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:07.126839   332 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:07.158880   348 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:07.198570 26430 raft_consensus.cc:2393] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 12: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:26:07.199373 32215 raft_consensus.cc:3055] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:26:07.207533 25832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:07.208246 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:07.215143 25650 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:07.185184   348 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:07.222685 25836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:07.223841 25686 raft_consensus.cc:1275] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:26:07.227023 26402 leader_election.cc:304] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:26:07.230756 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:07.231539 25686 raft_consensus.cc:2468] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 20.
I20260709 12:26:07.234458   332 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:07.199805 32215 raft_consensus.cc:740] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:26:07.248589 32215 consensus_queue.cc:260] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:07.249873 32215 raft_consensus.cc:3060] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:07.263378 25686 raft_consensus.cc:1240] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 21. Current term is 22. Ops: []
I20260709 12:26:07.265026 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:26:07.266139 25762 raft_consensus.cc:2393] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 12: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:26:07.252317   322 raft_consensus.cc:2749] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:26:07.284606 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:07.261646 32574 raft_consensus.cc:2749] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:07.293076 25686 raft_consensus.cc:1275] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:26:07.257726 32594 consensus_queue.cc:1059] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 12:26:07.299003 25686 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
mode: GRACEFUL
new_leader_uuid: "a866ff967d964388a6f0dff7fd43df89"
 from {username='slave'} at 127.0.0.1:49108
I20260709 12:26:07.297839   332 consensus_queue.cc:1048] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.002s
W20260709 12:26:07.300511   350 log.cc:927] Time spent T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.174s	user 0.001s	sys 0.000s
I20260709 12:26:07.300374 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:07.299639 25686 raft_consensus.cc:606] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 16 LEADER]: Received request to transfer leadership to TS a866ff967d964388a6f0dff7fd43df89
W20260709 12:26:07.300256   354 log.cc:927] Time spent T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 12:26:07.306746 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:07.321382 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:26:07.325136 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 22 candidate_status { last_received { term: 20 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:26:07.326181 25763 raft_consensus.cc:1240] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 23 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 22. Current term is 23. Ops: []
W20260709 12:26:07.333191 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 76728.9us
I20260709 12:26:07.335364 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:07.336570 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:26:07.337543 26431 raft_consensus.cc:2393] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 19: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:26:07.338706 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5f0353e850934c9db0a248807127ca4c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:07.342190 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:07.347203 25801 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:07.349467 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
W20260709 12:26:07.349800 25649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:07.354636 25801 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:07.355230 25829 raft_consensus.cc:2468] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 19.
I20260709 12:26:07.360396 26402 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:07.361460 26437 raft_consensus.cc:1240] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 12:26:07.361681 25682 raft_consensus.cc:2393] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 12: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:26:07.363399 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:07.365396 26436 raft_consensus.cc:1275] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:26:07.360680 32662 raft_consensus.cc:2749] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:26:07.368849 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:07.369607 25831 raft_consensus.cc:2393] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 12: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
W20260709 12:26:07.372265 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 98200.1us
I20260709 12:26:07.377099 31537 raft_consensus.cc:2749] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:07.370002 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:26:07.378487 26439 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:07.381157 25649 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:07.350082 32644 raft_consensus.cc:697] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:26:07.385869 25649 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:26:07.396417 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:26:07.404748 25684 raft_consensus.cc:1275] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:26:07.413763 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:26:07.414633 25761 raft_consensus.cc:3060] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:07.418988 25800 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:26:07.391258 32741 raft_consensus.cc:2764] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
W20260709 12:26:07.443794   358 log.cc:927] Time spent T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:26:07.393159 32585 raft_consensus.cc:2749] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:26:07.451529 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 91195.1us
I20260709 12:26:07.452040 25757 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
mode: GRACEFUL
new_leader_uuid: "a866ff967d964388a6f0dff7fd43df89"
 from {username='slave'} at 127.0.0.1:47510
I20260709 12:26:07.453322 25830 raft_consensus.cc:1240] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 16. Current term is 17. Ops: []
I20260709 12:26:07.459771 26402 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:26:07.465338 31537 consensus_queue.cc:1048] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:26:07.442804 32611 raft_consensus.cc:2804] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:07.484571 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:26:07.461706   345 log.cc:927] Time spent T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.307s	user 0.004s	sys 0.000s
I20260709 12:26:07.488149   348 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:07.491338   348 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 22 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:07.494369 32727 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:07.498430   366 raft_consensus.cc:2749] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:26:07.499405   366 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.509286 25757 raft_consensus.cc:606] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Received request to transfer leadership to TS a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:07.509907 25757 raft_consensus.cc:614] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:07.511899 32594 raft_consensus.cc:2804] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:26:07.512666 32594 raft_consensus.cc:697] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 20 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:26:07.454530 32748 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:26:07.514806 25759 raft_consensus.cc:1275] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 12:26:07.474504   357 log.cc:927] Time spent T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260709 12:26:07.517285   337 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.513861 32594 consensus_queue.cc:237] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:07.515462 32611 raft_consensus.cc:697] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 12 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:26:07.519560 32742 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.472934   322 consensus_queue.cc:1059] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 12:26:07.572429 32611 consensus_queue.cc:237] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:07.572995 32727 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 21 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:07.517519   366 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:26:07.584741   371 log.cc:927] Time spent T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:26:07.544035   368 consensus_queue.cc:1059] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.065s
I20260709 12:26:07.608000 25761 raft_consensus.cc:2468] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 17.
I20260709 12:26:07.608981 25762 raft_consensus.cc:1240] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 16. Current term is 17. Ops: [13.10-16.11]
I20260709 12:26:07.609285 26439 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 25.
W20260709 12:26:07.610630 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 133433us
I20260709 12:26:07.612181 26402 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:07.531535 32748 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:07.618036 32764 raft_consensus.cc:2749] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:26:07.528839 32644 consensus_queue.cc:237] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:07.568005   337 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:07.631357   337 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:07.565784 32742 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:07.634402 32742 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:26:07.645854 25726 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:07.649703 32748 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:07.650583 32651 consensus_queue.cc:1048] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:07.657763 32428 raft_consensus.cc:3055] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:07.658269 32428 raft_consensus.cc:740] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:26:07.660462 25757 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
mode: GRACEFUL
new_leader_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:47510
I20260709 12:26:07.661321 25757 raft_consensus.cc:606] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Received request to transfer leadership to TS 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:26:07.661773 25757 raft_consensus.cc:614] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:07.679970   366 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:07.684827 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:07.686215 25759 raft_consensus.cc:2468] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 17.
I20260709 12:26:07.688802 26401 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:26:07.699430 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:07.701388 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:07.702033 25828 raft_consensus.cc:2468] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 18.
I20260709 12:26:07.659155 32428 consensus_queue.cc:260] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:07.700228 26434 raft_consensus.cc:2468] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 21.
I20260709 12:26:07.706188 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:07.706658 25759 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
mode: GRACEFUL
new_leader_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:47510
I20260709 12:26:07.725710 25759 raft_consensus.cc:606] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Received request to transfer leadership to TS 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:26:07.726058 25759 raft_consensus.cc:614] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:07.706250 32601 raft_consensus.cc:2804] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:07.729751 32601 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:07.730121 32601 raft_consensus.cc:3060] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:07.707434 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:07.710289 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:26:07.711979   362 log.cc:927] Time spent T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.332s	user 0.000s	sys 0.004s
I20260709 12:26:07.728065 25830 raft_consensus.cc:1275] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 25 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 23 index: 19. Preceding OpId from leader: term: 25 index: 20. (index mismatch)
I20260709 12:26:07.724885 26433 raft_consensus.cc:2468] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 18.
I20260709 12:26:07.738214 32601 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:07.739425 26437 raft_consensus.cc:2368] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for earlier term 17. Current term is 18.
I20260709 12:26:07.661339 32733 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:07.741317 25759 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
mode: GRACEFUL
new_leader_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:47510
I20260709 12:26:07.742172 25759 raft_consensus.cc:606] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 23 FOLLOWER]: Received request to transfer leadership to TS 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:26:07.742592 25759 raft_consensus.cc:614] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:07.743173 32601 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:07.748086 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:26:07.753567 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:07.759615 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:07.762069 32428 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:07.767661 25650 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:26:07.768628 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 120292us
I20260709 12:26:07.770506 26437 raft_consensus.cc:1275] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 21 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:26:07.789062 26437 raft_consensus.cc:1275] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 21 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:26:07.792459 26439 raft_consensus.cc:1275] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 12:26:07.614358 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 99033.2us
W20260709 12:26:07.814055 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 44475.8us
I20260709 12:26:07.819204 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:26:07.820205 25761 raft_consensus.cc:3060] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:07.829890 25837 raft_consensus.cc:1240] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 16. Current term is 17. Ops: []
I20260709 12:26:07.827780 26402 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:26:07.835816 25726 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:07.843565 25649 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:26:07.812920 25800 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:26:07.850121 31537 raft_consensus.cc:2804] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:07.850677 31537 raft_consensus.cc:697] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 17 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:26:07.825567   305 raft_consensus.cc:2804] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:07.851627 31537 consensus_queue.cc:237] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:07.854955 32748 raft_consensus.cc:2749] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:26:07.854869 32529 consensus_queue.cc:1048] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:26:07.854898   379 consensus_queue.cc:1059] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 22.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 12:26:07.852303   333 raft_consensus.cc:2749] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:07.851817 25726 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:07.865971 26402 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:26:07.847591 25761 raft_consensus.cc:2468] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 18.
I20260709 12:26:07.868112 32601 raft_consensus.cc:2749] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:07.886930   333 raft_consensus.cc:2749] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:07.859726   305 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:07.944968 25649 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:07.947525 25650 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:26:07.880532 26401 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:26:07.891903 26402 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:26:07.886047 25726 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
W20260709 12:26:07.950423 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 70003us
I20260709 12:26:07.904156 32550 raft_consensus.cc:2804] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:26:07.960748 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 74765.9us
I20260709 12:26:07.983167 25726 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
W20260709 12:26:07.983433 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 91641.7us
I20260709 12:26:07.976218 32727 raft_consensus.cc:2749] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:07.946353   312 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.952775   305 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:07.975487 32574 raft_consensus.cc:2804] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:26:07.950136   374 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:07.985999   376 raft_consensus.cc:2749] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:07.980870 32550 raft_consensus.cc:697] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 19 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:26:08.000895 25726 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:08.004761   333 raft_consensus.cc:2749] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:26:08.007190 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 75295.5us
I20260709 12:26:08.014853 25726 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:07.996280   324 raft_consensus.cc:2749] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:07.982847   334 consensus_queue.cc:1048] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.023s
I20260709 12:26:08.020653 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:26:08.018486   348 raft_consensus.cc:2749] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:07.986768 32740 consensus_queue.cc:1059] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 12:26:08.000378 32741 raft_consensus.cc:2804] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:08.029654 26437 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:08.030356 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:26:08.030063 25726 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:08.035380 26433 raft_consensus.cc:1275] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 25 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 23 index: 19. Preceding OpId from leader: term: 25 index: 20. (index mismatch)
I20260709 12:26:08.038225 32677 consensus_queue.cc:1048] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:26:08.007164 32574 raft_consensus.cc:697] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 18 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:26:08.046469 32717 raft_consensus.cc:493] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:26:07.988744   370 consensus_queue.cc:1048] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:26:07.989073   312 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:26:08.058174 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 113894us
W20260709 12:26:08.059659 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 112249us
I20260709 12:26:08.006999 32601 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.039727 32611 consensus_queue.cc:1048] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 12:26:08.014582   337 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:08.048605   378 log.cc:927] Time spent T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:26:08.071226 32717 raft_consensus.cc:515] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:08.001533   374 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:08.064903 32741 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:08.097757 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 67818.2us
I20260709 12:26:08.074115 32550 consensus_queue.cc:237] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:08.032269 32651 raft_consensus.cc:2749] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:26:08.099795   337 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:08.105024 32717 leader_election.cc:290] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:08.098941 32215 raft_consensus.cc:2749] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:26:08.106702   337 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:08.099215 32601 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:08.109731 32601 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:08.110342 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:08.110666 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:08.076938 32574 consensus_queue.cc:237] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:08.091493 25828 raft_consensus.cc:1240] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 12:26:08.092253 25650 leader_election.cc:400] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Vote denied by peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611) with higher term. Message: Invalid argument: T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for earlier term 17. Current term is 18.
I20260709 12:26:08.119891 25650 leader_election.cc:403] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:08.054044 32742 raft_consensus.cc:3055] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:26:08.123203 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22f8565191e471dbe96772477b84e36" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:08.101141 32741 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:26:08.152560 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 203770us
I20260709 12:26:08.156440 25685 raft_consensus.cc:1240] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 12:26:07.988227   360 consensus_queue.cc:1048] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 12:26:08.162824 25680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:08.163546 25680 raft_consensus.cc:2468] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 17.
W20260709 12:26:08.163753   375 log.cc:927] Time spent T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 12:26:08.161445 25800 leader_election.cc:304] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:08.129130 32742 raft_consensus.cc:740] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:26:08.159519 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:08.171041 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:08.171957 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:08.174490 26435 raft_consensus.cc:2468] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 17.
I20260709 12:26:08.149156   393 raft_consensus.cc:3060] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:26:08.185521 25684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:26:08.186756 25835 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44218 (request call id 2225) took 1069 ms. Trace:
I20260709 12:26:08.187120 25835 rpcz_store.cc:276] 0709 12:26:07.117528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:07.117637 (+   109us) service_pool.cc:224] Handling call
0709 12:26:07.218078 (+100441us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:07.218461 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:07.218504 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:07.232492 (+ 13988us) log.cc:844] Serialized 26 byte log entry
0709 12:26:07.604186 (+371694us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:26:07.604229 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:07.604298 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:08.186564 (+582266us) raft_consensus.cc:1685] finished
0709 12:26:08.186585 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:08.186700 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":24233,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":88,"thread_start_us":314805,"threads_started":1,"wal-append.queue_time_us":584995}
I20260709 12:26:08.190519 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:08.191272 25763 raft_consensus.cc:2368] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for earlier term 17. Current term is 18.
I20260709 12:26:08.178664 32651 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:08.192353 32651 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:08.194519 32651 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:08.199281 32727 raft_consensus.cc:3055] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:26:08.199837 32727 raft_consensus.cc:740] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:26:08.200436 25759 raft_consensus.cc:1240] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 21. Current term is 22. Ops: []
I20260709 12:26:08.200898   395 consensus_queue.cc:1059] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 12:26:08.165426 32748 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.202020   395 consensus_queue.cc:1059] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.010s
W20260709 12:26:08.217747   396 log.cc:927] Time spent T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 12:26:08.219060   387 log.cc:927] Time spent T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:26:08.172401 32611 raft_consensus.cc:2749] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:08.152801 32526 consensus_queue.cc:1048] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.059s
I20260709 12:26:08.229378 26437 raft_consensus.cc:2468] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 22.
I20260709 12:26:08.165294 32740 consensus_queue.cc:1048] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.051s
I20260709 12:26:08.171437   391 consensus_queue.cc:1048] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.057s
I20260709 12:26:08.241874   392 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
W20260709 12:26:08.281431   383 log.cc:927] Time spent T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.275s	user 0.000s	sys 0.003s
I20260709 12:26:08.284221 31537 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.288443 31537 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:08.235255 32594 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.305120   312 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:08.226070 32748 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:26:08.325433 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 140057us
I20260709 12:26:08.344965 26434 raft_consensus.cc:1275] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:26:08.360383 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:08.361816 26434 raft_consensus.cc:1240] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 22 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 21. Current term is 22. Ops: [21.16-21.16]
I20260709 12:26:08.359666 26402 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:26:08.362424 32717 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.372720 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:08.373358 32717 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:08.368369   366 raft_consensus.cc:2804] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:08.376801   366 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:08.377182   366 raft_consensus.cc:3060] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:08.377267   337 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.378082   337 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:08.380717 25650 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:26:08.287797   392 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:08.386008   379 consensus_queue.cc:1059] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:26:08.387121   336 raft_consensus.cc:3055] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:26:08.387527   336 raft_consensus.cc:740] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 21 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:26:08.320013 32594 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:08.388514   336 consensus_queue.cc:260] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:08.375756 32717 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:08.384900   324 raft_consensus.cc:993] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc: : Instructing follower a866ff967d964388a6f0dff7fd43df89 to start an election
I20260709 12:26:08.387567   392 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:08.393265 25835 raft_consensus.cc:2410] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 23 because replica has last-logged OpId of term: 22 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 14.
I20260709 12:26:08.383888   323 raft_consensus.cc:2804] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:08.398670   323 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:08.399128   323 raft_consensus.cc:3060] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:08.402307 32741 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:08.398115   324 raft_consensus.cc:1081] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 16 LEADER]: Signalling peer a866ff967d964388a6f0dff7fd43df89 to start an election
W20260709 12:26:08.407115   385 log.cc:927] Time spent T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.379s	user 0.001s	sys 0.001s
I20260709 12:26:08.389989 32594 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:08.407466   323 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:08.408515   342 consensus_queue.cc:1048] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:26:08.410449   323 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:08.415869 25828 raft_consensus.cc:1240] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 17 LEADER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 16. Current term is 17. Ops: []
I20260709 12:26:08.389940   336 raft_consensus.cc:3060] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:08.418982   305 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:08.442775 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:08.449888 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:08.450762 25682 raft_consensus.cc:2468] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 16.
I20260709 12:26:08.452250 26402 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:26:08.457396 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
W20260709 12:26:08.458446 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 306409us
I20260709 12:26:08.462749 26439 raft_consensus.cc:1275] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:26:08.465507 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:08.466161 25681 raft_consensus.cc:1275] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:26:08.470834 25763 raft_consensus.cc:1240] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:08.471839 25684 raft_consensus.cc:1240] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Rejecting Update request from peer 5cccf20a8bff46dba6601f241d172b8a for earlier term 21. Current term is 22. Ops: [21.14-21.14]
I20260709 12:26:08.482784   373 consensus_queue.cc:1059] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:26:08.486306 25677 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40220 (request call id 3083) took 1501 ms. Trace:
I20260709 12:26:08.453984   374 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:08.487015 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:08.473383 26433 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51"
dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
 from {username='slave'} at 127.0.0.1:36510
I20260709 12:26:08.501374 26433 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:08.501793 26433 raft_consensus.cc:3060] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:08.390125 32742 consensus_queue.cc:260] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:08.505927 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 26 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:08.486737 25677 rpcz_store.cc:276] 0709 12:26:06.984743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:06.984852 (+   109us) service_pool.cc:224] Handling call
0709 12:26:07.208595 (+223743us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:07.208889 (+   294us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:07.208916 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:07.220534 (+ 11618us) log.cc:844] Serialized 26 byte log entry
0709 12:26:07.683003 (+462469us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b18000f2260. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d9f93cab1 00007f5d9f949281 00007f5d96a56e07 00007f5d9f8b19a9 00007f5d96a7369b 00007f5d96a7193f 00007f5d96a73c02 00007f5d996fb20b 00007f5d99700d23 00007f5d997010d1 00007f5d99b1ca0f
0709 12:26:07.862062 (+179059us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:26:07.948628 (+ 86566us) log.cc:844] Serialized 14 byte log entry
0709 12:26:08.084300 (+135672us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:08.084411 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:08.406452 (+322041us) spinlock_profiling.cc:243] Waited 20 ms on lock 0x7b4400022b4c. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d968fcdb1 00007f5d9699ac85 00007f5d9699b6a2 00007f5d9970d1db 00007f5d99708aaf 00007f5d996fc86e 00007f5d996fbbb6 00007f5d996fb7d8 00007f5d99705221 00007f5d997051d9 00007f5d99705169
0709 12:26:08.486079 (+ 79627us) raft_consensus.cc:1685] finished
0709 12:26:08.486101 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:08.486251 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7460,"prepare.queue_time_us":84075,"prepare.run_cpu_time_us":587,"prepare.run_wall_time_us":892,"raft.queue_time_us":51540,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":19181,"spinlock_wait_cycles":78316544,"thread_start_us":301214,"threads_started":2,"wal-append.queue_time_us":745100}
I20260709 12:26:08.508224 26439 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 25.
I20260709 12:26:08.510985 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:08.511219 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:26:08.512868 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:26:08.511734 25682 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 18.
I20260709 12:26:08.513442 25686 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:08.524336 32748 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:08.526669 32742 raft_consensus.cc:3060] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:08.526834 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:08.477111 32550 raft_consensus.cc:2804] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:08.531965 25684 raft_consensus.cc:1275] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:26:08.533046 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e8d1d3d43ad47308fae5ed98608feb8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:26:08.534394 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 44748.5us
I20260709 12:26:08.537670 25650 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:08.545300 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:08.544153 25726 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:26:08.554670 25677 raft_consensus.cc:1240] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 12:26:08.542644 25801 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:26:08.536273 32550 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:08.560992 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:08.561466 25756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:26:08.562278 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:08.564173 25686 raft_consensus.cc:2468] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 21.
I20260709 12:26:08.546056 32526 raft_consensus.cc:2749] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:08.543798   393 raft_consensus.cc:2749] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611) with higher term. Message: Invalid argument: T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for earlier term 17. Current term is 18.
I20260709 12:26:08.566418 25649 leader_election.cc:400] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Vote denied by peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267) with higher term. Message: Invalid argument: T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for earlier term 17. Current term is 18.
I20260709 12:26:08.568219   405 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:26:08.568536 25679 raft_consensus.cc:1240] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 21. Current term is 22. Ops: [21.10-21.10]
I20260709 12:26:08.569211   348 raft_consensus.cc:2804] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:26:08.584904   348 raft_consensus.cc:697] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 22 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:26:08.586033   348 consensus_queue.cc:237] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:08.569578 32283 raft_consensus.cc:2804] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:26:08.588240 32283 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:08.588654 32283 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:26:08.514515 32644 consensus_queue.cc:1048] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.039s
W20260709 12:26:08.530516   309 consensus_queue.cc:1175] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5cccf20a8bff46dba6601f241d172b8a" responder_term: 17 status { last_received { term: 17 index: 12 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 16. Current term is 17. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:26:08.563835 32550 raft_consensus.cc:3060] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:08.582610 25726 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:08.552955   374 consensus_queue.cc:1048] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.033s
I20260709 12:26:08.593976 25683 raft_consensus.cc:2468] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 18.
I20260709 12:26:08.595608 25686 raft_consensus.cc:1275] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:26:08.600167   400 raft_consensus.cc:2749] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:08.604588 25726 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:08.609143   400 consensus_queue.cc:1059] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 12:26:08.616289 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:08.618371 25759 raft_consensus.cc:1275] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:26:08.583156 32215 consensus_queue.cc:1048] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 12:26:08.594395   366 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:08.626616 26437 raft_consensus.cc:2393] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 18: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:26:08.627781 26433 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:08.630373 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:26:08.631184 25679 raft_consensus.cc:2393] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 18: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:26:08.622350 32740 consensus_queue.cc:1059] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 20.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 12:26:08.591081   405 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:08.633818 32286 consensus_queue.cc:1059] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:26:08.634886   399 consensus_queue.cc:1048] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:26:08.635128   405 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:08.645289 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:08.620656 32651 raft_consensus.cc:2804] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:26:08.653235 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: true dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:26:08.653998 25679 raft_consensus.cc:3055] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:26:08.654321 25679 raft_consensus.cc:740] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:26:08.654780 32552 raft_consensus.cc:3055] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:26:08.655292 32552 raft_consensus.cc:740] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:26:08.655064 25679 consensus_queue.cc:260] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:08.656172 32552 consensus_queue.cc:260] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:08.657405 32552 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:08.644541 32717 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:08.661216 32717 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:08.662376   305 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 19 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:08.663415 32717 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:26:08.664438 25652 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:08.665686   380 raft_consensus.cc:3055] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:26:08.666139   380 raft_consensus.cc:740] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 22 LEADER]: Becoming Follower/Learner. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:26:08.666985   380 consensus_queue.cc:260] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:08.668706 32733 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:08.669226 32733 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:08.671581 32733 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:08.672168 32733 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:08.672633 32733 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:08.680848 25678 raft_consensus.cc:1240] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 12:26:08.682433 25759 raft_consensus.cc:1240] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 23 FOLLOWER]: Rejecting Update request from peer f82778701b464892aab92a752ed7ffdc for earlier term 22. Current term is 23. Ops: []
I20260709 12:26:08.689081 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:08.690711 32741 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 22 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:08.691969   380 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:08.692682 32550 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:08.695063 25679 raft_consensus.cc:3060] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:08.695257 31537 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:08.624049 32571 consensus_queue.cc:1048] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.028s
I20260709 12:26:08.696199 26433 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:08.703866 26439 raft_consensus.cc:1240] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:26:08.722580 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:08.723428 25828 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:08.724320 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:08.733562 25679 raft_consensus.cc:2468] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 17.
I20260709 12:26:08.738245 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:26:08.676294 32651 raft_consensus.cc:697] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 21 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:26:08.753633 25828 raft_consensus.cc:2468] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 19.
I20260709 12:26:08.741775 26402 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:26:08.755906 25650 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:26:08.767091 25759 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: true dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:26:08.732872 32604 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:08.763465 25650 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
W20260709 12:26:08.768402 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 102499us
I20260709 12:26:08.767693 25759 raft_consensus.cc:3060] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:08.769694 25650 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
W20260709 12:26:08.759481   415 log.cc:927] Time spent T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 12:26:08.769068 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:26:08.772039 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:26:08.772758 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:26:08.772905 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:26:08.739678   366 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:08.776350 26432 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:08.757972 32733 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:08.779783 26401 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:08.789431 31537 consensus_queue.cc:1048] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:26:08.765826   376 raft_consensus.cc:2804] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:08.740186 32574 consensus_queue.cc:1059] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.044s
I20260709 12:26:08.775435   405 raft_consensus.cc:2804] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:08.825685 25650 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:08.783567   394 raft_consensus.cc:2749] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:08.826503 25681 raft_consensus.cc:1275] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:26:08.826462 26401 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:08.831040   376 raft_consensus.cc:697] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 17 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:26:08.822994   374 raft_consensus.cc:2749] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:26:08.886422 26432 raft_consensus.cc:2468] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 19.
I20260709 12:26:08.876868 25759 raft_consensus.cc:2468] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 17.
W20260709 12:26:08.888561 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 73485.7us
I20260709 12:26:08.890669 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:08.890494 32727 consensus_queue.cc:260] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.10, Last appended by leader: 10, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:26:08.891453   416 log.cc:927] Time spent T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.277s	user 0.000s	sys 0.003s
I20260709 12:26:08.893435   309 raft_consensus.cc:2749] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:08.894207 25685 raft_consensus.cc:2410] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 for term 22 because replica has last-logged OpId of term: 21 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 15.
I20260709 12:26:08.894721   376 consensus_queue.cc:237] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:08.775067 32604 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:08.900969 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:26:08.883802   415 log.cc:927] Time spent T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
W20260709 12:26:08.903367 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 91467.8us
I20260709 12:26:08.909078 26436 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:08.919742 26436 raft_consensus.cc:2410] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 12:26:08.896651 32574 raft_consensus.cc:2749] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:26:08.888197   405 raft_consensus.cc:697] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 19 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:26:08.910984 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:08.902870   336 raft_consensus.cc:2749] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:26:08.922463 25650 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:26:08.908161   348 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:08.937611   348 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:08.937949   406 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:26:08.940248   406 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:08.940474   405 consensus_queue.cc:237] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:26:08.935839   419 log.cc:927] Time spent T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.131s	user 0.002s	sys 0.004s
I20260709 12:26:08.883671 32651 consensus_queue.cc:237] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:26:08.960351   408 log.cc:927] Time spent T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.490s	user 0.004s	sys 0.000s
I20260709 12:26:08.954224 32604 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:26:08.955015   425 log.cc:927] Time spent T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:26:08.956072 32283 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 26 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:08.972280 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:08.972594   333 raft_consensus.cc:3055] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:08.973034   333 raft_consensus.cc:740] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:26:08.973937 32283 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 26 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:08.973912   333 consensus_queue.cc:260] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:08.975234   333 raft_consensus.cc:3060] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:08.956758   393 raft_consensus.cc:2749] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:26:08.921581 32727 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:08.939837   348 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:08.944597   406 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:08.933771   374 consensus_queue.cc:1048] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
W20260709 12:26:09.016156 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 110951us
I20260709 12:26:09.018829 32550 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:09.019213 25762 raft_consensus.cc:1275] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:26:09.023180   337 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:09.029469 25762 raft_consensus.cc:1240] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 21 LEADER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 12:26:09.032614 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:09.035490 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:26:09.034246   434 log.cc:927] Time spent T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.069s	user 0.002s	sys 0.000s
I20260709 12:26:09.094740 25650 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:09.099730 32741 raft_consensus.cc:2749] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:09.112605   369 raft_consensus.cc:3055] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:26:09.113114   369 raft_consensus.cc:740] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:26:09.088927   437 consensus_queue.cc:1048] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 12:26:09.099897   439 consensus_queue.cc:1059] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.022s
I20260709 12:26:09.129230   439 consensus_queue.cc:1243] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer 6e673265293d4e9a937dc45150aeb1b8 log is divergent from this leader: its last log entry 21.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:26:09.129611 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:09.135421 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:09.136318 25761 raft_consensus.cc:2410] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 12:26:09.136852 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 26 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:09.145043 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:09.144060   400 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:09.146548   400 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:09.149387   400 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:09.150113 25759 raft_consensus.cc:1275] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:26:09.151566 25754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:09.152527 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:09.154009 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:09.154767 25763 raft_consensus.cc:1275] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 12:26:09.155503   440 log.cc:927] Time spent T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 12:26:09.158149   422 log.cc:927] Time spent T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.274s	user 0.001s	sys 0.000s
I20260709 12:26:09.164893 25837 raft_consensus.cc:1240] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 26 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 25. Current term is 26. Ops: [25.20-25.20]
I20260709 12:26:09.146314 32716 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:09.169262 25677 raft_consensus.cc:1275] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:26:09.172185 32716 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:09.176570 32716 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:09.184082 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:09.184425 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:09.185925 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:09.144318   376 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:09.192970 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 26 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:26:09.193288 26437 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:09.194895 26434 raft_consensus.cc:1240] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Rejecting Update request from peer 6e673265293d4e9a937dc45150aeb1b8 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260709 12:26:09.195835 26437 raft_consensus.cc:1275] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 22 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:26:09.197988 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:09.196655 25650 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:09.203382 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:09.212870 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:09.203233   322 raft_consensus.cc:2749] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:26:09.257388 25726 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:09.257980 26438 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 26 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:26:09.255576   370 consensus_queue.cc:1048] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.003s
I20260709 12:26:09.203639   376 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:09.260085 25831 raft_consensus.cc:1275] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:26:09.261881   376 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:09.266286   400 consensus_queue.cc:1059] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:26:09.267319   400 raft_consensus.cc:3055] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:26:09.267709   400 raft_consensus.cc:740] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:26:09.268584   400 consensus_queue.cc:260] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:09.269784   400 raft_consensus.cc:3060] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:26:09.272912   431 log.cc:927] Time spent T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
I20260709 12:26:09.273834 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:09.274343 25677 raft_consensus.cc:1240] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 12:26:09.274461 25686 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 18.
W20260709 12:26:09.280045 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:09.281483 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:09.282544 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:09.283214 25762 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 17.
I20260709 12:26:09.291301 26401 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:26:09.299491 25677 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
mode: GRACEFUL
new_leader_uuid: "a866ff967d964388a6f0dff7fd43df89"
 from {username='slave'} at 127.0.0.1:49108
I20260709 12:26:09.300185 25677 raft_consensus.cc:606] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Received request to transfer leadership to TS a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:09.300537 25677 raft_consensus.cc:614] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:09.310223 25677 raft_consensus.cc:1275] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 16. (term mismatch)
I20260709 12:26:09.310635 25677 pending_rounds.cc:85] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc: Aborting all ops after (but not including) 15
I20260709 12:26:09.310853 25677 pending_rounds.cc:107] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc: Aborting uncommitted NO_OP operation due to leader change: 21.16
I20260709 12:26:09.311122 25677 raft_consensus.cc:2889] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:09.317269   370 consensus_queue.cc:1048] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:26:09.289080   348 raft_consensus.cc:2749] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:09.314085 32571 raft_consensus.cc:2804] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:09.354389 25763 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
mode: GRACEFUL
new_leader_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:47510
I20260709 12:26:09.367195 32571 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:09.367345 25763 raft_consensus.cc:606] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Received request to transfer leadership to TS 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:26:09.367695 32571 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:09.367758 25763 raft_consensus.cc:614] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:09.361702 32651 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:09.369225 32651 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:09.371253 32651 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:09.372293 25763 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
mode: GRACEFUL
new_leader_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:47510
I20260709 12:26:09.372884 25763 raft_consensus.cc:606] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Received request to transfer leadership to TS 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:26:09.373270 25763 raft_consensus.cc:614] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:09.289821   376 consensus_queue.cc:1059] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.086s
I20260709 12:26:09.376116 25763 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e535a01d34654e31ac7826205390f938"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
mode: GRACEFUL
new_leader_uuid: "a866ff967d964388a6f0dff7fd43df89"
 from {username='slave'} at 127.0.0.1:47510
I20260709 12:26:09.376892 25763 raft_consensus.cc:606] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Received request to transfer leadership to TS a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:09.377319 25763 raft_consensus.cc:614] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:09.380395 25763 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
mode: GRACEFUL
new_leader_uuid: "5cccf20a8bff46dba6601f241d172b8a"
 from {username='slave'} at 127.0.0.1:47510
I20260709 12:26:09.380970 25763 raft_consensus.cc:606] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 23 FOLLOWER]: Received request to transfer leadership to TS 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:26:09.381331 25763 raft_consensus.cc:614] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:09.382300 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:26:09.384060 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:09.383843   369 consensus_queue.cc:260] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:09.384874 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:09.385174   369 raft_consensus.cc:3060] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:09.386264 32571 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:26:09.396060 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 83940.8us
W20260709 12:26:09.391664 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 107785us
I20260709 12:26:09.399227 25800 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:09.401121 26435 raft_consensus.cc:1275] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:26:09.401353 25762 raft_consensus.cc:1240] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 21 LEADER]: Rejecting Update request from peer a866ff967d964388a6f0dff7fd43df89 for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 12:26:09.417124 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:09.417829 25681 raft_consensus.cc:2468] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 22.
W20260709 12:26:09.446041 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 49310.8us
I20260709 12:26:09.448246 25801 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:09.408874 32611 consensus_queue.cc:1048] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 12:26:09.450533 32611 raft_consensus.cc:2749] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:09.501854 25800 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:09.504441 32716 raft_consensus.cc:2749] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:09.508041 32552 consensus_queue.cc:1048] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:26:09.518697 25800 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:09.529825 25800 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:09.535732   411 raft_consensus.cc:2749] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:09.531186   390 raft_consensus.cc:2749] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:09.536964 32716 consensus_queue.cc:1048] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:09.541201 32571 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:26:09.545600 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 130777us
I20260709 12:26:09.545680   324 consensus_queue.cc:1048] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.002s
W20260709 12:26:09.550074 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 132900us
I20260709 12:26:09.554224 25726 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:26:09.562249 25682 raft_consensus.cc:1275] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:26:09.563422 25681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:26:09.564051 25681 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:09.564271 25686 raft_consensus.cc:1275] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:26:09.566306   333 raft_consensus.cc:2804] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:26:09.566721   333 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:09.567111   333 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:09.570181 26439 raft_consensus.cc:1275] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 21 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 14. (term mismatch)
I20260709 12:26:09.570562 26439 pending_rounds.cc:85] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89: Aborting all ops after (but not including) 13
I20260709 12:26:09.570793 26439 pending_rounds.cc:107] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89: Aborting uncommitted NO_OP operation due to leader change: 20.14
I20260709 12:26:09.571045 26439 raft_consensus.cc:2889] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:09.575183   333 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:09.577523 25763 raft_consensus.cc:1275] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:26:09.577489 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:26:09.581266 25762 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:26:09.585611   348 consensus_queue.cc:1048] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:26:09.585886   437 consensus_queue.cc:1048] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 12:26:09.597640 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 62392.1us
I20260709 12:26:09.608724 25835 raft_consensus.cc:1275] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:26:09.616890 25800 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:09.606757   334 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:26:09.619999 32764 consensus_queue.cc:1048] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.019s
I20260709 12:26:09.620198 32571 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:26:09.641767 32571 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:09.652523   322 consensus_queue.cc:1048] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:26:09.659618 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:09.658870 25762 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 19.
W20260709 12:26:09.680114 25727 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:09.681466 25681 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 19.
W20260709 12:26:09.683781 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 65418.1us
I20260709 12:26:09.684324 26402 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:26:09.685534 25683 raft_consensus.cc:2393] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 22: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:26:09.686796   369 raft_consensus.cc:2804] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:09.687472   369 raft_consensus.cc:697] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 19 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:26:09.688689   369 consensus_queue.cc:237] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:09.629662   390 raft_consensus.cc:2749] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
W20260709 12:26:09.698801 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 79761.4us
I20260709 12:26:09.701499 25800 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:09.654649 32571 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:09.635627 32717 raft_consensus.cc:2749] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:26:09.636891 32651 consensus_queue.cc:1048] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.064s
I20260709 12:26:09.716195 32611 raft_consensus.cc:2749] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:09.729873   333 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 23 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:09.655545   334 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:09.793057 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:09.763516   334 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:09.820216   348 consensus_queue.cc:1059] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: INVALID_TERM, Last received: 23.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260709 12:26:09.821691   399 raft_consensus.cc:3055] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:26:09.822171   399 raft_consensus.cc:740] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:26:09.823215   399 consensus_queue.cc:260] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 25.20, Last appended by leader: 20, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:09.831887   399 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:26:09.836156 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 72334.7us
I20260709 12:26:09.846208 25686 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:26:09.846467 26402 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:26:09.846798 25686 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:26:09.836088 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 95155.9us
I20260709 12:26:09.852929 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:09.893417 25726 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:09.912210 25686 raft_consensus.cc:2468] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 23.
W20260709 12:26:09.920910 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 49834.1us
I20260709 12:26:09.948410 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:09.950680 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:09.952940 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 23 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:09.955053 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e535a01d34654e31ac7826205390f938" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:26:09.922537 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 67492.4us
I20260709 12:26:09.852682   414 raft_consensus.cc:2749] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:09.963806 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:09.968465 25837 raft_consensus.cc:2468] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 22.
I20260709 12:26:09.969460   407 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:26:09.976962 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:09.977761 25833 raft_consensus.cc:3060] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:09.972977 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:09.984200 25800 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:09.920336 32550 consensus_queue.cc:1048] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.064s
I20260709 12:26:09.982110   391 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:09.990343   348 raft_consensus.cc:2749] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:26:10.093190 32286 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.091s	sys 0.111s
W20260709 12:26:10.093667 32286 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.091s	sys 0.111s
I20260709 12:26:09.981591   407 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:10.013684 32552 raft_consensus.cc:2749] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:10.047585   391 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:26:10.055734   442 log.cc:927] Time spent T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
W20260709 12:26:10.141238   377 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.002s	sys 0.025s
W20260709 12:26:10.155529   377 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.002s	sys 0.026s
W20260709 12:26:10.188345 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 295035us
I20260709 12:26:10.163745   348 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:10.191977   348 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:10.215190 25726 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:10.193655   305 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:10.235006   399 raft_consensus.cc:2749] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:26:10.243744 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 274163us
I20260709 12:26:10.227648   305 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:26:10.256300 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 273163us
W20260709 12:26:10.259507 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 110267us
W20260709 12:26:10.304817 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 153795us
I20260709 12:26:10.309819 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:10.311710 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:10.320235 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:10.312754 25685 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 23.
I20260709 12:26:10.321007 25763 raft_consensus.cc:2393] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 23: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
W20260709 12:26:10.322896   467 log.cc:927] Time spent T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
W20260709 12:26:10.323247   469 log.cc:927] Time spent T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 12:26:10.308090   470 log.cc:927] Time spent T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:26:10.328649   348 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:10.319734 25833 raft_consensus.cc:2468] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 19.
I20260709 12:26:10.341495 26402 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:26:10.312404   391 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:10.346861 25685 raft_consensus.cc:1275] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:26:10.335497 32215 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:10.358495   481 log.cc:927] Time spent T 00000000000000000000000000000000 P 496fd6924b624e77b03ccfd15653d47b: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:26:10.351320   377 raft_consensus.cc:2804] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 12:26:10.359345   471 log.cc:927] Time spent T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 12:26:10.361832   305 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:10.359539   377 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:26:10.364655   377 raft_consensus.cc:3060] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:10.351682 32215 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:10.352356   407 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:10.370395 32215 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:10.370501 25801 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:26:10.372320   391 raft_consensus.cc:2804] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:26:10.372706   391 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:10.373163   391 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:10.373605 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:10.374199 25763 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 23.
I20260709 12:26:10.379349   377 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:10.381496   377 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 22 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:10.384716 25649 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:26:10.385666   380 raft_consensus.cc:2804] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:26:10.386052   380 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:10.386402   380 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:10.406009 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:10.415647 25650 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:10.417430 25837 raft_consensus.cc:1275] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 12:26:10.422693 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 83696.4us
I20260709 12:26:10.423658 25726 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a
W20260709 12:26:10.431658 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 83138.8us
I20260709 12:26:10.419206   322 raft_consensus.cc:2749] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:10.434460 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:10.431962   400 raft_consensus.cc:2804] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:26:10.445602   400 raft_consensus.cc:697] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 23 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:26:10.446559   400 consensus_queue.cc:237] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 21.10, Last appended by leader: 10, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:26:10.435460 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 54393.3us
I20260709 12:26:10.464841 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:10.475782 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:10.476697 25677 raft_consensus.cc:2468] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 18.
I20260709 12:26:10.477653 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:10.479955 26435 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:10.481317 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:26:10.482494 25677 raft_consensus.cc:2393] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 22: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:26:10.480587 26435 raft_consensus.cc:2468] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 18.
I20260709 12:26:10.485338 32594 consensus_queue.cc:1048] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.010s
W20260709 12:26:10.503017   468 log.cc:927] Time spent T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.277s	user 0.004s	sys 0.000s
I20260709 12:26:10.507103   391 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:10.523242 25726 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:26:10.527755 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:10.480243 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:10.542343 25830 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:44194
I20260709 12:26:10.542948 25830 raft_consensus.cc:606] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 14 LEADER]: Received request to transfer leadership
I20260709 12:26:10.545329 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:10.546538 25759 raft_consensus.cc:1275] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:26:10.547771 25834 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 23.
I20260709 12:26:10.541868 32215 raft_consensus.cc:2804] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:10.574437 25828 raft_consensus.cc:2468] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 22.
W20260709 12:26:10.576328 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 45586.6us
I20260709 12:26:10.544804   485 consensus_queue.cc:1048] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 12:26:10.578497 32215 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:10.606220 26402 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:26:10.612957 32611 raft_consensus.cc:493] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:26:10.613765 32611 raft_consensus.cc:515] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:10.604029 32571 consensus_queue.cc:1048] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 12:26:10.607652 32215 raft_consensus.cc:3060] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:10.632562   369 raft_consensus.cc:2804] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 22 FOLLOWER]: Leader election won for term 22
W20260709 12:26:10.667495   498 log.cc:927] Time spent T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 12:26:10.668678   495 log.cc:927] Time spent T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:26:10.669132   391 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 23 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:26:10.672834   496 log.cc:927] Time spent T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 12:26:10.685971   499 log.cc:927] Time spent T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 12:26:10.706281 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:26:10.702536 32529 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:10.709239   303 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:10.722608 32529 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:10.722694   303 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:10.725069   303 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:10.725183 32529 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:10.718618 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:26:10.697764   369 raft_consensus.cc:697] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 22 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:26:10.722059   491 raft_consensus.cc:993] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a: : Instructing follower 6e673265293d4e9a937dc45150aeb1b8 to start an election
I20260709 12:26:10.728118 25758 raft_consensus.cc:2393] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 23: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
I20260709 12:26:10.730778 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:10.736510 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 22 candidate_status { last_received { term: 21 index: 10 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:10.737196 25677 raft_consensus.cc:2368] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 22. Current term is 23.
I20260709 12:26:10.722103   380 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:10.740477 25801 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:10.740964 25679 raft_consensus.cc:2393] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 24: Already voted for candidate f82778701b464892aab92a752ed7ffdc in this term.
I20260709 12:26:10.740829 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:10.741573 25758 raft_consensus.cc:2468] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 17.
I20260709 12:26:10.741815   380 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 24 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:10.743553 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:10.743976 25649 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:26:10.744139 25834 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:10.745497 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:26:10.746075 25758 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:10.748487 25801 leader_election.cc:400] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 22 pre-election: Vote denied by peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) with higher term. Message: Invalid argument: T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 22. Current term is 23.
I20260709 12:26:10.749037 25801 leader_election.cc:403] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:10.751070   391 raft_consensus.cc:3060] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Advancing to term 23
I20260709 12:26:10.754925   369 consensus_queue.cc:237] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:10.749873   380 raft_consensus.cc:2804] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:10.764570   380 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:10.765183   380 raft_consensus.cc:3060] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:10.769398 25758 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 24.
I20260709 12:26:10.774008 25834 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 24.
I20260709 12:26:10.770565 25649 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:26:10.778029   324 raft_consensus.cc:2804] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:26:10.778563   324 raft_consensus.cc:697] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 24 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:26:10.779606   324 consensus_queue.cc:237] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:10.780701 32611 leader_election.cc:290] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:10.774911   390 raft_consensus.cc:2749] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 24 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:26:10.785825 26433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:10.790802 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:10.791576 26431 raft_consensus.cc:2393] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 17: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:26:10.793748   476 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:10.794246   476 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:10.794656   491 raft_consensus.cc:1081] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 14 LEADER]: Signalling peer 6e673265293d4e9a937dc45150aeb1b8 to start an election
I20260709 12:26:10.799448 25726 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:10.800155   476 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:10.801663 25762 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:53460
I20260709 12:26:10.802258 25762 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:10.802606 25762 raft_consensus.cc:3060] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:10.803056   490 raft_consensus.cc:2749] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:26:10.797693 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de96c5816bc14e3cb8f32ff10dc52a61" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:10.812271 25800 leader_election.cc:304] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:10.813113   390 raft_consensus.cc:2749] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:10.815503 25834 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:44194
I20260709 12:26:10.816187 25834 raft_consensus.cc:606] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 14 LEADER]: Received request to transfer leadership
W20260709 12:26:10.817703 25569 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for c87d777e7d64471f988b07272bf2441c already in progress [suppressed 2 similar messages]
I20260709 12:26:10.828323 25679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:10.819413 25762 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:10.831223 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:10.832322 25763 raft_consensus.cc:2410] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 12:26:10.827093   391 raft_consensus.cc:2749] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349) with higher term. Message: Invalid argument: T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for earlier term 22. Current term is 23.
I20260709 12:26:10.851082 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:26:10.851679 25685 raft_consensus.cc:3060] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:10.853299 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:10.853930 25834 raft_consensus.cc:3055] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:10.854254 25834 raft_consensus.cc:740] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:26:10.855115 25834 consensus_queue.cc:260] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:10.857143 25762 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:10.859424 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:26:10.860050 26431 raft_consensus.cc:3060] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:10.845865 32215 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:10.870350 32215 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:10.871135 26431 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 15.
I20260709 12:26:10.872865   323 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:10.873524   323 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:10.889861 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:26:10.872895 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:26:10.890883 25677 raft_consensus.cc:3060] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:10.890596 26431 raft_consensus.cc:3060] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:10.878960 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:10.879276 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:10.893270 25833 raft_consensus.cc:2410] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc for term 23 because replica has last-logged OpId of term: 21 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 13.
I20260709 12:26:10.888099 25834 raft_consensus.cc:3060] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:10.889245 25685 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 15.
I20260709 12:26:10.894846 25726 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:26:10.875888   323 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:10.901546 25650 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:10.903321 25830 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "a866ff967d964388a6f0dff7fd43df89"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:26:10.903905 25830 raft_consensus.cc:606] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Received request to transfer leadership to TS a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:10.904258 25830 raft_consensus.cc:614] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:10.901047   490 raft_consensus.cc:2804] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:10.909282 25834 raft_consensus.cc:2468] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 15.
I20260709 12:26:10.905752   323 raft_consensus.cc:2749] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:26:10.911994   506 log.cc:927] Time spent T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 12:26:10.908458   490 raft_consensus.cc:697] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 15 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:26:10.914070   490 consensus_queue.cc:237] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:10.918366   380 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:10.919631 25679 raft_consensus.cc:2410] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 12:26:10.921768 26402 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:10.922917 32550 raft_consensus.cc:2749] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:10.927863   380 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:10.929154 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:26:10.930616 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:26:10.932090 25761 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
mode: GRACEFUL
new_leader_uuid: "a866ff967d964388a6f0dff7fd43df89"
 from {username='slave'} at 127.0.0.1:47510
I20260709 12:26:10.931495 26430 raft_consensus.cc:2393] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f82778701b464892aab92a752ed7ffdc in current term 17: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:26:10.932791 25761 raft_consensus.cc:606] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Received request to transfer leadership to TS a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:10.933156 25761 raft_consensus.cc:614] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:10.910527 26431 raft_consensus.cc:2468] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 19.
I20260709 12:26:10.939136 25726 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:26:10.950363   400 raft_consensus.cc:2804] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:10.951512   400 raft_consensus.cc:697] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 19 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:26:10.952632   400 consensus_queue.cc:237] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:10.951434 25831 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:44194
I20260709 12:26:10.955237 25831 raft_consensus.cc:606] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Received request to transfer leadership
I20260709 12:26:10.955564 25831 raft_consensus.cc:614] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:10.963440 25677 raft_consensus.cc:2468] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 19.
I20260709 12:26:10.965701 25760 raft_consensus.cc:2468] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 17.
I20260709 12:26:10.966950 25649 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:10.974982 25834 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a8fa32386b77471b923cc6c4241570d5"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "a866ff967d964388a6f0dff7fd43df89"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:26:10.975636 25834 raft_consensus.cc:606] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Received request to transfer leadership to TS a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:10.976022 25834 raft_consensus.cc:614] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:10.976887   324 raft_consensus.cc:2804] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:10.981396   324 raft_consensus.cc:697] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 17 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:26:10.984905   324 consensus_queue.cc:237] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:11.000041 25677 raft_consensus.cc:1275] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 23 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 20 index: 9. Preceding OpId from leader: term: 23 index: 11. (index mismatch)
I20260709 12:26:11.020825 32215 consensus_queue.cc:1048] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:11.066231 25581 catalog_manager.cc:5697] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 11 to 16, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 16 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:11.070813 25831 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "f82778701b464892aab92a752ed7ffdc"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:26:11.078135 25831 raft_consensus.cc:606] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Received request to transfer leadership to TS f82778701b464892aab92a752ed7ffdc
I20260709 12:26:11.078474 25831 raft_consensus.cc:614] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:11.087677 25831 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "a866ff967d964388a6f0dff7fd43df89"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:26:11.088320 25831 raft_consensus.cc:606] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Received request to transfer leadership to TS a866ff967d964388a6f0dff7fd43df89
W20260709 12:26:11.088498 25576 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41232 (request call id 393) took 17080 ms (client timeout 15000 ms). Trace:
I20260709 12:26:11.088687 25831 raft_consensus.cc:614] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:11.096796 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:26:11.098604 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:11.098165 25581 catalog_manager.cc:5697] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 15 to 20, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 20 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:11.099411 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:11.112461 25676 tablet_service.cc:1558] Processing DeleteTablet for tablet 237622cb71464b3ca091560bd9d8c06b with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 6 (current committed config index is 8)) from {username='slave'} at 127.0.0.1:40214
I20260709 12:26:11.116154 25581 catalog_manager.cc:5697] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:11.130653 25581 catalog_manager.cc:5697] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 11 to 12, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 12 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:11.149322 25581 catalog_manager.cc:5697] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 11 to 14, leader changed from a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 14 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:11.154289 25569 catalog_manager.cc:5028] TS f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): tablet 237622cb71464b3ca091560bd9d8c06b (table test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]) successfully deleted
I20260709 12:26:11.155331 25831 raft_consensus.cc:1275] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 23 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 21 index: 10. Preceding OpId from leader: term: 23 index: 11. (index mismatch)
W20260709 12:26:11.156937 25632 auto_rebalancer.cc:893] Removing replace marker failed: Replica 5cccf20a8bff46dba6601f241d172b8a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
W20260709 12:26:11.157924 25632 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 12:26:11.157788 32215 consensus_queue.cc:1048] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:26:11.158241 25632 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 12:26:11.151628 25581 catalog_manager.cc:5697] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:11.175523 25583 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41224 (request call id 336) took 70479 ms (client timeout 15000 ms). Trace:
W20260709 12:26:11.176013 25583 rpcz_store.cc:269] 0709 12:25:00.669242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.669491 (+   249us) service_pool.cc:224] Handling call
0709 12:26:11.146461 (+70476970us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1538632,"reported_tablets":46}
W20260709 12:26:11.093971 25576 rpcz_store.cc:269] 0709 12:25:54.008156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:54.019764 (+ 11608us) service_pool.cc:224] Handling call
0709 12:26:11.088399 (+17068635us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:08.022421 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:08.023288 (+   867us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:08.023362 (+    74us) write_op.cc:435] Acquired schema lock
0709 12:26:08.023390 (+    28us) tablet.cc:662] Decoding operations
0709 12:26:08.307478 (+284088us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:08.307633 (+   155us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:08.307677 (+    44us) tablet.cc:685] Acquiring locks for 30 operations
0709 12:26:08.310735 (+  3058us) tablet.cc:701] Row locks acquired
0709 12:26:08.310795 (+    60us) write_op.cc:260] PREPARE: finished
0709 12:26:08.311049 (+   254us) write_op.cc:270] Start()
0709 12:26:08.311244 (+   195us) write_op.cc:276] Timestamp: P: 1783599968310962 usec, L: 0
0709 12:26:08.311293 (+    49us) op_driver.cc:348] REPLICATION: starting
0709 12:26:08.374564 (+ 63271us) log.cc:844] Serialized 11966 byte log entry
0709 12:26:08.822990 (+448426us) op_driver.cc:464] REPLICATION: finished
0709 12:26:08.969165 (+146175us) write_op.cc:301] APPLY: starting
0709 12:26:08.969285 (+   120us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:09.354768 (+385483us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:09.354921 (+   153us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:10.091716 (+736795us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:10.092237 (+   521us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=60,key_file_lookups=60,delta_file_lookups=60,mrs_lookups=0
0709 12:26:10.092299 (+    62us) write_op.cc:312] APPLY: finished
0709 12:26:10.092941 (+   642us) log.cc:844] Serialized 260 byte log entry
0709 12:26:10.241788 (+148847us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:10.246562 (+  4774us) write_op.cc:454] Released schema lock
0709 12:26:10.246664 (+   102us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:10.310128 (+ 63464us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:10.313057 (+  2929us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":84910,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":97846,"apply.run_cpu_time_us":61744,"apply.run_wall_time_us":1310114,"cfile_cache_hit":122,"cfile_cache_hit_bytes":129527,"num_ops":30,"prepare.queue_time_us":376583,"prepare.run_cpu_time_us":48276,"prepare.run_wall_time_us":467553,"raft.queue_time_us":160100,"raft.run_cpu_time_us":7817,"raft.run_wall_time_us":175819,"replication_time_us":457100,"thread_start_us":624887,"threads_started":5,"wal-append.queue_time_us":348476,"wal-append.run_cpu_time_us":10241,"wal-append.run_wall_time_us":1073548}]]}
I20260709 12:26:11.177219 25581 catalog_manager.cc:5697] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 6 to 12. New cstate: current_term: 12 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:11.180663 32764 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:11.181262 32764 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:11.183490 32764 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:11.185201 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:11.185896 25763 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 26.
I20260709 12:26:11.187063 26401 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:26:11.185243 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:11.188593 25834 raft_consensus.cc:2393] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 26: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:26:11.189297 32764 raft_consensus.cc:2804] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:26:11.189708 32764 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:11.190097 32764 raft_consensus.cc:3060] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:26:11.198817 32764 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:11.201831 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:11.202250 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:26:11.202586 25834 raft_consensus.cc:2393] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 26: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:26:11.179677 25581 catalog_manager.cc:5697] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 9 to 10, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 10 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:11.209580 25581 catalog_manager.cc:5697] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 8 to 9, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 9 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:11.211483 25834 raft_consensus.cc:1275] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 24 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 12:26:11.221702 32764 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 26 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:11.225869   323 consensus_queue.cc:1048] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:11.234591 25833 raft_consensus.cc:1275] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:26:11.237191   369 consensus_queue.cc:1048] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:26:11.243534 25763 raft_consensus.cc:2468] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 26.
I20260709 12:26:11.247035 26401 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a
I20260709 12:26:11.261354   485 raft_consensus.cc:2804] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:26:11.261926   485 raft_consensus.cc:697] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 26 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:26:11.262758   485 consensus_queue.cc:237] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 25.20, Last appended by leader: 20, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:11.286033 25683 raft_consensus.cc:1275] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 12:26:11.287519 25762 raft_consensus.cc:1275] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 24 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 12:26:11.290300   369 consensus_queue.cc:1048] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:26:11.291349   322 consensus_queue.cc:1048] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:11.303717 26431 raft_consensus.cc:1275] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:26:11.304804 32529 raft_consensus.cc:493] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:11.305414 32529 raft_consensus.cc:515] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:11.306788   400 consensus_queue.cc:1048] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:11.313702 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 27 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:11.314622 25762 raft_consensus.cc:2410] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a for term 27 because replica has last-logged OpId of term: 25 index: 20, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 19.
I20260709 12:26:11.313702 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a278e46eb5d49edab4ba69303448a66" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 27 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:11.317265 25801 leader_election.cc:304] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:11.312387 32529 leader_election.cc:290] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:11.326516   502 raft_consensus.cc:2749] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:26:11.385807 25683 raft_consensus.cc:1275] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:26:11.393392   400 consensus_queue.cc:1048] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:26:11.420305 26439 raft_consensus.cc:1275] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:26:11.422775 32651 consensus_queue.cc:1048] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:11.481802 25831 raft_consensus.cc:1275] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:26:11.483359   400 consensus_queue.cc:1048] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:11.526783 25683 raft_consensus.cc:1275] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:26:11.528389   400 consensus_queue.cc:1048] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:11.566952 25575 catalog_manager.cc:5697] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 20 to 22, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 22 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } }
I20260709 12:26:11.577397 25676 tablet_service.cc:1558] Processing DeleteTablet for tablet 237622cb71464b3ca091560bd9d8c06b with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 6 (current committed config index is 8)) from {username='slave'} at 127.0.0.1:40214
W20260709 12:26:11.577819 25581 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41224 (request call id 337) took 44837 ms (client timeout 15000 ms). Trace:
I20260709 12:26:11.581141 25569 catalog_manager.cc:5028] TS f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): tablet 237622cb71464b3ca091560bd9d8c06b (table test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]) successfully deleted
W20260709 12:26:11.578698 25581 rpcz_store.cc:269] 0709 12:25:26.740461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:26.740626 (+   165us) service_pool.cc:224] Handling call
0709 12:26:11.577752 (+44837126us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:11.308039 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:11.353061 (+ 45022us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:11.357152 (+  4091us) write_op.cc:435] Acquired schema lock
0709 12:26:11.358791 (+  1639us) tablet.cc:662] Decoding operations
0709 12:26:11.364384 (+  5593us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:11.364441 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:11.364469 (+    28us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:26:11.367753 (+  3284us) tablet.cc:701] Row locks acquired
0709 12:26:11.367976 (+   223us) write_op.cc:260] PREPARE: finished
0709 12:26:11.368165 (+   189us) write_op.cc:270] Start()
0709 12:26:11.368283 (+   118us) write_op.cc:276] Timestamp: P: 1783599971368104 usec, L: 0
0709 12:26:11.368304 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:26:11.369327 (+  1023us) log.cc:844] Serialized 3638 byte log entry
0709 12:26:11.442817 (+ 73490us) op_driver.cc:464] REPLICATION: finished
0709 12:26:11.476576 (+ 33759us) write_op.cc:301] APPLY: starting
0709 12:26:11.476664 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:11.486039 (+  9375us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:11.486146 (+   107us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:11.493380 (+  7234us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:11.497959 (+  4579us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 12:26:11.498019 (+    60us) write_op.cc:312] APPLY: finished
0709 12:26:11.498346 (+   327us) log.cc:844] Serialized 89 byte log entry
0709 12:26:11.499230 (+   884us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:11.499369 (+   139us) write_op.cc:454] Released schema lock
0709 12:26:11.499425 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:11.551544 (+ 52119us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:11.561225 (+  9681us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":13191,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":33522,"apply.run_cpu_time_us":12748,"apply.run_wall_time_us":48703,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41747,"num_ops":9,"prepare.queue_time_us":10191,"prepare.run_cpu_time_us":5855,"prepare.run_wall_time_us":72800,"raft.queue_time_us":54136,"raft.run_cpu_time_us":15237,"raft.run_wall_time_us":37002,"replication_time_us":74349,"spinlock_wait_cycles":6912,"thread_start_us":101528,"threads_started":4,"wal-append.queue_time_us":14648}]]}
I20260709 12:26:11.590242 25762 raft_consensus.cc:1275] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:26:11.589475 25575 catalog_manager.cc:5697] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 18 to 22. New cstate: current_term: 22 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:11.591300 25575 catalog_manager.cc:5697] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 18 to 21, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 21 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } }
I20260709 12:26:11.592224 26431 raft_consensus.cc:1275] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:26:11.593353   407 consensus_queue.cc:1048] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:26:11.595754   380 consensus_queue.cc:1048] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:26:11.599467 25575 catalog_manager.cc:5697] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 10 to 12, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 12 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:11.601468 25575 catalog_manager.cc:5697] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 14 to 20, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 20 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:11.603313 25575 catalog_manager.cc:5697] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 8 to 18, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 18 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:11.628345 25575 catalog_manager.cc:5697] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 8 to 15, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 15 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:11.648233 25575 catalog_manager.cc:5697] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 16 to 22, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 22 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:11.650137 25575 catalog_manager.cc:5697] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 20 to 26, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 26 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:11.649199 25763 raft_consensus.cc:1275] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 26 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 25 index: 20. Preceding OpId from leader: term: 26 index: 21. (index mismatch)
I20260709 12:26:11.652025 25575 catalog_manager.cc:5697] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 17 to 18, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 18 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:11.652877   485 consensus_queue.cc:1048] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.001s
I20260709 12:26:11.654081 25575 catalog_manager.cc:5697] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 13 to 22, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 22 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } }
I20260709 12:26:11.655860 25575 catalog_manager.cc:5697] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 14 to 17, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 17 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:11.657652 25575 catalog_manager.cc:5697] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 8 to 19, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 19 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:11.659955 25575 catalog_manager.cc:5697] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 16 to 19, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 19 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:11.662048 25575 catalog_manager.cc:5697] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 8 to 16. New cstate: current_term: 16 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:11.663655 25575 catalog_manager.cc:5697] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 17 to 18, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 18 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:11.666198 25575 catalog_manager.cc:5697] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 19 to 22, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 22 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:11.671296 25575 catalog_manager.cc:5697] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 12 to 17, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 17 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } }
I20260709 12:26:11.680858 25575 catalog_manager.cc:5697] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 15 to 16, leader changed from a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 16 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:11.691805 25575 catalog_manager.cc:5697] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 18 to 20, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 20 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } }
I20260709 12:26:11.709686 25575 catalog_manager.cc:5697] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 10 to 18. New cstate: current_term: 18 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:11.716567 25834 raft_consensus.cc:1275] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 26 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 23 index: 19. Preceding OpId from leader: term: 26 index: 21. (index mismatch)
I20260709 12:26:11.717341 25575 catalog_manager.cc:5697] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 13 to 14, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 14 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:11.718225 32764 consensus_queue.cc:1048] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 19, Time since last communication: 0.000s
I20260709 12:26:11.718983 25575 catalog_manager.cc:5697] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 12 to 17, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 17 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:11.742890 25575 catalog_manager.cc:5697] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 10 to 16, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 16 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } }
I20260709 12:26:11.744753 25575 catalog_manager.cc:5697] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 3 to 19. New cstate: current_term: 19 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:11.748354 25575 catalog_manager.cc:5697] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 14 to 18, leader changed from a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 18 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:11.750293 25575 catalog_manager.cc:5697] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 8 to 15, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 15 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:11.762281 25575 catalog_manager.cc:5697] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 15 to 22. New cstate: current_term: 22 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:11.764971 25575 catalog_manager.cc:5697] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 10 to 18, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 18 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:11.766229 25575 catalog_manager.cc:5697] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 9 to 17, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 17 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } }
I20260709 12:26:11.767381 25575 catalog_manager.cc:5697] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 9 to 18, leader changed from a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 18 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:11.772603 25575 catalog_manager.cc:5697] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 9 to 13, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 13 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:11.774516 25575 catalog_manager.cc:5697] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 16 to 18, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 18 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:11.780009 25575 catalog_manager.cc:5697] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 12 to 19, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 19 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } }
I20260709 12:26:12.052979 25579 catalog_manager.cc:5697] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 14 to 17, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 17 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:12.051891 25575 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41224 (request call id 339) took 1694 ms. Trace:
I20260709 12:26:12.091552 25579 catalog_manager.cc:5697] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 14 to 17, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 17 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:12.105860 25579 catalog_manager.cc:5697] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 14 to 18, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 18 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:12.132292 25579 catalog_manager.cc:5697] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 16 to 19, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 19 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:12.083527 25575 rpcz_store.cc:276] 0709 12:26:10.357346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:10.360150 (+  2804us) service_pool.cc:224] Handling call
0709 12:26:12.051788 (+1691638us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:11.801766 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:11.802337 (+   571us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:11.802379 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:26:11.803092 (+   713us) tablet.cc:662] Decoding operations
0709 12:26:11.809848 (+  6756us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:11.809914 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:11.809949 (+    35us) tablet.cc:685] Acquiring locks for 34 operations
0709 12:26:11.812514 (+  2565us) tablet.cc:701] Row locks acquired
0709 12:26:11.812534 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:26:11.812686 (+   152us) write_op.cc:270] Start()
0709 12:26:11.812804 (+   118us) write_op.cc:276] Timestamp: P: 1783599971812634 usec, L: 0
0709 12:26:11.812826 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:26:11.813522 (+   696us) log.cc:844] Serialized 13404 byte log entry
0709 12:26:11.817034 (+  3512us) op_driver.cc:464] REPLICATION: finished
0709 12:26:11.817496 (+   462us) write_op.cc:301] APPLY: starting
0709 12:26:11.817576 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:11.901530 (+ 83954us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:11.901631 (+   101us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:11.962880 (+ 61249us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:11.963347 (+   467us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=68,key_file_lookups=68,delta_file_lookups=68,mrs_lookups=0
0709 12:26:11.963431 (+    84us) write_op.cc:312] APPLY: finished
0709 12:26:11.976162 (+ 12731us) log.cc:844] Serialized 292 byte log entry
0709 12:26:11.976387 (+   225us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:11.976690 (+   303us) write_op.cc:454] Released schema lock
0709 12:26:11.976775 (+    85us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:11.984916 (+  8141us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:11.984947 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":135626,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":247,"apply.run_cpu_time_us":40633,"apply.run_wall_time_us":167167,"cfile_cache_hit":136,"cfile_cache_hit_bytes":142120,"num_ops":34,"prepare.queue_time_us":135,"prepare.run_cpu_time_us":7432,"prepare.run_wall_time_us":28992,"replication_time_us":4071}]]}
I20260709 12:26:12.168599 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:12.268664 25583 catalog_manager.cc:5697] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 17 to 19, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 19 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:12.274138 25583 catalog_manager.cc:5697] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 14 to 16, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 16 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:12.285355 25583 catalog_manager.cc:5697] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 19 to 20, leader changed from a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 20 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:12.287395 25583 catalog_manager.cc:5697] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 16 to 20, leader changed from a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 20 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:12.311026 25583 catalog_manager.cc:5697] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:12.313287 25583 catalog_manager.cc:5697] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 13 to 14, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 14 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
W20260709 12:26:12.322872 25579 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52974 (request call id 259) took 19728 ms (client timeout 15000 ms). Trace:
W20260709 12:26:12.323509 25579 rpcz_store.cc:269] 0709 12:25:52.594931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:52.595222 (+   291us) service_pool.cc:224] Handling call
0709 12:26:12.322732 (+19727510us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:12.137082 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:12.137747 (+   665us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:12.137790 (+    43us) write_op.cc:435] Acquired schema lock
0709 12:26:12.137814 (+    24us) tablet.cc:662] Decoding operations
0709 12:26:12.138513 (+   699us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:12.138585 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:12.138623 (+    38us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:26:12.139148 (+   525us) tablet.cc:701] Row locks acquired
0709 12:26:12.139171 (+    23us) write_op.cc:260] PREPARE: finished
0709 12:26:12.139378 (+   207us) write_op.cc:270] Start()
0709 12:26:12.139513 (+   135us) write_op.cc:276] Timestamp: P: 1783599972139315 usec, L: 0
0709 12:26:12.139540 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:26:12.140274 (+   734us) log.cc:844] Serialized 1698 byte log entry
0709 12:26:12.145464 (+  5190us) op_driver.cc:464] REPLICATION: finished
0709 12:26:12.147929 (+  2465us) write_op.cc:301] APPLY: starting
0709 12:26:12.148016 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:12.150306 (+  2290us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:12.150399 (+    93us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:12.152858 (+  2459us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:12.153065 (+   207us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 12:26:12.153105 (+    40us) write_op.cc:312] APPLY: finished
0709 12:26:12.153324 (+   219us) log.cc:844] Serialized 49 byte log entry
0709 12:26:12.154372 (+  1048us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:12.154477 (+   105us) write_op.cc:454] Released schema lock
0709 12:26:12.154522 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:12.186374 (+ 31852us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:12.186412 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":19550,"reported_tablets":42,"child_traces":[["op",{"apply.queue_time_us":2212,"apply.run_cpu_time_us":6158,"apply.run_wall_time_us":38408,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16720,"num_ops":4,"prepare.queue_time_us":125,"prepare.run_cpu_time_us":3536,"prepare.run_wall_time_us":17084,"replication_time_us":5781}]]}
I20260709 12:26:12.350576 25583 catalog_manager.cc:5697] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 15 to 17, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 17 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:12.362257 25583 catalog_manager.cc:5697] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 18 to 21, leader changed from a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 21 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:12.377048 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 56497.8us
W20260709 12:26:12.378729 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 52441.2us
I20260709 12:26:12.381824 25583 catalog_manager.cc:5697] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 13 to 20, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 20 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:12.385411 25583 catalog_manager.cc:5697] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 17 to 18, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 18 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:12.386366 25831 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3767151a5d4345659810a40ea7f44873"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:26:12.386951 25831 raft_consensus.cc:606] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 20 LEADER]: Received request to transfer leadership to TS 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:26:12.386729 25583 catalog_manager.cc:5697] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 16 to 20. New cstate: current_term: 20 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:12.387974 25583 catalog_manager.cc:5697] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 17 to 18, leader changed from a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 18 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:12.389209 25583 catalog_manager.cc:5697] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:12.392402 25583 catalog_manager.cc:5697] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 22 to 25. New cstate: current_term: 25 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:12.396056 25583 catalog_manager.cc:5697] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 17 to 19, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 19 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:12.406286 25583 catalog_manager.cc:5697] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 14 to 15, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 15 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:12.429504 25833 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "a866ff967d964388a6f0dff7fd43df89"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:26:12.430153 25833 raft_consensus.cc:606] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 14 LEADER]: Received request to transfer leadership to TS a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:12.449255 25833 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:26:12.449930 25833 raft_consensus.cc:606] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Received request to transfer leadership to TS 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:26:12.450313 25833 raft_consensus.cc:614] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:12.468248 25833 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a22f8565191e471dbe96772477b84e36"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:26:12.469043 25833 raft_consensus.cc:606] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Received request to transfer leadership to TS 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:26:12.469488 25833 raft_consensus.cc:614] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:12.478156 25833 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "a866ff967d964388a6f0dff7fd43df89"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:26:12.478797 25833 raft_consensus.cc:606] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 18 LEADER]: Received request to transfer leadership to TS a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:12.483143 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:26:12.486514 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:12.487278 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:12.499634 25580 catalog_manager.cc:5697] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 17 to 21, leader changed from a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 21 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:12.513866 25583 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41232 (request call id 394) took 1969 ms. Trace:
I20260709 12:26:12.514389 25583 rpcz_store.cc:276] 0709 12:26:10.544174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:11.177120 (+632946us) service_pool.cc:224] Handling call
0709 12:26:12.513798 (+1336678us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:12.415221 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:12.415720 (+   499us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:12.415756 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:26:12.415773 (+    17us) tablet.cc:662] Decoding operations
0709 12:26:12.417064 (+  1291us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:12.417122 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:12.417147 (+    25us) tablet.cc:685] Acquiring locks for 16 operations
0709 12:26:12.418256 (+  1109us) tablet.cc:701] Row locks acquired
0709 12:26:12.418274 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:26:12.418417 (+   143us) write_op.cc:270] Start()
0709 12:26:12.418531 (+   114us) write_op.cc:276] Timestamp: P: 1783599972418368 usec, L: 0
0709 12:26:12.418556 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:26:12.419228 (+   672us) log.cc:844] Serialized 6330 byte log entry
0709 12:26:12.421842 (+  2614us) op_driver.cc:464] REPLICATION: finished
0709 12:26:12.422267 (+   425us) write_op.cc:301] APPLY: starting
0709 12:26:12.422345 (+    78us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:12.433235 (+ 10890us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:12.433330 (+    95us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:12.445374 (+ 12044us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:12.445648 (+   274us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0709 12:26:12.445693 (+    45us) write_op.cc:312] APPLY: finished
0709 12:26:12.446047 (+   354us) log.cc:844] Serialized 148 byte log entry
0709 12:26:12.446828 (+   781us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:12.446992 (+   164us) write_op.cc:454] Released schema lock
0709 12:26:12.447048 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:12.462875 (+ 15827us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:12.462905 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":87902,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":245,"apply.run_cpu_time_us":18449,"apply.run_wall_time_us":40148,"cfile_cache_hit":64,"cfile_cache_hit_bytes":66880,"num_ops":16,"prepare.queue_time_us":104,"prepare.run_cpu_time_us":4294,"prepare.run_wall_time_us":12608,"replication_time_us":3175}]]}
I20260709 12:26:12.531265 25575 catalog_manager.cc:5697] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 16 to 19, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 19 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:12.546082 25575 catalog_manager.cc:5697] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 14 to 15, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 15 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:12.549113 32552 raft_consensus.cc:993] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a: : Instructing follower a866ff967d964388a6f0dff7fd43df89 to start an election
I20260709 12:26:12.549651 32552 raft_consensus.cc:1081] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 18 LEADER]: Signalling peer a866ff967d964388a6f0dff7fd43df89 to start an election
I20260709 12:26:12.552935 26439 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780"
dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
 from {username='slave'} at 127.0.0.1:36508
I20260709 12:26:12.553540 26439 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:12.553890 26439 raft_consensus.cc:3060] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:12.570259 25677 consensus_queue.cc:237] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:26:12.548030 25575 catalog_manager.cc:5697] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 14 to 19, leader changed from a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 19 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
W20260709 12:26:12.578366 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 49612.4us
I20260709 12:26:12.582831 25575 catalog_manager.cc:5697] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 15 to 23, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 23 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } }
I20260709 12:26:12.584340 25575 catalog_manager.cc:5697] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 21 to 22, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 22 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:12.585860 25575 catalog_manager.cc:5697] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 16 to 17, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 17 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:12.602051 25575 catalog_manager.cc:5697] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 20 to 24. New cstate: current_term: 24 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:12.603399 26439 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:12.614302 25833 raft_consensus.cc:1275] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:26:12.621649   411 raft_consensus.cc:993] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a: : Instructing follower 6e673265293d4e9a937dc45150aeb1b8 to start an election
I20260709 12:26:12.622339   411 raft_consensus.cc:1081] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 20 LEADER]: Signalling peer 6e673265293d4e9a937dc45150aeb1b8 to start an election
I20260709 12:26:12.630053 25760 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3767151a5d4345659810a40ea7f44873"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:53460
I20260709 12:26:12.630715 25760 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:12.631074 25760 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:12.633178   380 consensus_queue.cc:1048] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:26:12.637158 26439 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349)
W20260709 12:26:12.649806 25650 consensus_peers.cc:597] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc -> Peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Couldn't send request to peer a866ff967d964388a6f0dff7fd43df89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 58ab3e51ccf14577a94774f25ade6cd8. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:12.642315 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: true dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:12.668201 25833 raft_consensus.cc:3055] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:26:12.668568 25833 raft_consensus.cc:740] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:26:12.669407 25833 consensus_queue.cc:260] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 18.17, Last appended by leader: 17, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:12.670670 25833 raft_consensus.cc:3060] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:12.684101 25685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 18 index: 17 } } ignore_live_leader: true dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:26:12.684788 25685 raft_consensus.cc:3060] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:12.691250 25763 raft_consensus.cc:1275] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:26:12.704778   380 consensus_queue.cc:1048] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:12.709107 25833 raft_consensus.cc:2468] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 19.
I20260709 12:26:12.700934 25580 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52974 (request call id 260) took 3186 ms. Trace:
I20260709 12:26:12.710394 26402 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:26:12.712018   539 raft_consensus.cc:2804] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:12.713058   539 raft_consensus.cc:697] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 19 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:26:12.713714 25760 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:12.714196   539 consensus_queue.cc:237] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 18.17, Last appended by leader: 17, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:12.737089 25834 raft_consensus.cc:2955] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index -1 to 13, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:26:12.739946 25760 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 21 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:12.743500 25683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: true dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:26:12.744102 25683 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:12.710187 25580 rpcz_store.cc:276] 0709 12:26:09.514505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:09.514784 (+   279us) service_pool.cc:224] Handling call
0709 12:26:12.700839 (+3186055us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:12.503686 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:12.504260 (+   574us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:12.504314 (+    54us) write_op.cc:435] Acquired schema lock
0709 12:26:12.504334 (+    20us) tablet.cc:662] Decoding operations
0709 12:26:12.506772 (+  2438us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:12.506823 (+    51us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:12.506848 (+    25us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:26:12.507025 (+   177us) tablet.cc:701] Row locks acquired
0709 12:26:12.507043 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:26:12.507183 (+   140us) write_op.cc:270] Start()
0709 12:26:12.507286 (+   103us) write_op.cc:276] Timestamp: P: 1783599972507136 usec, L: 0
0709 12:26:12.507310 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:26:12.507900 (+   590us) log.cc:844] Serialized 539 byte log entry
0709 12:26:12.509908 (+  2008us) op_driver.cc:464] REPLICATION: finished
0709 12:26:12.510329 (+   421us) write_op.cc:301] APPLY: starting
0709 12:26:12.510419 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:12.511153 (+   734us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:12.511239 (+    86us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:12.511904 (+   665us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:12.512089 (+   185us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:26:12.512131 (+    42us) write_op.cc:312] APPLY: finished
0709 12:26:12.512303 (+   172us) log.cc:844] Serialized 25 byte log entry
0709 12:26:12.512472 (+   169us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:12.512551 (+    79us) write_op.cc:454] Released schema lock
0709 12:26:12.512590 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:12.512976 (+   386us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:12.513007 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6306,"reported_tablets":42,"child_traces":[["op",{"apply.queue_time_us":229,"apply.run_cpu_time_us":2599,"apply.run_wall_time_us":2600,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4180,"num_ops":1,"prepare.queue_time_us":117,"prepare.run_cpu_time_us":2486,"prepare.run_wall_time_us":4534,"replication_time_us":2487}]]}
I20260709 12:26:12.727088   543 raft_consensus.cc:2955] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index -1 to 13, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:26:12.748307 25831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: true dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:12.748965 25831 raft_consensus.cc:3055] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:26:12.749258 25831 raft_consensus.cc:740] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:26:12.750053 25831 consensus_queue.cc:260] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:12.756342 25831 raft_consensus.cc:3060] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:12.730031 25685 raft_consensus.cc:2468] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 19.
I20260709 12:26:12.731827 25762 raft_consensus.cc:2955] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index -1 to 13, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:26:12.767884 25683 raft_consensus.cc:2468] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 21.
I20260709 12:26:12.770710 25726 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:26:12.771824   540 raft_consensus.cc:2804] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:26:12.772344   540 raft_consensus.cc:697] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:26:12.773139   540 consensus_queue.cc:237] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:12.794984 25831 raft_consensus.cc:2468] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 21.
I20260709 12:26:12.825385   411 raft_consensus.cc:993] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a: : Instructing follower a866ff967d964388a6f0dff7fd43df89 to start an election
I20260709 12:26:12.825928   411 raft_consensus.cc:1081] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 14 LEADER]: Signalling peer a866ff967d964388a6f0dff7fd43df89 to start an election
I20260709 12:26:12.827827 26439 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7"
dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
 from {username='slave'} at 127.0.0.1:36508
I20260709 12:26:12.828460 26439 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:12.828852 26439 raft_consensus.cc:3060] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:12.854485 25583 catalog_manager.cc:5697] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 25 to 26, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 26 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:12.857862 26439 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:12.870083 25677 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: true dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:26:12.871482 25677 raft_consensus.cc:3060] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:12.870700 26439 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:12.874204 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: true dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:12.874948 25834 raft_consensus.cc:3055] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:12.875260 25834 raft_consensus.cc:740] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:26:12.878970 25834 consensus_queue.cc:260] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:12.880550 25677 raft_consensus.cc:2468] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 15.
I20260709 12:26:12.880601 25834 raft_consensus.cc:3060] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:12.882491 26402 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:26:12.883510   539 raft_consensus.cc:2804] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:12.884183   539 raft_consensus.cc:697] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 15 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:26:12.885296   539 consensus_queue.cc:237] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:12.890962 25834 raft_consensus.cc:2468] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 15.
I20260709 12:26:12.890972 25575 catalog_manager.cc:5697] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc reported cstate change: config changed from index -1 to 13, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New cstate: current_term: 18 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:12.972782 25763 consensus_queue.cc:237] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:26:13.016083 25834 raft_consensus.cc:1275] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:26:13.016211 25677 raft_consensus.cc:1275] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
W20260709 12:26:13.016750 25726 consensus_peers.cc:597] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Couldn't send request to peer a866ff967d964388a6f0dff7fd43df89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: afda1f2e78cc4f799b9bad380ffd3d44. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:13.017661   540 consensus_queue.cc:1048] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:26:13.020917 32651 consensus_queue.cc:1048] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 12:26:13.082767 25577 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41240 (request call id 372) took 40093 ms (client timeout 15000 ms). Trace:
W20260709 12:26:13.083812 25577 rpcz_store.cc:269] 0709 12:25:32.989971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:33.041767 (+ 51796us) service_pool.cc:224] Handling call
0709 12:26:13.082660 (+40040893us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":187621,"reported_tablets":47}
I20260709 12:26:13.090016 25580 catalog_manager.cc:5697] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 18 to 19, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 19 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:13.093293 25583 catalog_manager.cc:5697] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 20 to 21, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 21 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:13.136693 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 43915.7us
I20260709 12:26:13.151021 32651 raft_consensus.cc:2955] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 LEADER]: Committing config change with OpId 22.16: config changed from index -1 to 16, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:26:13.156679 25677 raft_consensus.cc:2955] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Committing config change with OpId 22.16: config changed from index -1 to 16, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
W20260709 12:26:13.163960 25584 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41240 (request call id 373) took 11837 ms (client timeout 15000 ms). Trace:
W20260709 12:26:13.164400 25584 rpcz_store.cc:269] 0709 12:26:01.326304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:01.358729 (+ 32425us) service_pool.cc:224] Handling call
0709 12:26:02.192820 (+834091us) spinlock_profiling.cc:243] Waited 84.3 ms on lock 0x7b5400078854. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99acb090 00007f5d99b69f3a 00007f5d9f91fe9c 00007f5d9fa1e04e 00007f5d9dedf2a4 00007f5d9dedf232 00007f5d9dedf161 00007f5d9dedf0dc 00007f5d9dede392 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:26:13.163311 (+10970491us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":225,"mutex_wait_us":55984,"reported_tablets":47,"spinlock_wait_cycles":193777536}
I20260709 12:26:13.179355 25834 consensus_queue.cc:237] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:26:13.182426   554 ts_tablet_manager.cc:933] T 58ab3e51ccf14577a94774f25ade6cd8 P a866ff967d964388a6f0dff7fd43df89: Initiating tablet copy from peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349)
I20260709 12:26:13.187527 25831 raft_consensus.cc:1275] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 18 index: 17. Preceding OpId from leader: term: 19 index: 18. (index mismatch)
I20260709 12:26:13.195938   539 consensus_queue.cc:1048] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:26:13.206786 25831 raft_consensus.cc:2955] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Committing config change with OpId 22.16: config changed from index -1 to 16, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:26:13.250443 25830 raft_consensus.cc:1275] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:26:13.287011   554 tablet_copy_client.cc:323] T 58ab3e51ccf14577a94774f25ade6cd8 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Beginning tablet copy session from remote peer at address 127.23.245.129:37349
I20260709 12:26:13.299139   540 consensus_queue.cc:1048] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
W20260709 12:26:13.337750 25801 consensus_peers.cc:597] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a -> Peer a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611): Couldn't send request to peer a866ff967d964388a6f0dff7fd43df89. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d7bb9a8676e14626b11877dab828ea68. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:13.397578 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 88833.9us
W20260709 12:26:13.420732 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 172496us
I20260709 12:26:13.497615 25831 raft_consensus.cc:1275] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:26:13.511871   369 consensus_queue.cc:1048] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 12:26:13.490456 25580 catalog_manager.cc:5697] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 14 to 15, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 15 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:13.519825 25695 tablet_copy_service.cc:140] P f82778701b464892aab92a752ed7ffdc: Received BeginTabletCopySession request for tablet 58ab3e51ccf14577a94774f25ade6cd8 from peer a866ff967d964388a6f0dff7fd43df89 ({username='slave'} at 127.0.0.1:51578)
I20260709 12:26:13.520797 25695 tablet_copy_service.cc:161] P f82778701b464892aab92a752ed7ffdc: Beginning new tablet copy session on tablet 58ab3e51ccf14577a94774f25ade6cd8 from peer a866ff967d964388a6f0dff7fd43df89 at {username='slave'} at 127.0.0.1:51578: session id = a866ff967d964388a6f0dff7fd43df89-58ab3e51ccf14577a94774f25ade6cd8
I20260709 12:26:13.525055 25683 raft_consensus.cc:1275] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:26:13.527062 25685 raft_consensus.cc:1275] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 18 index: 17. Preceding OpId from leader: term: 19 index: 18. (index mismatch)
I20260709 12:26:13.527081 25583 catalog_manager.cc:5697] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc reported cstate change: config changed from index -1 to 16, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New cstate: current_term: 22 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:26:13.536055 26439 consensus_queue.cc:237] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:13.552487   568 consensus_queue.cc:1048] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:26:13.556927   566 consensus_queue.cc:1048] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260709 12:26:13.562402 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 122045us
I20260709 12:26:13.589298 25679 raft_consensus.cc:1275] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:26:13.621881 25759 raft_consensus.cc:1275] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:26:13.636296 25695 tablet_copy_source_session.cc:215] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:13.676080   573 consensus_queue.cc:1048] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260709 12:26:13.701190   554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58ab3e51ccf14577a94774f25ade6cd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:13.750114   583 ts_tablet_manager.cc:933] T afda1f2e78cc4f799b9bad380ffd3d44 P a866ff967d964388a6f0dff7fd43df89: Initiating tablet copy from peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:13.759037 25830 raft_consensus.cc:1275] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:26:13.753633 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:13.834026 25681 raft_consensus.cc:1275] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:26:13.819093   579 raft_consensus.cc:2955] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 21 LEADER]: Committing config change with OpId 21.13: config changed from index -1 to 13, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:26:13.844383   533 consensus_queue.cc:1048] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.070s
I20260709 12:26:13.848511   583 tablet_copy_client.cc:323] T afda1f2e78cc4f799b9bad380ffd3d44 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Beginning tablet copy session from remote peer at address 127.23.245.130:37267
I20260709 12:26:13.850731 25773 tablet_copy_service.cc:140] P 6e673265293d4e9a937dc45150aeb1b8: Received BeginTabletCopySession request for tablet afda1f2e78cc4f799b9bad380ffd3d44 from peer a866ff967d964388a6f0dff7fd43df89 ({username='slave'} at 127.0.0.1:48606)
I20260709 12:26:13.851301 25773 tablet_copy_service.cc:161] P 6e673265293d4e9a937dc45150aeb1b8: Beginning new tablet copy session on tablet afda1f2e78cc4f799b9bad380ffd3d44 from peer a866ff967d964388a6f0dff7fd43df89 at {username='slave'} at 127.0.0.1:48606: session id = a866ff967d964388a6f0dff7fd43df89-afda1f2e78cc4f799b9bad380ffd3d44
I20260709 12:26:13.866204   568 consensus_queue.cc:1048] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:26:13.866657 25763 raft_consensus.cc:2955] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Committing config change with OpId 21.13: config changed from index -1 to 13, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:26:13.884655   574 consensus_queue.cc:1048] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:26:13.935551   554 tablet_copy_client.cc:806] T 58ab3e51ccf14577a94774f25ade6cd8 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:13.936290   554 tablet_copy_client.cc:670] T 58ab3e51ccf14577a94774f25ade6cd8 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 1 WAL segments...
W20260709 12:26:14.005192 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 218942us
I20260709 12:26:14.007714 25685 raft_consensus.cc:2955] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Committing config change with OpId 21.13: config changed from index -1 to 13, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
I20260709 12:26:14.017916 25677 raft_consensus.cc:1275] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:26:14.057281 25773 tablet_copy_source_session.cc:215] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:14.064203   583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afda1f2e78cc4f799b9bad380ffd3d44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:14.072042 25580 catalog_manager.cc:5697] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: config changed from index -1 to 13, NON_VOTER a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) added. New cstate: current_term: 21 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } } }
W20260709 12:26:14.136958 25582 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41224 (request call id 338) took 21636 ms (client timeout 15000 ms). Trace:
W20260709 12:26:14.137502 25582 rpcz_store.cc:269] 0709 12:25:52.500534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:52.504122 (+  3588us) service_pool.cc:224] Handling call
0709 12:25:52.549021 (+ 44899us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b5400078854. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99acb090 00007f5d99b69f3a 00007f5d9f91fe9c 00007f5d9fa1e04e 00007f5d9dedf2a4 00007f5d9dedf232 00007f5d9dedf161 00007f5d9dedf0dc 00007f5d9dede392 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:26:14.136748 (+21587727us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38790,"reported_tablets":46,"spinlock_wait_cycles":34429824}
I20260709 12:26:14.161867   596 ts_tablet_manager.cc:933] T d7bb9a8676e14626b11877dab828ea68 P a866ff967d964388a6f0dff7fd43df89: Initiating tablet copy from peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:14.164090   554 tablet_copy_client.cc:538] T 58ab3e51ccf14577a94774f25ade6cd8 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:14.165060 32764 consensus_queue.cc:1048] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.011s
I20260709 12:26:14.259773   583 tablet_copy_client.cc:806] T afda1f2e78cc4f799b9bad380ffd3d44 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:14.261900   583 tablet_copy_client.cc:670] T afda1f2e78cc4f799b9bad380ffd3d44 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:14.308295   596 tablet_copy_client.cc:323] T d7bb9a8676e14626b11877dab828ea68 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Beginning tablet copy session from remote peer at address 127.23.245.131:36237
W20260709 12:26:14.326390 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 74677.8us
I20260709 12:26:14.329659   540 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:26:14.330343   540 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:14.331360 25847 tablet_copy_service.cc:140] P 5cccf20a8bff46dba6601f241d172b8a: Received BeginTabletCopySession request for tablet d7bb9a8676e14626b11877dab828ea68 from peer a866ff967d964388a6f0dff7fd43df89 ({username='slave'} at 127.0.0.1:41782)
I20260709 12:26:14.331986 25847 tablet_copy_service.cc:161] P 5cccf20a8bff46dba6601f241d172b8a: Beginning new tablet copy session on tablet d7bb9a8676e14626b11877dab828ea68 from peer a866ff967d964388a6f0dff7fd43df89 at {username='slave'} at 127.0.0.1:41782: session id = a866ff967d964388a6f0dff7fd43df89-d7bb9a8676e14626b11877dab828ea68
I20260709 12:26:14.362314 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:14.343452   540 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:14.370540 25847 tablet_copy_source_session.cc:215] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:14.371389 32764 raft_consensus.cc:2955] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 19 LEADER]: Committing config change with OpId 19.15: config changed from index 8 to 15, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:14.361147   583 tablet_copy_client.cc:538] T afda1f2e78cc4f799b9bad380ffd3d44 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:14.380950 25682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f82778701b464892aab92a752ed7ffdc" is_pre_election: true
I20260709 12:26:14.387171 25726 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
W20260709 12:26:14.396299 25578 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52974 (request call id 258) took 44649 ms (client timeout 15000 ms). Trace:
W20260709 12:26:14.396785 25578 rpcz_store.cc:269] 0709 12:25:29.746620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:29.766718 (+ 20098us) service_pool.cc:224] Handling call
0709 12:25:31.385114 (+1618396us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b5400078854. stack: 00007f5d96a42343 00007f5d96a42240 00007f5d963d11d4 00007f5da010f304 00007f5da010f299 00007f5d99acb090 00007f5d99b69f3a 00007f5d9f91fe9c 00007f5d9fa1e04e 00007f5d9dedf2a4 00007f5d9dedf232 00007f5d9dedf161 00007f5d9dedf0dc 00007f5d9dede392 00007f5d97e9c48c 00007f5d97e9b8c6
0709 12:26:14.395763 (+43010649us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30657,"reported_tablets":42,"spinlock_wait_cycles":2795653376}
I20260709 12:26:14.397367   560 raft_consensus.cc:2749] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:14.406515   554 tablet_bootstrap.cc:492] T 58ab3e51ccf14577a94774f25ade6cd8 P a866ff967d964388a6f0dff7fd43df89: Bootstrap starting.
W20260709 12:26:14.431694 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 64998us
I20260709 12:26:14.454284   583 tablet_bootstrap.cc:492] T afda1f2e78cc4f799b9bad380ffd3d44 P a866ff967d964388a6f0dff7fd43df89: Bootstrap starting.
I20260709 12:26:14.454828 25569 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 51d1a71a6e1f4e20842a35cdeb808ac0 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:14.465142 25828 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:26:14.465878 25828 raft_consensus.cc:606] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 15 LEADER]: Received request to transfer leadership to TS 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:26:14.470077 25830 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:26:14.470676 25830 raft_consensus.cc:606] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 18 LEADER]: Received request to transfer leadership to TS 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:26:14.478142 25828 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69"
dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
mode: GRACEFUL
new_leader_uuid: "f82778701b464892aab92a752ed7ffdc"
 from {username='slave'} at 127.0.0.1:60480
I20260709 12:26:14.480675 25828 raft_consensus.cc:606] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 18 LEADER]: Received request to transfer leadership to TS f82778701b464892aab92a752ed7ffdc
I20260709 12:26:14.477748 25578 catalog_manager.cc:5697] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: config changed from index 8 to 15, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New cstate: current_term: 19 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:14.479242 25830 raft_consensus.cc:2955] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 8 to 15, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:14.489410 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:26:14.491191 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:14.519398 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:14.526502   596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7bb9a8676e14626b11877dab828ea68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:14.563175 25680 raft_consensus.cc:2955] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 8 to 15, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:14.548061 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:14.619351   596 tablet_copy_client.cc:806] T d7bb9a8676e14626b11877dab828ea68 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:14.625530   596 tablet_copy_client.cc:670] T d7bb9a8676e14626b11877dab828ea68 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Starting download of 1 WAL segments...
W20260709 12:26:14.630494 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 46220.8us
I20260709 12:26:14.637696   596 tablet_copy_client.cc:538] T d7bb9a8676e14626b11877dab828ea68 P a866ff967d964388a6f0dff7fd43df89: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:14.638510   570 raft_consensus.cc:993] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a: : Instructing follower 6e673265293d4e9a937dc45150aeb1b8 to start an election
I20260709 12:26:14.639156 32552 raft_consensus.cc:1081] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 15 LEADER]: Signalling peer 6e673265293d4e9a937dc45150aeb1b8 to start an election
I20260709 12:26:14.640878 25760 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:53460
I20260709 12:26:14.641430 25760 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:14.641763 25760 raft_consensus.cc:3060] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:14.654479 25760 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:14.658536 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:14.659091 25830 raft_consensus.cc:3055] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:26:14.659364 25830 raft_consensus.cc:740] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:26:14.660614 25830 consensus_queue.cc:260] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:14.662366 25678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "f82778701b464892aab92a752ed7ffdc"
I20260709 12:26:14.665947 25678 raft_consensus.cc:3060] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:14.668397   554 tablet_bootstrap.cc:492] T 58ab3e51ccf14577a94774f25ade6cd8 P a866ff967d964388a6f0dff7fd43df89: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=0 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:14.669396   554 tablet_bootstrap.cc:492] T 58ab3e51ccf14577a94774f25ade6cd8 P a866ff967d964388a6f0dff7fd43df89: Bootstrap complete.
I20260709 12:26:14.663038 25830 raft_consensus.cc:3060] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:14.670118   554 ts_tablet_manager.cc:1403] T 58ab3e51ccf14577a94774f25ade6cd8 P a866ff967d964388a6f0dff7fd43df89: Time spent bootstrapping tablet: real 0.264s	user 0.038s	sys 0.010s
I20260709 12:26:14.662168 25760 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:14.683271 25830 raft_consensus.cc:2468] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 16.
I20260709 12:26:14.688112   574 raft_consensus.cc:993] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a: : Instructing follower 6e673265293d4e9a937dc45150aeb1b8 to start an election
I20260709 12:26:14.688645   574 raft_consensus.cc:1081] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 18 LEADER]: Signalling peer 6e673265293d4e9a937dc45150aeb1b8 to start an election
I20260709 12:26:14.691310 25726 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:26:14.692565   560 raft_consensus.cc:2804] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:14.693056   560 raft_consensus.cc:697] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:26:14.693964   560 consensus_queue.cc:237] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:14.696122 25759 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701"
dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
 from {username='slave'} at 127.0.0.1:53460
I20260709 12:26:14.696661 25759 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:14.696998 25759 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:14.700522 25678 raft_consensus.cc:2468] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 16.
I20260709 12:26:14.717775 25759 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:14.719118 25753 tablet_service.cc:1558] Processing DeleteTablet for tablet 51d1a71a6e1f4e20842a35cdeb808ac0 with delete_type TABLET_DATA_TOMBSTONED (TS 6e673265293d4e9a937dc45150aeb1b8 not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:38410
I20260709 12:26:14.724570 25759 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:14.725940 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:26:14.726734 26430 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:14.730185 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:14.730834 25830 raft_consensus.cc:3055] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:26:14.731134 25830 raft_consensus.cc:740] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:26:14.732054 25830 consensus_queue.cc:260] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:14.733189 25830 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:14.736517   596 tablet_bootstrap.cc:492] T d7bb9a8676e14626b11877dab828ea68 P a866ff967d964388a6f0dff7fd43df89: Bootstrap starting.
I20260709 12:26:14.740815 25830 raft_consensus.cc:2468] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 19.
I20260709 12:26:14.742057 26430 raft_consensus.cc:2468] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 19.
I20260709 12:26:14.766776 25726 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:26:14.768206 32215 raft_consensus.cc:2804] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:14.768674 32215 raft_consensus.cc:697] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:26:14.769501 32215 consensus_queue.cc:237] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:14.787564   606 tablet_replica.cc:333] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
I20260709 12:26:14.789332   606 raft_consensus.cc:2243] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:14.792410   606 raft_consensus.cc:2272] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:14.793017   554 raft_consensus.cc:359] T 58ab3e51ccf14577a94774f25ade6cd8 P a866ff967d964388a6f0dff7fd43df89 [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:26:14.794075   554 raft_consensus.cc:740] T 58ab3e51ccf14577a94774f25ade6cd8 P a866ff967d964388a6f0dff7fd43df89 [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Initialized, Role: LEARNER
I20260709 12:26:14.796142   606 ts_tablet_manager.cc:1916] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:14.794840   554 consensus_queue.cc:260] T 58ab3e51ccf14577a94774f25ade6cd8 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:26:14.811460   554 ts_tablet_manager.cc:1434] T 58ab3e51ccf14577a94774f25ade6cd8 P a866ff967d964388a6f0dff7fd43df89: Time spent starting tablet: real 0.141s	user 0.010s	sys 0.000s
I20260709 12:26:14.814461 25695 tablet_copy_service.cc:342] P f82778701b464892aab92a752ed7ffdc: Request end of tablet copy session a866ff967d964388a6f0dff7fd43df89-58ab3e51ccf14577a94774f25ade6cd8 received from {username='slave'} at 127.0.0.1:51578
I20260709 12:26:14.816221 25695 tablet_copy_service.cc:434] P f82778701b464892aab92a752ed7ffdc: ending tablet copy session a866ff967d964388a6f0dff7fd43df89-58ab3e51ccf14577a94774f25ade6cd8 on tablet 58ab3e51ccf14577a94774f25ade6cd8 with peer a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:14.834585 25577 catalog_manager.cc:5697] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 15 to 16, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 16 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:14.855456   606 ts_tablet_manager.cc:1929] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 19.14
I20260709 12:26:14.876507   606 log.cc:1199] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 6e673265293d4e9a937dc45150aeb1b8: Deleting WAL directory at /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-1-root/wals/51d1a71a6e1f4e20842a35cdeb808ac0
I20260709 12:26:14.880239 25577 catalog_manager.cc:5697] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 18 to 19, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 19 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:14.886999   583 tablet_bootstrap.cc:492] T afda1f2e78cc4f799b9bad380ffd3d44 P a866ff967d964388a6f0dff7fd43df89: Bootstrap replayed 1/1 log segments. Stats: ops{read=16 overwritten=0 applied=16 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:14.891016   583 tablet_bootstrap.cc:492] T afda1f2e78cc4f799b9bad380ffd3d44 P a866ff967d964388a6f0dff7fd43df89: Bootstrap complete.
I20260709 12:26:14.891875   583 ts_tablet_manager.cc:1403] T afda1f2e78cc4f799b9bad380ffd3d44 P a866ff967d964388a6f0dff7fd43df89: Time spent bootstrapping tablet: real 0.438s	user 0.059s	sys 0.005s
I20260709 12:26:14.894575 25568 catalog_manager.cc:5028] TS 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): tablet 51d1a71a6e1f4e20842a35cdeb808ac0 (table test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]) successfully deleted
I20260709 12:26:14.910511   583 raft_consensus.cc:359] T afda1f2e78cc4f799b9bad380ffd3d44 P a866ff967d964388a6f0dff7fd43df89 [term 22 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:26:14.911550   583 raft_consensus.cc:740] T afda1f2e78cc4f799b9bad380ffd3d44 P a866ff967d964388a6f0dff7fd43df89 [term 22 LEARNER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Initialized, Role: LEARNER
I20260709 12:26:14.921972 26430 raft_consensus.cc:1217] T 58ab3e51ccf14577a94774f25ade6cd8 P a866ff967d964388a6f0dff7fd43df89 [term 18 LEARNER]: Deduplicated request from leader. Original: 18.12->[18.13-18.13]   Dedup: 18.13->[]
I20260709 12:26:14.924661   583 consensus_queue.cc:260] T afda1f2e78cc4f799b9bad380ffd3d44 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:26:14.927783   583 ts_tablet_manager.cc:1434] T afda1f2e78cc4f799b9bad380ffd3d44 P a866ff967d964388a6f0dff7fd43df89: Time spent starting tablet: real 0.035s	user 0.002s	sys 0.003s
I20260709 12:26:14.937762 25773 tablet_copy_service.cc:342] P 6e673265293d4e9a937dc45150aeb1b8: Request end of tablet copy session a866ff967d964388a6f0dff7fd43df89-afda1f2e78cc4f799b9bad380ffd3d44 received from {username='slave'} at 127.0.0.1:48606
I20260709 12:26:14.938416 25773 tablet_copy_service.cc:434] P 6e673265293d4e9a937dc45150aeb1b8: ending tablet copy session a866ff967d964388a6f0dff7fd43df89-afda1f2e78cc4f799b9bad380ffd3d44 on tablet afda1f2e78cc4f799b9bad380ffd3d44 with peer a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:14.960067   574 raft_consensus.cc:993] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a: : Instructing follower f82778701b464892aab92a752ed7ffdc to start an election
I20260709 12:26:14.960621   574 raft_consensus.cc:1081] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 18 LEADER]: Signalling peer f82778701b464892aab92a752ed7ffdc to start an election
I20260709 12:26:14.963255 25680 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69"
dest_uuid: "f82778701b464892aab92a752ed7ffdc"
 from {username='slave'} at 127.0.0.1:40220
I20260709 12:26:14.963879 25680 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:14.964262 25680 raft_consensus.cc:3060] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:14.976547 25680 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:15.033521 25680 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 19 election: Requested vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:15.033766 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:26:15.034405 26439 raft_consensus.cc:3060] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:15.040670 25830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:15.041321 25830 raft_consensus.cc:3055] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:26:15.041605 25830 raft_consensus.cc:740] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:26:15.042409 25830 consensus_queue.cc:260] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:15.043565 25830 raft_consensus.cc:3060] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:15.061376 26439 raft_consensus.cc:2468] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 19.
I20260709 12:26:15.062644 25650 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc; no voters: 
I20260709 12:26:15.063591   580 raft_consensus.cc:2804] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:15.073316   580 raft_consensus.cc:697] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 19 LEADER]: Becoming Leader. State: Replica: f82778701b464892aab92a752ed7ffdc, State: Running, Role: LEADER
I20260709 12:26:15.074290   580 consensus_queue.cc:237] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:15.097306 25828 raft_consensus.cc:1275] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:26:15.109227   596 tablet_bootstrap.cc:492] T d7bb9a8676e14626b11877dab828ea68 P a866ff967d964388a6f0dff7fd43df89: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=2 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:15.135519   596 tablet_bootstrap.cc:492] T d7bb9a8676e14626b11877dab828ea68 P a866ff967d964388a6f0dff7fd43df89: Bootstrap complete.
I20260709 12:26:15.164470   596 ts_tablet_manager.cc:1403] T d7bb9a8676e14626b11877dab828ea68 P a866ff967d964388a6f0dff7fd43df89: Time spent bootstrapping tablet: real 0.429s	user 0.056s	sys 0.056s
I20260709 12:26:15.167649   596 raft_consensus.cc:359] T d7bb9a8676e14626b11877dab828ea68 P a866ff967d964388a6f0dff7fd43df89 [term 21 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:26:15.180095   596 raft_consensus.cc:740] T d7bb9a8676e14626b11877dab828ea68 P a866ff967d964388a6f0dff7fd43df89 [term 21 LEARNER]: Becoming Follower/Learner. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Initialized, Role: LEARNER
I20260709 12:26:15.171530   560 consensus_queue.cc:1048] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:26:15.172125 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 45700.6us
I20260709 12:26:15.178618 25577 catalog_manager.cc:5697] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc reported cstate change: term changed from 18 to 19, leader changed from 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) to f82778701b464892aab92a752ed7ffdc (127.23.245.129). New cstate: current_term: 19 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:15.109061 25830 raft_consensus.cc:2468] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f82778701b464892aab92a752ed7ffdc in term 19.
I20260709 12:26:15.185282   596 consensus_queue.cc:260] T d7bb9a8676e14626b11877dab828ea68 P a866ff967d964388a6f0dff7fd43df89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:26:15.200287   596 ts_tablet_manager.cc:1434] T d7bb9a8676e14626b11877dab828ea68 P a866ff967d964388a6f0dff7fd43df89: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.001s
I20260709 12:26:15.217564 25847 tablet_copy_service.cc:342] P 5cccf20a8bff46dba6601f241d172b8a: Request end of tablet copy session a866ff967d964388a6f0dff7fd43df89-d7bb9a8676e14626b11877dab828ea68 received from {username='slave'} at 127.0.0.1:41782
I20260709 12:26:15.218041 25847 tablet_copy_service.cc:434] P 5cccf20a8bff46dba6601f241d172b8a: ending tablet copy session a866ff967d964388a6f0dff7fd43df89-d7bb9a8676e14626b11877dab828ea68 on tablet d7bb9a8676e14626b11877dab828ea68 with peer a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:15.271258 25682 raft_consensus.cc:1275] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:26:15.273030 25828 raft_consensus.cc:1275] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:26:15.274605 26430 raft_consensus.cc:1275] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:26:15.293982   560 consensus_queue.cc:1048] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:26:15.296438   560 consensus_queue.cc:1048] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:15.340133   560 consensus_queue.cc:1048] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:26:15.357724 26439 raft_consensus.cc:1217] T afda1f2e78cc4f799b9bad380ffd3d44 P a866ff967d964388a6f0dff7fd43df89 [term 22 LEARNER]: Deduplicated request from leader. Original: 22.15->[22.16-22.16]   Dedup: 22.16->[]
I20260709 12:26:15.538905 26439 raft_consensus.cc:1275] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:26:15.572926   591 consensus_queue.cc:1048] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.013s
I20260709 12:26:15.585511   575 raft_consensus.cc:1064] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc: attempting to promote NON_VOTER a866ff967d964388a6f0dff7fd43df89 to VOTER
I20260709 12:26:15.622009   575 consensus_queue.cc:237] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 11, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:15.637072 25830 raft_consensus.cc:1275] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260709 12:26:15.640214 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 74680.3us
I20260709 12:26:15.658844 26431 raft_consensus.cc:1217] T d7bb9a8676e14626b11877dab828ea68 P a866ff967d964388a6f0dff7fd43df89 [term 21 LEARNER]: Deduplicated request from leader. Original: 21.12->[21.13-21.13]   Dedup: 21.13->[]
I20260709 12:26:15.642107   592 consensus_queue.cc:1048] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.016s
W20260709 12:26:15.794028   613 log.cc:927] Time spent T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 12:26:15.818043 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:26:15.992141   628 log.cc:927] Time spent T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89: Append to log took a long time: real 0.234s	user 0.001s	sys 0.000s
W20260709 12:26:16.025583 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 59081us
W20260709 12:26:16.051986 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 76433.1us
I20260709 12:26:16.120736 25833 raft_consensus.cc:1275] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 12:26:16.122272 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 72565.8us
I20260709 12:26:16.123554 26431 raft_consensus.cc:1275] T 58ab3e51ccf14577a94774f25ade6cd8 P a866ff967d964388a6f0dff7fd43df89 [term 18 LEARNER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 12:26:16.134799 25649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 288119us
I20260709 12:26:16.147169 25758 raft_consensus.cc:1275] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Refusing update from remote peer f82778701b464892aab92a752ed7ffdc: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:26:16.152341   630 consensus_queue.cc:1048] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:26:16.159375 24534 tablet_server.cc:179] TabletServer@127.23.245.129:0 shutting down...
I20260709 12:26:16.174737   570 raft_consensus.cc:1064] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a: attempting to promote NON_VOTER a866ff967d964388a6f0dff7fd43df89 to VOTER
I20260709 12:26:16.177330   570 consensus_queue.cc:237] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 11, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:26:16.198936 25801 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:16.200420   642 consensus_queue.cc:1048] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:26:16.208796   630 consensus_queue.cc:1048] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:26:16.291359 25801 consensus_peers.cc:597] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:16.305600 26402 consensus_peers.cc:597] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:16.333110   639 raft_consensus.cc:2955] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 18 LEADER]: Committing config change with OpId 18.14: config changed from index 13 to 14, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
W20260709 12:26:16.336896 26402 consensus_peers.cc:597] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:16.337821 26402 consensus_peers.cc:597] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:16.341059 26430 raft_consensus.cc:2955] T 58ab3e51ccf14577a94774f25ade6cd8 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:16.347538 25760 raft_consensus.cc:1275] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:26:16.371776 25760 raft_consensus.cc:2955] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:16.361116   570 consensus_queue.cc:1048] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.014s
I20260709 12:26:16.397264 26432 raft_consensus.cc:1275] T d7bb9a8676e14626b11877dab828ea68 P a866ff967d964388a6f0dff7fd43df89 [term 21 LEARNER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260709 12:26:16.388706 26402 consensus_peers.cc:597] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:16.406114 25801 consensus_peers.cc:597] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:16.408329 25830 raft_consensus.cc:2955] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:16.412111   570 consensus_queue.cc:1048] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:26:16.413242 25801 consensus_peers.cc:597] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:16.414209 25801 consensus_peers.cc:597] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:16.415802 26402 consensus_peers.cc:597] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:16.422933 26402 consensus_peers.cc:597] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:16.426191 25801 consensus_peers.cc:597] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:16.427094 25801 consensus_peers.cc:597] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:16.438987 26402 consensus_peers.cc:597] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:16.438416 25583 catalog_manager.cc:5697] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc reported cstate change: config changed from index 13 to 14, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "f82778701b464892aab92a752ed7ffdc" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:26:16.490156 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 224777us
I20260709 12:26:16.606851   625 raft_consensus.cc:1064] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8: attempting to promote NON_VOTER a866ff967d964388a6f0dff7fd43df89 to VOTER
I20260709 12:26:16.610334   625 consensus_queue.cc:237] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 14, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:16.707207   580 raft_consensus.cc:493] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
W20260709 12:26:16.724812   658 log.cc:927] Time spent T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.165s	user 0.000s	sys 0.005s
I20260709 12:26:16.756342   580 raft_consensus.cc:515] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:16.759285   580 leader_election.cc:290] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:26:16.800817 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 204728us
W20260709 12:26:16.819834 25728 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:16.879386 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 73329.1us
W20260709 12:26:16.885601 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 156043us
I20260709 12:26:16.888147 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:16.920567 26432 raft_consensus.cc:1275] T afda1f2e78cc4f799b9bad380ffd3d44 P a866ff967d964388a6f0dff7fd43df89 [term 22 LEARNER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:26:16.929688   642 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:26:16.930382   642 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:26:16.933095   642 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:26:16.941102 26402 consensus_peers.cc:597] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:16.996773   661 consensus_queue.cc:1048] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.014s
W20260709 12:26:17.002321 25801 consensus_peers.cc:597] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:17.005050 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2487f95c174426ebe2cdfc51537aea3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:17.009351 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:17.008651   673 raft_consensus.cc:2955] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 21 LEADER]: Committing config change with OpId 21.14: config changed from index 13 to 14, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:17.033749 26430 raft_consensus.cc:2955] T d7bb9a8676e14626b11877dab828ea68 P a866ff967d964388a6f0dff7fd43df89 [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index 13 to 14, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:17.075554 25762 raft_consensus.cc:2955] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index 13 to 14, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:17.075860 25649 leader_election.cc:304] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:26:17.081723   663 raft_consensus.cc:493] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:26:17.082340   663 raft_consensus.cc:515] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:17.082362   630 raft_consensus.cc:493] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:26:17.084517   630 raft_consensus.cc:515] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:17.086468   630 leader_election.cc:290] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:17.093511 25828 raft_consensus.cc:1275] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
W20260709 12:26:17.093698 25726 consensus_peers.cc:597] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:17.089936   671 raft_consensus.cc:2749] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:26:17.096707 25726 consensus_peers.cc:597] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:17.106654   663 leader_election.cc:290] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:17.106910   668 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:17.107524   668 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:17.112237   668 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:26:17.116544 25726 consensus_peers.cc:597] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:17.117532 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 131604us
I20260709 12:26:17.120852 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bb9a8676e14626b11877dab828ea68" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:17.123085   580 raft_consensus.cc:493] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:26:17.123705   580 raft_consensus.cc:515] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:26:17.124372 25801 consensus_peers.cc:597] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:17.125967   580 leader_election.cc:290] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:17.131317 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:26:17.134949 25801 consensus_peers.cc:597] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:17.147038 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:17.146111 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:17.155936 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43b78aa0054b4da398a8fc04d12454a7" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:17.160377 25650 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:26:17.161448 26402 consensus_peers.cc:597] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:17.163578 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:17.169294 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87d777e7d64471f988b07272bf2441c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:17.174460 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:17.175829 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d1a71a6e1f4e20842a35cdeb808ac0" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:17.182193 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d74d1c9c8a84919a6f57b0b6721de51" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:17.182451   630 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:17.183024   630 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:17.167151   671 raft_consensus.cc:2749] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:26:17.191335 25650 leader_election.cc:304] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:17.192577 25650 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:17.194072 25650 leader_election.cc:304] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:17.212461   668 raft_consensus.cc:2749] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:17.195194   663 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:17.217576   663 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:17.224083   668 raft_consensus.cc:2749] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:17.224895 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:17.227305 25650 leader_election.cc:304] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:17.228351   668 raft_consensus.cc:2749] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:17.219697   663 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:26:17.229867 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 112126us
W20260709 12:26:17.234465 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 68790.4us
W20260709 12:26:17.241017 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 101025us
W20260709 12:26:17.241760 25801 consensus_peers.cc:597] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:17.242750   630 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:17.243093 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:17.213356   580 raft_consensus.cc:2749] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:17.213796   575 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:17.249099   575 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:17.252180 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:17.253607   575 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:17.258307 25584 catalog_manager.cc:5697] T d7bb9a8676e14626b11877dab828ea68 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: config changed from index 13 to 14, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New cstate: current_term: 21 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:17.270535 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a6b77683d6547db82cd02da9d9c938a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:17.276615 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3767151a5d4345659810a40ea7f44873" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:17.278659 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d32f766d8f384968a837db40f23c072c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
W20260709 12:26:17.264348 25726 consensus_peers.cc:597] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:17.283821   668 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:17.292534   668 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:17.294780   668 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:17.306219 25650 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
W20260709 12:26:17.320286 25569 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 182410us
I20260709 12:26:17.275681   663 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:17.308533 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:17.323873 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9ea7c5f4a6a4724bfcb0c6d88c32b1c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:17.324572 25650 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:26:17.325878 25650 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:26:17.336951   663 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:17.327545   671 raft_consensus.cc:2749] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:26:17.340708   642 raft_consensus.cc:2749] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:26:17.373322   580 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
W20260709 12:26:17.381582 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 53969.6us
I20260709 12:26:17.394106 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:17.400728   672 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:17.406781   669 raft_consensus.cc:2749] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:17.407167   672 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: NON_VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: true } }
I20260709 12:26:17.409987   672 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:17.427510 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:17.381632   630 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
W20260709 12:26:17.423396 25801 leader_election.cc:336] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:17.405416   677 raft_consensus.cc:493] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:26:17.440454   677 raft_consensus.cc:515] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:17.442557   677 leader_election.cc:290] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:17.445138 25755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:17.447160 25650 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:17.443080 25800 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
W20260709 12:26:17.447625 25569 catalog_manager.cc:4755] TS f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): ChangeConfig:REMOVE_PEER RPC failed for tablet 58ab3e51ccf14577a94774f25ade6cd8: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:26:17.448134 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 43712.4us
I20260709 12:26:17.386046   668 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:26:17.459103   639 raft_consensus.cc:2749] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:17.460119 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca85fa90ddc84c0680729add054d3003" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:17.439594   630 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:17.474630 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bb433064bfd49359e66128eb1c5edb3" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 24 candidate_status { last_received { term: 23 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:17.475193 25650 leader_election.cc:304] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:26:17.477756   618 raft_consensus.cc:2749] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:26:17.483357 32552 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:17.484092 32552 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:17.449977   580 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:17.462356   625 consensus_queue.cc:1048] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.020s
I20260709 12:26:17.472838   663 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:17.486860   673 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:17.524163   673 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:17.470431   668 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:17.526190   673 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:17.526597   668 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:17.522917   686 raft_consensus.cc:493] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:26:17.516640 32552 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:17.501583   626 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
W20260709 12:26:17.540836 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 45936.6us
W20260709 12:26:17.536806 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 61704.7us
I20260709 12:26:17.545672 25650 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:26:17.553568   668 raft_consensus.cc:2749] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:26:17.546195 25726 consensus_peers.cc:597] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:17.560897 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 70850.6us
I20260709 12:26:17.538594   639 raft_consensus.cc:2749] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:26:17.579777 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022a05e9e59f4ddf8f793ff24696476d" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:17.584510 25763 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:26:17.581926 25726 consensus_peers.cc:597] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:17.590324 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:26:17.590481 25726 consensus_peers.cc:597] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:17.533986   686 raft_consensus.cc:515] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:17.604460   686 leader_election.cc:290] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:17.541184   626 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:17.605280   580 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:17.606617   626 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:17.599474 24534 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:26:17.594872 25726 consensus_peers.cc:597] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:17.608968 25726 consensus_peers.cc:597] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:17.609421 25726 consensus_peers.cc:597] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:17.610574 25726 consensus_peers.cc:597] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:17.598565   630 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:17.616451 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:17.608282 24534 tablet_replica.cc:333] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
I20260709 12:26:17.618564 24534 raft_consensus.cc:2243] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:17.619246 24534 raft_consensus.cc:2272] T 022a05e9e59f4ddf8f793ff24696476d P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:17.622488 25835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:17.641534 24534 tablet_replica.cc:333] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
I20260709 12:26:17.647037 24534 raft_consensus.cc:2243] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:17.649483 24534 raft_consensus.cc:2272] T 4e8d1d3d43ad47308fae5ed98608feb8 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:17.652343 24534 tablet_replica.cc:333] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
I20260709 12:26:17.662016 24534 raft_consensus.cc:2243] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:17.655089 25834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:17.655123 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:17.665421 24534 raft_consensus.cc:2272] T afda1f2e78cc4f799b9bad380ffd3d44 P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:17.667059   575 raft_consensus.cc:493] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:26:17.667587   575 raft_consensus.cc:515] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:26:17.656762 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 45241.3us
I20260709 12:26:17.669559   575 leader_election.cc:290] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:17.654435 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3324229ffe6d4ca282dc77ffa254a5b2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:17.671427   642 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:26:17.671972   642 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:17.674072   642 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:17.674566   642 raft_consensus.cc:493] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:26:17.675154   642 raft_consensus.cc:515] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:17.676431   671 raft_consensus.cc:493] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:26:17.676965   630 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:26:17.676503   692 raft_consensus.cc:493] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:26:17.677594   630 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:17.677701   692 raft_consensus.cc:515] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:17.679476 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4734c282e09b4bbbb96de8eee61c160a" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:17.676996   671 raft_consensus.cc:515] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:17.681988   671 leader_election.cc:290] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:17.682356 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90d850895b8a4a40a4fba5caf2048ca2" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:17.683007   630 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:17.684116   692 leader_election.cc:290] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:17.685429 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01372ae5f161477dab1b4c89fd847b3c" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:17.686224   642 leader_election.cc:290] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:17.693012 24534 tablet_replica.cc:333] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
I20260709 12:26:17.697841   691 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:26:17.698431   691 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:17.700007 24534 raft_consensus.cc:2243] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:17.700588   691 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:17.703698   692 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:17.704288   692 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:17.706775   692 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:17.712848 24534 raft_consensus.cc:2272] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:17.713506 25650 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:26:17.716184   692 raft_consensus.cc:2749] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:17.716470 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:17.717182 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:17.718364 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c043718ee3a40fea4b2b1453fcb259b" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:17.719642 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:17.720558 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 20 candidate_status { last_received { term: 19 index: 18 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:17.719589 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "522704a36135481fa4fc221fa9a0801e" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:17.725700 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:17.728157 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d79b16002fc460a9e70bd0a5bcec639" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:17.730000 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:17.732574 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca1c66d4736542ecb25b33fab43ae780" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 20 candidate_status { last_received { term: 19 index: 18 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:17.735773 24534 tablet_replica.cc:333] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
I20260709 12:26:17.735703 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:17.737156 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:17.738472 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819272169f6f4293b6e279793be58b49" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:17.744246 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aae9f34f7154346afd482b3183ee180" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:17.747438 24534 raft_consensus.cc:2243] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:26:17.755298 25833 raft_consensus.cc:2955] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Committing config change with OpId 22.17: config changed from index 16 to 17, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:17.757619 24534 raft_consensus.cc:2272] T 74bf68992e4a43c78d2ef30e6c477746 P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:17.745095 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:17.753327   540 raft_consensus.cc:2955] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 LEADER]: Committing config change with OpId 22.17: config changed from index 16 to 17, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:17.766659 24534 tablet_replica.cc:333] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
I20260709 12:26:17.766424 26431 raft_consensus.cc:2955] T afda1f2e78cc4f799b9bad380ffd3d44 P a866ff967d964388a6f0dff7fd43df89 [term 22 FOLLOWER]: Committing config change with OpId 22.17: config changed from index 16 to 17, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:17.768833 24534 raft_consensus.cc:2243] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:17.770583 24534 raft_consensus.cc:2272] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:17.777987 24534 tablet_replica.cc:333] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
I20260709 12:26:17.783737 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6182e86ac1764086b37738a0f1b04cd4" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:17.784490 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7954a5254e674b77843c0d32002d2e90" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:17.784749   692 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:17.792997 24534 raft_consensus.cc:2243] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:26:17.793176   692 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:17.796865   692 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:17.785368   691 raft_consensus.cc:493] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 26 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:26:17.797528   691 raft_consensus.cc:515] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:17.799623   691 leader_election.cc:290] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:17.809762 24534 raft_consensus.cc:2272] T 05232536e53b419682a5f24515843652 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:17.813083 25584 catalog_manager.cc:5697] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: config changed from index 16 to 17, a866ff967d964388a6f0dff7fd43df89 (127.23.245.132) changed from NON_VOTER to VOTER. New cstate: current_term: 22 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:17.815523 24534 tablet_replica.cc:333] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
I20260709 12:26:17.816653 24534 raft_consensus.cc:2243] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:17.821151 24534 raft_consensus.cc:2272] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:17.842850 24534 tablet_replica.cc:333] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
I20260709 12:26:17.833124   692 raft_consensus.cc:493] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a866ff967d964388a6f0dff7fd43df89)
I20260709 12:26:17.856897   692 raft_consensus.cc:515] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:17.859050   692 leader_election.cc:290] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:17.809831 25650 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:17.848945 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:26:17.860268 25650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 50525.4us
I20260709 12:26:17.861199   691 raft_consensus.cc:2749] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:17.861351 25650 leader_election.cc:304] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:17.863319   691 raft_consensus.cc:2749] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:17.863463 25650 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:17.864650   691 raft_consensus.cc:2749] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:17.867702 24534 raft_consensus.cc:2243] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:26:17.876488 24534 raft_consensus.cc:2272] T 06c3ab7c0c7a496390151c476ec675a0 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:17.885026 24534 tablet_replica.cc:333] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
I20260709 12:26:17.887861 25649 leader_election.cc:304] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:17.897532   692 raft_consensus.cc:2749] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:17.898823 25649 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:17.899084 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c38d3f292da44b3dbb2e512cd53e21da" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
W20260709 12:26:17.899673 25649 raft_consensus.cc:2686] T 5aae9f34f7154346afd482b3183ee180 P f82778701b464892aab92a752ed7ffdc: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:26:17.901535 25649 leader_election.cc:304] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:17.902774 24534 raft_consensus.cc:2243] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:17.907565   692 raft_consensus.cc:2749] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:17.909862 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:17.913035 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:17.914423 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63f47864b8d248a792567d96c5e453b8" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:17.914469 24534 raft_consensus.cc:2272] T d7bb9a8676e14626b11877dab828ea68 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:17.916747 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b12e2b074f1b4518bcfc6728abeca136" candidate_uuid: "f82778701b464892aab92a752ed7ffdc" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:26:17.919639 25801 leader_election.cc:336] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:17.920159 25801 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
W20260709 12:26:17.921284 25801 leader_election.cc:336] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:17.921697 25801 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:17.922441   673 raft_consensus.cc:2749] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:17.923036   626 raft_consensus.cc:2749] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:17.923606 25650 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:17.924682 24534 tablet_replica.cc:333] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
W20260709 12:26:17.934306 25801 leader_election.cc:336] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:17.940590 25801 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:17.943548   626 raft_consensus.cc:2749] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:17.944896 24534 raft_consensus.cc:2243] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:17.945335   642 raft_consensus.cc:2749] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:26:17.952420 24534 raft_consensus.cc:2272] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:17.946224 25650 leader_election.cc:304] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:17.956897   642 raft_consensus.cc:2749] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:17.958396 25650 leader_election.cc:304] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
W20260709 12:26:17.959157 25650 raft_consensus.cc:2686] T 3d79b16002fc460a9e70bd0a5bcec639 P f82778701b464892aab92a752ed7ffdc: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:26:17.960676 25650 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:17.966565 24534 tablet_replica.cc:333] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
I20260709 12:26:17.977622   692 raft_consensus.cc:2749] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:17.980270 24534 raft_consensus.cc:2243] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:17.981994 25650 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:26:17.995599 24534 raft_consensus.cc:2272] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:17.998696   692 raft_consensus.cc:2706] T 6182e86ac1764086b37738a0f1b04cd4 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Received pre-election callback for term 17 while not running: Illegal state: RaftConsensus is not running: State = Stopped
I20260709 12:26:18.006637 24534 tablet_replica.cc:333] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
I20260709 12:26:18.039798 24534 raft_consensus.cc:2243] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:26:18.044581 24534 raft_consensus.cc:2272] T f50d78c25fc8461f8670d3708bbce774 P f82778701b464892aab92a752ed7ffdc [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.065418 25650 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:18.077082   642 raft_consensus.cc:2749] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:26:18.096381 25650 leader_election.cc:304] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:18.069739 24534 tablet_replica.cc:333] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
I20260709 12:26:18.099625 24534 raft_consensus.cc:2243] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:18.101293 25650 leader_election.cc:304] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f82778701b464892aab92a752ed7ffdc; no voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:18.101699 24534 raft_consensus.cc:2272] T 3767151a5d4345659810a40ea7f44873 P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:18.103255 25650 raft_consensus.cc:2686] T 63f47864b8d248a792567d96c5e453b8 P f82778701b464892aab92a752ed7ffdc: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:26:18.101218   691 raft_consensus.cc:2749] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:18.168366 24534 tablet_replica.cc:333] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
I20260709 12:26:18.169274 24534 raft_consensus.cc:2243] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:26:18.176236 24534 raft_consensus.cc:2272] T 04fe73edd8db49c08ea7a6adb6e443e6 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.179025 24534 tablet_replica.cc:333] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
I20260709 12:26:18.182482 24534 raft_consensus.cc:2243] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:18.184803 24534 raft_consensus.cc:2272] T 2bb433064bfd49359e66128eb1c5edb3 P f82778701b464892aab92a752ed7ffdc [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.188512 24534 tablet_replica.cc:333] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
I20260709 12:26:18.189301 24534 raft_consensus.cc:2243] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:18.189939 24534 raft_consensus.cc:2272] T 43b78aa0054b4da398a8fc04d12454a7 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.192520 24534 tablet_replica.cc:333] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
I20260709 12:26:18.193396 24534 raft_consensus.cc:2243] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:18.195300 24534 raft_consensus.cc:2272] T 51d1a71a6e1f4e20842a35cdeb808ac0 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.213178 24534 tablet_replica.cc:333] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
I20260709 12:26:18.213948 24534 raft_consensus.cc:2243] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:18.214515 24534 raft_consensus.cc:2272] T 01372ae5f161477dab1b4c89fd847b3c P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.217090 24534 tablet_replica.cc:333] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
I20260709 12:26:18.217803 24534 raft_consensus.cc:2243] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:26:18.241416 24534 raft_consensus.cc:2272] T 03fbd3823c734a7d92ea482cf0d206b9 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.248724 24534 tablet_replica.cc:333] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
I20260709 12:26:18.249650 24534 raft_consensus.cc:2243] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:26:18.251858 24534 raft_consensus.cc:2272] T 5204a6a2db104ffa90f8679086d4e6f8 P f82778701b464892aab92a752ed7ffdc [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.281277 24534 tablet_replica.cc:333] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
I20260709 12:26:18.282472 24534 raft_consensus.cc:2243] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:26:18.283636 24534 raft_consensus.cc:2272] T 7939d783f9eb4a738d840145c79cf380 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.293928 24534 tablet_replica.cc:333] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
I20260709 12:26:18.295445 24534 raft_consensus.cc:2243] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:18.308568 24534 raft_consensus.cc:2272] T 0a6b77683d6547db82cd02da9d9c938a P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.313550 24534 tablet_replica.cc:333] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
I20260709 12:26:18.320045 24534 raft_consensus.cc:2243] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:18.320878 24534 raft_consensus.cc:2272] T 7954a5254e674b77843c0d32002d2e90 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.327247 24534 tablet_replica.cc:333] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
I20260709 12:26:18.328027 24534 raft_consensus.cc:2243] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:18.328601 24534 raft_consensus.cc:2272] T d2487f95c174426ebe2cdfc51537aea3 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.331136 24534 tablet_replica.cc:333] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
I20260709 12:26:18.331830 24534 raft_consensus.cc:2243] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:18.348356 24534 raft_consensus.cc:2272] T 819272169f6f4293b6e279793be58b49 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.358855 24534 tablet_replica.cc:333] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
I20260709 12:26:18.359601 24534 raft_consensus.cc:2243] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:26:18.361996 24534 raft_consensus.cc:2272] T f5c104146a1c4ce1b19e2c6b5a1bf37a P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.371742 24534 tablet_replica.cc:333] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
I20260709 12:26:18.372550 24534 raft_consensus.cc:2243] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:18.373937 24534 raft_consensus.cc:2272] T ca85fa90ddc84c0680729add054d3003 P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.382705 24534 tablet_replica.cc:333] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
I20260709 12:26:18.383517 24534 raft_consensus.cc:2243] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:18.384153 24534 raft_consensus.cc:2272] T 3324229ffe6d4ca282dc77ffa254a5b2 P f82778701b464892aab92a752ed7ffdc [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.386741 24534 tablet_replica.cc:333] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
I20260709 12:26:18.387446 24534 raft_consensus.cc:2243] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:18.388008 24534 raft_consensus.cc:2272] T 90d850895b8a4a40a4fba5caf2048ca2 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.400619 24534 tablet_replica.cc:333] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
I20260709 12:26:18.401363 24534 raft_consensus.cc:2243] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:26:18.402560 24534 raft_consensus.cc:2272] T 58ab3e51ccf14577a94774f25ade6cd8 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.409852 24534 tablet_replica.cc:333] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
I20260709 12:26:18.410687 24534 raft_consensus.cc:2243] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:18.411362 24534 raft_consensus.cc:2272] T c38d3f292da44b3dbb2e512cd53e21da P f82778701b464892aab92a752ed7ffdc [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.420259 24534 tablet_replica.cc:333] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
I20260709 12:26:18.421065 24534 raft_consensus.cc:2243] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:18.421634 24534 raft_consensus.cc:2272] T c87d777e7d64471f988b07272bf2441c P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.424326 24534 tablet_replica.cc:333] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
I20260709 12:26:18.425057 24534 raft_consensus.cc:2243] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:18.436590 24534 raft_consensus.cc:2272] T d32f766d8f384968a837db40f23c072c P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.439534 24534 tablet_replica.cc:333] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
I20260709 12:26:18.440297 24534 raft_consensus.cc:2243] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:18.440846 24534 raft_consensus.cc:2272] T 8d74d1c9c8a84919a6f57b0b6721de51 P f82778701b464892aab92a752ed7ffdc [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.443243 24534 tablet_replica.cc:333] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
I20260709 12:26:18.444067 24534 raft_consensus.cc:2243] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:26:18.445080 24534 raft_consensus.cc:2272] T f1625669bcc54589846d8a3d94c097d4 P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.447620 24534 tablet_replica.cc:333] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
I20260709 12:26:18.454165 24534 raft_consensus.cc:2243] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:26:18.462570 24534 raft_consensus.cc:2272] T ea014f5d4c6744b9b7032f2fa25b4165 P f82778701b464892aab92a752ed7ffdc [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.465163 24534 tablet_replica.cc:333] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
I20260709 12:26:18.469522 24534 raft_consensus.cc:2243] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:18.473618 24534 raft_consensus.cc:2272] T 4734c282e09b4bbbb96de8eee61c160a P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.476258 24534 tablet_replica.cc:333] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
I20260709 12:26:18.476917 24534 raft_consensus.cc:2243] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:18.482386 24534 raft_consensus.cc:2272] T b12e2b074f1b4518bcfc6728abeca136 P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.484946 24534 tablet_replica.cc:333] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
I20260709 12:26:18.485584 24534 raft_consensus.cc:2243] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:18.493567 24534 raft_consensus.cc:2272] T 0c043718ee3a40fea4b2b1453fcb259b P f82778701b464892aab92a752ed7ffdc [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.496629 24534 tablet_replica.cc:333] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
I20260709 12:26:18.497347 24534 raft_consensus.cc:2243] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:18.497880 24534 raft_consensus.cc:2272] T ca1c66d4736542ecb25b33fab43ae780 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.500305 24534 tablet_replica.cc:333] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
I20260709 12:26:18.500944 24534 raft_consensus.cc:2243] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:18.501468 24534 raft_consensus.cc:2272] T 522704a36135481fa4fc221fa9a0801e P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.503882 24534 tablet_replica.cc:333] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
I20260709 12:26:18.517503 24534 raft_consensus.cc:2243] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:26:18.522172 24534 raft_consensus.cc:2272] T 97d7984a0036411695d6b3427bff9d69 P f82778701b464892aab92a752ed7ffdc [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.524641 24534 tablet_replica.cc:333] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
I20260709 12:26:18.525286 24534 raft_consensus.cc:2243] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:26:18.533965 24534 raft_consensus.cc:2272] T 06bd2840931844279521c7e8eb8750bf P f82778701b464892aab92a752ed7ffdc [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.536453 24534 tablet_replica.cc:333] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc: stopping tablet replica
I20260709 12:26:18.537060 24534 raft_consensus.cc:2243] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 22 LEADER]: Raft consensus shutting down.
W20260709 12:26:18.550015 25569 catalog_manager.cc:4755] TS f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): ChangeConfig:REMOVE_PEER RPC failed for tablet 58ab3e51ccf14577a94774f25ade6cd8: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:18.552351 24534 raft_consensus.cc:2272] T 14252b42f20346a5b1ae15409e129b12 P f82778701b464892aab92a752ed7ffdc [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:18.611241 26402 consensus_peers.cc:597] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:18.634730 26402 consensus_peers.cc:597] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:18.722716 26402 consensus_peers.cc:597] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:18.809317   623 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:18.809894   623 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:18.812376   623 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:18.815038 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:26:18.833699 25801 consensus_peers.cc:597] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:18.865546 25801 consensus_peers.cc:597] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:18.867592 26402 leader_election.cc:336] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:18.868248 26402 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
W20260709 12:26:18.870932 26402 consensus_peers.cc:597] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:18.870990   623 raft_consensus.cc:2749] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:26:18.878751 25801 consensus_peers.cc:597] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:18.885967 26402 consensus_peers.cc:597] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:18.921001 26402 consensus_peers.cc:597] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:19.128010 25801 consensus_peers.cc:597] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:19.135491 25801 consensus_peers.cc:597] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:19.142787 25801 consensus_peers.cc:597] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:19.179143   705 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:19.179749   705 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:19.182101   705 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:26:19.191359 25726 leader_election.cc:336] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
W20260709 12:26:19.203598 25801 consensus_peers.cc:597] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:19.208282   699 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:19.208855   699 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:19.211140   699 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:19.213295 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:19.213910 25833 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 22.
I20260709 12:26:19.214195 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:19.214788 25762 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 22.
I20260709 12:26:19.220633 25726 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:26:19.221518   625 raft_consensus.cc:2804] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:26:19.221946   625 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:19.222337   625 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:26:19.234347 26402 consensus_peers.cc:597] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:19.221171 25801 leader_election.cc:336] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:19.247327 25800 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:26:19.248361   708 raft_consensus.cc:2804] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:26:19.248826   708 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:19.249230   708 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:19.264047   625 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:19.278116   708 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:19.280612   708 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 23 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:19.276768   625 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 23 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:19.284364 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:26:19.285192 25761 raft_consensus.cc:2393] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 23: Already voted for candidate 6e673265293d4e9a937dc45150aeb1b8 in this term.
W20260709 12:26:19.285657 25726 leader_election.cc:336] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:19.285998 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:19.286671 25833 raft_consensus.cc:2393] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 23: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
W20260709 12:26:19.289113 25801 leader_election.cc:336] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:19.289541 25726 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:19.289618 25801 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:19.290300   703 raft_consensus.cc:2749] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:26:19.291611   708 raft_consensus.cc:2749] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:26:19.307824 25837 consensus_queue.cc:237] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:19.326236 26431 raft_consensus.cc:1275] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:26:19.330458   710 consensus_queue.cc:1048] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:26:19.339123 25801 consensus_peers.cc:597] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:19.341552   625 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:19.342104   625 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:19.344161   625 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:19.349442   708 raft_consensus.cc:2955] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index 3 to 10, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:19.351259 26432 raft_consensus.cc:2955] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 3 to 10, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:19.352921 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:19.353531 26434 raft_consensus.cc:2468] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 18.
I20260709 12:26:19.356151 25726 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:26:19.356907   703 raft_consensus.cc:2804] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:19.357255   703 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:19.357578   703 raft_consensus.cc:3060] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:26:19.365995 25726 leader_election.cc:336] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:19.374475 25569 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5aae9f34f7154346afd482b3183ee180 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 14)
I20260709 12:26:19.379897   703 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:19.380983 25584 catalog_manager.cc:5697] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: config changed from index 3 to 10, VOTER 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) evicted. New cstate: current_term: 12 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
W20260709 12:26:19.393313 25801 consensus_peers.cc:597] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:19.389624 25726 leader_election.cc:336] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:19.408123   703 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:19.410346 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05232536e53b419682a5f24515843652" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:26:19.410987 26432 raft_consensus.cc:3060] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:19.412765   710 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:19.413406   710 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:19.417943 26432 raft_consensus.cc:2468] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 19.
I20260709 12:26:19.413409   636 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:19.419236   636 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:19.420192   625 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:19.420712   625 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:19.422624   625 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:19.423043 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:19.424115   636 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:19.423704 25761 raft_consensus.cc:2468] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 15.
I20260709 12:26:19.424706 25726 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:26:19.425314   710 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:19.425768 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:19.426271   623 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:19.426151   703 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:19.442181   703 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:19.445391   703 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:26:19.448051 25801 leader_election.cc:336] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:19.447887   623 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:19.449234 26401 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:26:19.450201   667 raft_consensus.cc:2804] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:19.450641   667 raft_consensus.cc:493] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:19.450814   623 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:19.451105   667 raft_consensus.cc:3060] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:19.452258 25800 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
W20260709 12:26:19.453410 26402 leader_election.cc:336] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:19.454185   710 raft_consensus.cc:2749] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:19.462044   703 raft_consensus.cc:2804] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:19.462591   703 raft_consensus.cc:697] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:26:19.463821 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:19.463670   703 consensus_queue.cc:237] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:19.464530 25762 raft_consensus.cc:2468] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 17.
I20260709 12:26:19.468889 26401 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:26:19.475881 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:19.481565   667 raft_consensus.cc:515] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:19.483992 26432 raft_consensus.cc:2393] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6e673265293d4e9a937dc45150aeb1b8 in current term 16: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:26:19.487541 26434 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:19.473766   623 raft_consensus.cc:2804] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:19.488703 26434 raft_consensus.cc:2468] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 17.
I20260709 12:26:19.489439   623 raft_consensus.cc:493] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:19.489890   623 raft_consensus.cc:3060] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:19.495788   625 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:19.496354   625 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:19.498471   625 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:26:19.499758 26402 leader_election.cc:336] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:19.505867   623 raft_consensus.cc:515] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:19.506449 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06c3ab7c0c7a496390151c476ec675a0" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:26:19.507081 25762 raft_consensus.cc:3060] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:19.508219   623 leader_election.cc:290] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:19.513995 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04fe73edd8db49c08ea7a6adb6e443e6" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:26:19.514611 25761 raft_consensus.cc:3060] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:19.515638   710 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:19.516157   710 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:19.518194   710 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:19.521978   710 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
W20260709 12:26:19.522758 26402 leader_election.cc:336] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:19.522815 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:19.524422 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:19.528182 25761 raft_consensus.cc:2468] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 18.
I20260709 12:26:19.525275   667 leader_election.cc:290] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:26:19.525434 25801 leader_election.cc:336] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:19.529340 25762 raft_consensus.cc:2468] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 16.
I20260709 12:26:19.531392   708 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:19.531260   710 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:19.531884   708 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:19.530079 25801 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:19.534211   708 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:19.534901   708 raft_consensus.cc:2749] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:19.536654   704 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:19.537246   704 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:19.539520   704 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:19.533505   710 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:26:19.541580 25801 leader_election.cc:336] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:19.542347   636 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
W20260709 12:26:19.543027 25801 leader_election.cc:336] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:19.542884   636 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:19.543320 25726 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:26:19.544461   705 raft_consensus.cc:2764] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 12:26:19.545378   636 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:26:19.546401 25726 leader_election.cc:336] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:19.546880 25726 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:19.549284 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:26:19.550462 26402 leader_election.cc:336] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:19.553035 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:19.553462 25800 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:19.553706 25833 raft_consensus.cc:2468] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 13.
I20260709 12:26:19.555081   625 raft_consensus.cc:2749] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:19.555709 26401 leader_election.cc:304] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:26:19.555121   708 raft_consensus.cc:2749] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:19.556519   636 raft_consensus.cc:2804] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:26:19.556929 25726 leader_election.cc:336] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:19.557054   636 raft_consensus.cc:697] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 18 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
W20260709 12:26:19.557870 25726 consensus_peers.cc:597] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:19.558406 25726 consensus_peers.cc:597] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:19.558030   636 consensus_queue.cc:237] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:19.559504 26401 leader_election.cc:304] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:26:19.560246   667 raft_consensus.cc:2804] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:19.560747   667 raft_consensus.cc:697] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 16 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:26:19.561630   667 consensus_queue.cc:237] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:19.560264 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:19.563877 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:19.566179 26432 raft_consensus.cc:2468] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 13.
I20260709 12:26:19.567262 25801 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:26:19.570433   710 raft_consensus.cc:2804] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:19.570979   710 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:19.571338   710 raft_consensus.cc:3060] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:26:19.571851 26402 leader_election.cc:336] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:19.572805 26402 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:19.573529   704 raft_consensus.cc:2749] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:19.578667   625 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:19.579213   625 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:26:19.580308 26402 leader_election.cc:336] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:19.581176   625 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:19.582816   710 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:26:19.579630 25726 leader_election.cc:336] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:19.587360 25726 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:19.588148   625 raft_consensus.cc:2749] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:19.591733   710 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:19.593449 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5204a6a2db104ffa90f8679086d4e6f8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:26:19.594106 26432 raft_consensus.cc:3060] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:19.581120 26402 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
W20260709 12:26:19.600028 25801 leader_election.cc:336] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:19.605556   705 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:19.606181   705 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:19.608146 26432 raft_consensus.cc:2468] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 14.
I20260709 12:26:19.608691   667 raft_consensus.cc:2764] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:26:19.609084   705 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:19.611145 25801 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:26:19.612206   710 raft_consensus.cc:2804] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:19.612718   710 raft_consensus.cc:697] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 14 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:26:19.613391   626 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:19.613709   710 consensus_queue.cc:237] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:26:19.617650 26402 consensus_peers.cc:597] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:19.613952   626 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:19.619856   626 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:19.620509   667 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:19.621225   667 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:19.622429 25753 tablet_service.cc:1558] Processing DeleteTablet for tablet 5aae9f34f7154346afd482b3183ee180 with delete_type TABLET_DATA_TOMBSTONED (TS 6e673265293d4e9a937dc45150aeb1b8 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:38410
I20260709 12:26:19.621253 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:19.624579   667 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:19.625397 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:19.626031 25758 raft_consensus.cc:2468] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 20.
I20260709 12:26:19.628304   703 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:19.628237 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:19.629060 25833 raft_consensus.cc:2468] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 19.
I20260709 12:26:19.629467 25800 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:26:19.629773   703 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:19.630549   709 raft_consensus.cc:2804] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:19.630949   709 raft_consensus.cc:493] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:19.631301   709 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:19.633105   703 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:26:19.633929 26402 leader_election.cc:336] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
W20260709 12:26:19.634135 25801 leader_election.cc:336] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:19.634967 26402 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:26:19.635898   667 raft_consensus.cc:2804] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:19.636369   667 raft_consensus.cc:493] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:19.636803   667 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:19.646586   709 raft_consensus.cc:515] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:19.650264   667 raft_consensus.cc:515] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:19.651248   703 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:19.654634 25577 catalog_manager.cc:5697] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 18 to 19, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 19 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:19.651775   703 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:26:19.657011 26402 leader_election.cc:336] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:19.657814   703 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:19.659091 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c104146a1c4ce1b19e2c6b5a1bf37a" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:19.659693 25833 raft_consensus.cc:3060] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:19.650012 25578 catalog_manager.cc:5697] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 17 to 18, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 18 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:19.664613   623 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:19.665117   623 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:19.665352 25758 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f50d78c25fc8461f8670d3708bbce774" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 21 candidate_status { last_received { term: 20 index: 10 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:26:19.666117 25758 raft_consensus.cc:3060] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:19.667253   623 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:19.660799 25578 catalog_manager.cc:5697] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 15 to 16, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 16 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:19.669534   626 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:19.658982   667 leader_election.cc:290] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:19.671677 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:19.672061 25833 raft_consensus.cc:2468] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 20.
I20260709 12:26:19.663633   709 leader_election.cc:290] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 21 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:26:19.674520 25726 consensus_peers.cc:597] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:19.675475 26402 leader_election.cc:304] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:26:19.670049   626 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:19.686048   626 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:19.683032 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:19.689303 25758 raft_consensus.cc:2468] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 21.
I20260709 12:26:19.688251 25837 raft_consensus.cc:2468] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 18.
I20260709 12:26:19.689654 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:19.690326 25761 raft_consensus.cc:2468] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 18.
W20260709 12:26:19.690642 25726 leader_election.cc:336] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:19.691088 25726 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:19.691876 25800 leader_election.cc:304] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:26:19.692610   623 raft_consensus.cc:2804] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:26:19.692791   721 tablet_replica.cc:333] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
I20260709 12:26:19.693811   721 raft_consensus.cc:2243] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:19.694159   623 raft_consensus.cc:697] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 20 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:26:19.694489   721 raft_consensus.cc:2272] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:19.695262 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:19.695211   623 consensus_queue.cc:237] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:26:19.696231 26402 leader_election.cc:336] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:19.696672 26402 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:19.697027   709 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 24 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:19.697431   715 raft_consensus.cc:2749] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:19.697506   709 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:19.698945   699 raft_consensus.cc:2804] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:26:19.699472   699 raft_consensus.cc:697] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 21 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:26:19.699649   709 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:19.700327   699 consensus_queue.cc:237] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 20.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:19.702919 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:19.703228 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:19.703533 25837 raft_consensus.cc:2468] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 18.
I20260709 12:26:19.703771 25833 raft_consensus.cc:2468] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 18.
I20260709 12:26:19.705332 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
W20260709 12:26:19.719744 25801 leader_election.cc:336] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
W20260709 12:26:19.720557 25801 consensus_peers.cc:597] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:19.722841 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:19.707682   705 raft_consensus.cc:2749] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:19.746626 25726 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:26:19.747574   625 raft_consensus.cc:2804] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:26:19.747675 25801 leader_election.cc:336] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:19.748035   625 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:19.748276 25801 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:19.749585   625 raft_consensus.cc:3060] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:26:19.753010 25801 leader_election.cc:336] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
W20260709 12:26:19.752179 24534 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 25708)
I20260709 12:26:19.749796   698 raft_consensus.cc:2749] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:26:19.763443 25801 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:19.747511 25726 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:26:19.764477   626 raft_consensus.cc:2749] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:19.768778   721 ts_tablet_manager.cc:1916] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:19.771510   704 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:19.772089   704 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:19.776743 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:19.777575 25762 raft_consensus.cc:2468] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 18.
W20260709 12:26:19.780544 26402 leader_election.cc:336] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:19.781302 26401 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:26:19.782294   667 raft_consensus.cc:2804] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:19.782694   667 raft_consensus.cc:493] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:19.783051   667 raft_consensus.cc:3060] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:26:19.794441 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 46991.5us
I20260709 12:26:19.774412   704 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:19.796437   703 raft_consensus.cc:2804] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:19.797586   715 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:19.820760   715 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:19.823982   625 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:19.825475 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:19.826305 25762 raft_consensus.cc:2468] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 18.
I20260709 12:26:19.826323   625 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:19.819882   703 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:19.831051 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:19.832134 25837 raft_consensus.cc:2468] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 18.
I20260709 12:26:19.816457   698 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:19.834513   698 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:19.836661   698 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:19.839159   667 raft_consensus.cc:515] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:19.823683   715 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:19.841974 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:19.846997 25761 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1625669bcc54589846d8a3d94c097d4" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:26:19.845644   667 leader_election.cc:290] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:19.847668 25761 raft_consensus.cc:3060] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:19.855710   721 ts_tablet_manager.cc:1929] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.9
I20260709 12:26:19.857504   721 log.cc:1199] T 5aae9f34f7154346afd482b3183ee180 P 6e673265293d4e9a937dc45150aeb1b8: Deleting WAL directory at /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-1-root/wals/5aae9f34f7154346afd482b3183ee180
I20260709 12:26:19.859762 25568 catalog_manager.cc:5028] TS 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): tablet 5aae9f34f7154346afd482b3183ee180 (table test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]) successfully deleted
W20260709 12:26:19.862552 25801 leader_election.cc:336] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:19.863004 25801 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:19.863677   698 raft_consensus.cc:2749] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:26:19.831828   703 raft_consensus.cc:3060] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:19.873986   698 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:19.874544   698 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:19.875519 26402 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:26:19.876688   698 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:19.882048 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:19.892529   667 raft_consensus.cc:2804] T 58ab3e51ccf14577a94774f25ade6cd8 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:19.892571 26431 raft_consensus.cc:2468] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 19.
I20260709 12:26:19.893051   667 raft_consensus.cc:493] T 58ab3e51ccf14577a94774f25ade6cd8 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
W20260709 12:26:19.893088 26402 leader_election.cc:336] T 58ab3e51ccf14577a94774f25ade6cd8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:19.893585   667 raft_consensus.cc:3060] T 58ab3e51ccf14577a94774f25ade6cd8 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:19.891326 25578 catalog_manager.cc:5697] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 13 to 14, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 14 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:19.897670 26402 leader_election.cc:336] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
W20260709 12:26:19.891077 25801 leader_election.cc:336] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
W20260709 12:26:19.900838 25801 consensus_peers.cc:597] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:19.901744 25801 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:26:19.903759   698 raft_consensus.cc:2804] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:19.904255   698 raft_consensus.cc:493] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:19.904654   698 raft_consensus.cc:3060] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:19.906059   667 raft_consensus.cc:515] T 58ab3e51ccf14577a94774f25ade6cd8 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:19.910100 25762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:26:19.910651 25762 raft_consensus.cc:3060] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:19.913188   625 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:19.913738   625 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:19.915735   625 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:19.922799   667 leader_election.cc:290] T 58ab3e51ccf14577a94774f25ade6cd8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:19.925340 25578 catalog_manager.cc:5697] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 19 to 20, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 20 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:19.927901 25762 raft_consensus.cc:2468] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 19.
I20260709 12:26:19.891556 25761 raft_consensus.cc:2468] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 19.
I20260709 12:26:19.931049   703 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:19.931334 26401 leader_election.cc:304] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:26:19.939375   715 raft_consensus.cc:2804] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:19.940133   715 raft_consensus.cc:697] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 19 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:26:19.941234   715 consensus_queue.cc:237] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:19.942358   703 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:19.931994   698 raft_consensus.cc:515] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:19.934654 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "58ab3e51ccf14577a94774f25ade6cd8" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:19.965024 25833 raft_consensus.cc:3060] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:19.946816 25577 catalog_manager.cc:5697] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 20 to 21, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 21 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
W20260709 12:26:19.959076 26402 leader_election.cc:336] T 58ab3e51ccf14577a94774f25ade6cd8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
W20260709 12:26:19.953027 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 144634us
W20260709 12:26:19.966471 25726 consensus_peers.cc:597] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:19.967001 25726 leader_election.cc:336] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:19.967440 25726 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: a866ff967d964388a6f0dff7fd43df89, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:19.968292   725 raft_consensus.cc:2749] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:26:19.968593 25726 consensus_peers.cc:597] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:19.968024 26402 consensus_peers.cc:597] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:19.969138 25726 leader_election.cc:336] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
W20260709 12:26:19.969897 25726 leader_election.cc:336] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
W20260709 12:26:19.970650 25726 consensus_peers.cc:597] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:19.973392 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7939d783f9eb4a738d840145c79cf380" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:19.973954 25837 raft_consensus.cc:3060] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:19.979059   698 leader_election.cc:290] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:19.981434 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97d7984a0036411695d6b3427bff9d69" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:26:19.982095 26431 raft_consensus.cc:3060] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:19.983392 25837 raft_consensus.cc:2468] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 19.
I20260709 12:26:19.984100 25833 raft_consensus.cc:2468] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 19.
W20260709 12:26:19.986768 25801 leader_election.cc:336] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:19.990667 26432 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:19.991065 26431 raft_consensus.cc:2468] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 20.
I20260709 12:26:19.991339 26432 raft_consensus.cc:2468] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 15.
I20260709 12:26:19.992568 25801 leader_election.cc:304] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:26:19.994509   626 raft_consensus.cc:2804] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:26:19.995012   626 raft_consensus.cc:697] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 20 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:26:19.995844   626 consensus_queue.cc:237] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:19.999251 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03fbd3823c734a7d92ea482cf0d206b9" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:19.999826 25837 raft_consensus.cc:3060] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:20.000540 26402 leader_election.cc:304] T 58ab3e51ccf14577a94774f25ade6cd8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:26:20.001776   623 raft_consensus.cc:2804] T 58ab3e51ccf14577a94774f25ade6cd8 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:20.002349   623 raft_consensus.cc:697] T 58ab3e51ccf14577a94774f25ade6cd8 P a866ff967d964388a6f0dff7fd43df89 [term 19 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:26:20.003468   623 consensus_queue.cc:237] T 58ab3e51ccf14577a94774f25ade6cd8 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:20.005553   725 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:20.006062   725 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:20.008422 25837 raft_consensus.cc:2468] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 19.
I20260709 12:26:20.014966 25577 catalog_manager.cc:5697] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 18 to 19, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 19 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:26:20.020830 25615 debug-util.cc:398] Leaking SignalData structure 0x7b08002a9860 after lost signal to thread 24537
W20260709 12:26:20.022047 25615 debug-util.cc:398] Leaking SignalData structure 0x7b080036f100 after lost signal to thread 25618
W20260709 12:26:20.023345 25615 debug-util.cc:398] Leaking SignalData structure 0x7b0800034f20 after lost signal to thread 25787
W20260709 12:26:20.026309 25615 debug-util.cc:398] Leaking SignalData structure 0x7b0800041800 after lost signal to thread 25861
W20260709 12:26:20.027956 25615 debug-util.cc:398] Leaking SignalData structure 0x7b08001aa280 after lost signal to thread 26463
I20260709 12:26:20.019446   725 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:20.047830 25578 catalog_manager.cc:5697] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 19 to 20, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 20 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:20.043910 26402 consensus_peers.cc:597] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:20.044664 25801 consensus_peers.cc:597] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:20.112732 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 92166.6us
I20260709 12:26:20.114465 25726 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:26:20.116093 25726 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:26:20.116179   733 raft_consensus.cc:2804] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:20.117431   733 raft_consensus.cc:697] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:26:20.118374   733 consensus_queue.cc:237] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:20.127221 25833 raft_consensus.cc:1275] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:26:20.137142   667 consensus_queue.cc:1048] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:26:20.145509   705 raft_consensus.cc:2804] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:20.146202   705 raft_consensus.cc:697] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:26:20.147073   705 consensus_queue.cc:237] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:26:20.147404 26402 consensus_peers.cc:597] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:20.161087 25761 raft_consensus.cc:1275] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:26:20.183302 25726 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:26:20.184064   625 raft_consensus.cc:2804] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:20.184427   625 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:20.184777   625 raft_consensus.cc:3060] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:26:20.189908 26402 consensus_peers.cc:597] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:20.192791 25726 consensus_peers.cc:597] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:20.197798 25801 consensus_peers.cc:597] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:20.205577   625 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:20.208374 25578 catalog_manager.cc:5697] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 18 to 19, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 19 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:20.212131   623 consensus_queue.cc:1048] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:26:20.214910 25761 raft_consensus.cc:1275] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:26:20.217206 25577 catalog_manager.cc:5697] T 58ab3e51ccf14577a94774f25ade6cd8 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 18 to 19, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 19 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:20.224684 25828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:20.225402 25828 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 24.
I20260709 12:26:20.207403   625 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:20.230140 26431 raft_consensus.cc:1275] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:26:20.246162 25761 raft_consensus.cc:1275] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 20 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:26:20.248293   710 consensus_queue.cc:1048] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:20.271160   667 consensus_queue.cc:1048] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:26:20.273413   725 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:20.273967   725 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:26:20.281076 25569 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 58ab3e51ccf14577a94774f25ade6cd8 with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER failed with leader a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:26:20.285676   725 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:20.312027 26431 raft_consensus.cc:1275] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:26:20.322224   710 consensus_queue.cc:1048] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:26:20.322742 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06bd2840931844279521c7e8eb8750bf" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:26:20.323473 26431 raft_consensus.cc:3060] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:20.330376 26431 raft_consensus.cc:2468] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 16.
W20260709 12:26:20.536216 25726 leader_election.cc:336] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
W20260709 12:26:20.539629 25726 consensus_peers.cc:597] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:20.543819 25726 leader_election.cc:336] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
W20260709 12:26:20.544704 25726 leader_election.cc:336] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:20.587584 25762 raft_consensus.cc:1275] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:26:20.606397 25726 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:26:20.621554   703 raft_consensus.cc:2804] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:26:20.622015   703 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 24 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:20.622450   703 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:20.644115   745 consensus_queue.cc:1048] T 58ab3e51ccf14577a94774f25ade6cd8 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:26:20.652920 25760 raft_consensus.cc:1275] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:26:20.661759   733 consensus_queue.cc:1048] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:26:20.662321   754 consensus_queue.cc:1048] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:26:20.665864 25726 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:26:20.693007 25726 leader_election.cc:336] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
W20260709 12:26:20.694072 25726 consensus_peers.cc:597] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:20.694633 25726 consensus_peers.cc:597] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:20.695159 25726 leader_election.cc:336] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:20.690742   733 raft_consensus.cc:2804] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:26:20.698652   739 log.cc:927] Time spent T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.080s	user 0.000s	sys 0.004s
I20260709 12:26:20.707338 25578 catalog_manager.cc:5697] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 18 to 19, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 19 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:20.718037 26432 raft_consensus.cc:1275] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:26:20.725231   733 raft_consensus.cc:697] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 16 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:26:20.726266   733 consensus_queue.cc:237] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:20.715554   703 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:20.737018   703 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 25 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:26:20.755168 24534 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 25708)
W20260709 12:26:20.760545 26402 consensus_peers.cc:597] T 58ab3e51ccf14577a94774f25ade6cd8 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:20.761217 26402 consensus_peers.cc:597] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:20.771162   753 consensus_queue.cc:1048] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:26:20.800665 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:20.801433 25837 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 22.
I20260709 12:26:20.805744 25578 catalog_manager.cc:5697] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 15 to 16, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 16 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:20.850927 25726 consensus_peers.cc:597] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:20.882164 25726 leader_election.cc:336] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:20.883610   757 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:20.884202   757 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:20.884641 25833 raft_consensus.cc:1275] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:26:20.886298   757 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:26:20.916826 25726 consensus_peers.cc:597] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:20.920267 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8" is_pre_election: true
I20260709 12:26:20.919029 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea014f5d4c6744b9b7032f2fa25b4165" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:20.920964 25760 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 23.
W20260709 12:26:20.921002 25726 consensus_peers.cc:597] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:20.921571 25837 raft_consensus.cc:3060] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:26:20.922679 25726 consensus_peers.cc:597] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:20.929304 25837 raft_consensus.cc:2468] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 25.
I20260709 12:26:20.936796 25800 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
I20260709 12:26:20.942560   753 raft_consensus.cc:2804] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:26:20.943002   753 raft_consensus.cc:493] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:20.943397   753 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:26:20.943496 25801 leader_election.cc:336] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
W20260709 12:26:20.953198 25801 consensus_peers.cc:597] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:20.944492 25726 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:26:20.964800   762 raft_consensus.cc:2804] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:26:20.965286   762 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Starting leader election (detected failure of leader f82778701b464892aab92a752ed7ffdc)
I20260709 12:26:20.965734   762 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:20.973709   753 raft_consensus.cc:515] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:20.978181 25760 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74bf68992e4a43c78d2ef30e6c477746" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "6e673265293d4e9a937dc45150aeb1b8"
I20260709 12:26:20.978837 25760 raft_consensus.cc:3060] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:20.982734   753 leader_election.cc:290] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 24 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:20.983639   625 consensus_queue.cc:1048] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:20.986920   762 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:20.991571   762 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 23 election: Requested vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:20.989523 25726 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: 
W20260709 12:26:21.005846 25726 leader_election.cc:336] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:21.015878 25760 raft_consensus.cc:2468] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 24.
I20260709 12:26:21.018456   625 raft_consensus.cc:2804] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:26:21.019006   625 raft_consensus.cc:697] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 25 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
I20260709 12:26:21.019829   625 consensus_queue.cc:237] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:26:20.998806 25801 leader_election.cc:336] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:20.999143 25837 raft_consensus.cc:1275] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:26:21.041100 25577 catalog_manager.cc:5697] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 24 to 25, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 25 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:21.044584 25800 leader_election.cc:304] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:26:21.045451   757 raft_consensus.cc:2804] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:26:21.045943   757 raft_consensus.cc:697] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 24 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:26:21.046773   757 consensus_queue.cc:237] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:21.055738 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14252b42f20346a5b1ae15409e129b12" candidate_uuid: "6e673265293d4e9a937dc45150aeb1b8" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:21.056470 25837 raft_consensus.cc:3060] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:26:21.056058 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 57291.7us
W20260709 12:26:21.070297 25726 leader_election.cc:336] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:21.082617 25837 raft_consensus.cc:2468] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e673265293d4e9a937dc45150aeb1b8 in term 23.
I20260709 12:26:21.111479   745 consensus_queue.cc:1048] T 58ab3e51ccf14577a94774f25ade6cd8 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.002s
I20260709 12:26:21.156104 25584 catalog_manager.cc:5697] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 22 to 24, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 24 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:21.184742 25726 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8; no voters: f82778701b464892aab92a752ed7ffdc
I20260709 12:26:21.192780   625 raft_consensus.cc:2804] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:26:21.193264   625 raft_consensus.cc:697] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 23 LEADER]: Becoming Leader. State: Replica: 6e673265293d4e9a937dc45150aeb1b8, State: Running, Role: LEADER
W20260709 12:26:21.193543 25801 consensus_peers.cc:597] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:21.194157   625 consensus_queue.cc:237] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:26:21.219884 25801 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111) [suppressed 337 similar messages]
W20260709 12:26:21.222621 26402 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:36237, user_credentials={real_user=slave}} blocked reactor thread for 57854.9us
W20260709 12:26:21.240811 25801 consensus_peers.cc:597] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:21.248662 25584 catalog_manager.cc:5697] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: term changed from 22 to 23, leader changed from f82778701b464892aab92a752ed7ffdc (127.23.245.129) to 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130). New cstate: current_term: 23 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:21.295370 26402 consensus_peers.cc:597] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:21.327440 26430 raft_consensus.cc:1275] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 12:26:21.339074   773 log.cc:927] Time spent T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
W20260709 12:26:21.340090 25801 consensus_peers.cc:597] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:21.365867   775 consensus_queue.cc:1048] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:26:21.380875 25726 consensus_peers.cc:597] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:21.448495 26402 consensus_peers.cc:597] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:21.460893 26402 consensus_peers.cc:597] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:21.526415 25801 consensus_peers.cc:597] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:21.540716 26402 consensus_peers.cc:597] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:21.549757 25834 raft_consensus.cc:1275] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 25 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
W20260709 12:26:21.572511 25801 consensus_peers.cc:597] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:21.576730 26402 consensus_peers.cc:597] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:21.578821   775 consensus_queue.cc:1048] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:26:21.590807 25726 consensus_peers.cc:597] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:21.598665 25833 raft_consensus.cc:1275] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 23 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
W20260709 12:26:21.618223 25801 consensus_peers.cc:597] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:21.619946   775 consensus_queue.cc:1048] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:26:21.655196 25760 raft_consensus.cc:1275] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 24 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
I20260709 12:26:21.656970   753 consensus_queue.cc:1048] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:26:21.682062 25801 consensus_peers.cc:597] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:21.755672 24534 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 25708)
W20260709 12:26:21.773466 26402 consensus_peers.cc:597] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:21.800216 26402 consensus_peers.cc:597] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:21.834421 25726 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 77003.6us
W20260709 12:26:21.923470 25801 consensus_peers.cc:597] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:21.987805 25801 consensus_peers.cc:597] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:22.049067 25726 consensus_peers.cc:597] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:22.183564 25726 consensus_peers.cc:597] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:22.183353 25756 consensus_queue.cc:237] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:22.267174 26430 raft_consensus.cc:1275] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Refusing update from remote peer 6e673265293d4e9a937dc45150aeb1b8: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:26:22.270126   733 consensus_queue.cc:1048] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
W20260709 12:26:22.337777 25726 consensus_peers.cc:597] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:22.363602 26431 consensus_queue.cc:237] T 58ab3e51ccf14577a94774f25ade6cd8 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:26:22.391076 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 77234.8us
W20260709 12:26:22.395239 25726 consensus_peers.cc:597] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:22.420814 26402 consensus_peers.cc:597] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:22.422186 25726 consensus_peers.cc:597] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:22.425165   762 raft_consensus.cc:2955] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 5 to 12, VOTER 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:22.431500 25761 raft_consensus.cc:1275] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:26:22.433075   750 consensus_queue.cc:1048] T 58ab3e51ccf14577a94774f25ade6cd8 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 12:26:22.450569 26402 consensus_peers.cc:597] T 58ab3e51ccf14577a94774f25ade6cd8 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:22.463261 25568 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c87d777e7d64471f988b07272bf2441c with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 14)
I20260709 12:26:22.466351 25584 catalog_manager.cc:5697] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 reported cstate change: config changed from index 5 to 12, VOTER 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) evicted. New cstate: current_term: 15 leader_uuid: "6e673265293d4e9a937dc45150aeb1b8" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:26:22.474213 25801 consensus_peers.cc:597] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:22.488927   783 raft_consensus.cc:2955] T 58ab3e51ccf14577a94774f25ade6cd8 P a866ff967d964388a6f0dff7fd43df89 [term 19 LEADER]: Committing config change with OpId 19.16: config changed from index 14 to 16, VOTER 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:22.490743 25760 raft_consensus.cc:2955] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Committing config change with OpId 19.16: config changed from index 14 to 16, VOTER 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
I20260709 12:26:22.500625 25569 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 58ab3e51ccf14577a94774f25ade6cd8 with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 9)
I20260709 12:26:22.505686 26431 raft_consensus.cc:2955] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 5 to 12, VOTER 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } } }
W20260709 12:26:22.518532 25801 consensus_peers.cc:597] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:22.540239 25577 catalog_manager.cc:5697] T 58ab3e51ccf14577a94774f25ade6cd8 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: config changed from index 14 to 16, VOTER 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131) evicted. New cstate: current_term: 19 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:22.592236 25824 tablet_service.cc:1558] Processing DeleteTablet for tablet c87d777e7d64471f988b07272bf2441c with delete_type TABLET_DATA_TOMBSTONED (TS 5cccf20a8bff46dba6601f241d172b8a not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:44194
W20260709 12:26:22.630235 25726 consensus_peers.cc:597] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:22.638453 25801 consensus_peers.cc:597] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:22.652196 25821 tablet_service.cc:1558] Processing DeleteTablet for tablet 58ab3e51ccf14577a94774f25ade6cd8 with delete_type TABLET_DATA_TOMBSTONED (TS 5cccf20a8bff46dba6601f241d172b8a not found in new config with opid_index 16) from {username='slave'} at 127.0.0.1:44194
I20260709 12:26:22.670970   793 tablet_replica.cc:333] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
W20260709 12:26:22.692884 26402 consensus_peers.cc:597] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:22.694650 26402 consensus_peers.cc:597] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:22.717940 25801 consensus_peers.cc:597] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:22.722847 26402 consensus_peers.cc:597] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:22.756189 24534 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 25708)
I20260709 12:26:22.757893   793 raft_consensus.cc:2243] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:22.758636   793 raft_consensus.cc:2272] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:22.761790   793 ts_tablet_manager.cc:1916] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:26:22.770066 25726 consensus_peers.cc:597] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:22.779526 25726 consensus_peers.cc:597] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:22.797648   793 ts_tablet_manager.cc:1929] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.11
I20260709 12:26:22.798343   793 log.cc:1199] T c87d777e7d64471f988b07272bf2441c P 5cccf20a8bff46dba6601f241d172b8a: Deleting WAL directory at /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-2-root/wals/c87d777e7d64471f988b07272bf2441c
I20260709 12:26:22.802546 25569 catalog_manager.cc:5028] TS 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): tablet c87d777e7d64471f988b07272bf2441c (table test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]) successfully deleted
I20260709 12:26:22.809209   793 tablet_replica.cc:333] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
I20260709 12:26:22.810503   793 raft_consensus.cc:2243] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:22.811476   793 raft_consensus.cc:2272] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:22.814705   793 ts_tablet_manager.cc:1916] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:22.855654   793 ts_tablet_manager.cc:1929] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 19.15
I20260709 12:26:22.868104   793 log.cc:1199] T 58ab3e51ccf14577a94774f25ade6cd8 P 5cccf20a8bff46dba6601f241d172b8a: Deleting WAL directory at /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599704270295-24534-0/minicluster-data/ts-2-root/wals/58ab3e51ccf14577a94774f25ade6cd8
I20260709 12:26:22.870038 25569 catalog_manager.cc:5028] TS 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): tablet 58ab3e51ccf14577a94774f25ade6cd8 (table test-workload [id=a94559b7cd8f4f5e987a5dbf477605d3]) successfully deleted
W20260709 12:26:22.880744 26402 consensus_peers.cc:597] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:23.015870 25726 consensus_peers.cc:597] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:23.035060 25726 consensus_peers.cc:597] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:23.059677 25726 consensus_peers.cc:597] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:23.109426 26402 consensus_peers.cc:597] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:23.163347 25726 consensus_peers.cc:597] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:23.178613 25726 consensus_peers.cc:597] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:23.437570 25726 consensus_peers.cc:597] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:23.464140 25801 consensus_peers.cc:597] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:23.465281 25726 consensus_peers.cc:597] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:23.691064 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 66221.4us
W20260709 12:26:23.721825 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 49837.8us
W20260709 12:26:23.722769 25801 consensus_peers.cc:597] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:23.756913 24534 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 25708)
W20260709 12:26:23.770324 25726 consensus_peers.cc:597] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:23.817425 25801 consensus_peers.cc:597] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:23.849562 25801 consensus_peers.cc:597] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:23.850467 26402 consensus_peers.cc:597] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:23.877799 26402 consensus_peers.cc:597] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:23.917713 25801 consensus_peers.cc:597] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:23.999307 26402 consensus_peers.cc:597] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:24.000218 26402 consensus_peers.cc:597] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:24.056480 26402 consensus_peers.cc:597] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:24.095644 25726 consensus_peers.cc:597] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:24.132712 25801 consensus_peers.cc:597] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:24.140117 26402 consensus_peers.cc:597] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:24.236960 26402 consensus_peers.cc:597] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:24.285378 25801 consensus_peers.cc:597] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:24.301105 25801 consensus_peers.cc:597] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:24.410005 25801 consensus_peers.cc:597] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:24.505853 25726 consensus_peers.cc:597] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:24.551296 25726 consensus_peers.cc:597] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:24.696761 26402 consensus_peers.cc:597] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:24.702628 25801 consensus_peers.cc:597] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:24.757611 24534 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 25708)
W20260709 12:26:24.795995 26402 consensus_peers.cc:597] T 58ab3e51ccf14577a94774f25ade6cd8 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:24.835813 25801 consensus_peers.cc:597] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:24.861963 25726 consensus_peers.cc:597] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:24.898763 25801 consensus_peers.cc:597] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:24.998457 25726 consensus_peers.cc:597] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:25.027621 25726 consensus_peers.cc:597] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:25.068434 25726 consensus_peers.cc:597] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:25.097913 26402 consensus_peers.cc:597] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:25.131225 25801 consensus_peers.cc:597] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:25.166440 25801 consensus_peers.cc:597] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:25.187121 26402 consensus_peers.cc:597] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:25.319520 26402 consensus_peers.cc:597] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:25.335229 25726 consensus_peers.cc:597] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:25.393659 26402 consensus_peers.cc:597] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:25.483675 25726 consensus_peers.cc:597] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:25.545253 25726 consensus_peers.cc:597] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:25.586987 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 55219us
W20260709 12:26:25.613163 25800 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 65946us
W20260709 12:26:25.616060 25726 consensus_peers.cc:597] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:25.756417 25726 consensus_peers.cc:597] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:25.758113 24534 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 25708)
W20260709 12:26:25.758837 25726 consensus_peers.cc:597] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:25.805514 26402 consensus_peers.cc:597] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:25.816220 25726 consensus_peers.cc:597] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:25.943746 25801 consensus_peers.cc:597] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:26.074165 25801 consensus_peers.cc:597] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:26.103008 25726 consensus_peers.cc:597] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:26.183658 25726 consensus_peers.cc:597] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:26.223836 26402 consensus_peers.cc:597] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:26.231479 26402 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111) [suppressed 452 similar messages]
W20260709 12:26:26.272516 25726 consensus_peers.cc:597] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:26.344977 26402 consensus_peers.cc:597] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:26.381819 25801 consensus_peers.cc:597] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:26.427352 25801 consensus_peers.cc:597] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:26.460180 25801 consensus_peers.cc:597] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:26.480136 26402 consensus_peers.cc:597] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:26.515985 26402 consensus_peers.cc:597] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:26.534657 25726 consensus_peers.cc:597] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:26.594269 26402 consensus_peers.cc:597] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:26.598306 26402 consensus_peers.cc:597] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:26.758706 24534 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 25708)
W20260709 12:26:26.817052 25801 consensus_peers.cc:597] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:26.850149 25801 consensus_peers.cc:597] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:26.854820 25801 consensus_peers.cc:597] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:26.860505 25801 consensus_peers.cc:597] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:26.861016 26402 consensus_peers.cc:597] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:26.903764 25726 consensus_peers.cc:597] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:27.188942 26402 consensus_peers.cc:597] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:27.223816 25726 consensus_peers.cc:597] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:27.282863 25801 consensus_peers.cc:597] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:27.358176 25801 consensus_peers.cc:597] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:27.389573 26402 consensus_peers.cc:597] T 58ab3e51ccf14577a94774f25ade6cd8 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:27.401875 26402 consensus_peers.cc:597] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:27.446455 25801 consensus_peers.cc:597] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:27.469257 26402 consensus_peers.cc:597] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:27.488874 25726 consensus_peers.cc:597] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:27.542860 25726 consensus_peers.cc:597] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:27.568233 25801 consensus_peers.cc:597] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:27.580821 25726 consensus_peers.cc:597] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:27.642155 25726 consensus_peers.cc:597] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:27.696599 26402 consensus_peers.cc:597] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:27.731490 25801 consensus_peers.cc:597] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:27.741984 26402 consensus_peers.cc:597] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:27.759373 24534 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 25708)
W20260709 12:26:27.759958 25726 consensus_peers.cc:597] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:27.987882 25726 consensus_peers.cc:597] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:28.146409 25726 consensus_peers.cc:597] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:28.263195 25726 consensus_peers.cc:597] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:28.263759 26402 consensus_peers.cc:597] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:28.300751 25726 consensus_peers.cc:597] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:28.337920 25726 consensus_peers.cc:597] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:28.536571 25801 consensus_peers.cc:597] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:28.697192 26402 consensus_peers.cc:597] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:28.713943 25726 consensus_peers.cc:597] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:28.731647 25726 consensus_peers.cc:597] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:28.759860 24534 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 25708)
W20260709 12:26:28.766281 25726 consensus_peers.cc:597] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:28.824180 25801 consensus_peers.cc:597] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:28.861743 25801 consensus_peers.cc:597] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:28.863241 25726 consensus_peers.cc:597] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:28.906621 26402 consensus_peers.cc:597] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:28.998107 26402 consensus_peers.cc:597] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:29.041945 26402 consensus_peers.cc:597] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:29.060931 25801 consensus_peers.cc:597] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:29.113940 26402 consensus_peers.cc:597] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:29.169723 25726 consensus_peers.cc:597] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:29.177412 25801 consensus_peers.cc:597] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:29.193149 25801 consensus_peers.cc:597] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:29.229059 25801 consensus_peers.cc:597] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:29.280534 25801 consensus_peers.cc:597] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:29.310540 26402 consensus_peers.cc:597] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:29.427971 26402 consensus_peers.cc:597] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:29.475180 25801 consensus_peers.cc:597] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:29.500768 25726 consensus_peers.cc:597] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:29.573251 25726 consensus_peers.cc:597] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:29.760828 24534 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 25708)
W20260709 12:26:29.780359 25801 consensus_peers.cc:597] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:29.783901 26402 consensus_peers.cc:597] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:29.799229 25801 consensus_peers.cc:597] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:29.905531 25801 consensus_peers.cc:597] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:29.973320 25801 consensus_peers.cc:597] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:29.979714 26402 consensus_peers.cc:597] T 58ab3e51ccf14577a94774f25ade6cd8 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:30.084172 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 67882.9us
W20260709 12:26:30.122044 25801 consensus_peers.cc:597] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:30.136111 26402 consensus_peers.cc:597] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:30.156378 25726 consensus_peers.cc:597] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:30.160414 25726 consensus_peers.cc:597] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:30.161048 25726 consensus_peers.cc:597] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:30.181073 26402 consensus_peers.cc:597] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:30.244231 26402 consensus_peers.cc:597] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:30.252110 25726 consensus_peers.cc:597] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:30.277269 26402 consensus_peers.cc:597] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:30.400410 25726 consensus_peers.cc:597] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:30.479051 25726 consensus_peers.cc:597] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:30.500952 25726 consensus_peers.cc:597] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:30.520164 25726 consensus_peers.cc:597] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:30.891867 25801 consensus_peers.cc:597] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:30.895262 25726 consensus_peers.cc:597] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:30.902138 25726 consensus_peers.cc:597] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:30.967109 26402 consensus_peers.cc:597] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:31.041253 26401 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:37267, user_credentials={real_user=slave}} blocked reactor thread for 50586.9us
W20260709 12:26:31.153241 26402 consensus_peers.cc:597] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:31.246803 25726 consensus_peers.cc:597] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:31.258100 25726 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111) [suppressed 440 similar messages]
W20260709 12:26:31.262431 26402 consensus_peers.cc:597] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:31.338225 25801 consensus_peers.cc:597] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:31.355701 25726 consensus_peers.cc:597] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:31.413851 25801 consensus_peers.cc:597] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:31.416364 25726 consensus_peers.cc:597] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:31.488361 25801 consensus_peers.cc:597] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:26:31.545096 24534 tablet_server.cc:196] TabletServer@127.23.245.129:0 shutdown complete.
W20260709 12:26:31.666417 25726 consensus_peers.cc:597] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:31.754416 26402 consensus_peers.cc:597] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:31.760005 26402 consensus_peers.cc:597] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:31.767182 25801 consensus_peers.cc:597] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:31.832077 25801 consensus_peers.cc:597] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:31.840201 26402 consensus_peers.cc:597] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:31.870484 25801 consensus_peers.cc:597] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:26:31.893899 24534 tablet_server.cc:179] TabletServer@127.23.245.130:0 shutting down...
W20260709 12:26:31.913300 26460 debug-util.cc:398] Leaking SignalData structure 0x7b08002f9c40 after lost signal to thread 24537
W20260709 12:26:31.914494 26460 debug-util.cc:398] Leaking SignalData structure 0x7b08002ee2c0 after lost signal to thread 25618
W20260709 12:26:31.915740 26460 debug-util.cc:398] Leaking SignalData structure 0x7b0800209be0 after lost signal to thread 25787
W20260709 12:26:31.917418 26460 debug-util.cc:398] Leaking SignalData structure 0x7b08002ac200 after lost signal to thread 25861
W20260709 12:26:31.918547 26460 debug-util.cc:398] Leaking SignalData structure 0x7b08003915a0 after lost signal to thread 26463
W20260709 12:26:31.920953 26401 consensus_peers.cc:597] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:31.930668 26402 consensus_peers.cc:597] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:31.939947 25800 consensus_peers.cc:597] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:31.977528 25801 consensus_peers.cc:597] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:31.985276 26401 consensus_peers.cc:597] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:31.992928 26401 consensus_peers.cc:597] T 58ab3e51ccf14577a94774f25ade6cd8 P a866ff967d964388a6f0dff7fd43df89 -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:32.011893 25726 consensus_peers.cc:597] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:32.013996 26402 consensus_peers.cc:597] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:32.022333 25800 consensus_peers.cc:597] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:32.026015 25726 consensus_peers.cc:597] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:32.029573 26401 consensus_peers.cc:597] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:32.044409 26401 consensus_peers.cc:597] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:32.050283 25801 consensus_peers.cc:597] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:26:32.073776 24534 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:26:32.080878 26401 consensus_peers.cc:597] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:32.081948 24534 tablet_replica.cc:333] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
I20260709 12:26:32.083204 24534 raft_consensus.cc:2243] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:26:32.084551 24534 raft_consensus.cc:2272] T 022a05e9e59f4ddf8f793ff24696476d P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.087522 24534 tablet_replica.cc:333] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
I20260709 12:26:32.088496 24534 raft_consensus.cc:2243] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:32.095152 24534 raft_consensus.cc:2272] T 2a278e46eb5d49edab4ba69303448a66 P 6e673265293d4e9a937dc45150aeb1b8 [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:32.096755 25800 consensus_peers.cc:597] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:32.101126 26401 consensus_peers.cc:597] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:32.103945 24534 tablet_replica.cc:333] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
I20260709 12:26:32.110616 24534 raft_consensus.cc:2243] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:26:32.111901 24534 raft_consensus.cc:2272] T 2d9ca842256c405c98d29454943e5d01 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:32.112226 25801 consensus_peers.cc:597] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:26:32.125689 24534 tablet_replica.cc:333] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
I20260709 12:26:32.126801 24534 raft_consensus.cc:2243] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:32.127532 24534 raft_consensus.cc:2272] T 74bf68992e4a43c78d2ef30e6c477746 P 6e673265293d4e9a937dc45150aeb1b8 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.130964 24534 tablet_replica.cc:333] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
I20260709 12:26:32.138162 24534 raft_consensus.cc:2243] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:32.139119 24534 raft_consensus.cc:2272] T b12e2b074f1b4518bcfc6728abeca136 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.144655 24534 tablet_replica.cc:333] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
I20260709 12:26:32.148721 24534 raft_consensus.cc:2243] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:26:32.150079 24534 raft_consensus.cc:2272] T 05232536e53b419682a5f24515843652 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:32.155426 25800 consensus_peers.cc:597] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:32.154685 24534 tablet_replica.cc:333] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
I20260709 12:26:32.164928 24534 raft_consensus.cc:2243] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:26:32.166675 24534 raft_consensus.cc:2272] T afda1f2e78cc4f799b9bad380ffd3d44 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.169667 24534 tablet_replica.cc:333] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
I20260709 12:26:32.177533 24534 raft_consensus.cc:2243] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Raft consensus shutting down.
W20260709 12:26:32.179055 25800 consensus_peers.cc:597] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:32.182337 24534 raft_consensus.cc:2272] T d7bb9a8676e14626b11877dab828ea68 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:32.187633 26401 consensus_peers.cc:597] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:32.203100 25800 consensus_peers.cc:597] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:32.205377 24534 tablet_replica.cc:333] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
I20260709 12:26:32.210696 24534 raft_consensus.cc:2243] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:26:32.212383 24534 raft_consensus.cc:2272] T 6182e86ac1764086b37738a0f1b04cd4 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:32.231225 26401 consensus_peers.cc:597] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:32.238598 26402 consensus_peers.cc:597] T 58ab3e51ccf14577a94774f25ade6cd8 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:32.239112 25800 consensus_peers.cc:597] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:32.240041 26401 consensus_peers.cc:597] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:32.240931 24534 tablet_replica.cc:333] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
I20260709 12:26:32.242151 24534 raft_consensus.cc:2243] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:32.246814 24534 raft_consensus.cc:2272] T f50d78c25fc8461f8670d3708bbce774 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:32.253243 26401 consensus_peers.cc:597] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:32.253881 24534 tablet_replica.cc:333] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
I20260709 12:26:32.263212 24534 raft_consensus.cc:2243] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:26:32.266467 24534 raft_consensus.cc:2272] T 3767151a5d4345659810a40ea7f44873 P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.271368 24534 tablet_replica.cc:333] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
W20260709 12:26:32.272054 26401 consensus_peers.cc:597] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:32.282083 24534 raft_consensus.cc:2243] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Raft consensus shutting down.
W20260709 12:26:32.285790 25800 consensus_peers.cc:597] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:32.285822 26401 consensus_peers.cc:597] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:32.284360 24534 raft_consensus.cc:2272] T 04fe73edd8db49c08ea7a6adb6e443e6 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.290865 24534 tablet_replica.cc:333] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
I20260709 12:26:32.295877 24534 raft_consensus.cc:2243] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:26:32.301513 24534 raft_consensus.cc:2272] T 2bb433064bfd49359e66128eb1c5edb3 P 6e673265293d4e9a937dc45150aeb1b8 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.304518 24534 tablet_replica.cc:333] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
I20260709 12:26:32.308254 24534 raft_consensus.cc:2243] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:26:32.309515 24534 raft_consensus.cc:2272] T 03fbd3823c734a7d92ea482cf0d206b9 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:32.320926 25800 consensus_peers.cc:597] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:32.341580 25726 consensus_peers.cc:597] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:32.352049 25801 consensus_peers.cc:597] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:26:32.357036 24534 tablet_replica.cc:333] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
I20260709 12:26:32.357985 24534 raft_consensus.cc:2243] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:32.358911 24534 raft_consensus.cc:2272] T 58ab3e51ccf14577a94774f25ade6cd8 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.361848 24534 tablet_replica.cc:333] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
I20260709 12:26:32.362646 24534 raft_consensus.cc:2243] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 21 LEADER]: Raft consensus shutting down.
W20260709 12:26:32.363763 25801 consensus_peers.cc:597] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:32.370409 26402 consensus_peers.cc:597] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:26:32.363708 24534 raft_consensus.cc:2272] T c38d3f292da44b3dbb2e512cd53e21da P 6e673265293d4e9a937dc45150aeb1b8 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.380748 24534 tablet_replica.cc:333] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
I20260709 12:26:32.381549 24534 raft_consensus.cc:2243] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:32.382170 24534 raft_consensus.cc:2272] T 5f0353e850934c9db0a248807127ca4c P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.389806 24534 tablet_replica.cc:333] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
I20260709 12:26:32.390411 24534 raft_consensus.cc:2243] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:26:32.406884 24534 raft_consensus.cc:2272] T 3324229ffe6d4ca282dc77ffa254a5b2 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.412209 24534 tablet_replica.cc:333] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
W20260709 12:26:32.412715 25800 consensus_peers.cc:597] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:32.416741 25801 consensus_peers.cc:597] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:26:32.413002 24534 raft_consensus.cc:2243] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:26:32.423300 24534 raft_consensus.cc:2272] T c87d777e7d64471f988b07272bf2441c P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.462615 24534 tablet_replica.cc:333] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
I20260709 12:26:32.463570 24534 raft_consensus.cc:2243] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:32.464661 24534 raft_consensus.cc:2272] T de96c5816bc14e3cb8f32ff10dc52a61 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.467212 24534 tablet_replica.cc:333] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
I20260709 12:26:32.467983 24534 raft_consensus.cc:2243] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:32.469075 24534 raft_consensus.cc:2272] T 25bd5658646b41608d707d196c6e0585 P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.472046 24534 tablet_replica.cc:333] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
I20260709 12:26:32.473075 24534 raft_consensus.cc:2243] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:32.473814 24534 raft_consensus.cc:2272] T a22f8565191e471dbe96772477b84e36 P 6e673265293d4e9a937dc45150aeb1b8 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.489461 24534 tablet_replica.cc:333] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
I20260709 12:26:32.494923 24534 raft_consensus.cc:2243] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:32.495730 24534 raft_consensus.cc:2272] T 8d74d1c9c8a84919a6f57b0b6721de51 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.524325 24534 tablet_replica.cc:333] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
I20260709 12:26:32.525192 24534 raft_consensus.cc:2243] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:32.526499 24534 raft_consensus.cc:2272] T f1625669bcc54589846d8a3d94c097d4 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.534446 24534 tablet_replica.cc:333] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
I20260709 12:26:32.540442 24534 raft_consensus.cc:2243] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:32.541424 24534 raft_consensus.cc:2272] T a8fa32386b77471b923cc6c4241570d5 P 6e673265293d4e9a937dc45150aeb1b8 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.544039 24534 tablet_replica.cc:333] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
I20260709 12:26:32.545060 24534 raft_consensus.cc:2243] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:32.545807 24534 raft_consensus.cc:2272] T 870002623db3456699b2b970d066f356 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.548691 24534 tablet_replica.cc:333] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
I20260709 12:26:32.549448 24534 raft_consensus.cc:2243] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:26:32.550752 24534 raft_consensus.cc:2272] T ea014f5d4c6744b9b7032f2fa25b4165 P 6e673265293d4e9a937dc45150aeb1b8 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.554021 24534 tablet_replica.cc:333] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
I20260709 12:26:32.554816 24534 raft_consensus.cc:2243] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:32.556560 24534 raft_consensus.cc:2272] T e535a01d34654e31ac7826205390f938 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.564723 24534 tablet_replica.cc:333] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
I20260709 12:26:32.565584 24534 raft_consensus.cc:2243] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:32.566490 24534 raft_consensus.cc:2272] T 7954a5254e674b77843c0d32002d2e90 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.583643 24534 tablet_replica.cc:333] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
W20260709 12:26:32.616780 25801 consensus_peers.cc:597] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:32.627719 26402 consensus_peers.cc:597] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:32.642496 26402 consensus_peers.cc:597] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:32.656687 26402 consensus_peers.cc:597] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:26:32.689191 24534 raft_consensus.cc:2243] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:26:32.690356 24534 raft_consensus.cc:2272] T 0a6b77683d6547db82cd02da9d9c938a P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.731448 24534 tablet_replica.cc:333] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
I20260709 12:26:32.733580 24534 raft_consensus.cc:2243] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:26:32.736591 24534 raft_consensus.cc:2272] T 7939d783f9eb4a738d840145c79cf380 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.746109 24534 tablet_replica.cc:333] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
I20260709 12:26:32.747014 24534 raft_consensus.cc:2243] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:26:32.748426 24534 raft_consensus.cc:2272] T d32f766d8f384968a837db40f23c072c P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.752605 24534 tablet_replica.cc:333] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
I20260709 12:26:32.753357 24534 raft_consensus.cc:2243] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:32.754995 24534 raft_consensus.cc:2272] T f979ddeb5c014d329931d4e2e035af60 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.763242 24534 tablet_replica.cc:333] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
I20260709 12:26:32.764094 24534 raft_consensus.cc:2243] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Raft consensus shutting down.
W20260709 12:26:32.786299 26402 consensus_peers.cc:597] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:26:32.797497 24534 raft_consensus.cc:2272] T 0c043718ee3a40fea4b2b1453fcb259b P 6e673265293d4e9a937dc45150aeb1b8 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.804347 24534 tablet_replica.cc:333] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
I20260709 12:26:32.805148 24534 raft_consensus.cc:2243] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:32.805934 24534 raft_consensus.cc:2272] T 06c3ab7c0c7a496390151c476ec675a0 P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.817812 24534 tablet_replica.cc:333] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
I20260709 12:26:32.818936 24534 raft_consensus.cc:2243] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:26:32.832598 24534 raft_consensus.cc:2272] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.835675 24534 tablet_replica.cc:333] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
I20260709 12:26:32.836542 24534 raft_consensus.cc:2243] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:32.837240 24534 raft_consensus.cc:2272] T d2487f95c174426ebe2cdfc51537aea3 P 6e673265293d4e9a937dc45150aeb1b8 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.840258 24534 tablet_replica.cc:333] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
I20260709 12:26:32.841035 24534 raft_consensus.cc:2243] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:32.841943 24534 raft_consensus.cc:2272] T 47453d79f4484e7ea165be91f0269a2b P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.844673 24534 tablet_replica.cc:333] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
I20260709 12:26:32.845404 24534 raft_consensus.cc:2243] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:32.846092 24534 raft_consensus.cc:2272] T ca85fa90ddc84c0680729add054d3003 P 6e673265293d4e9a937dc45150aeb1b8 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.864575 24534 tablet_replica.cc:333] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
I20260709 12:26:32.865415 24534 raft_consensus.cc:2243] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:26:32.866786 24534 raft_consensus.cc:2272] T 237622cb71464b3ca091560bd9d8c06b P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.869916 24534 tablet_replica.cc:333] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
I20260709 12:26:32.870618 24534 raft_consensus.cc:2243] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:26:32.871882 24534 raft_consensus.cc:2272] T 06bd2840931844279521c7e8eb8750bf P 6e673265293d4e9a937dc45150aeb1b8 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.874785 24534 tablet_replica.cc:333] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
I20260709 12:26:32.875479 24534 raft_consensus.cc:2243] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:26:32.876816 24534 raft_consensus.cc:2272] T 8dcbaf690aa54e4887d08b85cec29701 P 6e673265293d4e9a937dc45150aeb1b8 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.879824 24534 tablet_replica.cc:333] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
I20260709 12:26:32.881177 24534 raft_consensus.cc:2243] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:26:32.889910 24534 raft_consensus.cc:2272] T 14252b42f20346a5b1ae15409e129b12 P 6e673265293d4e9a937dc45150aeb1b8 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:32.893515 24534 tablet_replica.cc:333] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8: stopping tablet replica
I20260709 12:26:32.894358 24534 raft_consensus.cc:2243] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:26:32.895648 24534 raft_consensus.cc:2272] T b679f7cf7f1e468582715c3427ced820 P 6e673265293d4e9a937dc45150aeb1b8 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:33.108882   808 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:33.109491   808 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:33.113018   808 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:26:33.127118 26402 leader_election.cc:336] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
W20260709 12:26:33.135947 26401 leader_election.cc:336] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
I20260709 12:26:33.137334 26401 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:33.143678   811 raft_consensus.cc:2749] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:33.230993   815 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:33.231549   815 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:33.235504 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:33.239871   815 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:26:33.240092 25800 leader_election.cc:336] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
I20260709 12:26:33.240593 25800 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:33.241441   815 raft_consensus.cc:2749] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:33.306147   815 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:33.306763   815 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:26:33.320323 25800 leader_election.cc:336] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
W20260709 12:26:33.321444 25801 leader_election.cc:336] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:33.322058 25801 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:33.323490   826 raft_consensus.cc:2749] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:26:33.324195   815 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:33.327057 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:33.336225   826 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:33.336791   826 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:33.338893   826 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:26:33.344038 26402 consensus_peers.cc:597] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:33.346814 25800 leader_election.cc:336] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
W20260709 12:26:33.368112 25801 leader_election.cc:336] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:33.368702 25801 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:33.369534   826 raft_consensus.cc:2749] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:33.430691   811 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P a866ff967d964388a6f0dff7fd43df89 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:33.431375   811 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P a866ff967d964388a6f0dff7fd43df89 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:33.441340   811 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:26:33.444427 26402 leader_election.cc:336] T afda1f2e78cc4f799b9bad380ffd3d44 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
W20260709 12:26:33.445979 26401 leader_election.cc:336] T afda1f2e78cc4f799b9bad380ffd3d44 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
I20260709 12:26:33.446404 26401 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:33.447409   811 raft_consensus.cc:2749] T afda1f2e78cc4f799b9bad380ffd3d44 P a866ff967d964388a6f0dff7fd43df89 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:26:33.447293 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:33.448047 25837 raft_consensus.cc:2468] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 22.
I20260709 12:26:33.458737   811 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:33.459244   811 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:33.461349   811 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:26:33.465533 26401 leader_election.cc:336] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
I20260709 12:26:33.466951 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:33.467605 25837 raft_consensus.cc:2468] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 19.
I20260709 12:26:33.468715 26402 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:26:33.469888   825 raft_consensus.cc:2804] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:33.470294   825 raft_consensus.cc:493] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:33.470680   825 raft_consensus.cc:3060] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:26:33.488283 25801 consensus_peers.cc:597] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:26:33.502022   825 raft_consensus.cc:515] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:33.512828   826 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:33.513439   826 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:33.514015   825 leader_election.cc:290] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:33.515415   826 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:33.518374 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d9ca842256c405c98d29454943e5d01" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:33.518946 25837 raft_consensus.cc:3060] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:26:33.525437 26401 leader_election.cc:336] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
W20260709 12:26:33.530601 25800 leader_election.cc:336] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
W20260709 12:26:33.541026 25801 leader_election.cc:336] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:33.541818 25801 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:33.542588   826 raft_consensus.cc:2749] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:33.539364 25837 raft_consensus.cc:2468] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 20.
I20260709 12:26:33.544036 26402 leader_election.cc:304] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:26:33.546063   808 raft_consensus.cc:2804] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:26:33.546610   808 raft_consensus.cc:697] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 20 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:26:33.547533   808 consensus_queue.cc:237] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:33.598137 25577 catalog_manager.cc:5697] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 19 to 20, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 20 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:33.637225   825 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:33.638008   825 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:33.642565   825 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:33.643133   815 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:33.646303   815 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:33.648399   815 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:26:33.653898 26401 leader_election.cc:336] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
I20260709 12:26:33.654788   826 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:33.655337   826 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:33.658095   826 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:26:33.667479 25801 leader_election.cc:336] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
W20260709 12:26:33.668774 25801 leader_election.cc:336] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
W20260709 12:26:33.669369 25800 leader_election.cc:336] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
I20260709 12:26:33.669766 25800 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:33.670380   815 raft_consensus.cc:2749] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:26:33.673906 25800 leader_election.cc:336] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
I20260709 12:26:33.674422 25800 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:33.675139   815 raft_consensus.cc:2749] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:26:33.677516 26402 consensus_peers.cc:597] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:26:33.678061 26402 leader_election.cc:336] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:33.678380 26402 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:33.678999   825 raft_consensus.cc:2749] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:33.748288   825 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:33.750067   825 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:33.754745   815 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:33.755666   815 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:33.759200   825 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:26:33.771113 26402 leader_election.cc:336] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:33.766172   815 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:33.747367   835 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
W20260709 12:26:33.775091 26401 leader_election.cc:336] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
I20260709 12:26:33.777464 26401 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:33.778774   815 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:33.777460   835 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:33.780066   836 raft_consensus.cc:2749] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:26:33.777462 25800 leader_election.cc:336] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
I20260709 12:26:33.784547   826 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:33.787302   826 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:33.788017   835 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:26:33.781373 26402 consensus_peers.cc:597] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:26:33.789867   826 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:26:33.795342 25801 leader_election.cc:336] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
W20260709 12:26:33.805269 25800 leader_election.cc:336] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
W20260709 12:26:33.806131 25800 leader_election.cc:336] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
I20260709 12:26:33.780061   815 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:33.811012 25801 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:33.825379   826 raft_consensus.cc:2749] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:26:33.828392 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:37349, user_credentials={real_user=slave}} blocked reactor thread for 46202.7us
W20260709 12:26:33.838201 25801 consensus_peers.cc:597] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:26:33.812799   815 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:26:33.842866 25800 leader_election.cc:336] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
W20260709 12:26:33.884984 25801 leader_election.cc:336] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:33.885553 25801 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:33.892462   826 raft_consensus.cc:2749] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:26:33.893810 25801 leader_election.cc:336] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:33.894609 25801 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:33.895471   826 raft_consensus.cc:2749] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:26:33.900697 25801 consensus_peers.cc:597] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:33.901381 25801 leader_election.cc:336] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:33.902108 25801 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:33.903198   826 raft_consensus.cc:2749] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:26:33.904512 25801 consensus_peers.cc:597] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:26:33.977265   808 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:33.978271   808 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:33.981421   808 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:26:33.995834 26402 leader_election.cc:336] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
W20260709 12:26:34.000221 26401 leader_election.cc:336] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
I20260709 12:26:34.000782 26401 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:34.002759   808 raft_consensus.cc:2749] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:26:34.013818 25801 consensus_peers.cc:597] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:26:34.021297 26402 consensus_peers.cc:597] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:26:34.024290 26401 consensus_peers.cc:597] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:34.041950 25833 raft_consensus.cc:1275] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:26:34.043673   808 consensus_queue.cc:1048] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:26:34.057070   825 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:34.058050   825 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:34.060680   815 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:34.061409   815 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:34.063416 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:34.064236 25837 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 16.
I20260709 12:26:34.065232 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:34.065898 26431 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 16.
I20260709 12:26:34.067111 25801 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:26:34.067570 26401 leader_election.cc:336] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
I20260709 12:26:34.067962   826 raft_consensus.cc:2804] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:34.068410   826 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:34.068845   826 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:34.073015 26402 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:26:34.073892   808 raft_consensus.cc:2804] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:34.074216   808 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:34.074517   808 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:34.086581   815 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:26:34.088006 25800 leader_election.cc:336] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
I20260709 12:26:34.060734   825 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:26:34.092896 24534 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 25784)
I20260709 12:26:34.097913   815 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:34.098675   815 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:34.101025   808 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:34.105726   808 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:34.106616 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:34.107998   815 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:26:34.114112 26401 leader_election.cc:336] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
I20260709 12:26:34.118503   837 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:34.119216   837 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:34.121752   837 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:34.122169   825 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
W20260709 12:26:34.124250 25800 leader_election.cc:336] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
I20260709 12:26:34.133037   825 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:26:34.133770 25801 leader_election.cc:336] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:34.134743 25801 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:34.136719   835 raft_consensus.cc:2749] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:26:34.129134   826 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:26:34.138586 25800 leader_election.cc:336] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
I20260709 12:26:34.152575 25833 raft_consensus.cc:2393] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 17: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:26:34.156201 26402 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:26:34.157068   811 raft_consensus.cc:2749] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:26:34.157838   811 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:34.158399   811 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:26:34.159739 26402 consensus_peers.cc:597] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:26:34.160732   811 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:34.162271   825 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:34.164767 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:34.165553 25833 raft_consensus.cc:2468] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 19.
W20260709 12:26:34.170009 25801 leader_election.cc:336] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:34.170469 25801 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
W20260709 12:26:34.175849 26401 leader_election.cc:336] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
I20260709 12:26:34.176324 26402 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
W20260709 12:26:34.177260 26401 leader_election.cc:336] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
I20260709 12:26:34.179636   835 raft_consensus.cc:2749] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:34.186800   839 raft_consensus.cc:2804] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:34.187399   839 raft_consensus.cc:493] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:34.187817   839 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:26:34.194104 25800 leader_election.cc:336] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
I20260709 12:26:34.204376   826 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:34.206004 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:26:34.208122 26431 raft_consensus.cc:2393] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 17: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:26:34.209316 25801 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
W20260709 12:26:34.210670 26402 leader_election.cc:336] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:34.211191 26402 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:34.212030   825 raft_consensus.cc:2749] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:34.213060   826 raft_consensus.cc:2749] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:26:34.218804 26401 consensus_peers.cc:597] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:34.215873 26402 consensus_peers.cc:597] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:26:34.236727 25801 consensus_peers.cc:597] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:26:34.221202   839 raft_consensus.cc:515] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:34.242813   839 leader_election.cc:290] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:34.251677 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dcbaf690aa54e4887d08b85cec29701" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
I20260709 12:26:34.253125 25837 raft_consensus.cc:3060] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:34.262014 25837 raft_consensus.cc:2468] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 20.
I20260709 12:26:34.266299 26402 leader_election.cc:304] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:26:34.268751   825 raft_consensus.cc:2804] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:26:34.269305   825 raft_consensus.cc:697] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 20 LEADER]: Becoming Leader. State: Replica: a866ff967d964388a6f0dff7fd43df89, State: Running, Role: LEADER
I20260709 12:26:34.271454   825 consensus_queue.cc:237] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:26:34.268996 26401 leader_election.cc:336] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
I20260709 12:26:34.310180   811 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:34.310807   811 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:34.313007   811 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:34.318596   811 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:34.319245   811 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:34.323379   811 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:26:34.324781 25800 consensus_peers.cc:597] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:34.324198 26402 consensus_peers.cc:597] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:26:34.331346   837 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:34.334654   837 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:34.337009   837 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:34.337783 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:34.338056 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:34.338424 25837 raft_consensus.cc:2468] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 20.
I20260709 12:26:34.338703 26431 raft_consensus.cc:2468] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 20.
I20260709 12:26:34.340149 25801 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 
I20260709 12:26:34.340869   837 raft_consensus.cc:2804] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:26:34.340916 26401 leader_election.cc:336] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
I20260709 12:26:34.341337   837 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:34.341749   837 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:34.346240 26402 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:26:34.347433   811 raft_consensus.cc:2804] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:34.347944   811 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:34.349779   811 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:26:34.349319 26401 leader_election.cc:336] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
W20260709 12:26:34.349318 25800 leader_election.cc:336] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
I20260709 12:26:34.346771 25577 catalog_manager.cc:5697] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 reported cstate change: term changed from 19 to 20, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to a866ff967d964388a6f0dff7fd43df89 (127.23.245.132). New cstate: current_term: 20 leader_uuid: "a866ff967d964388a6f0dff7fd43df89" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:26:34.351876 26401 consensus_peers.cc:597] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:34.354622 26402 leader_election.cc:336] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:34.355096 26402 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:34.355804   825 raft_consensus.cc:2749] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:34.362979   811 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:34.365833   811 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 21 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:34.367561 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a"
W20260709 12:26:34.371273 26401 leader_election.cc:336] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
I20260709 12:26:34.351903   837 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:34.373322 25837 raft_consensus.cc:2393] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate a866ff967d964388a6f0dff7fd43df89 in current term 21: Already voted for candidate 5cccf20a8bff46dba6601f241d172b8a in this term.
I20260709 12:26:34.374485   837 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 21 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:34.377041 26431 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:26:34.377769 26431 raft_consensus.cc:2393] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 5cccf20a8bff46dba6601f241d172b8a in current term 21: Already voted for candidate a866ff967d964388a6f0dff7fd43df89 in this term.
I20260709 12:26:34.385809 26402 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:26:34.390286 25800 leader_election.cc:336] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
I20260709 12:26:34.391084 25800 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, a866ff967d964388a6f0dff7fd43df89
I20260709 12:26:34.392436   826 raft_consensus.cc:2749] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:26:34.395999   811 raft_consensus.cc:2749] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 12:26:34.454944 26402 consensus_peers.cc:597] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:26:34.457823 26401 consensus_peers.cc:597] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:34.474853 25801 consensus_peers.cc:597] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:26:34.487479 26401 consensus_peers.cc:597] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:34.498385 25801 consensus_peers.cc:597] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:34.498555 26401 consensus_peers.cc:597] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:34.531477 25800 consensus_peers.cc:597] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:34.532442 25801 consensus_peers.cc:597] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:34.548197 26401 consensus_peers.cc:597] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:34.556402 26401 consensus_peers.cc:597] T 58ab3e51ccf14577a94774f25ade6cd8 P a866ff967d964388a6f0dff7fd43df89 -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:34.579097 25800 consensus_peers.cc:597] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:34.581461 25801 consensus_peers.cc:597] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:26:34.614280 25801 consensus_peers.cc:597] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:26:34.631589 25800 consensus_peers.cc:597] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:34.652753 26401 consensus_peers.cc:597] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:34.697510 26401 consensus_peers.cc:597] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:34.714934 25800 consensus_peers.cc:597] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:34.718099 26401 consensus_peers.cc:597] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:34.727830 25837 raft_consensus.cc:1275] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Refusing update from remote peer a866ff967d964388a6f0dff7fd43df89: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:26:34.730947   825 consensus_queue.cc:1048] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 12:26:34.744181 26402 consensus_peers.cc:597] T 58ab3e51ccf14577a94774f25ade6cd8 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:34.745806 26401 consensus_peers.cc:597] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:34.762516 25800 consensus_peers.cc:597] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:34.770226 25800 consensus_peers.cc:597] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:34.773010 26401 consensus_peers.cc:597] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:34.784503 26401 consensus_peers.cc:597] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:34.812027 25800 consensus_peers.cc:597] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:34.866225 25801 consensus_peers.cc:597] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:34.879314 25801 consensus_peers.cc:597] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:26:34.934388 25800 consensus_peers.cc:597] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:35.003705 26402 consensus_peers.cc:597] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:26:35.046461   825 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P a866ff967d964388a6f0dff7fd43df89 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:35.047227   825 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P a866ff967d964388a6f0dff7fd43df89 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:26:35.065174 26401 leader_election.cc:336] T afda1f2e78cc4f799b9bad380ffd3d44 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
W20260709 12:26:35.065876 26401 consensus_peers.cc:597] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:35.074780   811 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:35.081892   811 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:26:35.087430 26402 consensus_peers.cc:597] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:35.088378 26402 leader_election.cc:336] T afda1f2e78cc4f799b9bad380ffd3d44 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:35.088805 26402 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:35.078358   825 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:26:35.093333 24534 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 25784)
W20260709 12:26:35.097499 26401 leader_election.cc:336] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
I20260709 12:26:35.083846   811 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:35.103360   839 raft_consensus.cc:2749] T afda1f2e78cc4f799b9bad380ffd3d44 P a866ff967d964388a6f0dff7fd43df89 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:26:35.110199 25837 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:35.110926 25837 raft_consensus.cc:2468] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 22.
W20260709 12:26:35.116003 25801 consensus_peers.cc:597] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:35.139179 26402 leader_election.cc:336] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:35.141752 26402 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
W20260709 12:26:35.163057 25800 consensus_peers.cc:597] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:35.166458   825 raft_consensus.cc:2749] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:35.201339   835 raft_consensus.cc:493] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:35.201953   835 raft_consensus.cc:515] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:35.204124   835 leader_election.cc:290] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:26:35.212951 25801 leader_election.cc:336] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
W20260709 12:26:35.244522 25800 leader_election.cc:336] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
I20260709 12:26:35.245111 25800 leader_election.cc:304] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:35.246646   835 raft_consensus.cc:2749] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:26:35.252112 26402 consensus_peers.cc:597] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:35.270836 26402 consensus_peers.cc:597] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:26:35.348023   825 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:35.348743   825 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:26:35.364285 26401 leader_election.cc:336] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
I20260709 12:26:35.351758   825 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:35.371842   837 raft_consensus.cc:493] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:35.372504   837 raft_consensus.cc:515] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:35.375351   837 leader_election.cc:290] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:26:35.385963 26402 leader_election.cc:336] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:35.398272 26402 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
W20260709 12:26:35.395968 25801 leader_election.cc:336] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:35.403029   825 raft_consensus.cc:2749] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:26:35.409811 25800 leader_election.cc:336] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
I20260709 12:26:35.419577 25800 leader_election.cc:304] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:35.422494   837 raft_consensus.cc:2749] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:35.427616   837 raft_consensus.cc:493] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:35.428239   837 raft_consensus.cc:515] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
W20260709 12:26:35.428465 26402 consensus_peers.cc:597] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:26:35.430312   837 leader_election.cc:290] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:26:35.446627 25801 leader_election.cc:336] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
W20260709 12:26:35.452457 25800 leader_election.cc:336] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
I20260709 12:26:35.461442 25800 leader_election.cc:304] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:35.474409   835 raft_consensus.cc:2749] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:35.563583   837 raft_consensus.cc:493] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:35.564193   837 raft_consensus.cc:515] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:35.566136   837 leader_election.cc:290] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:35.623314   825 raft_consensus.cc:493] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:35.624200   825 raft_consensus.cc:515] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:35.629105   825 leader_election.cc:290] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:26:35.640450 26401 leader_election.cc:336] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
W20260709 12:26:35.655377 25800 leader_election.cc:336] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
I20260709 12:26:35.657299   835 raft_consensus.cc:493] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:35.659667   835 raft_consensus.cc:515] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:35.661744   835 leader_election.cc:290] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:26:35.693493 26402 leader_election.cc:336] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
W20260709 12:26:35.701475 25801 leader_election.cc:336] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:35.702023 25801 leader_election.cc:304] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:35.702821   850 raft_consensus.cc:2749] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:26:35.709834   850 raft_consensus.cc:493] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:35.710387   850 raft_consensus.cc:515] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:35.712625   850 leader_election.cc:290] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:35.694065 26402 leader_election.cc:304] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:35.735419   825 raft_consensus.cc:2749] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:26:35.724143 25800 leader_election.cc:336] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
I20260709 12:26:35.730378   850 raft_consensus.cc:493] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:35.738720   850 raft_consensus.cc:515] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:35.740813   850 leader_election.cc:290] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:26:35.742308 25800 leader_election.cc:336] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
W20260709 12:26:35.760012 25801 leader_election.cc:336] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:35.763617 25801 leader_election.cc:304] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:35.772729   850 raft_consensus.cc:2749] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:26:35.780205 25800 leader_election.cc:336] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
W20260709 12:26:35.771786 26402 consensus_peers.cc:597] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:26:35.792209   835 raft_consensus.cc:493] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:35.792774   835 raft_consensus.cc:515] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:35.794854   835 leader_election.cc:290] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:26:35.797407 25801 leader_election.cc:336] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:35.809823 25801 leader_election.cc:304] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:35.812497   835 raft_consensus.cc:2749] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:26:35.817296 25800 leader_election.cc:336] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
I20260709 12:26:35.822605   825 raft_consensus.cc:493] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:35.829593   825 raft_consensus.cc:515] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:35.832175   839 raft_consensus.cc:493] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:35.832777   839 raft_consensus.cc:515] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:35.834896   839 leader_election.cc:290] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:35.837950   825 leader_election.cc:290] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:26:35.848177 26401 leader_election.cc:336] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
W20260709 12:26:35.853271 26401 leader_election.cc:336] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
W20260709 12:26:35.857295 25801 leader_election.cc:336] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:35.869681 25801 leader_election.cc:304] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:35.879594   850 raft_consensus.cc:2749] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:26:35.880605   850 raft_consensus.cc:493] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:35.881119   850 raft_consensus.cc:515] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:35.883327   850 leader_election.cc:290] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:26:35.886343 26402 leader_election.cc:336] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:35.893364 26402 leader_election.cc:304] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:35.903905   825 raft_consensus.cc:2749] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:26:35.905231 26402 leader_election.cc:336] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:35.912214 26402 leader_election.cc:304] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:35.914822   850 raft_consensus.cc:493] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:35.917287   850 raft_consensus.cc:515] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } }
I20260709 12:26:35.919473   850 leader_election.cc:290] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
I20260709 12:26:35.920346   825 raft_consensus.cc:2749] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:26:35.925163 25800 leader_election.cc:336] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
W20260709 12:26:35.915980 25801 leader_election.cc:336] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:35.938331 25801 leader_election.cc:304] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:35.939450   850 raft_consensus.cc:2749] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:26:35.949581 25800 leader_election.cc:336] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
W20260709 12:26:35.971247 25801 leader_election.cc:336] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:35.977794 25801 leader_election.cc:304] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:35.980355   850 raft_consensus.cc:2749] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:26:35.999852   850 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:36.000422   850 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:36.002660   850 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:26:36.009193 25800 leader_election.cc:336] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
W20260709 12:26:36.015566 25801 leader_election.cc:336] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:36.016211 25801 leader_election.cc:304] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:36.016989   850 raft_consensus.cc:2749] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:26:36.019743 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:36.020457 26430 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 17.
I20260709 12:26:36.027210 25801 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:26:36.028070   850 raft_consensus.cc:2804] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:36.028524   850 raft_consensus.cc:493] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:36.028921   850 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:36.055301   850 raft_consensus.cc:515] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:36.089027   835 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:36.118280   835 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:36.119513   850 leader_election.cc:290] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:26:36.093783 24534 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 25784)
I20260709 12:26:36.120745   835 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
W20260709 12:26:36.126415 25800 leader_election.cc:336] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
W20260709 12:26:36.127266 25800 leader_election.cc:336] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
W20260709 12:26:36.160362 26402 consensus_peers.cc:597] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:26:36.192909 25801 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:35611, user_credentials={real_user=slave}} blocked reactor thread for 75208.4us
I20260709 12:26:36.196430 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "237622cb71464b3ca091560bd9d8c06b" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:26:36.197067 26430 raft_consensus.cc:3060] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:36.205766 26430 raft_consensus.cc:2468] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 18.
I20260709 12:26:36.211138 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89" is_pre_election: true
I20260709 12:26:36.223775 26430 raft_consensus.cc:2468] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 21.
W20260709 12:26:36.232669 25801 consensus_peers.cc:597] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:26:36.234172 25801 leader_election.cc:304] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:26:36.235487   851 raft_consensus.cc:2804] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:26:36.235630 25801 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:26:36.237877   850 raft_consensus.cc:2804] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:36.238346   850 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:36.238759   850 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:36.247560   851 raft_consensus.cc:697] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 18 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
I20260709 12:26:36.248503   850 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:36.250945   850 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 22 election: Requested vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), a866ff967d964388a6f0dff7fd43df89 (127.23.245.132:35611)
I20260709 12:26:36.252766   851 consensus_queue.cc:237] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:36.254172 26430 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b679f7cf7f1e468582715c3427ced820" candidate_uuid: "5cccf20a8bff46dba6601f241d172b8a" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "a866ff967d964388a6f0dff7fd43df89"
I20260709 12:26:36.254726 26430 raft_consensus.cc:3060] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:26:36.261659 25800 leader_election.cc:336] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
I20260709 12:26:36.278769 25577 catalog_manager.cc:5697] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 16 to 18, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 18 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:36.280289 26430 raft_consensus.cc:2468] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5cccf20a8bff46dba6601f241d172b8a in term 22.
I20260709 12:26:36.281570 25801 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:26:36.282749   851 raft_consensus.cc:2804] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:26:36.283305   851 raft_consensus.cc:697] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 22 LEADER]: Becoming Leader. State: Replica: 5cccf20a8bff46dba6601f241d172b8a, State: Running, Role: LEADER
W20260709 12:26:36.279824 26402 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111) [suppressed 619 similar messages]
I20260709 12:26:36.295288   851 consensus_queue.cc:237] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:26:36.296973 26402 consensus_peers.cc:597] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:26:36.317267 25801 consensus_peers.cc:597] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:26:36.326869   825 raft_consensus.cc:493] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:36.327435   825 raft_consensus.cc:515] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:36.329483   825 leader_election.cc:290] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:26:36.344534 25801 consensus_peers.cc:597] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:26:36.345423 26402 leader_election.cc:336] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
W20260709 12:26:36.349954 26401 leader_election.cc:336] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
I20260709 12:26:36.350497 26401 leader_election.cc:304] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:36.355801   825 raft_consensus.cc:2749] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:36.388654 25577 catalog_manager.cc:5697] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a reported cstate change: term changed from 20 to 22, leader changed from 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130) to 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131). New cstate: current_term: 22 leader_uuid: "5cccf20a8bff46dba6601f241d172b8a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:36.485900 25801 consensus_peers.cc:597] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:36.530797 25801 consensus_peers.cc:597] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:26:36.570472 26401 consensus_peers.cc:597] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:36.576977 26401 consensus_peers.cc:597] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:36.636627 26401 consensus_peers.cc:597] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:36.712960 25800 consensus_peers.cc:597] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:36.730994 26430 raft_consensus.cc:1275] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:26:36.733625   850 consensus_queue.cc:1048] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:26:36.740456 26401 consensus_peers.cc:597] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:36.805365 25800 consensus_peers.cc:597] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:36.805941 25800 consensus_peers.cc:597] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:36.864810 26401 consensus_peers.cc:597] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:36.874064 25801 consensus_peers.cc:597] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:26:36.886092 26430 raft_consensus.cc:1275] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 22 FOLLOWER]: Refusing update from remote peer 5cccf20a8bff46dba6601f241d172b8a: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:26:36.887559   850 consensus_queue.cc:1048] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:26:36.914517 24534 tablet_server.cc:196] TabletServer@127.23.245.130:0 shutdown complete.
W20260709 12:26:36.920296 25801 consensus_peers.cc:597] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:36.938717 25801 consensus_peers.cc:597] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:26:36.948010   811 raft_consensus.cc:493] T afda1f2e78cc4f799b9bad380ffd3d44 P a866ff967d964388a6f0dff7fd43df89 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:36.948545   811 raft_consensus.cc:515] T afda1f2e78cc4f799b9bad380ffd3d44 P a866ff967d964388a6f0dff7fd43df89 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } attrs { replace: true } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:36.950501   811 leader_election.cc:290] T afda1f2e78cc4f799b9bad380ffd3d44 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:36.951474 25833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afda1f2e78cc4f799b9bad380ffd3d44" candidate_uuid: "a866ff967d964388a6f0dff7fd43df89" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "5cccf20a8bff46dba6601f241d172b8a" is_pre_election: true
I20260709 12:26:36.952198 25833 raft_consensus.cc:2468] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a866ff967d964388a6f0dff7fd43df89 in term 22.
W20260709 12:26:36.954953 26401 leader_election.cc:336] T afda1f2e78cc4f799b9bad380ffd3d44 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
W20260709 12:26:36.959213 26401 consensus_peers.cc:597] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:37.007611 26401 consensus_peers.cc:597] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:37.021656 25800 consensus_peers.cc:597] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:37.075465 24534 tablet_server.cc:179] TabletServer@127.23.245.131:0 shutting down...
W20260709 12:26:37.084661 26401 consensus_peers.cc:597] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:37.091524 25800 consensus_peers.cc:597] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:37.094493 26401 consensus_peers.cc:597] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:37.100499 25800 consensus_peers.cc:597] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:37.111440 26401 consensus_peers.cc:597] T 58ab3e51ccf14577a94774f25ade6cd8 P a866ff967d964388a6f0dff7fd43df89 -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:37.123315 25800 consensus_peers.cc:597] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:37.126896 26402 consensus_peers.cc:597] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 -> Peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Couldn't send request to peer 5cccf20a8bff46dba6601f241d172b8a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:37.148105 24534 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:37.149070 24534 tablet_replica.cc:333] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
I20260709 12:26:37.149828 24534 raft_consensus.cc:2243] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:26:37.150856 24534 raft_consensus.cc:2272] T 4e8d1d3d43ad47308fae5ed98608feb8 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.153061 24534 tablet_replica.cc:333] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
I20260709 12:26:37.153680 24534 raft_consensus.cc:2243] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.154107 24534 raft_consensus.cc:2272] T 2d9ca842256c405c98d29454943e5d01 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.155820 24534 tablet_replica.cc:333] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
I20260709 12:26:37.156483 24534 raft_consensus.cc:2243] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.157137 24534 raft_consensus.cc:2272] T 3d79b16002fc460a9e70bd0a5bcec639 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.159473 24534 tablet_replica.cc:333] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
I20260709 12:26:37.160346 24534 raft_consensus.cc:2243] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:26:37.161620 24534 raft_consensus.cc:2272] T 5aae9f34f7154346afd482b3183ee180 P 5cccf20a8bff46dba6601f241d172b8a [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.164844 24534 tablet_replica.cc:333] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
W20260709 12:26:37.165524 26401 consensus_peers.cc:597] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:37.165807 24534 raft_consensus.cc:2243] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.166683 24534 raft_consensus.cc:2272] T 2a278e46eb5d49edab4ba69303448a66 P 5cccf20a8bff46dba6601f241d172b8a [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.169255 24534 tablet_replica.cc:333] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
W20260709 12:26:37.169421 26402 consensus_peers.cc:597] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 -> Peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Couldn't send request to peer 5cccf20a8bff46dba6601f241d172b8a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:37.169922 24534 raft_consensus.cc:2243] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.170593 24534 raft_consensus.cc:2272] T 022a05e9e59f4ddf8f793ff24696476d P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.173329 24534 tablet_replica.cc:333] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
W20260709 12:26:37.173766 26402 consensus_peers.cc:597] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 -> Peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Couldn't send request to peer 5cccf20a8bff46dba6601f241d172b8a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:37.174166 24534 raft_consensus.cc:2243] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.174954 24534 raft_consensus.cc:2272] T afda1f2e78cc4f799b9bad380ffd3d44 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.177438 24534 tablet_replica.cc:333] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
I20260709 12:26:37.178375 24534 raft_consensus.cc:2243] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:26:37.179698 24534 raft_consensus.cc:2272] T 74bf68992e4a43c78d2ef30e6c477746 P 5cccf20a8bff46dba6601f241d172b8a [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.181951 24534 tablet_replica.cc:333] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
I20260709 12:26:37.182581 24534 raft_consensus.cc:2243] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:26:37.183763 24534 raft_consensus.cc:2272] T d7bb9a8676e14626b11877dab828ea68 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.186039 24534 tablet_replica.cc:333] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
I20260709 12:26:37.186735 24534 raft_consensus.cc:2243] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.187644 24534 raft_consensus.cc:2272] T 63f47864b8d248a792567d96c5e453b8 P 5cccf20a8bff46dba6601f241d172b8a [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.189548 24534 tablet_replica.cc:333] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
I20260709 12:26:37.190155 24534 raft_consensus.cc:2243] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.190600 24534 raft_consensus.cc:2272] T 6182e86ac1764086b37738a0f1b04cd4 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.192543 24534 tablet_replica.cc:333] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
I20260709 12:26:37.193116 24534 raft_consensus.cc:2243] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:26:37.194031 24534 raft_consensus.cc:2272] T f50d78c25fc8461f8670d3708bbce774 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.196177 24534 tablet_replica.cc:333] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
I20260709 12:26:37.196906 24534 raft_consensus.cc:2243] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.197479 24534 raft_consensus.cc:2272] T 3767151a5d4345659810a40ea7f44873 P 5cccf20a8bff46dba6601f241d172b8a [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.199539 24534 tablet_replica.cc:333] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
I20260709 12:26:37.200335 24534 raft_consensus.cc:2243] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.200975 24534 raft_consensus.cc:2272] T 2bb433064bfd49359e66128eb1c5edb3 P 5cccf20a8bff46dba6601f241d172b8a [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.204324 24534 tablet_replica.cc:333] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
I20260709 12:26:37.205015 24534 raft_consensus.cc:2243] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.205681 24534 raft_consensus.cc:2272] T 03fbd3823c734a7d92ea482cf0d206b9 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:37.206871 26402 consensus_peers.cc:597] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 -> Peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Couldn't send request to peer 5cccf20a8bff46dba6601f241d172b8a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:37.208498 24534 tablet_replica.cc:333] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
I20260709 12:26:37.209131 24534 raft_consensus.cc:2243] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.209734 24534 raft_consensus.cc:2272] T 43b78aa0054b4da398a8fc04d12454a7 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.212162 24534 tablet_replica.cc:333] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
I20260709 12:26:37.212958 24534 raft_consensus.cc:2243] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Raft consensus shutting down.
W20260709 12:26:37.213506 25800 consensus_peers.cc:597] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:37.213706 24534 raft_consensus.cc:2272] T 51d1a71a6e1f4e20842a35cdeb808ac0 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:37.214883 26402 consensus_peers.cc:597] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 -> Peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Couldn't send request to peer 5cccf20a8bff46dba6601f241d172b8a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:37.216315 24534 tablet_replica.cc:333] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
I20260709 12:26:37.217024 24534 raft_consensus.cc:2243] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:26:37.217912 24534 raft_consensus.cc:2272] T 01372ae5f161477dab1b4c89fd847b3c P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.219857 24534 tablet_replica.cc:333] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
I20260709 12:26:37.220474 24534 raft_consensus.cc:2243] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.220992 24534 raft_consensus.cc:2272] T 7939d783f9eb4a738d840145c79cf380 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.222958 24534 tablet_replica.cc:333] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
I20260709 12:26:37.223502 24534 raft_consensus.cc:2243] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:26:37.224434 24534 raft_consensus.cc:2272] T d2487f95c174426ebe2cdfc51537aea3 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.226351 24534 tablet_replica.cc:333] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
I20260709 12:26:37.226909 24534 raft_consensus.cc:2243] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.227375 24534 raft_consensus.cc:2272] T 47453d79f4484e7ea165be91f0269a2b P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.229336 24534 tablet_replica.cc:333] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
I20260709 12:26:37.229908 24534 raft_consensus.cc:2243] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:26:37.230836 24534 raft_consensus.cc:2272] T 819272169f6f4293b6e279793be58b49 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.232861 24534 tablet_replica.cc:333] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
I20260709 12:26:37.233713 24534 raft_consensus.cc:2243] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:26:37.234709 24534 raft_consensus.cc:2272] T e535a01d34654e31ac7826205390f938 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.237460 24534 tablet_replica.cc:333] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
I20260709 12:26:37.238224 24534 raft_consensus.cc:2243] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.238935 24534 raft_consensus.cc:2272] T f5c104146a1c4ce1b19e2c6b5a1bf37a P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:37.240727 25801 consensus_peers.cc:597] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:26:37.241425 24534 tablet_replica.cc:333] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
I20260709 12:26:37.242089 24534 raft_consensus.cc:2243] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:26:37.242967 24534 raft_consensus.cc:2272] T ca85fa90ddc84c0680729add054d3003 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.244920 24534 tablet_replica.cc:333] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
I20260709 12:26:37.245464 24534 raft_consensus.cc:2243] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:26:37.246344 24534 raft_consensus.cc:2272] T 5204a6a2db104ffa90f8679086d4e6f8 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.248478 24534 tablet_replica.cc:333] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
I20260709 12:26:37.248999 24534 raft_consensus.cc:2243] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:26:37.249852 24534 raft_consensus.cc:2272] T 5f0353e850934c9db0a248807127ca4c P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.252175 24534 tablet_replica.cc:333] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
I20260709 12:26:37.252792 24534 raft_consensus.cc:2243] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:26:37.253525 24534 raft_consensus.cc:2272] T 90d850895b8a4a40a4fba5caf2048ca2 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.255425 24534 tablet_replica.cc:333] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
I20260709 12:26:37.256024 24534 raft_consensus.cc:2243] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.256482 24534 raft_consensus.cc:2272] T 3324229ffe6d4ca282dc77ffa254a5b2 P 5cccf20a8bff46dba6601f241d172b8a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.258184 24534 tablet_replica.cc:333] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
I20260709 12:26:37.258854 24534 raft_consensus.cc:2243] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.259584 24534 raft_consensus.cc:2272] T de96c5816bc14e3cb8f32ff10dc52a61 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.262034 24534 tablet_replica.cc:333] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
I20260709 12:26:37.262599 24534 raft_consensus.cc:2243] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:26:37.263715 24534 raft_consensus.cc:2272] T 25bd5658646b41608d707d196c6e0585 P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.265645 24534 tablet_replica.cc:333] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
I20260709 12:26:37.266333 24534 raft_consensus.cc:2243] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.266891 24534 raft_consensus.cc:2272] T a22f8565191e471dbe96772477b84e36 P 5cccf20a8bff46dba6601f241d172b8a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.269336 24534 tablet_replica.cc:333] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
I20260709 12:26:37.269979 24534 raft_consensus.cc:2243] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.270591 24534 raft_consensus.cc:2272] T a8fa32386b77471b923cc6c4241570d5 P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.273141 24534 tablet_replica.cc:333] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
I20260709 12:26:37.273803 24534 raft_consensus.cc:2243] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.274309 24534 raft_consensus.cc:2272] T ea014f5d4c6744b9b7032f2fa25b4165 P 5cccf20a8bff46dba6601f241d172b8a [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:37.274835 26402 consensus_peers.cc:597] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 -> Peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Couldn't send request to peer 5cccf20a8bff46dba6601f241d172b8a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:37.276502 24534 tablet_replica.cc:333] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
I20260709 12:26:37.277247 24534 raft_consensus.cc:2243] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:26:37.278308 24534 raft_consensus.cc:2272] T 870002623db3456699b2b970d066f356 P 5cccf20a8bff46dba6601f241d172b8a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.280870 24534 tablet_replica.cc:333] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
I20260709 12:26:37.281440 24534 raft_consensus.cc:2243] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:26:37.282249 24534 raft_consensus.cc:2272] T 4734c282e09b4bbbb96de8eee61c160a P 5cccf20a8bff46dba6601f241d172b8a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.284297 24534 tablet_replica.cc:333] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
I20260709 12:26:37.284817 24534 raft_consensus.cc:2243] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.285319 24534 raft_consensus.cc:2272] T d32f766d8f384968a837db40f23c072c P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.287199 24534 tablet_replica.cc:333] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
I20260709 12:26:37.287680 24534 raft_consensus.cc:2243] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:26:37.288568 24534 raft_consensus.cc:2272] T f979ddeb5c014d329931d4e2e035af60 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.290460 24534 tablet_replica.cc:333] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
I20260709 12:26:37.291015 24534 raft_consensus.cc:2243] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.291666 24534 raft_consensus.cc:2272] T 14252b42f20346a5b1ae15409e129b12 P 5cccf20a8bff46dba6601f241d172b8a [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.293362 24534 tablet_replica.cc:333] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
I20260709 12:26:37.293844 24534 raft_consensus.cc:2243] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.294275 24534 raft_consensus.cc:2272] T 8dcbaf690aa54e4887d08b85cec29701 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.296154 24534 tablet_replica.cc:333] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
I20260709 12:26:37.296763 24534 raft_consensus.cc:2243] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:26:37.297773 24534 raft_consensus.cc:2272] T 522704a36135481fa4fc221fa9a0801e P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.300262 24534 tablet_replica.cc:333] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
I20260709 12:26:37.300936 24534 raft_consensus.cc:2243] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:37.301463 24534 raft_consensus.cc:2272] T ca1c66d4736542ecb25b33fab43ae780 P 5cccf20a8bff46dba6601f241d172b8a [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.303262 24534 tablet_replica.cc:333] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
I20260709 12:26:37.303721 24534 raft_consensus.cc:2243] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:26:37.304502 24534 raft_consensus.cc:2272] T 237622cb71464b3ca091560bd9d8c06b P 5cccf20a8bff46dba6601f241d172b8a [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.306831 24534 tablet_replica.cc:333] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
I20260709 12:26:37.307545 24534 raft_consensus.cc:2243] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:26:37.308471 24534 raft_consensus.cc:2272] T 97d7984a0036411695d6b3427bff9d69 P 5cccf20a8bff46dba6601f241d172b8a [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:37.310195 24534 tablet_replica.cc:333] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a: stopping tablet replica
I20260709 12:26:37.310636 24534 raft_consensus.cc:2243] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:26:37.311483 24534 raft_consensus.cc:2272] T b679f7cf7f1e468582715c3427ced820 P 5cccf20a8bff46dba6601f241d172b8a [term 22 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:37.360572 26402 consensus_peers.cc:597] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 -> Peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Couldn't send request to peer 5cccf20a8bff46dba6601f241d172b8a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:37.392433 26402 consensus_peers.cc:597] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:26:37.393199 26402 consensus_peers.cc:597] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:26:37.393589 26402 consensus_peers.cc:597] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:26:37.393965 26402 consensus_peers.cc:597] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:26:37.395612 26402 leader_election.cc:336] T afda1f2e78cc4f799b9bad380ffd3d44 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:37.396023 26402 leader_election.cc:304] T afda1f2e78cc4f799b9bad380ffd3d44 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5cccf20a8bff46dba6601f241d172b8a, a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
W20260709 12:26:37.397540 26401 consensus_peers.cc:597] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:37.403072   811 raft_consensus.cc:2749] T afda1f2e78cc4f799b9bad380ffd3d44 P a866ff967d964388a6f0dff7fd43df89 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:26:37.413537 26401 consensus_peers.cc:597] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:37.425813 26402 consensus_peers.cc:597] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 -> Peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Couldn't send request to peer 5cccf20a8bff46dba6601f241d172b8a. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.131:36237: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:37.461151 26402 consensus_peers.cc:597] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 -> Peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Couldn't send request to peer 5cccf20a8bff46dba6601f241d172b8a. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.131:36237: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:37.500914 26402 consensus_peers.cc:597] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 -> Peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Couldn't send request to peer 5cccf20a8bff46dba6601f241d172b8a. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.131:36237: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:37.517055 26402 consensus_peers.cc:597] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 -> Peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Couldn't send request to peer 5cccf20a8bff46dba6601f241d172b8a. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.131:36237: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:37.521108 26401 consensus_peers.cc:597] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:37.587693 26402 consensus_peers.cc:597] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:26:37.596318 26402 consensus_peers.cc:597] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 -> Peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Couldn't send request to peer 5cccf20a8bff46dba6601f241d172b8a. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.131:36237: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:37.670521 26402 consensus_peers.cc:597] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 -> Peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Couldn't send request to peer 5cccf20a8bff46dba6601f241d172b8a. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.131:36237: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:37.842968 26401 consensus_peers.cc:597] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 -> Peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Couldn't send request to peer 6e673265293d4e9a937dc45150aeb1b8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:37.872428 26402 consensus_peers.cc:597] T 58ab3e51ccf14577a94774f25ade6cd8 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:37.951121 26402 consensus_peers.cc:597] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:26:38.153069 26402 consensus_peers.cc:597] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:26:38.157963   825 raft_consensus.cc:493] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:26:38.158457   825 raft_consensus.cc:515] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:38.160117   825 leader_election.cc:290] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:26:38.171777 26402 leader_election.cc:336] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
W20260709 12:26:38.172438 26402 leader_election.cc:336] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Network error: Client connection negotiation failed: client connection to 127.23.245.131:36237: connect: Connection refused (error 111)
I20260709 12:26:38.172762 26402 leader_election.cc:304] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:38.173400   825 raft_consensus.cc:2749] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:38.174655   825 raft_consensus.cc:493] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:26:38.175020   825 raft_consensus.cc:515] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:38.176645   825 leader_election.cc:290] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:26:38.181025 26402 leader_election.cc:336] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
W20260709 12:26:38.182749 26402 leader_election.cc:336] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Network error: Client connection negotiation failed: client connection to 127.23.245.131:36237: connect: Connection refused (error 111)
I20260709 12:26:38.183156 26402 leader_election.cc:304] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:38.183736   825 raft_consensus.cc:2749] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:38.242851   869 raft_consensus.cc:493] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
W20260709 12:26:38.244202 26402 consensus_peers.cc:597] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:26:38.243643   869 raft_consensus.cc:515] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:38.250562   869 leader_election.cc:290] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:26:38.252283 26401 leader_election.cc:336] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
W20260709 12:26:38.253269 26402 leader_election.cc:336] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:38.253662 26402 leader_election.cc:304] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:38.254410   869 raft_consensus.cc:2749] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:26:38.284019   869 raft_consensus.cc:493] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:26:38.284662   869 raft_consensus.cc:515] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:38.286757   869 leader_election.cc:290] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:26:38.293633 26402 leader_election.cc:336] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
W20260709 12:26:38.294160 26402 leader_election.cc:336] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Network error: Client connection negotiation failed: client connection to 127.23.245.131:36237: connect: Connection refused (error 111)
I20260709 12:26:38.294481 26402 leader_election.cc:304] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:38.295197   869 raft_consensus.cc:2749] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:38.305226 24534 tablet_server.cc:196] TabletServer@127.23.245.131:0 shutdown complete.
W20260709 12:26:38.338366 26402 consensus_peers.cc:597] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 -> Peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Couldn't send request to peer f82778701b464892aab92a752ed7ffdc. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:26:38.402499   811 raft_consensus.cc:493] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:26:38.403007   811 raft_consensus.cc:515] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:38.404942   811 leader_election.cc:290] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:26:38.410874 26401 leader_election.cc:336] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
W20260709 12:26:38.411597 26402 leader_election.cc:336] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Network error: Client connection negotiation failed: client connection to 127.23.245.131:36237: connect: Connection refused (error 111)
I20260709 12:26:38.412045 26402 leader_election.cc:304] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:26:38.412675   811 raft_consensus.cc:493] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:26:38.413767   811 raft_consensus.cc:515] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:38.413229   869 raft_consensus.cc:2749] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:38.417006   811 leader_election.cc:290] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:38.420112   811 raft_consensus.cc:493] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:26:38.420665   811 raft_consensus.cc:515] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:26:38.422336 26402 leader_election.cc:336] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Network error: Client connection negotiation failed: client connection to 127.23.245.131:36237: connect: Connection refused (error 111)
I20260709 12:26:38.423302   811 leader_election.cc:290] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:38.426323   869 raft_consensus.cc:493] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:26:38.426936   869 raft_consensus.cc:515] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:38.429288   869 leader_election.cc:290] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:26:38.432111 26401 leader_election.cc:336] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
I20260709 12:26:38.432552 26401 leader_election.cc:304] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:26:38.434262 24534 tablet_server.cc:179] TabletServer@127.23.245.132:0 shutting down...
I20260709 12:26:38.434551   866 raft_consensus.cc:2749] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:38.438897   811 raft_consensus.cc:493] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:26:38.439668   811 raft_consensus.cc:515] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
W20260709 12:26:38.440335 26402 leader_election.cc:336] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
W20260709 12:26:38.444088 26401 leader_election.cc:336] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
W20260709 12:26:38.444491 26402 leader_election.cc:336] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Network error: Client connection negotiation failed: client connection to 127.23.245.131:36237: connect: Connection refused (error 111)
I20260709 12:26:38.443782   811 leader_election.cc:290] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:38.444940 26402 leader_election.cc:304] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
W20260709 12:26:38.445947 26402 leader_election.cc:336] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Network error: Client connection negotiation failed: client connection to 127.23.245.131:36237: connect: Connection refused (error 111)
I20260709 12:26:38.446348   811 raft_consensus.cc:2749] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:38.446388 26402 leader_election.cc:304] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:26:38.448952   811 raft_consensus.cc:2749] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:26:38.455044 26401 leader_election.cc:336] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
I20260709 12:26:38.456702   811 raft_consensus.cc:493] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:26:38.457203   811 raft_consensus.cc:515] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:38.459084   811 leader_election.cc:290] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:26:38.460351 26402 leader_election.cc:336] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Network error: Client connection negotiation failed: client connection to 127.23.245.131:36237: connect: Connection refused (error 111)
I20260709 12:26:38.460827 26402 leader_election.cc:304] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
I20260709 12:26:38.463783   811 raft_consensus.cc:2749] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:26:38.465040   811 raft_consensus.cc:493] T d7bb9a8676e14626b11877dab828ea68 P a866ff967d964388a6f0dff7fd43df89 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:26:38.465593   811 raft_consensus.cc:515] T d7bb9a8676e14626b11877dab828ea68 P a866ff967d964388a6f0dff7fd43df89 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } attrs { replace: true } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:38.468120   811 leader_election.cc:290] T d7bb9a8676e14626b11877dab828ea68 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
W20260709 12:26:38.469468 26402 leader_election.cc:336] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
W20260709 12:26:38.477926 26401 leader_election.cc:336] T d7bb9a8676e14626b11877dab828ea68 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
W20260709 12:26:38.482925 26402 leader_election.cc:336] T d7bb9a8676e14626b11877dab828ea68 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:38.483337 26402 leader_election.cc:304] T d7bb9a8676e14626b11877dab828ea68 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
W20260709 12:26:38.485100 26402 leader_election.cc:336] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Network error: Client connection negotiation failed: client connection to 127.23.245.131:36237: connect: Connection refused (error 111)
I20260709 12:26:38.485519 26402 leader_election.cc:304] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:38.486366   869 raft_consensus.cc:2749] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:26:38.486495 26402 leader_election.cc:336] T d7bb9a8676e14626b11877dab828ea68 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Network error: Client connection negotiation failed: client connection to 127.23.245.131:36237: connect: Connection refused (error 111)
I20260709 12:26:38.487200   811 raft_consensus.cc:2749] T d7bb9a8676e14626b11877dab828ea68 P a866ff967d964388a6f0dff7fd43df89 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:26:38.491714   811 raft_consensus.cc:493] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 6e673265293d4e9a937dc45150aeb1b8)
I20260709 12:26:38.492236   811 raft_consensus.cc:515] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:38.494339   811 leader_election.cc:290] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267)
W20260709 12:26:38.499696 26401 leader_election.cc:336] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
I20260709 12:26:38.502105 24534 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:26:38.502007 26402 leader_election.cc:336] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:38.503075 24534 tablet_replica.cc:333] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89: stopping tablet replica
I20260709 12:26:38.504318 24534 raft_consensus.cc:2243] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:26:38.502525 26402 leader_election.cc:304] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 6e673265293d4e9a937dc45150aeb1b8, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:38.505527 24534 raft_consensus.cc:2272] T 51d1a71a6e1f4e20842a35cdeb808ac0 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.506001   811 raft_consensus.cc:2749] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:38.508210 24534 tablet_replica.cc:333] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89: stopping tablet replica
I20260709 12:26:38.508937 24534 raft_consensus.cc:2243] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:38.509537 24534 raft_consensus.cc:2272] T 5aae9f34f7154346afd482b3183ee180 P a866ff967d964388a6f0dff7fd43df89 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.512058 24534 tablet_replica.cc:333] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89: stopping tablet replica
I20260709 12:26:38.512828 24534 raft_consensus.cc:2243] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:38.513379 24534 raft_consensus.cc:2272] T 237622cb71464b3ca091560bd9d8c06b P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.515673 24534 tablet_replica.cc:333] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89: stopping tablet replica
I20260709 12:26:38.516412 24534 raft_consensus.cc:2243] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:38.517279 24534 raft_consensus.cc:2272] T c87d777e7d64471f988b07272bf2441c P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.519483 24534 tablet_replica.cc:333] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89: stopping tablet replica
I20260709 12:26:38.519845   811 raft_consensus.cc:493] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:26:38.520293 24534 raft_consensus.cc:2243] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 26 LEADER]: Raft consensus shutting down.
I20260709 12:26:38.520371   811 raft_consensus.cc:515] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:38.521517 24534 raft_consensus.cc:2272] T 2a278e46eb5d49edab4ba69303448a66 P a866ff967d964388a6f0dff7fd43df89 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.522575   811 leader_election.cc:290] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:38.524093 24534 tablet_replica.cc:333] T afda1f2e78cc4f799b9bad380ffd3d44 P a866ff967d964388a6f0dff7fd43df89: stopping tablet replica
I20260709 12:26:38.524567   811 raft_consensus.cc:493] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:26:38.525203 24534 raft_consensus.cc:2243] T afda1f2e78cc4f799b9bad380ffd3d44 P a866ff967d964388a6f0dff7fd43df89 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:38.525075   811 raft_consensus.cc:515] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f82778701b464892aab92a752ed7ffdc" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 37349 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:38.525972 24534 raft_consensus.cc:2272] T afda1f2e78cc4f799b9bad380ffd3d44 P a866ff967d964388a6f0dff7fd43df89 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.526954   869 raft_consensus.cc:493] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5cccf20a8bff46dba6601f241d172b8a)
I20260709 12:26:38.527464   869 raft_consensus.cc:515] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "6e673265293d4e9a937dc45150aeb1b8" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 37267 } } peers { permanent_uuid: "5cccf20a8bff46dba6601f241d172b8a" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36237 } } peers { permanent_uuid: "a866ff967d964388a6f0dff7fd43df89" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 35611 } attrs { promote: false } }
I20260709 12:26:38.528682   811 leader_election.cc:290] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:38.529292 24534 tablet_replica.cc:333] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89: stopping tablet replica
I20260709 12:26:38.529628   869 leader_election.cc:290] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267), 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237)
I20260709 12:26:38.530192 24534 raft_consensus.cc:2243] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:26:38.531385 24534 raft_consensus.cc:2272] T 06c3ab7c0c7a496390151c476ec675a0 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:38.534171 26402 leader_election.cc:336] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:38.534453 24534 tablet_replica.cc:333] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89: stopping tablet replica
W20260709 12:26:38.535347 26401 leader_election.cc:336] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 6e673265293d4e9a937dc45150aeb1b8 (127.23.245.130:37267): Network error: Client connection negotiation failed: client connection to 127.23.245.130:37267: connect: Connection refused (error 111)
W20260709 12:26:38.535725 26402 leader_election.cc:336] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Network error: Client connection negotiation failed: client connection to 127.23.245.131:36237: connect: Connection refused (error 111)
I20260709 12:26:38.536044 24534 raft_consensus.cc:2243] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:38.536142 26402 leader_election.cc:304] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:38.537007 24534 raft_consensus.cc:2272] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.537009   869 raft_consensus.cc:2749] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:38.540313 24534 tablet_replica.cc:333] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89: stopping tablet replica
W20260709 12:26:38.540532 26402 leader_election.cc:336] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer f82778701b464892aab92a752ed7ffdc (127.23.245.129:37349): Network error: Client connection negotiation failed: client connection to 127.23.245.129:37349: connect: Connection refused (error 111)
I20260709 12:26:38.541163 24534 raft_consensus.cc:2243] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Raft consensus shutting down.
W20260709 12:26:38.541268 26402 leader_election.cc:336] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Network error: Client connection negotiation failed: client connection to 127.23.245.131:36237: connect: Connection refused (error 111)
I20260709 12:26:38.541672 26402 leader_election.cc:304] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, f82778701b464892aab92a752ed7ffdc
I20260709 12:26:38.542027 24534 raft_consensus.cc:2272] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:38.542287 26402 raft_consensus.cc:2686] T 522704a36135481fa4fc221fa9a0801e P a866ff967d964388a6f0dff7fd43df89: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 12:26:38.542846 26402 leader_election.cc:336] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5cccf20a8bff46dba6601f241d172b8a (127.23.245.131:36237): Network error: Client connection negotiation failed: client connection to 127.23.245.131:36237: connect: Connection refused (error 111)
I20260709 12:26:38.543217 26402 leader_election.cc:304] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a866ff967d964388a6f0dff7fd43df89; no voters: 5cccf20a8bff46dba6601f241d172b8a, 6e673265293d4e9a937dc45150aeb1b8
W20260709 12:26:38.543792 26402 raft_consensus.cc:2686] T f979ddeb5c014d329931d4e2e035af60 P a866ff967d964388a6f0dff7fd43df89: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:26:38.544972 24534 tablet_replica.cc:333] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89: stopping tablet replica
I20260709 12:26:38.545843 24534 raft_consensus.cc:2243] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:38.546518 24534 raft_consensus.cc:2272] T 05232536e53b419682a5f24515843652 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.549309 24534 tablet_replica.cc:333] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89: stopping tablet replica
I20260709 12:26:38.550187 24534 raft_consensus.cc:2243] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:38.550751 24534 raft_consensus.cc:2272] T 90d850895b8a4a40a4fba5caf2048ca2 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.553454 24534 tablet_replica.cc:333] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89: stopping tablet replica
I20260709 12:26:38.554116 24534 raft_consensus.cc:2243] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:26:38.555066 24534 raft_consensus.cc:2272] T de96c5816bc14e3cb8f32ff10dc52a61 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.557376 24534 tablet_replica.cc:333] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89: stopping tablet replica
I20260709 12:26:38.557922 24534 raft_consensus.cc:2243] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:38.558393 24534 raft_consensus.cc:2272] T 25bd5658646b41608d707d196c6e0585 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.560470 24534 tablet_replica.cc:333] T d7bb9a8676e14626b11877dab828ea68 P a866ff967d964388a6f0dff7fd43df89: stopping tablet replica
I20260709 12:26:38.561044 24534 raft_consensus.cc:2243] T d7bb9a8676e14626b11877dab828ea68 P a866ff967d964388a6f0dff7fd43df89 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:38.561581 24534 raft_consensus.cc:2272] T d7bb9a8676e14626b11877dab828ea68 P a866ff967d964388a6f0dff7fd43df89 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.564078 24534 tablet_replica.cc:333] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89: stopping tablet replica
I20260709 12:26:38.564605 24534 raft_consensus.cc:2243] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:38.565223 24534 raft_consensus.cc:2272] T 0a6b77683d6547db82cd02da9d9c938a P a866ff967d964388a6f0dff7fd43df89 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.567201 24534 tablet_replica.cc:333] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89: stopping tablet replica
I20260709 12:26:38.567730 24534 raft_consensus.cc:2243] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:26:38.568548 24534 raft_consensus.cc:2272] T ca1c66d4736542ecb25b33fab43ae780 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.570552 24534 tablet_replica.cc:333] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89: stopping tablet replica
I20260709 12:26:38.571084 24534 raft_consensus.cc:2243] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:38.571554 24534 raft_consensus.cc:2272] T 06bd2840931844279521c7e8eb8750bf P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.573680 24534 tablet_replica.cc:333] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89: stopping tablet replica
I20260709 12:26:38.574226 24534 raft_consensus.cc:2243] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 26 LEADER]: Raft consensus shutting down.
I20260709 12:26:38.574986 24534 raft_consensus.cc:2272] T 63f47864b8d248a792567d96c5e453b8 P a866ff967d964388a6f0dff7fd43df89 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.577286 24534 tablet_replica.cc:333] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89: stopping tablet replica
I20260709 12:26:38.577831 24534 raft_consensus.cc:2243] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:38.578450 24534 raft_consensus.cc:2272] T 819272169f6f4293b6e279793be58b49 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.580523 24534 tablet_replica.cc:333] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89: stopping tablet replica
I20260709 12:26:38.581084 24534 raft_consensus.cc:2243] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:26:38.582149 24534 raft_consensus.cc:2272] T 7954a5254e674b77843c0d32002d2e90 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.584223 24534 tablet_replica.cc:333] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89: stopping tablet replica
I20260709 12:26:38.584755 24534 raft_consensus.cc:2243] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:26:38.585561 24534 raft_consensus.cc:2272] T f5c104146a1c4ce1b19e2c6b5a1bf37a P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.588100 24534 tablet_replica.cc:333] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89: stopping tablet replica
I20260709 12:26:38.588687 24534 raft_consensus.cc:2243] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:26:38.589516 24534 raft_consensus.cc:2272] T 3d79b16002fc460a9e70bd0a5bcec639 P a866ff967d964388a6f0dff7fd43df89 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.591557 24534 tablet_replica.cc:333] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89: stopping tablet replica
I20260709 12:26:38.592295 24534 raft_consensus.cc:2243] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:26:38.593153 24534 raft_consensus.cc:2272] T a22f8565191e471dbe96772477b84e36 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.595117 24534 tablet_replica.cc:333] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89: stopping tablet replica
I20260709 12:26:38.595759 24534 raft_consensus.cc:2243] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:26:38.596767 24534 raft_consensus.cc:2272] T f1625669bcc54589846d8a3d94c097d4 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.598881 24534 tablet_replica.cc:333] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89: stopping tablet replica
I20260709 12:26:38.599414 24534 raft_consensus.cc:2243] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:26:38.600334 24534 raft_consensus.cc:2272] T 8d74d1c9c8a84919a6f57b0b6721de51 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.602430 24534 tablet_replica.cc:333] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89: stopping tablet replica
I20260709 12:26:38.602980 24534 raft_consensus.cc:2243] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:38.603570 24534 raft_consensus.cc:2272] T 4734c282e09b4bbbb96de8eee61c160a P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.605782 24534 tablet_replica.cc:333] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89: stopping tablet replica
I20260709 12:26:38.606307 24534 raft_consensus.cc:2243] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:38.606786 24534 raft_consensus.cc:2272] T 870002623db3456699b2b970d066f356 P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.609207 24534 tablet_replica.cc:333] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89: stopping tablet replica
I20260709 12:26:38.609943 24534 raft_consensus.cc:2243] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:38.610438 24534 raft_consensus.cc:2272] T e535a01d34654e31ac7826205390f938 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.613023 24534 tablet_replica.cc:333] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89: stopping tablet replica
I20260709 12:26:38.613732 24534 raft_consensus.cc:2243] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:26:38.614880 24534 raft_consensus.cc:2272] T 04fe73edd8db49c08ea7a6adb6e443e6 P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.617476 24534 tablet_replica.cc:333] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89: stopping tablet replica
I20260709 12:26:38.618024 24534 raft_consensus.cc:2243] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:38.618541 24534 raft_consensus.cc:2272] T 5204a6a2db104ffa90f8679086d4e6f8 P a866ff967d964388a6f0dff7fd43df89 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.620890 24534 tablet_replica.cc:333] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89: stopping tablet replica
I20260709 12:26:38.621567 24534 raft_consensus.cc:2243] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:38.622200 24534 raft_consensus.cc:2272] T 5f0353e850934c9db0a248807127ca4c P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.624722 24534 tablet_replica.cc:333] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89: stopping tablet replica
I20260709 12:26:38.625252 24534 raft_consensus.cc:2243] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:26:38.626042 24534 raft_consensus.cc:2272] T 8dcbaf690aa54e4887d08b85cec29701 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.628085 24534 tablet_replica.cc:333] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89: stopping tablet replica
I20260709 12:26:38.628587 24534 raft_consensus.cc:2243] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:26:38.629400 24534 raft_consensus.cc:2272] T 47453d79f4484e7ea165be91f0269a2b P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.631377 24534 tablet_replica.cc:333] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89: stopping tablet replica
I20260709 12:26:38.631965 24534 raft_consensus.cc:2243] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:26:38.632861 24534 raft_consensus.cc:2272] T 2d9ca842256c405c98d29454943e5d01 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.634847 24534 tablet_replica.cc:333] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89: stopping tablet replica
I20260709 12:26:38.635377 24534 raft_consensus.cc:2243] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:38.636005 24534 raft_consensus.cc:2272] T 4e8d1d3d43ad47308fae5ed98608feb8 P a866ff967d964388a6f0dff7fd43df89 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.637944 24534 tablet_replica.cc:333] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89: stopping tablet replica
I20260709 12:26:38.638481 24534 raft_consensus.cc:2243] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:26:38.639371 24534 raft_consensus.cc:2272] T b12e2b074f1b4518bcfc6728abeca136 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.641471 24534 tablet_replica.cc:333] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89: stopping tablet replica
I20260709 12:26:38.641999 24534 raft_consensus.cc:2243] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:26:38.642831 24534 raft_consensus.cc:2272] T 0c043718ee3a40fea4b2b1453fcb259b P a866ff967d964388a6f0dff7fd43df89 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.644958 24534 tablet_replica.cc:333] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89: stopping tablet replica
I20260709 12:26:38.645560 24534 raft_consensus.cc:2243] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:38.646039 24534 raft_consensus.cc:2272] T f9ea7c5f4a6a4724bfcb0c6d88c32b1c P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.648305 24534 tablet_replica.cc:333] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89: stopping tablet replica
I20260709 12:26:38.648837 24534 raft_consensus.cc:2243] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:26:38.649679 24534 raft_consensus.cc:2272] T a8fa32386b77471b923cc6c4241570d5 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.651582 24534 tablet_replica.cc:333] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89: stopping tablet replica
I20260709 12:26:38.652081 24534 raft_consensus.cc:2243] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:38.652511 24534 raft_consensus.cc:2272] T b679f7cf7f1e468582715c3427ced820 P a866ff967d964388a6f0dff7fd43df89 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.654285 24534 tablet_replica.cc:333] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89: stopping tablet replica
I20260709 12:26:38.654810 24534 raft_consensus.cc:2243] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:38.655270 24534 raft_consensus.cc:2272] T 97d7984a0036411695d6b3427bff9d69 P a866ff967d964388a6f0dff7fd43df89 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.657229 24534 tablet_replica.cc:333] T 58ab3e51ccf14577a94774f25ade6cd8 P a866ff967d964388a6f0dff7fd43df89: stopping tablet replica
I20260709 12:26:38.657732 24534 raft_consensus.cc:2243] T 58ab3e51ccf14577a94774f25ade6cd8 P a866ff967d964388a6f0dff7fd43df89 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:26:38.658806 24534 raft_consensus.cc:2272] T 58ab3e51ccf14577a94774f25ade6cd8 P a866ff967d964388a6f0dff7fd43df89 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.661258 24534 tablet_replica.cc:333] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89: stopping tablet replica
I20260709 12:26:38.661737 24534 raft_consensus.cc:2243] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:38.662298 24534 raft_consensus.cc:2272] T c38d3f292da44b3dbb2e512cd53e21da P a866ff967d964388a6f0dff7fd43df89 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.664351 24534 tablet_replica.cc:333] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89: stopping tablet replica
I20260709 12:26:38.664829 24534 raft_consensus.cc:2243] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:26:38.665606 24534 raft_consensus.cc:2272] T 43b78aa0054b4da398a8fc04d12454a7 P a866ff967d964388a6f0dff7fd43df89 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:38.667650 24534 tablet_replica.cc:333] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89: stopping tablet replica
I20260709 12:26:38.668213 24534 raft_consensus.cc:2243] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:38.668818 24534 raft_consensus.cc:2272] T 01372ae5f161477dab1b4c89fd847b3c P a866ff967d964388a6f0dff7fd43df89 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:39.087240 24534 tablet_server.cc:196] TabletServer@127.23.245.132:0 shutdown complete.
I20260709 12:26:39.166141 24534 master.cc:562] Master@127.23.245.190:45099 shutting down...
W20260709 12:26:39.211509 25632 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 12:26:39.211855 25632 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:26:39.212124 25632 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
I20260709 12:26:39.215380 24534 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 496fd6924b624e77b03ccfd15653d47b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:39.215902 24534 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 496fd6924b624e77b03ccfd15653d47b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:39.216310 24534 tablet_replica.cc:333] T 00000000000000000000000000000000 P 496fd6924b624e77b03ccfd15653d47b: stopping tablet replica
I20260709 12:26:39.351606 24534 master.cc:584] Master@127.23.245.190:45099 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (235067 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 12:26:39.460583 24534 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.23.245.190:34325
I20260709 12:26:39.461750 24534 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:39.467470   871 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:39.467657   870 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:39.468700   873 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:39.469092 24534 server_base.cc:1061] running on GCE node
I20260709 12:26:39.473074 24534 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:39.473307 24534 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:39.473474 24534 hybrid_clock.cc:648] HybridClock initialized: now 1783599999473456 us; error 0 us; skew 500 ppm
I20260709 12:26:39.474048 24534 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:39.476619 24534 webserver.cc:533] Webserver started at http://127.23.245.190:33247/ using document root <none> and password file <none>
I20260709 12:26:39.477125 24534 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:39.477327 24534 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:39.477614 24534 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:39.478833 24534 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599704270295-24534-0/minicluster-data/master-0-root/instance:
uuid: "0c6302794b2d42eea2f95fe038fb037f"
format_stamp: "Formatted at 2026-07-09 12:26:39 on dist-test-slave-mlt7"
I20260709 12:26:39.483292 24534 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:26:39.486792   878 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:39.487560 24534 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:26:39.487943 24534 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599704270295-24534-0/minicluster-data/master-0-root
uuid: "0c6302794b2d42eea2f95fe038fb037f"
format_stamp: "Formatted at 2026-07-09 12:26:39 on dist-test-slave-mlt7"
I20260709 12:26:39.488230 24534 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599704270295-24534-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599704270295-24534-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599704270295-24534-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:39.499516 24534 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:39.500772 24534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:39.538443 24534 rpc_server.cc:307] RPC server started. Bound to: 127.23.245.190:34325
I20260709 12:26:39.538543   929 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.245.190:34325 every 8 connection(s)
I20260709 12:26:39.542359   930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:39.552487   930 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c6302794b2d42eea2f95fe038fb037f: Bootstrap starting.
I20260709 12:26:39.557575   930 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0c6302794b2d42eea2f95fe038fb037f: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:39.563397   930 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c6302794b2d42eea2f95fe038fb037f: No bootstrap required, opened a new log
I20260709 12:26:39.566257   930 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0c6302794b2d42eea2f95fe038fb037f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c6302794b2d42eea2f95fe038fb037f" member_type: VOTER }
I20260709 12:26:39.566767   930 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0c6302794b2d42eea2f95fe038fb037f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:39.567047   930 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0c6302794b2d42eea2f95fe038fb037f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c6302794b2d42eea2f95fe038fb037f, State: Initialized, Role: FOLLOWER
I20260709 12:26:39.567736   930 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0c6302794b2d42eea2f95fe038fb037f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c6302794b2d42eea2f95fe038fb037f" member_type: VOTER }
I20260709 12:26:39.568292   930 raft_consensus.cc:399] T 00000000000000000000000000000000 P 0c6302794b2d42eea2f95fe038fb037f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:26:39.568540   930 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0c6302794b2d42eea2f95fe038fb037f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:26:39.568809   930 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0c6302794b2d42eea2f95fe038fb037f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:39.573474   930 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0c6302794b2d42eea2f95fe038fb037f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c6302794b2d42eea2f95fe038fb037f" member_type: VOTER }
I20260709 12:26:39.573990   930 leader_election.cc:304] T 00000000000000000000000000000000 P 0c6302794b2d42eea2f95fe038fb037f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0c6302794b2d42eea2f95fe038fb037f; no voters: 
I20260709 12:26:39.575100   930 leader_election.cc:290] T 00000000000000000000000000000000 P 0c6302794b2d42eea2f95fe038fb037f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:26:39.575513   933 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0c6302794b2d42eea2f95fe038fb037f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:39.576938   933 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0c6302794b2d42eea2f95fe038fb037f [term 1 LEADER]: Becoming Leader. State: Replica: 0c6302794b2d42eea2f95fe038fb037f, State: Running, Role: LEADER
I20260709 12:26:39.577594   933 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0c6302794b2d42eea2f95fe038fb037f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c6302794b2d42eea2f95fe038fb037f" member_type: VOTER }
I20260709 12:26:39.577963   930 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0c6302794b2d42eea2f95fe038fb037f [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:26:39.581961   934 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c6302794b2d42eea2f95fe038fb037f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0c6302794b2d42eea2f95fe038fb037f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c6302794b2d42eea2f95fe038fb037f" member_type: VOTER } }
I20260709 12:26:39.582669   934 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c6302794b2d42eea2f95fe038fb037f [sys.catalog]: This master's current role is: LEADER
I20260709 12:26:39.582792   935 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c6302794b2d42eea2f95fe038fb037f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0c6302794b2d42eea2f95fe038fb037f. Latest consensus state: current_term: 1 leader_uuid: "0c6302794b2d42eea2f95fe038fb037f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c6302794b2d42eea2f95fe038fb037f" member_type: VOTER } }
I20260709 12:26:39.583673   935 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c6302794b2d42eea2f95fe038fb037f [sys.catalog]: This master's current role is: LEADER
I20260709 12:26:39.588425   940 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:26:39.596086   940 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:26:39.597076 24534 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:26:39.605103   940 catalog_manager.cc:1383] Generated new cluster ID: 9cfdddb0ab9547b4a0a23bff8b3d03e2
I20260709 12:26:39.605436   940 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:26:39.623204   940 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:26:39.624498   940 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:26:39.644007   940 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 0c6302794b2d42eea2f95fe038fb037f: Generated new TSK 0
I20260709 12:26:39.644690   940 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:26:39.663728 24534 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:39.670112   951 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:39.672572   952 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:39.674911   954 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:39.675855 24534 server_base.cc:1061] running on GCE node
I20260709 12:26:39.678094 24534 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:39.678280 24534 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:39.678496 24534 hybrid_clock.cc:648] HybridClock initialized: now 1783599999678462 us; error 0 us; skew 500 ppm
I20260709 12:26:39.679162 24534 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:39.687383 24534 webserver.cc:533] Webserver started at http://127.23.245.129:35951/ using document root <none> and password file <none>
I20260709 12:26:39.687906 24534 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:39.688146 24534 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:39.688403 24534 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:39.689564 24534 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599704270295-24534-0/minicluster-data/ts-0-root/instance:
uuid: "aa098a557d34433896712068efd0d9a8"
format_stamp: "Formatted at 2026-07-09 12:26:39 on dist-test-slave-mlt7"
I20260709 12:26:39.694222 24534 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:26:39.697613   959 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:39.698594 24534 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:26:39.698973 24534 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599704270295-24534-0/minicluster-data/ts-0-root
uuid: "aa098a557d34433896712068efd0d9a8"
format_stamp: "Formatted at 2026-07-09 12:26:39 on dist-test-slave-mlt7"
I20260709 12:26:39.699281 24534 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599704270295-24534-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599704270295-24534-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599704270295-24534-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:39.714457 24534 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:39.715588 24534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:39.717116 24534 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:39.719389 24534 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:39.719558 24534 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:39.719846 24534 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:39.720084 24534 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:26:39.762297 24534 rpc_server.cc:307] RPC server started. Bound to: 127.23.245.129:32981
I20260709 12:26:39.762504  1021 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.245.129:32981 every 8 connection(s)
I20260709 12:26:39.767505 24534 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:39.775137  1026 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:39.777323  1027 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:39.779187  1029 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:39.781296 24534 server_base.cc:1061] running on GCE node
I20260709 12:26:39.784271 24534 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:26:39.784541  1022 heartbeater.cc:344] Connected to a master server at 127.23.245.190:34325
W20260709 12:26:39.784554 24534 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:39.784997 24534 hybrid_clock.cc:648] HybridClock initialized: now 1783599999784974 us; error 0 us; skew 500 ppm
I20260709 12:26:39.785048  1022 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:39.785632 24534 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:39.785900  1022 heartbeater.cc:507] Master 127.23.245.190:34325 requested a full tablet report, sending...
I20260709 12:26:39.788296   895 ts_manager.cc:194] Registered new tserver with Master: aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:39.788586 24534 webserver.cc:533] Webserver started at http://127.23.245.130:42575/ using document root <none> and password file <none>
I20260709 12:26:39.789259 24534 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:39.789522 24534 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:39.789865 24534 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:39.790827   895 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58076
I20260709 12:26:39.791518 24534 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599704270295-24534-0/minicluster-data/ts-1-root/instance:
uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
format_stamp: "Formatted at 2026-07-09 12:26:39 on dist-test-slave-mlt7"
I20260709 12:26:39.796486 24534 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:26:39.800271  1034 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:39.801234 24534 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:26:39.801566 24534 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599704270295-24534-0/minicluster-data/ts-1-root
uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
format_stamp: "Formatted at 2026-07-09 12:26:39 on dist-test-slave-mlt7"
I20260709 12:26:39.801851 24534 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599704270295-24534-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599704270295-24534-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599704270295-24534-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:39.816069 24534 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:39.817392 24534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:39.818984 24534 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:39.821336 24534 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:39.821557 24534 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:39.821802 24534 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:39.821973 24534 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:39.863049 24534 rpc_server.cc:307] RPC server started. Bound to: 127.23.245.130:43679
I20260709 12:26:39.863171  1096 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.245.130:43679 every 8 connection(s)
I20260709 12:26:39.868100 24534 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:39.874534  1100 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:39.877658  1101 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:39.878005 24534 server_base.cc:1061] running on GCE node
W20260709 12:26:39.878921  1103 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:39.880110 24534 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:39.880350 24534 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:39.880575 24534 hybrid_clock.cc:648] HybridClock initialized: now 1783599999880555 us; error 0 us; skew 500 ppm
I20260709 12:26:39.881187 24534 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:39.882094  1097 heartbeater.cc:344] Connected to a master server at 127.23.245.190:34325
I20260709 12:26:39.882539  1097 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:39.883249  1097 heartbeater.cc:507] Master 127.23.245.190:34325 requested a full tablet report, sending...
I20260709 12:26:39.883760 24534 webserver.cc:533] Webserver started at http://127.23.245.131:37139/ using document root <none> and password file <none>
I20260709 12:26:39.884431 24534 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:39.884678 24534 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:39.884963 24534 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:39.885529   895 ts_manager.cc:194] Registered new tserver with Master: 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:39.886253 24534 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599704270295-24534-0/minicluster-data/ts-2-root/instance:
uuid: "8fa35514a8d84740b1b46ae496307f20"
format_stamp: "Formatted at 2026-07-09 12:26:39 on dist-test-slave-mlt7"
I20260709 12:26:39.886991   895 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58088
I20260709 12:26:39.891139 24534 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.004s
I20260709 12:26:39.894791  1108 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:39.895689 24534 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:26:39.896062 24534 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599704270295-24534-0/minicluster-data/ts-2-root
uuid: "8fa35514a8d84740b1b46ae496307f20"
format_stamp: "Formatted at 2026-07-09 12:26:39 on dist-test-slave-mlt7"
I20260709 12:26:39.896389 24534 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599704270295-24534-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599704270295-24534-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599704270295-24534-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:39.939791 24534 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:39.941147 24534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:39.942633 24534 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:39.944922 24534 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:39.945163 24534 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:39.945417 24534 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:39.945600 24534 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:39.985869 24534 rpc_server.cc:307] RPC server started. Bound to: 127.23.245.131:40341
I20260709 12:26:39.985970  1170 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.245.131:40341 every 8 connection(s)
I20260709 12:26:39.990661 24534 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:39.996872  1174 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:40.002169  1175 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:40.002910  1177 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:40.005234 24534 server_base.cc:1061] running on GCE node
I20260709 12:26:40.006485 24534 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:40.006971 24534 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:40.007221 24534 hybrid_clock.cc:648] HybridClock initialized: now 1783600000007199 us; error 0 us; skew 500 ppm
I20260709 12:26:40.007943  1171 heartbeater.cc:344] Connected to a master server at 127.23.245.190:34325
I20260709 12:26:40.007979 24534 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:40.008464  1171 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:40.009469  1171 heartbeater.cc:507] Master 127.23.245.190:34325 requested a full tablet report, sending...
I20260709 12:26:40.012286   895 ts_manager.cc:194] Registered new tserver with Master: 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341)
I20260709 12:26:40.013013 24534 webserver.cc:533] Webserver started at http://127.23.245.132:39617/ using document root <none> and password file <none>
I20260709 12:26:40.014055 24534 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:40.014446 24534 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:40.014518   895 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58094
I20260709 12:26:40.015023 24534 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:40.017138 24534 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599704270295-24534-0/minicluster-data/ts-3-root/instance:
uuid: "937efeddef934b2b8bc8632594903085"
format_stamp: "Formatted at 2026-07-09 12:26:40 on dist-test-slave-mlt7"
I20260709 12:26:40.024364 24534 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.003s	sys 0.004s
I20260709 12:26:40.029552  1182 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:40.030639 24534 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.001s
I20260709 12:26:40.031051 24534 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599704270295-24534-0/minicluster-data/ts-3-root
uuid: "937efeddef934b2b8bc8632594903085"
format_stamp: "Formatted at 2026-07-09 12:26:40 on dist-test-slave-mlt7"
I20260709 12:26:40.031543 24534 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599704270295-24534-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599704270295-24534-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599704270295-24534-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:40.052219 24534 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:40.053440 24534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:40.054864 24534 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:40.057215 24534 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:40.057462 24534 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:40.057705 24534 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:40.057890 24534 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:40.104988 24534 rpc_server.cc:307] RPC server started. Bound to: 127.23.245.132:33909
I20260709 12:26:40.105110  1244 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.245.132:33909 every 8 connection(s)
I20260709 12:26:40.119593  1245 heartbeater.cc:344] Connected to a master server at 127.23.245.190:34325
I20260709 12:26:40.120105  1245 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:40.121004  1245 heartbeater.cc:507] Master 127.23.245.190:34325 requested a full tablet report, sending...
I20260709 12:26:40.122961   895 ts_manager.cc:194] Registered new tserver with Master: 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:26:40.123126 24534 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.014889401s
I20260709 12:26:40.124460   895 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58102
I20260709 12:26:40.150131   895 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58112:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 12:26:40.386719  1210 tablet_service.cc:1511] Processing CreateTablet for tablet e2ef4b262fac46fe9f9111b609547aa3 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:26:40.387666  1062 tablet_service.cc:1511] Processing CreateTablet for tablet e2ef4b262fac46fe9f9111b609547aa3 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:26:40.388414  1210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2ef4b262fac46fe9f9111b609547aa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.389094  1062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2ef4b262fac46fe9f9111b609547aa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.393050  1061 tablet_service.cc:1511] Processing CreateTablet for tablet e281f15348944cc1ab51fce7c1653aac (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:26:40.394841  1061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e281f15348944cc1ab51fce7c1653aac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.398239  1208 tablet_service.cc:1511] Processing CreateTablet for tablet c9793ebdadaa4da18e4e2c2fe6dae825 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:26:40.391633  1209 tablet_service.cc:1511] Processing CreateTablet for tablet b2ae9b52b5bd4abf9b47e9e7f86a9519 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:26:40.401724  1209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2ae9b52b5bd4abf9b47e9e7f86a9519. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.395583  1060 tablet_service.cc:1511] Processing CreateTablet for tablet c9793ebdadaa4da18e4e2c2fe6dae825 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:26:40.406526  1060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9793ebdadaa4da18e4e2c2fe6dae825. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.412969  1059 tablet_service.cc:1511] Processing CreateTablet for tablet 284ea666431c4339998eb885cd31facb (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:26:40.414813  1059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 284ea666431c4339998eb885cd31facb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.418190  1207 tablet_service.cc:1511] Processing CreateTablet for tablet e12f4bd1b2ed49988317684782c8616b (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:26:40.422765  1058 tablet_service.cc:1511] Processing CreateTablet for tablet e12f4bd1b2ed49988317684782c8616b (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:26:40.424643  1058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e12f4bd1b2ed49988317684782c8616b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.427850  1206 tablet_service.cc:1511] Processing CreateTablet for tablet 70720af8528947a89c03ec468c1235eb (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:26:40.431608  1057 tablet_service.cc:1511] Processing CreateTablet for tablet 8c7002e5875a494e8e845023cc05503f (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:26:40.433212  1057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c7002e5875a494e8e845023cc05503f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.438536  1205 tablet_service.cc:1511] Processing CreateTablet for tablet 8c7002e5875a494e8e845023cc05503f (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:26:40.441183   987 tablet_service.cc:1511] Processing CreateTablet for tablet e2ef4b262fac46fe9f9111b609547aa3 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:26:40.442795   987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2ef4b262fac46fe9f9111b609547aa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.445139   986 tablet_service.cc:1511] Processing CreateTablet for tablet e281f15348944cc1ab51fce7c1653aac (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:26:40.449096   984 tablet_service.cc:1511] Processing CreateTablet for tablet 284ea666431c4339998eb885cd31facb (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:26:40.453285   982 tablet_service.cc:1511] Processing CreateTablet for tablet 70720af8528947a89c03ec468c1235eb (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:26:40.455907   981 tablet_service.cc:1511] Processing CreateTablet for tablet 2f2713fe1c7148f0b6d9a69c53ec3515 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:26:40.461550  1204 tablet_service.cc:1511] Processing CreateTablet for tablet 5b3d71845177478a9e2510c82e0cf9d1 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:26:40.458010   979 tablet_service.cc:1511] Processing CreateTablet for tablet 580f367489064e218eef65b4654744b8 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:26:40.459669   980 tablet_service.cc:1511] Processing CreateTablet for tablet 5b3d71845177478a9e2510c82e0cf9d1 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:26:40.447616   985 tablet_service.cc:1511] Processing CreateTablet for tablet b2ae9b52b5bd4abf9b47e9e7f86a9519 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:26:40.451767   983 tablet_service.cc:1511] Processing CreateTablet for tablet e12f4bd1b2ed49988317684782c8616b (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:26:40.424643  1207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e12f4bd1b2ed49988317684782c8616b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.469843  1061 tablet_service.cc:1511] Processing CreateTablet for tablet 2f2713fe1c7148f0b6d9a69c53ec3515 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:26:40.471311  1061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f2713fe1c7148f0b6d9a69c53ec3515. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.473238   978 tablet_service.cc:1511] Processing CreateTablet for tablet c9d72f2a6ae046cb9d4e6277d13e34e6 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:26:40.475701  1203 tablet_service.cc:1511] Processing CreateTablet for tablet 580f367489064e218eef65b4654744b8 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:26:40.477177  1203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 580f367489064e218eef65b4654744b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.481189  1202 tablet_service.cc:1511] Processing CreateTablet for tablet 1b6df135b8494d0d916747b8994b5cf9 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:26:40.482595  1202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b6df135b8494d0d916747b8994b5cf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.484459  1205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c7002e5875a494e8e845023cc05503f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.485682   986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e281f15348944cc1ab51fce7c1653aac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.488323   978 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9d72f2a6ae046cb9d4e6277d13e34e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.492272   979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 580f367489064e218eef65b4654744b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.496274   982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70720af8528947a89c03ec468c1235eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.500284  1208 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9793ebdadaa4da18e4e2c2fe6dae825. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.504283   983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e12f4bd1b2ed49988317684782c8616b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.506541   980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b3d71845177478a9e2510c82e0cf9d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.508219  1206 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70720af8528947a89c03ec468c1235eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.508322   984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 284ea666431c4339998eb885cd31facb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.509019  1204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b3d71845177478a9e2510c82e0cf9d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.511861   985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2ae9b52b5bd4abf9b47e9e7f86a9519. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.511420  1056 tablet_service.cc:1511] Processing CreateTablet for tablet 5b3d71845177478a9e2510c82e0cf9d1 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:26:40.512183  1053 tablet_service.cc:1511] Processing CreateTablet for tablet 3a19a87d91404b73bdba7121512bf7aa (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:26:40.513051  1056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b3d71845177478a9e2510c82e0cf9d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.513785  1053 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a19a87d91404b73bdba7121512bf7aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.515434  1055 tablet_service.cc:1511] Processing CreateTablet for tablet 1b6df135b8494d0d916747b8994b5cf9 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:26:40.516263   981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f2713fe1c7148f0b6d9a69c53ec3515. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.517009  1055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b6df135b8494d0d916747b8994b5cf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.520932  1201 tablet_service.cc:1511] Processing CreateTablet for tablet 3a19a87d91404b73bdba7121512bf7aa (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:26:40.521292  1054 tablet_service.cc:1511] Processing CreateTablet for tablet c9d72f2a6ae046cb9d4e6277d13e34e6 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:26:40.522437  1201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a19a87d91404b73bdba7121512bf7aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.522769  1054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9d72f2a6ae046cb9d4e6277d13e34e6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:40.591846   943 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:40.593798  1204 tablet_service.cc:1511] Processing CreateTablet for tablet 3e22afc1ef634aaabf17a4e5a3bf0be3 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:26:40.599885   983 tablet_service.cc:1511] Processing CreateTablet for tablet 3a19a87d91404b73bdba7121512bf7aa (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:26:40.602133   983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a19a87d91404b73bdba7121512bf7aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.602881  1204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e22afc1ef634aaabf17a4e5a3bf0be3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.652274  1062 tablet_service.cc:1511] Processing CreateTablet for tablet b8e49440650449f49e5303568f2f19c0 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:26:40.652583   987 tablet_service.cc:1511] Processing CreateTablet for tablet 3e22afc1ef634aaabf17a4e5a3bf0be3 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:26:40.653867   987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e22afc1ef634aaabf17a4e5a3bf0be3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.657435  1061 tablet_service.cc:1511] Processing CreateTablet for tablet 9a7d578ba2eb41f7a38f15c5dd34b8cb (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:26:40.663112  1057 tablet_service.cc:1511] Processing CreateTablet for tablet e81f2374d9904e93bf2941ff8b241c09 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:26:40.663805  1054 tablet_service.cc:1511] Processing CreateTablet for tablet acc6ab0dce1640e380b433b32a874108 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:26:40.664705  1057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e81f2374d9904e93bf2941ff8b241c09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.667739  1059 tablet_service.cc:1511] Processing CreateTablet for tablet e5af913e96004f3b8cac5fbe6ac655ac (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:26:40.668493  1061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a7d578ba2eb41f7a38f15c5dd34b8cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.669322  1059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5af913e96004f3b8cac5fbe6ac655ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.670547   980 tablet_service.cc:1511] Processing CreateTablet for tablet 9a7d578ba2eb41f7a38f15c5dd34b8cb (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:26:40.671819   980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a7d578ba2eb41f7a38f15c5dd34b8cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.671730  1210 tablet_service.cc:1511] Processing CreateTablet for tablet b8e49440650449f49e5303568f2f19c0 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:26:40.673170  1210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8e49440650449f49e5303568f2f19c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.673009   982 tablet_service.cc:1511] Processing CreateTablet for tablet e81f2374d9904e93bf2941ff8b241c09 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:26:40.674294   982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e81f2374d9904e93bf2941ff8b241c09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.676322  1062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8e49440650449f49e5303568f2f19c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.679271  1207 tablet_service.cc:1511] Processing CreateTablet for tablet e81f2374d9904e93bf2941ff8b241c09 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:26:40.680254  1054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acc6ab0dce1640e380b433b32a874108. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.680900  1207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e81f2374d9904e93bf2941ff8b241c09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.685235  1264 tablet_bootstrap.cc:492] T e2ef4b262fac46fe9f9111b609547aa3 P 937efeddef934b2b8bc8632594903085: Bootstrap starting.
I20260709 12:26:40.706352  1266 tablet_bootstrap.cc:492] T 284ea666431c4339998eb885cd31facb P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:40.709054   986 tablet_service.cc:1511] Processing CreateTablet for tablet e5af913e96004f3b8cac5fbe6ac655ac (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:26:40.710484   986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5af913e96004f3b8cac5fbe6ac655ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.713299   984 tablet_service.cc:1511] Processing CreateTablet for tablet c4234c6cf75048c5a6cdf34e43c9bd1e (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:26:40.714596   984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4234c6cf75048c5a6cdf34e43c9bd1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.722429  1135 tablet_service.cc:1511] Processing CreateTablet for tablet b2ae9b52b5bd4abf9b47e9e7f86a9519 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:26:40.723870  1135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2ae9b52b5bd4abf9b47e9e7f86a9519. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.724562  1136 tablet_service.cc:1511] Processing CreateTablet for tablet e281f15348944cc1ab51fce7c1653aac (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:26:40.725894  1136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e281f15348944cc1ab51fce7c1653aac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.728901  1202 tablet_service.cc:1511] Processing CreateTablet for tablet acc6ab0dce1640e380b433b32a874108 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:26:40.729130  1134 tablet_service.cc:1511] Processing CreateTablet for tablet c9793ebdadaa4da18e4e2c2fe6dae825 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:26:40.788885  1202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acc6ab0dce1640e380b433b32a874108. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.730962  1133 tablet_service.cc:1511] Processing CreateTablet for tablet 284ea666431c4339998eb885cd31facb (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:26:40.732774  1132 tablet_service.cc:1511] Processing CreateTablet for tablet 70720af8528947a89c03ec468c1235eb (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:26:40.734526  1131 tablet_service.cc:1511] Processing CreateTablet for tablet 8c7002e5875a494e8e845023cc05503f (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:26:40.736244  1130 tablet_service.cc:1511] Processing CreateTablet for tablet 2f2713fe1c7148f0b6d9a69c53ec3515 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:26:40.738054  1129 tablet_service.cc:1511] Processing CreateTablet for tablet 580f367489064e218eef65b4654744b8 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:26:40.740303  1128 tablet_service.cc:1511] Processing CreateTablet for tablet 1b6df135b8494d0d916747b8994b5cf9 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:26:40.742553  1127 tablet_service.cc:1511] Processing CreateTablet for tablet c9d72f2a6ae046cb9d4e6277d13e34e6 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
W20260709 12:26:40.748191   882 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.23.245.129:32981, user_credentials={real_user=slave}} blocked reactor thread for 62395.6us
I20260709 12:26:40.796265  1022 heartbeater.cc:499] Master 127.23.245.190:34325 was elected leader, sending a full tablet report...
I20260709 12:26:40.806054  1135 tablet_service.cc:1511] Processing CreateTablet for tablet e5af913e96004f3b8cac5fbe6ac655ac (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:26:40.820293  1056 tablet_service.cc:1511] Processing CreateTablet for tablet edea2a0a3c264f2b810295aea0acfb73 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:26:40.820528   986 tablet_service.cc:1511] Processing CreateTablet for tablet ec47b02d68674e2386a86244d9026b78 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:26:40.821902   986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec47b02d68674e2386a86244d9026b78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.821894  1056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edea2a0a3c264f2b810295aea0acfb73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.753952  1264 tablet_bootstrap.cc:654] T e2ef4b262fac46fe9f9111b609547aa3 P 937efeddef934b2b8bc8632594903085: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:40.764528  1205 tablet_service.cc:1511] Processing CreateTablet for tablet 6715731f9a31415a98fa8a0ab9944eec (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:26:40.768327  1201 tablet_service.cc:1511] Processing CreateTablet for tablet c4234c6cf75048c5a6cdf34e43c9bd1e (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:26:40.769914  1209 tablet_service.cc:1511] Processing CreateTablet for tablet ec47b02d68674e2386a86244d9026b78 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:26:40.774598  1055 tablet_service.cc:1511] Processing CreateTablet for tablet ec47b02d68674e2386a86244d9026b78 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:26:40.825457  1055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec47b02d68674e2386a86244d9026b78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.780678  1266 tablet_bootstrap.cc:654] T 284ea666431c4339998eb885cd31facb P aa098a557d34433896712068efd0d9a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:40.788949  1134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9793ebdadaa4da18e4e2c2fe6dae825. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.835863   978 tablet_service.cc:1511] Processing CreateTablet for tablet 333930b9df5744d59ab498b170a35315 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:26:40.837329   978 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 333930b9df5744d59ab498b170a35315. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.841310   979 tablet_service.cc:1511] Processing CreateTablet for tablet 6715731f9a31415a98fa8a0ab9944eec (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:26:40.842693   979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6715731f9a31415a98fa8a0ab9944eec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.843068  1210 tablet_service.cc:1511] Processing CreateTablet for tablet edea2a0a3c264f2b810295aea0acfb73 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:26:40.730438  1265 tablet_bootstrap.cc:492] T e2ef4b262fac46fe9f9111b609547aa3 P 7f9cbe40e40d429aa004e4a7fb42f132: Bootstrap starting.
I20260709 12:26:40.848383  1128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b6df135b8494d0d916747b8994b5cf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.851720  1131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c7002e5875a494e8e845023cc05503f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.865007  1201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4234c6cf75048c5a6cdf34e43c9bd1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.871965  1267 tablet_bootstrap.cc:492] T e281f15348944cc1ab51fce7c1653aac P 8fa35514a8d84740b1b46ae496307f20: Bootstrap starting.
I20260709 12:26:40.873062  1061 tablet_service.cc:1511] Processing CreateTablet for tablet 333930b9df5744d59ab498b170a35315 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:26:40.874497  1061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 333930b9df5744d59ab498b170a35315. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.874861  1265 tablet_bootstrap.cc:654] T e2ef4b262fac46fe9f9111b609547aa3 P 7f9cbe40e40d429aa004e4a7fb42f132: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:40.876441  1136 tablet_service.cc:1511] Processing CreateTablet for tablet c4234c6cf75048c5a6cdf34e43c9bd1e (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:26:40.877501  1264 tablet_bootstrap.cc:492] T e2ef4b262fac46fe9f9111b609547aa3 P 937efeddef934b2b8bc8632594903085: No bootstrap required, opened a new log
I20260709 12:26:40.870587  1132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70720af8528947a89c03ec468c1235eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.882411  1136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4234c6cf75048c5a6cdf34e43c9bd1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.878116  1264 ts_tablet_manager.cc:1403] T e2ef4b262fac46fe9f9111b609547aa3 P 937efeddef934b2b8bc8632594903085: Time spent bootstrapping tablet: real 0.193s	user 0.010s	sys 0.011s
I20260709 12:26:40.888747  1210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edea2a0a3c264f2b810295aea0acfb73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.891340  1097 heartbeater.cc:499] Master 127.23.245.190:34325 was elected leader, sending a full tablet report...
I20260709 12:26:40.899014  1059 tablet_service.cc:1511] Processing CreateTablet for tablet c495ce9da627479e92d7b24b3be3641a (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:26:40.900403  1059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c495ce9da627479e92d7b24b3be3641a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.902007  1209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec47b02d68674e2386a86244d9026b78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.902624  1267 tablet_bootstrap.cc:654] T e281f15348944cc1ab51fce7c1653aac P 8fa35514a8d84740b1b46ae496307f20: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:40.894845  1207 tablet_service.cc:1511] Processing CreateTablet for tablet c495ce9da627479e92d7b24b3be3641a (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:26:40.895202   984 tablet_service.cc:1511] Processing CreateTablet for tablet c495ce9da627479e92d7b24b3be3641a (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:26:40.904000  1207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c495ce9da627479e92d7b24b3be3641a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.904203   984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c495ce9da627479e92d7b24b3be3641a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.890877  1130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f2713fe1c7148f0b6d9a69c53ec3515. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.912576  1127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c9d72f2a6ae046cb9d4e6277d13e34e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.916447  1266 tablet_bootstrap.cc:492] T 284ea666431c4339998eb885cd31facb P aa098a557d34433896712068efd0d9a8: No bootstrap required, opened a new log
I20260709 12:26:40.917012  1266 ts_tablet_manager.cc:1403] T 284ea666431c4339998eb885cd31facb P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.211s	user 0.013s	sys 0.013s
I20260709 12:26:40.920149  1266 raft_consensus.cc:359] T 284ea666431c4339998eb885cd31facb P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:40.920934  1266 raft_consensus.cc:385] T 284ea666431c4339998eb885cd31facb P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:40.921247  1266 raft_consensus.cc:740] T 284ea666431c4339998eb885cd31facb P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:40.928324  1135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5af913e96004f3b8cac5fbe6ac655ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.929970  1266 consensus_queue.cc:260] T 284ea666431c4339998eb885cd31facb P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:40.932299  1133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 284ea666431c4339998eb885cd31facb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.945801  1203 tablet_service.cc:1511] Processing CreateTablet for tablet 5302c354091f4926812eb90f518b9d6a (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:26:40.946655   986 tablet_service.cc:1511] Processing CreateTablet for tablet 5302c354091f4926812eb90f518b9d6a (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:26:40.953058   986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5302c354091f4926812eb90f518b9d6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.959987  1129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 580f367489064e218eef65b4654744b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.962385  1054 tablet_service.cc:1511] Processing CreateTablet for tablet c77af7e1c2044a8eacfe0e76ee974591 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:26:40.963759  1054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c77af7e1c2044a8eacfe0e76ee974591. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.972270  1265 tablet_bootstrap.cc:492] T e2ef4b262fac46fe9f9111b609547aa3 P 7f9cbe40e40d429aa004e4a7fb42f132: No bootstrap required, opened a new log
I20260709 12:26:40.948261  1205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6715731f9a31415a98fa8a0ab9944eec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.984009  1203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5302c354091f4926812eb90f518b9d6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:40.983212  1265 ts_tablet_manager.cc:1403] T e2ef4b262fac46fe9f9111b609547aa3 P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent bootstrapping tablet: real 0.253s	user 0.008s	sys 0.011s
I20260709 12:26:41.012552   985 tablet_service.cc:1511] Processing CreateTablet for tablet b364263cacab4add984e2b6c912fb62e (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:26:41.013973   985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b364263cacab4add984e2b6c912fb62e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.014725  1207 tablet_service.cc:1511] Processing CreateTablet for tablet c77af7e1c2044a8eacfe0e76ee974591 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:26:41.016109  1207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c77af7e1c2044a8eacfe0e76ee974591. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.025952  1267 tablet_bootstrap.cc:492] T e281f15348944cc1ab51fce7c1653aac P 8fa35514a8d84740b1b46ae496307f20: No bootstrap required, opened a new log
I20260709 12:26:41.026701  1267 ts_tablet_manager.cc:1403] T e281f15348944cc1ab51fce7c1653aac P 8fa35514a8d84740b1b46ae496307f20: Time spent bootstrapping tablet: real 0.166s	user 0.014s	sys 0.012s
I20260709 12:26:41.027475  1171 heartbeater.cc:499] Master 127.23.245.190:34325 was elected leader, sending a full tablet report...
I20260709 12:26:41.027946  1272 raft_consensus.cc:493] T 284ea666431c4339998eb885cd31facb P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.028484  1272 raft_consensus.cc:515] T 284ea666431c4339998eb885cd31facb P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:41.031407  1266 ts_tablet_manager.cc:1434] T 284ea666431c4339998eb885cd31facb P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.114s	user 0.010s	sys 0.004s
I20260709 12:26:41.038138  1264 raft_consensus.cc:359] T e2ef4b262fac46fe9f9111b609547aa3 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:41.038969  1264 raft_consensus.cc:385] T e2ef4b262fac46fe9f9111b609547aa3 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:41.039291  1264 raft_consensus.cc:740] T e2ef4b262fac46fe9f9111b609547aa3 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 937efeddef934b2b8bc8632594903085, State: Initialized, Role: FOLLOWER
I20260709 12:26:41.050240  1061 tablet_service.cc:1511] Processing CreateTablet for tablet b364263cacab4add984e2b6c912fb62e (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:26:41.056501  1265 raft_consensus.cc:359] T e2ef4b262fac46fe9f9111b609547aa3 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:41.056309  1264 consensus_queue.cc:260] T e2ef4b262fac46fe9f9111b609547aa3 P 937efeddef934b2b8bc8632594903085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:41.059558  1266 tablet_bootstrap.cc:492] T e12f4bd1b2ed49988317684782c8616b P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:41.035638  1127 tablet_service.cc:1511] Processing CreateTablet for tablet 3e22afc1ef634aaabf17a4e5a3bf0be3 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:26:41.073662  1265 raft_consensus.cc:385] T e2ef4b262fac46fe9f9111b609547aa3 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:41.077859  1265 raft_consensus.cc:740] T e2ef4b262fac46fe9f9111b609547aa3 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Initialized, Role: FOLLOWER
I20260709 12:26:41.080300  1127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e22afc1ef634aaabf17a4e5a3bf0be3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.082397  1128 tablet_service.cc:1511] Processing CreateTablet for tablet 9a7d578ba2eb41f7a38f15c5dd34b8cb (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:26:41.089371  1131 tablet_service.cc:1511] Processing CreateTablet for tablet acc6ab0dce1640e380b433b32a874108 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:26:41.083760  1128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a7d578ba2eb41f7a38f15c5dd34b8cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.068852  1272 leader_election.cc:290] T 284ea666431c4339998eb885cd31facb P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679), 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341)
I20260709 12:26:41.055611  1134 tablet_service.cc:1511] Processing CreateTablet for tablet b8e49440650449f49e5303568f2f19c0 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:26:41.100948  1134 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8e49440650449f49e5303568f2f19c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.106984  1266 tablet_bootstrap.cc:654] T e12f4bd1b2ed49988317684782c8616b P aa098a557d34433896712068efd0d9a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:41.114584  1265 consensus_queue.cc:260] T e2ef4b262fac46fe9f9111b609547aa3 P 7f9cbe40e40d429aa004e4a7fb42f132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:41.118211  1131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acc6ab0dce1640e380b433b32a874108. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.127331  1245 heartbeater.cc:499] Master 127.23.245.190:34325 was elected leader, sending a full tablet report...
I20260709 12:26:41.130087   984 tablet_service.cc:1511] Processing CreateTablet for tablet 98b5b180139845c99c537cd675a60830 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:26:41.131438   984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98b5b180139845c99c537cd675a60830. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:41.148809   963 leader_election.cc:343] T 284ea666431c4339998eb885cd31facb P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341): Not found: Tablet not found: 284ea666431c4339998eb885cd31facb
I20260709 12:26:41.149047  1209 tablet_service.cc:1511] Processing CreateTablet for tablet 98b5b180139845c99c537cd675a60830 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:26:41.150417  1209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98b5b180139845c99c537cd675a60830. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.111331  1267 raft_consensus.cc:359] T e281f15348944cc1ab51fce7c1653aac P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:41.152125  1061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b364263cacab4add984e2b6c912fb62e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.157423  1267 raft_consensus.cc:385] T e281f15348944cc1ab51fce7c1653aac P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:41.159142  1267 raft_consensus.cc:740] T e281f15348944cc1ab51fce7c1653aac P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Initialized, Role: FOLLOWER
I20260709 12:26:41.164732  1267 consensus_queue.cc:260] T e281f15348944cc1ab51fce7c1653aac P 8fa35514a8d84740b1b46ae496307f20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:41.169744  1133 tablet_service.cc:1511] Processing CreateTablet for tablet c77af7e1c2044a8eacfe0e76ee974591 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:26:41.170142  1054 tablet_service.cc:1511] Processing CreateTablet for tablet 98b5b180139845c99c537cd675a60830 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:26:41.171463  1054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98b5b180139845c99c537cd675a60830. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.171521  1133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c77af7e1c2044a8eacfe0e76ee974591. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.175441  1132 tablet_service.cc:1511] Processing CreateTablet for tablet 333930b9df5744d59ab498b170a35315 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:26:41.174012  1136 tablet_service.cc:1511] Processing CreateTablet for tablet b364263cacab4add984e2b6c912fb62e (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:26:41.123999  1130 tablet_service.cc:1511] Processing CreateTablet for tablet 6715731f9a31415a98fa8a0ab9944eec (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:26:41.182042  1265 ts_tablet_manager.cc:1434] T e2ef4b262fac46fe9f9111b609547aa3 P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent starting tablet: real 0.188s	user 0.020s	sys 0.006s
I20260709 12:26:41.191306  1278 raft_consensus.cc:493] T e281f15348944cc1ab51fce7c1653aac P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.192039  1276 raft_consensus.cc:493] T e2ef4b262fac46fe9f9111b609547aa3 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.191953  1278 raft_consensus.cc:515] T e281f15348944cc1ab51fce7c1653aac P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:41.195423  1276 raft_consensus.cc:515] T e2ef4b262fac46fe9f9111b609547aa3 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:41.198047  1072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284ea666431c4339998eb885cd31facb" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:41.198604  1276 leader_election.cc:290] T e2ef4b262fac46fe9f9111b609547aa3 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:41.202322  1136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b364263cacab4add984e2b6c912fb62e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:41.208693   961 leader_election.cc:343] T 284ea666431c4339998eb885cd31facb P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:41.210599  1278 leader_election.cc:290] T e281f15348944cc1ab51fce7c1653aac P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:41.211037   961 leader_election.cc:304] T 284ea666431c4339998eb885cd31facb P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa098a557d34433896712068efd0d9a8; no voters: 7f9cbe40e40d429aa004e4a7fb42f132, 8fa35514a8d84740b1b46ae496307f20
I20260709 12:26:41.217895  1265 tablet_bootstrap.cc:492] T e281f15348944cc1ab51fce7c1653aac P 7f9cbe40e40d429aa004e4a7fb42f132: Bootstrap starting.
I20260709 12:26:41.219009  1272 raft_consensus.cc:2749] T 284ea666431c4339998eb885cd31facb P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:41.209044  1129 tablet_service.cc:1511] Processing CreateTablet for tablet edea2a0a3c264f2b810295aea0acfb73 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:26:41.219426  1130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6715731f9a31415a98fa8a0ab9944eec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.229605  1128 tablet_service.cc:1511] Processing CreateTablet for tablet 343e626d0073462fa2020fcf2e2f8ffb (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:26:41.226939  1127 tablet_service.cc:1511] Processing CreateTablet for tablet 5302c354091f4926812eb90f518b9d6a (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:26:41.237780  1127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5302c354091f4926812eb90f518b9d6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.240532  1264 ts_tablet_manager.cc:1434] T e2ef4b262fac46fe9f9111b609547aa3 P 937efeddef934b2b8bc8632594903085: Time spent starting tablet: real 0.353s	user 0.008s	sys 0.019s
I20260709 12:26:41.241647  1264 tablet_bootstrap.cc:492] T 5b3d71845177478a9e2510c82e0cf9d1 P 937efeddef934b2b8bc8632594903085: Bootstrap starting.
I20260709 12:26:41.253363  1267 ts_tablet_manager.cc:1434] T e281f15348944cc1ab51fce7c1653aac P 8fa35514a8d84740b1b46ae496307f20: Time spent starting tablet: real 0.226s	user 0.008s	sys 0.011s
W20260709 12:26:41.254204  1172 tablet.cc:2406] T e281f15348944cc1ab51fce7c1653aac P 8fa35514a8d84740b1b46ae496307f20: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:26:41.257192  1203 tablet_service.cc:1511] Processing CreateTablet for tablet 343e626d0073462fa2020fcf2e2f8ffb (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:26:41.260105  1129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edea2a0a3c264f2b810295aea0acfb73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.262873  1132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 333930b9df5744d59ab498b170a35315. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.268251  1277 raft_consensus.cc:493] T e2ef4b262fac46fe9f9111b609547aa3 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.268833  1277 raft_consensus.cc:515] T e2ef4b262fac46fe9f9111b609547aa3 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:41.269512  1267 tablet_bootstrap.cc:492] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P 8fa35514a8d84740b1b46ae496307f20: Bootstrap starting.
I20260709 12:26:41.270439   986 tablet_service.cc:1511] Processing CreateTablet for tablet 343e626d0073462fa2020fcf2e2f8ffb (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:26:41.271559  1277 leader_election.cc:290] T e2ef4b262fac46fe9f9111b609547aa3 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:41.271854   986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 343e626d0073462fa2020fcf2e2f8ffb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.272262  1128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 343e626d0073462fa2020fcf2e2f8ffb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.281488  1203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 343e626d0073462fa2020fcf2e2f8ffb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.283039  1266 tablet_bootstrap.cc:492] T e12f4bd1b2ed49988317684782c8616b P aa098a557d34433896712068efd0d9a8: No bootstrap required, opened a new log
I20260709 12:26:41.283665  1266 ts_tablet_manager.cc:1403] T e12f4bd1b2ed49988317684782c8616b P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.224s	user 0.004s	sys 0.015s
I20260709 12:26:41.287125  1266 raft_consensus.cc:359] T e12f4bd1b2ed49988317684782c8616b P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:41.288035  1266 raft_consensus.cc:385] T e12f4bd1b2ed49988317684782c8616b P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:41.288319  1266 raft_consensus.cc:740] T e12f4bd1b2ed49988317684782c8616b P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:41.289633  1266 consensus_queue.cc:260] T e12f4bd1b2ed49988317684782c8616b P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:41.299851  1266 ts_tablet_manager.cc:1434] T e12f4bd1b2ed49988317684782c8616b P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 12:26:41.328394  1265 tablet_bootstrap.cc:654] T e281f15348944cc1ab51fce7c1653aac P 7f9cbe40e40d429aa004e4a7fb42f132: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:41.329865  1267 tablet_bootstrap.cc:654] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P 8fa35514a8d84740b1b46ae496307f20: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:41.321390  1266 tablet_bootstrap.cc:492] T e2ef4b262fac46fe9f9111b609547aa3 P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:41.337355  1135 tablet_service.cc:1511] Processing CreateTablet for tablet e6de424e08ed4b1d8f6d32d17a44025d (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:26:41.338706  1135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6de424e08ed4b1d8f6d32d17a44025d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.350513  1072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ef4b262fac46fe9f9111b609547aa3" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:41.351257  1072 raft_consensus.cc:2468] T e2ef4b262fac46fe9f9111b609547aa3 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 0.
I20260709 12:26:41.352732  1184 leader_election.cc:304] T e2ef4b262fac46fe9f9111b609547aa3 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 937efeddef934b2b8bc8632594903085; no voters: 
I20260709 12:26:41.353618  1276 raft_consensus.cc:2804] T e2ef4b262fac46fe9f9111b609547aa3 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:41.353993  1276 raft_consensus.cc:493] T e2ef4b262fac46fe9f9111b609547aa3 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:41.354315  1276 raft_consensus.cc:3060] T e2ef4b262fac46fe9f9111b609547aa3 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:41.360949  1264 tablet_bootstrap.cc:654] T 5b3d71845177478a9e2510c82e0cf9d1 P 937efeddef934b2b8bc8632594903085: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:41.384088  1056 tablet_service.cc:1511] Processing CreateTablet for tablet e6de424e08ed4b1d8f6d32d17a44025d (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:26:41.387001  1056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6de424e08ed4b1d8f6d32d17a44025d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.391839  1265 tablet_bootstrap.cc:492] T e281f15348944cc1ab51fce7c1653aac P 7f9cbe40e40d429aa004e4a7fb42f132: No bootstrap required, opened a new log
I20260709 12:26:41.392434  1265 ts_tablet_manager.cc:1403] T e281f15348944cc1ab51fce7c1653aac P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent bootstrapping tablet: real 0.189s	user 0.013s	sys 0.006s
I20260709 12:26:41.398789  1265 raft_consensus.cc:359] T e281f15348944cc1ab51fce7c1653aac P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:41.399545  1265 raft_consensus.cc:385] T e281f15348944cc1ab51fce7c1653aac P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:41.399267  1276 raft_consensus.cc:515] T e2ef4b262fac46fe9f9111b609547aa3 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:41.399866  1265 raft_consensus.cc:740] T e281f15348944cc1ab51fce7c1653aac P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Initialized, Role: FOLLOWER
I20260709 12:26:41.401552  1276 leader_election.cc:290] T e2ef4b262fac46fe9f9111b609547aa3 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Requested vote from peers 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:41.401712  1265 consensus_queue.cc:260] T e281f15348944cc1ab51fce7c1653aac P 7f9cbe40e40d429aa004e4a7fb42f132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:41.402652  1072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ef4b262fac46fe9f9111b609547aa3" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
I20260709 12:26:41.404508  1072 raft_consensus.cc:3060] T e2ef4b262fac46fe9f9111b609547aa3 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:41.405447  1265 ts_tablet_manager.cc:1434] T e281f15348944cc1ab51fce7c1653aac P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent starting tablet: real 0.013s	user 0.000s	sys 0.007s
I20260709 12:26:41.406463  1265 tablet_bootstrap.cc:492] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 7f9cbe40e40d429aa004e4a7fb42f132: Bootstrap starting.
I20260709 12:26:41.416780  1071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e281f15348944cc1ab51fce7c1653aac" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:41.417537  1071 raft_consensus.cc:2468] T e281f15348944cc1ab51fce7c1653aac P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 0.
I20260709 12:26:41.418848  1110 leader_election.cc:304] T e281f15348944cc1ab51fce7c1653aac P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 8fa35514a8d84740b1b46ae496307f20; no voters: 
I20260709 12:26:41.419811  1278 raft_consensus.cc:2804] T e281f15348944cc1ab51fce7c1653aac P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:41.420199  1278 raft_consensus.cc:493] T e281f15348944cc1ab51fce7c1653aac P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:41.420535  1278 raft_consensus.cc:3060] T e281f15348944cc1ab51fce7c1653aac P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:41.424348  1266 tablet_bootstrap.cc:654] T e2ef4b262fac46fe9f9111b609547aa3 P aa098a557d34433896712068efd0d9a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:41.425837  1265 tablet_bootstrap.cc:654] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 7f9cbe40e40d429aa004e4a7fb42f132: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:41.431717  1278 raft_consensus.cc:515] T e281f15348944cc1ab51fce7c1653aac P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:41.454689   997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ef4b262fac46fe9f9111b609547aa3" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
I20260709 12:26:41.455576  1209 tablet_service.cc:1511] Processing CreateTablet for tablet e6de424e08ed4b1d8f6d32d17a44025d (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
W20260709 12:26:41.456549  1038 leader_election.cc:343] T e2ef4b262fac46fe9f9111b609547aa3 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:41.457029  1209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6de424e08ed4b1d8f6d32d17a44025d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.459111  1071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e281f15348944cc1ab51fce7c1653aac" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
I20260709 12:26:41.460016  1071 raft_consensus.cc:3060] T e281f15348944cc1ab51fce7c1653aac P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:41.461613  1278 leader_election.cc:290] T e281f15348944cc1ab51fce7c1653aac P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 election: Requested vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:41.462548   986 tablet_service.cc:1511] Processing CreateTablet for tablet 74e3cbe3521a46cfb42a6cb7ba98430c (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:26:41.464485   986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74e3cbe3521a46cfb42a6cb7ba98430c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.469542  1054 tablet_service.cc:1511] Processing CreateTablet for tablet 74e3cbe3521a46cfb42a6cb7ba98430c (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:26:41.474823  1267 tablet_bootstrap.cc:492] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P 8fa35514a8d84740b1b46ae496307f20: No bootstrap required, opened a new log
I20260709 12:26:41.476018  1207 tablet_service.cc:1511] Processing CreateTablet for tablet a93df19c4206495e971bc5e95a2111bc (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:26:41.476014  1133 tablet_service.cc:1511] Processing CreateTablet for tablet 74e3cbe3521a46cfb42a6cb7ba98430c (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:26:41.476711  1267 ts_tablet_manager.cc:1403] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P 8fa35514a8d84740b1b46ae496307f20: Time spent bootstrapping tablet: real 0.207s	user 0.014s	sys 0.006s
I20260709 12:26:41.477701  1207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a93df19c4206495e971bc5e95a2111bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.477715  1133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74e3cbe3521a46cfb42a6cb7ba98430c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.480051  1054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74e3cbe3521a46cfb42a6cb7ba98430c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.480508  1267 raft_consensus.cc:359] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:41.481382  1267 raft_consensus.cc:385] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:41.481699  1267 raft_consensus.cc:740] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Initialized, Role: FOLLOWER
I20260709 12:26:41.482542  1267 consensus_queue.cc:260] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P 8fa35514a8d84740b1b46ae496307f20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:41.484920  1267 ts_tablet_manager.cc:1434] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P 8fa35514a8d84740b1b46ae496307f20: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.007s
I20260709 12:26:41.485980  1267 tablet_bootstrap.cc:492] T 1b6df135b8494d0d916747b8994b5cf9 P 8fa35514a8d84740b1b46ae496307f20: Bootstrap starting.
I20260709 12:26:41.487634   984 tablet_service.cc:1511] Processing CreateTablet for tablet a93df19c4206495e971bc5e95a2111bc (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:26:41.489228   984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a93df19c4206495e971bc5e95a2111bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.501652  1061 tablet_service.cc:1511] Processing CreateTablet for tablet a93df19c4206495e971bc5e95a2111bc (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:26:41.503062  1061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a93df19c4206495e971bc5e95a2111bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.507133  1132 tablet_service.cc:1511] Processing CreateTablet for tablet 1d925407b8314f5b95a8c940f195433a (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:26:41.508563  1132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d925407b8314f5b95a8c940f195433a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.508527  1203 tablet_service.cc:1511] Processing CreateTablet for tablet 1d925407b8314f5b95a8c940f195433a (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:26:41.509887  1203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d925407b8314f5b95a8c940f195433a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.511229  1267 tablet_bootstrap.cc:654] T 1b6df135b8494d0d916747b8994b5cf9 P 8fa35514a8d84740b1b46ae496307f20: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:41.516327  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ef4b262fac46fe9f9111b609547aa3" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:41.517346  1220 raft_consensus.cc:2393] T e2ef4b262fac46fe9f9111b609547aa3 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7f9cbe40e40d429aa004e4a7fb42f132 in current term 1: Already voted for candidate 937efeddef934b2b8bc8632594903085 in this term.
I20260709 12:26:41.518738  1035 leader_election.cc:304] T e2ef4b262fac46fe9f9111b609547aa3 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132; no voters: 937efeddef934b2b8bc8632594903085, aa098a557d34433896712068efd0d9a8
I20260709 12:26:41.487810  1072 raft_consensus.cc:2468] T e2ef4b262fac46fe9f9111b609547aa3 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 1.
I20260709 12:26:41.519939  1277 raft_consensus.cc:2749] T e2ef4b262fac46fe9f9111b609547aa3 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:41.520455  1184 leader_election.cc:304] T e2ef4b262fac46fe9f9111b609547aa3 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 937efeddef934b2b8bc8632594903085; no voters: 
I20260709 12:26:41.521277  1276 raft_consensus.cc:2804] T e2ef4b262fac46fe9f9111b609547aa3 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:41.524289   996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e281f15348944cc1ab51fce7c1653aac" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8"
I20260709 12:26:41.524320   997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e281f15348944cc1ab51fce7c1653aac" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
W20260709 12:26:41.527045  1112 leader_election.cc:343] T e281f15348944cc1ab51fce7c1653aac P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:41.527747  1112 leader_election.cc:343] T e281f15348944cc1ab51fce7c1653aac P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:41.530103  1071 raft_consensus.cc:2468] T e281f15348944cc1ab51fce7c1653aac P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 1.
I20260709 12:26:41.530875   985 tablet_service.cc:1511] Processing CreateTablet for tablet 1d925407b8314f5b95a8c940f195433a (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:26:41.532240   985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d925407b8314f5b95a8c940f195433a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.532449  1059 tablet_service.cc:1511] Processing CreateTablet for tablet dc91bacc3de44d21bc62d8b9a003fdcf (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:26:41.533249   997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ef4b262fac46fe9f9111b609547aa3" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
I20260709 12:26:41.533762  1059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc91bacc3de44d21bc62d8b9a003fdcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.534409   996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ef4b262fac46fe9f9111b609547aa3" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8"
I20260709 12:26:41.536214  1110 leader_election.cc:304] T e281f15348944cc1ab51fce7c1653aac P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 8fa35514a8d84740b1b46ae496307f20; no voters: aa098a557d34433896712068efd0d9a8
W20260709 12:26:41.537503  1186 leader_election.cc:343] T e2ef4b262fac46fe9f9111b609547aa3 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:41.538451  1186 leader_election.cc:343] T e2ef4b262fac46fe9f9111b609547aa3 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:41.539417  1278 raft_consensus.cc:2804] T e281f15348944cc1ab51fce7c1653aac P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:41.539988  1278 raft_consensus.cc:697] T e281f15348944cc1ab51fce7c1653aac P 8fa35514a8d84740b1b46ae496307f20 [term 1 LEADER]: Becoming Leader. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Running, Role: LEADER
I20260709 12:26:41.540808  1278 consensus_queue.cc:237] T e281f15348944cc1ab51fce7c1653aac P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:41.551723  1136 tablet_service.cc:1511] Processing CreateTablet for tablet dc91bacc3de44d21bc62d8b9a003fdcf (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:26:41.552790  1205 tablet_service.cc:1511] Processing CreateTablet for tablet dc91bacc3de44d21bc62d8b9a003fdcf (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:26:41.553274  1136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc91bacc3de44d21bc62d8b9a003fdcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.554118  1205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc91bacc3de44d21bc62d8b9a003fdcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.572758  1265 tablet_bootstrap.cc:492] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 7f9cbe40e40d429aa004e4a7fb42f132: No bootstrap required, opened a new log
I20260709 12:26:41.575564  1265 ts_tablet_manager.cc:1403] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent bootstrapping tablet: real 0.169s	user 0.015s	sys 0.009s
I20260709 12:26:41.578760  1265 raft_consensus.cc:359] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:41.579506  1265 raft_consensus.cc:385] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:41.572758  1264 tablet_bootstrap.cc:492] T 5b3d71845177478a9e2510c82e0cf9d1 P 937efeddef934b2b8bc8632594903085: No bootstrap required, opened a new log
I20260709 12:26:41.580416  1264 ts_tablet_manager.cc:1403] T 5b3d71845177478a9e2510c82e0cf9d1 P 937efeddef934b2b8bc8632594903085: Time spent bootstrapping tablet: real 0.339s	user 0.022s	sys 0.009s
I20260709 12:26:41.583082  1276 raft_consensus.cc:697] T e2ef4b262fac46fe9f9111b609547aa3 P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Becoming Leader. State: Replica: 937efeddef934b2b8bc8632594903085, State: Running, Role: LEADER
I20260709 12:26:41.587239  1264 raft_consensus.cc:359] T 5b3d71845177478a9e2510c82e0cf9d1 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
W20260709 12:26:41.597162   943 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:41.597930  1059 tablet_service.cc:1511] Processing CreateTablet for tablet 95743acb416b403b9bfb59afe5bf2fe7 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:26:41.599385  1059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95743acb416b403b9bfb59afe5bf2fe7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.600901   895 catalog_manager.cc:5697] T e281f15348944cc1ab51fce7c1653aac P 8fa35514a8d84740b1b46ae496307f20 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131). New cstate: current_term: 1 leader_uuid: "8fa35514a8d84740b1b46ae496307f20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:41.579888  1265 raft_consensus.cc:740] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Initialized, Role: FOLLOWER
I20260709 12:26:41.607306   986 tablet_service.cc:1511] Processing CreateTablet for tablet 95743acb416b403b9bfb59afe5bf2fe7 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:26:41.608073  1203 tablet_service.cc:1511] Processing CreateTablet for tablet 329e639d23154fb6bd4ccdf095dbd0e0 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:26:41.608426  1133 tablet_service.cc:1511] Processing CreateTablet for tablet 95743acb416b403b9bfb59afe5bf2fe7 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:26:41.608901   986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95743acb416b403b9bfb59afe5bf2fe7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.609434  1203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 329e639d23154fb6bd4ccdf095dbd0e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.609863  1133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 95743acb416b403b9bfb59afe5bf2fe7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.610344  1267 tablet_bootstrap.cc:492] T 1b6df135b8494d0d916747b8994b5cf9 P 8fa35514a8d84740b1b46ae496307f20: No bootstrap required, opened a new log
I20260709 12:26:41.610839  1267 ts_tablet_manager.cc:1403] T 1b6df135b8494d0d916747b8994b5cf9 P 8fa35514a8d84740b1b46ae496307f20: Time spent bootstrapping tablet: real 0.125s	user 0.014s	sys 0.003s
I20260709 12:26:41.612856  1266 tablet_bootstrap.cc:492] T e2ef4b262fac46fe9f9111b609547aa3 P aa098a557d34433896712068efd0d9a8: No bootstrap required, opened a new log
I20260709 12:26:41.613440  1266 ts_tablet_manager.cc:1403] T e2ef4b262fac46fe9f9111b609547aa3 P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.301s	user 0.019s	sys 0.014s
I20260709 12:26:41.593325  1264 raft_consensus.cc:385] T 5b3d71845177478a9e2510c82e0cf9d1 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:41.618130  1061 tablet_service.cc:1511] Processing CreateTablet for tablet 329e639d23154fb6bd4ccdf095dbd0e0 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:26:41.616422  1264 raft_consensus.cc:740] T 5b3d71845177478a9e2510c82e0cf9d1 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 937efeddef934b2b8bc8632594903085, State: Initialized, Role: FOLLOWER
I20260709 12:26:41.620976  1265 consensus_queue.cc:260] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 7f9cbe40e40d429aa004e4a7fb42f132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:41.628273   985 tablet_service.cc:1511] Processing CreateTablet for tablet 329e639d23154fb6bd4ccdf095dbd0e0 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:26:41.629689   985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 329e639d23154fb6bd4ccdf095dbd0e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.587524  1276 consensus_queue.cc:237] T e2ef4b262fac46fe9f9111b609547aa3 P 937efeddef934b2b8bc8632594903085 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:41.627424  1264 consensus_queue.cc:260] T 5b3d71845177478a9e2510c82e0cf9d1 P 937efeddef934b2b8bc8632594903085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:41.640894  1054 tablet_service.cc:1511] Processing CreateTablet for tablet 7b2e497f1fcf4e40b4374fd2b5b261af (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:26:41.637481  1209 tablet_service.cc:1511] Processing CreateTablet for tablet a1c303d40c6a4cae88aa89d681ae7b76 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:26:41.643563  1209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1c303d40c6a4cae88aa89d681ae7b76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.645287  1207 tablet_service.cc:1511] Processing CreateTablet for tablet 7b2e497f1fcf4e40b4374fd2b5b261af (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:26:41.643260  1132 tablet_service.cc:1511] Processing CreateTablet for tablet a1c303d40c6a4cae88aa89d681ae7b76 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:26:41.644063  1272 raft_consensus.cc:493] T e12f4bd1b2ed49988317684782c8616b P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.643823  1127 tablet_service.cc:1511] Processing CreateTablet for tablet 7b2e497f1fcf4e40b4374fd2b5b261af (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:26:41.644790   986 tablet_service.cc:1511] Processing CreateTablet for tablet a1c303d40c6a4cae88aa89d681ae7b76 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:26:41.650118  1054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b2e497f1fcf4e40b4374fd2b5b261af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.652510   986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1c303d40c6a4cae88aa89d681ae7b76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.652670  1207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b2e497f1fcf4e40b4374fd2b5b261af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.652505  1132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1c303d40c6a4cae88aa89d681ae7b76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.648010  1272 raft_consensus.cc:515] T e12f4bd1b2ed49988317684782c8616b P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:41.653371  1056 tablet_service.cc:1511] Processing CreateTablet for tablet 0017925ea1bb4374b09c9e692a17f87e (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:26:41.662251  1272 leader_election.cc:290] T e12f4bd1b2ed49988317684782c8616b P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:41.664533  1071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e12f4bd1b2ed49988317684782c8616b" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
W20260709 12:26:41.666078   961 leader_election.cc:343] T e12f4bd1b2ed49988317684782c8616b P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:41.672329  1127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b2e497f1fcf4e40b4374fd2b5b261af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.676138  1061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 329e639d23154fb6bd4ccdf095dbd0e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.676849  1265 ts_tablet_manager.cc:1434] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent starting tablet: real 0.101s	user 0.007s	sys 0.001s
I20260709 12:26:41.678220  1264 ts_tablet_manager.cc:1434] T 5b3d71845177478a9e2510c82e0cf9d1 P 937efeddef934b2b8bc8632594903085: Time spent starting tablet: real 0.076s	user 0.007s	sys 0.002s
I20260709 12:26:41.682318  1056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0017925ea1bb4374b09c9e692a17f87e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.677695   984 tablet_service.cc:1511] Processing CreateTablet for tablet 0017925ea1bb4374b09c9e692a17f87e (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:26:41.688223  1133 tablet_service.cc:1511] Processing CreateTablet for tablet 0017925ea1bb4374b09c9e692a17f87e (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:26:41.689393   984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0017925ea1bb4374b09c9e692a17f87e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.689692  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e12f4bd1b2ed49988317684782c8616b" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:41.689414  1133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0017925ea1bb4374b09c9e692a17f87e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:41.691334   960 leader_election.cc:343] T e12f4bd1b2ed49988317684782c8616b P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:41.691792   960 leader_election.cc:304] T e12f4bd1b2ed49988317684782c8616b P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa098a557d34433896712068efd0d9a8; no voters: 7f9cbe40e40d429aa004e4a7fb42f132, 937efeddef934b2b8bc8632594903085
I20260709 12:26:41.692983  1272 raft_consensus.cc:2749] T e12f4bd1b2ed49988317684782c8616b P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:41.680371  1266 raft_consensus.cc:359] T e2ef4b262fac46fe9f9111b609547aa3 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:41.710919   986 tablet_service.cc:1511] Processing CreateTablet for tablet c5197f4025d94ce096c14c6ca011b47b (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:26:41.711876   986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5197f4025d94ce096c14c6ca011b47b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.721906  1055 tablet_service.cc:1511] Processing CreateTablet for tablet c5197f4025d94ce096c14c6ca011b47b (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:26:41.722770  1265 tablet_bootstrap.cc:492] T 8c7002e5875a494e8e845023cc05503f P 7f9cbe40e40d429aa004e4a7fb42f132: Bootstrap starting.
I20260709 12:26:41.723318  1055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5197f4025d94ce096c14c6ca011b47b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.710683  1266 raft_consensus.cc:385] T e2ef4b262fac46fe9f9111b609547aa3 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:41.724874  1267 raft_consensus.cc:359] T 1b6df135b8494d0d916747b8994b5cf9 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:41.728102  1267 raft_consensus.cc:385] T 1b6df135b8494d0d916747b8994b5cf9 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:41.728461  1267 raft_consensus.cc:740] T 1b6df135b8494d0d916747b8994b5cf9 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Initialized, Role: FOLLOWER
I20260709 12:26:41.729333  1267 consensus_queue.cc:260] T 1b6df135b8494d0d916747b8994b5cf9 P 8fa35514a8d84740b1b46ae496307f20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:41.729138   894 catalog_manager.cc:5697] T e2ef4b262fac46fe9f9111b609547aa3 P 937efeddef934b2b8bc8632594903085 reported cstate change: term changed from 0 to 1, leader changed from <none> to 937efeddef934b2b8bc8632594903085 (127.23.245.132). New cstate: current_term: 1 leader_uuid: "937efeddef934b2b8bc8632594903085" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:41.731894  1267 ts_tablet_manager.cc:1434] T 1b6df135b8494d0d916747b8994b5cf9 P 8fa35514a8d84740b1b46ae496307f20: Time spent starting tablet: real 0.121s	user 0.009s	sys 0.001s
I20260709 12:26:41.732393  1203 tablet_service.cc:1511] Processing CreateTablet for tablet c5197f4025d94ce096c14c6ca011b47b (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:26:41.732944  1267 tablet_bootstrap.cc:492] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 8fa35514a8d84740b1b46ae496307f20: Bootstrap starting.
I20260709 12:26:41.733690  1203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5197f4025d94ce096c14c6ca011b47b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.736093  1264 tablet_bootstrap.cc:492] T e12f4bd1b2ed49988317684782c8616b P 937efeddef934b2b8bc8632594903085: Bootstrap starting.
I20260709 12:26:41.727857  1266 raft_consensus.cc:740] T e2ef4b262fac46fe9f9111b609547aa3 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:41.741896  1266 consensus_queue.cc:260] T e2ef4b262fac46fe9f9111b609547aa3 P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:41.743076  1135 tablet_service.cc:1511] Processing CreateTablet for tablet 4d899bdd8a44422ca2a8036f84e9f9f3 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:26:41.744417  1135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d899bdd8a44422ca2a8036f84e9f9f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.747352  1205 tablet_service.cc:1511] Processing CreateTablet for tablet 4d899bdd8a44422ca2a8036f84e9f9f3 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:26:41.748153  1266 ts_tablet_manager.cc:1434] T e2ef4b262fac46fe9f9111b609547aa3 P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.134s	user 0.010s	sys 0.000s
I20260709 12:26:41.748701  1205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d899bdd8a44422ca2a8036f84e9f9f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.749254  1266 tablet_bootstrap.cc:492] T 5b3d71845177478a9e2510c82e0cf9d1 P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:41.763267  1267 tablet_bootstrap.cc:654] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 8fa35514a8d84740b1b46ae496307f20: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:41.764071  1057 tablet_service.cc:1511] Processing CreateTablet for tablet 6474754cce8f4042bcab4ac631e9a82f (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:26:41.765395  1057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6474754cce8f4042bcab4ac631e9a82f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.765990  1128 tablet_service.cc:1511] Processing CreateTablet for tablet 6474754cce8f4042bcab4ac631e9a82f (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:26:41.767248  1128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6474754cce8f4042bcab4ac631e9a82f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.768952  1201 tablet_service.cc:1511] Processing CreateTablet for tablet 6474754cce8f4042bcab4ac631e9a82f (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:26:41.769390  1062 tablet_service.cc:1511] Processing CreateTablet for tablet 3d2ccd742ac442419de89cb38ee12d37 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:26:41.770673  1062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d2ccd742ac442419de89cb38ee12d37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.770740  1201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6474754cce8f4042bcab4ac631e9a82f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.775233   978 tablet_service.cc:1511] Processing CreateTablet for tablet 3d2ccd742ac442419de89cb38ee12d37 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:26:41.776609   978 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d2ccd742ac442419de89cb38ee12d37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.784149   986 tablet_service.cc:1511] Processing CreateTablet for tablet 4d899bdd8a44422ca2a8036f84e9f9f3 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:26:41.791126   986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d899bdd8a44422ca2a8036f84e9f9f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.799724  1278 raft_consensus.cc:493] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.800061  1266 tablet_bootstrap.cc:654] T 5b3d71845177478a9e2510c82e0cf9d1 P aa098a557d34433896712068efd0d9a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:41.800580  1278 raft_consensus.cc:515] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:41.811955  1278 leader_election.cc:290] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:41.818017   996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ae9b52b5bd4abf9b47e9e7f86a9519" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
I20260709 12:26:41.819802  1059 tablet_service.cc:1511] Processing CreateTablet for tablet c36d0201599a49169424a6b75f5349f2 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:26:41.821651  1264 tablet_bootstrap.cc:654] T e12f4bd1b2ed49988317684782c8616b P 937efeddef934b2b8bc8632594903085: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:41.822451  1272 raft_consensus.cc:493] T e2ef4b262fac46fe9f9111b609547aa3 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.822996  1272 raft_consensus.cc:515] T e2ef4b262fac46fe9f9111b609547aa3 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:41.825205  1272 leader_election.cc:290] T e2ef4b262fac46fe9f9111b609547aa3 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
W20260709 12:26:41.832782  1112 leader_election.cc:343] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:41.821048  1207 tablet_service.cc:1511] Processing CreateTablet for tablet c36d0201599a49169424a6b75f5349f2 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:26:41.835934  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ef4b262fac46fe9f9111b609547aa3" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:41.836894  1207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c36d0201599a49169424a6b75f5349f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.835698   979 tablet_service.cc:1511] Processing CreateTablet for tablet c36d0201599a49169424a6b75f5349f2 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:26:41.837913   979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c36d0201599a49169424a6b75f5349f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.842090  1209 tablet_service.cc:1511] Processing CreateTablet for tablet 040ea9f986ee4ed29b941698c802c501 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:26:41.843446  1209 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 040ea9f986ee4ed29b941698c802c501. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.794248  1265 tablet_bootstrap.cc:654] T 8c7002e5875a494e8e845023cc05503f P 7f9cbe40e40d429aa004e4a7fb42f132: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:41.853341  1071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ef4b262fac46fe9f9111b609547aa3" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:41.854233  1071 raft_consensus.cc:2393] T e2ef4b262fac46fe9f9111b609547aa3 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aa098a557d34433896712068efd0d9a8 in current term 1: Already voted for candidate 937efeddef934b2b8bc8632594903085 in this term.
I20260709 12:26:41.846169  1054 tablet_service.cc:1511] Processing CreateTablet for tablet f84cb753a9bd4fdd91824bb2d5050621 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:26:41.855501   961 leader_election.cc:304] T e2ef4b262fac46fe9f9111b609547aa3 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa098a557d34433896712068efd0d9a8; no voters: 7f9cbe40e40d429aa004e4a7fb42f132, 937efeddef934b2b8bc8632594903085
I20260709 12:26:41.856623  1272 raft_consensus.cc:3060] T e2ef4b262fac46fe9f9111b609547aa3 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:41.871942  1277 raft_consensus.cc:493] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.872372  1059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c36d0201599a49169424a6b75f5349f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.872541  1277 raft_consensus.cc:515] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:41.873572  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ae9b52b5bd4abf9b47e9e7f86a9519" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:41.874975  1277 leader_election.cc:290] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341)
W20260709 12:26:41.875795  1109 leader_election.cc:343] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:41.876365  1127 tablet_service.cc:1511] Processing CreateTablet for tablet 040ea9f986ee4ed29b941698c802c501 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:26:41.876489  1109 leader_election.cc:304] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20; no voters: 937efeddef934b2b8bc8632594903085, aa098a557d34433896712068efd0d9a8
I20260709 12:26:41.877734  1127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 040ea9f986ee4ed29b941698c802c501. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.878005  1278 raft_consensus.cc:2749] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:41.871483   987 tablet_service.cc:1511] Processing CreateTablet for tablet 040ea9f986ee4ed29b941698c802c501 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:26:41.879900   987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 040ea9f986ee4ed29b941698c802c501. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.880667  1210 tablet_service.cc:1511] Processing CreateTablet for tablet f84cb753a9bd4fdd91824bb2d5050621 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:26:41.881956  1210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f84cb753a9bd4fdd91824bb2d5050621. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.885459  1054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f84cb753a9bd4fdd91824bb2d5050621. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.885634  1135 tablet_service.cc:1511] Processing CreateTablet for tablet f84cb753a9bd4fdd91824bb2d5050621 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:26:41.887137  1135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f84cb753a9bd4fdd91824bb2d5050621. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.887790   996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2713fe1c7148f0b6d9a69c53ec3515" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
I20260709 12:26:41.890432  1133 tablet_service.cc:1511] Processing CreateTablet for tablet 3d2ccd742ac442419de89cb38ee12d37 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
W20260709 12:26:41.893571  1038 leader_election.cc:343] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:41.916076  1133 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d2ccd742ac442419de89cb38ee12d37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.929416  1276 raft_consensus.cc:493] T 5b3d71845177478a9e2510c82e0cf9d1 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:41.929980  1276 raft_consensus.cc:515] T 5b3d71845177478a9e2510c82e0cf9d1 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:41.931517   986 tablet_service.cc:1511] Processing CreateTablet for tablet 0e2eae4c387445f39a059befe390fe45 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:26:41.932852   986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e2eae4c387445f39a059befe390fe45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.934770  1276 leader_election.cc:290] T 5b3d71845177478a9e2510c82e0cf9d1 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:41.935401  1056 tablet_service.cc:1511] Processing CreateTablet for tablet 0e2eae4c387445f39a059befe390fe45 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:26:41.936764  1056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e2eae4c387445f39a059befe390fe45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.935431   996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3d71845177478a9e2510c82e0cf9d1" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
W20260709 12:26:41.948055  1186 leader_election.cc:343] T 5b3d71845177478a9e2510c82e0cf9d1 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:41.936627  1071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3d71845177478a9e2510c82e0cf9d1" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
W20260709 12:26:41.949877  1184 leader_election.cc:343] T 5b3d71845177478a9e2510c82e0cf9d1 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:41.950309  1184 leader_election.cc:304] T 5b3d71845177478a9e2510c82e0cf9d1 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 937efeddef934b2b8bc8632594903085; no voters: 7f9cbe40e40d429aa004e4a7fb42f132, aa098a557d34433896712068efd0d9a8
I20260709 12:26:41.958786  1276 raft_consensus.cc:2749] T 5b3d71845177478a9e2510c82e0cf9d1 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:41.958423  1267 tablet_bootstrap.cc:492] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 8fa35514a8d84740b1b46ae496307f20: No bootstrap required, opened a new log
I20260709 12:26:41.959880  1267 ts_tablet_manager.cc:1403] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 8fa35514a8d84740b1b46ae496307f20: Time spent bootstrapping tablet: real 0.227s	user 0.015s	sys 0.008s
I20260709 12:26:41.960114  1264 tablet_bootstrap.cc:492] T e12f4bd1b2ed49988317684782c8616b P 937efeddef934b2b8bc8632594903085: No bootstrap required, opened a new log
I20260709 12:26:41.960686  1264 ts_tablet_manager.cc:1403] T e12f4bd1b2ed49988317684782c8616b P 937efeddef934b2b8bc8632594903085: Time spent bootstrapping tablet: real 0.250s	user 0.020s	sys 0.012s
I20260709 12:26:41.963563  1267 raft_consensus.cc:359] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:41.964363  1267 raft_consensus.cc:385] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:26:41.968111  1112 consensus_peers.cc:597] T e281f15348944cc1ab51fce7c1653aac P 8fa35514a8d84740b1b46ae496307f20 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:41.968281  1278 consensus_queue.cc:1048] T e281f15348944cc1ab51fce7c1653aac P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:41.976598  1272 raft_consensus.cc:2749] T e2ef4b262fac46fe9f9111b609547aa3 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:41.982117  1128 tablet_service.cc:1511] Processing CreateTablet for tablet 0e2eae4c387445f39a059befe390fe45 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:26:41.983582  1128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e2eae4c387445f39a059befe390fe45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.986727  1264 raft_consensus.cc:359] T e12f4bd1b2ed49988317684782c8616b P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:41.987562  1264 raft_consensus.cc:385] T e12f4bd1b2ed49988317684782c8616b P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:41.989871  1146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2713fe1c7148f0b6d9a69c53ec3515" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
W20260709 12:26:41.991506  1038 leader_election.cc:343] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:41.991999  1038 leader_election.cc:304] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132; no voters: 8fa35514a8d84740b1b46ae496307f20, aa098a557d34433896712068efd0d9a8
I20260709 12:26:41.993433  1277 raft_consensus.cc:2749] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:41.993732  1205 tablet_service.cc:1511] Processing CreateTablet for tablet c97b34e374ed4aec812cc43e2a5f07de (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:26:41.998355   979 tablet_service.cc:1511] Processing CreateTablet for tablet c97b34e374ed4aec812cc43e2a5f07de (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:26:41.999039  1205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c97b34e374ed4aec812cc43e2a5f07de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.998788  1132 tablet_service.cc:1511] Processing CreateTablet for tablet c97b34e374ed4aec812cc43e2a5f07de (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:26:41.999722   979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c97b34e374ed4aec812cc43e2a5f07de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.003646  1062 tablet_service.cc:1511] Processing CreateTablet for tablet ac8f3ce8c750468c966a23ea2787b888 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:26:42.005892  1062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac8f3ce8c750468c966a23ea2787b888. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.005779  1057 tablet_service.cc:1511] Processing CreateTablet for tablet 8c9afd5af68441ffa4c3f90cbd33d977 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:26:42.000137  1132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c97b34e374ed4aec812cc43e2a5f07de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.007087  1057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c9afd5af68441ffa4c3f90cbd33d977. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:41.964676  1267 raft_consensus.cc:740] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Initialized, Role: FOLLOWER
I20260709 12:26:42.005779   978 tablet_service.cc:1511] Processing CreateTablet for tablet ac8f3ce8c750468c966a23ea2787b888 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:26:42.010825  1267 consensus_queue.cc:260] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 8fa35514a8d84740b1b46ae496307f20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:41.987876  1264 raft_consensus.cc:740] T e12f4bd1b2ed49988317684782c8616b P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 937efeddef934b2b8bc8632594903085, State: Initialized, Role: FOLLOWER
I20260709 12:26:42.020408  1266 tablet_bootstrap.cc:492] T 5b3d71845177478a9e2510c82e0cf9d1 P aa098a557d34433896712068efd0d9a8: No bootstrap required, opened a new log
I20260709 12:26:42.022058  1266 ts_tablet_manager.cc:1403] T 5b3d71845177478a9e2510c82e0cf9d1 P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.273s	user 0.026s	sys 0.008s
I20260709 12:26:42.021548   978 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac8f3ce8c750468c966a23ea2787b888. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.021490  1136 tablet_service.cc:1511] Processing CreateTablet for tablet 8c9afd5af68441ffa4c3f90cbd33d977 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:26:42.027179  1136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c9afd5af68441ffa4c3f90cbd33d977. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.027874  1203 tablet_service.cc:1511] Processing CreateTablet for tablet 8c9afd5af68441ffa4c3f90cbd33d977 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:26:42.021034  1264 consensus_queue.cc:260] T e12f4bd1b2ed49988317684782c8616b P 937efeddef934b2b8bc8632594903085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:42.029289  1203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c9afd5af68441ffa4c3f90cbd33d977. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.030907  1264 ts_tablet_manager.cc:1434] T e12f4bd1b2ed49988317684782c8616b P 937efeddef934b2b8bc8632594903085: Time spent starting tablet: real 0.070s	user 0.004s	sys 0.002s
I20260709 12:26:42.033175  1267 ts_tablet_manager.cc:1434] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 8fa35514a8d84740b1b46ae496307f20: Time spent starting tablet: real 0.073s	user 0.003s	sys 0.003s
I20260709 12:26:42.034317  1267 tablet_bootstrap.cc:492] T c9793ebdadaa4da18e4e2c2fe6dae825 P 8fa35514a8d84740b1b46ae496307f20: Bootstrap starting.
I20260709 12:26:42.056524  1207 tablet_service.cc:1511] Processing CreateTablet for tablet ac8f3ce8c750468c966a23ea2787b888 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:26:42.057984  1207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac8f3ce8c750468c966a23ea2787b888. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.037657  1264 tablet_bootstrap.cc:492] T 3a19a87d91404b73bdba7121512bf7aa P 937efeddef934b2b8bc8632594903085: Bootstrap starting.
I20260709 12:26:42.061895  1265 tablet_bootstrap.cc:492] T 8c7002e5875a494e8e845023cc05503f P 7f9cbe40e40d429aa004e4a7fb42f132: No bootstrap required, opened a new log
I20260709 12:26:42.062475  1265 ts_tablet_manager.cc:1403] T 8c7002e5875a494e8e845023cc05503f P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent bootstrapping tablet: real 0.352s	user 0.014s	sys 0.007s
I20260709 12:26:42.065476  1265 raft_consensus.cc:359] T 8c7002e5875a494e8e845023cc05503f P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:42.066206  1265 raft_consensus.cc:385] T 8c7002e5875a494e8e845023cc05503f P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:42.066509  1265 raft_consensus.cc:740] T 8c7002e5875a494e8e845023cc05503f P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Initialized, Role: FOLLOWER
I20260709 12:26:42.071484  1265 consensus_queue.cc:260] T 8c7002e5875a494e8e845023cc05503f P 7f9cbe40e40d429aa004e4a7fb42f132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:42.073995  1278 raft_consensus.cc:493] T 1b6df135b8494d0d916747b8994b5cf9 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.074550  1278 raft_consensus.cc:515] T 1b6df135b8494d0d916747b8994b5cf9 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:42.076611  1278 leader_election.cc:290] T 1b6df135b8494d0d916747b8994b5cf9 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:26:42.077832  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b6df135b8494d0d916747b8994b5cf9" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:42.078136  1072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b6df135b8494d0d916747b8994b5cf9" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
W20260709 12:26:42.079348  1109 leader_election.cc:343] T 1b6df135b8494d0d916747b8994b5cf9 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:42.079905  1110 leader_election.cc:343] T 1b6df135b8494d0d916747b8994b5cf9 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:42.080344  1110 leader_election.cc:304] T 1b6df135b8494d0d916747b8994b5cf9 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20; no voters: 7f9cbe40e40d429aa004e4a7fb42f132, 937efeddef934b2b8bc8632594903085
I20260709 12:26:42.081072  1278 raft_consensus.cc:2749] T 1b6df135b8494d0d916747b8994b5cf9 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:42.081151  1265 ts_tablet_manager.cc:1434] T 8c7002e5875a494e8e845023cc05503f P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 12:26:42.083233  1276 raft_consensus.cc:493] T e12f4bd1b2ed49988317684782c8616b P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.083786  1276 raft_consensus.cc:515] T e12f4bd1b2ed49988317684782c8616b P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:42.085264  1264 tablet_bootstrap.cc:654] T 3a19a87d91404b73bdba7121512bf7aa P 937efeddef934b2b8bc8632594903085: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:42.085992  1276 leader_election.cc:290] T e12f4bd1b2ed49988317684782c8616b P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:42.087788  1265 tablet_bootstrap.cc:492] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 7f9cbe40e40d429aa004e4a7fb42f132: Bootstrap starting.
I20260709 12:26:42.087464   996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e12f4bd1b2ed49988317684782c8616b" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
I20260709 12:26:42.087484  1072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e12f4bd1b2ed49988317684782c8616b" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:42.088357   996 raft_consensus.cc:2468] T e12f4bd1b2ed49988317684782c8616b P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 0.
I20260709 12:26:42.089643  1186 leader_election.cc:304] T e12f4bd1b2ed49988317684782c8616b P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 937efeddef934b2b8bc8632594903085, aa098a557d34433896712068efd0d9a8; no voters: 
W20260709 12:26:42.090605  1184 leader_election.cc:343] T e12f4bd1b2ed49988317684782c8616b P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:42.091488  1276 raft_consensus.cc:2804] T e12f4bd1b2ed49988317684782c8616b P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:42.091939  1276 raft_consensus.cc:493] T e12f4bd1b2ed49988317684782c8616b P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:42.092368  1276 raft_consensus.cc:3060] T e12f4bd1b2ed49988317684782c8616b P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:42.095754  1265 tablet_bootstrap.cc:654] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 7f9cbe40e40d429aa004e4a7fb42f132: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:42.097839  1266 raft_consensus.cc:359] T 5b3d71845177478a9e2510c82e0cf9d1 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:42.098639  1266 raft_consensus.cc:385] T 5b3d71845177478a9e2510c82e0cf9d1 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:42.109308  1062 tablet_service.cc:1511] Processing CreateTablet for tablet ec806598903e4f88a40176e07ca4fad0 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:26:42.110707  1062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec806598903e4f88a40176e07ca4fad0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.110796  1264 tablet_bootstrap.cc:492] T 3a19a87d91404b73bdba7121512bf7aa P 937efeddef934b2b8bc8632594903085: No bootstrap required, opened a new log
I20260709 12:26:42.111593  1264 ts_tablet_manager.cc:1403] T 3a19a87d91404b73bdba7121512bf7aa P 937efeddef934b2b8bc8632594903085: Time spent bootstrapping tablet: real 0.080s	user 0.022s	sys 0.000s
I20260709 12:26:42.115617   979 tablet_service.cc:1511] Processing CreateTablet for tablet ec806598903e4f88a40176e07ca4fad0 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:26:42.116333  1132 tablet_service.cc:1511] Processing CreateTablet for tablet ec806598903e4f88a40176e07ca4fad0 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:26:42.117683   979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec806598903e4f88a40176e07ca4fad0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.118182  1205 tablet_service.cc:1511] Processing CreateTablet for tablet 348d7f300dcb474b8b012e01d0af067f (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:26:42.119500  1205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 348d7f300dcb474b8b012e01d0af067f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.123114   986 tablet_service.cc:1511] Processing CreateTablet for tablet 348d7f300dcb474b8b012e01d0af067f (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:26:42.125051   986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 348d7f300dcb474b8b012e01d0af067f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.126531  1059 tablet_service.cc:1511] Processing CreateTablet for tablet 348d7f300dcb474b8b012e01d0af067f (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:26:42.127863  1059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 348d7f300dcb474b8b012e01d0af067f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.129199  1298 consensus_queue.cc:1048] T e2ef4b262fac46fe9f9111b609547aa3 P 937efeddef934b2b8bc8632594903085 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:42.117676  1132 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec806598903e4f88a40176e07ca4fad0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.141561  1264 raft_consensus.cc:359] T 3a19a87d91404b73bdba7121512bf7aa P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:42.105432  1266 raft_consensus.cc:740] T 5b3d71845177478a9e2510c82e0cf9d1 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:42.148738  1265 tablet_bootstrap.cc:492] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 7f9cbe40e40d429aa004e4a7fb42f132: No bootstrap required, opened a new log
I20260709 12:26:42.149582  1265 ts_tablet_manager.cc:1403] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent bootstrapping tablet: real 0.062s	user 0.010s	sys 0.024s
I20260709 12:26:42.153267  1276 raft_consensus.cc:515] T e12f4bd1b2ed49988317684782c8616b P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:42.157153  1267 tablet_bootstrap.cc:654] T c9793ebdadaa4da18e4e2c2fe6dae825 P 8fa35514a8d84740b1b46ae496307f20: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:42.157752   997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e12f4bd1b2ed49988317684782c8616b" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8"
I20260709 12:26:42.158684   997 raft_consensus.cc:3060] T e12f4bd1b2ed49988317684782c8616b P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:42.142320  1264 raft_consensus.cc:385] T 3a19a87d91404b73bdba7121512bf7aa P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:42.174319  1264 raft_consensus.cc:740] T 3a19a87d91404b73bdba7121512bf7aa P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 937efeddef934b2b8bc8632594903085, State: Initialized, Role: FOLLOWER
I20260709 12:26:42.180564  1276 leader_election.cc:290] T e12f4bd1b2ed49988317684782c8616b P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Requested vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:42.182337  1071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e12f4bd1b2ed49988317684782c8616b" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
W20260709 12:26:42.184681  1184 leader_election.cc:343] T e12f4bd1b2ed49988317684782c8616b P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:42.186723  1266 consensus_queue.cc:260] T 5b3d71845177478a9e2510c82e0cf9d1 P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:42.190578  1264 consensus_queue.cc:260] T 3a19a87d91404b73bdba7121512bf7aa P 937efeddef934b2b8bc8632594903085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:42.193333  1264 ts_tablet_manager.cc:1434] T 3a19a87d91404b73bdba7121512bf7aa P 937efeddef934b2b8bc8632594903085: Time spent starting tablet: real 0.081s	user 0.007s	sys 0.001s
I20260709 12:26:42.195389  1265 raft_consensus.cc:359] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:42.197633  1210 tablet_service.cc:1511] Processing CreateTablet for tablet de3dd28c345442b38f399c5db383c5b2 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:26:42.203405  1207 tablet_service.cc:1511] Processing CreateTablet for tablet 1d2d9d3061d24ab1aac189e9a8b0a12d (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:26:42.204713  1207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d2d9d3061d24ab1aac189e9a8b0a12d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.204638  1135 tablet_service.cc:1511] Processing CreateTablet for tablet 1d2d9d3061d24ab1aac189e9a8b0a12d (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:26:42.206027  1135 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d2d9d3061d24ab1aac189e9a8b0a12d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.201143  1265 raft_consensus.cc:385] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:42.218493  1265 raft_consensus.cc:740] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Initialized, Role: FOLLOWER
I20260709 12:26:42.218873  1210 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de3dd28c345442b38f399c5db383c5b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.219648  1265 consensus_queue.cc:260] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 7f9cbe40e40d429aa004e4a7fb42f132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:42.222826  1136 tablet_service.cc:1511] Processing CreateTablet for tablet de3dd28c345442b38f399c5db383c5b2 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:26:42.225545  1136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de3dd28c345442b38f399c5db383c5b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.225770  1266 ts_tablet_manager.cc:1434] T 5b3d71845177478a9e2510c82e0cf9d1 P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.203s	user 0.008s	sys 0.004s
I20260709 12:26:42.227093  1276 consensus_queue.cc:1048] T e2ef4b262fac46fe9f9111b609547aa3 P 937efeddef934b2b8bc8632594903085 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:42.228104   978 tablet_service.cc:1511] Processing CreateTablet for tablet eb44e6d7d92f49eb9758d5a5f6ce50b6 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:26:42.228574  1277 raft_consensus.cc:493] T 8c7002e5875a494e8e845023cc05503f P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.229708  1267 tablet_bootstrap.cc:492] T c9793ebdadaa4da18e4e2c2fe6dae825 P 8fa35514a8d84740b1b46ae496307f20: No bootstrap required, opened a new log
I20260709 12:26:42.243217  1277 raft_consensus.cc:515] T 8c7002e5875a494e8e845023cc05503f P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:42.247416   978 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb44e6d7d92f49eb9758d5a5f6ce50b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.247328  1315 raft_consensus.cc:493] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.247998  1315 raft_consensus.cc:515] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:42.248900  1128 tablet_service.cc:1511] Processing CreateTablet for tablet eb44e6d7d92f49eb9758d5a5f6ce50b6 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:26:42.250062  1315 leader_election.cc:290] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:42.250162  1128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb44e6d7d92f49eb9758d5a5f6ce50b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.244576  1267 ts_tablet_manager.cc:1403] T c9793ebdadaa4da18e4e2c2fe6dae825 P 8fa35514a8d84740b1b46ae496307f20: Time spent bootstrapping tablet: real 0.211s	user 0.014s	sys 0.006s
I20260709 12:26:42.251718  1264 tablet_bootstrap.cc:492] T 1b6df135b8494d0d916747b8994b5cf9 P 937efeddef934b2b8bc8632594903085: Bootstrap starting.
I20260709 12:26:42.258065  1056 tablet_service.cc:1511] Processing CreateTablet for tablet eb44e6d7d92f49eb9758d5a5f6ce50b6 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:26:42.258684  1072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d72f2a6ae046cb9d4e6277d13e34e6" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:42.259399  1072 raft_consensus.cc:2468] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 0.
I20260709 12:26:42.259567  1056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb44e6d7d92f49eb9758d5a5f6ce50b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.260558   995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d72f2a6ae046cb9d4e6277d13e34e6" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
I20260709 12:26:42.263824  1277 leader_election.cc:290] T 8c7002e5875a494e8e845023cc05503f P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
W20260709 12:26:42.264256  1112 leader_election.cc:343] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:42.264632  1277 raft_consensus.cc:493] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.265089  1277 raft_consensus.cc:515] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:42.266235  1146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7002e5875a494e8e845023cc05503f" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:42.267799   986 tablet_service.cc:1511] Processing CreateTablet for tablet a943f9cb8fef49e6a38b910ff1bb9076 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:26:42.268993   986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a943f9cb8fef49e6a38b910ff1bb9076. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.270792  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7002e5875a494e8e845023cc05503f" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:42.277585  1207 tablet_service.cc:1511] Processing CreateTablet for tablet a943f9cb8fef49e6a38b910ff1bb9076 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:26:42.279564  1207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a943f9cb8fef49e6a38b910ff1bb9076. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:42.285497  1038 leader_election.cc:343] T 8c7002e5875a494e8e845023cc05503f P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:42.287744   979 tablet_service.cc:1511] Processing CreateTablet for tablet de3dd28c345442b38f399c5db383c5b2 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:26:42.280725  1266 tablet_bootstrap.cc:492] T 70720af8528947a89c03ec468c1235eb P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:42.290007   995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d72f2a6ae046cb9d4e6277d13e34e6" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
I20260709 12:26:42.290179  1146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d72f2a6ae046cb9d4e6277d13e34e6" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:42.290867  1146 raft_consensus.cc:2468] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f9cbe40e40d429aa004e4a7fb42f132 in term 0.
I20260709 12:26:42.290660  1057 tablet_service.cc:1511] Processing CreateTablet for tablet 1d2d9d3061d24ab1aac189e9a8b0a12d (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:26:42.291999  1057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d2d9d3061d24ab1aac189e9a8b0a12d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.292178  1038 leader_election.cc:304] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 8fa35514a8d84740b1b46ae496307f20; no voters: 
I20260709 12:26:42.292876  1127 tablet_service.cc:1511] Processing CreateTablet for tablet 0c434afb0b164ab5b38dea54bfcebfe8 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:26:42.294163  1127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c434afb0b164ab5b38dea54bfcebfe8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:42.296100  1038 leader_election.cc:343] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:42.296730  1035 leader_election.cc:343] T 8c7002e5875a494e8e845023cc05503f P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:42.291908  1054 tablet_service.cc:1511] Processing CreateTablet for tablet a943f9cb8fef49e6a38b910ff1bb9076 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:26:42.299168  1054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a943f9cb8fef49e6a38b910ff1bb9076. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.299293  1035 leader_election.cc:304] T 8c7002e5875a494e8e845023cc05503f P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132; no voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085
I20260709 12:26:42.299990  1110 leader_election.cc:304] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 8fa35514a8d84740b1b46ae496307f20; no voters: aa098a557d34433896712068efd0d9a8
I20260709 12:26:42.289124   979 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de3dd28c345442b38f399c5db383c5b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.280001  1277 leader_election.cc:290] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341)
I20260709 12:26:42.334429  1317 raft_consensus.cc:2804] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:42.335103  1317 raft_consensus.cc:493] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:42.335446  1317 raft_consensus.cc:3060] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:42.336599  1320 raft_consensus.cc:2804] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:42.337037  1320 raft_consensus.cc:493] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:42.337421  1320 raft_consensus.cc:3060] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:42.345703   986 tablet_service.cc:1511] Processing CreateTablet for tablet 0c434afb0b164ab5b38dea54bfcebfe8 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:26:42.346908   986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c434afb0b164ab5b38dea54bfcebfe8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:42.348304  1264 tablet_bootstrap.cc:654] T 1b6df135b8494d0d916747b8994b5cf9 P 937efeddef934b2b8bc8632594903085: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:42.348065  1267 raft_consensus.cc:359] T c9793ebdadaa4da18e4e2c2fe6dae825 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:42.348977  1267 raft_consensus.cc:385] T c9793ebdadaa4da18e4e2c2fe6dae825 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:42.349339  1267 raft_consensus.cc:740] T c9793ebdadaa4da18e4e2c2fe6dae825 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Initialized, Role: FOLLOWER
I20260709 12:26:42.350189  1267 consensus_queue.cc:260] T c9793ebdadaa4da18e4e2c2fe6dae825 P 8fa35514a8d84740b1b46ae496307f20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:42.370609  1320 raft_consensus.cc:515] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:42.328948  1277 raft_consensus.cc:2749] T 8c7002e5875a494e8e845023cc05503f P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:42.374862  1207 tablet_service.cc:1511] Processing CreateTablet for tablet 0c434afb0b164ab5b38dea54bfcebfe8 (DEFAULT_TABLE table=test-workload [id=633b7d67c1824a9ead1177eb6db1a6e8]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:26:42.376456  1207 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c434afb0b164ab5b38dea54bfcebfe8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:42.327877  1110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:43679, user_credentials={real_user=slave}} blocked reactor thread for 46041.5us
I20260709 12:26:42.386276  1264 tablet_bootstrap.cc:492] T 1b6df135b8494d0d916747b8994b5cf9 P 937efeddef934b2b8bc8632594903085: No bootstrap required, opened a new log
I20260709 12:26:42.387668   997 raft_consensus.cc:2468] T e12f4bd1b2ed49988317684782c8616b P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 1.
I20260709 12:26:42.406622  1186 leader_election.cc:304] T e12f4bd1b2ed49988317684782c8616b P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 937efeddef934b2b8bc8632594903085, aa098a557d34433896712068efd0d9a8; no voters: 7f9cbe40e40d429aa004e4a7fb42f132
I20260709 12:26:42.401103  1264 ts_tablet_manager.cc:1403] T 1b6df135b8494d0d916747b8994b5cf9 P 937efeddef934b2b8bc8632594903085: Time spent bootstrapping tablet: real 0.160s	user 0.012s	sys 0.002s
I20260709 12:26:42.407902  1298 raft_consensus.cc:2804] T e12f4bd1b2ed49988317684782c8616b P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:42.412328   997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d72f2a6ae046cb9d4e6277d13e34e6" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8"
I20260709 12:26:42.413141  1317 raft_consensus.cc:515] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
W20260709 12:26:42.415026  1038 leader_election.cc:343] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:42.416050  1320 leader_election.cc:290] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 election: Requested vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341)
I20260709 12:26:42.416079  1267 ts_tablet_manager.cc:1434] T c9793ebdadaa4da18e4e2c2fe6dae825 P 8fa35514a8d84740b1b46ae496307f20: Time spent starting tablet: real 0.159s	user 0.005s	sys 0.004s
I20260709 12:26:42.418922  1146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d72f2a6ae046cb9d4e6277d13e34e6" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20"
I20260709 12:26:42.419727  1146 raft_consensus.cc:2393] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7f9cbe40e40d429aa004e4a7fb42f132 in current term 1: Already voted for candidate 8fa35514a8d84740b1b46ae496307f20 in this term.
I20260709 12:26:42.426610  1317 leader_election.cc:290] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 election: Requested vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:42.437253  1038 leader_election.cc:304] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132; no voters: 8fa35514a8d84740b1b46ae496307f20, aa098a557d34433896712068efd0d9a8
I20260709 12:26:42.438372  1267 tablet_bootstrap.cc:492] T 8c7002e5875a494e8e845023cc05503f P 8fa35514a8d84740b1b46ae496307f20: Bootstrap starting.
I20260709 12:26:42.427982  1298 raft_consensus.cc:697] T e12f4bd1b2ed49988317684782c8616b P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Becoming Leader. State: Replica: 937efeddef934b2b8bc8632594903085, State: Running, Role: LEADER
I20260709 12:26:42.443356  1264 raft_consensus.cc:359] T 1b6df135b8494d0d916747b8994b5cf9 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:42.444404  1266 tablet_bootstrap.cc:654] T 70720af8528947a89c03ec468c1235eb P aa098a557d34433896712068efd0d9a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:42.451562  1272 raft_consensus.cc:493] T 5b3d71845177478a9e2510c82e0cf9d1 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.444445  1264 raft_consensus.cc:385] T 1b6df135b8494d0d916747b8994b5cf9 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:42.452129  1272 raft_consensus.cc:515] T 5b3d71845177478a9e2510c82e0cf9d1 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:42.452520  1264 raft_consensus.cc:740] T 1b6df135b8494d0d916747b8994b5cf9 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 937efeddef934b2b8bc8632594903085, State: Initialized, Role: FOLLOWER
I20260709 12:26:42.454445  1272 leader_election.cc:290] T 5b3d71845177478a9e2510c82e0cf9d1 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:42.440663  1320 raft_consensus.cc:2749] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:26:42.456334   997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d72f2a6ae046cb9d4e6277d13e34e6" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8"
I20260709 12:26:42.456413  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3d71845177478a9e2510c82e0cf9d1" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:42.457571  1220 raft_consensus.cc:2468] T 5b3d71845177478a9e2510c82e0cf9d1 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa098a557d34433896712068efd0d9a8 in term 0.
W20260709 12:26:42.458170  1112 leader_election.cc:343] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:42.459484   960 leader_election.cc:304] T 5b3d71845177478a9e2510c82e0cf9d1 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 937efeddef934b2b8bc8632594903085, aa098a557d34433896712068efd0d9a8; no voters: 
I20260709 12:26:42.460768  1272 raft_consensus.cc:2804] T 5b3d71845177478a9e2510c82e0cf9d1 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:42.461947  1264 consensus_queue.cc:260] T 1b6df135b8494d0d916747b8994b5cf9 P 937efeddef934b2b8bc8632594903085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:42.460538  1298 consensus_queue.cc:237] T e12f4bd1b2ed49988317684782c8616b P 937efeddef934b2b8bc8632594903085 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:42.461333  1272 raft_consensus.cc:493] T 5b3d71845177478a9e2510c82e0cf9d1 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:42.475179  1272 raft_consensus.cc:3060] T 5b3d71845177478a9e2510c82e0cf9d1 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:42.475494  1264 ts_tablet_manager.cc:1434] T 1b6df135b8494d0d916747b8994b5cf9 P 937efeddef934b2b8bc8632594903085: Time spent starting tablet: real 0.067s	user 0.005s	sys 0.005s
I20260709 12:26:42.484176  1317 raft_consensus.cc:493] T c9793ebdadaa4da18e4e2c2fe6dae825 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.485718  1317 raft_consensus.cc:515] T c9793ebdadaa4da18e4e2c2fe6dae825 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:42.488132  1317 leader_election.cc:290] T c9793ebdadaa4da18e4e2c2fe6dae825 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:26:42.489259  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9793ebdadaa4da18e4e2c2fe6dae825" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
W20260709 12:26:42.490973  1109 leader_election.cc:343] T c9793ebdadaa4da18e4e2c2fe6dae825 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:42.493713  1267 tablet_bootstrap.cc:654] T 8c7002e5875a494e8e845023cc05503f P 8fa35514a8d84740b1b46ae496307f20: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:42.496500  1264 tablet_bootstrap.cc:492] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P 937efeddef934b2b8bc8632594903085: Bootstrap starting.
I20260709 12:26:42.496671  1265 ts_tablet_manager.cc:1434] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent starting tablet: real 0.347s	user 0.025s	sys 0.030s
I20260709 12:26:42.503264  1265 tablet_bootstrap.cc:492] T 284ea666431c4339998eb885cd31facb P 7f9cbe40e40d429aa004e4a7fb42f132: Bootstrap starting.
I20260709 12:26:42.504202  1264 tablet_bootstrap.cc:654] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P 937efeddef934b2b8bc8632594903085: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:42.506188  1272 raft_consensus.cc:515] T 5b3d71845177478a9e2510c82e0cf9d1 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:42.512307  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3d71845177478a9e2510c82e0cf9d1" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085"
I20260709 12:26:42.513274  1220 raft_consensus.cc:3060] T 5b3d71845177478a9e2510c82e0cf9d1 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:42.517480  1035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:33909, user_credentials={real_user=slave}} blocked reactor thread for 231947us
I20260709 12:26:42.520074  1072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3d71845177478a9e2510c82e0cf9d1" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:42.521723  1072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d72f2a6ae046cb9d4e6277d13e34e6" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
I20260709 12:26:42.522574  1072 raft_consensus.cc:2393] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8fa35514a8d84740b1b46ae496307f20 in current term 1: Already voted for candidate 7f9cbe40e40d429aa004e4a7fb42f132 in this term.
I20260709 12:26:42.523788  1072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9793ebdadaa4da18e4e2c2fe6dae825" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:42.523902   892 catalog_manager.cc:5697] T e12f4bd1b2ed49988317684782c8616b P 937efeddef934b2b8bc8632594903085 reported cstate change: term changed from 0 to 1, leader changed from <none> to 937efeddef934b2b8bc8632594903085 (127.23.245.132). New cstate: current_term: 1 leader_uuid: "937efeddef934b2b8bc8632594903085" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:42.525127   961 leader_election.cc:343] T 5b3d71845177478a9e2510c82e0cf9d1 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:42.526470  1110 leader_election.cc:304] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20; no voters: 7f9cbe40e40d429aa004e4a7fb42f132, aa098a557d34433896712068efd0d9a8
I20260709 12:26:42.527717  1317 raft_consensus.cc:2749] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:26:42.529107  1110 leader_election.cc:343] T c9793ebdadaa4da18e4e2c2fe6dae825 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:42.529614  1110 leader_election.cc:304] T c9793ebdadaa4da18e4e2c2fe6dae825 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20; no voters: 7f9cbe40e40d429aa004e4a7fb42f132, 937efeddef934b2b8bc8632594903085
I20260709 12:26:42.530750  1317 raft_consensus.cc:2749] T c9793ebdadaa4da18e4e2c2fe6dae825 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:42.534091  1266 tablet_bootstrap.cc:492] T 70720af8528947a89c03ec468c1235eb P aa098a557d34433896712068efd0d9a8: No bootstrap required, opened a new log
I20260709 12:26:42.534644  1266 ts_tablet_manager.cc:1403] T 70720af8528947a89c03ec468c1235eb P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.279s	user 0.019s	sys 0.021s
I20260709 12:26:42.535575  1220 raft_consensus.cc:2468] T 5b3d71845177478a9e2510c82e0cf9d1 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa098a557d34433896712068efd0d9a8 in term 1.
I20260709 12:26:42.536880   960 leader_election.cc:304] T 5b3d71845177478a9e2510c82e0cf9d1 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 937efeddef934b2b8bc8632594903085, aa098a557d34433896712068efd0d9a8; no voters: 
I20260709 12:26:42.538056  1272 leader_election.cc:290] T 5b3d71845177478a9e2510c82e0cf9d1 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 election: Requested vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:42.538846  1272 raft_consensus.cc:2804] T 5b3d71845177478a9e2510c82e0cf9d1 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:42.539425  1272 raft_consensus.cc:697] T 5b3d71845177478a9e2510c82e0cf9d1 P aa098a557d34433896712068efd0d9a8 [term 1 LEADER]: Becoming Leader. State: Replica: aa098a557d34433896712068efd0d9a8, State: Running, Role: LEADER
I20260709 12:26:42.541028  1298 raft_consensus.cc:493] T 3a19a87d91404b73bdba7121512bf7aa P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.546278  1072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3d71845177478a9e2510c82e0cf9d1" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
I20260709 12:26:42.546406  1298 raft_consensus.cc:515] T 3a19a87d91404b73bdba7121512bf7aa P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
W20260709 12:26:42.547753   961 leader_election.cc:343] T 5b3d71845177478a9e2510c82e0cf9d1 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:42.548650  1298 leader_election.cc:290] T 3a19a87d91404b73bdba7121512bf7aa P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:42.550148   997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a19a87d91404b73bdba7121512bf7aa" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
I20260709 12:26:42.550335  1072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a19a87d91404b73bdba7121512bf7aa" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
W20260709 12:26:42.553258  1184 leader_election.cc:343] T 3a19a87d91404b73bdba7121512bf7aa P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:42.554766  1186 leader_election.cc:343] T 3a19a87d91404b73bdba7121512bf7aa P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:42.555344  1186 leader_election.cc:304] T 3a19a87d91404b73bdba7121512bf7aa P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 937efeddef934b2b8bc8632594903085; no voters: 7f9cbe40e40d429aa004e4a7fb42f132, aa098a557d34433896712068efd0d9a8
I20260709 12:26:42.557052  1298 raft_consensus.cc:2749] T 3a19a87d91404b73bdba7121512bf7aa P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:42.537638  1266 raft_consensus.cc:359] T 70720af8528947a89c03ec468c1235eb P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:42.558944  1266 raft_consensus.cc:385] T 70720af8528947a89c03ec468c1235eb P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:42.560410  1266 raft_consensus.cc:740] T 70720af8528947a89c03ec468c1235eb P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:42.562318  1266 consensus_queue.cc:260] T 70720af8528947a89c03ec468c1235eb P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:42.570158  1267 tablet_bootstrap.cc:492] T 8c7002e5875a494e8e845023cc05503f P 8fa35514a8d84740b1b46ae496307f20: No bootstrap required, opened a new log
I20260709 12:26:42.570554  1265 tablet_bootstrap.cc:654] T 284ea666431c4339998eb885cd31facb P 7f9cbe40e40d429aa004e4a7fb42f132: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:42.570823  1267 ts_tablet_manager.cc:1403] T 8c7002e5875a494e8e845023cc05503f P 8fa35514a8d84740b1b46ae496307f20: Time spent bootstrapping tablet: real 0.133s	user 0.017s	sys 0.020s
I20260709 12:26:42.565668  1272 consensus_queue.cc:237] T 5b3d71845177478a9e2510c82e0cf9d1 P aa098a557d34433896712068efd0d9a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:42.574465  1267 raft_consensus.cc:359] T 8c7002e5875a494e8e845023cc05503f P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:42.575327  1267 raft_consensus.cc:385] T 8c7002e5875a494e8e845023cc05503f P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:42.575654  1267 raft_consensus.cc:740] T 8c7002e5875a494e8e845023cc05503f P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Initialized, Role: FOLLOWER
I20260709 12:26:42.576645  1267 consensus_queue.cc:260] T 8c7002e5875a494e8e845023cc05503f P 8fa35514a8d84740b1b46ae496307f20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:42.582540  1264 tablet_bootstrap.cc:492] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P 937efeddef934b2b8bc8632594903085: No bootstrap required, opened a new log
I20260709 12:26:42.583288  1264 ts_tablet_manager.cc:1403] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P 937efeddef934b2b8bc8632594903085: Time spent bootstrapping tablet: real 0.087s	user 0.017s	sys 0.019s
I20260709 12:26:42.584154  1267 ts_tablet_manager.cc:1434] T 8c7002e5875a494e8e845023cc05503f P 8fa35514a8d84740b1b46ae496307f20: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 12:26:42.585311  1267 tablet_bootstrap.cc:492] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 8fa35514a8d84740b1b46ae496307f20: Bootstrap starting.
I20260709 12:26:42.592588  1267 tablet_bootstrap.cc:654] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 8fa35514a8d84740b1b46ae496307f20: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:42.601034   895 catalog_manager.cc:5697] T 5b3d71845177478a9e2510c82e0cf9d1 P aa098a557d34433896712068efd0d9a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to aa098a557d34433896712068efd0d9a8 (127.23.245.129). New cstate: current_term: 1 leader_uuid: "aa098a557d34433896712068efd0d9a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:42.610742   943 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:42.625521  1265 tablet_bootstrap.cc:492] T 284ea666431c4339998eb885cd31facb P 7f9cbe40e40d429aa004e4a7fb42f132: No bootstrap required, opened a new log
I20260709 12:26:42.622217  1264 raft_consensus.cc:359] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:42.626310  1265 ts_tablet_manager.cc:1403] T 284ea666431c4339998eb885cd31facb P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent bootstrapping tablet: real 0.123s	user 0.020s	sys 0.006s
I20260709 12:26:42.626473  1264 raft_consensus.cc:385] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:42.626977  1264 raft_consensus.cc:740] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 937efeddef934b2b8bc8632594903085, State: Initialized, Role: FOLLOWER
I20260709 12:26:42.627794  1264 consensus_queue.cc:260] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P 937efeddef934b2b8bc8632594903085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:42.629931  1264 ts_tablet_manager.cc:1434] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P 937efeddef934b2b8bc8632594903085: Time spent starting tablet: real 0.046s	user 0.004s	sys 0.004s
I20260709 12:26:42.633883  1264 tablet_bootstrap.cc:492] T 8c7002e5875a494e8e845023cc05503f P 937efeddef934b2b8bc8632594903085: Bootstrap starting.
I20260709 12:26:42.630667  1265 raft_consensus.cc:359] T 284ea666431c4339998eb885cd31facb P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:42.640837  1265 raft_consensus.cc:385] T 284ea666431c4339998eb885cd31facb P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:42.643874  1266 ts_tablet_manager.cc:1434] T 70720af8528947a89c03ec468c1235eb P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.109s	user 0.026s	sys 0.041s
I20260709 12:26:42.645030  1266 tablet_bootstrap.cc:492] T e281f15348944cc1ab51fce7c1653aac P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:42.641193  1265 raft_consensus.cc:740] T 284ea666431c4339998eb885cd31facb P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Initialized, Role: FOLLOWER
I20260709 12:26:42.651181  1265 consensus_queue.cc:260] T 284ea666431c4339998eb885cd31facb P 7f9cbe40e40d429aa004e4a7fb42f132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:42.656948  1266 tablet_bootstrap.cc:654] T e281f15348944cc1ab51fce7c1653aac P aa098a557d34433896712068efd0d9a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:42.657177  1265 ts_tablet_manager.cc:1434] T 284ea666431c4339998eb885cd31facb P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent starting tablet: real 0.030s	user 0.010s	sys 0.000s
I20260709 12:26:42.658306  1265 tablet_bootstrap.cc:492] T c9793ebdadaa4da18e4e2c2fe6dae825 P 7f9cbe40e40d429aa004e4a7fb42f132: Bootstrap starting.
I20260709 12:26:42.666162  1267 tablet_bootstrap.cc:492] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 8fa35514a8d84740b1b46ae496307f20: No bootstrap required, opened a new log
I20260709 12:26:42.666927  1267 ts_tablet_manager.cc:1403] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 8fa35514a8d84740b1b46ae496307f20: Time spent bootstrapping tablet: real 0.082s	user 0.012s	sys 0.015s
I20260709 12:26:42.671084  1267 raft_consensus.cc:359] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:42.677325  1264 tablet_bootstrap.cc:654] T 8c7002e5875a494e8e845023cc05503f P 937efeddef934b2b8bc8632594903085: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:42.677593  1267 raft_consensus.cc:385] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:42.677995  1267 raft_consensus.cc:740] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Initialized, Role: FOLLOWER
I20260709 12:26:42.678489  1266 tablet_bootstrap.cc:492] T e281f15348944cc1ab51fce7c1653aac P aa098a557d34433896712068efd0d9a8: No bootstrap required, opened a new log
I20260709 12:26:42.679150  1266 ts_tablet_manager.cc:1403] T e281f15348944cc1ab51fce7c1653aac P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.034s	user 0.023s	sys 0.000s
I20260709 12:26:42.679391  1328 raft_consensus.cc:493] T 284ea666431c4339998eb885cd31facb P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.679893  1328 raft_consensus.cc:515] T 284ea666431c4339998eb885cd31facb P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:42.682065  1328 leader_election.cc:290] T 284ea666431c4339998eb885cd31facb P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341)
I20260709 12:26:42.683770  1267 consensus_queue.cc:260] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 8fa35514a8d84740b1b46ae496307f20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:42.684338  1146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284ea666431c4339998eb885cd31facb" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:42.685055   997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284ea666431c4339998eb885cd31facb" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
I20260709 12:26:42.685727   997 raft_consensus.cc:2468] T 284ea666431c4339998eb885cd31facb P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f9cbe40e40d429aa004e4a7fb42f132 in term 0.
I20260709 12:26:42.686443  1267 ts_tablet_manager.cc:1434] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 8fa35514a8d84740b1b46ae496307f20: Time spent starting tablet: real 0.019s	user 0.011s	sys 0.000s
I20260709 12:26:42.687496  1267 tablet_bootstrap.cc:492] T 580f367489064e218eef65b4654744b8 P 8fa35514a8d84740b1b46ae496307f20: Bootstrap starting.
I20260709 12:26:42.687881  1038 leader_election.cc:304] T 284ea666431c4339998eb885cd31facb P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, aa098a557d34433896712068efd0d9a8; no voters: 
I20260709 12:26:42.689564  1265 tablet_bootstrap.cc:654] T c9793ebdadaa4da18e4e2c2fe6dae825 P 7f9cbe40e40d429aa004e4a7fb42f132: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:42.692759  1038 leader_election.cc:343] T 284ea666431c4339998eb885cd31facb P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:42.694481  1328 raft_consensus.cc:2804] T 284ea666431c4339998eb885cd31facb P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:42.695031  1328 raft_consensus.cc:493] T 284ea666431c4339998eb885cd31facb P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:42.695454  1328 raft_consensus.cc:3060] T 284ea666431c4339998eb885cd31facb P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:42.699158  1267 tablet_bootstrap.cc:654] T 580f367489064e218eef65b4654744b8 P 8fa35514a8d84740b1b46ae496307f20: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:42.702638  1266 raft_consensus.cc:359] T e281f15348944cc1ab51fce7c1653aac P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:42.703544  1266 raft_consensus.cc:385] T e281f15348944cc1ab51fce7c1653aac P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:42.705323  1265 tablet_bootstrap.cc:492] T c9793ebdadaa4da18e4e2c2fe6dae825 P 7f9cbe40e40d429aa004e4a7fb42f132: No bootstrap required, opened a new log
I20260709 12:26:42.709488  1267 tablet_bootstrap.cc:492] T 580f367489064e218eef65b4654744b8 P 8fa35514a8d84740b1b46ae496307f20: No bootstrap required, opened a new log
I20260709 12:26:42.711661  1265 ts_tablet_manager.cc:1403] T c9793ebdadaa4da18e4e2c2fe6dae825 P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent bootstrapping tablet: real 0.054s	user 0.011s	sys 0.006s
I20260709 12:26:42.711701  1267 ts_tablet_manager.cc:1403] T 580f367489064e218eef65b4654744b8 P 8fa35514a8d84740b1b46ae496307f20: Time spent bootstrapping tablet: real 0.024s	user 0.006s	sys 0.005s
I20260709 12:26:42.714314  1267 raft_consensus.cc:359] T 580f367489064e218eef65b4654744b8 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:42.714994  1267 raft_consensus.cc:385] T 580f367489064e218eef65b4654744b8 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:42.715472  1267 raft_consensus.cc:740] T 580f367489064e218eef65b4654744b8 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Initialized, Role: FOLLOWER
I20260709 12:26:42.715062  1265 raft_consensus.cc:359] T c9793ebdadaa4da18e4e2c2fe6dae825 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:42.716722  1267 consensus_queue.cc:260] T 580f367489064e218eef65b4654744b8 P 8fa35514a8d84740b1b46ae496307f20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:42.717967  1265 raft_consensus.cc:385] T c9793ebdadaa4da18e4e2c2fe6dae825 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:42.717789  1328 raft_consensus.cc:515] T 284ea666431c4339998eb885cd31facb P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:42.718463  1265 raft_consensus.cc:740] T c9793ebdadaa4da18e4e2c2fe6dae825 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Initialized, Role: FOLLOWER
I20260709 12:26:42.719574  1265 consensus_queue.cc:260] T c9793ebdadaa4da18e4e2c2fe6dae825 P 7f9cbe40e40d429aa004e4a7fb42f132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:42.731478  1298 raft_consensus.cc:493] T 1b6df135b8494d0d916747b8994b5cf9 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.732151  1298 raft_consensus.cc:515] T 1b6df135b8494d0d916747b8994b5cf9 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:42.733551  1267 ts_tablet_manager.cc:1434] T 580f367489064e218eef65b4654744b8 P 8fa35514a8d84740b1b46ae496307f20: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:26:42.734845  1267 tablet_bootstrap.cc:492] T 70720af8528947a89c03ec468c1235eb P 8fa35514a8d84740b1b46ae496307f20: Bootstrap starting.
I20260709 12:26:42.737819  1298 leader_election.cc:290] T 1b6df135b8494d0d916747b8994b5cf9 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679), 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341)
I20260709 12:26:42.738694  1072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b6df135b8494d0d916747b8994b5cf9" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
W20260709 12:26:42.740208  1184 leader_election.cc:343] T 1b6df135b8494d0d916747b8994b5cf9 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:42.742669  1267 tablet_bootstrap.cc:654] T 70720af8528947a89c03ec468c1235eb P 8fa35514a8d84740b1b46ae496307f20: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:42.723006  1265 ts_tablet_manager.cc:1434] T c9793ebdadaa4da18e4e2c2fe6dae825 P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 12:26:42.745193  1265 tablet_bootstrap.cc:492] T e12f4bd1b2ed49988317684782c8616b P 7f9cbe40e40d429aa004e4a7fb42f132: Bootstrap starting.
I20260709 12:26:42.754535  1265 tablet_bootstrap.cc:654] T e12f4bd1b2ed49988317684782c8616b P 7f9cbe40e40d429aa004e4a7fb42f132: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:42.765990  1265 tablet_bootstrap.cc:492] T e12f4bd1b2ed49988317684782c8616b P 7f9cbe40e40d429aa004e4a7fb42f132: No bootstrap required, opened a new log
I20260709 12:26:42.766669  1265 ts_tablet_manager.cc:1403] T e12f4bd1b2ed49988317684782c8616b P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent bootstrapping tablet: real 0.022s	user 0.006s	sys 0.008s
I20260709 12:26:42.767895  1317 raft_consensus.cc:493] T 580f367489064e218eef65b4654744b8 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.768584  1317 raft_consensus.cc:515] T 580f367489064e218eef65b4654744b8 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:42.773243   997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580f367489064e218eef65b4654744b8" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
W20260709 12:26:42.775116  1112 leader_election.cc:343] T 580f367489064e218eef65b4654744b8 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:42.775903  1317 leader_election.cc:290] T 580f367489064e218eef65b4654744b8 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:42.715942  1266 raft_consensus.cc:740] T e281f15348944cc1ab51fce7c1653aac P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:42.780720  1266 consensus_queue.cc:260] T e281f15348944cc1ab51fce7c1653aac P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:42.783321  1266 ts_tablet_manager.cc:1434] T e281f15348944cc1ab51fce7c1653aac P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.104s	user 0.004s	sys 0.001s
I20260709 12:26:42.786484  1267 tablet_bootstrap.cc:492] T 70720af8528947a89c03ec468c1235eb P 8fa35514a8d84740b1b46ae496307f20: No bootstrap required, opened a new log
I20260709 12:26:42.787345  1267 ts_tablet_manager.cc:1403] T 70720af8528947a89c03ec468c1235eb P 8fa35514a8d84740b1b46ae496307f20: Time spent bootstrapping tablet: real 0.053s	user 0.013s	sys 0.010s
I20260709 12:26:42.790410  1265 raft_consensus.cc:359] T e12f4bd1b2ed49988317684782c8616b P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:42.793021  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580f367489064e218eef65b4654744b8" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:42.793951  1265 raft_consensus.cc:385] T e12f4bd1b2ed49988317684782c8616b P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:42.794385  1265 raft_consensus.cc:740] T e12f4bd1b2ed49988317684782c8616b P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Initialized, Role: FOLLOWER
W20260709 12:26:42.797081  1109 leader_election.cc:343] T 580f367489064e218eef65b4654744b8 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:42.803076  1109 leader_election.cc:304] T 580f367489064e218eef65b4654744b8 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20; no voters: 937efeddef934b2b8bc8632594903085, aa098a557d34433896712068efd0d9a8
I20260709 12:26:42.798705  1264 tablet_bootstrap.cc:492] T 8c7002e5875a494e8e845023cc05503f P 937efeddef934b2b8bc8632594903085: No bootstrap required, opened a new log
I20260709 12:26:42.804091  1317 raft_consensus.cc:2749] T 580f367489064e218eef65b4654744b8 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:42.804600  1264 ts_tablet_manager.cc:1403] T 8c7002e5875a494e8e845023cc05503f P 937efeddef934b2b8bc8632594903085: Time spent bootstrapping tablet: real 0.171s	user 0.061s	sys 0.031s
I20260709 12:26:42.806567  1320 raft_consensus.cc:493] T c9793ebdadaa4da18e4e2c2fe6dae825 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.807073  1320 raft_consensus.cc:515] T c9793ebdadaa4da18e4e2c2fe6dae825 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:42.807854  1264 raft_consensus.cc:359] T 8c7002e5875a494e8e845023cc05503f P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:42.808610  1264 raft_consensus.cc:385] T 8c7002e5875a494e8e845023cc05503f P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:42.808911  1264 raft_consensus.cc:740] T 8c7002e5875a494e8e845023cc05503f P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 937efeddef934b2b8bc8632594903085, State: Initialized, Role: FOLLOWER
I20260709 12:26:42.809300  1320 leader_election.cc:290] T c9793ebdadaa4da18e4e2c2fe6dae825 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:26:42.809666  1264 consensus_queue.cc:260] T 8c7002e5875a494e8e845023cc05503f P 937efeddef934b2b8bc8632594903085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:42.811326  1146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9793ebdadaa4da18e4e2c2fe6dae825" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:42.799198  1265 consensus_queue.cc:260] T e12f4bd1b2ed49988317684782c8616b P 7f9cbe40e40d429aa004e4a7fb42f132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:42.812096  1146 raft_consensus.cc:2468] T c9793ebdadaa4da18e4e2c2fe6dae825 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f9cbe40e40d429aa004e4a7fb42f132 in term 0.
I20260709 12:26:42.813400  1265 ts_tablet_manager.cc:1434] T e12f4bd1b2ed49988317684782c8616b P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.004s
I20260709 12:26:42.814294  1265 tablet_bootstrap.cc:492] T 3a19a87d91404b73bdba7121512bf7aa P 7f9cbe40e40d429aa004e4a7fb42f132: Bootstrap starting.
I20260709 12:26:42.800797  1266 tablet_bootstrap.cc:492] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:42.813400  1038 leader_election.cc:304] T c9793ebdadaa4da18e4e2c2fe6dae825 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 8fa35514a8d84740b1b46ae496307f20; no voters: 
I20260709 12:26:42.817440  1323 raft_consensus.cc:2804] T c9793ebdadaa4da18e4e2c2fe6dae825 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:42.817813  1323 raft_consensus.cc:493] T c9793ebdadaa4da18e4e2c2fe6dae825 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:42.818130  1323 raft_consensus.cc:3060] T c9793ebdadaa4da18e4e2c2fe6dae825 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:42.800812   997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284ea666431c4339998eb885cd31facb" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8"
I20260709 12:26:42.818686   997 raft_consensus.cc:3060] T 284ea666431c4339998eb885cd31facb P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:42.819471  1328 leader_election.cc:290] T 284ea666431c4339998eb885cd31facb P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 election: Requested vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341)
I20260709 12:26:42.792871  1267 raft_consensus.cc:359] T 70720af8528947a89c03ec468c1235eb P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:42.820145  1267 raft_consensus.cc:385] T 70720af8528947a89c03ec468c1235eb P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:42.820442  1267 raft_consensus.cc:740] T 70720af8528947a89c03ec468c1235eb P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Initialized, Role: FOLLOWER
I20260709 12:26:42.821105  1267 consensus_queue.cc:260] T 70720af8528947a89c03ec468c1235eb P 8fa35514a8d84740b1b46ae496307f20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:42.822011  1146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "284ea666431c4339998eb885cd31facb" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20"
I20260709 12:26:42.823137  1267 ts_tablet_manager.cc:1434] T 70720af8528947a89c03ec468c1235eb P 8fa35514a8d84740b1b46ae496307f20: Time spent starting tablet: real 0.035s	user 0.004s	sys 0.000s
W20260709 12:26:42.824069  1038 leader_election.cc:343] T 284ea666431c4339998eb885cd31facb P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:42.828444  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9793ebdadaa4da18e4e2c2fe6dae825" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
W20260709 12:26:42.829851  1035 leader_election.cc:343] T c9793ebdadaa4da18e4e2c2fe6dae825 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:42.831162  1266 tablet_bootstrap.cc:654] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P aa098a557d34433896712068efd0d9a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:42.834633  1265 tablet_bootstrap.cc:654] T 3a19a87d91404b73bdba7121512bf7aa P 7f9cbe40e40d429aa004e4a7fb42f132: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:42.836153  1264 ts_tablet_manager.cc:1434] T 8c7002e5875a494e8e845023cc05503f P 937efeddef934b2b8bc8632594903085: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 12:26:42.837601  1264 tablet_bootstrap.cc:492] T c9793ebdadaa4da18e4e2c2fe6dae825 P 937efeddef934b2b8bc8632594903085: Bootstrap starting.
I20260709 12:26:42.835390  1323 raft_consensus.cc:515] T c9793ebdadaa4da18e4e2c2fe6dae825 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:42.849589  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9793ebdadaa4da18e4e2c2fe6dae825" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085"
W20260709 12:26:42.851747  1035 leader_election.cc:343] T c9793ebdadaa4da18e4e2c2fe6dae825 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:42.852700  1323 leader_election.cc:290] T c9793ebdadaa4da18e4e2c2fe6dae825 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 election: Requested vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:26:42.854521   997 raft_consensus.cc:2468] T 284ea666431c4339998eb885cd31facb P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f9cbe40e40d429aa004e4a7fb42f132 in term 1.
I20260709 12:26:42.856545  1038 leader_election.cc:304] T 284ea666431c4339998eb885cd31facb P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, aa098a557d34433896712068efd0d9a8; no voters: 8fa35514a8d84740b1b46ae496307f20
I20260709 12:26:42.858821  1264 tablet_bootstrap.cc:654] T c9793ebdadaa4da18e4e2c2fe6dae825 P 937efeddef934b2b8bc8632594903085: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:42.859210  1323 raft_consensus.cc:2804] T 284ea666431c4339998eb885cd31facb P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:42.860064  1323 raft_consensus.cc:697] T 284ea666431c4339998eb885cd31facb P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 LEADER]: Becoming Leader. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Running, Role: LEADER
I20260709 12:26:42.861287  1323 consensus_queue.cc:237] T 284ea666431c4339998eb885cd31facb P 7f9cbe40e40d429aa004e4a7fb42f132 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:42.866205  1266 tablet_bootstrap.cc:492] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P aa098a557d34433896712068efd0d9a8: No bootstrap required, opened a new log
I20260709 12:26:42.866827  1266 ts_tablet_manager.cc:1403] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.066s	user 0.008s	sys 0.004s
I20260709 12:26:42.870054  1266 raft_consensus.cc:359] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:42.870805  1266 raft_consensus.cc:385] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:42.871115  1266 raft_consensus.cc:740] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:42.872846  1266 consensus_queue.cc:260] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:42.873178  1145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b6df135b8494d0d916747b8994b5cf9" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:42.874120  1145 raft_consensus.cc:2468] T 1b6df135b8494d0d916747b8994b5cf9 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 0.
I20260709 12:26:42.874241  1146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9793ebdadaa4da18e4e2c2fe6dae825" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20"
I20260709 12:26:42.874879  1146 raft_consensus.cc:3060] T c9793ebdadaa4da18e4e2c2fe6dae825 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:42.875780  1186 leader_election.cc:304] T 1b6df135b8494d0d916747b8994b5cf9 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085; no voters: 7f9cbe40e40d429aa004e4a7fb42f132
I20260709 12:26:42.877139  1298 raft_consensus.cc:2804] T 1b6df135b8494d0d916747b8994b5cf9 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:42.877529  1298 raft_consensus.cc:493] T 1b6df135b8494d0d916747b8994b5cf9 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:42.877888  1298 raft_consensus.cc:3060] T 1b6df135b8494d0d916747b8994b5cf9 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:42.881498  1266 ts_tablet_manager.cc:1434] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 12:26:42.884344  1266 tablet_bootstrap.cc:492] T 2f2713fe1c7148f0b6d9a69c53ec3515 P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:42.888842  1298 raft_consensus.cc:515] T 1b6df135b8494d0d916747b8994b5cf9 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:42.894852  1072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b6df135b8494d0d916747b8994b5cf9" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
W20260709 12:26:42.897431  1184 leader_election.cc:343] T 1b6df135b8494d0d916747b8994b5cf9 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:42.899149  1267 tablet_bootstrap.cc:492] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 8fa35514a8d84740b1b46ae496307f20: Bootstrap starting.
I20260709 12:26:42.902313  1145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b6df135b8494d0d916747b8994b5cf9" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20"
I20260709 12:26:42.903505  1145 raft_consensus.cc:3060] T 1b6df135b8494d0d916747b8994b5cf9 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:42.904398  1298 leader_election.cc:290] T 1b6df135b8494d0d916747b8994b5cf9 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Requested vote from peers 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679), 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341)
I20260709 12:26:42.906944  1266 tablet_bootstrap.cc:654] T 2f2713fe1c7148f0b6d9a69c53ec3515 P aa098a557d34433896712068efd0d9a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:42.912523  1298 raft_consensus.cc:493] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.913395  1298 raft_consensus.cc:515] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:42.917785  1144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ae9b52b5bd4abf9b47e9e7f86a9519" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:42.919021  1144 raft_consensus.cc:2468] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 0.
I20260709 12:26:42.921533  1186 leader_election.cc:304] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085; no voters: 
I20260709 12:26:42.922685  1327 raft_consensus.cc:2804] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:42.927945  1266 tablet_bootstrap.cc:492] T 2f2713fe1c7148f0b6d9a69c53ec3515 P aa098a557d34433896712068efd0d9a8: No bootstrap required, opened a new log
I20260709 12:26:42.927776  1145 raft_consensus.cc:2468] T 1b6df135b8494d0d916747b8994b5cf9 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 1.
I20260709 12:26:42.928603  1266 ts_tablet_manager.cc:1403] T 2f2713fe1c7148f0b6d9a69c53ec3515 P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.045s	user 0.018s	sys 0.007s
I20260709 12:26:42.929405  1186 leader_election.cc:304] T 1b6df135b8494d0d916747b8994b5cf9 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085; no voters: 7f9cbe40e40d429aa004e4a7fb42f132
I20260709 12:26:42.929571  1265 tablet_bootstrap.cc:492] T 3a19a87d91404b73bdba7121512bf7aa P 7f9cbe40e40d429aa004e4a7fb42f132: No bootstrap required, opened a new log
I20260709 12:26:42.923399  1327 raft_consensus.cc:493] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:42.930998  1265 ts_tablet_manager.cc:1403] T 3a19a87d91404b73bdba7121512bf7aa P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent bootstrapping tablet: real 0.117s	user 0.022s	sys 0.030s
I20260709 12:26:42.925199  1146 raft_consensus.cc:2468] T c9793ebdadaa4da18e4e2c2fe6dae825 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f9cbe40e40d429aa004e4a7fb42f132 in term 1.
I20260709 12:26:42.931799  1327 raft_consensus.cc:3060] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:42.932847  1298 leader_election.cc:290] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:42.932965  1038 leader_election.cc:304] T c9793ebdadaa4da18e4e2c2fe6dae825 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 8fa35514a8d84740b1b46ae496307f20; no voters: 937efeddef934b2b8bc8632594903085
I20260709 12:26:42.934185  1323 raft_consensus.cc:2804] T c9793ebdadaa4da18e4e2c2fe6dae825 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:42.934726  1323 raft_consensus.cc:697] T c9793ebdadaa4da18e4e2c2fe6dae825 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 LEADER]: Becoming Leader. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Running, Role: LEADER
I20260709 12:26:42.939139  1267 tablet_bootstrap.cc:654] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 8fa35514a8d84740b1b46ae496307f20: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:42.936961  1276 raft_consensus.cc:2804] T 1b6df135b8494d0d916747b8994b5cf9 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:42.936839  1323 consensus_queue.cc:237] T c9793ebdadaa4da18e4e2c2fe6dae825 P 7f9cbe40e40d429aa004e4a7fb42f132 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:42.940522  1276 raft_consensus.cc:697] T 1b6df135b8494d0d916747b8994b5cf9 P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Becoming Leader. State: Replica: 937efeddef934b2b8bc8632594903085, State: Running, Role: LEADER
I20260709 12:26:42.941617  1276 consensus_queue.cc:237] T 1b6df135b8494d0d916747b8994b5cf9 P 937efeddef934b2b8bc8632594903085 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:42.942962   995 raft_consensus.cc:3060] T e281f15348944cc1ab51fce7c1653aac P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:42.946063   894 catalog_manager.cc:5697] T 284ea666431c4339998eb885cd31facb P 7f9cbe40e40d429aa004e4a7fb42f132 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130). New cstate: current_term: 1 leader_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:42.949103  1072 raft_consensus.cc:3060] T e12f4bd1b2ed49988317684782c8616b P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:42.943500  1265 raft_consensus.cc:359] T 3a19a87d91404b73bdba7121512bf7aa P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:42.951875  1265 raft_consensus.cc:385] T 3a19a87d91404b73bdba7121512bf7aa P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:42.952492  1265 raft_consensus.cc:740] T 3a19a87d91404b73bdba7121512bf7aa P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Initialized, Role: FOLLOWER
I20260709 12:26:42.953356  1265 consensus_queue.cc:260] T 3a19a87d91404b73bdba7121512bf7aa P 7f9cbe40e40d429aa004e4a7fb42f132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:42.952913  1266 raft_consensus.cc:359] T 2f2713fe1c7148f0b6d9a69c53ec3515 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:42.957496  1266 raft_consensus.cc:385] T 2f2713fe1c7148f0b6d9a69c53ec3515 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:42.957950  1266 raft_consensus.cc:740] T 2f2713fe1c7148f0b6d9a69c53ec3515 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:42.959968  1265 ts_tablet_manager.cc:1434] T 3a19a87d91404b73bdba7121512bf7aa P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 12:26:42.961385  1265 tablet_bootstrap.cc:492] T b8e49440650449f49e5303568f2f19c0 P 7f9cbe40e40d429aa004e4a7fb42f132: Bootstrap starting.
I20260709 12:26:42.960953  1266 consensus_queue.cc:260] T 2f2713fe1c7148f0b6d9a69c53ec3515 P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:42.963976  1266 ts_tablet_manager.cc:1434] T 2f2713fe1c7148f0b6d9a69c53ec3515 P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.002s
I20260709 12:26:42.965807  1266 tablet_bootstrap.cc:492] T 3a19a87d91404b73bdba7121512bf7aa P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:42.970613  1328 raft_consensus.cc:493] T 3a19a87d91404b73bdba7121512bf7aa P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.971468  1328 raft_consensus.cc:515] T 3a19a87d91404b73bdba7121512bf7aa P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:42.973657  1266 tablet_bootstrap.cc:654] T 3a19a87d91404b73bdba7121512bf7aa P aa098a557d34433896712068efd0d9a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:42.975731  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a19a87d91404b73bdba7121512bf7aa" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:42.976521  1220 raft_consensus.cc:2468] T 3a19a87d91404b73bdba7121512bf7aa P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f9cbe40e40d429aa004e4a7fb42f132 in term 0.
I20260709 12:26:42.978442  1035 leader_election.cc:304] T 3a19a87d91404b73bdba7121512bf7aa P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 937efeddef934b2b8bc8632594903085; no voters: 
I20260709 12:26:42.980302  1328 leader_election.cc:290] T 3a19a87d91404b73bdba7121512bf7aa P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:42.981192  1328 raft_consensus.cc:2804] T 3a19a87d91404b73bdba7121512bf7aa P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:42.981804  1328 raft_consensus.cc:493] T 3a19a87d91404b73bdba7121512bf7aa P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:42.982547  1328 raft_consensus.cc:3060] T 3a19a87d91404b73bdba7121512bf7aa P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:42.984094   996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a19a87d91404b73bdba7121512bf7aa" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
I20260709 12:26:42.985684  1317 raft_consensus.cc:493] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:42.986203  1038 leader_election.cc:343] T 3a19a87d91404b73bdba7121512bf7aa P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:42.986193  1317 raft_consensus.cc:515] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:42.990454  1317 leader_election.cc:290] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:42.990643   996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2713fe1c7148f0b6d9a69c53ec3515" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
I20260709 12:26:42.941654   997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ae9b52b5bd4abf9b47e9e7f86a9519" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
I20260709 12:26:42.991498   996 raft_consensus.cc:2468] T 2f2713fe1c7148f0b6d9a69c53ec3515 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 0.
I20260709 12:26:42.995296  1112 leader_election.cc:304] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20, aa098a557d34433896712068efd0d9a8; no voters: 
I20260709 12:26:42.996510  1272 raft_consensus.cc:493] T 70720af8528947a89c03ec468c1235eb P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:42.997061  1272 raft_consensus.cc:515] T 70720af8528947a89c03ec468c1235eb P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:42.999282  1272 leader_election.cc:290] T 70720af8528947a89c03ec468c1235eb P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:26:43.001609  1145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70720af8528947a89c03ec468c1235eb" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
W20260709 12:26:43.005860  1186 leader_election.cc:343] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:43.006837  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70720af8528947a89c03ec468c1235eb" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:43.001844  1317 raft_consensus.cc:2804] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:26:43.014858   960 leader_election.cc:343] T 70720af8528947a89c03ec468c1235eb P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:43.008370  1317 raft_consensus.cc:493] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:43.016139  1317 raft_consensus.cc:3060] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:43.017032  1265 tablet_bootstrap.cc:654] T b8e49440650449f49e5303568f2f19c0 P 7f9cbe40e40d429aa004e4a7fb42f132: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.019526  1276 consensus_queue.cc:1048] T e12f4bd1b2ed49988317684782c8616b P 937efeddef934b2b8bc8632594903085 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:43.020592  1267 tablet_bootstrap.cc:492] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 8fa35514a8d84740b1b46ae496307f20: No bootstrap required, opened a new log
I20260709 12:26:43.020458  1327 raft_consensus.cc:515] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:43.022575  1327 leader_election.cc:290] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Requested vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:43.009631  1145 raft_consensus.cc:2468] T 70720af8528947a89c03ec468c1235eb P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa098a557d34433896712068efd0d9a8 in term 0.
I20260709 12:26:43.025943   894 catalog_manager.cc:5697] T 1b6df135b8494d0d916747b8994b5cf9 P 937efeddef934b2b8bc8632594903085 reported cstate change: term changed from 0 to 1, leader changed from <none> to 937efeddef934b2b8bc8632594903085 (127.23.245.132). New cstate: current_term: 1 leader_uuid: "937efeddef934b2b8bc8632594903085" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:43.027290  1267 ts_tablet_manager.cc:1403] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 8fa35514a8d84740b1b46ae496307f20: Time spent bootstrapping tablet: real 0.128s	user 0.024s	sys 0.026s
I20260709 12:26:43.035127  1264 tablet_bootstrap.cc:492] T c9793ebdadaa4da18e4e2c2fe6dae825 P 937efeddef934b2b8bc8632594903085: No bootstrap required, opened a new log
I20260709 12:26:43.035969  1264 ts_tablet_manager.cc:1403] T c9793ebdadaa4da18e4e2c2fe6dae825 P 937efeddef934b2b8bc8632594903085: Time spent bootstrapping tablet: real 0.199s	user 0.037s	sys 0.016s
I20260709 12:26:43.048628  1145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ae9b52b5bd4abf9b47e9e7f86a9519" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20"
I20260709 12:26:43.051075  1362 raft_consensus.cc:493] T 8c7002e5875a494e8e845023cc05503f P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.036738  1328 raft_consensus.cc:515] T 3a19a87d91404b73bdba7121512bf7aa P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:43.064476  1276 raft_consensus.cc:493] T 8c7002e5875a494e8e845023cc05503f P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.065011  1276 raft_consensus.cc:515] T 8c7002e5875a494e8e845023cc05503f P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:43.066545  1328 leader_election.cc:290] T 3a19a87d91404b73bdba7121512bf7aa P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 election: Requested vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
W20260709 12:26:43.054773  1035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:33909, user_credentials={real_user=slave}} blocked reactor thread for 76479.3us
I20260709 12:26:43.067111  1276 leader_election.cc:290] T 8c7002e5875a494e8e845023cc05503f P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679), 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341)
I20260709 12:26:43.058311   997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ae9b52b5bd4abf9b47e9e7f86a9519" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8"
I20260709 12:26:43.058332  1267 raft_consensus.cc:359] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:43.041865   963 leader_election.cc:304] T 70720af8528947a89c03ec468c1235eb P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20, aa098a557d34433896712068efd0d9a8; no voters: 937efeddef934b2b8bc8632594903085
I20260709 12:26:43.058959  1264 raft_consensus.cc:359] T c9793ebdadaa4da18e4e2c2fe6dae825 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:43.060192  1145 raft_consensus.cc:3060] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:43.063508  1327 consensus_queue.cc:1048] T e12f4bd1b2ed49988317684782c8616b P 937efeddef934b2b8bc8632594903085 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:43.068559  1267 raft_consensus.cc:385] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.069038  1264 raft_consensus.cc:385] T c9793ebdadaa4da18e4e2c2fe6dae825 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.069854  1267 raft_consensus.cc:740] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.069938  1264 raft_consensus.cc:740] T c9793ebdadaa4da18e4e2c2fe6dae825 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 937efeddef934b2b8bc8632594903085, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.070693  1267 consensus_queue.cc:260] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 8fa35514a8d84740b1b46ae496307f20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:43.070945  1264 consensus_queue.cc:260] T c9793ebdadaa4da18e4e2c2fe6dae825 P 937efeddef934b2b8bc8632594903085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:43.073817  1336 raft_consensus.cc:2804] T 70720af8528947a89c03ec468c1235eb P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:43.073647  1070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7002e5875a494e8e845023cc05503f" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:43.074292  1336 raft_consensus.cc:493] T 70720af8528947a89c03ec468c1235eb P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:43.074493  1070 raft_consensus.cc:2468] T 8c7002e5875a494e8e845023cc05503f P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 0.
I20260709 12:26:43.074678  1336 raft_consensus.cc:3060] T 70720af8528947a89c03ec468c1235eb P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:43.074841  1071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2713fe1c7148f0b6d9a69c53ec3515" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:43.075778  1071 raft_consensus.cc:2468] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 0.
I20260709 12:26:43.077216  1184 leader_election.cc:304] T 8c7002e5875a494e8e845023cc05503f P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 937efeddef934b2b8bc8632594903085; no voters: 
I20260709 12:26:43.077952   996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a19a87d91404b73bdba7121512bf7aa" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8"
I20260709 12:26:43.081498  1146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7002e5875a494e8e845023cc05503f" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
W20260709 12:26:43.082335  1038 leader_election.cc:343] T 3a19a87d91404b73bdba7121512bf7aa P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:43.083777  1327 raft_consensus.cc:2804] T 8c7002e5875a494e8e845023cc05503f P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:43.084406  1327 raft_consensus.cc:493] T 8c7002e5875a494e8e845023cc05503f P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:43.084517  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a19a87d91404b73bdba7121512bf7aa" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085"
I20260709 12:26:43.084906  1327 raft_consensus.cc:3060] T 8c7002e5875a494e8e845023cc05503f P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:43.085220  1220 raft_consensus.cc:3060] T 3a19a87d91404b73bdba7121512bf7aa P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:43.087301  1264 ts_tablet_manager.cc:1434] T c9793ebdadaa4da18e4e2c2fe6dae825 P 937efeddef934b2b8bc8632594903085: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.000s
I20260709 12:26:43.088361  1264 tablet_bootstrap.cc:492] T 70720af8528947a89c03ec468c1235eb P 937efeddef934b2b8bc8632594903085: Bootstrap starting.
I20260709 12:26:43.071035  1317 raft_consensus.cc:515] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:43.094334  1336 raft_consensus.cc:515] T 70720af8528947a89c03ec468c1235eb P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:43.095577  1266 tablet_bootstrap.cc:492] T 3a19a87d91404b73bdba7121512bf7aa P aa098a557d34433896712068efd0d9a8: No bootstrap required, opened a new log
I20260709 12:26:43.096215  1272 consensus_queue.cc:1048] T 5b3d71845177478a9e2510c82e0cf9d1 P aa098a557d34433896712068efd0d9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:43.098887  1267 ts_tablet_manager.cc:1434] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 8fa35514a8d84740b1b46ae496307f20: Time spent starting tablet: real 0.069s	user 0.017s	sys 0.014s
I20260709 12:26:43.101560  1265 tablet_bootstrap.cc:492] T b8e49440650449f49e5303568f2f19c0 P 7f9cbe40e40d429aa004e4a7fb42f132: No bootstrap required, opened a new log
I20260709 12:26:43.102025  1265 ts_tablet_manager.cc:1403] T b8e49440650449f49e5303568f2f19c0 P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent bootstrapping tablet: real 0.141s	user 0.014s	sys 0.000s
I20260709 12:26:43.097600  1266 ts_tablet_manager.cc:1403] T 3a19a87d91404b73bdba7121512bf7aa P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.132s	user 0.022s	sys 0.035s
I20260709 12:26:43.111690  1144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70720af8528947a89c03ec468c1235eb" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20"
I20260709 12:26:43.112407  1144 raft_consensus.cc:3060] T 70720af8528947a89c03ec468c1235eb P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:43.114823  1327 raft_consensus.cc:515] T 8c7002e5875a494e8e845023cc05503f P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:43.116662  1266 raft_consensus.cc:359] T 3a19a87d91404b73bdba7121512bf7aa P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:43.117365  1266 raft_consensus.cc:385] T 3a19a87d91404b73bdba7121512bf7aa P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.117645  1266 raft_consensus.cc:740] T 3a19a87d91404b73bdba7121512bf7aa P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.117790  1071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7002e5875a494e8e845023cc05503f" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
I20260709 12:26:43.118391  1071 raft_consensus.cc:3060] T 8c7002e5875a494e8e845023cc05503f P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:43.118371  1266 consensus_queue.cc:260] T 3a19a87d91404b73bdba7121512bf7aa P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:43.123649  1317 leader_election.cc:290] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 election: Requested vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:43.123565  1334 raft_consensus.cc:493] T e281f15348944cc1ab51fce7c1653aac P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8fa35514a8d84740b1b46ae496307f20)
W20260709 12:26:43.107995  1186 leader_election.cc:343] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:43.125648  1334 raft_consensus.cc:515] T e281f15348944cc1ab51fce7c1653aac P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:43.128494  1070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2713fe1c7148f0b6d9a69c53ec3515" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
I20260709 12:26:43.129148  1070 raft_consensus.cc:3060] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:43.129006  1265 raft_consensus.cc:359] T b8e49440650449f49e5303568f2f19c0 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:43.129739  1265 raft_consensus.cc:385] T b8e49440650449f49e5303568f2f19c0 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.130049  1265 raft_consensus.cc:740] T b8e49440650449f49e5303568f2f19c0 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.132261  1272 raft_consensus.cc:493] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.132772  1272 raft_consensus.cc:515] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:43.134043  1265 consensus_queue.cc:260] T b8e49440650449f49e5303568f2f19c0 P 7f9cbe40e40d429aa004e4a7fb42f132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:43.135470  1272 leader_election.cc:290] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679), 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341)
I20260709 12:26:43.110150   996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2713fe1c7148f0b6d9a69c53ec3515" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8"
I20260709 12:26:43.136294  1069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7d578ba2eb41f7a38f15c5dd34b8cb" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:43.140475   996 raft_consensus.cc:3060] T 2f2713fe1c7148f0b6d9a69c53ec3515 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:43.136278  1143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7d578ba2eb41f7a38f15c5dd34b8cb" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
W20260709 12:26:43.142019   963 leader_election.cc:343] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:43.143401   961 leader_election.cc:343] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:43.144063   961 leader_election.cc:304] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa098a557d34433896712068efd0d9a8; no voters: 7f9cbe40e40d429aa004e4a7fb42f132, 8fa35514a8d84740b1b46ae496307f20
I20260709 12:26:43.144420  1264 tablet_bootstrap.cc:654] T 70720af8528947a89c03ec468c1235eb P 937efeddef934b2b8bc8632594903085: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.146431  1272 raft_consensus.cc:2749] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:43.069032  1362 raft_consensus.cc:515] T 8c7002e5875a494e8e845023cc05503f P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:43.144071  1265 ts_tablet_manager.cc:1434] T b8e49440650449f49e5303568f2f19c0 P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.000s
I20260709 12:26:43.157099  1265 tablet_bootstrap.cc:492] T e81f2374d9904e93bf2941ff8b241c09 P 7f9cbe40e40d429aa004e4a7fb42f132: Bootstrap starting.
I20260709 12:26:43.161069  1276 raft_consensus.cc:493] T c9793ebdadaa4da18e4e2c2fe6dae825 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.161645  1276 raft_consensus.cc:515] T c9793ebdadaa4da18e4e2c2fe6dae825 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:43.162387  1145 raft_consensus.cc:2468] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 1.
I20260709 12:26:43.162628  1143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7002e5875a494e8e845023cc05503f" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20"
I20260709 12:26:43.167135  1146 raft_consensus.cc:2468] T 8c7002e5875a494e8e845023cc05503f P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 0.
I20260709 12:26:43.168370  1362 leader_election.cc:290] T 8c7002e5875a494e8e845023cc05503f P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:26:43.169019  1276 leader_election.cc:290] T c9793ebdadaa4da18e4e2c2fe6dae825 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679), 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341)
I20260709 12:26:43.170262  1218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7002e5875a494e8e845023cc05503f" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:43.172737  1068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9793ebdadaa4da18e4e2c2fe6dae825" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:43.174566   996 raft_consensus.cc:2468] T 2f2713fe1c7148f0b6d9a69c53ec3515 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 1.
I20260709 12:26:43.171826  1218 raft_consensus.cc:2393] T 8c7002e5875a494e8e845023cc05503f P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8fa35514a8d84740b1b46ae496307f20 in current term 1: Already voted for candidate 937efeddef934b2b8bc8632594903085 in this term.
I20260709 12:26:43.180670  1336 leader_election.cc:290] T 70720af8528947a89c03ec468c1235eb P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 election: Requested vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:26:43.181573  1186 leader_election.cc:304] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085; no voters: aa098a557d34433896712068efd0d9a8
I20260709 12:26:43.184648  1144 raft_consensus.cc:2468] T 70720af8528947a89c03ec468c1235eb P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa098a557d34433896712068efd0d9a8 in term 1.
I20260709 12:26:43.185909   963 leader_election.cc:304] T 70720af8528947a89c03ec468c1235eb P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20, aa098a557d34433896712068efd0d9a8; no voters: 
I20260709 12:26:43.186812  1336 raft_consensus.cc:2804] T 70720af8528947a89c03ec468c1235eb P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:26:43.186991   961 consensus_peers.cc:597] T 5b3d71845177478a9e2510c82e0cf9d1 P aa098a557d34433896712068efd0d9a8 -> Peer 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679): Couldn't send request to peer 7f9cbe40e40d429aa004e4a7fb42f132. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:43.187333  1336 raft_consensus.cc:697] T 70720af8528947a89c03ec468c1235eb P aa098a557d34433896712068efd0d9a8 [term 1 LEADER]: Becoming Leader. State: Replica: aa098a557d34433896712068efd0d9a8, State: Running, Role: LEADER
I20260709 12:26:43.188232  1068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7002e5875a494e8e845023cc05503f" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:43.188308  1336 consensus_queue.cc:237] T 70720af8528947a89c03ec468c1235eb P aa098a557d34433896712068efd0d9a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:43.189826  1334 leader_election.cc:290] T e281f15348944cc1ab51fce7c1653aac P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:43.190801  1110 leader_election.cc:304] T 8c7002e5875a494e8e845023cc05503f P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20; no voters: 7f9cbe40e40d429aa004e4a7fb42f132, 937efeddef934b2b8bc8632594903085
I20260709 12:26:43.182459  1071 raft_consensus.cc:2468] T 8c7002e5875a494e8e845023cc05503f P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 1.
I20260709 12:26:43.181941   894 catalog_manager.cc:5697] T c9793ebdadaa4da18e4e2c2fe6dae825 P 7f9cbe40e40d429aa004e4a7fb42f132 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130). New cstate: current_term: 1 leader_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:43.183485  1143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9793ebdadaa4da18e4e2c2fe6dae825" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:43.180361  1327 leader_election.cc:290] T 8c7002e5875a494e8e845023cc05503f P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Requested vote from peers 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679), 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341)
I20260709 12:26:43.209578  1146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e281f15348944cc1ab51fce7c1653aac" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:43.205397  1362 raft_consensus.cc:3060] T 8c7002e5875a494e8e845023cc05503f P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:43.213558  1267 tablet_bootstrap.cc:492] T 284ea666431c4339998eb885cd31facb P 8fa35514a8d84740b1b46ae496307f20: Bootstrap starting.
I20260709 12:26:43.206748  1276 raft_consensus.cc:2804] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:43.221598  1068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e281f15348944cc1ab51fce7c1653aac" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:43.226223  1266 ts_tablet_manager.cc:1434] T 3a19a87d91404b73bdba7121512bf7aa P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.123s	user 0.010s	sys 0.016s
I20260709 12:26:43.222944  1143 raft_consensus.cc:2393] T c9793ebdadaa4da18e4e2c2fe6dae825 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 937efeddef934b2b8bc8632594903085 in current term 1: Already voted for candidate 7f9cbe40e40d429aa004e4a7fb42f132 in this term.
I20260709 12:26:43.228422  1266 tablet_bootstrap.cc:492] T e81f2374d9904e93bf2941ff8b241c09 P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:43.234582  1112 leader_election.cc:304] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20, aa098a557d34433896712068efd0d9a8; no voters: 
I20260709 12:26:43.235631  1317 raft_consensus.cc:2804] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:43.236027  1266 tablet_bootstrap.cc:654] T e81f2374d9904e93bf2941ff8b241c09 P aa098a557d34433896712068efd0d9a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.236210  1317 raft_consensus.cc:697] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 8fa35514a8d84740b1b46ae496307f20 [term 1 LEADER]: Becoming Leader. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Running, Role: LEADER
I20260709 12:26:43.247112  1276 raft_consensus.cc:697] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Becoming Leader. State: Replica: 937efeddef934b2b8bc8632594903085, State: Running, Role: LEADER
I20260709 12:26:43.248308  1276 consensus_queue.cc:237] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P 937efeddef934b2b8bc8632594903085 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:43.248893  1365 raft_consensus.cc:493] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.249429  1365 raft_consensus.cc:515] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:43.225719  1184 leader_election.cc:304] T 8c7002e5875a494e8e845023cc05503f P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 937efeddef934b2b8bc8632594903085; no voters: 
I20260709 12:26:43.254097  1298 raft_consensus.cc:2804] T 8c7002e5875a494e8e845023cc05503f P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:43.238641  1070 raft_consensus.cc:2468] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 1.
I20260709 12:26:43.260859   961 leader_election.cc:304] T e281f15348944cc1ab51fce7c1653aac P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa098a557d34433896712068efd0d9a8; no voters: 7f9cbe40e40d429aa004e4a7fb42f132, 8fa35514a8d84740b1b46ae496307f20
I20260709 12:26:43.262290  1369 raft_consensus.cc:2749] T e281f15348944cc1ab51fce7c1653aac P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:43.262207  1186 leader_election.cc:304] T c9793ebdadaa4da18e4e2c2fe6dae825 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 937efeddef934b2b8bc8632594903085; no voters: 7f9cbe40e40d429aa004e4a7fb42f132, 8fa35514a8d84740b1b46ae496307f20
I20260709 12:26:43.268811  1317 consensus_queue.cc:237] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:43.257787  1362 raft_consensus.cc:2749] T 8c7002e5875a494e8e845023cc05503f P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:43.274246  1327 raft_consensus.cc:3060] T c9793ebdadaa4da18e4e2c2fe6dae825 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:43.272578   895 catalog_manager.cc:5697] T 70720af8528947a89c03ec468c1235eb P aa098a557d34433896712068efd0d9a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to aa098a557d34433896712068efd0d9a8 (127.23.245.129). New cstate: current_term: 1 leader_uuid: "aa098a557d34433896712068efd0d9a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:43.267439  1369 raft_consensus.cc:493] T 3a19a87d91404b73bdba7121512bf7aa P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.267992  1218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70720af8528947a89c03ec468c1235eb" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085"
I20260709 12:26:43.280494  1264 tablet_bootstrap.cc:492] T 70720af8528947a89c03ec468c1235eb P 937efeddef934b2b8bc8632594903085: No bootstrap required, opened a new log
I20260709 12:26:43.280999  1264 ts_tablet_manager.cc:1403] T 70720af8528947a89c03ec468c1235eb P 937efeddef934b2b8bc8632594903085: Time spent bootstrapping tablet: real 0.193s	user 0.016s	sys 0.022s
W20260709 12:26:43.283392   960 leader_election.cc:343] T 70720af8528947a89c03ec468c1235eb P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:43.284910  1365 leader_election.cc:290] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:43.279600  1298 raft_consensus.cc:697] T 8c7002e5875a494e8e845023cc05503f P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Becoming Leader. State: Replica: 937efeddef934b2b8bc8632594903085, State: Running, Role: LEADER
I20260709 12:26:43.287082  1298 consensus_queue.cc:237] T 8c7002e5875a494e8e845023cc05503f P 937efeddef934b2b8bc8632594903085 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:43.294744  1266 tablet_bootstrap.cc:492] T e81f2374d9904e93bf2941ff8b241c09 P aa098a557d34433896712068efd0d9a8: No bootstrap required, opened a new log
W20260709 12:26:43.294961  1038 consensus_peers.cc:597] T 284ea666431c4339998eb885cd31facb P 7f9cbe40e40d429aa004e4a7fb42f132 -> Peer 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341): Couldn't send request to peer 8fa35514a8d84740b1b46ae496307f20. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:43.295325  1266 ts_tablet_manager.cc:1403] T e81f2374d9904e93bf2941ff8b241c09 P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.068s	user 0.013s	sys 0.003s
I20260709 12:26:43.280159  1220 raft_consensus.cc:2468] T 3a19a87d91404b73bdba7121512bf7aa P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f9cbe40e40d429aa004e4a7fb42f132 in term 1.
I20260709 12:26:43.299225  1265 tablet_bootstrap.cc:654] T e81f2374d9904e93bf2941ff8b241c09 P 7f9cbe40e40d429aa004e4a7fb42f132: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.299978  1035 leader_election.cc:304] T 3a19a87d91404b73bdba7121512bf7aa P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 937efeddef934b2b8bc8632594903085; no voters: aa098a557d34433896712068efd0d9a8
I20260709 12:26:43.301270  1328 raft_consensus.cc:2804] T 3a19a87d91404b73bdba7121512bf7aa P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:43.301777  1328 raft_consensus.cc:697] T 3a19a87d91404b73bdba7121512bf7aa P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 LEADER]: Becoming Leader. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Running, Role: LEADER
I20260709 12:26:43.302618  1328 consensus_queue.cc:237] T 3a19a87d91404b73bdba7121512bf7aa P 7f9cbe40e40d429aa004e4a7fb42f132 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:43.304862   997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e22afc1ef634aaabf17a4e5a3bf0be3" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
W20260709 12:26:43.306231  1112 leader_election.cc:343] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:43.280259  1369 raft_consensus.cc:515] T 3a19a87d91404b73bdba7121512bf7aa P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:43.308447  1369 leader_election.cc:290] T 3a19a87d91404b73bdba7121512bf7aa P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:43.310178  1070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a19a87d91404b73bdba7121512bf7aa" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:43.311159  1264 raft_consensus.cc:359] T 70720af8528947a89c03ec468c1235eb P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:43.296300  1218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e22afc1ef634aaabf17a4e5a3bf0be3" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:43.311888  1264 raft_consensus.cc:385] T 70720af8528947a89c03ec468c1235eb P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.314595  1264 raft_consensus.cc:740] T 70720af8528947a89c03ec468c1235eb P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 937efeddef934b2b8bc8632594903085, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.315220  1264 consensus_queue.cc:260] T 70720af8528947a89c03ec468c1235eb P 937efeddef934b2b8bc8632594903085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
W20260709 12:26:43.313091  1109 leader_election.cc:343] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:43.320640  1109 leader_election.cc:304] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20; no voters: 937efeddef934b2b8bc8632594903085, aa098a557d34433896712068efd0d9a8
I20260709 12:26:43.313472  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a19a87d91404b73bdba7121512bf7aa" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:43.323570  1220 raft_consensus.cc:2393] T 3a19a87d91404b73bdba7121512bf7aa P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aa098a557d34433896712068efd0d9a8 in current term 1: Already voted for candidate 7f9cbe40e40d429aa004e4a7fb42f132 in this term.
I20260709 12:26:43.325315   960 leader_election.cc:304] T 3a19a87d91404b73bdba7121512bf7aa P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa098a557d34433896712068efd0d9a8; no voters: 7f9cbe40e40d429aa004e4a7fb42f132, 937efeddef934b2b8bc8632594903085
I20260709 12:26:43.327543  1371 raft_consensus.cc:3060] T 3a19a87d91404b73bdba7121512bf7aa P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:43.330257  1327 raft_consensus.cc:2749] T c9793ebdadaa4da18e4e2c2fe6dae825 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:43.331739  1264 ts_tablet_manager.cc:1434] T 70720af8528947a89c03ec468c1235eb P 937efeddef934b2b8bc8632594903085: Time spent starting tablet: real 0.051s	user 0.004s	sys 0.003s
I20260709 12:26:43.333465  1264 tablet_bootstrap.cc:492] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 937efeddef934b2b8bc8632594903085: Bootstrap starting.
I20260709 12:26:43.333894  1365 raft_consensus.cc:2749] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:43.336643  1267 tablet_bootstrap.cc:654] T 284ea666431c4339998eb885cd31facb P 8fa35514a8d84740b1b46ae496307f20: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.337587  1266 raft_consensus.cc:359] T e81f2374d9904e93bf2941ff8b241c09 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:43.341197  1266 raft_consensus.cc:385] T e81f2374d9904e93bf2941ff8b241c09 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.341552  1266 raft_consensus.cc:740] T e81f2374d9904e93bf2941ff8b241c09 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.344658  1266 consensus_queue.cc:260] T e81f2374d9904e93bf2941ff8b241c09 P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:43.358083  1264 tablet_bootstrap.cc:654] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 937efeddef934b2b8bc8632594903085: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.363076  1265 tablet_bootstrap.cc:492] T e81f2374d9904e93bf2941ff8b241c09 P 7f9cbe40e40d429aa004e4a7fb42f132: No bootstrap required, opened a new log
I20260709 12:26:43.363533  1265 ts_tablet_manager.cc:1403] T e81f2374d9904e93bf2941ff8b241c09 P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent bootstrapping tablet: real 0.207s	user 0.017s	sys 0.000s
I20260709 12:26:43.376732  1266 ts_tablet_manager.cc:1434] T e81f2374d9904e93bf2941ff8b241c09 P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.081s	user 0.005s	sys 0.005s
I20260709 12:26:43.381731  1266 tablet_bootstrap.cc:492] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:43.386715  1265 raft_consensus.cc:359] T e81f2374d9904e93bf2941ff8b241c09 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:43.389302  1265 raft_consensus.cc:385] T e81f2374d9904e93bf2941ff8b241c09 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.389575  1265 raft_consensus.cc:740] T e81f2374d9904e93bf2941ff8b241c09 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.390381  1265 consensus_queue.cc:260] T e81f2374d9904e93bf2941ff8b241c09 P 7f9cbe40e40d429aa004e4a7fb42f132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:43.386932  1371 raft_consensus.cc:2749] T 3a19a87d91404b73bdba7121512bf7aa P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:43.393203  1265 ts_tablet_manager.cc:1434] T e81f2374d9904e93bf2941ff8b241c09 P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.000s
I20260709 12:26:43.394222  1265 tablet_bootstrap.cc:492] T 1b6df135b8494d0d916747b8994b5cf9 P 7f9cbe40e40d429aa004e4a7fb42f132: Bootstrap starting.
I20260709 12:26:43.396874  1266 tablet_bootstrap.cc:654] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P aa098a557d34433896712068efd0d9a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.400079  1265 tablet_bootstrap.cc:654] T 1b6df135b8494d0d916747b8994b5cf9 P 7f9cbe40e40d429aa004e4a7fb42f132: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.401412  1264 tablet_bootstrap.cc:492] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 937efeddef934b2b8bc8632594903085: No bootstrap required, opened a new log
I20260709 12:26:43.402184  1264 ts_tablet_manager.cc:1403] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 937efeddef934b2b8bc8632594903085: Time spent bootstrapping tablet: real 0.069s	user 0.016s	sys 0.015s
I20260709 12:26:43.408475  1266 tablet_bootstrap.cc:492] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P aa098a557d34433896712068efd0d9a8: No bootstrap required, opened a new log
I20260709 12:26:43.409025  1266 ts_tablet_manager.cc:1403] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.006s
I20260709 12:26:43.410285  1371 raft_consensus.cc:493] T e81f2374d9904e93bf2941ff8b241c09 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.410140  1264 raft_consensus.cc:359] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:43.410774  1371 raft_consensus.cc:515] T e81f2374d9904e93bf2941ff8b241c09 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:43.417198  1264 raft_consensus.cc:385] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.417569   895 catalog_manager.cc:5697] T 3a19a87d91404b73bdba7121512bf7aa P 7f9cbe40e40d429aa004e4a7fb42f132 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130). New cstate: current_term: 1 leader_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:43.418866  1371 leader_election.cc:290] T e81f2374d9904e93bf2941ff8b241c09 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:43.419128  1267 tablet_bootstrap.cc:492] T 284ea666431c4339998eb885cd31facb P 8fa35514a8d84740b1b46ae496307f20: No bootstrap required, opened a new log
I20260709 12:26:43.419598  1267 ts_tablet_manager.cc:1403] T 284ea666431c4339998eb885cd31facb P 8fa35514a8d84740b1b46ae496307f20: Time spent bootstrapping tablet: real 0.206s	user 0.004s	sys 0.016s
I20260709 12:26:43.421785  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81f2374d9904e93bf2941ff8b241c09" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
W20260709 12:26:43.423704   960 leader_election.cc:343] T e81f2374d9904e93bf2941ff8b241c09 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:43.424564  1070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81f2374d9904e93bf2941ff8b241c09" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:43.413245   893 catalog_manager.cc:5697] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 8fa35514a8d84740b1b46ae496307f20 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131). New cstate: current_term: 1 leader_uuid: "8fa35514a8d84740b1b46ae496307f20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:43.425211   892 catalog_manager.cc:5697] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P 937efeddef934b2b8bc8632594903085 reported cstate change: term changed from 0 to 1, leader changed from <none> to 937efeddef934b2b8bc8632594903085 (127.23.245.132). New cstate: current_term: 1 leader_uuid: "937efeddef934b2b8bc8632594903085" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:43.426556  1267 raft_consensus.cc:359] T 284ea666431c4339998eb885cd31facb P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:43.427438  1267 raft_consensus.cc:385] T 284ea666431c4339998eb885cd31facb P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.417574  1264 raft_consensus.cc:740] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 937efeddef934b2b8bc8632594903085, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.428650  1264 consensus_queue.cc:260] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 937efeddef934b2b8bc8632594903085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:43.427762  1267 raft_consensus.cc:740] T 284ea666431c4339998eb885cd31facb P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Initialized, Role: FOLLOWER
W20260709 12:26:43.415206  1184 consensus_peers.cc:597] T 1b6df135b8494d0d916747b8994b5cf9 P 937efeddef934b2b8bc8632594903085 -> Peer 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679): Couldn't send request to peer 7f9cbe40e40d429aa004e4a7fb42f132. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:43.430135  1267 consensus_queue.cc:260] T 284ea666431c4339998eb885cd31facb P 8fa35514a8d84740b1b46ae496307f20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:43.432051  1264 ts_tablet_manager.cc:1434] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 937efeddef934b2b8bc8632594903085: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 12:26:43.425256  1070 raft_consensus.cc:2468] T e81f2374d9904e93bf2941ff8b241c09 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa098a557d34433896712068efd0d9a8 in term 0.
I20260709 12:26:43.433065  1264 tablet_bootstrap.cc:492] T 580f367489064e218eef65b4654744b8 P 937efeddef934b2b8bc8632594903085: Bootstrap starting.
I20260709 12:26:43.434406   961 leader_election.cc:304] T e81f2374d9904e93bf2941ff8b241c09 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, aa098a557d34433896712068efd0d9a8; no voters: 937efeddef934b2b8bc8632594903085
I20260709 12:26:43.437506  1267 ts_tablet_manager.cc:1434] T 284ea666431c4339998eb885cd31facb P 8fa35514a8d84740b1b46ae496307f20: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 12:26:43.437178   892 catalog_manager.cc:5697] T 8c7002e5875a494e8e845023cc05503f P 937efeddef934b2b8bc8632594903085 reported cstate change: term changed from 0 to 1, leader changed from <none> to 937efeddef934b2b8bc8632594903085 (127.23.245.132). New cstate: current_term: 1 leader_uuid: "937efeddef934b2b8bc8632594903085" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:43.437551  1328 raft_consensus.cc:493] T b8e49440650449f49e5303568f2f19c0 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.440146  1328 raft_consensus.cc:515] T b8e49440650449f49e5303568f2f19c0 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:43.442441  1328 leader_election.cc:290] T b8e49440650449f49e5303568f2f19c0 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:26:43.438670  1267 tablet_bootstrap.cc:492] T c4234c6cf75048c5a6cdf34e43c9bd1e P 8fa35514a8d84740b1b46ae496307f20: Bootstrap starting.
I20260709 12:26:43.448820  1143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e49440650449f49e5303568f2f19c0" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:43.454178  1371 raft_consensus.cc:2804] T e81f2374d9904e93bf2941ff8b241c09 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:43.454674  1371 raft_consensus.cc:493] T e81f2374d9904e93bf2941ff8b241c09 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:43.455057  1371 raft_consensus.cc:3060] T e81f2374d9904e93bf2941ff8b241c09 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:43.457643  1265 tablet_bootstrap.cc:492] T 1b6df135b8494d0d916747b8994b5cf9 P 7f9cbe40e40d429aa004e4a7fb42f132: No bootstrap required, opened a new log
I20260709 12:26:43.457966  1264 tablet_bootstrap.cc:654] T 580f367489064e218eef65b4654744b8 P 937efeddef934b2b8bc8632594903085: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.458302  1265 ts_tablet_manager.cc:1403] T 1b6df135b8494d0d916747b8994b5cf9 P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent bootstrapping tablet: real 0.064s	user 0.009s	sys 0.045s
I20260709 12:26:43.461228  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e49440650449f49e5303568f2f19c0" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
W20260709 12:26:43.462800  1035 leader_election.cc:343] T b8e49440650449f49e5303568f2f19c0 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:43.464133  1371 raft_consensus.cc:515] T e81f2374d9904e93bf2941ff8b241c09 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:43.463496  1265 raft_consensus.cc:359] T 1b6df135b8494d0d916747b8994b5cf9 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:43.466387  1265 raft_consensus.cc:385] T 1b6df135b8494d0d916747b8994b5cf9 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.461136  1266 raft_consensus.cc:359] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:43.465956  1267 tablet_bootstrap.cc:654] T c4234c6cf75048c5a6cdf34e43c9bd1e P 8fa35514a8d84740b1b46ae496307f20: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.467355  1266 raft_consensus.cc:385] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.467549  1070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81f2374d9904e93bf2941ff8b241c09" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
I20260709 12:26:43.467731  1266 raft_consensus.cc:740] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.468222  1070 raft_consensus.cc:3060] T e81f2374d9904e93bf2941ff8b241c09 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:43.466982  1265 raft_consensus.cc:740] T 1b6df135b8494d0d916747b8994b5cf9 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.468664  1266 consensus_queue.cc:260] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:43.469378  1265 consensus_queue.cc:260] T 1b6df135b8494d0d916747b8994b5cf9 P 7f9cbe40e40d429aa004e4a7fb42f132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:43.473855  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81f2374d9904e93bf2941ff8b241c09" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085"
I20260709 12:26:43.475368  1265 ts_tablet_manager.cc:1434] T 1b6df135b8494d0d916747b8994b5cf9 P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:26:43.476254  1266 ts_tablet_manager.cc:1434] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.061s	user 0.007s	sys 0.000s
W20260709 12:26:43.475456   960 leader_election.cc:343] T e81f2374d9904e93bf2941ff8b241c09 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:43.477149  1265 tablet_bootstrap.cc:492] T 5b3d71845177478a9e2510c82e0cf9d1 P 7f9cbe40e40d429aa004e4a7fb42f132: Bootstrap starting.
I20260709 12:26:43.477677  1371 leader_election.cc:290] T e81f2374d9904e93bf2941ff8b241c09 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 election: Requested vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:43.477224  1266 tablet_bootstrap.cc:492] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:43.479084  1359 consensus_queue.cc:1048] T c9793ebdadaa4da18e4e2c2fe6dae825 P 7f9cbe40e40d429aa004e4a7fb42f132 [LEADER]: Connected to new peer: Peer: permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:43.484369  1266 tablet_bootstrap.cc:654] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P aa098a557d34433896712068efd0d9a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.489492  1267 tablet_bootstrap.cc:492] T c4234c6cf75048c5a6cdf34e43c9bd1e P 8fa35514a8d84740b1b46ae496307f20: No bootstrap required, opened a new log
I20260709 12:26:43.490091  1267 ts_tablet_manager.cc:1403] T c4234c6cf75048c5a6cdf34e43c9bd1e P 8fa35514a8d84740b1b46ae496307f20: Time spent bootstrapping tablet: real 0.052s	user 0.014s	sys 0.004s
I20260709 12:26:43.490406  1265 tablet_bootstrap.cc:654] T 5b3d71845177478a9e2510c82e0cf9d1 P 7f9cbe40e40d429aa004e4a7fb42f132: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.492861  1267 raft_consensus.cc:359] T c4234c6cf75048c5a6cdf34e43c9bd1e P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:43.493536  1267 raft_consensus.cc:385] T c4234c6cf75048c5a6cdf34e43c9bd1e P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.493811  1267 raft_consensus.cc:740] T c4234c6cf75048c5a6cdf34e43c9bd1e P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Initialized, Role: FOLLOWER
W20260709 12:26:43.463603  1038 leader_election.cc:343] T b8e49440650449f49e5303568f2f19c0 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:43.494446  1038 leader_election.cc:304] T b8e49440650449f49e5303568f2f19c0 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132; no voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085
I20260709 12:26:43.494479  1267 consensus_queue.cc:260] T c4234c6cf75048c5a6cdf34e43c9bd1e P 8fa35514a8d84740b1b46ae496307f20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:43.496121  1320 raft_consensus.cc:2749] T b8e49440650449f49e5303568f2f19c0 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:43.496285  1359 consensus_queue.cc:1048] T 284ea666431c4339998eb885cd31facb P 7f9cbe40e40d429aa004e4a7fb42f132 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:43.497048  1267 ts_tablet_manager.cc:1434] T c4234c6cf75048c5a6cdf34e43c9bd1e P 8fa35514a8d84740b1b46ae496307f20: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:26:43.498019  1267 tablet_bootstrap.cc:492] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P 8fa35514a8d84740b1b46ae496307f20: Bootstrap starting.
I20260709 12:26:43.510891  1328 consensus_queue.cc:1048] T c9793ebdadaa4da18e4e2c2fe6dae825 P 7f9cbe40e40d429aa004e4a7fb42f132 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:43.512442  1267 tablet_bootstrap.cc:654] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P 8fa35514a8d84740b1b46ae496307f20: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.514540  1070 raft_consensus.cc:2468] T e81f2374d9904e93bf2941ff8b241c09 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa098a557d34433896712068efd0d9a8 in term 1.
I20260709 12:26:43.517686   961 leader_election.cc:304] T e81f2374d9904e93bf2941ff8b241c09 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, aa098a557d34433896712068efd0d9a8; no voters: 937efeddef934b2b8bc8632594903085
I20260709 12:26:43.519603  1371 raft_consensus.cc:2804] T e81f2374d9904e93bf2941ff8b241c09 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:43.520149  1371 raft_consensus.cc:697] T e81f2374d9904e93bf2941ff8b241c09 P aa098a557d34433896712068efd0d9a8 [term 1 LEADER]: Becoming Leader. State: Replica: aa098a557d34433896712068efd0d9a8, State: Running, Role: LEADER
I20260709 12:26:43.520977  1371 consensus_queue.cc:237] T e81f2374d9904e93bf2941ff8b241c09 P aa098a557d34433896712068efd0d9a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:43.530704  1266 tablet_bootstrap.cc:492] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P aa098a557d34433896712068efd0d9a8: No bootstrap required, opened a new log
I20260709 12:26:43.531363  1266 ts_tablet_manager.cc:1403] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.054s	user 0.013s	sys 0.004s
I20260709 12:26:43.532692  1265 tablet_bootstrap.cc:492] T 5b3d71845177478a9e2510c82e0cf9d1 P 7f9cbe40e40d429aa004e4a7fb42f132: No bootstrap required, opened a new log
I20260709 12:26:43.533193  1265 ts_tablet_manager.cc:1403] T 5b3d71845177478a9e2510c82e0cf9d1 P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent bootstrapping tablet: real 0.056s	user 0.014s	sys 0.025s
I20260709 12:26:43.541765  1327 consensus_queue.cc:1048] T 1b6df135b8494d0d916747b8994b5cf9 P 937efeddef934b2b8bc8632594903085 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:43.544323  1265 raft_consensus.cc:359] T 5b3d71845177478a9e2510c82e0cf9d1 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:43.545081  1265 raft_consensus.cc:385] T 5b3d71845177478a9e2510c82e0cf9d1 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.545421  1265 raft_consensus.cc:740] T 5b3d71845177478a9e2510c82e0cf9d1 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.546168  1265 consensus_queue.cc:260] T 5b3d71845177478a9e2510c82e0cf9d1 P 7f9cbe40e40d429aa004e4a7fb42f132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:43.549263  1264 tablet_bootstrap.cc:492] T 580f367489064e218eef65b4654744b8 P 937efeddef934b2b8bc8632594903085: No bootstrap required, opened a new log
I20260709 12:26:43.549968  1264 ts_tablet_manager.cc:1403] T 580f367489064e218eef65b4654744b8 P 937efeddef934b2b8bc8632594903085: Time spent bootstrapping tablet: real 0.117s	user 0.030s	sys 0.035s
I20260709 12:26:43.553036  1265 ts_tablet_manager.cc:1434] T 5b3d71845177478a9e2510c82e0cf9d1 P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 12:26:43.554315  1265 tablet_bootstrap.cc:492] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P 7f9cbe40e40d429aa004e4a7fb42f132: Bootstrap starting.
I20260709 12:26:43.562206  1264 raft_consensus.cc:359] T 580f367489064e218eef65b4654744b8 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:43.564229  1264 raft_consensus.cc:385] T 580f367489064e218eef65b4654744b8 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.564495  1264 raft_consensus.cc:740] T 580f367489064e218eef65b4654744b8 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 937efeddef934b2b8bc8632594903085, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.565186  1264 consensus_queue.cc:260] T 580f367489064e218eef65b4654744b8 P 937efeddef934b2b8bc8632594903085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:43.567716  1264 ts_tablet_manager.cc:1434] T 580f367489064e218eef65b4654744b8 P 937efeddef934b2b8bc8632594903085: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.003s
I20260709 12:26:43.568707  1264 tablet_bootstrap.cc:492] T e81f2374d9904e93bf2941ff8b241c09 P 937efeddef934b2b8bc8632594903085: Bootstrap starting.
I20260709 12:26:43.569535  1323 raft_consensus.cc:493] T 1b6df135b8494d0d916747b8994b5cf9 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.569723  1266 raft_consensus.cc:359] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:43.570997  1266 raft_consensus.cc:385] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.572016  1266 raft_consensus.cc:740] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.577705  1266 consensus_queue.cc:260] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:43.578562  1323 raft_consensus.cc:515] T 1b6df135b8494d0d916747b8994b5cf9 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:43.588743  1323 leader_election.cc:290] T 1b6df135b8494d0d916747b8994b5cf9 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:26:43.590425  1219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b6df135b8494d0d916747b8994b5cf9" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:43.590899  1265 tablet_bootstrap.cc:654] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P 7f9cbe40e40d429aa004e4a7fb42f132: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.591948  1144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b6df135b8494d0d916747b8994b5cf9" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:43.592906  1266 ts_tablet_manager.cc:1434] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.050s	user 0.009s	sys 0.000s
I20260709 12:26:43.596432  1266 tablet_bootstrap.cc:492] T e5af913e96004f3b8cac5fbe6ac655ac P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:43.596297  1035 leader_election.cc:304] T 1b6df135b8494d0d916747b8994b5cf9 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132; no voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085
I20260709 12:26:43.598318  1328 raft_consensus.cc:2749] T 1b6df135b8494d0d916747b8994b5cf9 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:26:43.590461  1391 log.cc:927] Time spent T c9793ebdadaa4da18e4e2c2fe6dae825 P 8fa35514a8d84740b1b46ae496307f20: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:26:43.602268  1264 tablet_bootstrap.cc:654] T e81f2374d9904e93bf2941ff8b241c09 P 937efeddef934b2b8bc8632594903085: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.617122  1267 tablet_bootstrap.cc:492] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P 8fa35514a8d84740b1b46ae496307f20: No bootstrap required, opened a new log
I20260709 12:26:43.617645  1267 ts_tablet_manager.cc:1403] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P 8fa35514a8d84740b1b46ae496307f20: Time spent bootstrapping tablet: real 0.120s	user 0.020s	sys 0.000s
I20260709 12:26:43.620420  1267 raft_consensus.cc:359] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:43.621140  1267 raft_consensus.cc:385] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.621426  1267 raft_consensus.cc:740] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.622423  1266 tablet_bootstrap.cc:654] T e5af913e96004f3b8cac5fbe6ac655ac P aa098a557d34433896712068efd0d9a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.622223  1267 consensus_queue.cc:260] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P 8fa35514a8d84740b1b46ae496307f20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:43.624305  1371 raft_consensus.cc:493] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.629758  1371 raft_consensus.cc:515] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:43.631197  1267 ts_tablet_manager.cc:1434] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P 8fa35514a8d84740b1b46ae496307f20: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:26:43.632872  1143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ae9b52b5bd4abf9b47e9e7f86a9519" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:43.634116  1220 raft_consensus.cc:3060] T 70720af8528947a89c03ec468c1235eb P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:43.640354  1143 raft_consensus.cc:2393] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aa098a557d34433896712068efd0d9a8 in current term 1: Already voted for candidate 937efeddef934b2b8bc8632594903085 in this term.
I20260709 12:26:43.643365  1265 tablet_bootstrap.cc:492] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P 7f9cbe40e40d429aa004e4a7fb42f132: No bootstrap required, opened a new log
I20260709 12:26:43.643949  1265 ts_tablet_manager.cc:1403] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent bootstrapping tablet: real 0.090s	user 0.014s	sys 0.014s
I20260709 12:26:43.644549  1371 leader_election.cc:290] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:26:43.645685  1219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2ae9b52b5bd4abf9b47e9e7f86a9519" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:43.634296  1267 tablet_bootstrap.cc:492] T e5af913e96004f3b8cac5fbe6ac655ac P 8fa35514a8d84740b1b46ae496307f20: Bootstrap starting.
I20260709 12:26:43.646584  1265 raft_consensus.cc:359] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:43.647320  1265 raft_consensus.cc:385] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.647292  1276 raft_consensus.cc:493] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.648126   960 leader_election.cc:304] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa098a557d34433896712068efd0d9a8; no voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085
I20260709 12:26:43.618742   894 catalog_manager.cc:5697] T e81f2374d9904e93bf2941ff8b241c09 P aa098a557d34433896712068efd0d9a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to aa098a557d34433896712068efd0d9a8 (127.23.245.129). New cstate: current_term: 1 leader_uuid: "aa098a557d34433896712068efd0d9a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:43.650080  1336 raft_consensus.cc:3060] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:43.660043  1266 tablet_bootstrap.cc:492] T e5af913e96004f3b8cac5fbe6ac655ac P aa098a557d34433896712068efd0d9a8: No bootstrap required, opened a new log
I20260709 12:26:43.660562  1266 ts_tablet_manager.cc:1403] T e5af913e96004f3b8cac5fbe6ac655ac P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.064s	user 0.007s	sys 0.007s
I20260709 12:26:43.650511  1371 consensus_queue.cc:1048] T 70720af8528947a89c03ec468c1235eb P aa098a557d34433896712068efd0d9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:43.648070  1276 raft_consensus.cc:515] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:43.663756  1276 leader_election.cc:290] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:43.665220  1266 raft_consensus.cc:359] T e5af913e96004f3b8cac5fbe6ac655ac P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:43.665858  1336 raft_consensus.cc:2749] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:43.666097  1266 raft_consensus.cc:385] T e5af913e96004f3b8cac5fbe6ac655ac P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.652488  1265 raft_consensus.cc:740] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.667230  1265 consensus_queue.cc:260] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P 7f9cbe40e40d429aa004e4a7fb42f132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:43.668133  1264 tablet_bootstrap.cc:492] T e81f2374d9904e93bf2941ff8b241c09 P 937efeddef934b2b8bc8632594903085: No bootstrap required, opened a new log
I20260709 12:26:43.668027   997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e22afc1ef634aaabf17a4e5a3bf0be3" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
I20260709 12:26:43.668659  1264 ts_tablet_manager.cc:1403] T e81f2374d9904e93bf2941ff8b241c09 P 937efeddef934b2b8bc8632594903085: Time spent bootstrapping tablet: real 0.100s	user 0.010s	sys 0.002s
I20260709 12:26:43.668761   997 raft_consensus.cc:2468] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 0.
I20260709 12:26:43.669727  1265 ts_tablet_manager.cc:1434] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 12:26:43.666407  1266 raft_consensus.cc:740] T e5af913e96004f3b8cac5fbe6ac655ac P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.669734  1362 raft_consensus.cc:493] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.670445  1362 raft_consensus.cc:515] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:43.670929  1265 tablet_bootstrap.cc:492] T acc6ab0dce1640e380b433b32a874108 P 7f9cbe40e40d429aa004e4a7fb42f132: Bootstrap starting.
I20260709 12:26:43.668134  1143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e22afc1ef634aaabf17a4e5a3bf0be3" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:43.671294  1186 leader_election.cc:304] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 937efeddef934b2b8bc8632594903085, aa098a557d34433896712068efd0d9a8; no voters: 
I20260709 12:26:43.671463  1143 raft_consensus.cc:2468] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 0.
I20260709 12:26:43.672271  1276 raft_consensus.cc:2804] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:43.672660  1362 leader_election.cc:290] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:43.672672  1276 raft_consensus.cc:493] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:43.673563  1276 raft_consensus.cc:3060] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:43.673782  1070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7d578ba2eb41f7a38f15c5dd34b8cb" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:43.674453  1070 raft_consensus.cc:2468] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 0.
W20260709 12:26:43.674870   943 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:43.675673  1336 consensus_queue.cc:1048] T 70720af8528947a89c03ec468c1235eb P aa098a557d34433896712068efd0d9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:43.675690  1110 leader_election.cc:304] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 8fa35514a8d84740b1b46ae496307f20; no voters: 
I20260709 12:26:43.680651  1265 tablet_bootstrap.cc:654] T acc6ab0dce1640e380b433b32a874108 P 7f9cbe40e40d429aa004e4a7fb42f132: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.681169  1365 raft_consensus.cc:2804] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:43.681576  1365 raft_consensus.cc:493] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:43.681923  1365 raft_consensus.cc:3060] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:43.681813  1266 consensus_queue.cc:260] T e5af913e96004f3b8cac5fbe6ac655ac P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:43.684441  1266 ts_tablet_manager.cc:1434] T e5af913e96004f3b8cac5fbe6ac655ac P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:26:43.685382  1266 tablet_bootstrap.cc:492] T c9d72f2a6ae046cb9d4e6277d13e34e6 P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:43.686631  1362 consensus_queue.cc:1048] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:43.654428  1267 tablet_bootstrap.cc:654] T e5af913e96004f3b8cac5fbe6ac655ac P 8fa35514a8d84740b1b46ae496307f20: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.677683   997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7d578ba2eb41f7a38f15c5dd34b8cb" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
I20260709 12:26:43.695387   997 raft_consensus.cc:2468] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 0.
I20260709 12:26:43.681206  1276 raft_consensus.cc:515] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:43.702512  1146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e22afc1ef634aaabf17a4e5a3bf0be3" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20"
I20260709 12:26:43.703197  1146 raft_consensus.cc:3060] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:43.710994  1298 consensus_queue.cc:1048] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P 937efeddef934b2b8bc8632594903085 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:43.713837  1146 raft_consensus.cc:2468] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 1.
I20260709 12:26:43.714812  1327 consensus_queue.cc:1048] T 8c7002e5875a494e8e845023cc05503f P 937efeddef934b2b8bc8632594903085 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:43.713843  1264 raft_consensus.cc:359] T e81f2374d9904e93bf2941ff8b241c09 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:43.716078  1144 raft_consensus.cc:3060] T 284ea666431c4339998eb885cd31facb P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:43.719973  1186 leader_election.cc:304] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085; no voters: 
I20260709 12:26:43.720990  1327 raft_consensus.cc:2804] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:43.721482  1327 raft_consensus.cc:697] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Becoming Leader. State: Replica: 937efeddef934b2b8bc8632594903085, State: Running, Role: LEADER
I20260709 12:26:43.722330  1327 consensus_queue.cc:237] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 937efeddef934b2b8bc8632594903085 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:43.714933  1365 raft_consensus.cc:515] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:43.732627  1362 consensus_queue.cc:1048] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:43.733870   996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7d578ba2eb41f7a38f15c5dd34b8cb" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8"
I20260709 12:26:43.734122  1365 leader_election.cc:290] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 election: Requested vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:43.734122  1068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7d578ba2eb41f7a38f15c5dd34b8cb" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
I20260709 12:26:43.734668   996 raft_consensus.cc:3060] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:43.735209  1068 raft_consensus.cc:3060] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:43.736302  1264 raft_consensus.cc:385] T e81f2374d9904e93bf2941ff8b241c09 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.736654  1264 raft_consensus.cc:740] T e81f2374d9904e93bf2941ff8b241c09 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 937efeddef934b2b8bc8632594903085, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.737372  1264 consensus_queue.cc:260] T e81f2374d9904e93bf2941ff8b241c09 P 937efeddef934b2b8bc8632594903085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:43.719348  1070 raft_consensus.cc:3060] T 5b3d71845177478a9e2510c82e0cf9d1 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:43.741014  1276 leader_election.cc:290] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Requested vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:43.742460   995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e22afc1ef634aaabf17a4e5a3bf0be3" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8"
I20260709 12:26:43.743279   995 raft_consensus.cc:3060] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:43.745968  1264 ts_tablet_manager.cc:1434] T e81f2374d9904e93bf2941ff8b241c09 P 937efeddef934b2b8bc8632594903085: Time spent starting tablet: real 0.077s	user 0.005s	sys 0.001s
I20260709 12:26:43.747213  1264 tablet_bootstrap.cc:492] T b8e49440650449f49e5303568f2f19c0 P 937efeddef934b2b8bc8632594903085: Bootstrap starting.
I20260709 12:26:43.749552  1266 tablet_bootstrap.cc:654] T c9d72f2a6ae046cb9d4e6277d13e34e6 P aa098a557d34433896712068efd0d9a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.751477   995 raft_consensus.cc:2468] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 1.
I20260709 12:26:43.754089  1267 tablet_bootstrap.cc:492] T e5af913e96004f3b8cac5fbe6ac655ac P 8fa35514a8d84740b1b46ae496307f20: No bootstrap required, opened a new log
I20260709 12:26:43.778014  1267 ts_tablet_manager.cc:1403] T e5af913e96004f3b8cac5fbe6ac655ac P 8fa35514a8d84740b1b46ae496307f20: Time spent bootstrapping tablet: real 0.144s	user 0.014s	sys 0.000s
I20260709 12:26:43.757542  1068 raft_consensus.cc:2468] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 1.
I20260709 12:26:43.762707  1276 raft_consensus.cc:493] T 580f367489064e218eef65b4654744b8 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.781486  1265 tablet_bootstrap.cc:492] T acc6ab0dce1640e380b433b32a874108 P 7f9cbe40e40d429aa004e4a7fb42f132: No bootstrap required, opened a new log
I20260709 12:26:43.782109  1265 ts_tablet_manager.cc:1403] T acc6ab0dce1640e380b433b32a874108 P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent bootstrapping tablet: real 0.111s	user 0.013s	sys 0.002s
I20260709 12:26:43.768543  1264 tablet_bootstrap.cc:654] T b8e49440650449f49e5303568f2f19c0 P 937efeddef934b2b8bc8632594903085: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.781004  1267 raft_consensus.cc:359] T e5af913e96004f3b8cac5fbe6ac655ac P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:43.783573  1110 leader_election.cc:304] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 8fa35514a8d84740b1b46ae496307f20; no voters: 
I20260709 12:26:43.784492  1362 raft_consensus.cc:2804] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:43.785370  1362 raft_consensus.cc:697] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P 8fa35514a8d84740b1b46ae496307f20 [term 1 LEADER]: Becoming Leader. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Running, Role: LEADER
I20260709 12:26:43.786278  1376 consensus_queue.cc:1048] T 8c7002e5875a494e8e845023cc05503f P 937efeddef934b2b8bc8632594903085 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:43.786262  1362 consensus_queue.cc:237] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:43.788223  1267 raft_consensus.cc:385] T e5af913e96004f3b8cac5fbe6ac655ac P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.789006  1267 raft_consensus.cc:740] T e5af913e96004f3b8cac5fbe6ac655ac P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.781772  1276 raft_consensus.cc:515] T 580f367489064e218eef65b4654744b8 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:43.792923   996 raft_consensus.cc:2468] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 1.
I20260709 12:26:43.794550  1143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580f367489064e218eef65b4654744b8" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:43.791566  1276 leader_election.cc:290] T 580f367489064e218eef65b4654744b8 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:43.795766  1143 raft_consensus.cc:2468] T 580f367489064e218eef65b4654744b8 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 0.
I20260709 12:26:43.800001  1186 leader_election.cc:304] T 580f367489064e218eef65b4654744b8 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085; no voters: 
I20260709 12:26:43.764395  1266 tablet_bootstrap.cc:492] T c9d72f2a6ae046cb9d4e6277d13e34e6 P aa098a557d34433896712068efd0d9a8: No bootstrap required, opened a new log
I20260709 12:26:43.802809  1266 ts_tablet_manager.cc:1403] T c9d72f2a6ae046cb9d4e6277d13e34e6 P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.118s	user 0.012s	sys 0.000s
I20260709 12:26:43.806197  1276 raft_consensus.cc:2804] T 580f367489064e218eef65b4654744b8 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:43.820189  1267 consensus_queue.cc:260] T e5af913e96004f3b8cac5fbe6ac655ac P 8fa35514a8d84740b1b46ae496307f20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:43.825842  1267 ts_tablet_manager.cc:1434] T e5af913e96004f3b8cac5fbe6ac655ac P 8fa35514a8d84740b1b46ae496307f20: Time spent starting tablet: real 0.047s	user 0.010s	sys 0.000s
I20260709 12:26:43.826792  1267 tablet_bootstrap.cc:492] T acc6ab0dce1640e380b433b32a874108 P 8fa35514a8d84740b1b46ae496307f20: Bootstrap starting.
I20260709 12:26:43.830179  1266 raft_consensus.cc:359] T c9d72f2a6ae046cb9d4e6277d13e34e6 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:43.831171  1266 raft_consensus.cc:385] T c9d72f2a6ae046cb9d4e6277d13e34e6 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.831519  1266 raft_consensus.cc:740] T c9d72f2a6ae046cb9d4e6277d13e34e6 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.818468  1276 raft_consensus.cc:493] T 580f367489064e218eef65b4654744b8 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:43.832731  1276 raft_consensus.cc:3060] T 580f367489064e218eef65b4654744b8 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:43.833613  1267 tablet_bootstrap.cc:654] T acc6ab0dce1640e380b433b32a874108 P 8fa35514a8d84740b1b46ae496307f20: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.822028  1327 raft_consensus.cc:493] T e81f2374d9904e93bf2941ff8b241c09 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.836221  1327 raft_consensus.cc:515] T e81f2374d9904e93bf2941ff8b241c09 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:43.840654  1072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81f2374d9904e93bf2941ff8b241c09" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:43.841331  1327 leader_election.cc:290] T e81f2374d9904e93bf2941ff8b241c09 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:43.841526  1072 raft_consensus.cc:2393] T e81f2374d9904e93bf2941ff8b241c09 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 937efeddef934b2b8bc8632594903085 in current term 1: Already voted for candidate aa098a557d34433896712068efd0d9a8 in this term.
I20260709 12:26:43.848120  1298 consensus_queue.cc:1048] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P 937efeddef934b2b8bc8632594903085 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:43.849931   996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580f367489064e218eef65b4654744b8" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
W20260709 12:26:43.860396  1186 leader_election.cc:343] T 580f367489064e218eef65b4654744b8 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:43.865572  1328 consensus_queue.cc:1048] T 3a19a87d91404b73bdba7121512bf7aa P 7f9cbe40e40d429aa004e4a7fb42f132 [LEADER]: Connected to new peer: Peer: permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:43.869210  1317 raft_consensus.cc:493] T c4234c6cf75048c5a6cdf34e43c9bd1e P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.869980  1317 raft_consensus.cc:515] T c4234c6cf75048c5a6cdf34e43c9bd1e P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:43.870779   994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81f2374d9904e93bf2941ff8b241c09" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
I20260709 12:26:43.874949  1219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4234c6cf75048c5a6cdf34e43c9bd1e" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:43.875753  1317 leader_election.cc:290] T c4234c6cf75048c5a6cdf34e43c9bd1e P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
W20260709 12:26:43.876652  1109 leader_election.cc:343] T c4234c6cf75048c5a6cdf34e43c9bd1e P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:43.877599   997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4234c6cf75048c5a6cdf34e43c9bd1e" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
I20260709 12:26:43.881603  1264 tablet_bootstrap.cc:492] T b8e49440650449f49e5303568f2f19c0 P 937efeddef934b2b8bc8632594903085: No bootstrap required, opened a new log
I20260709 12:26:43.882364  1264 ts_tablet_manager.cc:1403] T b8e49440650449f49e5303568f2f19c0 P 937efeddef934b2b8bc8632594903085: Time spent bootstrapping tablet: real 0.135s	user 0.014s	sys 0.017s
I20260709 12:26:43.885676  1266 consensus_queue.cc:260] T c9d72f2a6ae046cb9d4e6277d13e34e6 P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:43.892288  1264 raft_consensus.cc:359] T b8e49440650449f49e5303568f2f19c0 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:43.893477  1264 raft_consensus.cc:385] T b8e49440650449f49e5303568f2f19c0 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.893860  1264 raft_consensus.cc:740] T b8e49440650449f49e5303568f2f19c0 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 937efeddef934b2b8bc8632594903085, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.891109  1265 raft_consensus.cc:359] T acc6ab0dce1640e380b433b32a874108 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:43.895249  1265 raft_consensus.cc:385] T acc6ab0dce1640e380b433b32a874108 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:43.895576  1265 raft_consensus.cc:740] T acc6ab0dce1640e380b433b32a874108 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Initialized, Role: FOLLOWER
I20260709 12:26:43.895632  1264 consensus_queue.cc:260] T b8e49440650449f49e5303568f2f19c0 P 937efeddef934b2b8bc8632594903085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:43.896292  1265 consensus_queue.cc:260] T acc6ab0dce1640e380b433b32a874108 P 7f9cbe40e40d429aa004e4a7fb42f132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:43.899637  1186 leader_election.cc:304] T e81f2374d9904e93bf2941ff8b241c09 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 937efeddef934b2b8bc8632594903085; no voters: 7f9cbe40e40d429aa004e4a7fb42f132, aa098a557d34433896712068efd0d9a8
I20260709 12:26:43.902263  1265 ts_tablet_manager.cc:1434] T acc6ab0dce1640e380b433b32a874108 P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent starting tablet: real 0.108s	user 0.007s	sys 0.000s
I20260709 12:26:43.901980  1276 raft_consensus.cc:515] T 580f367489064e218eef65b4654744b8 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:43.902518  1264 ts_tablet_manager.cc:1434] T b8e49440650449f49e5303568f2f19c0 P 937efeddef934b2b8bc8632594903085: Time spent starting tablet: real 0.020s	user 0.010s	sys 0.000s
I20260709 12:26:43.903545  1265 tablet_bootstrap.cc:492] T e5af913e96004f3b8cac5fbe6ac655ac P 7f9cbe40e40d429aa004e4a7fb42f132: Bootstrap starting.
I20260709 12:26:43.903869  1264 tablet_bootstrap.cc:492] T c495ce9da627479e92d7b24b3be3641a P 937efeddef934b2b8bc8632594903085: Bootstrap starting.
I20260709 12:26:43.904399  1276 leader_election.cc:290] T 580f367489064e218eef65b4654744b8 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Requested vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:43.905124  1327 raft_consensus.cc:3060] T e81f2374d9904e93bf2941ff8b241c09 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:43.910882  1265 tablet_bootstrap.cc:654] T e5af913e96004f3b8cac5fbe6ac655ac P 7f9cbe40e40d429aa004e4a7fb42f132: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.914494  1264 tablet_bootstrap.cc:654] T c495ce9da627479e92d7b24b3be3641a P 937efeddef934b2b8bc8632594903085: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:43.901961  1266 ts_tablet_manager.cc:1434] T c9d72f2a6ae046cb9d4e6277d13e34e6 P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.099s	user 0.009s	sys 0.000s
I20260709 12:26:43.919484  1327 raft_consensus.cc:2749] T e81f2374d9904e93bf2941ff8b241c09 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:26:43.889865  1112 leader_election.cc:343] T c4234c6cf75048c5a6cdf34e43c9bd1e P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:43.970156  1186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:32981, user_credentials={real_user=slave}} blocked reactor thread for 69052.5us
I20260709 12:26:43.970932  1112 leader_election.cc:304] T c4234c6cf75048c5a6cdf34e43c9bd1e P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20; no voters: 937efeddef934b2b8bc8632594903085, aa098a557d34433896712068efd0d9a8
I20260709 12:26:43.971067  1072 raft_consensus.cc:3060] T 1b6df135b8494d0d916747b8994b5cf9 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:43.977458  1112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:32981, user_credentials={real_user=slave}} blocked reactor thread for 88625.1us
I20260709 12:26:43.988873   994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580f367489064e218eef65b4654744b8" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8"
W20260709 12:26:43.997298  1186 leader_election.cc:343] T 580f367489064e218eef65b4654744b8 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:43.999393  1143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580f367489064e218eef65b4654744b8" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20"
I20260709 12:26:44.000319  1143 raft_consensus.cc:3060] T 580f367489064e218eef65b4654744b8 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:44.011371  1317 raft_consensus.cc:2749] T c4234c6cf75048c5a6cdf34e43c9bd1e P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:44.025754  1276 raft_consensus.cc:493] T b8e49440650449f49e5303568f2f19c0 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.026592  1276 raft_consensus.cc:515] T b8e49440650449f49e5303568f2f19c0 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:44.029937  1266 tablet_bootstrap.cc:492] T c4234c6cf75048c5a6cdf34e43c9bd1e P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:44.041736  1265 tablet_bootstrap.cc:492] T e5af913e96004f3b8cac5fbe6ac655ac P 7f9cbe40e40d429aa004e4a7fb42f132: No bootstrap required, opened a new log
I20260709 12:26:44.042779  1265 ts_tablet_manager.cc:1403] T e5af913e96004f3b8cac5fbe6ac655ac P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent bootstrapping tablet: real 0.140s	user 0.006s	sys 0.007s
I20260709 12:26:44.043843  1371 consensus_queue.cc:1048] T e81f2374d9904e93bf2941ff8b241c09 P aa098a557d34433896712068efd0d9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:44.047021  1265 raft_consensus.cc:359] T e5af913e96004f3b8cac5fbe6ac655ac P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:44.047880  1265 raft_consensus.cc:385] T e5af913e96004f3b8cac5fbe6ac655ac P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.048230  1265 raft_consensus.cc:740] T e5af913e96004f3b8cac5fbe6ac655ac P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.049320  1265 consensus_queue.cc:260] T e5af913e96004f3b8cac5fbe6ac655ac P 7f9cbe40e40d429aa004e4a7fb42f132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:44.050539  1371 consensus_queue.cc:1048] T e81f2374d9904e93bf2941ff8b241c09 P aa098a557d34433896712068efd0d9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:44.051659  1265 ts_tablet_manager.cc:1434] T e5af913e96004f3b8cac5fbe6ac655ac P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.006s
I20260709 12:26:44.026608  1336 raft_consensus.cc:493] T e5af913e96004f3b8cac5fbe6ac655ac P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.056620  1336 raft_consensus.cc:515] T e5af913e96004f3b8cac5fbe6ac655ac P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:44.061414  1068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5af913e96004f3b8cac5fbe6ac655ac" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:44.062350  1068 raft_consensus.cc:2468] T e5af913e96004f3b8cac5fbe6ac655ac P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa098a557d34433896712068efd0d9a8 in term 0.
I20260709 12:26:44.066001   961 leader_election.cc:304] T e5af913e96004f3b8cac5fbe6ac655ac P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, aa098a557d34433896712068efd0d9a8; no voters: 
I20260709 12:26:44.066191  1276 leader_election.cc:290] T b8e49440650449f49e5303568f2f19c0 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679), 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341)
I20260709 12:26:44.066758  1068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e49440650449f49e5303568f2f19c0" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:44.067420  1146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e49440650449f49e5303568f2f19c0" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:44.067685  1068 raft_consensus.cc:2468] T b8e49440650449f49e5303568f2f19c0 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 0.
I20260709 12:26:44.067401  1371 raft_consensus.cc:2804] T e5af913e96004f3b8cac5fbe6ac655ac P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:26:44.068867  1186 leader_election.cc:343] T b8e49440650449f49e5303568f2f19c0 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:44.069506  1267 tablet_bootstrap.cc:492] T acc6ab0dce1640e380b433b32a874108 P 8fa35514a8d84740b1b46ae496307f20: No bootstrap required, opened a new log
I20260709 12:26:44.069638  1371 raft_consensus.cc:493] T e5af913e96004f3b8cac5fbe6ac655ac P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:44.070310  1267 ts_tablet_manager.cc:1403] T acc6ab0dce1640e380b433b32a874108 P 8fa35514a8d84740b1b46ae496307f20: Time spent bootstrapping tablet: real 0.244s	user 0.030s	sys 0.050s
I20260709 12:26:44.070000  1184 leader_election.cc:304] T b8e49440650449f49e5303568f2f19c0 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 937efeddef934b2b8bc8632594903085; no voters: 8fa35514a8d84740b1b46ae496307f20
I20260709 12:26:44.070436  1371 raft_consensus.cc:3060] T e5af913e96004f3b8cac5fbe6ac655ac P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:44.071548  1276 raft_consensus.cc:2804] T b8e49440650449f49e5303568f2f19c0 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:44.072029  1276 raft_consensus.cc:493] T b8e49440650449f49e5303568f2f19c0 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:44.076686  1328 consensus_queue.cc:1048] T 3a19a87d91404b73bdba7121512bf7aa P 7f9cbe40e40d429aa004e4a7fb42f132 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:44.077217  1265 tablet_bootstrap.cc:492] T 333930b9df5744d59ab498b170a35315 P 7f9cbe40e40d429aa004e4a7fb42f132: Bootstrap starting.
I20260709 12:26:44.020748   893 catalog_manager.cc:5697] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P 8fa35514a8d84740b1b46ae496307f20 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131). New cstate: current_term: 1 leader_uuid: "8fa35514a8d84740b1b46ae496307f20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:44.075008  1276 raft_consensus.cc:3060] T b8e49440650449f49e5303568f2f19c0 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:44.083007  1146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5af913e96004f3b8cac5fbe6ac655ac" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:44.083873  1146 raft_consensus.cc:2468] T e5af913e96004f3b8cac5fbe6ac655ac P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa098a557d34433896712068efd0d9a8 in term 0.
I20260709 12:26:44.091781  1265 tablet_bootstrap.cc:654] T 333930b9df5744d59ab498b170a35315 P 7f9cbe40e40d429aa004e4a7fb42f132: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.081924  1336 leader_election.cc:290] T e5af913e96004f3b8cac5fbe6ac655ac P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679), 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341)
I20260709 12:26:44.097357  1371 raft_consensus.cc:515] T e5af913e96004f3b8cac5fbe6ac655ac P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:44.098395  1264 tablet_bootstrap.cc:492] T c495ce9da627479e92d7b24b3be3641a P 937efeddef934b2b8bc8632594903085: No bootstrap required, opened a new log
I20260709 12:26:44.099116  1264 ts_tablet_manager.cc:1403] T c495ce9da627479e92d7b24b3be3641a P 937efeddef934b2b8bc8632594903085: Time spent bootstrapping tablet: real 0.195s	user 0.028s	sys 0.016s
I20260709 12:26:44.100661  1068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5af913e96004f3b8cac5fbe6ac655ac" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
I20260709 12:26:44.101353  1068 raft_consensus.cc:3060] T e5af913e96004f3b8cac5fbe6ac655ac P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:44.102360  1266 tablet_bootstrap.cc:654] T c4234c6cf75048c5a6cdf34e43c9bd1e P aa098a557d34433896712068efd0d9a8: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:44.110601  1112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:32981, user_credentials={real_user=slave}} blocked reactor thread for 121635us
I20260709 12:26:44.112071  1365 raft_consensus.cc:493] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.112892  1365 raft_consensus.cc:515] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:44.116457  1365 leader_election.cc:290] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:44.117322  1071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d72f2a6ae046cb9d4e6277d13e34e6" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:44.118258  1071 raft_consensus.cc:2468] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 1.
I20260709 12:26:44.118469   996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d72f2a6ae046cb9d4e6277d13e34e6" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
I20260709 12:26:44.119242   996 raft_consensus.cc:2468] T c9d72f2a6ae046cb9d4e6277d13e34e6 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 0.
I20260709 12:26:44.119957  1110 leader_election.cc:304] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 8fa35514a8d84740b1b46ae496307f20; no voters: 
I20260709 12:26:44.123172  1365 raft_consensus.cc:2804] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:44.126276  1365 raft_consensus.cc:493] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:44.126868  1365 raft_consensus.cc:3060] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:44.133450  1267 raft_consensus.cc:359] T acc6ab0dce1640e380b433b32a874108 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:44.134369  1267 raft_consensus.cc:385] T acc6ab0dce1640e380b433b32a874108 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.134647  1267 raft_consensus.cc:740] T acc6ab0dce1640e380b433b32a874108 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.136976  1068 raft_consensus.cc:2468] T e5af913e96004f3b8cac5fbe6ac655ac P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa098a557d34433896712068efd0d9a8 in term 1.
I20260709 12:26:44.140045   961 leader_election.cc:304] T e5af913e96004f3b8cac5fbe6ac655ac P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, aa098a557d34433896712068efd0d9a8; no voters: 
I20260709 12:26:44.141963  1369 raft_consensus.cc:2804] T e5af913e96004f3b8cac5fbe6ac655ac P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:44.142553  1369 raft_consensus.cc:697] T e5af913e96004f3b8cac5fbe6ac655ac P aa098a557d34433896712068efd0d9a8 [term 1 LEADER]: Becoming Leader. State: Replica: aa098a557d34433896712068efd0d9a8, State: Running, Role: LEADER
I20260709 12:26:44.143195  1143 raft_consensus.cc:2468] T 580f367489064e218eef65b4654744b8 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 1.
I20260709 12:26:44.143774  1369 consensus_queue.cc:237] T e5af913e96004f3b8cac5fbe6ac655ac P aa098a557d34433896712068efd0d9a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:44.121829  1264 raft_consensus.cc:359] T c495ce9da627479e92d7b24b3be3641a P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:44.148245  1264 raft_consensus.cc:385] T c495ce9da627479e92d7b24b3be3641a P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.148876  1264 raft_consensus.cc:740] T c495ce9da627479e92d7b24b3be3641a P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 937efeddef934b2b8bc8632594903085, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.135485  1267 consensus_queue.cc:260] T acc6ab0dce1640e380b433b32a874108 P 8fa35514a8d84740b1b46ae496307f20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:44.158198  1264 consensus_queue.cc:260] T c495ce9da627479e92d7b24b3be3641a P 937efeddef934b2b8bc8632594903085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:44.162654  1264 ts_tablet_manager.cc:1434] T c495ce9da627479e92d7b24b3be3641a P 937efeddef934b2b8bc8632594903085: Time spent starting tablet: real 0.063s	user 0.010s	sys 0.001s
I20260709 12:26:44.156296  1371 leader_election.cc:290] T e5af913e96004f3b8cac5fbe6ac655ac P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 election: Requested vote from peers 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679), 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341)
I20260709 12:26:44.163493  1144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5af913e96004f3b8cac5fbe6ac655ac" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20"
I20260709 12:26:44.164309  1144 raft_consensus.cc:3060] T e5af913e96004f3b8cac5fbe6ac655ac P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:44.163873   894 catalog_manager.cc:5697] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 937efeddef934b2b8bc8632594903085 reported cstate change: term changed from 0 to 1, leader changed from <none> to 937efeddef934b2b8bc8632594903085 (127.23.245.132). New cstate: current_term: 1 leader_uuid: "937efeddef934b2b8bc8632594903085" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:44.166759  1264 tablet_bootstrap.cc:492] T acc6ab0dce1640e380b433b32a874108 P 937efeddef934b2b8bc8632594903085: Bootstrap starting.
I20260709 12:26:44.168368  1186 leader_election.cc:304] T 580f367489064e218eef65b4654744b8 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085; no voters: aa098a557d34433896712068efd0d9a8
I20260709 12:26:44.170356  1327 raft_consensus.cc:2804] T 580f367489064e218eef65b4654744b8 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:44.170915  1327 raft_consensus.cc:697] T 580f367489064e218eef65b4654744b8 P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Becoming Leader. State: Replica: 937efeddef934b2b8bc8632594903085, State: Running, Role: LEADER
I20260709 12:26:44.172122  1327 consensus_queue.cc:237] T 580f367489064e218eef65b4654744b8 P 937efeddef934b2b8bc8632594903085 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:44.109067  1276 raft_consensus.cc:515] T b8e49440650449f49e5303568f2f19c0 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:44.149952  1365 raft_consensus.cc:515] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:44.200407   996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d72f2a6ae046cb9d4e6277d13e34e6" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8"
I20260709 12:26:44.201344   996 raft_consensus.cc:3060] T c9d72f2a6ae046cb9d4e6277d13e34e6 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Advancing to term 2
I20260709 12:26:44.205019  1068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c9d72f2a6ae046cb9d4e6277d13e34e6" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
I20260709 12:26:44.205919  1068 raft_consensus.cc:3060] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:44.208756  1276 leader_election.cc:290] T b8e49440650449f49e5303568f2f19c0 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Requested vote from peers 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679), 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341)
I20260709 12:26:44.210435  1146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e49440650449f49e5303568f2f19c0" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20"
I20260709 12:26:44.211141  1267 ts_tablet_manager.cc:1434] T acc6ab0dce1640e380b433b32a874108 P 8fa35514a8d84740b1b46ae496307f20: Time spent starting tablet: real 0.140s	user 0.008s	sys 0.004s
W20260709 12:26:44.212739  1186 leader_election.cc:343] T b8e49440650449f49e5303568f2f19c0 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:44.216336  1365 leader_election.cc:290] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 2 election: Requested vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:44.217281  1374 consensus_queue.cc:1048] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 937efeddef934b2b8bc8632594903085 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:44.197165  1264 tablet_bootstrap.cc:654] T acc6ab0dce1640e380b433b32a874108 P 937efeddef934b2b8bc8632594903085: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.233660  1072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e49440650449f49e5303568f2f19c0" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
I20260709 12:26:44.234368  1072 raft_consensus.cc:3060] T b8e49440650449f49e5303568f2f19c0 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:44.237505   996 raft_consensus.cc:2468] T c9d72f2a6ae046cb9d4e6277d13e34e6 P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 2.
I20260709 12:26:44.237970  1266 tablet_bootstrap.cc:492] T c4234c6cf75048c5a6cdf34e43c9bd1e P aa098a557d34433896712068efd0d9a8: No bootstrap required, opened a new log
I20260709 12:26:44.213007  1267 tablet_bootstrap.cc:492] T 6715731f9a31415a98fa8a0ab9944eec P 8fa35514a8d84740b1b46ae496307f20: Bootstrap starting.
I20260709 12:26:44.248688  1144 raft_consensus.cc:2468] T e5af913e96004f3b8cac5fbe6ac655ac P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa098a557d34433896712068efd0d9a8 in term 1.
I20260709 12:26:44.249002  1265 tablet_bootstrap.cc:492] T 333930b9df5744d59ab498b170a35315 P 7f9cbe40e40d429aa004e4a7fb42f132: No bootstrap required, opened a new log
I20260709 12:26:44.263815  1112 leader_election.cc:304] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20, aa098a557d34433896712068efd0d9a8; no voters: 
I20260709 12:26:44.264546  1265 ts_tablet_manager.cc:1403] T 333930b9df5744d59ab498b170a35315 P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent bootstrapping tablet: real 0.188s	user 0.019s	sys 0.005s
I20260709 12:26:44.265280  1365 raft_consensus.cc:2804] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:44.266130  1365 raft_consensus.cc:697] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 8fa35514a8d84740b1b46ae496307f20 [term 2 LEADER]: Becoming Leader. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Running, Role: LEADER
I20260709 12:26:44.266360  1072 raft_consensus.cc:2468] T b8e49440650449f49e5303568f2f19c0 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 1.
I20260709 12:26:44.267488  1265 raft_consensus.cc:359] T 333930b9df5744d59ab498b170a35315 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:44.267313  1365 consensus_queue.cc:237] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:44.268354  1265 raft_consensus.cc:385] T 333930b9df5744d59ab498b170a35315 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.268683  1265 raft_consensus.cc:740] T 333930b9df5744d59ab498b170a35315 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.268823  1184 leader_election.cc:304] T b8e49440650449f49e5303568f2f19c0 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 937efeddef934b2b8bc8632594903085; no voters: 8fa35514a8d84740b1b46ae496307f20
I20260709 12:26:44.269562  1265 consensus_queue.cc:260] T 333930b9df5744d59ab498b170a35315 P 7f9cbe40e40d429aa004e4a7fb42f132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:44.270069  1374 raft_consensus.cc:2804] T b8e49440650449f49e5303568f2f19c0 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:44.270632  1374 raft_consensus.cc:697] T b8e49440650449f49e5303568f2f19c0 P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Becoming Leader. State: Replica: 937efeddef934b2b8bc8632594903085, State: Running, Role: LEADER
I20260709 12:26:44.270896  1267 tablet_bootstrap.cc:654] T 6715731f9a31415a98fa8a0ab9944eec P 8fa35514a8d84740b1b46ae496307f20: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.263687  1266 ts_tablet_manager.cc:1403] T c4234c6cf75048c5a6cdf34e43c9bd1e P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.346s	user 0.027s	sys 0.007s
I20260709 12:26:44.271548  1374 consensus_queue.cc:237] T b8e49440650449f49e5303568f2f19c0 P 937efeddef934b2b8bc8632594903085 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:44.272881   892 catalog_manager.cc:5697] T e5af913e96004f3b8cac5fbe6ac655ac P aa098a557d34433896712068efd0d9a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to aa098a557d34433896712068efd0d9a8 (127.23.245.129). New cstate: current_term: 1 leader_uuid: "aa098a557d34433896712068efd0d9a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:44.256526  1068 raft_consensus.cc:2468] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 2.
I20260709 12:26:44.260213  1276 consensus_queue.cc:1048] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 937efeddef934b2b8bc8632594903085 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:44.274842  1266 raft_consensus.cc:359] T c4234c6cf75048c5a6cdf34e43c9bd1e P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:44.275641  1266 raft_consensus.cc:385] T c4234c6cf75048c5a6cdf34e43c9bd1e P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.275952  1266 raft_consensus.cc:740] T c4234c6cf75048c5a6cdf34e43c9bd1e P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.259740  1264 tablet_bootstrap.cc:492] T acc6ab0dce1640e380b433b32a874108 P 937efeddef934b2b8bc8632594903085: No bootstrap required, opened a new log
I20260709 12:26:44.277021  1264 ts_tablet_manager.cc:1403] T acc6ab0dce1640e380b433b32a874108 P 937efeddef934b2b8bc8632594903085: Time spent bootstrapping tablet: real 0.111s	user 0.014s	sys 0.021s
I20260709 12:26:44.279415  1266 consensus_queue.cc:260] T c4234c6cf75048c5a6cdf34e43c9bd1e P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:44.272084  1265 ts_tablet_manager.cc:1434] T 333930b9df5744d59ab498b170a35315 P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:26:44.282790  1266 ts_tablet_manager.cc:1434] T c4234c6cf75048c5a6cdf34e43c9bd1e P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:26:44.283248  1265 tablet_bootstrap.cc:492] T ec47b02d68674e2386a86244d9026b78 P 7f9cbe40e40d429aa004e4a7fb42f132: Bootstrap starting.
I20260709 12:26:44.284128  1266 tablet_bootstrap.cc:492] T 580f367489064e218eef65b4654744b8 P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:44.286352  1421 consensus_queue.cc:1048] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:44.290392  1265 tablet_bootstrap.cc:654] T ec47b02d68674e2386a86244d9026b78 P 7f9cbe40e40d429aa004e4a7fb42f132: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.289181  1264 raft_consensus.cc:359] T acc6ab0dce1640e380b433b32a874108 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:44.293393  1264 raft_consensus.cc:385] T acc6ab0dce1640e380b433b32a874108 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.293731  1264 raft_consensus.cc:740] T acc6ab0dce1640e380b433b32a874108 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 937efeddef934b2b8bc8632594903085, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.294879  1264 consensus_queue.cc:260] T acc6ab0dce1640e380b433b32a874108 P 937efeddef934b2b8bc8632594903085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:44.297665  1264 ts_tablet_manager.cc:1434] T acc6ab0dce1640e380b433b32a874108 P 937efeddef934b2b8bc8632594903085: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:26:44.302335  1264 tablet_bootstrap.cc:492] T edea2a0a3c264f2b810295aea0acfb73 P 937efeddef934b2b8bc8632594903085: Bootstrap starting.
I20260709 12:26:44.307109  1267 tablet_bootstrap.cc:492] T 6715731f9a31415a98fa8a0ab9944eec P 8fa35514a8d84740b1b46ae496307f20: No bootstrap required, opened a new log
I20260709 12:26:44.307981  1267 ts_tablet_manager.cc:1403] T 6715731f9a31415a98fa8a0ab9944eec P 8fa35514a8d84740b1b46ae496307f20: Time spent bootstrapping tablet: real 0.095s	user 0.002s	sys 0.012s
I20260709 12:26:44.314054  1266 tablet_bootstrap.cc:654] T 580f367489064e218eef65b4654744b8 P aa098a557d34433896712068efd0d9a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.316071   893 catalog_manager.cc:5697] T 580f367489064e218eef65b4654744b8 P 937efeddef934b2b8bc8632594903085 reported cstate change: term changed from 0 to 1, leader changed from <none> to 937efeddef934b2b8bc8632594903085 (127.23.245.132). New cstate: current_term: 1 leader_uuid: "937efeddef934b2b8bc8632594903085" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:44.317488  1267 raft_consensus.cc:359] T 6715731f9a31415a98fa8a0ab9944eec P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:44.324451  1267 raft_consensus.cc:385] T 6715731f9a31415a98fa8a0ab9944eec P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.324878  1267 raft_consensus.cc:740] T 6715731f9a31415a98fa8a0ab9944eec P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.344801  1267 consensus_queue.cc:260] T 6715731f9a31415a98fa8a0ab9944eec P 8fa35514a8d84740b1b46ae496307f20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:44.350299  1323 raft_consensus.cc:493] T acc6ab0dce1640e380b433b32a874108 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.350802  1323 raft_consensus.cc:515] T acc6ab0dce1640e380b433b32a874108 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:44.354784  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc6ab0dce1640e380b433b32a874108" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:44.355502  1220 raft_consensus.cc:2468] T acc6ab0dce1640e380b433b32a874108 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f9cbe40e40d429aa004e4a7fb42f132 in term 0.
I20260709 12:26:44.357278  1035 leader_election.cc:304] T acc6ab0dce1640e380b433b32a874108 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 937efeddef934b2b8bc8632594903085; no voters: 
I20260709 12:26:44.358172  1359 raft_consensus.cc:2804] T acc6ab0dce1640e380b433b32a874108 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:44.358548  1359 raft_consensus.cc:493] T acc6ab0dce1640e380b433b32a874108 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:44.358646  1267 ts_tablet_manager.cc:1434] T 6715731f9a31415a98fa8a0ab9944eec P 8fa35514a8d84740b1b46ae496307f20: Time spent starting tablet: real 0.050s	user 0.008s	sys 0.000s
I20260709 12:26:44.358948  1359 raft_consensus.cc:3060] T acc6ab0dce1640e380b433b32a874108 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:44.359050  1323 leader_election.cc:290] T acc6ab0dce1640e380b433b32a874108 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:26:44.358964  1144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc6ab0dce1640e380b433b32a874108" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:44.360025  1267 tablet_bootstrap.cc:492] T b8e49440650449f49e5303568f2f19c0 P 8fa35514a8d84740b1b46ae496307f20: Bootstrap starting.
I20260709 12:26:44.360283  1144 raft_consensus.cc:2468] T acc6ab0dce1640e380b433b32a874108 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f9cbe40e40d429aa004e4a7fb42f132 in term 0.
I20260709 12:26:44.368916  1267 tablet_bootstrap.cc:654] T b8e49440650449f49e5303568f2f19c0 P 8fa35514a8d84740b1b46ae496307f20: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.369756  1317 consensus_queue.cc:1048] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:44.383683  1266 tablet_bootstrap.cc:492] T 580f367489064e218eef65b4654744b8 P aa098a557d34433896712068efd0d9a8: No bootstrap required, opened a new log
I20260709 12:26:44.384397  1266 ts_tablet_manager.cc:1403] T 580f367489064e218eef65b4654744b8 P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.101s	user 0.015s	sys 0.000s
I20260709 12:26:44.387861  1265 tablet_bootstrap.cc:492] T ec47b02d68674e2386a86244d9026b78 P 7f9cbe40e40d429aa004e4a7fb42f132: No bootstrap required, opened a new log
I20260709 12:26:44.388532  1265 ts_tablet_manager.cc:1403] T ec47b02d68674e2386a86244d9026b78 P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent bootstrapping tablet: real 0.106s	user 0.030s	sys 0.035s
I20260709 12:26:44.388167  1266 raft_consensus.cc:359] T 580f367489064e218eef65b4654744b8 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:44.389170  1266 raft_consensus.cc:385] T 580f367489064e218eef65b4654744b8 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.389557  1266 raft_consensus.cc:740] T 580f367489064e218eef65b4654744b8 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.392383  1265 raft_consensus.cc:359] T ec47b02d68674e2386a86244d9026b78 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:44.393285  1265 raft_consensus.cc:385] T ec47b02d68674e2386a86244d9026b78 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.393621  1265 raft_consensus.cc:740] T ec47b02d68674e2386a86244d9026b78 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.401288   894 catalog_manager.cc:5697] T b8e49440650449f49e5303568f2f19c0 P 937efeddef934b2b8bc8632594903085 reported cstate change: term changed from 0 to 1, leader changed from <none> to 937efeddef934b2b8bc8632594903085 (127.23.245.132). New cstate: current_term: 1 leader_uuid: "937efeddef934b2b8bc8632594903085" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:44.390793  1266 consensus_queue.cc:260] T 580f367489064e218eef65b4654744b8 P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:44.404474  1266 ts_tablet_manager.cc:1434] T 580f367489064e218eef65b4654744b8 P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:26:44.404666  1359 raft_consensus.cc:515] T acc6ab0dce1640e380b433b32a874108 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:44.405786  1266 tablet_bootstrap.cc:492] T ec47b02d68674e2386a86244d9026b78 P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:44.407855  1359 leader_election.cc:290] T acc6ab0dce1640e380b433b32a874108 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 election: Requested vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:26:44.409010  1144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc6ab0dce1640e380b433b32a874108" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20"
I20260709 12:26:44.409803  1144 raft_consensus.cc:3060] T acc6ab0dce1640e380b433b32a874108 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:44.411064  1265 consensus_queue.cc:260] T ec47b02d68674e2386a86244d9026b78 P 7f9cbe40e40d429aa004e4a7fb42f132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:44.413116  1265 ts_tablet_manager.cc:1434] T ec47b02d68674e2386a86244d9026b78 P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent starting tablet: real 0.024s	user 0.001s	sys 0.007s
I20260709 12:26:44.414206  1265 tablet_bootstrap.cc:492] T c495ce9da627479e92d7b24b3be3641a P 7f9cbe40e40d429aa004e4a7fb42f132: Bootstrap starting.
I20260709 12:26:44.409010  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc6ab0dce1640e380b433b32a874108" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085"
I20260709 12:26:44.416180  1220 raft_consensus.cc:3060] T acc6ab0dce1640e380b433b32a874108 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:44.423112  1266 tablet_bootstrap.cc:654] T ec47b02d68674e2386a86244d9026b78 P aa098a557d34433896712068efd0d9a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.428897  1265 tablet_bootstrap.cc:654] T c495ce9da627479e92d7b24b3be3641a P 7f9cbe40e40d429aa004e4a7fb42f132: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.428318   893 catalog_manager.cc:5697] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 8fa35514a8d84740b1b46ae496307f20 reported cstate change: term changed from 0 to 2, leader changed from <none> to 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131). New cstate: current_term: 2 leader_uuid: "8fa35514a8d84740b1b46ae496307f20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:44.435370  1144 raft_consensus.cc:2468] T acc6ab0dce1640e380b433b32a874108 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f9cbe40e40d429aa004e4a7fb42f132 in term 1.
I20260709 12:26:44.436986  1038 leader_election.cc:304] T acc6ab0dce1640e380b433b32a874108 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 8fa35514a8d84740b1b46ae496307f20; no voters: 
I20260709 12:26:44.409447  1267 tablet_bootstrap.cc:492] T b8e49440650449f49e5303568f2f19c0 P 8fa35514a8d84740b1b46ae496307f20: No bootstrap required, opened a new log
I20260709 12:26:44.439633  1323 raft_consensus.cc:2804] T acc6ab0dce1640e380b433b32a874108 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:44.440192  1323 raft_consensus.cc:697] T acc6ab0dce1640e380b433b32a874108 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 LEADER]: Becoming Leader. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Running, Role: LEADER
I20260709 12:26:44.440421  1267 ts_tablet_manager.cc:1403] T b8e49440650449f49e5303568f2f19c0 P 8fa35514a8d84740b1b46ae496307f20: Time spent bootstrapping tablet: real 0.081s	user 0.014s	sys 0.008s
I20260709 12:26:44.440887  1323 consensus_queue.cc:237] T acc6ab0dce1640e380b433b32a874108 P 7f9cbe40e40d429aa004e4a7fb42f132 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:44.443463  1267 raft_consensus.cc:359] T b8e49440650449f49e5303568f2f19c0 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:44.444419  1267 raft_consensus.cc:385] T b8e49440650449f49e5303568f2f19c0 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.444677  1267 raft_consensus.cc:740] T b8e49440650449f49e5303568f2f19c0 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.445355  1267 consensus_queue.cc:260] T b8e49440650449f49e5303568f2f19c0 P 8fa35514a8d84740b1b46ae496307f20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:44.445930  1265 tablet_bootstrap.cc:492] T c495ce9da627479e92d7b24b3be3641a P 7f9cbe40e40d429aa004e4a7fb42f132: No bootstrap required, opened a new log
I20260709 12:26:44.446385  1265 ts_tablet_manager.cc:1403] T c495ce9da627479e92d7b24b3be3641a P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.003s
I20260709 12:26:44.447504  1267 ts_tablet_manager.cc:1434] T b8e49440650449f49e5303568f2f19c0 P 8fa35514a8d84740b1b46ae496307f20: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.001s
I20260709 12:26:44.437409  1220 raft_consensus.cc:2468] T acc6ab0dce1640e380b433b32a874108 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f9cbe40e40d429aa004e4a7fb42f132 in term 1.
I20260709 12:26:44.438896  1264 tablet_bootstrap.cc:654] T edea2a0a3c264f2b810295aea0acfb73 P 937efeddef934b2b8bc8632594903085: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.452821  1267 tablet_bootstrap.cc:492] T edea2a0a3c264f2b810295aea0acfb73 P 8fa35514a8d84740b1b46ae496307f20: Bootstrap starting.
I20260709 12:26:44.449082  1265 raft_consensus.cc:359] T c495ce9da627479e92d7b24b3be3641a P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:44.459415  1265 raft_consensus.cc:385] T c495ce9da627479e92d7b24b3be3641a P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.459739  1265 raft_consensus.cc:740] T c495ce9da627479e92d7b24b3be3641a P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.460309  1267 tablet_bootstrap.cc:654] T edea2a0a3c264f2b810295aea0acfb73 P 8fa35514a8d84740b1b46ae496307f20: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.460505  1265 consensus_queue.cc:260] T c495ce9da627479e92d7b24b3be3641a P 7f9cbe40e40d429aa004e4a7fb42f132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:44.463006  1265 ts_tablet_manager.cc:1434] T c495ce9da627479e92d7b24b3be3641a P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:26:44.463303  1264 tablet_bootstrap.cc:492] T edea2a0a3c264f2b810295aea0acfb73 P 937efeddef934b2b8bc8632594903085: No bootstrap required, opened a new log
I20260709 12:26:44.464481  1265 tablet_bootstrap.cc:492] T edea2a0a3c264f2b810295aea0acfb73 P 7f9cbe40e40d429aa004e4a7fb42f132: Bootstrap starting.
I20260709 12:26:44.463804  1264 ts_tablet_manager.cc:1403] T edea2a0a3c264f2b810295aea0acfb73 P 937efeddef934b2b8bc8632594903085: Time spent bootstrapping tablet: real 0.162s	user 0.007s	sys 0.006s
I20260709 12:26:44.470007  1264 raft_consensus.cc:359] T edea2a0a3c264f2b810295aea0acfb73 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:44.470685  1264 raft_consensus.cc:385] T edea2a0a3c264f2b810295aea0acfb73 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.472891  1264 raft_consensus.cc:740] T edea2a0a3c264f2b810295aea0acfb73 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 937efeddef934b2b8bc8632594903085, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.473793  1264 consensus_queue.cc:260] T edea2a0a3c264f2b810295aea0acfb73 P 937efeddef934b2b8bc8632594903085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:44.478147  1264 ts_tablet_manager.cc:1434] T edea2a0a3c264f2b810295aea0acfb73 P 937efeddef934b2b8bc8632594903085: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:26:44.479908  1369 raft_consensus.cc:493] T 580f367489064e218eef65b4654744b8 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.480713  1369 raft_consensus.cc:515] T 580f367489064e218eef65b4654744b8 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:44.479848  1264 tablet_bootstrap.cc:492] T ec47b02d68674e2386a86244d9026b78 P 937efeddef934b2b8bc8632594903085: Bootstrap starting.
I20260709 12:26:44.484551  1265 tablet_bootstrap.cc:654] T edea2a0a3c264f2b810295aea0acfb73 P 7f9cbe40e40d429aa004e4a7fb42f132: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.486095  1144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580f367489064e218eef65b4654744b8" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:44.486953  1144 raft_consensus.cc:2393] T 580f367489064e218eef65b4654744b8 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aa098a557d34433896712068efd0d9a8 in current term 1: Already voted for candidate 937efeddef934b2b8bc8632594903085 in this term.
I20260709 12:26:44.489504  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "580f367489064e218eef65b4654744b8" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:44.490114  1264 tablet_bootstrap.cc:654] T ec47b02d68674e2386a86244d9026b78 P 937efeddef934b2b8bc8632594903085: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.492434  1369 leader_election.cc:290] T 580f367489064e218eef65b4654744b8 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:26:44.490904  1365 raft_consensus.cc:493] T b8e49440650449f49e5303568f2f19c0 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.499449  1365 raft_consensus.cc:515] T b8e49440650449f49e5303568f2f19c0 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:44.500571  1267 tablet_bootstrap.cc:492] T edea2a0a3c264f2b810295aea0acfb73 P 8fa35514a8d84740b1b46ae496307f20: No bootstrap required, opened a new log
I20260709 12:26:44.501171  1267 ts_tablet_manager.cc:1403] T edea2a0a3c264f2b810295aea0acfb73 P 8fa35514a8d84740b1b46ae496307f20: Time spent bootstrapping tablet: real 0.049s	user 0.016s	sys 0.013s
I20260709 12:26:44.501784  1365 leader_election.cc:290] T b8e49440650449f49e5303568f2f19c0 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:26:44.502388  1068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e49440650449f49e5303568f2f19c0" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:44.503242  1068 raft_consensus.cc:2393] T b8e49440650449f49e5303568f2f19c0 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8fa35514a8d84740b1b46ae496307f20 in current term 1: Already voted for candidate 937efeddef934b2b8bc8632594903085 in this term.
I20260709 12:26:44.506353   960 leader_election.cc:304] T 580f367489064e218eef65b4654744b8 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa098a557d34433896712068efd0d9a8; no voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085
I20260709 12:26:44.507404  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e49440650449f49e5303568f2f19c0" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:44.508440  1369 raft_consensus.cc:3060] T 580f367489064e218eef65b4654744b8 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:44.509445  1110 leader_election.cc:304] T b8e49440650449f49e5303568f2f19c0 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20; no voters: 7f9cbe40e40d429aa004e4a7fb42f132, 937efeddef934b2b8bc8632594903085
I20260709 12:26:44.514010  1267 raft_consensus.cc:359] T edea2a0a3c264f2b810295aea0acfb73 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:44.514652  1267 raft_consensus.cc:385] T edea2a0a3c264f2b810295aea0acfb73 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.514914  1267 raft_consensus.cc:740] T edea2a0a3c264f2b810295aea0acfb73 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.516171  1365 raft_consensus.cc:3060] T b8e49440650449f49e5303568f2f19c0 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:44.517132  1267 consensus_queue.cc:260] T edea2a0a3c264f2b810295aea0acfb73 P 8fa35514a8d84740b1b46ae496307f20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:44.518685  1265 tablet_bootstrap.cc:492] T edea2a0a3c264f2b810295aea0acfb73 P 7f9cbe40e40d429aa004e4a7fb42f132: No bootstrap required, opened a new log
I20260709 12:26:44.519198  1265 ts_tablet_manager.cc:1403] T edea2a0a3c264f2b810295aea0acfb73 P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent bootstrapping tablet: real 0.055s	user 0.012s	sys 0.015s
I20260709 12:26:44.519579  1267 ts_tablet_manager.cc:1434] T edea2a0a3c264f2b810295aea0acfb73 P 8fa35514a8d84740b1b46ae496307f20: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.001s
I20260709 12:26:44.520799  1267 tablet_bootstrap.cc:492] T 343e626d0073462fa2020fcf2e2f8ffb P 8fa35514a8d84740b1b46ae496307f20: Bootstrap starting.
I20260709 12:26:44.521889  1265 raft_consensus.cc:359] T edea2a0a3c264f2b810295aea0acfb73 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:44.522282  1264 tablet_bootstrap.cc:492] T ec47b02d68674e2386a86244d9026b78 P 937efeddef934b2b8bc8632594903085: No bootstrap required, opened a new log
I20260709 12:26:44.522444  1265 raft_consensus.cc:385] T edea2a0a3c264f2b810295aea0acfb73 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.522794  1265 raft_consensus.cc:740] T edea2a0a3c264f2b810295aea0acfb73 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.522796  1264 ts_tablet_manager.cc:1403] T ec47b02d68674e2386a86244d9026b78 P 937efeddef934b2b8bc8632594903085: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.001s
I20260709 12:26:44.524958  1369 raft_consensus.cc:2749] T 580f367489064e218eef65b4654744b8 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:44.525173  1266 tablet_bootstrap.cc:492] T ec47b02d68674e2386a86244d9026b78 P aa098a557d34433896712068efd0d9a8: No bootstrap required, opened a new log
I20260709 12:26:44.527889  1266 ts_tablet_manager.cc:1403] T ec47b02d68674e2386a86244d9026b78 P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.122s	user 0.011s	sys 0.036s
I20260709 12:26:44.528029  1365 raft_consensus.cc:2749] T b8e49440650449f49e5303568f2f19c0 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:44.528681  1264 raft_consensus.cc:359] T ec47b02d68674e2386a86244d9026b78 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:44.529400  1264 raft_consensus.cc:385] T ec47b02d68674e2386a86244d9026b78 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.529672  1264 raft_consensus.cc:740] T ec47b02d68674e2386a86244d9026b78 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 937efeddef934b2b8bc8632594903085, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.523525  1265 consensus_queue.cc:260] T edea2a0a3c264f2b810295aea0acfb73 P 7f9cbe40e40d429aa004e4a7fb42f132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:44.526103  1327 raft_consensus.cc:493] T edea2a0a3c264f2b810295aea0acfb73 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.530472  1327 raft_consensus.cc:515] T edea2a0a3c264f2b810295aea0acfb73 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:44.530509  1264 consensus_queue.cc:260] T ec47b02d68674e2386a86244d9026b78 P 937efeddef934b2b8bc8632594903085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:44.527307  1267 tablet_bootstrap.cc:654] T 343e626d0073462fa2020fcf2e2f8ffb P 8fa35514a8d84740b1b46ae496307f20: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.530745  1266 raft_consensus.cc:359] T ec47b02d68674e2386a86244d9026b78 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:44.531618  1266 raft_consensus.cc:385] T ec47b02d68674e2386a86244d9026b78 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.531909  1266 raft_consensus.cc:740] T ec47b02d68674e2386a86244d9026b78 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.532830  1327 leader_election.cc:290] T edea2a0a3c264f2b810295aea0acfb73 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679), 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341)
I20260709 12:26:44.534056  1144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edea2a0a3c264f2b810295aea0acfb73" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:44.534723  1144 raft_consensus.cc:2468] T edea2a0a3c264f2b810295aea0acfb73 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 0.
I20260709 12:26:44.536399  1186 leader_election.cc:304] T edea2a0a3c264f2b810295aea0acfb73 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085; no voters: 
I20260709 12:26:44.534598  1068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edea2a0a3c264f2b810295aea0acfb73" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:44.537132  1265 ts_tablet_manager.cc:1434] T edea2a0a3c264f2b810295aea0acfb73 P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:26:44.537242  1068 raft_consensus.cc:2468] T edea2a0a3c264f2b810295aea0acfb73 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 0.
I20260709 12:26:44.537915  1323 raft_consensus.cc:493] T edea2a0a3c264f2b810295aea0acfb73 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.538391  1323 raft_consensus.cc:515] T edea2a0a3c264f2b810295aea0acfb73 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:44.538805  1265 tablet_bootstrap.cc:492] T c77af7e1c2044a8eacfe0e76ee974591 P 7f9cbe40e40d429aa004e4a7fb42f132: Bootstrap starting.
I20260709 12:26:44.532661  1266 consensus_queue.cc:260] T ec47b02d68674e2386a86244d9026b78 P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:44.541086  1327 raft_consensus.cc:2804] T edea2a0a3c264f2b810295aea0acfb73 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:44.541512  1327 raft_consensus.cc:493] T edea2a0a3c264f2b810295aea0acfb73 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:44.541893  1327 raft_consensus.cc:3060] T edea2a0a3c264f2b810295aea0acfb73 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:44.545666  1376 raft_consensus.cc:493] T c495ce9da627479e92d7b24b3be3641a P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.546604  1265 tablet_bootstrap.cc:654] T c77af7e1c2044a8eacfe0e76ee974591 P 7f9cbe40e40d429aa004e4a7fb42f132: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.546231  1376 raft_consensus.cc:515] T c495ce9da627479e92d7b24b3be3641a P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:44.546728   894 catalog_manager.cc:5697] T acc6ab0dce1640e380b433b32a874108 P 7f9cbe40e40d429aa004e4a7fb42f132 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130). New cstate: current_term: 1 leader_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:44.553262  1264 ts_tablet_manager.cc:1434] T ec47b02d68674e2386a86244d9026b78 P 937efeddef934b2b8bc8632594903085: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.000s
I20260709 12:26:44.551355  1327 raft_consensus.cc:515] T edea2a0a3c264f2b810295aea0acfb73 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:44.554926  1323 leader_election.cc:290] T edea2a0a3c264f2b810295aea0acfb73 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:26:44.554435  1264 tablet_bootstrap.cc:492] T c4234c6cf75048c5a6cdf34e43c9bd1e P 937efeddef934b2b8bc8632594903085: Bootstrap starting.
I20260709 12:26:44.555624   996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c495ce9da627479e92d7b24b3be3641a" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
I20260709 12:26:44.555997  1144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edea2a0a3c264f2b810295aea0acfb73" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:44.588869  1144 raft_consensus.cc:2468] T edea2a0a3c264f2b810295aea0acfb73 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f9cbe40e40d429aa004e4a7fb42f132 in term 0.
I20260709 12:26:44.589408  1265 tablet_bootstrap.cc:492] T c77af7e1c2044a8eacfe0e76ee974591 P 7f9cbe40e40d429aa004e4a7fb42f132: No bootstrap required, opened a new log
I20260709 12:26:44.589906  1265 ts_tablet_manager.cc:1403] T c77af7e1c2044a8eacfe0e76ee974591 P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent bootstrapping tablet: real 0.051s	user 0.031s	sys 0.020s
I20260709 12:26:44.590664  1267 tablet_bootstrap.cc:492] T 343e626d0073462fa2020fcf2e2f8ffb P 8fa35514a8d84740b1b46ae496307f20: No bootstrap required, opened a new log
I20260709 12:26:44.590428  1038 leader_election.cc:304] T edea2a0a3c264f2b810295aea0acfb73 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 8fa35514a8d84740b1b46ae496307f20; no voters: 
I20260709 12:26:44.557773  1327 leader_election.cc:290] T edea2a0a3c264f2b810295aea0acfb73 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Requested vote from peers 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679), 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341)
I20260709 12:26:44.591529  1323 raft_consensus.cc:2804] T edea2a0a3c264f2b810295aea0acfb73 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:44.592031  1323 raft_consensus.cc:493] T edea2a0a3c264f2b810295aea0acfb73 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:44.592223  1186 leader_election.cc:343] T c495ce9da627479e92d7b24b3be3641a P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:44.561074  1376 leader_election.cc:290] T c495ce9da627479e92d7b24b3be3641a P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:44.592967  1265 raft_consensus.cc:359] T c77af7e1c2044a8eacfe0e76ee974591 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:44.593402  1264 tablet_bootstrap.cc:654] T c4234c6cf75048c5a6cdf34e43c9bd1e P 937efeddef934b2b8bc8632594903085: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.592348  1323 raft_consensus.cc:3060] T edea2a0a3c264f2b810295aea0acfb73 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:44.573314  1451 raft_consensus.cc:493] T c4234c6cf75048c5a6cdf34e43c9bd1e P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.573566  1374 consensus_queue.cc:1048] T 580f367489064e218eef65b4654744b8 P 937efeddef934b2b8bc8632594903085 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 12:26:44.594491  1451 raft_consensus.cc:515] T c4234c6cf75048c5a6cdf34e43c9bd1e P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:44.579703  1359 raft_consensus.cc:493] T 333930b9df5744d59ab498b170a35315 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.561633  1336 consensus_queue.cc:1048] T e5af913e96004f3b8cac5fbe6ac655ac P aa098a557d34433896712068efd0d9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.032s
I20260709 12:26:44.573850  1068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edea2a0a3c264f2b810295aea0acfb73" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
I20260709 12:26:44.564182  1146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edea2a0a3c264f2b810295aea0acfb73" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20"
I20260709 12:26:44.598037  1146 raft_consensus.cc:3060] T edea2a0a3c264f2b810295aea0acfb73 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:44.596486  1359 raft_consensus.cc:515] T 333930b9df5744d59ab498b170a35315 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:44.603004  1359 leader_election.cc:290] T 333930b9df5744d59ab498b170a35315 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341)
I20260709 12:26:44.585608  1266 ts_tablet_manager.cc:1434] T ec47b02d68674e2386a86244d9026b78 P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.057s	user 0.003s	sys 0.003s
I20260709 12:26:44.605334  1266 tablet_bootstrap.cc:492] T 6715731f9a31415a98fa8a0ab9944eec P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:44.560436  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edea2a0a3c264f2b810295aea0acfb73" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:44.606262  1220 raft_consensus.cc:2393] T edea2a0a3c264f2b810295aea0acfb73 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7f9cbe40e40d429aa004e4a7fb42f132 in current term 1: Already voted for candidate 937efeddef934b2b8bc8632594903085 in this term.
I20260709 12:26:44.608989  1451 leader_election.cc:290] T c4234c6cf75048c5a6cdf34e43c9bd1e P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:26:44.609548  1451 consensus_queue.cc:1048] T e5af913e96004f3b8cac5fbe6ac655ac P aa098a557d34433896712068efd0d9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:44.593711  1265 raft_consensus.cc:385] T c77af7e1c2044a8eacfe0e76ee974591 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.610337  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4234c6cf75048c5a6cdf34e43c9bd1e" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:44.563773  1072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c495ce9da627479e92d7b24b3be3641a" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:44.613603   996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "333930b9df5744d59ab498b170a35315" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
I20260709 12:26:44.615446  1266 tablet_bootstrap.cc:654] T 6715731f9a31415a98fa8a0ab9944eec P aa098a557d34433896712068efd0d9a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.615976  1143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4234c6cf75048c5a6cdf34e43c9bd1e" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:44.616911  1143 raft_consensus.cc:2468] T c4234c6cf75048c5a6cdf34e43c9bd1e P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa098a557d34433896712068efd0d9a8 in term 0.
I20260709 12:26:44.611142  1359 raft_consensus.cc:493] T c495ce9da627479e92d7b24b3be3641a P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.618907   963 leader_election.cc:304] T c4234c6cf75048c5a6cdf34e43c9bd1e P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20, aa098a557d34433896712068efd0d9a8; no voters: 
I20260709 12:26:44.619174  1359 raft_consensus.cc:515] T c495ce9da627479e92d7b24b3be3641a P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:44.615965  1142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "333930b9df5744d59ab498b170a35315" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:44.620699  1072 raft_consensus.cc:2468] T c495ce9da627479e92d7b24b3be3641a P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 0.
I20260709 12:26:44.610739  1265 raft_consensus.cc:740] T c77af7e1c2044a8eacfe0e76ee974591 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.626367  1267 ts_tablet_manager.cc:1403] T 343e626d0073462fa2020fcf2e2f8ffb P 8fa35514a8d84740b1b46ae496307f20: Time spent bootstrapping tablet: real 0.106s	user 0.011s	sys 0.017s
I20260709 12:26:44.629031  1371 raft_consensus.cc:2804] T c4234c6cf75048c5a6cdf34e43c9bd1e P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:44.637442  1265 consensus_queue.cc:260] T c77af7e1c2044a8eacfe0e76ee974591 P 7f9cbe40e40d429aa004e4a7fb42f132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
W20260709 12:26:44.638985   960 leader_election.cc:343] T c4234c6cf75048c5a6cdf34e43c9bd1e P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:44.640184  1371 raft_consensus.cc:493] T c4234c6cf75048c5a6cdf34e43c9bd1e P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:44.632754  1038 leader_election.cc:343] T 333930b9df5744d59ab498b170a35315 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:44.643725  1038 leader_election.cc:343] T 333930b9df5744d59ab498b170a35315 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:44.644198  1038 leader_election.cc:304] T 333930b9df5744d59ab498b170a35315 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132; no voters: 8fa35514a8d84740b1b46ae496307f20, aa098a557d34433896712068efd0d9a8
I20260709 12:26:44.645231  1371 raft_consensus.cc:3060] T c4234c6cf75048c5a6cdf34e43c9bd1e P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:44.646436  1320 raft_consensus.cc:2749] T 333930b9df5744d59ab498b170a35315 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:44.648458  1184 leader_election.cc:304] T c495ce9da627479e92d7b24b3be3641a P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 937efeddef934b2b8bc8632594903085; no voters: aa098a557d34433896712068efd0d9a8
I20260709 12:26:44.649103  1265 ts_tablet_manager.cc:1434] T c77af7e1c2044a8eacfe0e76ee974591 P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.001s
I20260709 12:26:44.649665  1374 raft_consensus.cc:2804] T c495ce9da627479e92d7b24b3be3641a P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:44.650084  1374 raft_consensus.cc:493] T c495ce9da627479e92d7b24b3be3641a P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:44.650242  1265 tablet_bootstrap.cc:492] T b364263cacab4add984e2b6c912fb62e P 7f9cbe40e40d429aa004e4a7fb42f132: Bootstrap starting.
I20260709 12:26:44.650470  1374 raft_consensus.cc:3060] T c495ce9da627479e92d7b24b3be3641a P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:44.657994  1265 tablet_bootstrap.cc:654] T b364263cacab4add984e2b6c912fb62e P 7f9cbe40e40d429aa004e4a7fb42f132: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.661424  1359 leader_election.cc:290] T c495ce9da627479e92d7b24b3be3641a P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:44.663002  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c495ce9da627479e92d7b24b3be3641a" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:44.667836   996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c495ce9da627479e92d7b24b3be3641a" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
W20260709 12:26:44.670320  1038 leader_election.cc:343] T c495ce9da627479e92d7b24b3be3641a P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:44.686902  1323 raft_consensus.cc:515] T edea2a0a3c264f2b810295aea0acfb73 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:44.688181  1068 raft_consensus.cc:2393] T edea2a0a3c264f2b810295aea0acfb73 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 937efeddef934b2b8bc8632594903085 in current term 1: Already voted for candidate 7f9cbe40e40d429aa004e4a7fb42f132 in this term.
I20260709 12:26:44.690804  1374 raft_consensus.cc:515] T c495ce9da627479e92d7b24b3be3641a P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:44.704097  1220 raft_consensus.cc:2393] T c495ce9da627479e92d7b24b3be3641a P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7f9cbe40e40d429aa004e4a7fb42f132 in current term 1: Already voted for candidate 937efeddef934b2b8bc8632594903085 in this term.
I20260709 12:26:44.706151  1035 leader_election.cc:304] T c495ce9da627479e92d7b24b3be3641a P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132; no voters: 937efeddef934b2b8bc8632594903085, aa098a557d34433896712068efd0d9a8
I20260709 12:26:44.692641  1371 raft_consensus.cc:515] T c4234c6cf75048c5a6cdf34e43c9bd1e P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:44.707206  1320 raft_consensus.cc:3060] T c495ce9da627479e92d7b24b3be3641a P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:44.709038   996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c495ce9da627479e92d7b24b3be3641a" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8"
W20260709 12:26:44.710700  1186 leader_election.cc:343] T c495ce9da627479e92d7b24b3be3641a P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:44.713287  1452 raft_consensus.cc:493] T ec47b02d68674e2386a86244d9026b78 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.713981  1452 raft_consensus.cc:515] T ec47b02d68674e2386a86244d9026b78 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:44.716682  1320 raft_consensus.cc:2749] T c495ce9da627479e92d7b24b3be3641a P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:44.717007  1452 leader_election.cc:290] T ec47b02d68674e2386a86244d9026b78 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:44.718227  1072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec47b02d68674e2386a86244d9026b78" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:44.718926  1072 raft_consensus.cc:2468] T ec47b02d68674e2386a86244d9026b78 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa098a557d34433896712068efd0d9a8 in term 0.
I20260709 12:26:44.719904  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec47b02d68674e2386a86244d9026b78" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:44.720830  1220 raft_consensus.cc:2468] T ec47b02d68674e2386a86244d9026b78 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa098a557d34433896712068efd0d9a8 in term 0.
I20260709 12:26:44.722198   961 leader_election.cc:304] T ec47b02d68674e2386a86244d9026b78 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, aa098a557d34433896712068efd0d9a8; no voters: 
I20260709 12:26:44.722604  1374 leader_election.cc:290] T c495ce9da627479e92d7b24b3be3641a P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Requested vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:44.723096  1336 raft_consensus.cc:2804] T ec47b02d68674e2386a86244d9026b78 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:44.723521  1336 raft_consensus.cc:493] T ec47b02d68674e2386a86244d9026b78 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:44.723881  1336 raft_consensus.cc:3060] T ec47b02d68674e2386a86244d9026b78 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:44.728531  1072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c495ce9da627479e92d7b24b3be3641a" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
I20260709 12:26:44.732484  1145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4234c6cf75048c5a6cdf34e43c9bd1e" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20"
I20260709 12:26:44.733242  1145 raft_consensus.cc:3060] T c4234c6cf75048c5a6cdf34e43c9bd1e P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:44.734620  1365 raft_consensus.cc:493] T 6715731f9a31415a98fa8a0ab9944eec P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.735095  1365 raft_consensus.cc:515] T 6715731f9a31415a98fa8a0ab9944eec P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:44.735461  1265 tablet_bootstrap.cc:492] T b364263cacab4add984e2b6c912fb62e P 7f9cbe40e40d429aa004e4a7fb42f132: No bootstrap required, opened a new log
I20260709 12:26:44.736052  1265 ts_tablet_manager.cc:1403] T b364263cacab4add984e2b6c912fb62e P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent bootstrapping tablet: real 0.086s	user 0.012s	sys 0.014s
I20260709 12:26:44.737197  1365 leader_election.cc:290] T 6715731f9a31415a98fa8a0ab9944eec P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:44.738755  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6715731f9a31415a98fa8a0ab9944eec" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:44.738844  1265 raft_consensus.cc:359] T b364263cacab4add984e2b6c912fb62e P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:44.739758  1265 raft_consensus.cc:385] T b364263cacab4add984e2b6c912fb62e P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.740064  1265 raft_consensus.cc:740] T b364263cacab4add984e2b6c912fb62e P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.740757  1265 consensus_queue.cc:260] T b364263cacab4add984e2b6c912fb62e P 7f9cbe40e40d429aa004e4a7fb42f132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
W20260709 12:26:44.740891  1109 leader_election.cc:343] T 6715731f9a31415a98fa8a0ab9944eec P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:44.742550   996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6715731f9a31415a98fa8a0ab9944eec" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
W20260709 12:26:44.744354  1112 leader_election.cc:343] T 6715731f9a31415a98fa8a0ab9944eec P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:44.745070  1112 leader_election.cc:304] T 6715731f9a31415a98fa8a0ab9944eec P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20; no voters: 937efeddef934b2b8bc8632594903085, aa098a557d34433896712068efd0d9a8
W20260709 12:26:44.746973   943 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:44.750380  1365 raft_consensus.cc:2749] T 6715731f9a31415a98fa8a0ab9944eec P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:44.751296  1265 ts_tablet_manager.cc:1434] T b364263cacab4add984e2b6c912fb62e P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:26:44.760533  1265 tablet_bootstrap.cc:492] T 98b5b180139845c99c537cd675a60830 P 7f9cbe40e40d429aa004e4a7fb42f132: Bootstrap starting.
I20260709 12:26:44.761476  1146 raft_consensus.cc:2468] T edea2a0a3c264f2b810295aea0acfb73 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 1.
I20260709 12:26:44.762848  1186 leader_election.cc:304] T edea2a0a3c264f2b810295aea0acfb73 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085; no voters: 7f9cbe40e40d429aa004e4a7fb42f132
I20260709 12:26:44.763330  1266 tablet_bootstrap.cc:492] T 6715731f9a31415a98fa8a0ab9944eec P aa098a557d34433896712068efd0d9a8: No bootstrap required, opened a new log
I20260709 12:26:44.763165  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4234c6cf75048c5a6cdf34e43c9bd1e" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085"
W20260709 12:26:44.763661  1454 log.cc:927] Time spent T 580f367489064e218eef65b4654744b8 P 8fa35514a8d84740b1b46ae496307f20: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 12:26:44.764125  1374 raft_consensus.cc:2804] T edea2a0a3c264f2b810295aea0acfb73 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:44.764397  1266 ts_tablet_manager.cc:1403] T 6715731f9a31415a98fa8a0ab9944eec P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.159s	user 0.049s	sys 0.049s
W20260709 12:26:44.764648   960 leader_election.cc:343] T c4234c6cf75048c5a6cdf34e43c9bd1e P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:44.764689  1374 raft_consensus.cc:697] T edea2a0a3c264f2b810295aea0acfb73 P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Becoming Leader. State: Replica: 937efeddef934b2b8bc8632594903085, State: Running, Role: LEADER
I20260709 12:26:44.765338  1371 leader_election.cc:290] T c4234c6cf75048c5a6cdf34e43c9bd1e P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 election: Requested vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:26:44.765744  1374 consensus_queue.cc:237] T edea2a0a3c264f2b810295aea0acfb73 P 937efeddef934b2b8bc8632594903085 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:44.767339  1266 raft_consensus.cc:359] T 6715731f9a31415a98fa8a0ab9944eec P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:44.768081  1266 raft_consensus.cc:385] T 6715731f9a31415a98fa8a0ab9944eec P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.767557  1336 raft_consensus.cc:515] T ec47b02d68674e2386a86244d9026b78 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:44.768393  1266 raft_consensus.cc:740] T 6715731f9a31415a98fa8a0ab9944eec P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.769896  1323 leader_election.cc:290] T edea2a0a3c264f2b810295aea0acfb73 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 election: Requested vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:26:44.757858  1267 raft_consensus.cc:359] T 343e626d0073462fa2020fcf2e2f8ffb P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:44.774384  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edea2a0a3c264f2b810295aea0acfb73" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085"
I20260709 12:26:44.779050  1267 raft_consensus.cc:385] T 343e626d0073462fa2020fcf2e2f8ffb P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.779486  1267 raft_consensus.cc:740] T 343e626d0073462fa2020fcf2e2f8ffb P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.779163  1266 consensus_queue.cc:260] T 6715731f9a31415a98fa8a0ab9944eec P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:44.774974  1146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edea2a0a3c264f2b810295aea0acfb73" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20"
I20260709 12:26:44.780697  1146 raft_consensus.cc:2393] T edea2a0a3c264f2b810295aea0acfb73 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7f9cbe40e40d429aa004e4a7fb42f132 in current term 1: Already voted for candidate 937efeddef934b2b8bc8632594903085 in this term.
I20260709 12:26:44.786652  1068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec47b02d68674e2386a86244d9026b78" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
I20260709 12:26:44.787446  1265 tablet_bootstrap.cc:654] T 98b5b180139845c99c537cd675a60830 P 7f9cbe40e40d429aa004e4a7fb42f132: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.787881  1038 leader_election.cc:304] T edea2a0a3c264f2b810295aea0acfb73 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132; no voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085
I20260709 12:26:44.788719  1323 raft_consensus.cc:2749] T edea2a0a3c264f2b810295aea0acfb73 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:26:44.790458  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec47b02d68674e2386a86244d9026b78" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085"
I20260709 12:26:44.778231  1264 tablet_bootstrap.cc:492] T c4234c6cf75048c5a6cdf34e43c9bd1e P 937efeddef934b2b8bc8632594903085: No bootstrap required, opened a new log
I20260709 12:26:44.780215  1267 consensus_queue.cc:260] T 343e626d0073462fa2020fcf2e2f8ffb P 8fa35514a8d84740b1b46ae496307f20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:44.791085  1220 raft_consensus.cc:3060] T ec47b02d68674e2386a86244d9026b78 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:44.791376  1264 ts_tablet_manager.cc:1403] T c4234c6cf75048c5a6cdf34e43c9bd1e P 937efeddef934b2b8bc8632594903085: Time spent bootstrapping tablet: real 0.237s	user 0.039s	sys 0.046s
I20260709 12:26:44.784376  1336 leader_election.cc:290] T ec47b02d68674e2386a86244d9026b78 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 election: Requested vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:44.745309  1072 raft_consensus.cc:2468] T c495ce9da627479e92d7b24b3be3641a P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 1.
I20260709 12:26:44.792814  1267 ts_tablet_manager.cc:1434] T 343e626d0073462fa2020fcf2e2f8ffb P 8fa35514a8d84740b1b46ae496307f20: Time spent starting tablet: real 0.166s	user 0.007s	sys 0.001s
I20260709 12:26:44.781915  1266 ts_tablet_manager.cc:1434] T 6715731f9a31415a98fa8a0ab9944eec P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:26:44.798102  1323 raft_consensus.cc:493] T b364263cacab4add984e2b6c912fb62e P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.809939  1323 raft_consensus.cc:515] T b364263cacab4add984e2b6c912fb62e P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:44.810921  1184 leader_election.cc:304] T c495ce9da627479e92d7b24b3be3641a P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 937efeddef934b2b8bc8632594903085; no voters: aa098a557d34433896712068efd0d9a8
I20260709 12:26:44.811743  1376 raft_consensus.cc:2804] T c495ce9da627479e92d7b24b3be3641a P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:44.812911   996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b364263cacab4add984e2b6c912fb62e" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
W20260709 12:26:44.814347  1038 leader_election.cc:343] T b364263cacab4add984e2b6c912fb62e P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:44.800122   892 catalog_manager.cc:5697] T edea2a0a3c264f2b810295aea0acfb73 P 937efeddef934b2b8bc8632594903085 reported cstate change: term changed from 0 to 1, leader changed from <none> to 937efeddef934b2b8bc8632594903085 (127.23.245.132). New cstate: current_term: 1 leader_uuid: "937efeddef934b2b8bc8632594903085" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:44.787411  1068 raft_consensus.cc:3060] T ec47b02d68674e2386a86244d9026b78 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:44.817569  1265 tablet_bootstrap.cc:492] T 98b5b180139845c99c537cd675a60830 P 7f9cbe40e40d429aa004e4a7fb42f132: No bootstrap required, opened a new log
I20260709 12:26:44.818205  1265 ts_tablet_manager.cc:1403] T 98b5b180139845c99c537cd675a60830 P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent bootstrapping tablet: real 0.058s	user 0.014s	sys 0.001s
I20260709 12:26:44.802439  1374 consensus_queue.cc:1048] T 580f367489064e218eef65b4654744b8 P 937efeddef934b2b8bc8632594903085 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:44.805708  1327 consensus_queue.cc:1048] T b8e49440650449f49e5303568f2f19c0 P 937efeddef934b2b8bc8632594903085 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:44.806169  1220 raft_consensus.cc:2468] T ec47b02d68674e2386a86244d9026b78 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa098a557d34433896712068efd0d9a8 in term 1.
I20260709 12:26:44.786695  1145 raft_consensus.cc:2468] T c4234c6cf75048c5a6cdf34e43c9bd1e P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa098a557d34433896712068efd0d9a8 in term 1.
I20260709 12:26:44.822337  1323 leader_election.cc:290] T b364263cacab4add984e2b6c912fb62e P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341)
I20260709 12:26:44.823447   963 leader_election.cc:304] T c4234c6cf75048c5a6cdf34e43c9bd1e P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20, aa098a557d34433896712068efd0d9a8; no voters: 937efeddef934b2b8bc8632594903085
I20260709 12:26:44.809355  1267 tablet_bootstrap.cc:492] T e6de424e08ed4b1d8f6d32d17a44025d P 8fa35514a8d84740b1b46ae496307f20: Bootstrap starting.
I20260709 12:26:44.809376  1266 tablet_bootstrap.cc:492] T c495ce9da627479e92d7b24b3be3641a P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:44.828397  1145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b364263cacab4add984e2b6c912fb62e" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
W20260709 12:26:44.831527  1038 leader_election.cc:343] T b364263cacab4add984e2b6c912fb62e P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:44.831784  1336 raft_consensus.cc:2804] T c4234c6cf75048c5a6cdf34e43c9bd1e P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:44.832149  1038 leader_election.cc:304] T b364263cacab4add984e2b6c912fb62e P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132; no voters: 8fa35514a8d84740b1b46ae496307f20, aa098a557d34433896712068efd0d9a8
I20260709 12:26:44.832363  1336 raft_consensus.cc:697] T c4234c6cf75048c5a6cdf34e43c9bd1e P aa098a557d34433896712068efd0d9a8 [term 1 LEADER]: Becoming Leader. State: Replica: aa098a557d34433896712068efd0d9a8, State: Running, Role: LEADER
I20260709 12:26:44.833531   960 leader_election.cc:304] T ec47b02d68674e2386a86244d9026b78 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 937efeddef934b2b8bc8632594903085, aa098a557d34433896712068efd0d9a8; no voters: 
I20260709 12:26:44.833828  1298 consensus_queue.cc:1048] T b8e49440650449f49e5303568f2f19c0 P 937efeddef934b2b8bc8632594903085 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:44.834439  1371 raft_consensus.cc:2804] T ec47b02d68674e2386a86244d9026b78 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:44.834959  1371 raft_consensus.cc:697] T ec47b02d68674e2386a86244d9026b78 P aa098a557d34433896712068efd0d9a8 [term 1 LEADER]: Becoming Leader. State: Replica: aa098a557d34433896712068efd0d9a8, State: Running, Role: LEADER
I20260709 12:26:44.835089  1323 raft_consensus.cc:2749] T b364263cacab4add984e2b6c912fb62e P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:44.835155  1265 raft_consensus.cc:359] T 98b5b180139845c99c537cd675a60830 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:44.836092  1265 raft_consensus.cc:385] T 98b5b180139845c99c537cd675a60830 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.836387  1265 raft_consensus.cc:740] T 98b5b180139845c99c537cd675a60830 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.837105  1265 consensus_queue.cc:260] T 98b5b180139845c99c537cd675a60830 P 7f9cbe40e40d429aa004e4a7fb42f132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:44.833266  1336 consensus_queue.cc:237] T c4234c6cf75048c5a6cdf34e43c9bd1e P aa098a557d34433896712068efd0d9a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:44.839524  1068 raft_consensus.cc:2468] T ec47b02d68674e2386a86244d9026b78 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa098a557d34433896712068efd0d9a8 in term 1.
I20260709 12:26:44.839598  1371 consensus_queue.cc:237] T ec47b02d68674e2386a86244d9026b78 P aa098a557d34433896712068efd0d9a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:44.842120  1267 tablet_bootstrap.cc:654] T e6de424e08ed4b1d8f6d32d17a44025d P 8fa35514a8d84740b1b46ae496307f20: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.844383  1376 raft_consensus.cc:697] T c495ce9da627479e92d7b24b3be3641a P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Becoming Leader. State: Replica: 937efeddef934b2b8bc8632594903085, State: Running, Role: LEADER
I20260709 12:26:44.845335  1376 consensus_queue.cc:237] T c495ce9da627479e92d7b24b3be3641a P 937efeddef934b2b8bc8632594903085 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:44.842949  1265 ts_tablet_manager.cc:1434] T 98b5b180139845c99c537cd675a60830 P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 12:26:44.831544  1266 tablet_bootstrap.cc:654] T c495ce9da627479e92d7b24b3be3641a P aa098a557d34433896712068efd0d9a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.847872  1265 tablet_bootstrap.cc:492] T e6de424e08ed4b1d8f6d32d17a44025d P 7f9cbe40e40d429aa004e4a7fb42f132: Bootstrap starting.
I20260709 12:26:44.854627  1072 raft_consensus.cc:1275] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Refusing update from remote peer 8fa35514a8d84740b1b46ae496307f20: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:26:44.856535  1365 consensus_queue.cc:1048] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:44.860713  1267 tablet_bootstrap.cc:492] T e6de424e08ed4b1d8f6d32d17a44025d P 8fa35514a8d84740b1b46ae496307f20: No bootstrap required, opened a new log
I20260709 12:26:44.861317  1267 ts_tablet_manager.cc:1403] T e6de424e08ed4b1d8f6d32d17a44025d P 8fa35514a8d84740b1b46ae496307f20: Time spent bootstrapping tablet: real 0.052s	user 0.012s	sys 0.000s
I20260709 12:26:44.864194  1265 tablet_bootstrap.cc:654] T e6de424e08ed4b1d8f6d32d17a44025d P 7f9cbe40e40d429aa004e4a7fb42f132: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.869318  1266 tablet_bootstrap.cc:492] T c495ce9da627479e92d7b24b3be3641a P aa098a557d34433896712068efd0d9a8: No bootstrap required, opened a new log
I20260709 12:26:44.873056  1266 ts_tablet_manager.cc:1403] T c495ce9da627479e92d7b24b3be3641a P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.064s	user 0.007s	sys 0.010s
I20260709 12:26:44.864305  1267 raft_consensus.cc:359] T e6de424e08ed4b1d8f6d32d17a44025d P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:44.874312  1267 raft_consensus.cc:385] T e6de424e08ed4b1d8f6d32d17a44025d P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.874672  1267 raft_consensus.cc:740] T e6de424e08ed4b1d8f6d32d17a44025d P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.875440   996 raft_consensus.cc:1275] T c9d72f2a6ae046cb9d4e6277d13e34e6 P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Refusing update from remote peer 8fa35514a8d84740b1b46ae496307f20: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:26:44.875543  1267 consensus_queue.cc:260] T e6de424e08ed4b1d8f6d32d17a44025d P 8fa35514a8d84740b1b46ae496307f20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:44.876495  1266 raft_consensus.cc:359] T c495ce9da627479e92d7b24b3be3641a P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:44.877059  1365 consensus_queue.cc:1048] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:44.877365  1266 raft_consensus.cc:385] T c495ce9da627479e92d7b24b3be3641a P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.877868  1266 raft_consensus.cc:740] T c495ce9da627479e92d7b24b3be3641a P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.879668  1266 consensus_queue.cc:260] T c495ce9da627479e92d7b24b3be3641a P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:44.880692  1264 raft_consensus.cc:359] T c4234c6cf75048c5a6cdf34e43c9bd1e P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:44.881384  1264 raft_consensus.cc:385] T c4234c6cf75048c5a6cdf34e43c9bd1e P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.881649  1264 raft_consensus.cc:740] T c4234c6cf75048c5a6cdf34e43c9bd1e P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 937efeddef934b2b8bc8632594903085, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.882807  1265 tablet_bootstrap.cc:492] T e6de424e08ed4b1d8f6d32d17a44025d P 7f9cbe40e40d429aa004e4a7fb42f132: No bootstrap required, opened a new log
I20260709 12:26:44.883499  1265 ts_tablet_manager.cc:1403] T e6de424e08ed4b1d8f6d32d17a44025d P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent bootstrapping tablet: real 0.036s	user 0.003s	sys 0.009s
I20260709 12:26:44.885998  1267 ts_tablet_manager.cc:1434] T e6de424e08ed4b1d8f6d32d17a44025d P 8fa35514a8d84740b1b46ae496307f20: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.002s
I20260709 12:26:44.887233  1267 tablet_bootstrap.cc:492] T 5302c354091f4926812eb90f518b9d6a P 8fa35514a8d84740b1b46ae496307f20: Bootstrap starting.
I20260709 12:26:44.894105  1266 ts_tablet_manager.cc:1434] T c495ce9da627479e92d7b24b3be3641a P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:26:44.895334  1266 tablet_bootstrap.cc:492] T 333930b9df5744d59ab498b170a35315 P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:44.896201  1267 tablet_bootstrap.cc:654] T 5302c354091f4926812eb90f518b9d6a P 8fa35514a8d84740b1b46ae496307f20: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.887351  1265 raft_consensus.cc:359] T e6de424e08ed4b1d8f6d32d17a44025d P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:44.909077  1265 raft_consensus.cc:385] T e6de424e08ed4b1d8f6d32d17a44025d P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.909372  1265 raft_consensus.cc:740] T e6de424e08ed4b1d8f6d32d17a44025d P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.916216  1264 consensus_queue.cc:260] T c4234c6cf75048c5a6cdf34e43c9bd1e P 937efeddef934b2b8bc8632594903085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:44.924382  1264 ts_tablet_manager.cc:1434] T c4234c6cf75048c5a6cdf34e43c9bd1e P 937efeddef934b2b8bc8632594903085: Time spent starting tablet: real 0.116s	user 0.007s	sys 0.000s
I20260709 12:26:44.925678  1264 tablet_bootstrap.cc:492] T 6715731f9a31415a98fa8a0ab9944eec P 937efeddef934b2b8bc8632594903085: Bootstrap starting.
I20260709 12:26:44.929092  1362 raft_consensus.cc:493] T e6de424e08ed4b1d8f6d32d17a44025d P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.929636  1362 raft_consensus.cc:515] T e6de424e08ed4b1d8f6d32d17a44025d P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:44.933391  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6de424e08ed4b1d8f6d32d17a44025d" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
W20260709 12:26:44.935714  1109 leader_election.cc:343] T e6de424e08ed4b1d8f6d32d17a44025d P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:44.931809  1362 leader_election.cc:290] T e6de424e08ed4b1d8f6d32d17a44025d P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:26:44.938195  1070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6de424e08ed4b1d8f6d32d17a44025d" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:44.944808  1265 consensus_queue.cc:260] T e6de424e08ed4b1d8f6d32d17a44025d P 7f9cbe40e40d429aa004e4a7fb42f132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:44.945941  1070 raft_consensus.cc:2468] T e6de424e08ed4b1d8f6d32d17a44025d P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 0.
I20260709 12:26:44.948544  1110 leader_election.cc:304] T e6de424e08ed4b1d8f6d32d17a44025d P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 8fa35514a8d84740b1b46ae496307f20; no voters: 937efeddef934b2b8bc8632594903085
I20260709 12:26:44.950129  1362 raft_consensus.cc:2804] T e6de424e08ed4b1d8f6d32d17a44025d P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:44.950572  1362 raft_consensus.cc:493] T e6de424e08ed4b1d8f6d32d17a44025d P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:44.950659  1265 ts_tablet_manager.cc:1434] T e6de424e08ed4b1d8f6d32d17a44025d P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent starting tablet: real 0.067s	user 0.007s	sys 0.003s
I20260709 12:26:44.951017  1362 raft_consensus.cc:3060] T e6de424e08ed4b1d8f6d32d17a44025d P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:44.951957  1265 tablet_bootstrap.cc:492] T 74e3cbe3521a46cfb42a6cb7ba98430c P 7f9cbe40e40d429aa004e4a7fb42f132: Bootstrap starting.
I20260709 12:26:44.953110  1264 tablet_bootstrap.cc:654] T 6715731f9a31415a98fa8a0ab9944eec P 937efeddef934b2b8bc8632594903085: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.954663  1266 tablet_bootstrap.cc:654] T 333930b9df5744d59ab498b170a35315 P aa098a557d34433896712068efd0d9a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.954326   891 catalog_manager.cc:5697] T ec47b02d68674e2386a86244d9026b78 P aa098a557d34433896712068efd0d9a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to aa098a557d34433896712068efd0d9a8 (127.23.245.129). New cstate: current_term: 1 leader_uuid: "aa098a557d34433896712068efd0d9a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:44.959216  1320 consensus_queue.cc:1048] T acc6ab0dce1640e380b433b32a874108 P 7f9cbe40e40d429aa004e4a7fb42f132 [LEADER]: Connected to new peer: Peer: permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:44.977560  1323 consensus_queue.cc:1048] T acc6ab0dce1640e380b433b32a874108 P 7f9cbe40e40d429aa004e4a7fb42f132 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:44.978161  1264 tablet_bootstrap.cc:492] T 6715731f9a31415a98fa8a0ab9944eec P 937efeddef934b2b8bc8632594903085: No bootstrap required, opened a new log
I20260709 12:26:44.979140  1264 ts_tablet_manager.cc:1403] T 6715731f9a31415a98fa8a0ab9944eec P 937efeddef934b2b8bc8632594903085: Time spent bootstrapping tablet: real 0.054s	user 0.015s	sys 0.005s
I20260709 12:26:44.982538  1264 raft_consensus.cc:359] T 6715731f9a31415a98fa8a0ab9944eec P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:44.983525  1264 raft_consensus.cc:385] T 6715731f9a31415a98fa8a0ab9944eec P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:44.983827  1264 raft_consensus.cc:740] T 6715731f9a31415a98fa8a0ab9944eec P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 937efeddef934b2b8bc8632594903085, State: Initialized, Role: FOLLOWER
I20260709 12:26:44.984597  1264 consensus_queue.cc:260] T 6715731f9a31415a98fa8a0ab9944eec P 937efeddef934b2b8bc8632594903085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:44.986972  1264 ts_tablet_manager.cc:1434] T 6715731f9a31415a98fa8a0ab9944eec P 937efeddef934b2b8bc8632594903085: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:26:44.988166  1264 tablet_bootstrap.cc:492] T 5302c354091f4926812eb90f518b9d6a P 937efeddef934b2b8bc8632594903085: Bootstrap starting.
I20260709 12:26:44.963191  1362 raft_consensus.cc:515] T e6de424e08ed4b1d8f6d32d17a44025d P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:44.966295  1267 tablet_bootstrap.cc:492] T 5302c354091f4926812eb90f518b9d6a P 8fa35514a8d84740b1b46ae496307f20: No bootstrap required, opened a new log
I20260709 12:26:44.974889  1265 tablet_bootstrap.cc:654] T 74e3cbe3521a46cfb42a6cb7ba98430c P 7f9cbe40e40d429aa004e4a7fb42f132: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:44.989626  1267 ts_tablet_manager.cc:1403] T 5302c354091f4926812eb90f518b9d6a P 8fa35514a8d84740b1b46ae496307f20: Time spent bootstrapping tablet: real 0.103s	user 0.019s	sys 0.018s
I20260709 12:26:44.988704   891 catalog_manager.cc:5697] T c4234c6cf75048c5a6cdf34e43c9bd1e P aa098a557d34433896712068efd0d9a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to aa098a557d34433896712068efd0d9a8 (127.23.245.129). New cstate: current_term: 1 leader_uuid: "aa098a557d34433896712068efd0d9a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:44.997571  1362 leader_election.cc:290] T e6de424e08ed4b1d8f6d32d17a44025d P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 election: Requested vote from peers 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:26:44.999703  1266 tablet_bootstrap.cc:492] T 333930b9df5744d59ab498b170a35315 P aa098a557d34433896712068efd0d9a8: No bootstrap required, opened a new log
I20260709 12:26:44.996636  1219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6de424e08ed4b1d8f6d32d17a44025d" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085"
I20260709 12:26:45.000665  1266 ts_tablet_manager.cc:1403] T 333930b9df5744d59ab498b170a35315 P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.106s	user 0.010s	sys 0.020s
I20260709 12:26:45.000483  1267 raft_consensus.cc:359] T 5302c354091f4926812eb90f518b9d6a P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:45.001282  1267 raft_consensus.cc:385] T 5302c354091f4926812eb90f518b9d6a P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.001596  1267 raft_consensus.cc:740] T 5302c354091f4926812eb90f518b9d6a P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Initialized, Role: FOLLOWER
W20260709 12:26:45.002013  1109 leader_election.cc:343] T e6de424e08ed4b1d8f6d32d17a44025d P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.001093  1070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6de424e08ed4b1d8f6d32d17a44025d" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
I20260709 12:26:45.002386  1267 consensus_queue.cc:260] T 5302c354091f4926812eb90f518b9d6a P 8fa35514a8d84740b1b46ae496307f20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:45.003180  1070 raft_consensus.cc:3060] T e6de424e08ed4b1d8f6d32d17a44025d P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.013984  1267 ts_tablet_manager.cc:1434] T 5302c354091f4926812eb90f518b9d6a P 8fa35514a8d84740b1b46ae496307f20: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 12:26:45.015534  1267 tablet_bootstrap.cc:492] T 333930b9df5744d59ab498b170a35315 P 8fa35514a8d84740b1b46ae496307f20: Bootstrap starting.
I20260709 12:26:45.021409  1070 raft_consensus.cc:2468] T e6de424e08ed4b1d8f6d32d17a44025d P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 1.
I20260709 12:26:45.008603  1264 tablet_bootstrap.cc:654] T 5302c354091f4926812eb90f518b9d6a P 937efeddef934b2b8bc8632594903085: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.023447  1110 leader_election.cc:304] T e6de424e08ed4b1d8f6d32d17a44025d P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 8fa35514a8d84740b1b46ae496307f20; no voters: 937efeddef934b2b8bc8632594903085
I20260709 12:26:45.004767  1266 raft_consensus.cc:359] T 333930b9df5744d59ab498b170a35315 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:45.024405  1266 raft_consensus.cc:385] T 333930b9df5744d59ab498b170a35315 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.024456  1265 tablet_bootstrap.cc:492] T 74e3cbe3521a46cfb42a6cb7ba98430c P 7f9cbe40e40d429aa004e4a7fb42f132: No bootstrap required, opened a new log
I20260709 12:26:45.024817  1266 raft_consensus.cc:740] T 333930b9df5744d59ab498b170a35315 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.024899  1362 raft_consensus.cc:2804] T e6de424e08ed4b1d8f6d32d17a44025d P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:45.025134  1265 ts_tablet_manager.cc:1403] T 74e3cbe3521a46cfb42a6cb7ba98430c P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent bootstrapping tablet: real 0.073s	user 0.016s	sys 0.003s
I20260709 12:26:45.025872  1362 raft_consensus.cc:697] T e6de424e08ed4b1d8f6d32d17a44025d P 8fa35514a8d84740b1b46ae496307f20 [term 1 LEADER]: Becoming Leader. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Running, Role: LEADER
I20260709 12:26:45.025735  1266 consensus_queue.cc:260] T 333930b9df5744d59ab498b170a35315 P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:45.028604  1265 raft_consensus.cc:359] T 74e3cbe3521a46cfb42a6cb7ba98430c P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:45.029399  1265 raft_consensus.cc:385] T 74e3cbe3521a46cfb42a6cb7ba98430c P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.029764  1265 raft_consensus.cc:740] T 74e3cbe3521a46cfb42a6cb7ba98430c P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.030542  1265 consensus_queue.cc:260] T 74e3cbe3521a46cfb42a6cb7ba98430c P 7f9cbe40e40d429aa004e4a7fb42f132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:45.031174  1267 tablet_bootstrap.cc:654] T 333930b9df5744d59ab498b170a35315 P 8fa35514a8d84740b1b46ae496307f20: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.028249  1362 consensus_queue.cc:237] T e6de424e08ed4b1d8f6d32d17a44025d P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:45.032608  1376 raft_consensus.cc:493] T c4234c6cf75048c5a6cdf34e43c9bd1e P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.033197  1265 ts_tablet_manager.cc:1434] T 74e3cbe3521a46cfb42a6cb7ba98430c P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:26:45.033126  1376 raft_consensus.cc:515] T c4234c6cf75048c5a6cdf34e43c9bd1e P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:45.034754  1265 tablet_bootstrap.cc:492] T a93df19c4206495e971bc5e95a2111bc P 7f9cbe40e40d429aa004e4a7fb42f132: Bootstrap starting.
I20260709 12:26:45.038134  1146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4234c6cf75048c5a6cdf34e43c9bd1e" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:45.039172  1146 raft_consensus.cc:2393] T c4234c6cf75048c5a6cdf34e43c9bd1e P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 937efeddef934b2b8bc8632594903085 in current term 1: Already voted for candidate aa098a557d34433896712068efd0d9a8 in this term.
I20260709 12:26:45.040343   997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4234c6cf75048c5a6cdf34e43c9bd1e" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
I20260709 12:26:45.042002  1265 tablet_bootstrap.cc:654] T a93df19c4206495e971bc5e95a2111bc P 7f9cbe40e40d429aa004e4a7fb42f132: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.043576  1186 leader_election.cc:304] T c4234c6cf75048c5a6cdf34e43c9bd1e P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 937efeddef934b2b8bc8632594903085; no voters: 8fa35514a8d84740b1b46ae496307f20, aa098a557d34433896712068efd0d9a8
I20260709 12:26:45.044656  1374 raft_consensus.cc:3060] T c4234c6cf75048c5a6cdf34e43c9bd1e P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.035743  1376 leader_election.cc:290] T c4234c6cf75048c5a6cdf34e43c9bd1e P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:45.048789  1371 raft_consensus.cc:493] T 6715731f9a31415a98fa8a0ab9944eec P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.048987   892 catalog_manager.cc:5697] T c495ce9da627479e92d7b24b3be3641a P 937efeddef934b2b8bc8632594903085 reported cstate change: term changed from 0 to 1, leader changed from <none> to 937efeddef934b2b8bc8632594903085 (127.23.245.132). New cstate: current_term: 1 leader_uuid: "937efeddef934b2b8bc8632594903085" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:45.049649  1371 raft_consensus.cc:515] T 6715731f9a31415a98fa8a0ab9944eec P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:45.029398  1266 ts_tablet_manager.cc:1434] T 333930b9df5744d59ab498b170a35315 P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.001s
I20260709 12:26:45.053058  1374 raft_consensus.cc:2749] T c4234c6cf75048c5a6cdf34e43c9bd1e P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:45.063081  1371 leader_election.cc:290] T 6715731f9a31415a98fa8a0ab9944eec P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:26:45.063876  1266 tablet_bootstrap.cc:492] T b364263cacab4add984e2b6c912fb62e P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:45.065462  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6715731f9a31415a98fa8a0ab9944eec" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:45.067150  1220 raft_consensus.cc:2468] T 6715731f9a31415a98fa8a0ab9944eec P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa098a557d34433896712068efd0d9a8 in term 0.
I20260709 12:26:45.067494  1265 tablet_bootstrap.cc:492] T a93df19c4206495e971bc5e95a2111bc P 7f9cbe40e40d429aa004e4a7fb42f132: No bootstrap required, opened a new log
I20260709 12:26:45.068054  1265 ts_tablet_manager.cc:1403] T a93df19c4206495e971bc5e95a2111bc P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.004s
I20260709 12:26:45.068365   960 leader_election.cc:304] T 6715731f9a31415a98fa8a0ab9944eec P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 937efeddef934b2b8bc8632594903085, aa098a557d34433896712068efd0d9a8; no voters: 
I20260709 12:26:45.071128  1265 raft_consensus.cc:359] T a93df19c4206495e971bc5e95a2111bc P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:45.071947  1265 raft_consensus.cc:385] T a93df19c4206495e971bc5e95a2111bc P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.072235  1371 raft_consensus.cc:2804] T 6715731f9a31415a98fa8a0ab9944eec P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:45.072652  1371 raft_consensus.cc:493] T 6715731f9a31415a98fa8a0ab9944eec P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:45.072980  1371 raft_consensus.cc:3060] T 6715731f9a31415a98fa8a0ab9944eec P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.072652  1145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6715731f9a31415a98fa8a0ab9944eec" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:45.079459  1145 raft_consensus.cc:2468] T 6715731f9a31415a98fa8a0ab9944eec P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa098a557d34433896712068efd0d9a8 in term 0.
I20260709 12:26:45.074174  1267 tablet_bootstrap.cc:492] T 333930b9df5744d59ab498b170a35315 P 8fa35514a8d84740b1b46ae496307f20: No bootstrap required, opened a new log
I20260709 12:26:45.079485  1266 tablet_bootstrap.cc:654] T b364263cacab4add984e2b6c912fb62e P aa098a557d34433896712068efd0d9a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.086225  1267 ts_tablet_manager.cc:1403] T 333930b9df5744d59ab498b170a35315 P 8fa35514a8d84740b1b46ae496307f20: Time spent bootstrapping tablet: real 0.071s	user 0.015s	sys 0.001s
I20260709 12:26:45.072280  1265 raft_consensus.cc:740] T a93df19c4206495e971bc5e95a2111bc P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.088088  1265 consensus_queue.cc:260] T a93df19c4206495e971bc5e95a2111bc P 7f9cbe40e40d429aa004e4a7fb42f132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:45.085597  1359 raft_consensus.cc:493] T c77af7e1c2044a8eacfe0e76ee974591 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.091130  1359 raft_consensus.cc:515] T c77af7e1c2044a8eacfe0e76ee974591 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:45.093245  1359 leader_election.cc:290] T c77af7e1c2044a8eacfe0e76ee974591 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:26:45.094022  1145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c77af7e1c2044a8eacfe0e76ee974591" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
W20260709 12:26:45.095422  1038 leader_election.cc:343] T c77af7e1c2044a8eacfe0e76ee974591 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.095520  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c77af7e1c2044a8eacfe0e76ee974591" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:45.096701  1371 raft_consensus.cc:515] T 6715731f9a31415a98fa8a0ab9944eec P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
W20260709 12:26:45.097121  1035 leader_election.cc:343] T c77af7e1c2044a8eacfe0e76ee974591 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.097644  1035 leader_election.cc:304] T c77af7e1c2044a8eacfe0e76ee974591 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132; no voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085
I20260709 12:26:45.098817  1359 raft_consensus.cc:2749] T c77af7e1c2044a8eacfe0e76ee974591 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:45.099771  1145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6715731f9a31415a98fa8a0ab9944eec" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20"
I20260709 12:26:45.100016  1371 leader_election.cc:290] T 6715731f9a31415a98fa8a0ab9944eec P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 election: Requested vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:26:45.100394  1145 raft_consensus.cc:3060] T 6715731f9a31415a98fa8a0ab9944eec P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.100833  1267 raft_consensus.cc:359] T 333930b9df5744d59ab498b170a35315 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:45.101147  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6715731f9a31415a98fa8a0ab9944eec" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085"
I20260709 12:26:45.101527  1267 raft_consensus.cc:385] T 333930b9df5744d59ab498b170a35315 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.101747  1220 raft_consensus.cc:3060] T 6715731f9a31415a98fa8a0ab9944eec P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.101783  1265 ts_tablet_manager.cc:1434] T a93df19c4206495e971bc5e95a2111bc P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 12:26:45.105470  1265 tablet_bootstrap.cc:492] T dc91bacc3de44d21bc62d8b9a003fdcf P 7f9cbe40e40d429aa004e4a7fb42f132: Bootstrap starting.
I20260709 12:26:45.108565  1359 raft_consensus.cc:493] T a93df19c4206495e971bc5e95a2111bc P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.109198  1359 raft_consensus.cc:515] T a93df19c4206495e971bc5e95a2111bc P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:45.109747  1220 raft_consensus.cc:2468] T 6715731f9a31415a98fa8a0ab9944eec P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa098a557d34433896712068efd0d9a8 in term 1.
I20260709 12:26:45.111037   960 leader_election.cc:304] T 6715731f9a31415a98fa8a0ab9944eec P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 937efeddef934b2b8bc8632594903085, aa098a557d34433896712068efd0d9a8; no voters: 
I20260709 12:26:45.112110  1265 tablet_bootstrap.cc:654] T dc91bacc3de44d21bc62d8b9a003fdcf P 7f9cbe40e40d429aa004e4a7fb42f132: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.112964  1219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93df19c4206495e971bc5e95a2111bc" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:45.112960   997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93df19c4206495e971bc5e95a2111bc" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
W20260709 12:26:45.117437  1038 leader_election.cc:343] T a93df19c4206495e971bc5e95a2111bc P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.117635  1371 raft_consensus.cc:2804] T 6715731f9a31415a98fa8a0ab9944eec P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:45.108074  1145 raft_consensus.cc:2468] T 6715731f9a31415a98fa8a0ab9944eec P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa098a557d34433896712068efd0d9a8 in term 1.
I20260709 12:26:45.119900  1371 raft_consensus.cc:697] T 6715731f9a31415a98fa8a0ab9944eec P aa098a557d34433896712068efd0d9a8 [term 1 LEADER]: Becoming Leader. State: Replica: aa098a557d34433896712068efd0d9a8, State: Running, Role: LEADER
I20260709 12:26:45.118595  1359 leader_election.cc:290] T a93df19c4206495e971bc5e95a2111bc P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
W20260709 12:26:45.118685  1035 leader_election.cc:343] T a93df19c4206495e971bc5e95a2111bc P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.121129  1371 consensus_queue.cc:237] T 6715731f9a31415a98fa8a0ab9944eec P aa098a557d34433896712068efd0d9a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:45.121753  1035 leader_election.cc:304] T a93df19c4206495e971bc5e95a2111bc P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132; no voters: 937efeddef934b2b8bc8632594903085, aa098a557d34433896712068efd0d9a8
I20260709 12:26:45.123119  1359 raft_consensus.cc:2749] T a93df19c4206495e971bc5e95a2111bc P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:45.125627  1264 tablet_bootstrap.cc:492] T 5302c354091f4926812eb90f518b9d6a P 937efeddef934b2b8bc8632594903085: No bootstrap required, opened a new log
I20260709 12:26:45.126559  1264 ts_tablet_manager.cc:1403] T 5302c354091f4926812eb90f518b9d6a P 937efeddef934b2b8bc8632594903085: Time spent bootstrapping tablet: real 0.139s	user 0.028s	sys 0.020s
I20260709 12:26:45.101853  1267 raft_consensus.cc:740] T 333930b9df5744d59ab498b170a35315 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.128595  1267 consensus_queue.cc:260] T 333930b9df5744d59ab498b170a35315 P 8fa35514a8d84740b1b46ae496307f20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:45.131126  1267 ts_tablet_manager.cc:1434] T 333930b9df5744d59ab498b170a35315 P 8fa35514a8d84740b1b46ae496307f20: Time spent starting tablet: real 0.044s	user 0.005s	sys 0.001s
I20260709 12:26:45.134814  1267 tablet_bootstrap.cc:492] T c77af7e1c2044a8eacfe0e76ee974591 P 8fa35514a8d84740b1b46ae496307f20: Bootstrap starting.
I20260709 12:26:45.135586  1264 raft_consensus.cc:359] T 5302c354091f4926812eb90f518b9d6a P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:45.136037  1266 tablet_bootstrap.cc:492] T b364263cacab4add984e2b6c912fb62e P aa098a557d34433896712068efd0d9a8: No bootstrap required, opened a new log
I20260709 12:26:45.136478  1264 raft_consensus.cc:385] T 5302c354091f4926812eb90f518b9d6a P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.136701  1266 ts_tablet_manager.cc:1403] T b364263cacab4add984e2b6c912fb62e P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.073s	user 0.016s	sys 0.005s
I20260709 12:26:45.136859  1264 raft_consensus.cc:740] T 5302c354091f4926812eb90f518b9d6a P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 937efeddef934b2b8bc8632594903085, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.137854  1264 consensus_queue.cc:260] T 5302c354091f4926812eb90f518b9d6a P 937efeddef934b2b8bc8632594903085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:45.139607  1266 raft_consensus.cc:359] T b364263cacab4add984e2b6c912fb62e P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:45.140362  1266 raft_consensus.cc:385] T b364263cacab4add984e2b6c912fb62e P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.140695  1266 raft_consensus.cc:740] T b364263cacab4add984e2b6c912fb62e P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.140177   891 catalog_manager.cc:5697] T e6de424e08ed4b1d8f6d32d17a44025d P 8fa35514a8d84740b1b46ae496307f20 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131). New cstate: current_term: 1 leader_uuid: "8fa35514a8d84740b1b46ae496307f20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:45.141369  1266 consensus_queue.cc:260] T b364263cacab4add984e2b6c912fb62e P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:45.140358  1264 ts_tablet_manager.cc:1434] T 5302c354091f4926812eb90f518b9d6a P 937efeddef934b2b8bc8632594903085: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.003s
I20260709 12:26:45.143282  1264 tablet_bootstrap.cc:492] T 343e626d0073462fa2020fcf2e2f8ffb P 937efeddef934b2b8bc8632594903085: Bootstrap starting.
I20260709 12:26:45.143967  1267 tablet_bootstrap.cc:654] T c77af7e1c2044a8eacfe0e76ee974591 P 8fa35514a8d84740b1b46ae496307f20: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.148960  1264 tablet_bootstrap.cc:654] T 343e626d0073462fa2020fcf2e2f8ffb P 937efeddef934b2b8bc8632594903085: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.153962  1265 tablet_bootstrap.cc:492] T dc91bacc3de44d21bc62d8b9a003fdcf P 7f9cbe40e40d429aa004e4a7fb42f132: No bootstrap required, opened a new log
I20260709 12:26:45.154435  1265 ts_tablet_manager.cc:1403] T dc91bacc3de44d21bc62d8b9a003fdcf P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent bootstrapping tablet: real 0.049s	user 0.005s	sys 0.011s
I20260709 12:26:45.157124  1265 raft_consensus.cc:359] T dc91bacc3de44d21bc62d8b9a003fdcf P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:45.157794  1265 raft_consensus.cc:385] T dc91bacc3de44d21bc62d8b9a003fdcf P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.158072  1265 raft_consensus.cc:740] T dc91bacc3de44d21bc62d8b9a003fdcf P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.158756  1265 consensus_queue.cc:260] T dc91bacc3de44d21bc62d8b9a003fdcf P 7f9cbe40e40d429aa004e4a7fb42f132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:45.161214  1266 ts_tablet_manager.cc:1434] T b364263cacab4add984e2b6c912fb62e P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 12:26:45.162278  1266 tablet_bootstrap.cc:492] T 5302c354091f4926812eb90f518b9d6a P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:45.169041  1265 ts_tablet_manager.cc:1434] T dc91bacc3de44d21bc62d8b9a003fdcf P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:26:45.170125  1265 tablet_bootstrap.cc:492] T 7b2e497f1fcf4e40b4374fd2b5b261af P 7f9cbe40e40d429aa004e4a7fb42f132: Bootstrap starting.
I20260709 12:26:45.176106  1266 tablet_bootstrap.cc:654] T 5302c354091f4926812eb90f518b9d6a P aa098a557d34433896712068efd0d9a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.178990  1359 raft_consensus.cc:493] T 98b5b180139845c99c537cd675a60830 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.179545  1359 raft_consensus.cc:515] T 98b5b180139845c99c537cd675a60830 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:45.181677  1359 leader_election.cc:290] T 98b5b180139845c99c537cd675a60830 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:45.184379   997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b5b180139845c99c537cd675a60830" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
I20260709 12:26:45.184427  1266 tablet_bootstrap.cc:492] T 5302c354091f4926812eb90f518b9d6a P aa098a557d34433896712068efd0d9a8: No bootstrap required, opened a new log
I20260709 12:26:45.185302  1371 raft_consensus.cc:493] T c495ce9da627479e92d7b24b3be3641a P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:45.186196  1038 leader_election.cc:343] T 98b5b180139845c99c537cd675a60830 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.175859  1265 tablet_bootstrap.cc:654] T 7b2e497f1fcf4e40b4374fd2b5b261af P 7f9cbe40e40d429aa004e4a7fb42f132: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.187546  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b5b180139845c99c537cd675a60830" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
W20260709 12:26:45.188802  1035 leader_election.cc:343] T 98b5b180139845c99c537cd675a60830 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.188849  1359 raft_consensus.cc:493] T dc91bacc3de44d21bc62d8b9a003fdcf P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.189366  1035 leader_election.cc:304] T 98b5b180139845c99c537cd675a60830 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132; no voters: 937efeddef934b2b8bc8632594903085, aa098a557d34433896712068efd0d9a8
I20260709 12:26:45.189584  1359 raft_consensus.cc:515] T dc91bacc3de44d21bc62d8b9a003fdcf P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:45.190251  1266 ts_tablet_manager.cc:1403] T 5302c354091f4926812eb90f518b9d6a P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.028s	user 0.007s	sys 0.005s
I20260709 12:26:45.190590  1320 raft_consensus.cc:2749] T 98b5b180139845c99c537cd675a60830 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:45.192596  1145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc91bacc3de44d21bc62d8b9a003fdcf" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
W20260709 12:26:45.193948  1038 leader_election.cc:343] T dc91bacc3de44d21bc62d8b9a003fdcf P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.186013  1371 raft_consensus.cc:515] T c495ce9da627479e92d7b24b3be3641a P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:45.196588  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c495ce9da627479e92d7b24b3be3641a" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:45.198593  1359 leader_election.cc:290] T dc91bacc3de44d21bc62d8b9a003fdcf P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:26:45.199579  1371 leader_election.cc:290] T c495ce9da627479e92d7b24b3be3641a P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:45.193943  1266 raft_consensus.cc:359] T 5302c354091f4926812eb90f518b9d6a P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:45.200940  1070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c495ce9da627479e92d7b24b3be3641a" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:45.202080  1070 raft_consensus.cc:2393] T c495ce9da627479e92d7b24b3be3641a P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aa098a557d34433896712068efd0d9a8 in current term 1: Already voted for candidate 937efeddef934b2b8bc8632594903085 in this term.
I20260709 12:26:45.204730  1362 raft_consensus.cc:493] T 5302c354091f4926812eb90f518b9d6a P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.205348  1362 raft_consensus.cc:515] T 5302c354091f4926812eb90f518b9d6a P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:45.210384  1219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302c354091f4926812eb90f518b9d6a" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:45.209992   893 catalog_manager.cc:5697] T 6715731f9a31415a98fa8a0ab9944eec P aa098a557d34433896712068efd0d9a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to aa098a557d34433896712068efd0d9a8 (127.23.245.129). New cstate: current_term: 1 leader_uuid: "aa098a557d34433896712068efd0d9a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:45.211000  1219 raft_consensus.cc:2468] T 5302c354091f4926812eb90f518b9d6a P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 0.
I20260709 12:26:45.215437  1109 leader_election.cc:304] T 5302c354091f4926812eb90f518b9d6a P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085; no voters: 
I20260709 12:26:45.216681  1365 raft_consensus.cc:2804] T 5302c354091f4926812eb90f518b9d6a P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:45.217157  1365 raft_consensus.cc:493] T 5302c354091f4926812eb90f518b9d6a P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:45.217576  1365 raft_consensus.cc:3060] T 5302c354091f4926812eb90f518b9d6a P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.226094  1362 leader_election.cc:290] T 5302c354091f4926812eb90f518b9d6a P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:45.227815   961 leader_election.cc:304] T c495ce9da627479e92d7b24b3be3641a P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa098a557d34433896712068efd0d9a8; no voters: 7f9cbe40e40d429aa004e4a7fb42f132, 937efeddef934b2b8bc8632594903085
I20260709 12:26:45.228740   997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302c354091f4926812eb90f518b9d6a" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
I20260709 12:26:45.229538  1371 raft_consensus.cc:3060] T c495ce9da627479e92d7b24b3be3641a P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.235577  1264 tablet_bootstrap.cc:492] T 343e626d0073462fa2020fcf2e2f8ffb P 937efeddef934b2b8bc8632594903085: No bootstrap required, opened a new log
I20260709 12:26:45.236367  1265 tablet_bootstrap.cc:492] T 7b2e497f1fcf4e40b4374fd2b5b261af P 7f9cbe40e40d429aa004e4a7fb42f132: No bootstrap required, opened a new log
I20260709 12:26:45.236512  1264 ts_tablet_manager.cc:1403] T 343e626d0073462fa2020fcf2e2f8ffb P 937efeddef934b2b8bc8632594903085: Time spent bootstrapping tablet: real 0.093s	user 0.013s	sys 0.017s
I20260709 12:26:45.236835  1265 ts_tablet_manager.cc:1403] T 7b2e497f1fcf4e40b4374fd2b5b261af P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent bootstrapping tablet: real 0.067s	user 0.020s	sys 0.010s
I20260709 12:26:45.199640  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc91bacc3de44d21bc62d8b9a003fdcf" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:45.239378  1264 raft_consensus.cc:359] T 343e626d0073462fa2020fcf2e2f8ffb P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:45.240159  1264 raft_consensus.cc:385] T 343e626d0073462fa2020fcf2e2f8ffb P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.240453  1264 raft_consensus.cc:740] T 343e626d0073462fa2020fcf2e2f8ffb P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 937efeddef934b2b8bc8632594903085, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.241088  1264 consensus_queue.cc:260] T 343e626d0073462fa2020fcf2e2f8ffb P 937efeddef934b2b8bc8632594903085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:45.242784  1265 raft_consensus.cc:359] T 7b2e497f1fcf4e40b4374fd2b5b261af P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:45.243479  1265 raft_consensus.cc:385] T 7b2e497f1fcf4e40b4374fd2b5b261af P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.243747  1265 raft_consensus.cc:740] T 7b2e497f1fcf4e40b4374fd2b5b261af P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Initialized, Role: FOLLOWER
W20260709 12:26:45.244670  1035 leader_election.cc:343] T dc91bacc3de44d21bc62d8b9a003fdcf P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.245270  1035 leader_election.cc:304] T dc91bacc3de44d21bc62d8b9a003fdcf P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132; no voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085
I20260709 12:26:45.248306  1359 raft_consensus.cc:2749] T dc91bacc3de44d21bc62d8b9a003fdcf P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:45.248497  1264 ts_tablet_manager.cc:1434] T 343e626d0073462fa2020fcf2e2f8ffb P 937efeddef934b2b8bc8632594903085: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 12:26:45.250536  1371 raft_consensus.cc:2749] T c495ce9da627479e92d7b24b3be3641a P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:45.244536  1265 consensus_queue.cc:260] T 7b2e497f1fcf4e40b4374fd2b5b261af P 7f9cbe40e40d429aa004e4a7fb42f132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:45.250905  1264 tablet_bootstrap.cc:492] T c77af7e1c2044a8eacfe0e76ee974591 P 937efeddef934b2b8bc8632594903085: Bootstrap starting.
I20260709 12:26:45.253713  1359 raft_consensus.cc:493] T 7b2e497f1fcf4e40b4374fd2b5b261af P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.254271  1359 raft_consensus.cc:515] T 7b2e497f1fcf4e40b4374fd2b5b261af P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:45.254272  1365 raft_consensus.cc:515] T 5302c354091f4926812eb90f518b9d6a P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:45.200942  1266 raft_consensus.cc:385] T 5302c354091f4926812eb90f518b9d6a P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.256318  1266 raft_consensus.cc:740] T 5302c354091f4926812eb90f518b9d6a P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.257077  1359 leader_election.cc:290] T 7b2e497f1fcf4e40b4374fd2b5b261af P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:26:45.256999  1266 consensus_queue.cc:260] T 5302c354091f4926812eb90f518b9d6a P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:45.257910   997 raft_consensus.cc:2468] T 5302c354091f4926812eb90f518b9d6a P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 0.
I20260709 12:26:45.258055  1145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b2e497f1fcf4e40b4374fd2b5b261af" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:45.259107  1265 ts_tablet_manager.cc:1434] T 7b2e497f1fcf4e40b4374fd2b5b261af P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:26:45.259327  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302c354091f4926812eb90f518b9d6a" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085"
I20260709 12:26:45.259958  1220 raft_consensus.cc:3060] T 5302c354091f4926812eb90f518b9d6a P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.260226  1265 tablet_bootstrap.cc:492] T 95743acb416b403b9bfb59afe5bf2fe7 P 7f9cbe40e40d429aa004e4a7fb42f132: Bootstrap starting.
I20260709 12:26:45.261953  1267 tablet_bootstrap.cc:492] T c77af7e1c2044a8eacfe0e76ee974591 P 8fa35514a8d84740b1b46ae496307f20: No bootstrap required, opened a new log
I20260709 12:26:45.262447  1267 ts_tablet_manager.cc:1403] T c77af7e1c2044a8eacfe0e76ee974591 P 8fa35514a8d84740b1b46ae496307f20: Time spent bootstrapping tablet: real 0.131s	user 0.030s	sys 0.030s
W20260709 12:26:45.263152  1038 leader_election.cc:343] T 7b2e497f1fcf4e40b4374fd2b5b261af P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.270177  1265 tablet_bootstrap.cc:654] T 95743acb416b403b9bfb59afe5bf2fe7 P 7f9cbe40e40d429aa004e4a7fb42f132: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.270642  1266 ts_tablet_manager.cc:1434] T 5302c354091f4926812eb90f518b9d6a P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.080s	user 0.007s	sys 0.001s
I20260709 12:26:45.270958  1219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b2e497f1fcf4e40b4374fd2b5b261af" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:45.271896  1266 tablet_bootstrap.cc:492] T 98b5b180139845c99c537cd675a60830 P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
W20260709 12:26:45.272563  1035 leader_election.cc:343] T 7b2e497f1fcf4e40b4374fd2b5b261af P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.273051  1035 leader_election.cc:304] T 7b2e497f1fcf4e40b4374fd2b5b261af P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132; no voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085
I20260709 12:26:45.273896  1362 raft_consensus.cc:493] T 343e626d0073462fa2020fcf2e2f8ffb P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.273692  1267 raft_consensus.cc:359] T c77af7e1c2044a8eacfe0e76ee974591 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:45.274407  1362 raft_consensus.cc:515] T 343e626d0073462fa2020fcf2e2f8ffb P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:45.274464  1267 raft_consensus.cc:385] T c77af7e1c2044a8eacfe0e76ee974591 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.275370  1267 raft_consensus.cc:740] T c77af7e1c2044a8eacfe0e76ee974591 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.276262  1267 consensus_queue.cc:260] T c77af7e1c2044a8eacfe0e76ee974591 P 8fa35514a8d84740b1b46ae496307f20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:45.275540  1264 tablet_bootstrap.cc:654] T c77af7e1c2044a8eacfe0e76ee974591 P 937efeddef934b2b8bc8632594903085: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.276938  1362 leader_election.cc:290] T 343e626d0073462fa2020fcf2e2f8ffb P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:45.282181  1219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343e626d0073462fa2020fcf2e2f8ffb" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:45.282935  1219 raft_consensus.cc:2468] T 343e626d0073462fa2020fcf2e2f8ffb P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 0.
I20260709 12:26:45.283177  1267 ts_tablet_manager.cc:1434] T c77af7e1c2044a8eacfe0e76ee974591 P 8fa35514a8d84740b1b46ae496307f20: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.003s
I20260709 12:26:45.284358  1109 leader_election.cc:304] T 343e626d0073462fa2020fcf2e2f8ffb P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085; no voters: 
I20260709 12:26:45.285257  1362 raft_consensus.cc:2804] T 343e626d0073462fa2020fcf2e2f8ffb P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:45.285621  1362 raft_consensus.cc:493] T 343e626d0073462fa2020fcf2e2f8ffb P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:45.286007  1362 raft_consensus.cc:3060] T 343e626d0073462fa2020fcf2e2f8ffb P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.285806   997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343e626d0073462fa2020fcf2e2f8ffb" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
I20260709 12:26:45.284396  1267 tablet_bootstrap.cc:492] T 74e3cbe3521a46cfb42a6cb7ba98430c P 8fa35514a8d84740b1b46ae496307f20: Bootstrap starting.
I20260709 12:26:45.291179  1266 tablet_bootstrap.cc:654] T 98b5b180139845c99c537cd675a60830 P aa098a557d34433896712068efd0d9a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.289530  1359 raft_consensus.cc:2749] T 7b2e497f1fcf4e40b4374fd2b5b261af P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:26:45.288184  1112 leader_election.cc:343] T 343e626d0073462fa2020fcf2e2f8ffb P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.305446  1365 leader_election.cc:290] T 5302c354091f4926812eb90f518b9d6a P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 election: Requested vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:45.307106   997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302c354091f4926812eb90f518b9d6a" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8"
I20260709 12:26:45.307744   997 raft_consensus.cc:3060] T 5302c354091f4926812eb90f518b9d6a P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.315480  1267 tablet_bootstrap.cc:654] T 74e3cbe3521a46cfb42a6cb7ba98430c P 8fa35514a8d84740b1b46ae496307f20: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.307783  1220 raft_consensus.cc:2468] T 5302c354091f4926812eb90f518b9d6a P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 1.
I20260709 12:26:45.317898  1109 leader_election.cc:304] T 5302c354091f4926812eb90f518b9d6a P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085; no voters: 
I20260709 12:26:45.323427  1336 consensus_queue.cc:1048] T ec47b02d68674e2386a86244d9026b78 P aa098a557d34433896712068efd0d9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:45.324111   997 raft_consensus.cc:2468] T 5302c354091f4926812eb90f518b9d6a P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 1.
I20260709 12:26:45.329792  1365 raft_consensus.cc:2804] T 5302c354091f4926812eb90f518b9d6a P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:45.331852  1365 raft_consensus.cc:697] T 5302c354091f4926812eb90f518b9d6a P 8fa35514a8d84740b1b46ae496307f20 [term 1 LEADER]: Becoming Leader. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Running, Role: LEADER
I20260709 12:26:45.332759  1365 consensus_queue.cc:237] T 5302c354091f4926812eb90f518b9d6a P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:45.332989  1362 raft_consensus.cc:515] T 343e626d0073462fa2020fcf2e2f8ffb P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:45.334676  1265 tablet_bootstrap.cc:492] T 95743acb416b403b9bfb59afe5bf2fe7 P 7f9cbe40e40d429aa004e4a7fb42f132: No bootstrap required, opened a new log
I20260709 12:26:45.335347  1265 ts_tablet_manager.cc:1403] T 95743acb416b403b9bfb59afe5bf2fe7 P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent bootstrapping tablet: real 0.075s	user 0.011s	sys 0.007s
I20260709 12:26:45.337312  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343e626d0073462fa2020fcf2e2f8ffb" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085"
I20260709 12:26:45.338173  1220 raft_consensus.cc:3060] T 343e626d0073462fa2020fcf2e2f8ffb P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.338824  1266 tablet_bootstrap.cc:492] T 98b5b180139845c99c537cd675a60830 P aa098a557d34433896712068efd0d9a8: No bootstrap required, opened a new log
I20260709 12:26:45.339388  1266 ts_tablet_manager.cc:1403] T 98b5b180139845c99c537cd675a60830 P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.068s	user 0.020s	sys 0.020s
I20260709 12:26:45.342121  1264 tablet_bootstrap.cc:492] T c77af7e1c2044a8eacfe0e76ee974591 P 937efeddef934b2b8bc8632594903085: No bootstrap required, opened a new log
I20260709 12:26:45.342581  1264 ts_tablet_manager.cc:1403] T c77af7e1c2044a8eacfe0e76ee974591 P 937efeddef934b2b8bc8632594903085: Time spent bootstrapping tablet: real 0.092s	user 0.022s	sys 0.015s
I20260709 12:26:45.344002  1362 leader_election.cc:290] T 343e626d0073462fa2020fcf2e2f8ffb P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 election: Requested vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:45.345746   997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343e626d0073462fa2020fcf2e2f8ffb" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8"
W20260709 12:26:45.347272  1112 leader_election.cc:343] T 343e626d0073462fa2020fcf2e2f8ffb P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.347944  1374 consensus_queue.cc:1048] T edea2a0a3c264f2b810295aea0acfb73 P 937efeddef934b2b8bc8632594903085 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:45.350719  1220 raft_consensus.cc:2468] T 343e626d0073462fa2020fcf2e2f8ffb P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 1.
I20260709 12:26:45.351773  1109 leader_election.cc:304] T 343e626d0073462fa2020fcf2e2f8ffb P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085; no voters: aa098a557d34433896712068efd0d9a8
I20260709 12:26:45.355625  1266 raft_consensus.cc:359] T 98b5b180139845c99c537cd675a60830 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:45.366447  1266 raft_consensus.cc:385] T 98b5b180139845c99c537cd675a60830 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.354570  1264 raft_consensus.cc:359] T c77af7e1c2044a8eacfe0e76ee974591 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:45.366853  1266 raft_consensus.cc:740] T 98b5b180139845c99c537cd675a60830 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.367110  1264 raft_consensus.cc:385] T c77af7e1c2044a8eacfe0e76ee974591 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.367010  1462 consensus_queue.cc:1048] T c495ce9da627479e92d7b24b3be3641a P 937efeddef934b2b8bc8632594903085 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:45.367524  1264 raft_consensus.cc:740] T c77af7e1c2044a8eacfe0e76ee974591 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 937efeddef934b2b8bc8632594903085, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.367575  1266 consensus_queue.cc:260] T 98b5b180139845c99c537cd675a60830 P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:45.347994  1267 tablet_bootstrap.cc:492] T 74e3cbe3521a46cfb42a6cb7ba98430c P 8fa35514a8d84740b1b46ae496307f20: No bootstrap required, opened a new log
I20260709 12:26:45.368897  1267 ts_tablet_manager.cc:1403] T 74e3cbe3521a46cfb42a6cb7ba98430c P 8fa35514a8d84740b1b46ae496307f20: Time spent bootstrapping tablet: real 0.085s	user 0.014s	sys 0.011s
I20260709 12:26:45.370003  1266 ts_tablet_manager.cc:1434] T 98b5b180139845c99c537cd675a60830 P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.005s
I20260709 12:26:45.371083  1266 tablet_bootstrap.cc:492] T 343e626d0073462fa2020fcf2e2f8ffb P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:45.373442  1264 consensus_queue.cc:260] T c77af7e1c2044a8eacfe0e76ee974591 P 937efeddef934b2b8bc8632594903085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:45.373695  1451 consensus_queue.cc:1048] T ec47b02d68674e2386a86244d9026b78 P aa098a557d34433896712068efd0d9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:45.356601  1265 raft_consensus.cc:359] T 95743acb416b403b9bfb59afe5bf2fe7 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:45.375458  1265 raft_consensus.cc:385] T 95743acb416b403b9bfb59afe5bf2fe7 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.375721  1265 raft_consensus.cc:740] T 95743acb416b403b9bfb59afe5bf2fe7 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.376030  1264 ts_tablet_manager.cc:1434] T c77af7e1c2044a8eacfe0e76ee974591 P 937efeddef934b2b8bc8632594903085: Time spent starting tablet: real 0.033s	user 0.010s	sys 0.004s
I20260709 12:26:45.377072  1264 tablet_bootstrap.cc:492] T 98b5b180139845c99c537cd675a60830 P 937efeddef934b2b8bc8632594903085: Bootstrap starting.
I20260709 12:26:45.376399  1265 consensus_queue.cc:260] T 95743acb416b403b9bfb59afe5bf2fe7 P 7f9cbe40e40d429aa004e4a7fb42f132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:45.379271  1265 ts_tablet_manager.cc:1434] T 95743acb416b403b9bfb59afe5bf2fe7 P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.005s
I20260709 12:26:45.360644   892 catalog_manager.cc:5697] T 5302c354091f4926812eb90f518b9d6a P 8fa35514a8d84740b1b46ae496307f20 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131). New cstate: current_term: 1 leader_uuid: "8fa35514a8d84740b1b46ae496307f20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:45.383517  1267 raft_consensus.cc:359] T 74e3cbe3521a46cfb42a6cb7ba98430c P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:45.386053  1265 tablet_bootstrap.cc:492] T c5197f4025d94ce096c14c6ca011b47b P 7f9cbe40e40d429aa004e4a7fb42f132: Bootstrap starting.
I20260709 12:26:45.353009  1359 raft_consensus.cc:493] T 74e3cbe3521a46cfb42a6cb7ba98430c P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.390954  1359 raft_consensus.cc:515] T 74e3cbe3521a46cfb42a6cb7ba98430c P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:45.384294  1267 raft_consensus.cc:385] T 74e3cbe3521a46cfb42a6cb7ba98430c P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.358903  1374 consensus_queue.cc:1048] T edea2a0a3c264f2b810295aea0acfb73 P 937efeddef934b2b8bc8632594903085 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.034s
I20260709 12:26:45.392525  1267 raft_consensus.cc:740] T 74e3cbe3521a46cfb42a6cb7ba98430c P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.354159  1362 raft_consensus.cc:2804] T 343e626d0073462fa2020fcf2e2f8ffb P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:45.394495  1362 raft_consensus.cc:697] T 343e626d0073462fa2020fcf2e2f8ffb P 8fa35514a8d84740b1b46ae496307f20 [term 1 LEADER]: Becoming Leader. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Running, Role: LEADER
I20260709 12:26:45.395342  1362 consensus_queue.cc:237] T 343e626d0073462fa2020fcf2e2f8ffb P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:45.395444  1267 consensus_queue.cc:260] T 74e3cbe3521a46cfb42a6cb7ba98430c P 8fa35514a8d84740b1b46ae496307f20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:45.398329  1265 tablet_bootstrap.cc:654] T c5197f4025d94ce096c14c6ca011b47b P 7f9cbe40e40d429aa004e4a7fb42f132: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.398408  1267 ts_tablet_manager.cc:1434] T 74e3cbe3521a46cfb42a6cb7ba98430c P 8fa35514a8d84740b1b46ae496307f20: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 12:26:45.403414  1451 consensus_queue.cc:1048] T c4234c6cf75048c5a6cdf34e43c9bd1e P aa098a557d34433896712068efd0d9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:45.405839  1359 leader_election.cc:290] T 74e3cbe3521a46cfb42a6cb7ba98430c P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341)
I20260709 12:26:45.406945  1146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74e3cbe3521a46cfb42a6cb7ba98430c" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:45.407671  1146 raft_consensus.cc:2468] T 74e3cbe3521a46cfb42a6cb7ba98430c P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f9cbe40e40d429aa004e4a7fb42f132 in term 0.
I20260709 12:26:45.409773  1038 leader_election.cc:304] T 74e3cbe3521a46cfb42a6cb7ba98430c P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 8fa35514a8d84740b1b46ae496307f20; no voters: 
I20260709 12:26:45.410998   997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74e3cbe3521a46cfb42a6cb7ba98430c" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
I20260709 12:26:45.412386  1266 tablet_bootstrap.cc:654] T 343e626d0073462fa2020fcf2e2f8ffb P aa098a557d34433896712068efd0d9a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.412294  1359 raft_consensus.cc:2804] T 74e3cbe3521a46cfb42a6cb7ba98430c P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:26:45.412640  1038 leader_election.cc:343] T 74e3cbe3521a46cfb42a6cb7ba98430c P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.417029  1359 raft_consensus.cc:493] T 74e3cbe3521a46cfb42a6cb7ba98430c P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:45.417483  1359 raft_consensus.cc:3060] T 74e3cbe3521a46cfb42a6cb7ba98430c P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.420626  1374 consensus_queue.cc:1048] T c495ce9da627479e92d7b24b3be3641a P 937efeddef934b2b8bc8632594903085 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:45.428372  1451 raft_consensus.cc:493] T b364263cacab4add984e2b6c912fb62e P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.428939  1451 raft_consensus.cc:515] T b364263cacab4add984e2b6c912fb62e P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:45.431176  1451 leader_election.cc:290] T b364263cacab4add984e2b6c912fb62e P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679), 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341)
I20260709 12:26:45.432144  1072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b364263cacab4add984e2b6c912fb62e" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:45.432403  1146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b364263cacab4add984e2b6c912fb62e" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:45.432932  1072 raft_consensus.cc:2468] T b364263cacab4add984e2b6c912fb62e P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa098a557d34433896712068efd0d9a8 in term 0.
W20260709 12:26:45.433964   963 leader_election.cc:343] T b364263cacab4add984e2b6c912fb62e P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.434654   961 leader_election.cc:304] T b364263cacab4add984e2b6c912fb62e P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, aa098a557d34433896712068efd0d9a8; no voters: 8fa35514a8d84740b1b46ae496307f20
I20260709 12:26:45.436913  1336 raft_consensus.cc:2804] T b364263cacab4add984e2b6c912fb62e P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:45.437327  1336 raft_consensus.cc:493] T b364263cacab4add984e2b6c912fb62e P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:45.437728  1336 raft_consensus.cc:3060] T b364263cacab4add984e2b6c912fb62e P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.443096  1371 consensus_queue.cc:1048] T c4234c6cf75048c5a6cdf34e43c9bd1e P aa098a557d34433896712068efd0d9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:45.451233  1265 tablet_bootstrap.cc:492] T c5197f4025d94ce096c14c6ca011b47b P 7f9cbe40e40d429aa004e4a7fb42f132: No bootstrap required, opened a new log
I20260709 12:26:45.453352  1265 ts_tablet_manager.cc:1403] T c5197f4025d94ce096c14c6ca011b47b P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent bootstrapping tablet: real 0.073s	user 0.010s	sys 0.004s
I20260709 12:26:45.456387  1265 raft_consensus.cc:359] T c5197f4025d94ce096c14c6ca011b47b P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:45.452382  1359 raft_consensus.cc:515] T 74e3cbe3521a46cfb42a6cb7ba98430c P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:45.461719  1336 raft_consensus.cc:515] T b364263cacab4add984e2b6c912fb62e P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:45.462903   996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74e3cbe3521a46cfb42a6cb7ba98430c" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8"
W20260709 12:26:45.464380  1038 leader_election.cc:343] T 74e3cbe3521a46cfb42a6cb7ba98430c P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.465063  1072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b364263cacab4add984e2b6c912fb62e" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
I20260709 12:26:45.465847  1072 raft_consensus.cc:3060] T b364263cacab4add984e2b6c912fb62e P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.466672  1146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74e3cbe3521a46cfb42a6cb7ba98430c" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20"
I20260709 12:26:45.467496  1146 raft_consensus.cc:3060] T 74e3cbe3521a46cfb42a6cb7ba98430c P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.471872  1365 raft_consensus.cc:493] T 333930b9df5744d59ab498b170a35315 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.472604  1365 raft_consensus.cc:515] T 333930b9df5744d59ab498b170a35315 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:45.473883  1072 raft_consensus.cc:2468] T b364263cacab4add984e2b6c912fb62e P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa098a557d34433896712068efd0d9a8 in term 1.
I20260709 12:26:45.475127   961 leader_election.cc:304] T b364263cacab4add984e2b6c912fb62e P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, aa098a557d34433896712068efd0d9a8; no voters: 
I20260709 12:26:45.479795   996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "333930b9df5744d59ab498b170a35315" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
I20260709 12:26:45.480690   996 raft_consensus.cc:2468] T 333930b9df5744d59ab498b170a35315 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 0.
I20260709 12:26:45.480692  1267 tablet_bootstrap.cc:492] T b364263cacab4add984e2b6c912fb62e P 8fa35514a8d84740b1b46ae496307f20: Bootstrap starting.
I20260709 12:26:45.482180  1112 leader_election.cc:304] T 333930b9df5744d59ab498b170a35315 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20, aa098a557d34433896712068efd0d9a8; no voters: 
I20260709 12:26:45.483116  1421 raft_consensus.cc:2804] T 333930b9df5744d59ab498b170a35315 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:45.483523  1421 raft_consensus.cc:493] T 333930b9df5744d59ab498b170a35315 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:45.483903  1421 raft_consensus.cc:3060] T 333930b9df5744d59ab498b170a35315 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.484019  1365 leader_election.cc:290] T 333930b9df5744d59ab498b170a35315 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:45.544559  1265 raft_consensus.cc:385] T c5197f4025d94ce096c14c6ca011b47b P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.546834  1266 tablet_bootstrap.cc:492] T 343e626d0073462fa2020fcf2e2f8ffb P aa098a557d34433896712068efd0d9a8: No bootstrap required, opened a new log
I20260709 12:26:45.485646  1068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "333930b9df5744d59ab498b170a35315" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:45.530817   891 catalog_manager.cc:5697] T 343e626d0073462fa2020fcf2e2f8ffb P 8fa35514a8d84740b1b46ae496307f20 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131). New cstate: current_term: 1 leader_uuid: "8fa35514a8d84740b1b46ae496307f20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:45.484366  1359 leader_election.cc:290] T 74e3cbe3521a46cfb42a6cb7ba98430c P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 election: Requested vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341)
I20260709 12:26:45.538761  1264 tablet_bootstrap.cc:654] T 98b5b180139845c99c537cd675a60830 P 937efeddef934b2b8bc8632594903085: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.553220  1266 ts_tablet_manager.cc:1403] T 343e626d0073462fa2020fcf2e2f8ffb P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.182s	user 0.016s	sys 0.004s
I20260709 12:26:45.553670  1265 raft_consensus.cc:740] T c5197f4025d94ce096c14c6ca011b47b P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.476109  1451 raft_consensus.cc:2804] T b364263cacab4add984e2b6c912fb62e P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:45.497210  1146 raft_consensus.cc:2468] T 74e3cbe3521a46cfb42a6cb7ba98430c P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f9cbe40e40d429aa004e4a7fb42f132 in term 1.
I20260709 12:26:45.582541  1265 consensus_queue.cc:260] T c5197f4025d94ce096c14c6ca011b47b P 7f9cbe40e40d429aa004e4a7fb42f132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:45.589731  1266 raft_consensus.cc:359] T 343e626d0073462fa2020fcf2e2f8ffb P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:45.590849  1266 raft_consensus.cc:385] T 343e626d0073462fa2020fcf2e2f8ffb P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.591239  1266 raft_consensus.cc:740] T 343e626d0073462fa2020fcf2e2f8ffb P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.573565  1365 raft_consensus.cc:493] T c77af7e1c2044a8eacfe0e76ee974591 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.592466  1365 raft_consensus.cc:515] T c77af7e1c2044a8eacfe0e76ee974591 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:45.599231  1376 raft_consensus.cc:493] T c77af7e1c2044a8eacfe0e76ee974591 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.599826  1376 raft_consensus.cc:515] T c77af7e1c2044a8eacfe0e76ee974591 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:45.602092  1376 leader_election.cc:290] T c77af7e1c2044a8eacfe0e76ee974591 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679), 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341)
I20260709 12:26:45.603819  1146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c77af7e1c2044a8eacfe0e76ee974591" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:45.604548  1146 raft_consensus.cc:2468] T c77af7e1c2044a8eacfe0e76ee974591 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 0.
I20260709 12:26:45.605468  1365 leader_election.cc:290] T c77af7e1c2044a8eacfe0e76ee974591 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:26:45.565124  1068 raft_consensus.cc:2468] T 333930b9df5744d59ab498b170a35315 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 0.
I20260709 12:26:45.606040  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c77af7e1c2044a8eacfe0e76ee974591" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:45.606324  1186 leader_election.cc:304] T c77af7e1c2044a8eacfe0e76ee974591 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085; no voters: 
I20260709 12:26:45.606982  1336 leader_election.cc:290] T b364263cacab4add984e2b6c912fb62e P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 election: Requested vote from peers 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679), 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341)
I20260709 12:26:45.604535  1072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c77af7e1c2044a8eacfe0e76ee974591" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:45.606786  1220 raft_consensus.cc:2468] T c77af7e1c2044a8eacfe0e76ee974591 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 0.
I20260709 12:26:45.608548  1266 consensus_queue.cc:260] T 343e626d0073462fa2020fcf2e2f8ffb P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:45.617337  1266 ts_tablet_manager.cc:1434] T 343e626d0073462fa2020fcf2e2f8ffb P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.049s	user 0.008s	sys 0.000s
I20260709 12:26:45.617336  1265 ts_tablet_manager.cc:1434] T c5197f4025d94ce096c14c6ca011b47b P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent starting tablet: real 0.163s	user 0.004s	sys 0.011s
I20260709 12:26:45.608186  1072 raft_consensus.cc:2468] T c77af7e1c2044a8eacfe0e76ee974591 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 0.
I20260709 12:26:45.608520  1451 raft_consensus.cc:697] T b364263cacab4add984e2b6c912fb62e P aa098a557d34433896712068efd0d9a8 [term 1 LEADER]: Becoming Leader. State: Replica: aa098a557d34433896712068efd0d9a8, State: Running, Role: LEADER
I20260709 12:26:45.613041  1376 raft_consensus.cc:2804] T c77af7e1c2044a8eacfe0e76ee974591 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:45.626044  1451 consensus_queue.cc:237] T b364263cacab4add984e2b6c912fb62e P aa098a557d34433896712068efd0d9a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:45.617074  1146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b364263cacab4add984e2b6c912fb62e" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20"
I20260709 12:26:45.622352  1265 tablet_bootstrap.cc:492] T 0017925ea1bb4374b09c9e692a17f87e P 7f9cbe40e40d429aa004e4a7fb42f132: Bootstrap starting.
I20260709 12:26:45.622884  1109 leader_election.cc:304] T c77af7e1c2044a8eacfe0e76ee974591 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085; no voters: 
I20260709 12:26:45.627766  1376 raft_consensus.cc:493] T c77af7e1c2044a8eacfe0e76ee974591 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:45.629015  1376 raft_consensus.cc:3060] T c77af7e1c2044a8eacfe0e76ee974591 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.630278  1362 raft_consensus.cc:2804] T c77af7e1c2044a8eacfe0e76ee974591 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:45.630712  1362 raft_consensus.cc:493] T c77af7e1c2044a8eacfe0e76ee974591 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:45.630918  1109 consensus_peers.cc:597] T e6de424e08ed4b1d8f6d32d17a44025d P 8fa35514a8d84740b1b46ae496307f20 -> Peer 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909): Couldn't send request to peer 937efeddef934b2b8bc8632594903085. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:45.632376  1362 raft_consensus.cc:3060] T c77af7e1c2044a8eacfe0e76ee974591 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.633571  1267 tablet_bootstrap.cc:654] T b364263cacab4add984e2b6c912fb62e P 8fa35514a8d84740b1b46ae496307f20: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.603221  1421 raft_consensus.cc:515] T 333930b9df5744d59ab498b170a35315 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
W20260709 12:26:45.634500   963 leader_election.cc:343] T b364263cacab4add984e2b6c912fb62e P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:45.616528   960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:33909, user_credentials={real_user=slave}} blocked reactor thread for 51239.7us
I20260709 12:26:45.644315  1070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c77af7e1c2044a8eacfe0e76ee974591" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:45.645072  1070 raft_consensus.cc:2468] T c77af7e1c2044a8eacfe0e76ee974591 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 0.
I20260709 12:26:45.649853  1365 consensus_queue.cc:1048] T e6de424e08ed4b1d8f6d32d17a44025d P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:45.661414  1513 raft_consensus.cc:493] T c5197f4025d94ce096c14c6ca011b47b P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.662034  1513 raft_consensus.cc:515] T c5197f4025d94ce096c14c6ca011b47b P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:45.669665  1362 raft_consensus.cc:515] T c77af7e1c2044a8eacfe0e76ee974591 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:45.671202  1513 leader_election.cc:290] T c5197f4025d94ce096c14c6ca011b47b P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:45.672952  1362 leader_election.cc:290] T c77af7e1c2044a8eacfe0e76ee974591 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 election: Requested vote from peers 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:26:45.673823  1219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c77af7e1c2044a8eacfe0e76ee974591" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085"
I20260709 12:26:45.693310   997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "333930b9df5744d59ab498b170a35315" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8"
I20260709 12:26:45.694252   997 raft_consensus.cc:3060] T 333930b9df5744d59ab498b170a35315 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.695083  1376 raft_consensus.cc:515] T c77af7e1c2044a8eacfe0e76ee974591 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:45.674315  1264 tablet_bootstrap.cc:492] T 98b5b180139845c99c537cd675a60830 P 937efeddef934b2b8bc8632594903085: No bootstrap required, opened a new log
I20260709 12:26:45.681874  1038 leader_election.cc:304] T 74e3cbe3521a46cfb42a6cb7ba98430c P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 8fa35514a8d84740b1b46ae496307f20; no voters: aa098a557d34433896712068efd0d9a8
I20260709 12:26:45.683465  1371 consensus_queue.cc:1048] T 6715731f9a31415a98fa8a0ab9944eec P aa098a557d34433896712068efd0d9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:45.700403  1320 raft_consensus.cc:2804] T 74e3cbe3521a46cfb42a6cb7ba98430c P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:45.700917  1320 raft_consensus.cc:697] T 74e3cbe3521a46cfb42a6cb7ba98430c P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 LEADER]: Becoming Leader. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Running, Role: LEADER
I20260709 12:26:45.701709  1217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5197f4025d94ce096c14c6ca011b47b" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:45.685123  1265 tablet_bootstrap.cc:654] T 0017925ea1bb4374b09c9e692a17f87e P 7f9cbe40e40d429aa004e4a7fb42f132: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.703531  1264 ts_tablet_manager.cc:1403] T 98b5b180139845c99c537cd675a60830 P 937efeddef934b2b8bc8632594903085: Time spent bootstrapping tablet: real 0.327s	user 0.018s	sys 0.002s
I20260709 12:26:45.701748  1320 consensus_queue.cc:237] T 74e3cbe3521a46cfb42a6cb7ba98430c P 7f9cbe40e40d429aa004e4a7fb42f132 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:45.707072  1072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c77af7e1c2044a8eacfe0e76ee974591" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
I20260709 12:26:45.707733  1072 raft_consensus.cc:3060] T c77af7e1c2044a8eacfe0e76ee974591 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.712208  1266 tablet_bootstrap.cc:492] T a93df19c4206495e971bc5e95a2111bc P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:45.710515   895 catalog_manager.cc:5697] T b364263cacab4add984e2b6c912fb62e P aa098a557d34433896712068efd0d9a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to aa098a557d34433896712068efd0d9a8 (127.23.245.129). New cstate: current_term: 1 leader_uuid: "aa098a557d34433896712068efd0d9a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:45.720389  1068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c77af7e1c2044a8eacfe0e76ee974591" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
I20260709 12:26:45.722541   996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5197f4025d94ce096c14c6ca011b47b" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
I20260709 12:26:45.723099  1219 raft_consensus.cc:2393] T c77af7e1c2044a8eacfe0e76ee974591 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8fa35514a8d84740b1b46ae496307f20 in current term 1: Already voted for candidate 937efeddef934b2b8bc8632594903085 in this term.
W20260709 12:26:45.724563  1035 leader_election.cc:343] T c5197f4025d94ce096c14c6ca011b47b P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.711840  1421 leader_election.cc:290] T 333930b9df5744d59ab498b170a35315 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 election: Requested vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:45.726059  1376 leader_election.cc:290] T c77af7e1c2044a8eacfe0e76ee974591 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Requested vote from peers 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679), 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341)
I20260709 12:26:45.727293  1144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c77af7e1c2044a8eacfe0e76ee974591" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20"
I20260709 12:26:45.730173  1144 raft_consensus.cc:2393] T c77af7e1c2044a8eacfe0e76ee974591 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 937efeddef934b2b8bc8632594903085 in current term 1: Already voted for candidate 8fa35514a8d84740b1b46ae496307f20 in this term.
I20260709 12:26:45.730432  1110 leader_election.cc:304] T c77af7e1c2044a8eacfe0e76ee974591 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20; no voters: 7f9cbe40e40d429aa004e4a7fb42f132, 937efeddef934b2b8bc8632594903085
I20260709 12:26:45.727602  1451 consensus_queue.cc:1048] T 6715731f9a31415a98fa8a0ab9944eec P aa098a557d34433896712068efd0d9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:45.732009  1068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "333930b9df5744d59ab498b170a35315" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
W20260709 12:26:45.729496  1038 leader_election.cc:343] T c5197f4025d94ce096c14c6ca011b47b P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.733103  1038 leader_election.cc:304] T c5197f4025d94ce096c14c6ca011b47b P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132; no voters: 937efeddef934b2b8bc8632594903085, aa098a557d34433896712068efd0d9a8
I20260709 12:26:45.731293  1264 raft_consensus.cc:359] T 98b5b180139845c99c537cd675a60830 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:45.732687  1068 raft_consensus.cc:3060] T 333930b9df5744d59ab498b170a35315 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.734566  1264 raft_consensus.cc:385] T 98b5b180139845c99c537cd675a60830 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.727967  1072 raft_consensus.cc:2468] T c77af7e1c2044a8eacfe0e76ee974591 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 1.
I20260709 12:26:45.745711  1264 raft_consensus.cc:740] T 98b5b180139845c99c537cd675a60830 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 937efeddef934b2b8bc8632594903085, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.736258  1320 raft_consensus.cc:2749] T c5197f4025d94ce096c14c6ca011b47b P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:45.749796  1511 raft_consensus.cc:493] T 95743acb416b403b9bfb59afe5bf2fe7 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.758410  1511 raft_consensus.cc:515] T 95743acb416b403b9bfb59afe5bf2fe7 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:45.746147  1421 raft_consensus.cc:2749] T c77af7e1c2044a8eacfe0e76ee974591 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:26:45.754000  1264 consensus_queue.cc:260] T 98b5b180139845c99c537cd675a60830 P 937efeddef934b2b8bc8632594903085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:45.770344   893 catalog_manager.cc:5697] T 74e3cbe3521a46cfb42a6cb7ba98430c P 7f9cbe40e40d429aa004e4a7fb42f132 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130). New cstate: current_term: 1 leader_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:45.771112  1511 leader_election.cc:290] T 95743acb416b403b9bfb59afe5bf2fe7 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341)
I20260709 12:26:45.771692  1184 leader_election.cc:304] T c77af7e1c2044a8eacfe0e76ee974591 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 937efeddef934b2b8bc8632594903085; no voters: 8fa35514a8d84740b1b46ae496307f20
I20260709 12:26:45.773593  1264 ts_tablet_manager.cc:1434] T 98b5b180139845c99c537cd675a60830 P 937efeddef934b2b8bc8632594903085: Time spent starting tablet: real 0.070s	user 0.005s	sys 0.006s
I20260709 12:26:45.774523  1376 raft_consensus.cc:2804] T c77af7e1c2044a8eacfe0e76ee974591 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:45.775024  1376 raft_consensus.cc:697] T c77af7e1c2044a8eacfe0e76ee974591 P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Becoming Leader. State: Replica: 937efeddef934b2b8bc8632594903085, State: Running, Role: LEADER
I20260709 12:26:45.776196  1264 tablet_bootstrap.cc:492] T a93df19c4206495e971bc5e95a2111bc P 937efeddef934b2b8bc8632594903085: Bootstrap starting.
I20260709 12:26:45.775935  1376 consensus_queue.cc:237] T c77af7e1c2044a8eacfe0e76ee974591 P 937efeddef934b2b8bc8632594903085 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:45.773273  1267 tablet_bootstrap.cc:492] T b364263cacab4add984e2b6c912fb62e P 8fa35514a8d84740b1b46ae496307f20: No bootstrap required, opened a new log
I20260709 12:26:45.782624  1267 ts_tablet_manager.cc:1403] T b364263cacab4add984e2b6c912fb62e P 8fa35514a8d84740b1b46ae496307f20: Time spent bootstrapping tablet: real 0.302s	user 0.014s	sys 0.004s
I20260709 12:26:45.782812   996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95743acb416b403b9bfb59afe5bf2fe7" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
I20260709 12:26:45.783653  1264 tablet_bootstrap.cc:654] T a93df19c4206495e971bc5e95a2111bc P 937efeddef934b2b8bc8632594903085: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.785621  1267 raft_consensus.cc:359] T b364263cacab4add984e2b6c912fb62e P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:45.791201  1267 raft_consensus.cc:385] T b364263cacab4add984e2b6c912fb62e P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.791627  1267 raft_consensus.cc:740] T b364263cacab4add984e2b6c912fb62e P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.792814  1267 consensus_queue.cc:260] T b364263cacab4add984e2b6c912fb62e P 8fa35514a8d84740b1b46ae496307f20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:45.795822  1267 ts_tablet_manager.cc:1434] T b364263cacab4add984e2b6c912fb62e P 8fa35514a8d84740b1b46ae496307f20: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
W20260709 12:26:45.799448  1038 leader_election.cc:343] T 95743acb416b403b9bfb59afe5bf2fe7 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.799789  1144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95743acb416b403b9bfb59afe5bf2fe7" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
W20260709 12:26:45.801790  1038 leader_election.cc:343] T 95743acb416b403b9bfb59afe5bf2fe7 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:45.805255  1371 raft_consensus.cc:493] T 343e626d0073462fa2020fcf2e2f8ffb P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.802513  1038 leader_election.cc:304] T 95743acb416b403b9bfb59afe5bf2fe7 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132; no voters: 8fa35514a8d84740b1b46ae496307f20, aa098a557d34433896712068efd0d9a8
I20260709 12:26:45.805827  1371 raft_consensus.cc:515] T 343e626d0073462fa2020fcf2e2f8ffb P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:45.806427  1320 raft_consensus.cc:2749] T 95743acb416b403b9bfb59afe5bf2fe7 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:45.798480  1267 tablet_bootstrap.cc:492] T 1d925407b8314f5b95a8c940f195433a P 8fa35514a8d84740b1b46ae496307f20: Bootstrap starting.
I20260709 12:26:45.827314  1451 raft_consensus.cc:493] T 98b5b180139845c99c537cd675a60830 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.828151   997 raft_consensus.cc:2468] T 333930b9df5744d59ab498b170a35315 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 1.
I20260709 12:26:45.829909  1146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343e626d0073462fa2020fcf2e2f8ffb" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:45.830153  1451 raft_consensus.cc:515] T 98b5b180139845c99c537cd675a60830 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:45.830907  1371 leader_election.cc:290] T 343e626d0073462fa2020fcf2e2f8ffb P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:26:45.828377  1068 raft_consensus.cc:2468] T 333930b9df5744d59ab498b170a35315 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 1.
I20260709 12:26:45.852027  1451 leader_election.cc:290] T 98b5b180139845c99c537cd675a60830 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:45.865196  1217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343e626d0073462fa2020fcf2e2f8ffb" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:45.866104  1217 raft_consensus.cc:2393] T 343e626d0073462fa2020fcf2e2f8ffb P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aa098a557d34433896712068efd0d9a8 in current term 1: Already voted for candidate 8fa35514a8d84740b1b46ae496307f20 in this term.
I20260709 12:26:45.867444  1112 leader_election.cc:304] T 333930b9df5744d59ab498b170a35315 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20, aa098a557d34433896712068efd0d9a8; no voters: 
I20260709 12:26:45.869174  1421 raft_consensus.cc:2804] T 333930b9df5744d59ab498b170a35315 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:45.869637  1421 raft_consensus.cc:697] T 333930b9df5744d59ab498b170a35315 P 8fa35514a8d84740b1b46ae496307f20 [term 1 LEADER]: Becoming Leader. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Running, Role: LEADER
I20260709 12:26:45.870437  1421 consensus_queue.cc:237] T 333930b9df5744d59ab498b170a35315 P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:45.872287  1265 tablet_bootstrap.cc:492] T 0017925ea1bb4374b09c9e692a17f87e P 7f9cbe40e40d429aa004e4a7fb42f132: No bootstrap required, opened a new log
I20260709 12:26:45.872838  1265 ts_tablet_manager.cc:1403] T 0017925ea1bb4374b09c9e692a17f87e P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent bootstrapping tablet: real 0.252s	user 0.040s	sys 0.031s
I20260709 12:26:45.879479  1266 tablet_bootstrap.cc:654] T a93df19c4206495e971bc5e95a2111bc P aa098a557d34433896712068efd0d9a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.878590  1265 raft_consensus.cc:359] T 0017925ea1bb4374b09c9e692a17f87e P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:45.880582  1265 raft_consensus.cc:385] T 0017925ea1bb4374b09c9e692a17f87e P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.881229  1265 raft_consensus.cc:740] T 0017925ea1bb4374b09c9e692a17f87e P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.886555  1317 consensus_queue.cc:1048] T 5302c354091f4926812eb90f518b9d6a P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:26:45.894690   943 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:45.896865  1267 tablet_bootstrap.cc:654] T 1d925407b8314f5b95a8c940f195433a P 8fa35514a8d84740b1b46ae496307f20: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:45.888409  1265 consensus_queue.cc:260] T 0017925ea1bb4374b09c9e692a17f87e P 7f9cbe40e40d429aa004e4a7fb42f132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:45.919287  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b5b180139845c99c537cd675a60830" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:45.920074  1220 raft_consensus.cc:2468] T 98b5b180139845c99c537cd675a60830 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa098a557d34433896712068efd0d9a8 in term 0.
I20260709 12:26:45.910218   893 catalog_manager.cc:5697] T c77af7e1c2044a8eacfe0e76ee974591 P 937efeddef934b2b8bc8632594903085 reported cstate change: term changed from 0 to 1, leader changed from <none> to 937efeddef934b2b8bc8632594903085 (127.23.245.132). New cstate: current_term: 1 leader_uuid: "937efeddef934b2b8bc8632594903085" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:45.927111  1265 ts_tablet_manager.cc:1434] T 0017925ea1bb4374b09c9e692a17f87e P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.001s
I20260709 12:26:45.936314  1264 tablet_bootstrap.cc:492] T a93df19c4206495e971bc5e95a2111bc P 937efeddef934b2b8bc8632594903085: No bootstrap required, opened a new log
I20260709 12:26:45.936882  1264 ts_tablet_manager.cc:1403] T a93df19c4206495e971bc5e95a2111bc P 937efeddef934b2b8bc8632594903085: Time spent bootstrapping tablet: real 0.161s	user 0.017s	sys 0.018s
I20260709 12:26:45.937987  1265 tablet_bootstrap.cc:492] T 329e639d23154fb6bd4ccdf095dbd0e0 P 7f9cbe40e40d429aa004e4a7fb42f132: Bootstrap starting.
I20260709 12:26:45.939399   960 leader_election.cc:304] T 343e626d0073462fa2020fcf2e2f8ffb P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa098a557d34433896712068efd0d9a8; no voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085
I20260709 12:26:45.942057  1336 raft_consensus.cc:3060] T 343e626d0073462fa2020fcf2e2f8ffb P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.939700  1069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b5b180139845c99c537cd675a60830" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:45.948699  1069 raft_consensus.cc:2468] T 98b5b180139845c99c537cd675a60830 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa098a557d34433896712068efd0d9a8 in term 0.
I20260709 12:26:45.953606  1317 raft_consensus.cc:493] T b364263cacab4add984e2b6c912fb62e P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.954162  1317 raft_consensus.cc:515] T b364263cacab4add984e2b6c912fb62e P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:45.958261  1266 tablet_bootstrap.cc:492] T a93df19c4206495e971bc5e95a2111bc P aa098a557d34433896712068efd0d9a8: No bootstrap required, opened a new log
I20260709 12:26:45.958807  1266 ts_tablet_manager.cc:1403] T a93df19c4206495e971bc5e95a2111bc P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.270s	user 0.020s	sys 0.014s
I20260709 12:26:45.959558  1317 leader_election.cc:290] T b364263cacab4add984e2b6c912fb62e P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:45.961319   960 leader_election.cc:304] T 98b5b180139845c99c537cd675a60830 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 937efeddef934b2b8bc8632594903085, aa098a557d34433896712068efd0d9a8; no voters: 
I20260709 12:26:45.963148  1336 raft_consensus.cc:2749] T 343e626d0073462fa2020fcf2e2f8ffb P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:45.964612  1264 raft_consensus.cc:359] T a93df19c4206495e971bc5e95a2111bc P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:45.967330  1264 raft_consensus.cc:385] T a93df19c4206495e971bc5e95a2111bc P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.967605  1264 raft_consensus.cc:740] T a93df19c4206495e971bc5e95a2111bc P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 937efeddef934b2b8bc8632594903085, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.966023  1266 raft_consensus.cc:359] T a93df19c4206495e971bc5e95a2111bc P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:45.968137  1266 raft_consensus.cc:385] T a93df19c4206495e971bc5e95a2111bc P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:45.968473  1266 raft_consensus.cc:740] T a93df19c4206495e971bc5e95a2111bc P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:45.968704  1264 consensus_queue.cc:260] T a93df19c4206495e971bc5e95a2111bc P 937efeddef934b2b8bc8632594903085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:45.969333  1266 consensus_queue.cc:260] T a93df19c4206495e971bc5e95a2111bc P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:45.970343  1371 raft_consensus.cc:2804] T 98b5b180139845c99c537cd675a60830 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:45.970916  1371 raft_consensus.cc:493] T 98b5b180139845c99c537cd675a60830 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:45.971443  1266 ts_tablet_manager.cc:1434] T a93df19c4206495e971bc5e95a2111bc P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.005s
I20260709 12:26:45.972581  1264 ts_tablet_manager.cc:1434] T a93df19c4206495e971bc5e95a2111bc P 937efeddef934b2b8bc8632594903085: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 12:26:45.971436  1371 raft_consensus.cc:3060] T 98b5b180139845c99c537cd675a60830 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.984393  1069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b364263cacab4add984e2b6c912fb62e" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:45.985270  1069 raft_consensus.cc:2393] T b364263cacab4add984e2b6c912fb62e P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8fa35514a8d84740b1b46ae496307f20 in current term 1: Already voted for candidate aa098a557d34433896712068efd0d9a8 in this term.
I20260709 12:26:45.987905  1266 tablet_bootstrap.cc:492] T 74e3cbe3521a46cfb42a6cb7ba98430c P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:45.983407  1371 raft_consensus.cc:515] T 98b5b180139845c99c537cd675a60830 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:45.995028  1069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b5b180139845c99c537cd675a60830" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
I20260709 12:26:45.995684  1069 raft_consensus.cc:3060] T 98b5b180139845c99c537cd675a60830 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:45.998492  1508 raft_consensus.cc:493] T a93df19c4206495e971bc5e95a2111bc P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.003270  1264 tablet_bootstrap.cc:492] T 1d925407b8314f5b95a8c940f195433a P 937efeddef934b2b8bc8632594903085: Bootstrap starting.
I20260709 12:26:46.001739  1508 raft_consensus.cc:515] T a93df19c4206495e971bc5e95a2111bc P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:45.999974   893 catalog_manager.cc:5697] T 333930b9df5744d59ab498b170a35315 P 8fa35514a8d84740b1b46ae496307f20 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131). New cstate: current_term: 1 leader_uuid: "8fa35514a8d84740b1b46ae496307f20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:46.006481  1508 leader_election.cc:290] T a93df19c4206495e971bc5e95a2111bc P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:46.007686  1070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93df19c4206495e971bc5e95a2111bc" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:46.008395  1070 raft_consensus.cc:2468] T a93df19c4206495e971bc5e95a2111bc P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 0.
I20260709 12:26:46.008849  1317 consensus_queue.cc:1048] T 343e626d0073462fa2020fcf2e2f8ffb P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:46.009738  1184 leader_election.cc:304] T a93df19c4206495e971bc5e95a2111bc P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 937efeddef934b2b8bc8632594903085; no voters: 
I20260709 12:26:45.998344  1371 leader_election.cc:290] T 98b5b180139845c99c537cd675a60830 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 election: Requested vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:46.012920  1508 raft_consensus.cc:2804] T a93df19c4206495e971bc5e95a2111bc P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:46.013515  1508 raft_consensus.cc:493] T a93df19c4206495e971bc5e95a2111bc P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:46.013841  1508 raft_consensus.cc:3060] T a93df19c4206495e971bc5e95a2111bc P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.028746   997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b364263cacab4add984e2b6c912fb62e" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
I20260709 12:26:46.035588  1146 raft_consensus.cc:3060] T b364263cacab4add984e2b6c912fb62e P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.038986  1267 tablet_bootstrap.cc:492] T 1d925407b8314f5b95a8c940f195433a P 8fa35514a8d84740b1b46ae496307f20: No bootstrap required, opened a new log
I20260709 12:26:46.039523  1267 ts_tablet_manager.cc:1403] T 1d925407b8314f5b95a8c940f195433a P 8fa35514a8d84740b1b46ae496307f20: Time spent bootstrapping tablet: real 0.241s	user 0.030s	sys 0.036s
I20260709 12:26:46.042624  1267 raft_consensus.cc:359] T 1d925407b8314f5b95a8c940f195433a P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:46.043324  1267 raft_consensus.cc:385] T 1d925407b8314f5b95a8c940f195433a P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.043601  1267 raft_consensus.cc:740] T 1d925407b8314f5b95a8c940f195433a P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.044430  1267 consensus_queue.cc:260] T 1d925407b8314f5b95a8c940f195433a P 8fa35514a8d84740b1b46ae496307f20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:46.045083  1371 consensus_queue.cc:1048] T b364263cacab4add984e2b6c912fb62e P aa098a557d34433896712068efd0d9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:46.033381  1508 raft_consensus.cc:515] T a93df19c4206495e971bc5e95a2111bc P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:46.048606  1265 tablet_bootstrap.cc:654] T 329e639d23154fb6bd4ccdf095dbd0e0 P 7f9cbe40e40d429aa004e4a7fb42f132: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.053292  1069 raft_consensus.cc:2468] T 98b5b180139845c99c537cd675a60830 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa098a557d34433896712068efd0d9a8 in term 1.
I20260709 12:26:46.054510   961 leader_election.cc:304] T 98b5b180139845c99c537cd675a60830 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, aa098a557d34433896712068efd0d9a8; no voters: 
I20260709 12:26:46.056195  1371 raft_consensus.cc:2804] T 98b5b180139845c99c537cd675a60830 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:46.056612  1266 tablet_bootstrap.cc:654] T 74e3cbe3521a46cfb42a6cb7ba98430c P aa098a557d34433896712068efd0d9a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.056723  1371 raft_consensus.cc:697] T 98b5b180139845c99c537cd675a60830 P aa098a557d34433896712068efd0d9a8 [term 1 LEADER]: Becoming Leader. State: Replica: aa098a557d34433896712068efd0d9a8, State: Running, Role: LEADER
I20260709 12:26:46.057746  1371 consensus_queue.cc:237] T 98b5b180139845c99c537cd675a60830 P aa098a557d34433896712068efd0d9a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:46.060057  1267 ts_tablet_manager.cc:1434] T 1d925407b8314f5b95a8c940f195433a P 8fa35514a8d84740b1b46ae496307f20: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:26:46.061281  1267 tablet_bootstrap.cc:492] T 95743acb416b403b9bfb59afe5bf2fe7 P 8fa35514a8d84740b1b46ae496307f20: Bootstrap starting.
I20260709 12:26:46.076696  1219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b5b180139845c99c537cd675a60830" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085"
I20260709 12:26:46.077459  1219 raft_consensus.cc:3060] T 98b5b180139845c99c537cd675a60830 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.078100  1362 consensus_queue.cc:1048] T 5302c354091f4926812eb90f518b9d6a P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:46.079523  1362 consensus_queue.cc:1048] T 343e626d0073462fa2020fcf2e2f8ffb P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:46.082244   997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93df19c4206495e971bc5e95a2111bc" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
I20260709 12:26:46.082943   997 raft_consensus.cc:2468] T a93df19c4206495e971bc5e95a2111bc P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 0.
I20260709 12:26:46.084574  1112 leader_election.cc:304] T b364263cacab4add984e2b6c912fb62e P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20; no voters: 7f9cbe40e40d429aa004e4a7fb42f132, aa098a557d34433896712068efd0d9a8
I20260709 12:26:46.087343  1508 leader_election.cc:290] T a93df19c4206495e971bc5e95a2111bc P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Requested vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:46.088809  1069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93df19c4206495e971bc5e95a2111bc" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
I20260709 12:26:46.089758  1069 raft_consensus.cc:3060] T a93df19c4206495e971bc5e95a2111bc P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.098035  1264 tablet_bootstrap.cc:654] T 1d925407b8314f5b95a8c940f195433a P 937efeddef934b2b8bc8632594903085: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.101226   895 catalog_manager.cc:5697] T 98b5b180139845c99c537cd675a60830 P aa098a557d34433896712068efd0d9a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to aa098a557d34433896712068efd0d9a8 (127.23.245.129). New cstate: current_term: 1 leader_uuid: "aa098a557d34433896712068efd0d9a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:46.104640  1267 tablet_bootstrap.cc:654] T 95743acb416b403b9bfb59afe5bf2fe7 P 8fa35514a8d84740b1b46ae496307f20: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.104738  1362 raft_consensus.cc:2749] T b364263cacab4add984e2b6c912fb62e P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:26:46.111049  1038 consensus_peers.cc:597] T 74e3cbe3521a46cfb42a6cb7ba98430c P 7f9cbe40e40d429aa004e4a7fb42f132 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:46.119015  1266 tablet_bootstrap.cc:492] T 74e3cbe3521a46cfb42a6cb7ba98430c P aa098a557d34433896712068efd0d9a8: No bootstrap required, opened a new log
I20260709 12:26:46.121362  1266 ts_tablet_manager.cc:1403] T 74e3cbe3521a46cfb42a6cb7ba98430c P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.149s	user 0.015s	sys 0.013s
I20260709 12:26:46.125576  1219 raft_consensus.cc:2468] T 98b5b180139845c99c537cd675a60830 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa098a557d34433896712068efd0d9a8 in term 1.
I20260709 12:26:46.125516  1266 raft_consensus.cc:359] T 74e3cbe3521a46cfb42a6cb7ba98430c P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:46.126505  1266 raft_consensus.cc:385] T 74e3cbe3521a46cfb42a6cb7ba98430c P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.137604  1266 raft_consensus.cc:740] T 74e3cbe3521a46cfb42a6cb7ba98430c P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.138593  1451 consensus_queue.cc:1048] T b364263cacab4add984e2b6c912fb62e P aa098a557d34433896712068efd0d9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:46.141966  1266 consensus_queue.cc:260] T 74e3cbe3521a46cfb42a6cb7ba98430c P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:46.155725  1266 ts_tablet_manager.cc:1434] T 74e3cbe3521a46cfb42a6cb7ba98430c P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.001s
I20260709 12:26:46.157203  1266 tablet_bootstrap.cc:492] T 1d925407b8314f5b95a8c940f195433a P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:46.158985  1264 tablet_bootstrap.cc:492] T 1d925407b8314f5b95a8c940f195433a P 937efeddef934b2b8bc8632594903085: No bootstrap required, opened a new log
I20260709 12:26:46.159677  1264 ts_tablet_manager.cc:1403] T 1d925407b8314f5b95a8c940f195433a P 937efeddef934b2b8bc8632594903085: Time spent bootstrapping tablet: real 0.159s	user 0.013s	sys 0.014s
I20260709 12:26:46.170482  1266 tablet_bootstrap.cc:654] T 1d925407b8314f5b95a8c940f195433a P aa098a557d34433896712068efd0d9a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.173460  1265 tablet_bootstrap.cc:492] T 329e639d23154fb6bd4ccdf095dbd0e0 P 7f9cbe40e40d429aa004e4a7fb42f132: No bootstrap required, opened a new log
I20260709 12:26:46.173983  1265 ts_tablet_manager.cc:1403] T 329e639d23154fb6bd4ccdf095dbd0e0 P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent bootstrapping tablet: real 0.242s	user 0.016s	sys 0.010s
I20260709 12:26:46.174743  1451 raft_consensus.cc:493] T 74e3cbe3521a46cfb42a6cb7ba98430c P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.175391  1451 raft_consensus.cc:515] T 74e3cbe3521a46cfb42a6cb7ba98430c P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:46.177098  1265 raft_consensus.cc:359] T 329e639d23154fb6bd4ccdf095dbd0e0 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:46.179544  1265 raft_consensus.cc:385] T 329e639d23154fb6bd4ccdf095dbd0e0 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.179906  1265 raft_consensus.cc:740] T 329e639d23154fb6bd4ccdf095dbd0e0 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.180845  1265 consensus_queue.cc:260] T 329e639d23154fb6bd4ccdf095dbd0e0 P 7f9cbe40e40d429aa004e4a7fb42f132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:46.185221  1265 ts_tablet_manager.cc:1434] T 329e639d23154fb6bd4ccdf095dbd0e0 P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 12:26:46.171794  1264 raft_consensus.cc:359] T 1d925407b8314f5b95a8c940f195433a P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:46.190124  1264 raft_consensus.cc:385] T 1d925407b8314f5b95a8c940f195433a P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.192407  1451 leader_election.cc:290] T 74e3cbe3521a46cfb42a6cb7ba98430c P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679), 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341)
I20260709 12:26:46.197258  1144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74e3cbe3521a46cfb42a6cb7ba98430c" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:46.199123  1144 raft_consensus.cc:2393] T 74e3cbe3521a46cfb42a6cb7ba98430c P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aa098a557d34433896712068efd0d9a8 in current term 1: Already voted for candidate 7f9cbe40e40d429aa004e4a7fb42f132 in this term.
W20260709 12:26:46.189311   960 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.132:33909, user_credentials={real_user=slave}} blocked reactor thread for 69179.3us
I20260709 12:26:46.200910  1070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74e3cbe3521a46cfb42a6cb7ba98430c" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:46.202940   996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a93df19c4206495e971bc5e95a2111bc" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8"
I20260709 12:26:46.203531   996 raft_consensus.cc:3060] T a93df19c4206495e971bc5e95a2111bc P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.190881  1264 raft_consensus.cc:740] T 1d925407b8314f5b95a8c940f195433a P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 937efeddef934b2b8bc8632594903085, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.204070  1069 raft_consensus.cc:2468] T a93df19c4206495e971bc5e95a2111bc P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 1.
I20260709 12:26:46.203893   961 leader_election.cc:304] T 74e3cbe3521a46cfb42a6cb7ba98430c P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa098a557d34433896712068efd0d9a8; no voters: 7f9cbe40e40d429aa004e4a7fb42f132, 8fa35514a8d84740b1b46ae496307f20
I20260709 12:26:46.205821  1264 consensus_queue.cc:260] T 1d925407b8314f5b95a8c940f195433a P 937efeddef934b2b8bc8632594903085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:46.207473  1540 raft_consensus.cc:3060] T 74e3cbe3521a46cfb42a6cb7ba98430c P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.212237  1265 tablet_bootstrap.cc:492] T 6474754cce8f4042bcab4ac631e9a82f P 7f9cbe40e40d429aa004e4a7fb42f132: Bootstrap starting.
I20260709 12:26:46.212803  1267 tablet_bootstrap.cc:492] T 95743acb416b403b9bfb59afe5bf2fe7 P 8fa35514a8d84740b1b46ae496307f20: No bootstrap required, opened a new log
I20260709 12:26:46.213321  1267 ts_tablet_manager.cc:1403] T 95743acb416b403b9bfb59afe5bf2fe7 P 8fa35514a8d84740b1b46ae496307f20: Time spent bootstrapping tablet: real 0.152s	user 0.006s	sys 0.015s
I20260709 12:26:46.214936  1540 raft_consensus.cc:2749] T 74e3cbe3521a46cfb42a6cb7ba98430c P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:46.216030  1264 ts_tablet_manager.cc:1434] T 1d925407b8314f5b95a8c940f195433a P 937efeddef934b2b8bc8632594903085: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.000s
I20260709 12:26:46.216071  1184 leader_election.cc:304] T a93df19c4206495e971bc5e95a2111bc P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 937efeddef934b2b8bc8632594903085; no voters: 
I20260709 12:26:46.217259  1264 tablet_bootstrap.cc:492] T e6de424e08ed4b1d8f6d32d17a44025d P 937efeddef934b2b8bc8632594903085: Bootstrap starting.
I20260709 12:26:46.221251  1508 raft_consensus.cc:2804] T a93df19c4206495e971bc5e95a2111bc P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:46.221843  1508 raft_consensus.cc:697] T a93df19c4206495e971bc5e95a2111bc P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Becoming Leader. State: Replica: 937efeddef934b2b8bc8632594903085, State: Running, Role: LEADER
I20260709 12:26:46.222687  1508 consensus_queue.cc:237] T a93df19c4206495e971bc5e95a2111bc P 937efeddef934b2b8bc8632594903085 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:46.224418  1264 tablet_bootstrap.cc:654] T e6de424e08ed4b1d8f6d32d17a44025d P 937efeddef934b2b8bc8632594903085: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.224907  1265 tablet_bootstrap.cc:654] T 6474754cce8f4042bcab4ac631e9a82f P 7f9cbe40e40d429aa004e4a7fb42f132: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.242664   996 raft_consensus.cc:2468] T a93df19c4206495e971bc5e95a2111bc P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 1.
I20260709 12:26:46.244812  1267 raft_consensus.cc:359] T 95743acb416b403b9bfb59afe5bf2fe7 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:46.245779  1267 raft_consensus.cc:385] T 95743acb416b403b9bfb59afe5bf2fe7 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.246126  1267 raft_consensus.cc:740] T 95743acb416b403b9bfb59afe5bf2fe7 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.246976  1267 consensus_queue.cc:260] T 95743acb416b403b9bfb59afe5bf2fe7 P 8fa35514a8d84740b1b46ae496307f20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:46.249605  1267 ts_tablet_manager.cc:1434] T 95743acb416b403b9bfb59afe5bf2fe7 P 8fa35514a8d84740b1b46ae496307f20: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 12:26:46.250651  1267 tablet_bootstrap.cc:492] T dc91bacc3de44d21bc62d8b9a003fdcf P 8fa35514a8d84740b1b46ae496307f20: Bootstrap starting.
I20260709 12:26:46.250214   891 catalog_manager.cc:5697] T a93df19c4206495e971bc5e95a2111bc P 937efeddef934b2b8bc8632594903085 reported cstate change: term changed from 0 to 1, leader changed from <none> to 937efeddef934b2b8bc8632594903085 (127.23.245.132). New cstate: current_term: 1 leader_uuid: "937efeddef934b2b8bc8632594903085" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:46.257206  1267 tablet_bootstrap.cc:654] T dc91bacc3de44d21bc62d8b9a003fdcf P 8fa35514a8d84740b1b46ae496307f20: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.258399  1511 consensus_queue.cc:1048] T 74e3cbe3521a46cfb42a6cb7ba98430c P 7f9cbe40e40d429aa004e4a7fb42f132 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:46.259415  1265 tablet_bootstrap.cc:492] T 6474754cce8f4042bcab4ac631e9a82f P 7f9cbe40e40d429aa004e4a7fb42f132: No bootstrap required, opened a new log
I20260709 12:26:46.262506  1265 ts_tablet_manager.cc:1403] T 6474754cce8f4042bcab4ac631e9a82f P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent bootstrapping tablet: real 0.051s	user 0.008s	sys 0.003s
I20260709 12:26:46.266250  1265 raft_consensus.cc:359] T 6474754cce8f4042bcab4ac631e9a82f P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:46.267104  1265 raft_consensus.cc:385] T 6474754cce8f4042bcab4ac631e9a82f P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.267460  1265 raft_consensus.cc:740] T 6474754cce8f4042bcab4ac631e9a82f P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.268620  1266 tablet_bootstrap.cc:492] T 1d925407b8314f5b95a8c940f195433a P aa098a557d34433896712068efd0d9a8: No bootstrap required, opened a new log
I20260709 12:26:46.269151  1266 ts_tablet_manager.cc:1403] T 1d925407b8314f5b95a8c940f195433a P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.112s	user 0.017s	sys 0.005s
I20260709 12:26:46.270578  1362 raft_consensus.cc:493] T 1d925407b8314f5b95a8c940f195433a P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.271093  1362 raft_consensus.cc:515] T 1d925407b8314f5b95a8c940f195433a P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:46.273249  1362 leader_election.cc:290] T 1d925407b8314f5b95a8c940f195433a P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:46.275997  1511 raft_consensus.cc:493] T 0017925ea1bb4374b09c9e692a17f87e P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.276575  1511 raft_consensus.cc:515] T 0017925ea1bb4374b09c9e692a17f87e P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:46.277156  1266 raft_consensus.cc:359] T 1d925407b8314f5b95a8c940f195433a P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:46.277838  1217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d925407b8314f5b95a8c940f195433a" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:46.278136  1266 raft_consensus.cc:385] T 1d925407b8314f5b95a8c940f195433a P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.278497  1217 raft_consensus.cc:2468] T 1d925407b8314f5b95a8c940f195433a P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 0.
I20260709 12:26:46.278595  1511 leader_election.cc:290] T 0017925ea1bb4374b09c9e692a17f87e P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341)
I20260709 12:26:46.278550  1266 raft_consensus.cc:740] T 1d925407b8314f5b95a8c940f195433a P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.279662   996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0017925ea1bb4374b09c9e692a17f87e" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
I20260709 12:26:46.280133  1109 leader_election.cc:304] T 1d925407b8314f5b95a8c940f195433a P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085; no voters: 
I20260709 12:26:46.281234  1365 raft_consensus.cc:2804] T 1d925407b8314f5b95a8c940f195433a P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:46.280982  1266 consensus_queue.cc:260] T 1d925407b8314f5b95a8c940f195433a P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:46.281651  1365 raft_consensus.cc:493] T 1d925407b8314f5b95a8c940f195433a P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:46.281829  1038 leader_election.cc:343] T 0017925ea1bb4374b09c9e692a17f87e P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:46.282078  1365 raft_consensus.cc:3060] T 1d925407b8314f5b95a8c940f195433a P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.285477  1266 ts_tablet_manager.cc:1434] T 1d925407b8314f5b95a8c940f195433a P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.016s	user 0.010s	sys 0.000s
I20260709 12:26:46.287297  1264 tablet_bootstrap.cc:492] T e6de424e08ed4b1d8f6d32d17a44025d P 937efeddef934b2b8bc8632594903085: No bootstrap required, opened a new log
I20260709 12:26:46.287783  1264 ts_tablet_manager.cc:1403] T e6de424e08ed4b1d8f6d32d17a44025d P 937efeddef934b2b8bc8632594903085: Time spent bootstrapping tablet: real 0.071s	user 0.026s	sys 0.030s
I20260709 12:26:46.288956  1146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0017925ea1bb4374b09c9e692a17f87e" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
W20260709 12:26:46.290555  1038 leader_election.cc:343] T 0017925ea1bb4374b09c9e692a17f87e P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:46.291047  1038 leader_election.cc:304] T 0017925ea1bb4374b09c9e692a17f87e P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132; no voters: 8fa35514a8d84740b1b46ae496307f20, aa098a557d34433896712068efd0d9a8
I20260709 12:26:46.291116  1264 raft_consensus.cc:359] T e6de424e08ed4b1d8f6d32d17a44025d P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:46.291821  1264 raft_consensus.cc:385] T e6de424e08ed4b1d8f6d32d17a44025d P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.291947  1511 raft_consensus.cc:2749] T 0017925ea1bb4374b09c9e692a17f87e P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:46.292161  1264 raft_consensus.cc:740] T e6de424e08ed4b1d8f6d32d17a44025d P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 937efeddef934b2b8bc8632594903085, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.292874  1264 consensus_queue.cc:260] T e6de424e08ed4b1d8f6d32d17a44025d P 937efeddef934b2b8bc8632594903085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:46.294317  1499 consensus_queue.cc:1048] T c77af7e1c2044a8eacfe0e76ee974591 P 937efeddef934b2b8bc8632594903085 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:46.294747  1264 ts_tablet_manager.cc:1434] T e6de424e08ed4b1d8f6d32d17a44025d P 937efeddef934b2b8bc8632594903085: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:26:46.298164  1264 tablet_bootstrap.cc:492] T dc91bacc3de44d21bc62d8b9a003fdcf P 937efeddef934b2b8bc8632594903085: Bootstrap starting.
I20260709 12:26:46.299055   995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d925407b8314f5b95a8c940f195433a" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
I20260709 12:26:46.299731   995 raft_consensus.cc:2468] T 1d925407b8314f5b95a8c940f195433a P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 0.
I20260709 12:26:46.301136  1266 tablet_bootstrap.cc:492] T 95743acb416b403b9bfb59afe5bf2fe7 P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:46.287169  1265 consensus_queue.cc:260] T 6474754cce8f4042bcab4ac631e9a82f P 7f9cbe40e40d429aa004e4a7fb42f132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:46.305253  1264 tablet_bootstrap.cc:654] T dc91bacc3de44d21bc62d8b9a003fdcf P 937efeddef934b2b8bc8632594903085: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.306988  1266 tablet_bootstrap.cc:654] T 95743acb416b403b9bfb59afe5bf2fe7 P aa098a557d34433896712068efd0d9a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.313824  1265 ts_tablet_manager.cc:1434] T 6474754cce8f4042bcab4ac631e9a82f P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.000s
I20260709 12:26:46.332468  1499 consensus_queue.cc:1048] T c77af7e1c2044a8eacfe0e76ee974591 P 937efeddef934b2b8bc8632594903085 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:46.334604  1265 tablet_bootstrap.cc:492] T 3d2ccd742ac442419de89cb38ee12d37 P 7f9cbe40e40d429aa004e4a7fb42f132: Bootstrap starting.
I20260709 12:26:46.351812  1365 raft_consensus.cc:515] T 1d925407b8314f5b95a8c940f195433a P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:46.370791  1265 tablet_bootstrap.cc:654] T 3d2ccd742ac442419de89cb38ee12d37 P 7f9cbe40e40d429aa004e4a7fb42f132: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.351958  1267 tablet_bootstrap.cc:492] T dc91bacc3de44d21bc62d8b9a003fdcf P 8fa35514a8d84740b1b46ae496307f20: No bootstrap required, opened a new log
I20260709 12:26:46.372401  1267 ts_tablet_manager.cc:1403] T dc91bacc3de44d21bc62d8b9a003fdcf P 8fa35514a8d84740b1b46ae496307f20: Time spent bootstrapping tablet: real 0.122s	user 0.012s	sys 0.008s
I20260709 12:26:46.379465  1217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d925407b8314f5b95a8c940f195433a" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085"
I20260709 12:26:46.380429  1217 raft_consensus.cc:3060] T 1d925407b8314f5b95a8c940f195433a P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.398864  1365 leader_election.cc:290] T 1d925407b8314f5b95a8c940f195433a P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 election: Requested vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:46.402086  1267 raft_consensus.cc:359] T dc91bacc3de44d21bc62d8b9a003fdcf P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:46.405936  1267 raft_consensus.cc:385] T dc91bacc3de44d21bc62d8b9a003fdcf P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.406307  1267 raft_consensus.cc:740] T dc91bacc3de44d21bc62d8b9a003fdcf P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.414923  1267 consensus_queue.cc:260] T dc91bacc3de44d21bc62d8b9a003fdcf P 8fa35514a8d84740b1b46ae496307f20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:46.403647  1217 raft_consensus.cc:2468] T 1d925407b8314f5b95a8c940f195433a P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 1.
I20260709 12:26:46.417575  1109 leader_election.cc:304] T 1d925407b8314f5b95a8c940f195433a P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085; no voters: 
I20260709 12:26:46.418731  1362 raft_consensus.cc:2804] T 1d925407b8314f5b95a8c940f195433a P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:46.419217  1362 raft_consensus.cc:697] T 1d925407b8314f5b95a8c940f195433a P 8fa35514a8d84740b1b46ae496307f20 [term 1 LEADER]: Becoming Leader. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Running, Role: LEADER
I20260709 12:26:46.420068  1362 consensus_queue.cc:237] T 1d925407b8314f5b95a8c940f195433a P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:46.427182  1267 ts_tablet_manager.cc:1434] T dc91bacc3de44d21bc62d8b9a003fdcf P 8fa35514a8d84740b1b46ae496307f20: Time spent starting tablet: real 0.054s	user 0.004s	sys 0.002s
I20260709 12:26:46.433390  1264 tablet_bootstrap.cc:492] T dc91bacc3de44d21bc62d8b9a003fdcf P 937efeddef934b2b8bc8632594903085: No bootstrap required, opened a new log
I20260709 12:26:46.435058  1264 ts_tablet_manager.cc:1403] T dc91bacc3de44d21bc62d8b9a003fdcf P 937efeddef934b2b8bc8632594903085: Time spent bootstrapping tablet: real 0.137s	user 0.040s	sys 0.082s
I20260709 12:26:46.433718   997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d925407b8314f5b95a8c940f195433a" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8"
I20260709 12:26:46.436415   997 raft_consensus.cc:3060] T 1d925407b8314f5b95a8c940f195433a P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.437287  1267 tablet_bootstrap.cc:492] T a1c303d40c6a4cae88aa89d681ae7b76 P 8fa35514a8d84740b1b46ae496307f20: Bootstrap starting.
I20260709 12:26:46.441213  1524 raft_consensus.cc:493] T 95743acb416b403b9bfb59afe5bf2fe7 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.442119  1524 raft_consensus.cc:515] T 95743acb416b403b9bfb59afe5bf2fe7 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:46.444311  1524 leader_election.cc:290] T 95743acb416b403b9bfb59afe5bf2fe7 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:46.444778  1524 consensus_queue.cc:1048] T 333930b9df5744d59ab498b170a35315 P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:46.434289  1266 tablet_bootstrap.cc:492] T 95743acb416b403b9bfb59afe5bf2fe7 P aa098a557d34433896712068efd0d9a8: No bootstrap required, opened a new log
I20260709 12:26:46.438084  1264 raft_consensus.cc:359] T dc91bacc3de44d21bc62d8b9a003fdcf P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:46.447434  1264 raft_consensus.cc:385] T dc91bacc3de44d21bc62d8b9a003fdcf P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.447456  1266 ts_tablet_manager.cc:1403] T 95743acb416b403b9bfb59afe5bf2fe7 P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.147s	user 0.034s	sys 0.058s
I20260709 12:26:46.447960  1264 raft_consensus.cc:740] T dc91bacc3de44d21bc62d8b9a003fdcf P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 937efeddef934b2b8bc8632594903085, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.451071  1264 consensus_queue.cc:260] T dc91bacc3de44d21bc62d8b9a003fdcf P 937efeddef934b2b8bc8632594903085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:46.454197  1264 ts_tablet_manager.cc:1434] T dc91bacc3de44d21bc62d8b9a003fdcf P 937efeddef934b2b8bc8632594903085: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:26:46.454562  1069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95743acb416b403b9bfb59afe5bf2fe7" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:46.455264  1264 tablet_bootstrap.cc:492] T 329e639d23154fb6bd4ccdf095dbd0e0 P 937efeddef934b2b8bc8632594903085: Bootstrap starting.
I20260709 12:26:46.455561  1069 raft_consensus.cc:2468] T 95743acb416b403b9bfb59afe5bf2fe7 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 0.
I20260709 12:26:46.457316  1110 leader_election.cc:304] T 95743acb416b403b9bfb59afe5bf2fe7 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 8fa35514a8d84740b1b46ae496307f20; no voters: 
I20260709 12:26:46.470052   995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95743acb416b403b9bfb59afe5bf2fe7" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
I20260709 12:26:46.465778  1362 raft_consensus.cc:2804] T 95743acb416b403b9bfb59afe5bf2fe7 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:46.473261  1362 raft_consensus.cc:493] T 95743acb416b403b9bfb59afe5bf2fe7 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:46.473739  1362 raft_consensus.cc:3060] T 95743acb416b403b9bfb59afe5bf2fe7 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.478315   997 raft_consensus.cc:2468] T 1d925407b8314f5b95a8c940f195433a P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 1.
I20260709 12:26:46.480520  1320 raft_consensus.cc:493] T 6474754cce8f4042bcab4ac631e9a82f P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.481045  1320 raft_consensus.cc:515] T 6474754cce8f4042bcab4ac631e9a82f P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:46.483129  1320 leader_election.cc:290] T 6474754cce8f4042bcab4ac631e9a82f P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:26:46.492993  1217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6474754cce8f4042bcab4ac631e9a82f" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:46.492725   891 catalog_manager.cc:5697] T 1d925407b8314f5b95a8c940f195433a P 8fa35514a8d84740b1b46ae496307f20 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131). New cstate: current_term: 1 leader_uuid: "8fa35514a8d84740b1b46ae496307f20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:46.494822  1035 leader_election.cc:343] T 6474754cce8f4042bcab4ac631e9a82f P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:46.499866  1267 tablet_bootstrap.cc:654] T a1c303d40c6a4cae88aa89d681ae7b76 P 8fa35514a8d84740b1b46ae496307f20: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.504014  1317 consensus_queue.cc:1048] T 333930b9df5744d59ab498b170a35315 P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:46.504678  1266 raft_consensus.cc:359] T 95743acb416b403b9bfb59afe5bf2fe7 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:46.505650  1266 raft_consensus.cc:385] T 95743acb416b403b9bfb59afe5bf2fe7 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.505985  1266 raft_consensus.cc:740] T 95743acb416b403b9bfb59afe5bf2fe7 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.508139  1266 consensus_queue.cc:260] T 95743acb416b403b9bfb59afe5bf2fe7 P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:46.509024  1145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6474754cce8f4042bcab4ac631e9a82f" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
W20260709 12:26:46.513506  1112 leader_election.cc:343] T 95743acb416b403b9bfb59afe5bf2fe7 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:46.529122  1362 raft_consensus.cc:515] T 95743acb416b403b9bfb59afe5bf2fe7 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:46.532691  1265 tablet_bootstrap.cc:492] T 3d2ccd742ac442419de89cb38ee12d37 P 7f9cbe40e40d429aa004e4a7fb42f132: No bootstrap required, opened a new log
I20260709 12:26:46.533215  1265 ts_tablet_manager.cc:1403] T 3d2ccd742ac442419de89cb38ee12d37 P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent bootstrapping tablet: real 0.200s	user 0.047s	sys 0.027s
I20260709 12:26:46.533643  1264 tablet_bootstrap.cc:654] T 329e639d23154fb6bd4ccdf095dbd0e0 P 937efeddef934b2b8bc8632594903085: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.534687  1266 ts_tablet_manager.cc:1434] T 95743acb416b403b9bfb59afe5bf2fe7 P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.086s	user 0.006s	sys 0.001s
I20260709 12:26:46.529965  1336 consensus_queue.cc:1048] T 98b5b180139845c99c537cd675a60830 P aa098a557d34433896712068efd0d9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:26:46.530967  1038 leader_election.cc:343] T 6474754cce8f4042bcab4ac631e9a82f P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:46.537606  1038 leader_election.cc:304] T 6474754cce8f4042bcab4ac631e9a82f P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132; no voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085
I20260709 12:26:46.538751  1511 raft_consensus.cc:493] T 329e639d23154fb6bd4ccdf095dbd0e0 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.539196  1265 raft_consensus.cc:359] T 3d2ccd742ac442419de89cb38ee12d37 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:46.540560  1265 raft_consensus.cc:385] T 3d2ccd742ac442419de89cb38ee12d37 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.539250  1511 raft_consensus.cc:515] T 329e639d23154fb6bd4ccdf095dbd0e0 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:46.540944  1265 raft_consensus.cc:740] T 3d2ccd742ac442419de89cb38ee12d37 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.545192  1265 consensus_queue.cc:260] T 3d2ccd742ac442419de89cb38ee12d37 P 7f9cbe40e40d429aa004e4a7fb42f132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:46.544404  1320 raft_consensus.cc:2749] T 6474754cce8f4042bcab4ac631e9a82f P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:46.552474  1266 tablet_bootstrap.cc:492] T a1c303d40c6a4cae88aa89d681ae7b76 P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:46.555344  1264 tablet_bootstrap.cc:492] T 329e639d23154fb6bd4ccdf095dbd0e0 P 937efeddef934b2b8bc8632594903085: No bootstrap required, opened a new log
I20260709 12:26:46.556797  1264 ts_tablet_manager.cc:1403] T 329e639d23154fb6bd4ccdf095dbd0e0 P 937efeddef934b2b8bc8632594903085: Time spent bootstrapping tablet: real 0.102s	user 0.007s	sys 0.010s
I20260709 12:26:46.559873  1264 raft_consensus.cc:359] T 329e639d23154fb6bd4ccdf095dbd0e0 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:46.560382  1499 raft_consensus.cc:493] T dc91bacc3de44d21bc62d8b9a003fdcf P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.560631  1264 raft_consensus.cc:385] T 329e639d23154fb6bd4ccdf095dbd0e0 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.561095  1264 raft_consensus.cc:740] T 329e639d23154fb6bd4ccdf095dbd0e0 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 937efeddef934b2b8bc8632594903085, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.560947  1499 raft_consensus.cc:515] T dc91bacc3de44d21bc62d8b9a003fdcf P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:46.564636  1511 leader_election.cc:290] T 329e639d23154fb6bd4ccdf095dbd0e0 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:46.566581   996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "329e639d23154fb6bd4ccdf095dbd0e0" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
I20260709 12:26:46.568492  1069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc91bacc3de44d21bc62d8b9a003fdcf" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:46.569116  1069 raft_consensus.cc:2468] T dc91bacc3de44d21bc62d8b9a003fdcf P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 0.
W20260709 12:26:46.569221  1038 leader_election.cc:343] T 329e639d23154fb6bd4ccdf095dbd0e0 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:46.570044  1499 leader_election.cc:290] T dc91bacc3de44d21bc62d8b9a003fdcf P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679), 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341)
I20260709 12:26:46.570680  1184 leader_election.cc:304] T dc91bacc3de44d21bc62d8b9a003fdcf P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 937efeddef934b2b8bc8632594903085; no voters: 
I20260709 12:26:46.571641  1498 raft_consensus.cc:2804] T dc91bacc3de44d21bc62d8b9a003fdcf P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:46.572046  1498 raft_consensus.cc:493] T dc91bacc3de44d21bc62d8b9a003fdcf P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:46.572383  1498 raft_consensus.cc:3060] T dc91bacc3de44d21bc62d8b9a003fdcf P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.572575  1371 raft_consensus.cc:493] T 95743acb416b403b9bfb59afe5bf2fe7 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.573107  1371 raft_consensus.cc:515] T 95743acb416b403b9bfb59afe5bf2fe7 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:46.574783  1264 consensus_queue.cc:260] T 329e639d23154fb6bd4ccdf095dbd0e0 P 937efeddef934b2b8bc8632594903085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:46.580804  1371 leader_election.cc:290] T 95743acb416b403b9bfb59afe5bf2fe7 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679), 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341)
I20260709 12:26:46.582392  1069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95743acb416b403b9bfb59afe5bf2fe7" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:46.582597  1145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc91bacc3de44d21bc62d8b9a003fdcf" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:46.583020  1069 raft_consensus.cc:2468] T 95743acb416b403b9bfb59afe5bf2fe7 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa098a557d34433896712068efd0d9a8 in term 0.
I20260709 12:26:46.583283  1145 raft_consensus.cc:2468] T dc91bacc3de44d21bc62d8b9a003fdcf P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 0.
I20260709 12:26:46.583403  1217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "329e639d23154fb6bd4ccdf095dbd0e0" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:46.584043  1217 raft_consensus.cc:2468] T 329e639d23154fb6bd4ccdf095dbd0e0 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f9cbe40e40d429aa004e4a7fb42f132 in term 0.
I20260709 12:26:46.584193   961 leader_election.cc:304] T 95743acb416b403b9bfb59afe5bf2fe7 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, aa098a557d34433896712068efd0d9a8; no voters: 
I20260709 12:26:46.585632  1371 raft_consensus.cc:2804] T 95743acb416b403b9bfb59afe5bf2fe7 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:46.586047  1371 raft_consensus.cc:493] T 95743acb416b403b9bfb59afe5bf2fe7 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:46.586671  1371 raft_consensus.cc:3060] T 95743acb416b403b9bfb59afe5bf2fe7 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.586736  1145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95743acb416b403b9bfb59afe5bf2fe7" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:46.587574  1145 raft_consensus.cc:2393] T 95743acb416b403b9bfb59afe5bf2fe7 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aa098a557d34433896712068efd0d9a8 in current term 1: Already voted for candidate 8fa35514a8d84740b1b46ae496307f20 in this term.
I20260709 12:26:46.587291  1035 leader_election.cc:304] T 329e639d23154fb6bd4ccdf095dbd0e0 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 937efeddef934b2b8bc8632594903085; no voters: aa098a557d34433896712068efd0d9a8
I20260709 12:26:46.588426  1511 raft_consensus.cc:2804] T 329e639d23154fb6bd4ccdf095dbd0e0 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:46.588798  1511 raft_consensus.cc:493] T 329e639d23154fb6bd4ccdf095dbd0e0 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:46.589141  1511 raft_consensus.cc:3060] T 329e639d23154fb6bd4ccdf095dbd0e0 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.597301  1498 raft_consensus.cc:515] T dc91bacc3de44d21bc62d8b9a003fdcf P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:46.600502  1498 leader_election.cc:290] T dc91bacc3de44d21bc62d8b9a003fdcf P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Requested vote from peers 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679), 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341)
I20260709 12:26:46.602074  1145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc91bacc3de44d21bc62d8b9a003fdcf" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20"
I20260709 12:26:46.602681  1145 raft_consensus.cc:3060] T dc91bacc3de44d21bc62d8b9a003fdcf P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.604385  1069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc91bacc3de44d21bc62d8b9a003fdcf" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
I20260709 12:26:46.605407  1069 raft_consensus.cc:3060] T dc91bacc3de44d21bc62d8b9a003fdcf P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.608296  1362 leader_election.cc:290] T 95743acb416b403b9bfb59afe5bf2fe7 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 election: Requested vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:46.610549  1145 raft_consensus.cc:2468] T dc91bacc3de44d21bc62d8b9a003fdcf P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 1.
I20260709 12:26:46.611636  1267 tablet_bootstrap.cc:492] T a1c303d40c6a4cae88aa89d681ae7b76 P 8fa35514a8d84740b1b46ae496307f20: No bootstrap required, opened a new log
I20260709 12:26:46.613121  1186 leader_election.cc:304] T dc91bacc3de44d21bc62d8b9a003fdcf P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085; no voters: 
I20260709 12:26:46.602021  1264 ts_tablet_manager.cc:1434] T 329e639d23154fb6bd4ccdf095dbd0e0 P 937efeddef934b2b8bc8632594903085: Time spent starting tablet: real 0.045s	user 0.002s	sys 0.004s
I20260709 12:26:46.620244  1267 ts_tablet_manager.cc:1403] T a1c303d40c6a4cae88aa89d681ae7b76 P 8fa35514a8d84740b1b46ae496307f20: Time spent bootstrapping tablet: real 0.183s	user 0.024s	sys 0.030s
I20260709 12:26:46.620751  1264 tablet_bootstrap.cc:492] T 7b2e497f1fcf4e40b4374fd2b5b261af P 937efeddef934b2b8bc8632594903085: Bootstrap starting.
I20260709 12:26:46.621279  1219 raft_consensus.cc:3060] T e6de424e08ed4b1d8f6d32d17a44025d P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.621563  1499 raft_consensus.cc:2804] T dc91bacc3de44d21bc62d8b9a003fdcf P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:46.622107  1499 raft_consensus.cc:697] T dc91bacc3de44d21bc62d8b9a003fdcf P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Becoming Leader. State: Replica: 937efeddef934b2b8bc8632594903085, State: Running, Role: LEADER
I20260709 12:26:46.623010  1267 raft_consensus.cc:359] T a1c303d40c6a4cae88aa89d681ae7b76 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:46.623801  1267 raft_consensus.cc:385] T a1c303d40c6a4cae88aa89d681ae7b76 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.624104  1267 raft_consensus.cc:740] T a1c303d40c6a4cae88aa89d681ae7b76 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.624571  1070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95743acb416b403b9bfb59afe5bf2fe7" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
I20260709 12:26:46.625195  1070 raft_consensus.cc:3060] T 95743acb416b403b9bfb59afe5bf2fe7 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.624960  1267 consensus_queue.cc:260] T a1c303d40c6a4cae88aa89d681ae7b76 P 8fa35514a8d84740b1b46ae496307f20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:46.626986  1267 ts_tablet_manager.cc:1434] T a1c303d40c6a4cae88aa89d681ae7b76 P 8fa35514a8d84740b1b46ae496307f20: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:26:46.627908  1267 tablet_bootstrap.cc:492] T 7b2e497f1fcf4e40b4374fd2b5b261af P 8fa35514a8d84740b1b46ae496307f20: Bootstrap starting.
I20260709 12:26:46.622901  1499 consensus_queue.cc:237] T dc91bacc3de44d21bc62d8b9a003fdcf P 937efeddef934b2b8bc8632594903085 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:46.628316  1265 ts_tablet_manager.cc:1434] T 3d2ccd742ac442419de89cb38ee12d37 P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent starting tablet: real 0.095s	user 0.011s	sys 0.012s
I20260709 12:26:46.629853  1265 tablet_bootstrap.cc:492] T 0e2eae4c387445f39a059befe390fe45 P 7f9cbe40e40d429aa004e4a7fb42f132: Bootstrap starting.
I20260709 12:26:46.637975   996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95743acb416b403b9bfb59afe5bf2fe7" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8"
I20260709 12:26:46.643456  1265 tablet_bootstrap.cc:654] T 0e2eae4c387445f39a059befe390fe45 P 7f9cbe40e40d429aa004e4a7fb42f132: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.644093  1336 consensus_queue.cc:1048] T 98b5b180139845c99c537cd675a60830 P aa098a557d34433896712068efd0d9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:46.644804  1267 tablet_bootstrap.cc:654] T 7b2e497f1fcf4e40b4374fd2b5b261af P 8fa35514a8d84740b1b46ae496307f20: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.627080  1264 tablet_bootstrap.cc:654] T 7b2e497f1fcf4e40b4374fd2b5b261af P 937efeddef934b2b8bc8632594903085: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.647393  1508 consensus_queue.cc:1048] T a93df19c4206495e971bc5e95a2111bc P 937efeddef934b2b8bc8632594903085 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:46.658627  1267 tablet_bootstrap.cc:492] T 7b2e497f1fcf4e40b4374fd2b5b261af P 8fa35514a8d84740b1b46ae496307f20: No bootstrap required, opened a new log
I20260709 12:26:46.678285  1267 ts_tablet_manager.cc:1403] T 7b2e497f1fcf4e40b4374fd2b5b261af P 8fa35514a8d84740b1b46ae496307f20: Time spent bootstrapping tablet: real 0.051s	user 0.010s	sys 0.007s
I20260709 12:26:46.681170  1267 raft_consensus.cc:359] T 7b2e497f1fcf4e40b4374fd2b5b261af P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:46.681856  1267 raft_consensus.cc:385] T 7b2e497f1fcf4e40b4374fd2b5b261af P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.682117  1267 raft_consensus.cc:740] T 7b2e497f1fcf4e40b4374fd2b5b261af P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.682825  1267 consensus_queue.cc:260] T 7b2e497f1fcf4e40b4374fd2b5b261af P 8fa35514a8d84740b1b46ae496307f20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:46.659678  1264 tablet_bootstrap.cc:492] T 7b2e497f1fcf4e40b4374fd2b5b261af P 937efeddef934b2b8bc8632594903085: No bootstrap required, opened a new log
I20260709 12:26:46.685043  1264 ts_tablet_manager.cc:1403] T 7b2e497f1fcf4e40b4374fd2b5b261af P 937efeddef934b2b8bc8632594903085: Time spent bootstrapping tablet: real 0.065s	user 0.012s	sys 0.000s
I20260709 12:26:46.687618  1264 raft_consensus.cc:359] T 7b2e497f1fcf4e40b4374fd2b5b261af P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:46.688306  1264 raft_consensus.cc:385] T 7b2e497f1fcf4e40b4374fd2b5b261af P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.688580  1264 raft_consensus.cc:740] T 7b2e497f1fcf4e40b4374fd2b5b261af P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 937efeddef934b2b8bc8632594903085, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.661592  1265 tablet_bootstrap.cc:492] T 0e2eae4c387445f39a059befe390fe45 P 7f9cbe40e40d429aa004e4a7fb42f132: No bootstrap required, opened a new log
I20260709 12:26:46.690181  1265 ts_tablet_manager.cc:1403] T 0e2eae4c387445f39a059befe390fe45 P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent bootstrapping tablet: real 0.061s	user 0.010s	sys 0.001s
I20260709 12:26:46.670208  1371 raft_consensus.cc:515] T 95743acb416b403b9bfb59afe5bf2fe7 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:46.693173  1265 raft_consensus.cc:359] T 0e2eae4c387445f39a059befe390fe45 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:46.693832  1265 raft_consensus.cc:385] T 0e2eae4c387445f39a059befe390fe45 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.694067  1265 raft_consensus.cc:740] T 0e2eae4c387445f39a059befe390fe45 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.694324  1371 leader_election.cc:290] T 95743acb416b403b9bfb59afe5bf2fe7 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 election: Requested vote from peers 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679), 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341)
I20260709 12:26:46.677656  1069 raft_consensus.cc:2468] T dc91bacc3de44d21bc62d8b9a003fdcf P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 1.
I20260709 12:26:46.694972  1072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95743acb416b403b9bfb59afe5bf2fe7" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
I20260709 12:26:46.694698  1265 consensus_queue.cc:260] T 0e2eae4c387445f39a059befe390fe45 P 7f9cbe40e40d429aa004e4a7fb42f132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:46.689200  1264 consensus_queue.cc:260] T 7b2e497f1fcf4e40b4374fd2b5b261af P 937efeddef934b2b8bc8632594903085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:46.666126  1070 raft_consensus.cc:2468] T 95743acb416b403b9bfb59afe5bf2fe7 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 1.
I20260709 12:26:46.696822   996 raft_consensus.cc:2393] T 95743acb416b403b9bfb59afe5bf2fe7 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8fa35514a8d84740b1b46ae496307f20 in current term 1: Already voted for candidate aa098a557d34433896712068efd0d9a8 in this term.
I20260709 12:26:46.696933  1265 ts_tablet_manager.cc:1434] T 0e2eae4c387445f39a059befe390fe45 P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:26:46.697077  1264 ts_tablet_manager.cc:1434] T 7b2e497f1fcf4e40b4374fd2b5b261af P 937efeddef934b2b8bc8632594903085: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:26:46.698134  1264 tablet_bootstrap.cc:492] T a1c303d40c6a4cae88aa89d681ae7b76 P 937efeddef934b2b8bc8632594903085: Bootstrap starting.
I20260709 12:26:46.698046  1145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "95743acb416b403b9bfb59afe5bf2fe7" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20"
I20260709 12:26:46.698920  1145 raft_consensus.cc:2393] T 95743acb416b403b9bfb59afe5bf2fe7 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate aa098a557d34433896712068efd0d9a8 in current term 1: Already voted for candidate 8fa35514a8d84740b1b46ae496307f20 in this term.
I20260709 12:26:46.699005  1265 tablet_bootstrap.cc:492] T f84cb753a9bd4fdd91824bb2d5050621 P 7f9cbe40e40d429aa004e4a7fb42f132: Bootstrap starting.
I20260709 12:26:46.651906  1511 raft_consensus.cc:515] T 329e639d23154fb6bd4ccdf095dbd0e0 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:46.701754  1072 raft_consensus.cc:2393] T 95743acb416b403b9bfb59afe5bf2fe7 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate aa098a557d34433896712068efd0d9a8 in current term 1: Already voted for candidate 8fa35514a8d84740b1b46ae496307f20 in this term.
I20260709 12:26:46.702123  1267 ts_tablet_manager.cc:1434] T 7b2e497f1fcf4e40b4374fd2b5b261af P 8fa35514a8d84740b1b46ae496307f20: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 12:26:46.703146  1267 tablet_bootstrap.cc:492] T 0017925ea1bb4374b09c9e692a17f87e P 8fa35514a8d84740b1b46ae496307f20: Bootstrap starting.
I20260709 12:26:46.702122  1511 leader_election.cc:290] T 329e639d23154fb6bd4ccdf095dbd0e0 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 election: Requested vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:46.706343   996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "329e639d23154fb6bd4ccdf095dbd0e0" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8"
I20260709 12:26:46.707428  1265 tablet_bootstrap.cc:654] T f84cb753a9bd4fdd91824bb2d5050621 P 7f9cbe40e40d429aa004e4a7fb42f132: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:46.707558  1038 leader_election.cc:343] T 329e639d23154fb6bd4ccdf095dbd0e0 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:46.708850  1110 leader_election.cc:304] T 95743acb416b403b9bfb59afe5bf2fe7 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 8fa35514a8d84740b1b46ae496307f20; no voters: 
I20260709 12:26:46.709658  1317 raft_consensus.cc:2804] T 95743acb416b403b9bfb59afe5bf2fe7 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:46.710314  1317 raft_consensus.cc:697] T 95743acb416b403b9bfb59afe5bf2fe7 P 8fa35514a8d84740b1b46ae496307f20 [term 1 LEADER]: Becoming Leader. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Running, Role: LEADER
I20260709 12:26:46.711117  1317 consensus_queue.cc:237] T 95743acb416b403b9bfb59afe5bf2fe7 P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:46.711585  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "329e639d23154fb6bd4ccdf095dbd0e0" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085"
I20260709 12:26:46.711790  1264 tablet_bootstrap.cc:654] T a1c303d40c6a4cae88aa89d681ae7b76 P 937efeddef934b2b8bc8632594903085: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.712179  1220 raft_consensus.cc:3060] T 329e639d23154fb6bd4ccdf095dbd0e0 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.715236  1267 tablet_bootstrap.cc:654] T 0017925ea1bb4374b09c9e692a17f87e P 8fa35514a8d84740b1b46ae496307f20: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.725128  1264 tablet_bootstrap.cc:492] T a1c303d40c6a4cae88aa89d681ae7b76 P 937efeddef934b2b8bc8632594903085: No bootstrap required, opened a new log
I20260709 12:26:46.725632  1264 ts_tablet_manager.cc:1403] T a1c303d40c6a4cae88aa89d681ae7b76 P 937efeddef934b2b8bc8632594903085: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.000s
I20260709 12:26:46.726781  1220 raft_consensus.cc:2468] T 329e639d23154fb6bd4ccdf095dbd0e0 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f9cbe40e40d429aa004e4a7fb42f132 in term 1.
I20260709 12:26:46.732787   961 leader_election.cc:304] T 95743acb416b403b9bfb59afe5bf2fe7 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa098a557d34433896712068efd0d9a8; no voters: 7f9cbe40e40d429aa004e4a7fb42f132, 8fa35514a8d84740b1b46ae496307f20
I20260709 12:26:46.733556  1371 raft_consensus.cc:2749] T 95743acb416b403b9bfb59afe5bf2fe7 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:26:46.733732  1508 consensus_queue.cc:1048] T a93df19c4206495e971bc5e95a2111bc P 937efeddef934b2b8bc8632594903085 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:46.735550  1267 tablet_bootstrap.cc:492] T 0017925ea1bb4374b09c9e692a17f87e P 8fa35514a8d84740b1b46ae496307f20: No bootstrap required, opened a new log
I20260709 12:26:46.735308  1035 leader_election.cc:304] T 329e639d23154fb6bd4ccdf095dbd0e0 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 937efeddef934b2b8bc8632594903085; no voters: aa098a557d34433896712068efd0d9a8
I20260709 12:26:46.736060  1267 ts_tablet_manager.cc:1403] T 0017925ea1bb4374b09c9e692a17f87e P 8fa35514a8d84740b1b46ae496307f20: Time spent bootstrapping tablet: real 0.033s	user 0.007s	sys 0.005s
I20260709 12:26:46.737389  1511 raft_consensus.cc:2804] T 329e639d23154fb6bd4ccdf095dbd0e0 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:46.738420  1511 raft_consensus.cc:697] T 329e639d23154fb6bd4ccdf095dbd0e0 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 LEADER]: Becoming Leader. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Running, Role: LEADER
I20260709 12:26:46.738835  1267 raft_consensus.cc:359] T 0017925ea1bb4374b09c9e692a17f87e P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:46.739560  1267 raft_consensus.cc:385] T 0017925ea1bb4374b09c9e692a17f87e P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.739825  1267 raft_consensus.cc:740] T 0017925ea1bb4374b09c9e692a17f87e P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.739753  1511 consensus_queue.cc:237] T 329e639d23154fb6bd4ccdf095dbd0e0 P 7f9cbe40e40d429aa004e4a7fb42f132 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:46.740835  1264 raft_consensus.cc:359] T a1c303d40c6a4cae88aa89d681ae7b76 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:46.741549  1264 raft_consensus.cc:385] T a1c303d40c6a4cae88aa89d681ae7b76 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.741825  1264 raft_consensus.cc:740] T a1c303d40c6a4cae88aa89d681ae7b76 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 937efeddef934b2b8bc8632594903085, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.742576  1267 consensus_queue.cc:260] T 0017925ea1bb4374b09c9e692a17f87e P 8fa35514a8d84740b1b46ae496307f20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:46.743610  1264 consensus_queue.cc:260] T a1c303d40c6a4cae88aa89d681ae7b76 P 937efeddef934b2b8bc8632594903085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:46.744594  1362 raft_consensus.cc:493] T 7b2e497f1fcf4e40b4374fd2b5b261af P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.745070  1362 raft_consensus.cc:515] T 7b2e497f1fcf4e40b4374fd2b5b261af P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:46.747213  1362 leader_election.cc:290] T 7b2e497f1fcf4e40b4374fd2b5b261af P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:26:46.749511  1267 ts_tablet_manager.cc:1434] T 0017925ea1bb4374b09c9e692a17f87e P 8fa35514a8d84740b1b46ae496307f20: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:26:46.750594  1267 tablet_bootstrap.cc:492] T 4d899bdd8a44422ca2a8036f84e9f9f3 P 8fa35514a8d84740b1b46ae496307f20: Bootstrap starting.
I20260709 12:26:46.756448  1267 tablet_bootstrap.cc:654] T 4d899bdd8a44422ca2a8036f84e9f9f3 P 8fa35514a8d84740b1b46ae496307f20: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.760821  1264 ts_tablet_manager.cc:1434] T a1c303d40c6a4cae88aa89d681ae7b76 P 937efeddef934b2b8bc8632594903085: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.001s
I20260709 12:26:46.761946  1264 tablet_bootstrap.cc:492] T 4d899bdd8a44422ca2a8036f84e9f9f3 P 937efeddef934b2b8bc8632594903085: Bootstrap starting.
I20260709 12:26:46.764422  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b2e497f1fcf4e40b4374fd2b5b261af" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:46.765235  1220 raft_consensus.cc:2468] T 7b2e497f1fcf4e40b4374fd2b5b261af P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 0.
I20260709 12:26:46.765377  1072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b2e497f1fcf4e40b4374fd2b5b261af" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:46.766084  1072 raft_consensus.cc:2468] T 7b2e497f1fcf4e40b4374fd2b5b261af P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 0.
I20260709 12:26:46.766474  1109 leader_election.cc:304] T 7b2e497f1fcf4e40b4374fd2b5b261af P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085; no voters: 
I20260709 12:26:46.767381  1317 raft_consensus.cc:2804] T 7b2e497f1fcf4e40b4374fd2b5b261af P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:46.767752  1317 raft_consensus.cc:493] T 7b2e497f1fcf4e40b4374fd2b5b261af P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:46.767859  1264 tablet_bootstrap.cc:654] T 4d899bdd8a44422ca2a8036f84e9f9f3 P 937efeddef934b2b8bc8632594903085: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.768134  1317 raft_consensus.cc:3060] T 7b2e497f1fcf4e40b4374fd2b5b261af P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.777426  1265 tablet_bootstrap.cc:492] T f84cb753a9bd4fdd91824bb2d5050621 P 7f9cbe40e40d429aa004e4a7fb42f132: No bootstrap required, opened a new log
I20260709 12:26:46.793498  1265 ts_tablet_manager.cc:1403] T f84cb753a9bd4fdd91824bb2d5050621 P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent bootstrapping tablet: real 0.095s	user 0.008s	sys 0.004s
I20260709 12:26:46.794845   895 catalog_manager.cc:5697] T 95743acb416b403b9bfb59afe5bf2fe7 P 8fa35514a8d84740b1b46ae496307f20 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131). New cstate: current_term: 1 leader_uuid: "8fa35514a8d84740b1b46ae496307f20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:46.778323  1317 raft_consensus.cc:515] T 7b2e497f1fcf4e40b4374fd2b5b261af P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:46.806517  1072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b2e497f1fcf4e40b4374fd2b5b261af" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
I20260709 12:26:46.807175  1072 raft_consensus.cc:3060] T 7b2e497f1fcf4e40b4374fd2b5b261af P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.808835  1217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b2e497f1fcf4e40b4374fd2b5b261af" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085"
I20260709 12:26:46.809463  1217 raft_consensus.cc:3060] T 7b2e497f1fcf4e40b4374fd2b5b261af P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.797736  1265 raft_consensus.cc:359] T f84cb753a9bd4fdd91824bb2d5050621 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:46.817104  1265 raft_consensus.cc:385] T f84cb753a9bd4fdd91824bb2d5050621 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.817462  1265 raft_consensus.cc:740] T f84cb753a9bd4fdd91824bb2d5050621 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.818482  1264 tablet_bootstrap.cc:492] T 4d899bdd8a44422ca2a8036f84e9f9f3 P 937efeddef934b2b8bc8632594903085: No bootstrap required, opened a new log
I20260709 12:26:46.818972  1317 leader_election.cc:290] T 7b2e497f1fcf4e40b4374fd2b5b261af P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 election: Requested vote from peers 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:26:46.819149  1264 ts_tablet_manager.cc:1403] T 4d899bdd8a44422ca2a8036f84e9f9f3 P 937efeddef934b2b8bc8632594903085: Time spent bootstrapping tablet: real 0.057s	user 0.008s	sys 0.007s
I20260709 12:26:46.819226  1217 raft_consensus.cc:2468] T 7b2e497f1fcf4e40b4374fd2b5b261af P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 1.
I20260709 12:26:46.820580  1109 leader_election.cc:304] T 7b2e497f1fcf4e40b4374fd2b5b261af P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085; no voters: 
I20260709 12:26:46.822187  1421 raft_consensus.cc:2804] T 7b2e497f1fcf4e40b4374fd2b5b261af P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:46.822729  1421 raft_consensus.cc:697] T 7b2e497f1fcf4e40b4374fd2b5b261af P 8fa35514a8d84740b1b46ae496307f20 [term 1 LEADER]: Becoming Leader. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Running, Role: LEADER
I20260709 12:26:46.782428  1266 tablet_bootstrap.cc:654] T a1c303d40c6a4cae88aa89d681ae7b76 P aa098a557d34433896712068efd0d9a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.784932  1511 raft_consensus.cc:493] T 3d2ccd742ac442419de89cb38ee12d37 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.824275  1511 raft_consensus.cc:515] T 3d2ccd742ac442419de89cb38ee12d37 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:46.823547  1421 consensus_queue.cc:237] T 7b2e497f1fcf4e40b4374fd2b5b261af P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:46.825286  1499 raft_consensus.cc:493] T a1c303d40c6a4cae88aa89d681ae7b76 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.825989  1499 raft_consensus.cc:515] T a1c303d40c6a4cae88aa89d681ae7b76 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:46.826362  1511 leader_election.cc:290] T 3d2ccd742ac442419de89cb38ee12d37 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341)
I20260709 12:26:46.826987  1264 raft_consensus.cc:359] T 4d899bdd8a44422ca2a8036f84e9f9f3 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:46.827669  1264 raft_consensus.cc:385] T 4d899bdd8a44422ca2a8036f84e9f9f3 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.827962  1264 raft_consensus.cc:740] T 4d899bdd8a44422ca2a8036f84e9f9f3 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 937efeddef934b2b8bc8632594903085, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.828438   997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2ccd742ac442419de89cb38ee12d37" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
I20260709 12:26:46.828819  1145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1c303d40c6a4cae88aa89d681ae7b76" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:46.829649  1145 raft_consensus.cc:2468] T a1c303d40c6a4cae88aa89d681ae7b76 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 0.
I20260709 12:26:46.831295  1186 leader_election.cc:304] T a1c303d40c6a4cae88aa89d681ae7b76 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085; no voters: 
I20260709 12:26:46.832351  1524 consensus_queue.cc:1048] T 1d925407b8314f5b95a8c940f195433a P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:26:46.832924  1038 leader_election.cc:343] T 3d2ccd742ac442419de89cb38ee12d37 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:46.834030  1145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2ccd742ac442419de89cb38ee12d37" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:46.834347  1499 leader_election.cc:290] T a1c303d40c6a4cae88aa89d681ae7b76 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:46.835203   997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1c303d40c6a4cae88aa89d681ae7b76" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
W20260709 12:26:46.836807  1038 leader_election.cc:343] T 3d2ccd742ac442419de89cb38ee12d37 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:46.837325  1508 raft_consensus.cc:2804] T a1c303d40c6a4cae88aa89d681ae7b76 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:46.837906  1508 raft_consensus.cc:493] T a1c303d40c6a4cae88aa89d681ae7b76 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:46.838444  1508 raft_consensus.cc:3060] T a1c303d40c6a4cae88aa89d681ae7b76 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.837327  1038 leader_election.cc:304] T 3d2ccd742ac442419de89cb38ee12d37 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132; no voters: 8fa35514a8d84740b1b46ae496307f20, aa098a557d34433896712068efd0d9a8
I20260709 12:26:46.841336  1511 raft_consensus.cc:2749] T 3d2ccd742ac442419de89cb38ee12d37 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:26:46.837849  1186 leader_election.cc:343] T a1c303d40c6a4cae88aa89d681ae7b76 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:46.832342  1265 consensus_queue.cc:260] T f84cb753a9bd4fdd91824bb2d5050621 P 7f9cbe40e40d429aa004e4a7fb42f132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:46.856781  1265 ts_tablet_manager.cc:1434] T f84cb753a9bd4fdd91824bb2d5050621 P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent starting tablet: real 0.062s	user 0.006s	sys 0.000s
I20260709 12:26:46.860733  1265 tablet_bootstrap.cc:492] T ac8f3ce8c750468c966a23ea2787b888 P 7f9cbe40e40d429aa004e4a7fb42f132: Bootstrap starting.
I20260709 12:26:46.853608  1072 raft_consensus.cc:2468] T 7b2e497f1fcf4e40b4374fd2b5b261af P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 1.
I20260709 12:26:46.828634  1264 consensus_queue.cc:260] T 4d899bdd8a44422ca2a8036f84e9f9f3 P 937efeddef934b2b8bc8632594903085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:46.871649  1264 ts_tablet_manager.cc:1434] T 4d899bdd8a44422ca2a8036f84e9f9f3 P 937efeddef934b2b8bc8632594903085: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.002s
I20260709 12:26:46.869917  1508 raft_consensus.cc:515] T a1c303d40c6a4cae88aa89d681ae7b76 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:46.874001  1264 tablet_bootstrap.cc:492] T c5197f4025d94ce096c14c6ca011b47b P 937efeddef934b2b8bc8632594903085: Bootstrap starting.
I20260709 12:26:46.875168  1265 tablet_bootstrap.cc:654] T ac8f3ce8c750468c966a23ea2787b888 P 7f9cbe40e40d429aa004e4a7fb42f132: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.875890  1508 leader_election.cc:290] T a1c303d40c6a4cae88aa89d681ae7b76 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Requested vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:46.877461   997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1c303d40c6a4cae88aa89d681ae7b76" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8"
I20260709 12:26:46.877528  1145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1c303d40c6a4cae88aa89d681ae7b76" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20"
I20260709 12:26:46.879954  1145 raft_consensus.cc:3060] T a1c303d40c6a4cae88aa89d681ae7b76 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:46.880131  1186 leader_election.cc:343] T a1c303d40c6a4cae88aa89d681ae7b76 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:46.882287  1264 tablet_bootstrap.cc:654] T c5197f4025d94ce096c14c6ca011b47b P 937efeddef934b2b8bc8632594903085: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.885994  1266 tablet_bootstrap.cc:492] T a1c303d40c6a4cae88aa89d681ae7b76 P aa098a557d34433896712068efd0d9a8: No bootstrap required, opened a new log
I20260709 12:26:46.886540  1266 ts_tablet_manager.cc:1403] T a1c303d40c6a4cae88aa89d681ae7b76 P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.338s	user 0.011s	sys 0.002s
I20260709 12:26:46.890133  1266 raft_consensus.cc:359] T a1c303d40c6a4cae88aa89d681ae7b76 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:46.891067  1266 raft_consensus.cc:385] T a1c303d40c6a4cae88aa89d681ae7b76 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:46.891414  1266 raft_consensus.cc:740] T a1c303d40c6a4cae88aa89d681ae7b76 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:46.892423  1266 consensus_queue.cc:260] T a1c303d40c6a4cae88aa89d681ae7b76 P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:46.894753  1266 ts_tablet_manager.cc:1434] T a1c303d40c6a4cae88aa89d681ae7b76 P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:26:46.895723  1266 tablet_bootstrap.cc:492] T c5197f4025d94ce096c14c6ca011b47b P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:46.905606  1371 raft_consensus.cc:493] T a1c303d40c6a4cae88aa89d681ae7b76 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:46.906246  1371 raft_consensus.cc:515] T a1c303d40c6a4cae88aa89d681ae7b76 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:46.916781  1371 leader_election.cc:290] T a1c303d40c6a4cae88aa89d681ae7b76 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:26:46.919154  1146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1c303d40c6a4cae88aa89d681ae7b76" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:46.919528  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1c303d40c6a4cae88aa89d681ae7b76" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:46.919679  1266 tablet_bootstrap.cc:654] T c5197f4025d94ce096c14c6ca011b47b P aa098a557d34433896712068efd0d9a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:46.920348  1220 raft_consensus.cc:2393] T a1c303d40c6a4cae88aa89d681ae7b76 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aa098a557d34433896712068efd0d9a8 in current term 1: Already voted for candidate 937efeddef934b2b8bc8632594903085 in this term.
I20260709 12:26:46.921538   960 leader_election.cc:304] T a1c303d40c6a4cae88aa89d681ae7b76 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa098a557d34433896712068efd0d9a8; no voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085
I20260709 12:26:46.923207  1371 raft_consensus.cc:3060] T a1c303d40c6a4cae88aa89d681ae7b76 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:46.931481  1267 tablet_bootstrap.cc:492] T 4d899bdd8a44422ca2a8036f84e9f9f3 P 8fa35514a8d84740b1b46ae496307f20: No bootstrap required, opened a new log
I20260709 12:26:46.932154  1267 ts_tablet_manager.cc:1403] T 4d899bdd8a44422ca2a8036f84e9f9f3 P 8fa35514a8d84740b1b46ae496307f20: Time spent bootstrapping tablet: real 0.182s	user 0.033s	sys 0.023s
I20260709 12:26:46.943480  1264 tablet_bootstrap.cc:492] T c5197f4025d94ce096c14c6ca011b47b P 937efeddef934b2b8bc8632594903085: No bootstrap required, opened a new log
I20260709 12:26:46.944262  1264 ts_tablet_manager.cc:1403] T c5197f4025d94ce096c14c6ca011b47b P 937efeddef934b2b8bc8632594903085: Time spent bootstrapping tablet: real 0.071s	user 0.022s	sys 0.002s
I20260709 12:26:46.944823  1267 raft_consensus.cc:359] T 4d899bdd8a44422ca2a8036f84e9f9f3 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:47.061301  1267 raft_consensus.cc:385] T 4d899bdd8a44422ca2a8036f84e9f9f3 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.062016  1371 raft_consensus.cc:2749] T a1c303d40c6a4cae88aa89d681ae7b76 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:47.062238  1264 raft_consensus.cc:359] T c5197f4025d94ce096c14c6ca011b47b P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:47.068343  1264 raft_consensus.cc:385] T c5197f4025d94ce096c14c6ca011b47b P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.068634  1264 raft_consensus.cc:740] T c5197f4025d94ce096c14c6ca011b47b P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 937efeddef934b2b8bc8632594903085, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.069268  1264 consensus_queue.cc:260] T c5197f4025d94ce096c14c6ca011b47b P 937efeddef934b2b8bc8632594903085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:47.061610  1267 raft_consensus.cc:740] T 4d899bdd8a44422ca2a8036f84e9f9f3 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.073341  1267 consensus_queue.cc:260] T 4d899bdd8a44422ca2a8036f84e9f9f3 P 8fa35514a8d84740b1b46ae496307f20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:47.073776   894 catalog_manager.cc:5697] T 329e639d23154fb6bd4ccdf095dbd0e0 P 7f9cbe40e40d429aa004e4a7fb42f132 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130). New cstate: current_term: 1 leader_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:47.120534  1267 ts_tablet_manager.cc:1434] T 4d899bdd8a44422ca2a8036f84e9f9f3 P 8fa35514a8d84740b1b46ae496307f20: Time spent starting tablet: real 0.188s	user 0.010s	sys 0.007s
I20260709 12:26:47.125089  1265 tablet_bootstrap.cc:492] T ac8f3ce8c750468c966a23ea2787b888 P 7f9cbe40e40d429aa004e4a7fb42f132: No bootstrap required, opened a new log
I20260709 12:26:47.125798  1265 ts_tablet_manager.cc:1403] T ac8f3ce8c750468c966a23ea2787b888 P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent bootstrapping tablet: real 0.265s	user 0.025s	sys 0.044s
I20260709 12:26:47.127355  1264 ts_tablet_manager.cc:1434] T c5197f4025d94ce096c14c6ca011b47b P 937efeddef934b2b8bc8632594903085: Time spent starting tablet: real 0.183s	user 0.014s	sys 0.006s
I20260709 12:26:47.110613  1145 raft_consensus.cc:2468] T a1c303d40c6a4cae88aa89d681ae7b76 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 1.
I20260709 12:26:47.120376  1511 raft_consensus.cc:493] T 0e2eae4c387445f39a059befe390fe45 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.123111  1574 raft_consensus.cc:493] T 4d899bdd8a44422ca2a8036f84e9f9f3 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.134176  1511 raft_consensus.cc:515] T 0e2eae4c387445f39a059befe390fe45 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:47.136484  1511 leader_election.cc:290] T 0e2eae4c387445f39a059befe390fe45 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341)
I20260709 12:26:47.136551  1574 raft_consensus.cc:515] T 4d899bdd8a44422ca2a8036f84e9f9f3 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:47.138562  1574 leader_election.cc:290] T 4d899bdd8a44422ca2a8036f84e9f9f3 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:47.144881  1267 tablet_bootstrap.cc:492] T 6474754cce8f4042bcab4ac631e9a82f P 8fa35514a8d84740b1b46ae496307f20: Bootstrap starting.
I20260709 12:26:47.149289  1264 tablet_bootstrap.cc:492] T 6474754cce8f4042bcab4ac631e9a82f P 937efeddef934b2b8bc8632594903085: Bootstrap starting.
I20260709 12:26:47.159783  1266 tablet_bootstrap.cc:492] T c5197f4025d94ce096c14c6ca011b47b P aa098a557d34433896712068efd0d9a8: No bootstrap required, opened a new log
I20260709 12:26:47.160574  1266 ts_tablet_manager.cc:1403] T c5197f4025d94ce096c14c6ca011b47b P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.265s	user 0.042s	sys 0.040s
I20260709 12:26:47.204730  1266 raft_consensus.cc:359] T c5197f4025d94ce096c14c6ca011b47b P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:47.207490  1511 raft_consensus.cc:493] T f84cb753a9bd4fdd91824bb2d5050621 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.188941  1145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2eae4c387445f39a059befe390fe45" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:47.209260  1267 tablet_bootstrap.cc:654] T 6474754cce8f4042bcab4ac631e9a82f P 8fa35514a8d84740b1b46ae496307f20: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.190798  1265 raft_consensus.cc:359] T ac8f3ce8c750468c966a23ea2787b888 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:47.216434  1266 raft_consensus.cc:385] T c5197f4025d94ce096c14c6ca011b47b P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.219494  1265 raft_consensus.cc:385] T ac8f3ce8c750468c966a23ea2787b888 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.219568  1266 raft_consensus.cc:740] T c5197f4025d94ce096c14c6ca011b47b P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.220131  1265 raft_consensus.cc:740] T ac8f3ce8c750468c966a23ea2787b888 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.221195  1265 consensus_queue.cc:260] T ac8f3ce8c750468c966a23ea2787b888 P 7f9cbe40e40d429aa004e4a7fb42f132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:47.222165  1266 consensus_queue.cc:260] T c5197f4025d94ce096c14c6ca011b47b P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:47.220978  1511 raft_consensus.cc:515] T f84cb753a9bd4fdd91824bb2d5050621 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:47.234179  1265 ts_tablet_manager.cc:1434] T ac8f3ce8c750468c966a23ea2787b888 P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent starting tablet: real 0.108s	user 0.013s	sys 0.003s
I20260709 12:26:47.240446  1266 ts_tablet_manager.cc:1434] T c5197f4025d94ce096c14c6ca011b47b P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.079s	user 0.009s	sys 0.000s
I20260709 12:26:47.242942  1186 leader_election.cc:304] T a1c303d40c6a4cae88aa89d681ae7b76 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085; no voters: aa098a557d34433896712068efd0d9a8
I20260709 12:26:47.246409  1376 raft_consensus.cc:2804] T a1c303d40c6a4cae88aa89d681ae7b76 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:47.251376   895 catalog_manager.cc:5697] T dc91bacc3de44d21bc62d8b9a003fdcf P 937efeddef934b2b8bc8632594903085 reported cstate change: term changed from 0 to 1, leader changed from <none> to 937efeddef934b2b8bc8632594903085 (127.23.245.132). New cstate: current_term: 1 leader_uuid: "937efeddef934b2b8bc8632594903085" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:47.252450  1376 raft_consensus.cc:697] T a1c303d40c6a4cae88aa89d681ae7b76 P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Becoming Leader. State: Replica: 937efeddef934b2b8bc8632594903085, State: Running, Role: LEADER
I20260709 12:26:47.241420   994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d899bdd8a44422ca2a8036f84e9f9f3" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
I20260709 12:26:47.253394  1376 consensus_queue.cc:237] T a1c303d40c6a4cae88aa89d681ae7b76 P 937efeddef934b2b8bc8632594903085 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:47.260068  1265 tablet_bootstrap.cc:492] T c36d0201599a49169424a6b75f5349f2 P 7f9cbe40e40d429aa004e4a7fb42f132: Bootstrap starting.
I20260709 12:26:47.258562   997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2eae4c387445f39a059befe390fe45" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
I20260709 12:26:47.267407  1498 raft_consensus.cc:493] T c5197f4025d94ce096c14c6ca011b47b P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.268050  1498 raft_consensus.cc:515] T c5197f4025d94ce096c14c6ca011b47b P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:47.270016  1498 leader_election.cc:290] T c5197f4025d94ce096c14c6ca011b47b P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:47.272302   996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5197f4025d94ce096c14c6ca011b47b" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
I20260709 12:26:47.272997   996 raft_consensus.cc:2468] T c5197f4025d94ce096c14c6ca011b47b P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 0.
I20260709 12:26:47.277217  1265 tablet_bootstrap.cc:654] T c36d0201599a49169424a6b75f5349f2 P 7f9cbe40e40d429aa004e4a7fb42f132: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.276742   890 catalog_manager.cc:5697] T 7b2e497f1fcf4e40b4374fd2b5b261af P 8fa35514a8d84740b1b46ae496307f20 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131). New cstate: current_term: 1 leader_uuid: "8fa35514a8d84740b1b46ae496307f20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:47.275128  1186 leader_election.cc:304] T c5197f4025d94ce096c14c6ca011b47b P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 937efeddef934b2b8bc8632594903085, aa098a557d34433896712068efd0d9a8; no voters: 
I20260709 12:26:47.278195  1511 leader_election.cc:290] T f84cb753a9bd4fdd91824bb2d5050621 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:26:47.279098  1498 raft_consensus.cc:2804] T c5197f4025d94ce096c14c6ca011b47b P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:47.279490  1498 raft_consensus.cc:493] T c5197f4025d94ce096c14c6ca011b47b P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:47.280411  1498 raft_consensus.cc:3060] T c5197f4025d94ce096c14c6ca011b47b P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:47.284256  1186 leader_election.cc:343] T 4d899bdd8a44422ca2a8036f84e9f9f3 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:47.285614  1264 tablet_bootstrap.cc:654] T 6474754cce8f4042bcab4ac631e9a82f P 937efeddef934b2b8bc8632594903085: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.289316  1266 tablet_bootstrap.cc:492] T 4d899bdd8a44422ca2a8036f84e9f9f3 P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:47.299242  1582 consensus_queue.cc:1048] T dc91bacc3de44d21bc62d8b9a003fdcf P 937efeddef934b2b8bc8632594903085 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:47.312510  1267 tablet_bootstrap.cc:492] T 6474754cce8f4042bcab4ac631e9a82f P 8fa35514a8d84740b1b46ae496307f20: No bootstrap required, opened a new log
I20260709 12:26:47.313126  1267 ts_tablet_manager.cc:1403] T 6474754cce8f4042bcab4ac631e9a82f P 8fa35514a8d84740b1b46ae496307f20: Time spent bootstrapping tablet: real 0.185s	user 0.010s	sys 0.005s
I20260709 12:26:47.316231  1498 raft_consensus.cc:515] T c5197f4025d94ce096c14c6ca011b47b P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:47.318311  1146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d899bdd8a44422ca2a8036f84e9f9f3" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:47.319022  1146 raft_consensus.cc:2468] T 4d899bdd8a44422ca2a8036f84e9f9f3 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 0.
I20260709 12:26:47.319904  1498 leader_election.cc:290] T c5197f4025d94ce096c14c6ca011b47b P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Requested vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:47.322749  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84cb753a9bd4fdd91824bb2d5050621" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:47.329442  1317 consensus_queue.cc:1048] T 95743acb416b403b9bfb59afe5bf2fe7 P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:47.330044  1186 leader_election.cc:304] T 4d899bdd8a44422ca2a8036f84e9f9f3 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085; no voters: aa098a557d34433896712068efd0d9a8
I20260709 12:26:47.330431  1586 raft_consensus.cc:493] T 0017925ea1bb4374b09c9e692a17f87e P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.330933  1586 raft_consensus.cc:515] T 0017925ea1bb4374b09c9e692a17f87e P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:47.331589  1511 consensus_queue.cc:1048] T 329e639d23154fb6bd4ccdf095dbd0e0 P 7f9cbe40e40d429aa004e4a7fb42f132 [LEADER]: Connected to new peer: Peer: permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:47.332070  1362 consensus_queue.cc:1048] T 1d925407b8314f5b95a8c940f195433a P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:47.333209  1511 raft_consensus.cc:493] T c5197f4025d94ce096c14c6ca011b47b P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.333380  1582 raft_consensus.cc:2804] T 4d899bdd8a44422ca2a8036f84e9f9f3 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:47.333820  1582 raft_consensus.cc:493] T 4d899bdd8a44422ca2a8036f84e9f9f3 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:47.333693  1511 raft_consensus.cc:515] T c5197f4025d94ce096c14c6ca011b47b P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:47.334316  1582 raft_consensus.cc:3060] T 4d899bdd8a44422ca2a8036f84e9f9f3 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:47.334455  1035 leader_election.cc:343] T f84cb753a9bd4fdd91824bb2d5050621 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:47.334103  1584 consensus_queue.cc:1048] T dc91bacc3de44d21bc62d8b9a003fdcf P 937efeddef934b2b8bc8632594903085 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:47.337404   997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5197f4025d94ce096c14c6ca011b47b" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8"
I20260709 12:26:47.338044   997 raft_consensus.cc:3060] T c5197f4025d94ce096c14c6ca011b47b P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.339113  1586 leader_election.cc:290] T 0017925ea1bb4374b09c9e692a17f87e P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:47.339008  1267 raft_consensus.cc:359] T 6474754cce8f4042bcab4ac631e9a82f P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:47.343662  1267 raft_consensus.cc:385] T 6474754cce8f4042bcab4ac631e9a82f P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.344079  1267 raft_consensus.cc:740] T 6474754cce8f4042bcab4ac631e9a82f P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.346849  1265 tablet_bootstrap.cc:492] T c36d0201599a49169424a6b75f5349f2 P 7f9cbe40e40d429aa004e4a7fb42f132: No bootstrap required, opened a new log
I20260709 12:26:47.346820  1070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5197f4025d94ce096c14c6ca011b47b" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:47.347530  1265 ts_tablet_manager.cc:1403] T c36d0201599a49169424a6b75f5349f2 P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent bootstrapping tablet: real 0.109s	user 0.013s	sys 0.025s
I20260709 12:26:47.347615  1070 raft_consensus.cc:2468] T c5197f4025d94ce096c14c6ca011b47b P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 0.
W20260709 12:26:47.352921  1038 leader_election.cc:343] T 0e2eae4c387445f39a059befe390fe45 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:47.353729  1038 consensus_peers.cc:597] T 329e639d23154fb6bd4ccdf095dbd0e0 P 7f9cbe40e40d429aa004e4a7fb42f132 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:47.350425  1265 raft_consensus.cc:359] T c36d0201599a49169424a6b75f5349f2 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:47.354403  1265 raft_consensus.cc:385] T c36d0201599a49169424a6b75f5349f2 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.354688  1265 raft_consensus.cc:740] T c36d0201599a49169424a6b75f5349f2 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.355316  1265 consensus_queue.cc:260] T c36d0201599a49169424a6b75f5349f2 P 7f9cbe40e40d429aa004e4a7fb42f132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:47.357095   996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5197f4025d94ce096c14c6ca011b47b" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
I20260709 12:26:47.357411  1265 ts_tablet_manager.cc:1434] T c36d0201599a49169424a6b75f5349f2 P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:26:47.358440  1265 tablet_bootstrap.cc:492] T 8c9afd5af68441ffa4c3f90cbd33d977 P 7f9cbe40e40d429aa004e4a7fb42f132: Bootstrap starting.
I20260709 12:26:47.360422  1070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0017925ea1bb4374b09c9e692a17f87e" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:47.361052  1070 raft_consensus.cc:2468] T 0017925ea1bb4374b09c9e692a17f87e P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 0.
I20260709 12:26:47.364907  1585 consensus_queue.cc:1048] T 7b2e497f1fcf4e40b4374fd2b5b261af P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:47.365197  1110 leader_election.cc:304] T 0017925ea1bb4374b09c9e692a17f87e P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 8fa35514a8d84740b1b46ae496307f20; no voters: 
I20260709 12:26:47.366300  1585 raft_consensus.cc:2804] T 0017925ea1bb4374b09c9e692a17f87e P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:47.366667  1585 raft_consensus.cc:493] T 0017925ea1bb4374b09c9e692a17f87e P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:47.366969  1511 leader_election.cc:290] T c5197f4025d94ce096c14c6ca011b47b P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:47.366983  1585 raft_consensus.cc:3060] T 0017925ea1bb4374b09c9e692a17f87e P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:47.370678   943 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:47.344707  1267 consensus_queue.cc:260] T 6474754cce8f4042bcab4ac631e9a82f P 8fa35514a8d84740b1b46ae496307f20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:47.373481   996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0017925ea1bb4374b09c9e692a17f87e" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
I20260709 12:26:47.374262  1145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84cb753a9bd4fdd91824bb2d5050621" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:47.376026  1218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5197f4025d94ce096c14c6ca011b47b" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:47.376847  1218 raft_consensus.cc:2393] T c5197f4025d94ce096c14c6ca011b47b P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7f9cbe40e40d429aa004e4a7fb42f132 in current term 1: Already voted for candidate 937efeddef934b2b8bc8632594903085 in this term.
W20260709 12:26:47.369802  1038 leader_election.cc:343] T 0e2eae4c387445f39a059befe390fe45 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:47.388813  1264 tablet_bootstrap.cc:492] T 6474754cce8f4042bcab4ac631e9a82f P 937efeddef934b2b8bc8632594903085: No bootstrap required, opened a new log
I20260709 12:26:47.390798  1264 ts_tablet_manager.cc:1403] T 6474754cce8f4042bcab4ac631e9a82f P 937efeddef934b2b8bc8632594903085: Time spent bootstrapping tablet: real 0.242s	user 0.016s	sys 0.003s
I20260709 12:26:47.388726   997 raft_consensus.cc:2468] T c5197f4025d94ce096c14c6ca011b47b P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 1.
I20260709 12:26:47.395776  1038 leader_election.cc:304] T 0e2eae4c387445f39a059befe390fe45 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132; no voters: 8fa35514a8d84740b1b46ae496307f20, aa098a557d34433896712068efd0d9a8
I20260709 12:26:47.399096  1589 raft_consensus.cc:2749] T 0e2eae4c387445f39a059befe390fe45 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:26:47.398850  1112 leader_election.cc:343] T 0017925ea1bb4374b09c9e692a17f87e P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:47.417610  1267 ts_tablet_manager.cc:1434] T 6474754cce8f4042bcab4ac631e9a82f P 8fa35514a8d84740b1b46ae496307f20: Time spent starting tablet: real 0.104s	user 0.008s	sys 0.000s
I20260709 12:26:47.411619  1264 raft_consensus.cc:359] T 6474754cce8f4042bcab4ac631e9a82f P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:47.418417  1264 raft_consensus.cc:385] T 6474754cce8f4042bcab4ac631e9a82f P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.418875  1264 raft_consensus.cc:740] T 6474754cce8f4042bcab4ac631e9a82f P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 937efeddef934b2b8bc8632594903085, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.422025  1186 leader_election.cc:304] T c5197f4025d94ce096c14c6ca011b47b P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 937efeddef934b2b8bc8632594903085, aa098a557d34433896712068efd0d9a8; no voters: 
I20260709 12:26:47.423321  1376 raft_consensus.cc:2804] T c5197f4025d94ce096c14c6ca011b47b P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:47.423178  1582 raft_consensus.cc:515] T 4d899bdd8a44422ca2a8036f84e9f9f3 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:47.424247  1376 raft_consensus.cc:697] T c5197f4025d94ce096c14c6ca011b47b P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Becoming Leader. State: Replica: 937efeddef934b2b8bc8632594903085, State: Running, Role: LEADER
I20260709 12:26:47.430384  1264 consensus_queue.cc:260] T 6474754cce8f4042bcab4ac631e9a82f P 937efeddef934b2b8bc8632594903085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:47.377764  1585 raft_consensus.cc:515] T 0017925ea1bb4374b09c9e692a17f87e P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:47.442549  1266 tablet_bootstrap.cc:654] T 4d899bdd8a44422ca2a8036f84e9f9f3 P aa098a557d34433896712068efd0d9a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.440932  1498 raft_consensus.cc:493] T 6474754cce8f4042bcab4ac631e9a82f P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.446009  1498 raft_consensus.cc:515] T 6474754cce8f4042bcab4ac631e9a82f P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:47.446017  1264 ts_tablet_manager.cc:1434] T 6474754cce8f4042bcab4ac631e9a82f P 937efeddef934b2b8bc8632594903085: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.003s
I20260709 12:26:47.448155  1267 tablet_bootstrap.cc:492] T 3d2ccd742ac442419de89cb38ee12d37 P 8fa35514a8d84740b1b46ae496307f20: Bootstrap starting.
I20260709 12:26:47.426066  1376 consensus_queue.cc:237] T c5197f4025d94ce096c14c6ca011b47b P 937efeddef934b2b8bc8632594903085 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
W20260709 12:26:47.447716  1038 leader_election.cc:343] T f84cb753a9bd4fdd91824bb2d5050621 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:47.458837  1144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d899bdd8a44422ca2a8036f84e9f9f3" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20"
I20260709 12:26:47.459550  1144 raft_consensus.cc:3060] T 4d899bdd8a44422ca2a8036f84e9f9f3 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.461556  1069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5197f4025d94ce096c14c6ca011b47b" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
I20260709 12:26:47.462182  1069 raft_consensus.cc:3060] T c5197f4025d94ce096c14c6ca011b47b P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.462417  1265 tablet_bootstrap.cc:654] T 8c9afd5af68441ffa4c3f90cbd33d977 P 7f9cbe40e40d429aa004e4a7fb42f132: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.465520  1498 leader_election.cc:290] T 6474754cce8f4042bcab4ac631e9a82f P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679), 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341)
I20260709 12:26:47.469532  1146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6474754cce8f4042bcab4ac631e9a82f" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:47.470208  1146 raft_consensus.cc:2468] T 6474754cce8f4042bcab4ac631e9a82f P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 0.
I20260709 12:26:47.471308  1186 leader_election.cc:304] T 6474754cce8f4042bcab4ac631e9a82f P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085; no voters: 
I20260709 12:26:47.472579  1498 raft_consensus.cc:2804] T 6474754cce8f4042bcab4ac631e9a82f P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:47.472733   997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d899bdd8a44422ca2a8036f84e9f9f3" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8"
I20260709 12:26:47.472971  1498 raft_consensus.cc:493] T 6474754cce8f4042bcab4ac631e9a82f P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:47.473328  1498 raft_consensus.cc:3060] T 6474754cce8f4042bcab4ac631e9a82f P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.453603  1582 leader_election.cc:290] T 4d899bdd8a44422ca2a8036f84e9f9f3 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Requested vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:47.480495  1511 raft_consensus.cc:493] T ac8f3ce8c750468c966a23ea2787b888 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:47.489255  1186 leader_election.cc:343] T 4d899bdd8a44422ca2a8036f84e9f9f3 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:47.491833  1264 tablet_bootstrap.cc:492] T c36d0201599a49169424a6b75f5349f2 P 937efeddef934b2b8bc8632594903085: Bootstrap starting.
I20260709 12:26:47.495311  1067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6474754cce8f4042bcab4ac631e9a82f" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:47.496430  1067 raft_consensus.cc:2468] T 6474754cce8f4042bcab4ac631e9a82f P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 0.
I20260709 12:26:47.490099  1511 raft_consensus.cc:515] T ac8f3ce8c750468c966a23ea2787b888 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:47.501931  1421 consensus_queue.cc:1048] T 95743acb416b403b9bfb59afe5bf2fe7 P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:26:47.477270  1038 leader_election.cc:304] T f84cb753a9bd4fdd91824bb2d5050621 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132; no voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085
I20260709 12:26:47.507835  1587 raft_consensus.cc:2749] T f84cb753a9bd4fdd91824bb2d5050621 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:26:47.507897  1038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:40341, user_credentials={real_user=slave}} blocked reactor thread for 63772.1us
I20260709 12:26:47.510316  1585 leader_election.cc:290] T 0017925ea1bb4374b09c9e692a17f87e P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 election: Requested vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:47.510946  1585 consensus_queue.cc:1048] T 7b2e497f1fcf4e40b4374fd2b5b261af P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:47.511359  1038 leader_election.cc:304] T c5197f4025d94ce096c14c6ca011b47b P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132; no voters: 937efeddef934b2b8bc8632594903085, aa098a557d34433896712068efd0d9a8
I20260709 12:26:47.513389  1511 leader_election.cc:290] T ac8f3ce8c750468c966a23ea2787b888 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:47.514513  1071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0017925ea1bb4374b09c9e692a17f87e" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
I20260709 12:26:47.515167  1071 raft_consensus.cc:3060] T 0017925ea1bb4374b09c9e692a17f87e P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.516465  1069 raft_consensus.cc:2468] T c5197f4025d94ce096c14c6ca011b47b P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 1.
I20260709 12:26:47.524573  1590 raft_consensus.cc:2749] T c5197f4025d94ce096c14c6ca011b47b P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:47.527100  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac8f3ce8c750468c966a23ea2787b888" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:47.527100   994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac8f3ce8c750468c966a23ea2787b888" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
I20260709 12:26:47.531013  1589 raft_consensus.cc:493] T c36d0201599a49169424a6b75f5349f2 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.531541  1589 raft_consensus.cc:515] T c36d0201599a49169424a6b75f5349f2 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:47.533769  1589 leader_election.cc:290] T c36d0201599a49169424a6b75f5349f2 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
W20260709 12:26:47.534853  1038 leader_election.cc:343] T ac8f3ce8c750468c966a23ea2787b888 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:47.535938   996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0017925ea1bb4374b09c9e692a17f87e" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8"
W20260709 12:26:47.544929  1112 leader_election.cc:343] T 0017925ea1bb4374b09c9e692a17f87e P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:47.545480   996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0201599a49169424a6b75f5349f2" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
I20260709 12:26:47.545197  1264 tablet_bootstrap.cc:654] T c36d0201599a49169424a6b75f5349f2 P 937efeddef934b2b8bc8632594903085: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.539222  1144 raft_consensus.cc:2468] T 4d899bdd8a44422ca2a8036f84e9f9f3 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 1.
I20260709 12:26:47.527751  1498 raft_consensus.cc:515] T 6474754cce8f4042bcab4ac631e9a82f P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
W20260709 12:26:47.575424  1038 leader_election.cc:343] T c36d0201599a49169424a6b75f5349f2 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:47.588605  1186 leader_election.cc:304] T 4d899bdd8a44422ca2a8036f84e9f9f3 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085; no voters: aa098a557d34433896712068efd0d9a8
I20260709 12:26:47.590488  1071 raft_consensus.cc:2468] T 0017925ea1bb4374b09c9e692a17f87e P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 1.
I20260709 12:26:47.599519  1498 leader_election.cc:290] T 6474754cce8f4042bcab4ac631e9a82f P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Requested vote from peers 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679), 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341)
I20260709 12:26:47.601037  1583 raft_consensus.cc:2804] T 4d899bdd8a44422ca2a8036f84e9f9f3 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:47.601585  1583 raft_consensus.cc:697] T 4d899bdd8a44422ca2a8036f84e9f9f3 P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Becoming Leader. State: Replica: 937efeddef934b2b8bc8632594903085, State: Running, Role: LEADER
I20260709 12:26:47.602401  1583 consensus_queue.cc:237] T 4d899bdd8a44422ca2a8036f84e9f9f3 P 937efeddef934b2b8bc8632594903085 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:47.616756  1219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0201599a49169424a6b75f5349f2" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:47.621330  1071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6474754cce8f4042bcab4ac631e9a82f" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
I20260709 12:26:47.622301  1071 raft_consensus.cc:3060] T 6474754cce8f4042bcab4ac631e9a82f P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.633315  1266 tablet_bootstrap.cc:492] T 4d899bdd8a44422ca2a8036f84e9f9f3 P aa098a557d34433896712068efd0d9a8: No bootstrap required, opened a new log
I20260709 12:26:47.633873  1266 ts_tablet_manager.cc:1403] T 4d899bdd8a44422ca2a8036f84e9f9f3 P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.347s	user 0.006s	sys 0.016s
I20260709 12:26:47.636737  1266 raft_consensus.cc:359] T 4d899bdd8a44422ca2a8036f84e9f9f3 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:47.637028  1144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6474754cce8f4042bcab4ac631e9a82f" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20"
I20260709 12:26:47.637458  1266 raft_consensus.cc:385] T 4d899bdd8a44422ca2a8036f84e9f9f3 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.637804  1266 raft_consensus.cc:740] T 4d899bdd8a44422ca2a8036f84e9f9f3 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.637882  1144 raft_consensus.cc:3060] T 6474754cce8f4042bcab4ac631e9a82f P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:47.641804  1035 leader_election.cc:343] T ac8f3ce8c750468c966a23ea2787b888 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:47.642498  1035 leader_election.cc:304] T ac8f3ce8c750468c966a23ea2787b888 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132; no voters: 937efeddef934b2b8bc8632594903085, aa098a557d34433896712068efd0d9a8
I20260709 12:26:47.643608  1589 raft_consensus.cc:2749] T ac8f3ce8c750468c966a23ea2787b888 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:47.647981  1144 raft_consensus.cc:2468] T 6474754cce8f4042bcab4ac631e9a82f P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 1.
I20260709 12:26:47.656193  1110 leader_election.cc:304] T 0017925ea1bb4374b09c9e692a17f87e P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 8fa35514a8d84740b1b46ae496307f20; no voters: aa098a557d34433896712068efd0d9a8
I20260709 12:26:47.657847  1585 raft_consensus.cc:2804] T 0017925ea1bb4374b09c9e692a17f87e P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:47.658346  1585 raft_consensus.cc:697] T 0017925ea1bb4374b09c9e692a17f87e P 8fa35514a8d84740b1b46ae496307f20 [term 1 LEADER]: Becoming Leader. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Running, Role: LEADER
I20260709 12:26:47.670567  1266 consensus_queue.cc:260] T 4d899bdd8a44422ca2a8036f84e9f9f3 P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:47.659184  1585 consensus_queue.cc:237] T 0017925ea1bb4374b09c9e692a17f87e P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:47.682428  1267 tablet_bootstrap.cc:654] T 3d2ccd742ac442419de89cb38ee12d37 P 8fa35514a8d84740b1b46ae496307f20: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.687053  1186 leader_election.cc:304] T 6474754cce8f4042bcab4ac631e9a82f P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085; no voters: 
I20260709 12:26:47.700435  1540 raft_consensus.cc:493] T 4d899bdd8a44422ca2a8036f84e9f9f3 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.701023  1540 raft_consensus.cc:515] T 4d899bdd8a44422ca2a8036f84e9f9f3 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:47.703018  1540 leader_election.cc:290] T 4d899bdd8a44422ca2a8036f84e9f9f3 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:26:47.709858  1508 raft_consensus.cc:2804] T 6474754cce8f4042bcab4ac631e9a82f P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:47.765581  1266 ts_tablet_manager.cc:1434] T 4d899bdd8a44422ca2a8036f84e9f9f3 P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.131s	user 0.008s	sys 0.015s
I20260709 12:26:47.766722  1266 tablet_bootstrap.cc:492] T 0017925ea1bb4374b09c9e692a17f87e P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:47.775316  1264 tablet_bootstrap.cc:492] T c36d0201599a49169424a6b75f5349f2 P 937efeddef934b2b8bc8632594903085: No bootstrap required, opened a new log
I20260709 12:26:47.775878  1264 ts_tablet_manager.cc:1403] T c36d0201599a49169424a6b75f5349f2 P 937efeddef934b2b8bc8632594903085: Time spent bootstrapping tablet: real 0.298s	user 0.013s	sys 0.007s
I20260709 12:26:47.778772  1264 raft_consensus.cc:359] T c36d0201599a49169424a6b75f5349f2 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:47.778214  1071 raft_consensus.cc:2468] T 6474754cce8f4042bcab4ac631e9a82f P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 1.
I20260709 12:26:47.781598  1265 tablet_bootstrap.cc:492] T 8c9afd5af68441ffa4c3f90cbd33d977 P 7f9cbe40e40d429aa004e4a7fb42f132: No bootstrap required, opened a new log
I20260709 12:26:47.786718  1265 ts_tablet_manager.cc:1403] T 8c9afd5af68441ffa4c3f90cbd33d977 P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent bootstrapping tablet: real 0.428s	user 0.008s	sys 0.011s
I20260709 12:26:47.779507  1264 raft_consensus.cc:385] T c36d0201599a49169424a6b75f5349f2 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.788334  1144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d899bdd8a44422ca2a8036f84e9f9f3" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:47.789238  1144 raft_consensus.cc:2393] T 4d899bdd8a44422ca2a8036f84e9f9f3 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aa098a557d34433896712068efd0d9a8 in current term 1: Already voted for candidate 937efeddef934b2b8bc8632594903085 in this term.
I20260709 12:26:47.759461  1508 raft_consensus.cc:697] T 6474754cce8f4042bcab4ac631e9a82f P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Becoming Leader. State: Replica: 937efeddef934b2b8bc8632594903085, State: Running, Role: LEADER
I20260709 12:26:47.787899  1264 raft_consensus.cc:740] T c36d0201599a49169424a6b75f5349f2 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 937efeddef934b2b8bc8632594903085, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.812876  1264 consensus_queue.cc:260] T c36d0201599a49169424a6b75f5349f2 P 937efeddef934b2b8bc8632594903085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:47.822799  1266 tablet_bootstrap.cc:654] T 0017925ea1bb4374b09c9e692a17f87e P aa098a557d34433896712068efd0d9a8: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:47.822944  1035 leader_election.cc:343] T c36d0201599a49169424a6b75f5349f2 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:47.826128  1265 raft_consensus.cc:359] T 8c9afd5af68441ffa4c3f90cbd33d977 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:47.828228  1264 ts_tablet_manager.cc:1434] T c36d0201599a49169424a6b75f5349f2 P 937efeddef934b2b8bc8632594903085: Time spent starting tablet: real 0.052s	user 0.005s	sys 0.002s
I20260709 12:26:47.828330  1265 raft_consensus.cc:385] T 8c9afd5af68441ffa4c3f90cbd33d977 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.828969  1265 raft_consensus.cc:740] T 8c9afd5af68441ffa4c3f90cbd33d977 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.833586  1265 consensus_queue.cc:260] T 8c9afd5af68441ffa4c3f90cbd33d977 P 7f9cbe40e40d429aa004e4a7fb42f132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:47.842974  1267 tablet_bootstrap.cc:492] T 3d2ccd742ac442419de89cb38ee12d37 P 8fa35514a8d84740b1b46ae496307f20: No bootstrap required, opened a new log
I20260709 12:26:47.843755  1267 ts_tablet_manager.cc:1403] T 3d2ccd742ac442419de89cb38ee12d37 P 8fa35514a8d84740b1b46ae496307f20: Time spent bootstrapping tablet: real 0.409s	user 0.009s	sys 0.025s
I20260709 12:26:47.844484  1265 ts_tablet_manager.cc:1434] T 8c9afd5af68441ffa4c3f90cbd33d977 P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent starting tablet: real 0.057s	user 0.006s	sys 0.002s
I20260709 12:26:47.845610  1218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d899bdd8a44422ca2a8036f84e9f9f3" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:47.841187  1508 consensus_queue.cc:237] T 6474754cce8f4042bcab4ac631e9a82f P 937efeddef934b2b8bc8632594903085 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:47.854417   895 catalog_manager.cc:5697] T 0017925ea1bb4374b09c9e692a17f87e P 8fa35514a8d84740b1b46ae496307f20 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131). New cstate: current_term: 1 leader_uuid: "8fa35514a8d84740b1b46ae496307f20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: HEALTHY } } }
W20260709 12:26:47.859889  1186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:40341, user_credentials={real_user=slave}} blocked reactor thread for 172917us
I20260709 12:26:47.837042  1035 leader_election.cc:304] T c36d0201599a49169424a6b75f5349f2 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132; no voters: 937efeddef934b2b8bc8632594903085, aa098a557d34433896712068efd0d9a8
I20260709 12:26:47.873498   960 leader_election.cc:304] T 4d899bdd8a44422ca2a8036f84e9f9f3 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa098a557d34433896712068efd0d9a8; no voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085
I20260709 12:26:47.876839   892 catalog_manager.cc:5697] T c5197f4025d94ce096c14c6ca011b47b P 937efeddef934b2b8bc8632594903085 reported cstate change: term changed from 0 to 1, leader changed from <none> to 937efeddef934b2b8bc8632594903085 (127.23.245.132). New cstate: current_term: 1 leader_uuid: "937efeddef934b2b8bc8632594903085" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:47.880915  1264 tablet_bootstrap.cc:492] T 8c9afd5af68441ffa4c3f90cbd33d977 P 937efeddef934b2b8bc8632594903085: Bootstrap starting.
I20260709 12:26:47.885083   892 catalog_manager.cc:5697] T a1c303d40c6a4cae88aa89d681ae7b76 P 937efeddef934b2b8bc8632594903085 reported cstate change: term changed from 0 to 1, leader changed from <none> to 937efeddef934b2b8bc8632594903085 (127.23.245.132). New cstate: current_term: 1 leader_uuid: "937efeddef934b2b8bc8632594903085" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:47.887247  1265 tablet_bootstrap.cc:492] T 348d7f300dcb474b8b012e01d0af067f P 7f9cbe40e40d429aa004e4a7fb42f132: Bootstrap starting.
I20260709 12:26:47.876368  1614 raft_consensus.cc:3060] T 4d899bdd8a44422ca2a8036f84e9f9f3 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:47.895525  1557 raft_consensus.cc:2749] T c36d0201599a49169424a6b75f5349f2 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:47.905550  1267 raft_consensus.cc:359] T 3d2ccd742ac442419de89cb38ee12d37 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:47.906453  1267 raft_consensus.cc:385] T 3d2ccd742ac442419de89cb38ee12d37 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:26:47.893013  1035 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:33909, user_credentials={real_user=slave}} blocked reactor thread for 70109.2us
I20260709 12:26:47.941484  1511 raft_consensus.cc:493] T 8c9afd5af68441ffa4c3f90cbd33d977 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.942058  1511 raft_consensus.cc:515] T 8c9afd5af68441ffa4c3f90cbd33d977 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:47.944265  1511 leader_election.cc:290] T 8c9afd5af68441ffa4c3f90cbd33d977 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:26:47.958679  1265 tablet_bootstrap.cc:654] T 348d7f300dcb474b8b012e01d0af067f P 7f9cbe40e40d429aa004e4a7fb42f132: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.964075  1264 tablet_bootstrap.cc:654] T 8c9afd5af68441ffa4c3f90cbd33d977 P 937efeddef934b2b8bc8632594903085: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:47.906793  1267 raft_consensus.cc:740] T 3d2ccd742ac442419de89cb38ee12d37 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.968392  1145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9afd5af68441ffa4c3f90cbd33d977" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:47.967187  1267 consensus_queue.cc:260] T 3d2ccd742ac442419de89cb38ee12d37 P 8fa35514a8d84740b1b46ae496307f20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
W20260709 12:26:47.980293  1038 leader_election.cc:343] T 8c9afd5af68441ffa4c3f90cbd33d977 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:47.980381  1574 consensus_queue.cc:1048] T c5197f4025d94ce096c14c6ca011b47b P 937efeddef934b2b8bc8632594903085 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:47.984444  1266 tablet_bootstrap.cc:492] T 0017925ea1bb4374b09c9e692a17f87e P aa098a557d34433896712068efd0d9a8: No bootstrap required, opened a new log
I20260709 12:26:47.984949  1266 ts_tablet_manager.cc:1403] T 0017925ea1bb4374b09c9e692a17f87e P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.218s	user 0.016s	sys 0.000s
I20260709 12:26:47.988783  1267 ts_tablet_manager.cc:1434] T 3d2ccd742ac442419de89cb38ee12d37 P 8fa35514a8d84740b1b46ae496307f20: Time spent starting tablet: real 0.145s	user 0.007s	sys 0.000s
I20260709 12:26:47.990056  1267 tablet_bootstrap.cc:492] T 040ea9f986ee4ed29b941698c802c501 P 8fa35514a8d84740b1b46ae496307f20: Bootstrap starting.
I20260709 12:26:47.983834  1614 raft_consensus.cc:2749] T 4d899bdd8a44422ca2a8036f84e9f9f3 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:47.987800  1266 raft_consensus.cc:359] T 0017925ea1bb4374b09c9e692a17f87e P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:47.997200  1266 raft_consensus.cc:385] T 0017925ea1bb4374b09c9e692a17f87e P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:47.997509  1266 raft_consensus.cc:740] T 0017925ea1bb4374b09c9e692a17f87e P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:47.998219  1266 consensus_queue.cc:260] T 0017925ea1bb4374b09c9e692a17f87e P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:48.000578  1266 ts_tablet_manager.cc:1434] T 0017925ea1bb4374b09c9e692a17f87e P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:26:48.002100  1266 tablet_bootstrap.cc:492] T 3d2ccd742ac442419de89cb38ee12d37 P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:48.003149  1508 consensus_queue.cc:1048] T a1c303d40c6a4cae88aa89d681ae7b76 P 937efeddef934b2b8bc8632594903085 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:48.008061  1219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9afd5af68441ffa4c3f90cbd33d977" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
W20260709 12:26:48.015555  1035 leader_election.cc:343] T 8c9afd5af68441ffa4c3f90cbd33d977 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:48.016422  1035 leader_election.cc:304] T 8c9afd5af68441ffa4c3f90cbd33d977 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132; no voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085
I20260709 12:26:48.017474  1267 tablet_bootstrap.cc:654] T 040ea9f986ee4ed29b941698c802c501 P 8fa35514a8d84740b1b46ae496307f20: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.017427  1557 raft_consensus.cc:2749] T 8c9afd5af68441ffa4c3f90cbd33d977 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:48.021291  1265 tablet_bootstrap.cc:492] T 348d7f300dcb474b8b012e01d0af067f P 7f9cbe40e40d429aa004e4a7fb42f132: No bootstrap required, opened a new log
I20260709 12:26:48.022070  1265 ts_tablet_manager.cc:1403] T 348d7f300dcb474b8b012e01d0af067f P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent bootstrapping tablet: real 0.158s	user 0.010s	sys 0.003s
I20260709 12:26:48.032222  1264 tablet_bootstrap.cc:492] T 8c9afd5af68441ffa4c3f90cbd33d977 P 937efeddef934b2b8bc8632594903085: No bootstrap required, opened a new log
I20260709 12:26:48.032824  1264 ts_tablet_manager.cc:1403] T 8c9afd5af68441ffa4c3f90cbd33d977 P 937efeddef934b2b8bc8632594903085: Time spent bootstrapping tablet: real 0.152s	user 0.009s	sys 0.010s
I20260709 12:26:48.035320  1618 consensus_queue.cc:1048] T a1c303d40c6a4cae88aa89d681ae7b76 P 937efeddef934b2b8bc8632594903085 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:48.049135  1586 raft_consensus.cc:493] T 3d2ccd742ac442419de89cb38ee12d37 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.055960  1586 raft_consensus.cc:515] T 3d2ccd742ac442419de89cb38ee12d37 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:48.058966  1266 tablet_bootstrap.cc:654] T 3d2ccd742ac442419de89cb38ee12d37 P aa098a557d34433896712068efd0d9a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.067842  1072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2ccd742ac442419de89cb38ee12d37" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:48.068878  1072 raft_consensus.cc:2468] T 3d2ccd742ac442419de89cb38ee12d37 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 0.
I20260709 12:26:48.061723   995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2ccd742ac442419de89cb38ee12d37" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
I20260709 12:26:48.074420  1110 leader_election.cc:304] T 3d2ccd742ac442419de89cb38ee12d37 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 8fa35514a8d84740b1b46ae496307f20; no voters: 
I20260709 12:26:48.059906  1586 leader_election.cc:290] T 3d2ccd742ac442419de89cb38ee12d37 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:48.074760  1265 raft_consensus.cc:359] T 348d7f300dcb474b8b012e01d0af067f P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:48.075152  1264 raft_consensus.cc:359] T 8c9afd5af68441ffa4c3f90cbd33d977 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:48.076917  1265 raft_consensus.cc:385] T 348d7f300dcb474b8b012e01d0af067f P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.077033  1264 raft_consensus.cc:385] T 8c9afd5af68441ffa4c3f90cbd33d977 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.077298  1265 raft_consensus.cc:740] T 348d7f300dcb474b8b012e01d0af067f P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.077454  1264 raft_consensus.cc:740] T 8c9afd5af68441ffa4c3f90cbd33d977 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 937efeddef934b2b8bc8632594903085, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.078210  1264 consensus_queue.cc:260] T 8c9afd5af68441ffa4c3f90cbd33d977 P 937efeddef934b2b8bc8632594903085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:48.083302  1267 tablet_bootstrap.cc:492] T 040ea9f986ee4ed29b941698c802c501 P 8fa35514a8d84740b1b46ae496307f20: No bootstrap required, opened a new log
W20260709 12:26:48.083725  1112 leader_election.cc:343] T 3d2ccd742ac442419de89cb38ee12d37 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:48.083858  1267 ts_tablet_manager.cc:1403] T 040ea9f986ee4ed29b941698c802c501 P 8fa35514a8d84740b1b46ae496307f20: Time spent bootstrapping tablet: real 0.094s	user 0.010s	sys 0.009s
I20260709 12:26:48.084888  1264 ts_tablet_manager.cc:1434] T 8c9afd5af68441ffa4c3f90cbd33d977 P 937efeddef934b2b8bc8632594903085: Time spent starting tablet: real 0.052s	user 0.004s	sys 0.004s
I20260709 12:26:48.084394  1586 raft_consensus.cc:2804] T 3d2ccd742ac442419de89cb38ee12d37 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:48.085901  1264 tablet_bootstrap.cc:492] T 040ea9f986ee4ed29b941698c802c501 P 937efeddef934b2b8bc8632594903085: Bootstrap starting.
I20260709 12:26:48.086156  1586 raft_consensus.cc:493] T 3d2ccd742ac442419de89cb38ee12d37 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:48.086527  1586 raft_consensus.cc:3060] T 3d2ccd742ac442419de89cb38ee12d37 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.088910  1265 consensus_queue.cc:260] T 348d7f300dcb474b8b012e01d0af067f P 7f9cbe40e40d429aa004e4a7fb42f132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:48.091825  1265 ts_tablet_manager.cc:1434] T 348d7f300dcb474b8b012e01d0af067f P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent starting tablet: real 0.069s	user 0.007s	sys 0.003s
I20260709 12:26:48.092394  1264 tablet_bootstrap.cc:654] T 040ea9f986ee4ed29b941698c802c501 P 937efeddef934b2b8bc8632594903085: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.093019  1265 tablet_bootstrap.cc:492] T ec806598903e4f88a40176e07ca4fad0 P 7f9cbe40e40d429aa004e4a7fb42f132: Bootstrap starting.
I20260709 12:26:48.097015  1267 raft_consensus.cc:359] T 040ea9f986ee4ed29b941698c802c501 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:48.097779  1267 raft_consensus.cc:385] T 040ea9f986ee4ed29b941698c802c501 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.098073  1267 raft_consensus.cc:740] T 040ea9f986ee4ed29b941698c802c501 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.098923  1267 consensus_queue.cc:260] T 040ea9f986ee4ed29b941698c802c501 P 8fa35514a8d84740b1b46ae496307f20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:48.101783  1267 ts_tablet_manager.cc:1434] T 040ea9f986ee4ed29b941698c802c501 P 8fa35514a8d84740b1b46ae496307f20: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.001s
I20260709 12:26:48.102873  1267 tablet_bootstrap.cc:492] T 0e2eae4c387445f39a059befe390fe45 P 8fa35514a8d84740b1b46ae496307f20: Bootstrap starting.
I20260709 12:26:48.109655  1267 tablet_bootstrap.cc:654] T 0e2eae4c387445f39a059befe390fe45 P 8fa35514a8d84740b1b46ae496307f20: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.111263  1584 consensus_queue.cc:1048] T c5197f4025d94ce096c14c6ca011b47b P 937efeddef934b2b8bc8632594903085 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:26:48.116080  1266 tablet_bootstrap.cc:492] T 3d2ccd742ac442419de89cb38ee12d37 P aa098a557d34433896712068efd0d9a8: No bootstrap required, opened a new log
I20260709 12:26:48.116951  1266 ts_tablet_manager.cc:1403] T 3d2ccd742ac442419de89cb38ee12d37 P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.116s	user 0.014s	sys 0.000s
I20260709 12:26:48.108443  1586 raft_consensus.cc:515] T 3d2ccd742ac442419de89cb38ee12d37 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:48.118482  1265 tablet_bootstrap.cc:654] T ec806598903e4f88a40176e07ca4fad0 P 7f9cbe40e40d429aa004e4a7fb42f132: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.131183  1266 raft_consensus.cc:359] T 3d2ccd742ac442419de89cb38ee12d37 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:48.132331  1266 raft_consensus.cc:385] T 3d2ccd742ac442419de89cb38ee12d37 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.132616  1266 raft_consensus.cc:740] T 3d2ccd742ac442419de89cb38ee12d37 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.136794  1266 consensus_queue.cc:260] T 3d2ccd742ac442419de89cb38ee12d37 P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:48.147609  1586 leader_election.cc:290] T 3d2ccd742ac442419de89cb38ee12d37 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 election: Requested vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:48.148145  1071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2ccd742ac442419de89cb38ee12d37" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
I20260709 12:26:48.148793  1071 raft_consensus.cc:3060] T 3d2ccd742ac442419de89cb38ee12d37 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.152506  1266 ts_tablet_manager.cc:1434] T 3d2ccd742ac442419de89cb38ee12d37 P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 12:26:48.156324   995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2ccd742ac442419de89cb38ee12d37" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8"
I20260709 12:26:48.156942   995 raft_consensus.cc:3060] T 3d2ccd742ac442419de89cb38ee12d37 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.170379  1071 raft_consensus.cc:2468] T 3d2ccd742ac442419de89cb38ee12d37 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 1.
I20260709 12:26:48.171908  1110 leader_election.cc:304] T 3d2ccd742ac442419de89cb38ee12d37 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 8fa35514a8d84740b1b46ae496307f20; no voters: 
I20260709 12:26:48.172545   995 raft_consensus.cc:2468] T 3d2ccd742ac442419de89cb38ee12d37 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 1.
I20260709 12:26:48.173115  1586 raft_consensus.cc:2804] T 3d2ccd742ac442419de89cb38ee12d37 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:48.180894  1266 tablet_bootstrap.cc:492] T 329e639d23154fb6bd4ccdf095dbd0e0 P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:48.173698  1586 raft_consensus.cc:697] T 3d2ccd742ac442419de89cb38ee12d37 P 8fa35514a8d84740b1b46ae496307f20 [term 1 LEADER]: Becoming Leader. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Running, Role: LEADER
I20260709 12:26:48.183991  1586 consensus_queue.cc:237] T 3d2ccd742ac442419de89cb38ee12d37 P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:48.195315  1264 tablet_bootstrap.cc:492] T 040ea9f986ee4ed29b941698c802c501 P 937efeddef934b2b8bc8632594903085: No bootstrap required, opened a new log
I20260709 12:26:48.195824  1264 ts_tablet_manager.cc:1403] T 040ea9f986ee4ed29b941698c802c501 P 937efeddef934b2b8bc8632594903085: Time spent bootstrapping tablet: real 0.110s	user 0.018s	sys 0.013s
I20260709 12:26:48.196115  1524 consensus_queue.cc:1048] T 0017925ea1bb4374b09c9e692a17f87e P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:48.198786  1264 raft_consensus.cc:359] T 040ea9f986ee4ed29b941698c802c501 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:48.199477  1264 raft_consensus.cc:385] T 040ea9f986ee4ed29b941698c802c501 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.199747  1264 raft_consensus.cc:740] T 040ea9f986ee4ed29b941698c802c501 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 937efeddef934b2b8bc8632594903085, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.200497  1264 consensus_queue.cc:260] T 040ea9f986ee4ed29b941698c802c501 P 937efeddef934b2b8bc8632594903085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:48.202634  1264 ts_tablet_manager.cc:1434] T 040ea9f986ee4ed29b941698c802c501 P 937efeddef934b2b8bc8632594903085: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:26:48.202809  1265 tablet_bootstrap.cc:492] T ec806598903e4f88a40176e07ca4fad0 P 7f9cbe40e40d429aa004e4a7fb42f132: No bootstrap required, opened a new log
I20260709 12:26:48.203362  1265 ts_tablet_manager.cc:1403] T ec806598903e4f88a40176e07ca4fad0 P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent bootstrapping tablet: real 0.111s	user 0.011s	sys 0.015s
I20260709 12:26:48.203569  1264 tablet_bootstrap.cc:492] T ac8f3ce8c750468c966a23ea2787b888 P 937efeddef934b2b8bc8632594903085: Bootstrap starting.
I20260709 12:26:48.205834  1266 tablet_bootstrap.cc:654] T 329e639d23154fb6bd4ccdf095dbd0e0 P aa098a557d34433896712068efd0d9a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.220386  1582 consensus_queue.cc:1048] T 4d899bdd8a44422ca2a8036f84e9f9f3 P 937efeddef934b2b8bc8632594903085 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:48.223066  1267 tablet_bootstrap.cc:492] T 0e2eae4c387445f39a059befe390fe45 P 8fa35514a8d84740b1b46ae496307f20: No bootstrap required, opened a new log
I20260709 12:26:48.223596  1267 ts_tablet_manager.cc:1403] T 0e2eae4c387445f39a059befe390fe45 P 8fa35514a8d84740b1b46ae496307f20: Time spent bootstrapping tablet: real 0.121s	user 0.031s	sys 0.009s
I20260709 12:26:48.226226  1267 raft_consensus.cc:359] T 0e2eae4c387445f39a059befe390fe45 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:48.226883  1267 raft_consensus.cc:385] T 0e2eae4c387445f39a059befe390fe45 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.227144  1267 raft_consensus.cc:740] T 0e2eae4c387445f39a059befe390fe45 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.227738  1267 consensus_queue.cc:260] T 0e2eae4c387445f39a059befe390fe45 P 8fa35514a8d84740b1b46ae496307f20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:48.235862   996 raft_consensus.cc:3060] T 0017925ea1bb4374b09c9e692a17f87e P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.236513  1267 ts_tablet_manager.cc:1434] T 0e2eae4c387445f39a059befe390fe45 P 8fa35514a8d84740b1b46ae496307f20: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:26:48.238962  1267 tablet_bootstrap.cc:492] T c97b34e374ed4aec812cc43e2a5f07de P 8fa35514a8d84740b1b46ae496307f20: Bootstrap starting.
I20260709 12:26:48.240235  1264 tablet_bootstrap.cc:654] T ac8f3ce8c750468c966a23ea2787b888 P 937efeddef934b2b8bc8632594903085: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.242825  1265 raft_consensus.cc:359] T ec806598903e4f88a40176e07ca4fad0 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:48.243594  1265 raft_consensus.cc:385] T ec806598903e4f88a40176e07ca4fad0 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.243845  1265 raft_consensus.cc:740] T ec806598903e4f88a40176e07ca4fad0 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.245692  1582 consensus_queue.cc:1048] T 4d899bdd8a44422ca2a8036f84e9f9f3 P 937efeddef934b2b8bc8632594903085 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:48.249322   890 catalog_manager.cc:5697] T 6474754cce8f4042bcab4ac631e9a82f P 937efeddef934b2b8bc8632594903085 reported cstate change: term changed from 0 to 1, leader changed from <none> to 937efeddef934b2b8bc8632594903085 (127.23.245.132). New cstate: current_term: 1 leader_uuid: "937efeddef934b2b8bc8632594903085" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:48.251837  1584 raft_consensus.cc:493] T c36d0201599a49169424a6b75f5349f2 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.251444   890 catalog_manager.cc:5697] T 4d899bdd8a44422ca2a8036f84e9f9f3 P 937efeddef934b2b8bc8632594903085 reported cstate change: term changed from 0 to 1, leader changed from <none> to 937efeddef934b2b8bc8632594903085 (127.23.245.132). New cstate: current_term: 1 leader_uuid: "937efeddef934b2b8bc8632594903085" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:48.252368  1584 raft_consensus.cc:515] T c36d0201599a49169424a6b75f5349f2 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:48.254503  1584 leader_election.cc:290] T c36d0201599a49169424a6b75f5349f2 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:48.255728  1265 consensus_queue.cc:260] T ec806598903e4f88a40176e07ca4fad0 P 7f9cbe40e40d429aa004e4a7fb42f132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:48.258739  1265 ts_tablet_manager.cc:1434] T ec806598903e4f88a40176e07ca4fad0 P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent starting tablet: real 0.055s	user 0.008s	sys 0.000s
I20260709 12:26:48.259012   997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0201599a49169424a6b75f5349f2" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
W20260709 12:26:48.260443  1186 leader_election.cc:343] T c36d0201599a49169424a6b75f5349f2 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:48.261154  1071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0201599a49169424a6b75f5349f2" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:48.259802  1265 tablet_bootstrap.cc:492] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P 7f9cbe40e40d429aa004e4a7fb42f132: Bootstrap starting.
I20260709 12:26:48.261823  1071 raft_consensus.cc:2468] T c36d0201599a49169424a6b75f5349f2 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 0.
I20260709 12:26:48.264587  1184 leader_election.cc:304] T c36d0201599a49169424a6b75f5349f2 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 937efeddef934b2b8bc8632594903085; no voters: aa098a557d34433896712068efd0d9a8
I20260709 12:26:48.267082  1267 tablet_bootstrap.cc:654] T c97b34e374ed4aec812cc43e2a5f07de P 8fa35514a8d84740b1b46ae496307f20: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.268290  1584 raft_consensus.cc:2804] T c36d0201599a49169424a6b75f5349f2 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:48.268805  1584 raft_consensus.cc:493] T c36d0201599a49169424a6b75f5349f2 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:48.271301  1584 raft_consensus.cc:3060] T c36d0201599a49169424a6b75f5349f2 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.276631  1582 raft_consensus.cc:493] T 8c9afd5af68441ffa4c3f90cbd33d977 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.277217  1582 raft_consensus.cc:515] T 8c9afd5af68441ffa4c3f90cbd33d977 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:48.277125   894 catalog_manager.cc:5697] T 3d2ccd742ac442419de89cb38ee12d37 P 8fa35514a8d84740b1b46ae496307f20 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131). New cstate: current_term: 1 leader_uuid: "8fa35514a8d84740b1b46ae496307f20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:48.280619  1266 tablet_bootstrap.cc:492] T 329e639d23154fb6bd4ccdf095dbd0e0 P aa098a557d34433896712068efd0d9a8: No bootstrap required, opened a new log
I20260709 12:26:48.281158  1266 ts_tablet_manager.cc:1403] T 329e639d23154fb6bd4ccdf095dbd0e0 P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.101s	user 0.012s	sys 0.000s
I20260709 12:26:48.284008  1614 raft_consensus.cc:493] T 0017925ea1bb4374b09c9e692a17f87e P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.284363  1071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9afd5af68441ffa4c3f90cbd33d977" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:48.284533  1614 raft_consensus.cc:515] T 0017925ea1bb4374b09c9e692a17f87e P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:48.285038  1071 raft_consensus.cc:2468] T 8c9afd5af68441ffa4c3f90cbd33d977 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 0.
I20260709 12:26:48.286501  1184 leader_election.cc:304] T 8c9afd5af68441ffa4c3f90cbd33d977 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 937efeddef934b2b8bc8632594903085; no voters: 
I20260709 12:26:48.287382  1574 raft_consensus.cc:2804] T 8c9afd5af68441ffa4c3f90cbd33d977 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:48.287734  1574 raft_consensus.cc:493] T 8c9afd5af68441ffa4c3f90cbd33d977 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:48.288062  1557 raft_consensus.cc:493] T 348d7f300dcb474b8b012e01d0af067f P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.288179  1574 raft_consensus.cc:3060] T 8c9afd5af68441ffa4c3f90cbd33d977 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.288581  1557 raft_consensus.cc:515] T 348d7f300dcb474b8b012e01d0af067f P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:48.293056  1266 raft_consensus.cc:359] T 329e639d23154fb6bd4ccdf095dbd0e0 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:48.293677  1266 raft_consensus.cc:385] T 329e639d23154fb6bd4ccdf095dbd0e0 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.293975  1266 raft_consensus.cc:740] T 329e639d23154fb6bd4ccdf095dbd0e0 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.294663  1585 consensus_queue.cc:1048] T 0017925ea1bb4374b09c9e692a17f87e P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:26:48.294731  1266 consensus_queue.cc:260] T 329e639d23154fb6bd4ccdf095dbd0e0 P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:48.297209  1266 ts_tablet_manager.cc:1434] T 329e639d23154fb6bd4ccdf095dbd0e0 P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:26:48.298393  1266 tablet_bootstrap.cc:492] T c36d0201599a49169424a6b75f5349f2 P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:48.318326  1582 leader_election.cc:290] T 8c9afd5af68441ffa4c3f90cbd33d977 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679), 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341)
I20260709 12:26:48.319036  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348d7f300dcb474b8b012e01d0af067f" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:48.322111  1614 leader_election.cc:290] T 0017925ea1bb4374b09c9e692a17f87e P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679), 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341)
I20260709 12:26:48.322942  1071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0017925ea1bb4374b09c9e692a17f87e" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:48.323457  1145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0017925ea1bb4374b09c9e692a17f87e" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:48.303987  1584 raft_consensus.cc:515] T c36d0201599a49169424a6b75f5349f2 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:48.326508   991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348d7f300dcb474b8b012e01d0af067f" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
I20260709 12:26:48.309571  1557 leader_election.cc:290] T 348d7f300dcb474b8b012e01d0af067f P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:48.328440  1574 raft_consensus.cc:515] T 8c9afd5af68441ffa4c3f90cbd33d977 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:48.329062  1266 tablet_bootstrap.cc:654] T c36d0201599a49169424a6b75f5349f2 P aa098a557d34433896712068efd0d9a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.330624  1574 leader_election.cc:290] T 8c9afd5af68441ffa4c3f90cbd33d977 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Requested vote from peers 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679), 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341)
I20260709 12:26:48.330982  1584 leader_election.cc:290] T c36d0201599a49169424a6b75f5349f2 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Requested vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
W20260709 12:26:48.331405  1038 leader_election.cc:343] T 348d7f300dcb474b8b012e01d0af067f P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:48.332265  1145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9afd5af68441ffa4c3f90cbd33d977" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:48.336521  1072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9afd5af68441ffa4c3f90cbd33d977" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
I20260709 12:26:48.337220  1072 raft_consensus.cc:3060] T 8c9afd5af68441ffa4c3f90cbd33d977 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:48.342790  1035 leader_election.cc:343] T 348d7f300dcb474b8b012e01d0af067f P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:48.343243  1035 leader_election.cc:304] T 348d7f300dcb474b8b012e01d0af067f P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132; no voters: 937efeddef934b2b8bc8632594903085, aa098a557d34433896712068efd0d9a8
I20260709 12:26:48.344691   961 leader_election.cc:304] T 0017925ea1bb4374b09c9e692a17f87e P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa098a557d34433896712068efd0d9a8; no voters: 7f9cbe40e40d429aa004e4a7fb42f132, 8fa35514a8d84740b1b46ae496307f20
I20260709 12:26:48.351467  1557 raft_consensus.cc:2749] T 348d7f300dcb474b8b012e01d0af067f P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:48.353852   991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0201599a49169424a6b75f5349f2" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8"
I20260709 12:26:48.358115  1070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0201599a49169424a6b75f5349f2" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
I20260709 12:26:48.358772  1070 raft_consensus.cc:3060] T c36d0201599a49169424a6b75f5349f2 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.360507  1145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c9afd5af68441ffa4c3f90cbd33d977" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20"
W20260709 12:26:48.365850  1186 leader_election.cc:343] T c36d0201599a49169424a6b75f5349f2 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:48.367111  1186 leader_election.cc:343] T 8c9afd5af68441ffa4c3f90cbd33d977 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:48.369163  1186 leader_election.cc:343] T 8c9afd5af68441ffa4c3f90cbd33d977 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:48.397253  1072 raft_consensus.cc:2468] T 8c9afd5af68441ffa4c3f90cbd33d977 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 1.
I20260709 12:26:48.397148  1421 raft_consensus.cc:493] T 040ea9f986ee4ed29b941698c802c501 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.415973  1421 raft_consensus.cc:515] T 040ea9f986ee4ed29b941698c802c501 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:48.415087  1612 raft_consensus.cc:2749] T 0017925ea1bb4374b09c9e692a17f87e P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:48.477698  1266 tablet_bootstrap.cc:492] T c36d0201599a49169424a6b75f5349f2 P aa098a557d34433896712068efd0d9a8: No bootstrap required, opened a new log
I20260709 12:26:48.478518  1266 ts_tablet_manager.cc:1403] T c36d0201599a49169424a6b75f5349f2 P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.180s	user 0.033s	sys 0.022s
W20260709 12:26:48.487782   943 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:48.491765  1264 tablet_bootstrap.cc:492] T ac8f3ce8c750468c966a23ea2787b888 P 937efeddef934b2b8bc8632594903085: No bootstrap required, opened a new log
I20260709 12:26:48.492650  1264 ts_tablet_manager.cc:1403] T ac8f3ce8c750468c966a23ea2787b888 P 937efeddef934b2b8bc8632594903085: Time spent bootstrapping tablet: real 0.289s	user 0.021s	sys 0.014s
I20260709 12:26:48.493070  1265 tablet_bootstrap.cc:654] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P 7f9cbe40e40d429aa004e4a7fb42f132: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.479979  1336 raft_consensus.cc:493] T 329e639d23154fb6bd4ccdf095dbd0e0 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.497226  1336 raft_consensus.cc:515] T 329e639d23154fb6bd4ccdf095dbd0e0 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:48.498165  1508 raft_consensus.cc:493] T 040ea9f986ee4ed29b941698c802c501 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.499053  1508 raft_consensus.cc:515] T 040ea9f986ee4ed29b941698c802c501 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:48.505299  1421 leader_election.cc:290] T 040ea9f986ee4ed29b941698c802c501 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:48.502336  1336 leader_election.cc:290] T 329e639d23154fb6bd4ccdf095dbd0e0 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:48.516047  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "040ea9f986ee4ed29b941698c802c501" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:48.516795  1220 raft_consensus.cc:2468] T 040ea9f986ee4ed29b941698c802c501 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 0.
I20260709 12:26:48.489671  1184 leader_election.cc:304] T 8c9afd5af68441ffa4c3f90cbd33d977 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 937efeddef934b2b8bc8632594903085; no voters: 8fa35514a8d84740b1b46ae496307f20
I20260709 12:26:48.517535  1618 consensus_queue.cc:1048] T 6474754cce8f4042bcab4ac631e9a82f P 937efeddef934b2b8bc8632594903085 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:48.520844  1267 tablet_bootstrap.cc:492] T c97b34e374ed4aec812cc43e2a5f07de P 8fa35514a8d84740b1b46ae496307f20: No bootstrap required, opened a new log
I20260709 12:26:48.521520  1267 ts_tablet_manager.cc:1403] T c97b34e374ed4aec812cc43e2a5f07de P 8fa35514a8d84740b1b46ae496307f20: Time spent bootstrapping tablet: real 0.283s	user 0.029s	sys 0.025s
I20260709 12:26:48.525578  1620 raft_consensus.cc:2804] T 8c9afd5af68441ffa4c3f90cbd33d977 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:48.526787  1620 raft_consensus.cc:697] T 8c9afd5af68441ffa4c3f90cbd33d977 P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Becoming Leader. State: Replica: 937efeddef934b2b8bc8632594903085, State: Running, Role: LEADER
I20260709 12:26:48.527736  1620 consensus_queue.cc:237] T 8c9afd5af68441ffa4c3f90cbd33d977 P 937efeddef934b2b8bc8632594903085 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:48.529937  1266 raft_consensus.cc:359] T c36d0201599a49169424a6b75f5349f2 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:48.532251  1266 raft_consensus.cc:385] T c36d0201599a49169424a6b75f5349f2 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.533182  1508 leader_election.cc:290] T 040ea9f986ee4ed29b941698c802c501 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:48.532573  1266 raft_consensus.cc:740] T c36d0201599a49169424a6b75f5349f2 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
W20260709 12:26:48.533615  1184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:43679, user_credentials={real_user=slave}} blocked reactor thread for 57140.6us
I20260709 12:26:48.543967  1109 leader_election.cc:304] T 040ea9f986ee4ed29b941698c802c501 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085; no voters: 
I20260709 12:26:48.545451  1145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "040ea9f986ee4ed29b941698c802c501" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:48.546252  1145 raft_consensus.cc:2468] T 040ea9f986ee4ed29b941698c802c501 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 0.
I20260709 12:26:48.548883  1618 consensus_queue.cc:1048] T 6474754cce8f4042bcab4ac631e9a82f P 937efeddef934b2b8bc8632594903085 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:48.550158  1586 raft_consensus.cc:2804] T 040ea9f986ee4ed29b941698c802c501 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:48.550617  1586 raft_consensus.cc:493] T 040ea9f986ee4ed29b941698c802c501 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:48.550997  1586 raft_consensus.cc:3060] T 040ea9f986ee4ed29b941698c802c501 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.554145  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "329e639d23154fb6bd4ccdf095dbd0e0" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:48.556375  1267 raft_consensus.cc:359] T c97b34e374ed4aec812cc43e2a5f07de P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:48.557116  1267 raft_consensus.cc:385] T c97b34e374ed4aec812cc43e2a5f07de P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.557384  1267 raft_consensus.cc:740] T c97b34e374ed4aec812cc43e2a5f07de P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.559718  1267 consensus_queue.cc:260] T c97b34e374ed4aec812cc43e2a5f07de P 8fa35514a8d84740b1b46ae496307f20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:48.561226  1267 ts_tablet_manager.cc:1434] T c97b34e374ed4aec812cc43e2a5f07de P 8fa35514a8d84740b1b46ae496307f20: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 12:26:48.562196  1267 tablet_bootstrap.cc:492] T f84cb753a9bd4fdd91824bb2d5050621 P 8fa35514a8d84740b1b46ae496307f20: Bootstrap starting.
I20260709 12:26:48.563345   995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "040ea9f986ee4ed29b941698c802c501" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
I20260709 12:26:48.575316   996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "040ea9f986ee4ed29b941698c802c501" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
I20260709 12:26:48.581634  1070 raft_consensus.cc:2468] T c36d0201599a49169424a6b75f5349f2 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 1.
W20260709 12:26:48.581780  1186 leader_election.cc:343] T 040ea9f986ee4ed29b941698c802c501 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:48.582314  1421 raft_consensus.cc:493] T c97b34e374ed4aec812cc43e2a5f07de P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.582886  1421 raft_consensus.cc:515] T c97b34e374ed4aec812cc43e2a5f07de P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:48.584144  1267 tablet_bootstrap.cc:654] T f84cb753a9bd4fdd91824bb2d5050621 P 8fa35514a8d84740b1b46ae496307f20: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.586046  1421 leader_election.cc:290] T c97b34e374ed4aec812cc43e2a5f07de P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:48.591141  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97b34e374ed4aec812cc43e2a5f07de" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:48.602581  1267 tablet_bootstrap.cc:492] T f84cb753a9bd4fdd91824bb2d5050621 P 8fa35514a8d84740b1b46ae496307f20: No bootstrap required, opened a new log
I20260709 12:26:48.603091  1267 ts_tablet_manager.cc:1403] T f84cb753a9bd4fdd91824bb2d5050621 P 8fa35514a8d84740b1b46ae496307f20: Time spent bootstrapping tablet: real 0.041s	user 0.008s	sys 0.001s
I20260709 12:26:48.603216  1186 leader_election.cc:304] T 040ea9f986ee4ed29b941698c802c501 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085; no voters: aa098a557d34433896712068efd0d9a8
I20260709 12:26:48.614574  1267 raft_consensus.cc:359] T f84cb753a9bd4fdd91824bb2d5050621 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:48.621645  1267 raft_consensus.cc:385] T f84cb753a9bd4fdd91824bb2d5050621 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.620426  1508 raft_consensus.cc:2804] T 040ea9f986ee4ed29b941698c802c501 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:48.621969  1267 raft_consensus.cc:740] T f84cb753a9bd4fdd91824bb2d5050621 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.622237  1508 raft_consensus.cc:493] T 040ea9f986ee4ed29b941698c802c501 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:48.622685  1508 raft_consensus.cc:3060] T 040ea9f986ee4ed29b941698c802c501 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.622830  1267 consensus_queue.cc:260] T f84cb753a9bd4fdd91824bb2d5050621 P 8fa35514a8d84740b1b46ae496307f20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
W20260709 12:26:48.626467  1109 leader_election.cc:343] T c97b34e374ed4aec812cc43e2a5f07de P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:48.606490  1642 log.cc:927] Time spent T 4d899bdd8a44422ca2a8036f84e9f9f3 P 8fa35514a8d84740b1b46ae496307f20: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 12:26:48.629467  1264 raft_consensus.cc:359] T ac8f3ce8c750468c966a23ea2787b888 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
W20260709 12:26:48.613897  1112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:32981, user_credentials={real_user=slave}} blocked reactor thread for 63282.7us
I20260709 12:26:48.614573  1651 raft_consensus.cc:493] T 0e2eae4c387445f39a059befe390fe45 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.616544  1069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "329e639d23154fb6bd4ccdf095dbd0e0" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:48.616894  1557 raft_consensus.cc:493] T ec806598903e4f88a40176e07ca4fad0 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.630630  1586 raft_consensus.cc:515] T 040ea9f986ee4ed29b941698c802c501 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:48.630892  1557 raft_consensus.cc:515] T ec806598903e4f88a40176e07ca4fad0 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:48.631582  1651 raft_consensus.cc:515] T 0e2eae4c387445f39a059befe390fe45 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:48.632838  1586 leader_election.cc:290] T 040ea9f986ee4ed29b941698c802c501 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 election: Requested vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:48.630226  1264 raft_consensus.cc:385] T ac8f3ce8c750468c966a23ea2787b888 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.633452  1264 raft_consensus.cc:740] T ac8f3ce8c750468c966a23ea2787b888 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 937efeddef934b2b8bc8632594903085, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.633795  1557 leader_election.cc:290] T ec806598903e4f88a40176e07ca4fad0 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341)
I20260709 12:26:48.634275  1264 consensus_queue.cc:260] T ac8f3ce8c750468c966a23ea2787b888 P 937efeddef934b2b8bc8632594903085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:48.635463  1069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2eae4c387445f39a059befe390fe45" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:48.635739  1184 leader_election.cc:304] T c36d0201599a49169424a6b75f5349f2 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 937efeddef934b2b8bc8632594903085; no voters: aa098a557d34433896712068efd0d9a8
I20260709 12:26:48.636376  1069 raft_consensus.cc:2468] T 0e2eae4c387445f39a059befe390fe45 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 0.
I20260709 12:26:48.634672  1651 leader_election.cc:290] T 0e2eae4c387445f39a059befe390fe45 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:48.636948  1582 raft_consensus.cc:2804] T c36d0201599a49169424a6b75f5349f2 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:26:48.637135  1112 leader_election.cc:343] T 040ea9f986ee4ed29b941698c802c501 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:48.535424  1266 consensus_queue.cc:260] T c36d0201599a49169424a6b75f5349f2 P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:48.640307   995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97b34e374ed4aec812cc43e2a5f07de" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
I20260709 12:26:48.640439  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "040ea9f986ee4ed29b941698c802c501" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085"
I20260709 12:26:48.643256   997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec806598903e4f88a40176e07ca4fad0" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
I20260709 12:26:48.644371   961 leader_election.cc:304] T 329e639d23154fb6bd4ccdf095dbd0e0 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa098a557d34433896712068efd0d9a8; no voters: 7f9cbe40e40d429aa004e4a7fb42f132, 937efeddef934b2b8bc8632594903085
I20260709 12:26:48.646531  1110 leader_election.cc:304] T 0e2eae4c387445f39a059befe390fe45 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 8fa35514a8d84740b1b46ae496307f20; no voters: 
I20260709 12:26:48.647397  1267 ts_tablet_manager.cc:1434] T f84cb753a9bd4fdd91824bb2d5050621 P 8fa35514a8d84740b1b46ae496307f20: Time spent starting tablet: real 0.044s	user 0.009s	sys 0.001s
I20260709 12:26:48.647541  1264 ts_tablet_manager.cc:1434] T ac8f3ce8c750468c966a23ea2787b888 P 937efeddef934b2b8bc8632594903085: Time spent starting tablet: real 0.155s	user 0.006s	sys 0.001s
I20260709 12:26:48.652652  1651 raft_consensus.cc:2804] T 0e2eae4c387445f39a059befe390fe45 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:48.653124  1651 raft_consensus.cc:493] T 0e2eae4c387445f39a059befe390fe45 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:48.653514  1651 raft_consensus.cc:3060] T 0e2eae4c387445f39a059befe390fe45 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.653728  1264 tablet_bootstrap.cc:492] T c97b34e374ed4aec812cc43e2a5f07de P 937efeddef934b2b8bc8632594903085: Bootstrap starting.
I20260709 12:26:48.654901  1145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec806598903e4f88a40176e07ca4fad0" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:48.658242  1266 ts_tablet_manager.cc:1434] T c36d0201599a49169424a6b75f5349f2 P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.179s	user 0.009s	sys 0.000s
I20260709 12:26:48.662421   996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "040ea9f986ee4ed29b941698c802c501" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8"
W20260709 12:26:48.661429  1038 leader_election.cc:343] T ec806598903e4f88a40176e07ca4fad0 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:48.663107  1612 raft_consensus.cc:2749] T 329e639d23154fb6bd4ccdf095dbd0e0 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:26:48.663628  1038 leader_election.cc:343] T ec806598903e4f88a40176e07ca4fad0 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:48.659161  1582 raft_consensus.cc:697] T c36d0201599a49169424a6b75f5349f2 P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Becoming Leader. State: Replica: 937efeddef934b2b8bc8632594903085, State: Running, Role: LEADER
I20260709 12:26:48.665226  1582 consensus_queue.cc:237] T c36d0201599a49169424a6b75f5349f2 P 937efeddef934b2b8bc8632594903085 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:48.664094  1038 leader_election.cc:304] T ec806598903e4f88a40176e07ca4fad0 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132; no voters: 8fa35514a8d84740b1b46ae496307f20, aa098a557d34433896712068efd0d9a8
I20260709 12:26:48.666692   996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2eae4c387445f39a059befe390fe45" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
I20260709 12:26:48.671764   894 catalog_manager.cc:5697] T 8c9afd5af68441ffa4c3f90cbd33d977 P 937efeddef934b2b8bc8632594903085 reported cstate change: term changed from 0 to 1, leader changed from <none> to 937efeddef934b2b8bc8632594903085 (127.23.245.132). New cstate: current_term: 1 leader_uuid: "937efeddef934b2b8bc8632594903085" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:48.679065  1266 tablet_bootstrap.cc:492] T 040ea9f986ee4ed29b941698c802c501 P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:48.673776  1557 raft_consensus.cc:2749] T ec806598903e4f88a40176e07ca4fad0 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:48.680054  1267 tablet_bootstrap.cc:492] T 8c9afd5af68441ffa4c3f90cbd33d977 P 8fa35514a8d84740b1b46ae496307f20: Bootstrap starting.
I20260709 12:26:48.690898  1508 raft_consensus.cc:515] T 040ea9f986ee4ed29b941698c802c501 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:48.693871  1265 tablet_bootstrap.cc:492] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P 7f9cbe40e40d429aa004e4a7fb42f132: No bootstrap required, opened a new log
I20260709 12:26:48.694272  1264 tablet_bootstrap.cc:654] T c97b34e374ed4aec812cc43e2a5f07de P 937efeddef934b2b8bc8632594903085: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.695015  1265 ts_tablet_manager.cc:1403] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent bootstrapping tablet: real 0.435s	user 0.013s	sys 0.016s
W20260709 12:26:48.679701  1112 leader_election.cc:343] T c97b34e374ed4aec812cc43e2a5f07de P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:48.703116  1220 raft_consensus.cc:2393] T 040ea9f986ee4ed29b941698c802c501 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8fa35514a8d84740b1b46ae496307f20 in current term 1: Already voted for candidate 937efeddef934b2b8bc8632594903085 in this term.
I20260709 12:26:48.716112  1112 leader_election.cc:304] T c97b34e374ed4aec812cc43e2a5f07de P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20; no voters: 937efeddef934b2b8bc8632594903085, aa098a557d34433896712068efd0d9a8
I20260709 12:26:48.717012  1362 raft_consensus.cc:2749] T c97b34e374ed4aec812cc43e2a5f07de P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:26:48.719841  1112 leader_election.cc:343] T 040ea9f986ee4ed29b941698c802c501 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:48.720367  1112 leader_election.cc:304] T 040ea9f986ee4ed29b941698c802c501 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20; no voters: 937efeddef934b2b8bc8632594903085, aa098a557d34433896712068efd0d9a8
I20260709 12:26:48.721145  1362 raft_consensus.cc:2749] T 040ea9f986ee4ed29b941698c802c501 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:26:48.725167  1112 leader_election.cc:343] T 0e2eae4c387445f39a059befe390fe45 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:48.727876  1651 raft_consensus.cc:515] T 0e2eae4c387445f39a059befe390fe45 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:48.729974  1651 leader_election.cc:290] T 0e2eae4c387445f39a059befe390fe45 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 election: Requested vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:48.731098  1267 tablet_bootstrap.cc:654] T 8c9afd5af68441ffa4c3f90cbd33d977 P 8fa35514a8d84740b1b46ae496307f20: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.731151  1067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2eae4c387445f39a059befe390fe45" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
I20260709 12:26:48.731950  1067 raft_consensus.cc:3060] T 0e2eae4c387445f39a059befe390fe45 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.735345  1266 tablet_bootstrap.cc:654] T 040ea9f986ee4ed29b941698c802c501 P aa098a557d34433896712068efd0d9a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.737982  1145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "040ea9f986ee4ed29b941698c802c501" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20"
I20260709 12:26:48.759613  1145 raft_consensus.cc:2393] T 040ea9f986ee4ed29b941698c802c501 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 937efeddef934b2b8bc8632594903085 in current term 1: Already voted for candidate 8fa35514a8d84740b1b46ae496307f20 in this term.
I20260709 12:26:48.748817  1524 consensus_queue.cc:1048] T 3d2ccd742ac442419de89cb38ee12d37 P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:48.753443  1067 raft_consensus.cc:2468] T 0e2eae4c387445f39a059befe390fe45 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 1.
I20260709 12:26:48.755570   996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2eae4c387445f39a059befe390fe45" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8"
I20260709 12:26:48.755165  1265 raft_consensus.cc:359] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:48.757895   995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "040ea9f986ee4ed29b941698c802c501" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8"
I20260709 12:26:48.763698  1110 leader_election.cc:304] T 0e2eae4c387445f39a059befe390fe45 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 8fa35514a8d84740b1b46ae496307f20; no voters: 
W20260709 12:26:48.764212  1186 leader_election.cc:343] T 040ea9f986ee4ed29b941698c802c501 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:48.764860  1186 leader_election.cc:304] T 040ea9f986ee4ed29b941698c802c501 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 937efeddef934b2b8bc8632594903085; no voters: 8fa35514a8d84740b1b46ae496307f20, aa098a557d34433896712068efd0d9a8
I20260709 12:26:48.758517  1508 leader_election.cc:290] T 040ea9f986ee4ed29b941698c802c501 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Requested vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:48.766285  1574 raft_consensus.cc:2749] T 040ea9f986ee4ed29b941698c802c501 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:26:48.766497  1265 raft_consensus.cc:385] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.766917  1265 raft_consensus.cc:740] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.768230  1265 consensus_queue.cc:260] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P 7f9cbe40e40d429aa004e4a7fb42f132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:48.771423  1265 ts_tablet_manager.cc:1434] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent starting tablet: real 0.076s	user 0.005s	sys 0.000s
I20260709 12:26:48.772266  1651 raft_consensus.cc:2804] T 0e2eae4c387445f39a059befe390fe45 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:48.772441  1524 raft_consensus.cc:493] T f84cb753a9bd4fdd91824bb2d5050621 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.772908  1651 raft_consensus.cc:697] T 0e2eae4c387445f39a059befe390fe45 P 8fa35514a8d84740b1b46ae496307f20 [term 1 LEADER]: Becoming Leader. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Running, Role: LEADER
I20260709 12:26:48.773061  1524 raft_consensus.cc:515] T f84cb753a9bd4fdd91824bb2d5050621 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:48.773927  1651 consensus_queue.cc:237] T 0e2eae4c387445f39a059befe390fe45 P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:48.775424  1524 leader_election.cc:290] T f84cb753a9bd4fdd91824bb2d5050621 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:26:48.776121  1362 consensus_queue.cc:1048] T 3d2ccd742ac442419de89cb38ee12d37 P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:48.777884  1067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84cb753a9bd4fdd91824bb2d5050621" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:48.778674  1067 raft_consensus.cc:2468] T f84cb753a9bd4fdd91824bb2d5050621 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 0.
I20260709 12:26:48.778520  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84cb753a9bd4fdd91824bb2d5050621" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
W20260709 12:26:48.780930  1109 leader_election.cc:343] T f84cb753a9bd4fdd91824bb2d5050621 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:48.784657   890 catalog_manager.cc:5697] T c36d0201599a49169424a6b75f5349f2 P 937efeddef934b2b8bc8632594903085 reported cstate change: term changed from 0 to 1, leader changed from <none> to 937efeddef934b2b8bc8632594903085 (127.23.245.132). New cstate: current_term: 1 leader_uuid: "937efeddef934b2b8bc8632594903085" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:48.772616  1265 tablet_bootstrap.cc:492] T a943f9cb8fef49e6a38b910ff1bb9076 P 7f9cbe40e40d429aa004e4a7fb42f132: Bootstrap starting.
I20260709 12:26:48.790936  1264 tablet_bootstrap.cc:492] T c97b34e374ed4aec812cc43e2a5f07de P 937efeddef934b2b8bc8632594903085: No bootstrap required, opened a new log
I20260709 12:26:48.792125  1264 ts_tablet_manager.cc:1403] T c97b34e374ed4aec812cc43e2a5f07de P 937efeddef934b2b8bc8632594903085: Time spent bootstrapping tablet: real 0.139s	user 0.014s	sys 0.001s
I20260709 12:26:48.794698  1264 raft_consensus.cc:359] T c97b34e374ed4aec812cc43e2a5f07de P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:48.795250  1264 raft_consensus.cc:385] T c97b34e374ed4aec812cc43e2a5f07de P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.795414  1264 raft_consensus.cc:740] T c97b34e374ed4aec812cc43e2a5f07de P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 937efeddef934b2b8bc8632594903085, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.791558  1110 leader_election.cc:304] T f84cb753a9bd4fdd91824bb2d5050621 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 8fa35514a8d84740b1b46ae496307f20; no voters: 937efeddef934b2b8bc8632594903085
I20260709 12:26:48.795979  1264 consensus_queue.cc:260] T c97b34e374ed4aec812cc43e2a5f07de P 937efeddef934b2b8bc8632594903085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:48.797968  1586 raft_consensus.cc:2804] T f84cb753a9bd4fdd91824bb2d5050621 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:48.788813  1267 tablet_bootstrap.cc:492] T 8c9afd5af68441ffa4c3f90cbd33d977 P 8fa35514a8d84740b1b46ae496307f20: No bootstrap required, opened a new log
I20260709 12:26:48.798511  1586 raft_consensus.cc:493] T f84cb753a9bd4fdd91824bb2d5050621 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:48.799113  1586 raft_consensus.cc:3060] T f84cb753a9bd4fdd91824bb2d5050621 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.799253  1267 ts_tablet_manager.cc:1403] T 8c9afd5af68441ffa4c3f90cbd33d977 P 8fa35514a8d84740b1b46ae496307f20: Time spent bootstrapping tablet: real 0.138s	user 0.025s	sys 0.026s
I20260709 12:26:48.799392  1264 ts_tablet_manager.cc:1434] T c97b34e374ed4aec812cc43e2a5f07de P 937efeddef934b2b8bc8632594903085: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:26:48.800716  1264 tablet_bootstrap.cc:492] T f84cb753a9bd4fdd91824bb2d5050621 P 937efeddef934b2b8bc8632594903085: Bootstrap starting.
I20260709 12:26:48.802014  1649 raft_consensus.cc:493] T c36d0201599a49169424a6b75f5349f2 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.802482  1649 raft_consensus.cc:515] T c36d0201599a49169424a6b75f5349f2 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:48.803171  1267 raft_consensus.cc:359] T 8c9afd5af68441ffa4c3f90cbd33d977 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:48.803962  1267 raft_consensus.cc:385] T 8c9afd5af68441ffa4c3f90cbd33d977 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.805321  1267 raft_consensus.cc:740] T 8c9afd5af68441ffa4c3f90cbd33d977 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.804633  1649 leader_election.cc:290] T c36d0201599a49169424a6b75f5349f2 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:48.805774  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0201599a49169424a6b75f5349f2" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:48.806252  1267 consensus_queue.cc:260] T 8c9afd5af68441ffa4c3f90cbd33d977 P 8fa35514a8d84740b1b46ae496307f20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:48.808338  1267 ts_tablet_manager.cc:1434] T 8c9afd5af68441ffa4c3f90cbd33d977 P 8fa35514a8d84740b1b46ae496307f20: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:26:48.803196  1265 tablet_bootstrap.cc:654] T a943f9cb8fef49e6a38b910ff1bb9076 P 7f9cbe40e40d429aa004e4a7fb42f132: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.808619  1067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0201599a49169424a6b75f5349f2" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:48.809425  1267 tablet_bootstrap.cc:492] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 8fa35514a8d84740b1b46ae496307f20: Bootstrap starting.
I20260709 12:26:48.809581  1067 raft_consensus.cc:2393] T c36d0201599a49169424a6b75f5349f2 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aa098a557d34433896712068efd0d9a8 in current term 1: Already voted for candidate 937efeddef934b2b8bc8632594903085 in this term.
I20260709 12:26:48.808629  1266 tablet_bootstrap.cc:492] T 040ea9f986ee4ed29b941698c802c501 P aa098a557d34433896712068efd0d9a8: No bootstrap required, opened a new log
I20260709 12:26:48.811142   961 leader_election.cc:304] T c36d0201599a49169424a6b75f5349f2 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa098a557d34433896712068efd0d9a8; no voters: 7f9cbe40e40d429aa004e4a7fb42f132, 937efeddef934b2b8bc8632594903085
I20260709 12:26:48.812018  1649 raft_consensus.cc:3060] T c36d0201599a49169424a6b75f5349f2 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.812626  1266 ts_tablet_manager.cc:1403] T 040ea9f986ee4ed29b941698c802c501 P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.139s	user 0.005s	sys 0.018s
I20260709 12:26:48.815896  1267 tablet_bootstrap.cc:654] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 8fa35514a8d84740b1b46ae496307f20: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.815662  1266 raft_consensus.cc:359] T 040ea9f986ee4ed29b941698c802c501 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:48.816416  1266 raft_consensus.cc:385] T 040ea9f986ee4ed29b941698c802c501 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.816732  1266 raft_consensus.cc:740] T 040ea9f986ee4ed29b941698c802c501 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.817512  1266 consensus_queue.cc:260] T 040ea9f986ee4ed29b941698c802c501 P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:48.819140  1266 ts_tablet_manager.cc:1434] T 040ea9f986ee4ed29b941698c802c501 P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:26:48.820214  1266 tablet_bootstrap.cc:492] T 0e2eae4c387445f39a059befe390fe45 P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:48.829705  1586 raft_consensus.cc:515] T f84cb753a9bd4fdd91824bb2d5050621 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:48.851141  1266 tablet_bootstrap.cc:654] T 0e2eae4c387445f39a059befe390fe45 P aa098a557d34433896712068efd0d9a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.852063  1067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84cb753a9bd4fdd91824bb2d5050621" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
I20260709 12:26:48.852936  1067 raft_consensus.cc:3060] T f84cb753a9bd4fdd91824bb2d5050621 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.854938  1265 tablet_bootstrap.cc:492] T a943f9cb8fef49e6a38b910ff1bb9076 P 7f9cbe40e40d429aa004e4a7fb42f132: No bootstrap required, opened a new log
I20260709 12:26:48.855522  1265 ts_tablet_manager.cc:1403] T a943f9cb8fef49e6a38b910ff1bb9076 P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent bootstrapping tablet: real 0.083s	user 0.012s	sys 0.001s
I20260709 12:26:48.856787   894 catalog_manager.cc:5697] T 0e2eae4c387445f39a059befe390fe45 P 8fa35514a8d84740b1b46ae496307f20 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131). New cstate: current_term: 1 leader_uuid: "8fa35514a8d84740b1b46ae496307f20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:48.858467  1265 raft_consensus.cc:359] T a943f9cb8fef49e6a38b910ff1bb9076 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:48.859238  1265 raft_consensus.cc:385] T a943f9cb8fef49e6a38b910ff1bb9076 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.859535  1265 raft_consensus.cc:740] T a943f9cb8fef49e6a38b910ff1bb9076 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.861272  1265 consensus_queue.cc:260] T a943f9cb8fef49e6a38b910ff1bb9076 P 7f9cbe40e40d429aa004e4a7fb42f132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:48.861766   995 raft_consensus.cc:3060] T 329e639d23154fb6bd4ccdf095dbd0e0 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.863826  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84cb753a9bd4fdd91824bb2d5050621" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085"
W20260709 12:26:48.865355  1109 leader_election.cc:343] T f84cb753a9bd4fdd91824bb2d5050621 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:48.865969  1586 leader_election.cc:290] T f84cb753a9bd4fdd91824bb2d5050621 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 election: Requested vote from peers 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:26:48.872016  1265 ts_tablet_manager.cc:1434] T a943f9cb8fef49e6a38b910ff1bb9076 P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:26:48.873241  1265 tablet_bootstrap.cc:492] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 7f9cbe40e40d429aa004e4a7fb42f132: Bootstrap starting.
I20260709 12:26:48.875852  1582 raft_consensus.cc:493] T ac8f3ce8c750468c966a23ea2787b888 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.876382  1582 raft_consensus.cc:515] T ac8f3ce8c750468c966a23ea2787b888 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:48.879016   996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac8f3ce8c750468c966a23ea2787b888" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
W20260709 12:26:48.880573  1186 leader_election.cc:343] T ac8f3ce8c750468c966a23ea2787b888 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:48.881505  1582 leader_election.cc:290] T ac8f3ce8c750468c966a23ea2787b888 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:48.882603  1070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac8f3ce8c750468c966a23ea2787b888" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:48.883496  1070 raft_consensus.cc:2468] T ac8f3ce8c750468c966a23ea2787b888 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 0.
I20260709 12:26:48.884203  1265 tablet_bootstrap.cc:654] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 7f9cbe40e40d429aa004e4a7fb42f132: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.884920  1184 leader_election.cc:304] T ac8f3ce8c750468c966a23ea2787b888 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 937efeddef934b2b8bc8632594903085; no voters: aa098a557d34433896712068efd0d9a8
I20260709 12:26:48.890101  1582 raft_consensus.cc:2804] T ac8f3ce8c750468c966a23ea2787b888 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:48.893361  1266 tablet_bootstrap.cc:492] T 0e2eae4c387445f39a059befe390fe45 P aa098a557d34433896712068efd0d9a8: No bootstrap required, opened a new log
I20260709 12:26:48.895818  1582 raft_consensus.cc:493] T ac8f3ce8c750468c966a23ea2787b888 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:48.896035  1266 ts_tablet_manager.cc:1403] T 0e2eae4c387445f39a059befe390fe45 P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.076s	user 0.015s	sys 0.000s
I20260709 12:26:48.896414  1582 raft_consensus.cc:3060] T ac8f3ce8c750468c966a23ea2787b888 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.899947  1266 raft_consensus.cc:359] T 0e2eae4c387445f39a059befe390fe45 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:48.900641  1266 raft_consensus.cc:385] T 0e2eae4c387445f39a059befe390fe45 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.900913  1266 raft_consensus.cc:740] T 0e2eae4c387445f39a059befe390fe45 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.901677  1266 consensus_queue.cc:260] T 0e2eae4c387445f39a059befe390fe45 P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:48.907390  1582 raft_consensus.cc:515] T ac8f3ce8c750468c966a23ea2787b888 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
W20260709 12:26:48.911396  1112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:32981, user_credentials={real_user=slave}} blocked reactor thread for 150634us
W20260709 12:26:48.912985  1112 leader_election.cc:343] T 0e2eae4c387445f39a059befe390fe45 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:48.915980  1068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac8f3ce8c750468c966a23ea2787b888" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
I20260709 12:26:48.916663  1068 raft_consensus.cc:3060] T ac8f3ce8c750468c966a23ea2787b888 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.923957   992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac8f3ce8c750468c966a23ea2787b888" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8"
W20260709 12:26:48.925855  1186 leader_election.cc:343] T ac8f3ce8c750468c966a23ea2787b888 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:48.903766  1266 ts_tablet_manager.cc:1434] T 0e2eae4c387445f39a059befe390fe45 P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:26:48.929692  1266 tablet_bootstrap.cc:492] T c97b34e374ed4aec812cc43e2a5f07de P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:48.932767  1557 raft_consensus.cc:493] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.934211  1557 raft_consensus.cc:515] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:48.940436  1649 raft_consensus.cc:2749] T c36d0201599a49169424a6b75f5349f2 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:48.941663   997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb44e6d7d92f49eb9758d5a5f6ce50b6" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
I20260709 12:26:48.942394  1557 leader_election.cc:290] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341)
I20260709 12:26:48.957298  1264 tablet_bootstrap.cc:654] T f84cb753a9bd4fdd91824bb2d5050621 P 937efeddef934b2b8bc8632594903085: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.957895  1145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb44e6d7d92f49eb9758d5a5f6ce50b6" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:48.963274  1265 tablet_bootstrap.cc:492] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 7f9cbe40e40d429aa004e4a7fb42f132: No bootstrap required, opened a new log
I20260709 12:26:48.963819  1265 ts_tablet_manager.cc:1403] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent bootstrapping tablet: real 0.091s	user 0.021s	sys 0.005s
I20260709 12:26:48.966575  1265 raft_consensus.cc:359] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:48.967284  1265 raft_consensus.cc:385] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.967563  1265 raft_consensus.cc:740] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.971596  1145 raft_consensus.cc:3060] T 8c9afd5af68441ffa4c3f90cbd33d977 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:48.971769  1264 tablet_bootstrap.cc:492] T f84cb753a9bd4fdd91824bb2d5050621 P 937efeddef934b2b8bc8632594903085: No bootstrap required, opened a new log
I20260709 12:26:48.972942  1264 ts_tablet_manager.cc:1403] T f84cb753a9bd4fdd91824bb2d5050621 P 937efeddef934b2b8bc8632594903085: Time spent bootstrapping tablet: real 0.172s	user 0.012s	sys 0.000s
I20260709 12:26:48.975339  1267 tablet_bootstrap.cc:492] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 8fa35514a8d84740b1b46ae496307f20: No bootstrap required, opened a new log
I20260709 12:26:48.976003  1267 ts_tablet_manager.cc:1403] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 8fa35514a8d84740b1b46ae496307f20: Time spent bootstrapping tablet: real 0.167s	user 0.040s	sys 0.029s
I20260709 12:26:48.980309  1264 raft_consensus.cc:359] T f84cb753a9bd4fdd91824bb2d5050621 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:48.981470  1264 raft_consensus.cc:385] T f84cb753a9bd4fdd91824bb2d5050621 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.981756  1264 raft_consensus.cc:740] T f84cb753a9bd4fdd91824bb2d5050621 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 937efeddef934b2b8bc8632594903085, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.982400  1264 consensus_queue.cc:260] T f84cb753a9bd4fdd91824bb2d5050621 P 937efeddef934b2b8bc8632594903085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:48.946772  1582 leader_election.cc:290] T ac8f3ce8c750468c966a23ea2787b888 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Requested vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:48.947219  1067 raft_consensus.cc:2468] T f84cb753a9bd4fdd91824bb2d5050621 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 1.
I20260709 12:26:48.980249  1265 consensus_queue.cc:260] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 7f9cbe40e40d429aa004e4a7fb42f132 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:48.984917  1264 ts_tablet_manager.cc:1434] T f84cb753a9bd4fdd91824bb2d5050621 P 937efeddef934b2b8bc8632594903085: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:26:48.981484  1267 raft_consensus.cc:359] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:48.991287  1267 raft_consensus.cc:385] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:48.991537  1264 tablet_bootstrap.cc:492] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 937efeddef934b2b8bc8632594903085: Bootstrap starting.
I20260709 12:26:48.991632  1267 raft_consensus.cc:740] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Initialized, Role: FOLLOWER
I20260709 12:26:48.992479  1267 consensus_queue.cc:260] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 8fa35514a8d84740b1b46ae496307f20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:48.946549  1266 tablet_bootstrap.cc:654] T c97b34e374ed4aec812cc43e2a5f07de P aa098a557d34433896712068efd0d9a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.995060  1267 ts_tablet_manager.cc:1434] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 8fa35514a8d84740b1b46ae496307f20: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:26:48.996555  1110 leader_election.cc:304] T f84cb753a9bd4fdd91824bb2d5050621 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 8fa35514a8d84740b1b46ae496307f20; no voters: 937efeddef934b2b8bc8632594903085
I20260709 12:26:48.996887  1265 ts_tablet_manager.cc:1434] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 7f9cbe40e40d429aa004e4a7fb42f132: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 12:26:48.997607  1362 raft_consensus.cc:2804] T f84cb753a9bd4fdd91824bb2d5050621 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:48.998065  1362 raft_consensus.cc:697] T f84cb753a9bd4fdd91824bb2d5050621 P 8fa35514a8d84740b1b46ae496307f20 [term 1 LEADER]: Becoming Leader. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Running, Role: LEADER
I20260709 12:26:48.998805  1362 consensus_queue.cc:237] T f84cb753a9bd4fdd91824bb2d5050621 P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:49.003374  1264 tablet_bootstrap.cc:654] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 937efeddef934b2b8bc8632594903085: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:48.995080  1068 raft_consensus.cc:2468] T ac8f3ce8c750468c966a23ea2787b888 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 1.
I20260709 12:26:49.008282  1184 leader_election.cc:304] T ac8f3ce8c750468c966a23ea2787b888 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 937efeddef934b2b8bc8632594903085; no voters: aa098a557d34433896712068efd0d9a8
I20260709 12:26:49.009572  1574 raft_consensus.cc:2804] T ac8f3ce8c750468c966a23ea2787b888 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:49.010372  1574 raft_consensus.cc:697] T ac8f3ce8c750468c966a23ea2787b888 P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Becoming Leader. State: Replica: 937efeddef934b2b8bc8632594903085, State: Running, Role: LEADER
W20260709 12:26:49.014371  1038 leader_election.cc:343] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:49.015666  1038 leader_election.cc:343] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:49.016222  1038 leader_election.cc:304] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132; no voters: 8fa35514a8d84740b1b46ae496307f20, aa098a557d34433896712068efd0d9a8
I20260709 12:26:49.011243  1574 consensus_queue.cc:237] T ac8f3ce8c750468c966a23ea2787b888 P 937efeddef934b2b8bc8632594903085 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:49.020068  1524 raft_consensus.cc:493] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.020675  1524 raft_consensus.cc:515] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:49.024694  1508 raft_consensus.cc:493] T c97b34e374ed4aec812cc43e2a5f07de P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.024940  1524 leader_election.cc:290] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:26:49.025484  1508 raft_consensus.cc:515] T c97b34e374ed4aec812cc43e2a5f07de P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:49.028126  1508 leader_election.cc:290] T c97b34e374ed4aec812cc43e2a5f07de P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:49.028193  1557 raft_consensus.cc:2749] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:49.028985  1067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2d9d3061d24ab1aac189e9a8b0a12d" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:49.029929  1067 raft_consensus.cc:2468] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 0.
I20260709 12:26:49.031247  1110 leader_election.cc:304] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 8fa35514a8d84740b1b46ae496307f20; no voters: 
I20260709 12:26:49.032150  1524 raft_consensus.cc:2804] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:49.033759   995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97b34e374ed4aec812cc43e2a5f07de" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
I20260709 12:26:49.034942  1524 raft_consensus.cc:493] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:49.037988  1524 raft_consensus.cc:3060] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:49.042052  1618 consensus_queue.cc:1048] T 8c9afd5af68441ffa4c3f90cbd33d977 P 937efeddef934b2b8bc8632594903085 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:49.036435  1219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2d9d3061d24ab1aac189e9a8b0a12d" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
W20260709 12:26:49.046729  1109 leader_election.cc:343] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:49.051326  1524 raft_consensus.cc:515] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
W20260709 12:26:49.055415  1186 leader_election.cc:343] T c97b34e374ed4aec812cc43e2a5f07de P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:49.059475  1146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97b34e374ed4aec812cc43e2a5f07de" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:49.060420  1146 raft_consensus.cc:2468] T c97b34e374ed4aec812cc43e2a5f07de P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 0.
I20260709 12:26:49.060629  1524 leader_election.cc:290] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 election: Requested vote from peers 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:26:49.071380  1264 tablet_bootstrap.cc:492] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 937efeddef934b2b8bc8632594903085: No bootstrap required, opened a new log
I20260709 12:26:49.072115  1264 ts_tablet_manager.cc:1403] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 937efeddef934b2b8bc8632594903085: Time spent bootstrapping tablet: real 0.081s	user 0.016s	sys 0.005s
I20260709 12:26:49.073586  1067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2d9d3061d24ab1aac189e9a8b0a12d" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
I20260709 12:26:49.074523  1067 raft_consensus.cc:3060] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:49.075659  1264 raft_consensus.cc:359] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:49.076762  1264 raft_consensus.cc:385] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:49.077061  1264 raft_consensus.cc:740] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 937efeddef934b2b8bc8632594903085, State: Initialized, Role: FOLLOWER
I20260709 12:26:49.077912  1264 consensus_queue.cc:260] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 937efeddef934b2b8bc8632594903085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:49.080797  1264 ts_tablet_manager.cc:1434] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 937efeddef934b2b8bc8632594903085: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:26:49.081924  1264 tablet_bootstrap.cc:492] T a943f9cb8fef49e6a38b910ff1bb9076 P 937efeddef934b2b8bc8632594903085: Bootstrap starting.
I20260709 12:26:49.071528   894 catalog_manager.cc:5697] T ac8f3ce8c750468c966a23ea2787b888 P 937efeddef934b2b8bc8632594903085 reported cstate change: term changed from 0 to 1, leader changed from <none> to 937efeddef934b2b8bc8632594903085 (127.23.245.132). New cstate: current_term: 1 leader_uuid: "937efeddef934b2b8bc8632594903085" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:49.087595  1186 leader_election.cc:304] T c97b34e374ed4aec812cc43e2a5f07de P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085; no voters: aa098a557d34433896712068efd0d9a8
I20260709 12:26:49.088559  1582 raft_consensus.cc:2804] T c97b34e374ed4aec812cc43e2a5f07de P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:49.088963  1582 raft_consensus.cc:493] T c97b34e374ed4aec812cc43e2a5f07de P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:49.089313  1582 raft_consensus.cc:3060] T c97b34e374ed4aec812cc43e2a5f07de P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:49.097107  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2d9d3061d24ab1aac189e9a8b0a12d" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085"
I20260709 12:26:49.098258  1220 raft_consensus.cc:3060] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:49.108271  1582 raft_consensus.cc:515] T c97b34e374ed4aec812cc43e2a5f07de P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:49.110502  1582 leader_election.cc:290] T c97b34e374ed4aec812cc43e2a5f07de P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Requested vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:49.111516   997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97b34e374ed4aec812cc43e2a5f07de" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8"
I20260709 12:26:49.112063  1264 tablet_bootstrap.cc:654] T a943f9cb8fef49e6a38b910ff1bb9076 P 937efeddef934b2b8bc8632594903085: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:49.112792  1186 leader_election.cc:343] T c97b34e374ed4aec812cc43e2a5f07de P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:49.114818  1067 raft_consensus.cc:2468] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 1.
I20260709 12:26:49.116218  1110 leader_election.cc:304] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 8fa35514a8d84740b1b46ae496307f20; no voters: 
I20260709 12:26:49.117581  1524 raft_consensus.cc:2804] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:49.118629  1524 raft_consensus.cc:697] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 8fa35514a8d84740b1b46ae496307f20 [term 1 LEADER]: Becoming Leader. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Running, Role: LEADER
I20260709 12:26:49.118768  1143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97b34e374ed4aec812cc43e2a5f07de" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20"
I20260709 12:26:49.119410  1143 raft_consensus.cc:3060] T c97b34e374ed4aec812cc43e2a5f07de P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:49.119554  1524 consensus_queue.cc:237] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:49.121112  1649 raft_consensus.cc:493] T 040ea9f986ee4ed29b941698c802c501 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.121629  1649 raft_consensus.cc:515] T 040ea9f986ee4ed29b941698c802c501 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:49.123654  1649 leader_election.cc:290] T 040ea9f986ee4ed29b941698c802c501 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:26:49.124643  1219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "040ea9f986ee4ed29b941698c802c501" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:49.125487  1219 raft_consensus.cc:2393] T 040ea9f986ee4ed29b941698c802c501 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aa098a557d34433896712068efd0d9a8 in current term 1: Already voted for candidate 937efeddef934b2b8bc8632594903085 in this term.
I20260709 12:26:49.125816  1144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "040ea9f986ee4ed29b941698c802c501" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:49.126837  1144 raft_consensus.cc:2393] T 040ea9f986ee4ed29b941698c802c501 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aa098a557d34433896712068efd0d9a8 in current term 1: Already voted for candidate 8fa35514a8d84740b1b46ae496307f20 in this term.
I20260709 12:26:49.128068   963 leader_election.cc:304] T 040ea9f986ee4ed29b941698c802c501 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa098a557d34433896712068efd0d9a8; no voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085
I20260709 12:26:49.129204  1649 raft_consensus.cc:3060] T 040ea9f986ee4ed29b941698c802c501 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:49.136670  1267 tablet_bootstrap.cc:492] T ec806598903e4f88a40176e07ca4fad0 P 8fa35514a8d84740b1b46ae496307f20: Bootstrap starting.
I20260709 12:26:49.138438  1264 tablet_bootstrap.cc:492] T a943f9cb8fef49e6a38b910ff1bb9076 P 937efeddef934b2b8bc8632594903085: No bootstrap required, opened a new log
I20260709 12:26:49.126799  1557 raft_consensus.cc:493] T a943f9cb8fef49e6a38b910ff1bb9076 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.139089  1264 ts_tablet_manager.cc:1403] T a943f9cb8fef49e6a38b910ff1bb9076 P 937efeddef934b2b8bc8632594903085: Time spent bootstrapping tablet: real 0.057s	user 0.008s	sys 0.009s
I20260709 12:26:49.142416  1264 raft_consensus.cc:359] T a943f9cb8fef49e6a38b910ff1bb9076 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:49.143316  1264 raft_consensus.cc:385] T a943f9cb8fef49e6a38b910ff1bb9076 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:49.143666  1264 raft_consensus.cc:740] T a943f9cb8fef49e6a38b910ff1bb9076 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 937efeddef934b2b8bc8632594903085, State: Initialized, Role: FOLLOWER
I20260709 12:26:49.144678  1264 consensus_queue.cc:260] T a943f9cb8fef49e6a38b910ff1bb9076 P 937efeddef934b2b8bc8632594903085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:49.145148  1649 raft_consensus.cc:2749] T 040ea9f986ee4ed29b941698c802c501 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:49.139133  1557 raft_consensus.cc:515] T a943f9cb8fef49e6a38b910ff1bb9076 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:49.148691  1557 leader_election.cc:290] T a943f9cb8fef49e6a38b910ff1bb9076 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:49.149480  1219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a943f9cb8fef49e6a38b910ff1bb9076" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:49.150267  1219 raft_consensus.cc:2468] T a943f9cb8fef49e6a38b910ff1bb9076 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f9cbe40e40d429aa004e4a7fb42f132 in term 0.
I20260709 12:26:49.151448  1035 leader_election.cc:304] T a943f9cb8fef49e6a38b910ff1bb9076 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 937efeddef934b2b8bc8632594903085; no voters: 
I20260709 12:26:49.152488  1557 raft_consensus.cc:2804] T a943f9cb8fef49e6a38b910ff1bb9076 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:49.152869  1557 raft_consensus.cc:493] T a943f9cb8fef49e6a38b910ff1bb9076 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:49.153208  1557 raft_consensus.cc:3060] T a943f9cb8fef49e6a38b910ff1bb9076 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:49.153859  1264 ts_tablet_manager.cc:1434] T a943f9cb8fef49e6a38b910ff1bb9076 P 937efeddef934b2b8bc8632594903085: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.004s
I20260709 12:26:49.155067  1264 tablet_bootstrap.cc:492] T 0c434afb0b164ab5b38dea54bfcebfe8 P 937efeddef934b2b8bc8632594903085: Bootstrap starting.
I20260709 12:26:49.158272   997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a943f9cb8fef49e6a38b910ff1bb9076" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
W20260709 12:26:49.161895  1038 leader_election.cc:343] T a943f9cb8fef49e6a38b910ff1bb9076 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:49.163043  1582 consensus_queue.cc:1048] T 8c9afd5af68441ffa4c3f90cbd33d977 P 937efeddef934b2b8bc8632594903085 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:49.131809  1143 raft_consensus.cc:2468] T c97b34e374ed4aec812cc43e2a5f07de P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 1.
I20260709 12:26:49.161052  1557 raft_consensus.cc:515] T a943f9cb8fef49e6a38b910ff1bb9076 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:49.174304  1219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a943f9cb8fef49e6a38b910ff1bb9076" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085"
I20260709 12:26:49.174515  1557 leader_election.cc:290] T a943f9cb8fef49e6a38b910ff1bb9076 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 election: Requested vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:49.174949  1219 raft_consensus.cc:3060] T a943f9cb8fef49e6a38b910ff1bb9076 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:49.176077  1186 leader_election.cc:304] T c97b34e374ed4aec812cc43e2a5f07de P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085; no voters: aa098a557d34433896712068efd0d9a8
I20260709 12:26:49.178850   997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a943f9cb8fef49e6a38b910ff1bb9076" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8"
I20260709 12:26:49.178860  1582 raft_consensus.cc:2804] T c97b34e374ed4aec812cc43e2a5f07de P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:49.179862  1582 raft_consensus.cc:697] T c97b34e374ed4aec812cc43e2a5f07de P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Becoming Leader. State: Replica: 937efeddef934b2b8bc8632594903085, State: Running, Role: LEADER
W20260709 12:26:49.180423  1038 leader_election.cc:343] T a943f9cb8fef49e6a38b910ff1bb9076 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:49.180706  1582 consensus_queue.cc:237] T c97b34e374ed4aec812cc43e2a5f07de P 937efeddef934b2b8bc8632594903085 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:49.189918   894 catalog_manager.cc:5697] T f84cb753a9bd4fdd91824bb2d5050621 P 8fa35514a8d84740b1b46ae496307f20 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131). New cstate: current_term: 1 leader_uuid: "8fa35514a8d84740b1b46ae496307f20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:49.204648  1267 tablet_bootstrap.cc:654] T ec806598903e4f88a40176e07ca4fad0 P 8fa35514a8d84740b1b46ae496307f20: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:49.204672  1220 raft_consensus.cc:2468] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 1.
I20260709 12:26:49.205937  1219 raft_consensus.cc:2468] T a943f9cb8fef49e6a38b910ff1bb9076 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f9cbe40e40d429aa004e4a7fb42f132 in term 1.
I20260709 12:26:49.296275  1266 tablet_bootstrap.cc:492] T c97b34e374ed4aec812cc43e2a5f07de P aa098a557d34433896712068efd0d9a8: No bootstrap required, opened a new log
I20260709 12:26:49.305099  1266 ts_tablet_manager.cc:1403] T c97b34e374ed4aec812cc43e2a5f07de P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.378s	user 0.050s	sys 0.064s
I20260709 12:26:49.298426  1264 tablet_bootstrap.cc:700] T 0c434afb0b164ab5b38dea54bfcebfe8 P 937efeddef934b2b8bc8632594903085: Time spent opening tablet: real 0.124s	user 0.000s	sys 0.007s
I20260709 12:26:49.308984   997 raft_consensus.cc:3060] T 0e2eae4c387445f39a059befe390fe45 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:49.311982  1264 tablet_bootstrap.cc:654] T 0c434afb0b164ab5b38dea54bfcebfe8 P 937efeddef934b2b8bc8632594903085: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:49.313761  1035 leader_election.cc:304] T a943f9cb8fef49e6a38b910ff1bb9076 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 937efeddef934b2b8bc8632594903085; no voters: aa098a557d34433896712068efd0d9a8
I20260709 12:26:49.320431  1589 raft_consensus.cc:2804] T a943f9cb8fef49e6a38b910ff1bb9076 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:49.321033  1589 raft_consensus.cc:697] T a943f9cb8fef49e6a38b910ff1bb9076 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 LEADER]: Becoming Leader. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Running, Role: LEADER
I20260709 12:26:49.321906  1589 consensus_queue.cc:237] T a943f9cb8fef49e6a38b910ff1bb9076 P 7f9cbe40e40d429aa004e4a7fb42f132 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:49.332508  1362 consensus_queue.cc:1048] T 0e2eae4c387445f39a059befe390fe45 P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:49.357623  1266 raft_consensus.cc:359] T c97b34e374ed4aec812cc43e2a5f07de P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:49.358913  1266 raft_consensus.cc:385] T c97b34e374ed4aec812cc43e2a5f07de P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:49.359367  1266 raft_consensus.cc:740] T c97b34e374ed4aec812cc43e2a5f07de P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:49.360385  1266 consensus_queue.cc:260] T c97b34e374ed4aec812cc43e2a5f07de P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:49.388536  1264 tablet_bootstrap.cc:492] T 0c434afb0b164ab5b38dea54bfcebfe8 P 937efeddef934b2b8bc8632594903085: No bootstrap required, opened a new log
I20260709 12:26:49.388193  1586 consensus_queue.cc:1048] T 0e2eae4c387445f39a059befe390fe45 P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:49.389083  1264 ts_tablet_manager.cc:1403] T 0c434afb0b164ab5b38dea54bfcebfe8 P 937efeddef934b2b8bc8632594903085: Time spent bootstrapping tablet: real 0.234s	user 0.009s	sys 0.008s
I20260709 12:26:49.392338  1264 raft_consensus.cc:359] T 0c434afb0b164ab5b38dea54bfcebfe8 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:49.393054  1264 raft_consensus.cc:385] T 0c434afb0b164ab5b38dea54bfcebfe8 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:49.393370  1264 raft_consensus.cc:740] T 0c434afb0b164ab5b38dea54bfcebfe8 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 937efeddef934b2b8bc8632594903085, State: Initialized, Role: FOLLOWER
I20260709 12:26:49.394251  1264 consensus_queue.cc:260] T 0c434afb0b164ab5b38dea54bfcebfe8 P 937efeddef934b2b8bc8632594903085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:49.396566  1264 ts_tablet_manager.cc:1434] T 0c434afb0b164ab5b38dea54bfcebfe8 P 937efeddef934b2b8bc8632594903085: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:26:49.425570  1267 tablet_bootstrap.cc:492] T ec806598903e4f88a40176e07ca4fad0 P 8fa35514a8d84740b1b46ae496307f20: No bootstrap required, opened a new log
I20260709 12:26:49.426134  1267 ts_tablet_manager.cc:1403] T ec806598903e4f88a40176e07ca4fad0 P 8fa35514a8d84740b1b46ae496307f20: Time spent bootstrapping tablet: real 0.290s	user 0.030s	sys 0.024s
I20260709 12:26:49.429395  1264 tablet_bootstrap.cc:492] T 348d7f300dcb474b8b012e01d0af067f P 937efeddef934b2b8bc8632594903085: Bootstrap starting.
I20260709 12:26:49.454015  1267 raft_consensus.cc:359] T ec806598903e4f88a40176e07ca4fad0 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:49.455369  1267 raft_consensus.cc:385] T ec806598903e4f88a40176e07ca4fad0 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:49.456295  1267 raft_consensus.cc:740] T ec806598903e4f88a40176e07ca4fad0 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Initialized, Role: FOLLOWER
I20260709 12:26:49.459692  1266 ts_tablet_manager.cc:1434] T c97b34e374ed4aec812cc43e2a5f07de P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.154s	user 0.016s	sys 0.027s
I20260709 12:26:49.455513  1574 raft_consensus.cc:493] T f84cb753a9bd4fdd91824bb2d5050621 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.460742  1574 raft_consensus.cc:515] T f84cb753a9bd4fdd91824bb2d5050621 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:26:49.463068  1574 leader_election.cc:290] T f84cb753a9bd4fdd91824bb2d5050621 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679), 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341)
I20260709 12:26:49.457928  1267 consensus_queue.cc:260] T ec806598903e4f88a40176e07ca4fad0 P 8fa35514a8d84740b1b46ae496307f20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:49.470238  1264 tablet_bootstrap.cc:654] T 348d7f300dcb474b8b012e01d0af067f P 937efeddef934b2b8bc8632594903085: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:49.473780  1266 tablet_bootstrap.cc:492] T 348d7f300dcb474b8b012e01d0af067f P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:49.471639  1267 ts_tablet_manager.cc:1434] T ec806598903e4f88a40176e07ca4fad0 P 8fa35514a8d84740b1b46ae496307f20: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.000s
I20260709 12:26:49.533350   894 catalog_manager.cc:5697] T a943f9cb8fef49e6a38b910ff1bb9076 P 7f9cbe40e40d429aa004e4a7fb42f132 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130). New cstate: current_term: 1 leader_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:49.538231  1267 tablet_bootstrap.cc:492] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P 8fa35514a8d84740b1b46ae496307f20: Bootstrap starting.
I20260709 12:26:49.573776  1267 tablet_bootstrap.cc:654] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P 8fa35514a8d84740b1b46ae496307f20: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:49.574424  1110 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:43679, user_credentials={real_user=slave}} blocked reactor thread for 143911us
W20260709 12:26:49.628887  1186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:40341, user_credentials={real_user=slave}} blocked reactor thread for 186073us
I20260709 12:26:49.635783   895 catalog_manager.cc:5697] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 8fa35514a8d84740b1b46ae496307f20 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131). New cstate: current_term: 1 leader_uuid: "8fa35514a8d84740b1b46ae496307f20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:49.615211  1682 raft_consensus.cc:493] T 0e2eae4c387445f39a059befe390fe45 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8fa35514a8d84740b1b46ae496307f20)
W20260709 12:26:49.654477   943 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:49.659112  1266 tablet_bootstrap.cc:654] T 348d7f300dcb474b8b012e01d0af067f P aa098a557d34433896712068efd0d9a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:49.647418  1682 raft_consensus.cc:515] T 0e2eae4c387445f39a059befe390fe45 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:49.655145  1141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84cb753a9bd4fdd91824bb2d5050621" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
W20260709 12:26:49.741353  1186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:32981, user_credentials={real_user=slave}} blocked reactor thread for 101727us
I20260709 12:26:49.680650  1681 consensus_queue.cc:1048] T c36d0201599a49169424a6b75f5349f2 P 937efeddef934b2b8bc8632594903085 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.057s
W20260709 12:26:49.749351  1186 consensus_peers.cc:597] T ac8f3ce8c750468c966a23ea2787b888 P 937efeddef934b2b8bc8632594903085 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:49.761945  1694 raft_consensus.cc:493] T ec806598903e4f88a40176e07ca4fad0 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.762427  1694 raft_consensus.cc:515] T ec806598903e4f88a40176e07ca4fad0 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:49.766644  1682 leader_election.cc:290] T 0e2eae4c387445f39a059befe390fe45 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679), 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341)
I20260709 12:26:49.779947  1264 tablet_bootstrap.cc:492] T 348d7f300dcb474b8b012e01d0af067f P 937efeddef934b2b8bc8632594903085: No bootstrap required, opened a new log
I20260709 12:26:49.780540  1264 ts_tablet_manager.cc:1403] T 348d7f300dcb474b8b012e01d0af067f P 937efeddef934b2b8bc8632594903085: Time spent bootstrapping tablet: real 0.359s	user 0.017s	sys 0.010s
I20260709 12:26:49.783417  1264 raft_consensus.cc:359] T 348d7f300dcb474b8b012e01d0af067f P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:49.794525  1264 raft_consensus.cc:385] T 348d7f300dcb474b8b012e01d0af067f P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:49.785760  1066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2eae4c387445f39a059befe390fe45" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:49.786404  1681 consensus_queue.cc:1048] T c97b34e374ed4aec812cc43e2a5f07de P 937efeddef934b2b8bc8632594903085 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:49.791031  1694 leader_election.cc:290] T ec806598903e4f88a40176e07ca4fad0 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:49.784201   992 raft_consensus.cc:3060] T c97b34e374ed4aec812cc43e2a5f07de P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:49.795063  1264 raft_consensus.cc:740] T 348d7f300dcb474b8b012e01d0af067f P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 937efeddef934b2b8bc8632594903085, State: Initialized, Role: FOLLOWER
I20260709 12:26:49.799397  1508 consensus_queue.cc:1048] T c36d0201599a49169424a6b75f5349f2 P 937efeddef934b2b8bc8632594903085 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:49.802944   890 catalog_manager.cc:5697] T c97b34e374ed4aec812cc43e2a5f07de P 937efeddef934b2b8bc8632594903085 reported cstate change: term changed from 0 to 1, leader changed from <none> to 937efeddef934b2b8bc8632594903085 (127.23.245.132). New cstate: current_term: 1 leader_uuid: "937efeddef934b2b8bc8632594903085" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:49.827963  1112 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:32981, user_credentials={real_user=slave}} blocked reactor thread for 123862us
I20260709 12:26:49.843235  1264 consensus_queue.cc:260] T 348d7f300dcb474b8b012e01d0af067f P 937efeddef934b2b8bc8632594903085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:49.844521   997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec806598903e4f88a40176e07ca4fad0" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
I20260709 12:26:49.845940  1266 tablet_bootstrap.cc:492] T 348d7f300dcb474b8b012e01d0af067f P aa098a557d34433896712068efd0d9a8: No bootstrap required, opened a new log
I20260709 12:26:49.846585  1266 ts_tablet_manager.cc:1403] T 348d7f300dcb474b8b012e01d0af067f P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.373s	user 0.013s	sys 0.012s
I20260709 12:26:49.858093  1264 ts_tablet_manager.cc:1434] T 348d7f300dcb474b8b012e01d0af067f P 937efeddef934b2b8bc8632594903085: Time spent starting tablet: real 0.077s	user 0.007s	sys 0.000s
I20260709 12:26:49.861150  1264 tablet_bootstrap.cc:492] T de3dd28c345442b38f399c5db383c5b2 P 937efeddef934b2b8bc8632594903085: Bootstrap starting.
I20260709 12:26:49.863005  1267 tablet_bootstrap.cc:492] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P 8fa35514a8d84740b1b46ae496307f20: No bootstrap required, opened a new log
I20260709 12:26:49.863523  1267 ts_tablet_manager.cc:1403] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P 8fa35514a8d84740b1b46ae496307f20: Time spent bootstrapping tablet: real 0.326s	user 0.018s	sys 0.016s
I20260709 12:26:49.866757  1068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f84cb753a9bd4fdd91824bb2d5050621" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:49.867574  1068 raft_consensus.cc:2393] T f84cb753a9bd4fdd91824bb2d5050621 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 937efeddef934b2b8bc8632594903085 in current term 1: Already voted for candidate 8fa35514a8d84740b1b46ae496307f20 in this term.
I20260709 12:26:49.868000  1267 raft_consensus.cc:359] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:49.868703  1267 raft_consensus.cc:385] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:49.869421  1267 raft_consensus.cc:740] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Initialized, Role: FOLLOWER
I20260709 12:26:49.870056  1267 consensus_queue.cc:260] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P 8fa35514a8d84740b1b46ae496307f20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:49.873505  1264 tablet_bootstrap.cc:654] T de3dd28c345442b38f399c5db383c5b2 P 937efeddef934b2b8bc8632594903085: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:49.874007  1112 leader_election.cc:343] T ec806598903e4f88a40176e07ca4fad0 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:49.875147  1267 ts_tablet_manager.cc:1434] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P 8fa35514a8d84740b1b46ae496307f20: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:26:49.850299  1684 raft_consensus.cc:493] T 0c434afb0b164ab5b38dea54bfcebfe8 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.899869  1266 raft_consensus.cc:359] T 348d7f300dcb474b8b012e01d0af067f P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:49.901038  1266 raft_consensus.cc:385] T 348d7f300dcb474b8b012e01d0af067f P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:49.901407  1266 raft_consensus.cc:740] T 348d7f300dcb474b8b012e01d0af067f P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:49.903080  1267 tablet_bootstrap.cc:492] T de3dd28c345442b38f399c5db383c5b2 P 8fa35514a8d84740b1b46ae496307f20: Bootstrap starting.
I20260709 12:26:49.911851  1264 tablet_bootstrap.cc:492] T de3dd28c345442b38f399c5db383c5b2 P 937efeddef934b2b8bc8632594903085: No bootstrap required, opened a new log
I20260709 12:26:49.912415  1264 ts_tablet_manager.cc:1403] T de3dd28c345442b38f399c5db383c5b2 P 937efeddef934b2b8bc8632594903085: Time spent bootstrapping tablet: real 0.052s	user 0.016s	sys 0.007s
I20260709 12:26:49.906456  1146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2eae4c387445f39a059befe390fe45" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:49.896171  1696 consensus_queue.cc:1048] T a943f9cb8fef49e6a38b910ff1bb9076 P 7f9cbe40e40d429aa004e4a7fb42f132 [LEADER]: Connected to new peer: Peer: permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 12:26:49.904661  1684 raft_consensus.cc:515] T 0c434afb0b164ab5b38dea54bfcebfe8 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:49.919665   963 leader_election.cc:304] T 0e2eae4c387445f39a059befe390fe45 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa098a557d34433896712068efd0d9a8; no voters: 7f9cbe40e40d429aa004e4a7fb42f132, 8fa35514a8d84740b1b46ae496307f20
I20260709 12:26:49.963711  1220 raft_consensus.cc:3060] T f84cb753a9bd4fdd91824bb2d5050621 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:49.969062   963 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:40341, user_credentials={real_user=slave}} blocked reactor thread for 49518.1us
I20260709 12:26:49.976788  1266 consensus_queue.cc:260] T 348d7f300dcb474b8b012e01d0af067f P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:49.982375  1686 raft_consensus.cc:2749] T 0e2eae4c387445f39a059befe390fe45 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:49.955981  1184 leader_election.cc:304] T f84cb753a9bd4fdd91824bb2d5050621 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 937efeddef934b2b8bc8632594903085; no voters: 7f9cbe40e40d429aa004e4a7fb42f132, 8fa35514a8d84740b1b46ae496307f20
I20260709 12:26:49.985498  1692 raft_consensus.cc:2749] T f84cb753a9bd4fdd91824bb2d5050621 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:26:49.985661  1184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:43679, user_credentials={real_user=slave}} blocked reactor thread for 45925.8us
I20260709 12:26:49.996483  1684 leader_election.cc:290] T 0c434afb0b164ab5b38dea54bfcebfe8 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
W20260709 12:26:49.997906  1038 consensus_peers.cc:597] T a943f9cb8fef49e6a38b910ff1bb9076 P 7f9cbe40e40d429aa004e4a7fb42f132 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:49.998311  1708 log.cc:927] Time spent T c36d0201599a49169424a6b75f5349f2 P aa098a557d34433896712068efd0d9a8: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 12:26:49.998358  1038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:32981, user_credentials={real_user=slave}} blocked reactor thread for 92760.4us
I20260709 12:26:50.002554  1651 consensus_queue.cc:1048] T f84cb753a9bd4fdd91824bb2d5050621 P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:50.004079  1682 raft_consensus.cc:493] T c97b34e374ed4aec812cc43e2a5f07de P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.004588  1682 raft_consensus.cc:515] T c97b34e374ed4aec812cc43e2a5f07de P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:50.005391  1266 ts_tablet_manager.cc:1434] T 348d7f300dcb474b8b012e01d0af067f P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.158s	user 0.010s	sys 0.000s
I20260709 12:26:50.006152  1143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c434afb0b164ab5b38dea54bfcebfe8" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:50.008554  1266 tablet_bootstrap.cc:492] T ac8f3ce8c750468c966a23ea2787b888 P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
W20260709 12:26:50.009528  1186 leader_election.cc:343] T 0c434afb0b164ab5b38dea54bfcebfe8 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:50.010033  1142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97b34e374ed4aec812cc43e2a5f07de" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:50.013197  1682 leader_election.cc:290] T c97b34e374ed4aec812cc43e2a5f07de P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:26:50.014267  1217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97b34e374ed4aec812cc43e2a5f07de" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:50.022704   960 leader_election.cc:304] T c97b34e374ed4aec812cc43e2a5f07de P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa098a557d34433896712068efd0d9a8; no voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085
I20260709 12:26:50.028512  1686 raft_consensus.cc:2749] T c97b34e374ed4aec812cc43e2a5f07de P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:50.032032  1067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec806598903e4f88a40176e07ca4fad0" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:50.033026  1067 raft_consensus.cc:2468] T ec806598903e4f88a40176e07ca4fad0 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 0.
I20260709 12:26:50.034011  1508 consensus_queue.cc:1048] T ac8f3ce8c750468c966a23ea2787b888 P 937efeddef934b2b8bc8632594903085 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:50.034060  1681 consensus_queue.cc:1048] T c97b34e374ed4aec812cc43e2a5f07de P 937efeddef934b2b8bc8632594903085 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:26:50.044417  1694 consensus_queue.cc:1048] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:50.055090  1267 tablet_bootstrap.cc:654] T de3dd28c345442b38f399c5db383c5b2 P 8fa35514a8d84740b1b46ae496307f20: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:50.057646  1110 leader_election.cc:304] T ec806598903e4f88a40176e07ca4fad0 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 8fa35514a8d84740b1b46ae496307f20; no voters: aa098a557d34433896712068efd0d9a8
I20260709 12:26:50.069185  1694 raft_consensus.cc:2804] T ec806598903e4f88a40176e07ca4fad0 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:50.069591  1694 raft_consensus.cc:493] T ec806598903e4f88a40176e07ca4fad0 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:50.069927  1694 raft_consensus.cc:3060] T ec806598903e4f88a40176e07ca4fad0 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:50.075829  1264 raft_consensus.cc:359] T de3dd28c345442b38f399c5db383c5b2 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:50.076623  1264 raft_consensus.cc:385] T de3dd28c345442b38f399c5db383c5b2 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:50.076896  1264 raft_consensus.cc:740] T de3dd28c345442b38f399c5db383c5b2 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 937efeddef934b2b8bc8632594903085, State: Initialized, Role: FOLLOWER
I20260709 12:26:50.074795  1421 consensus_queue.cc:1048] T f84cb753a9bd4fdd91824bb2d5050621 P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:26:50.102609  1421 consensus_queue.cc:1048] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:50.105427  1362 raft_consensus.cc:493] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.077976  1264 consensus_queue.cc:260] T de3dd28c345442b38f399c5db383c5b2 P 937efeddef934b2b8bc8632594903085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:50.105947  1362 raft_consensus.cc:515] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:50.074103   991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c434afb0b164ab5b38dea54bfcebfe8" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
I20260709 12:26:50.127656  1362 leader_election.cc:290] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:50.131690   992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb44e6d7d92f49eb9758d5a5f6ce50b6" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
W20260709 12:26:50.133901  1112 leader_election.cc:343] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:50.135545  1264 ts_tablet_manager.cc:1434] T de3dd28c345442b38f399c5db383c5b2 P 937efeddef934b2b8bc8632594903085: Time spent starting tablet: real 0.223s	user 0.007s	sys 0.000s
I20260709 12:26:50.151575  1066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb44e6d7d92f49eb9758d5a5f6ce50b6" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:50.152693  1066 raft_consensus.cc:2468] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 0.
W20260709 12:26:50.156790  1186 leader_election.cc:343] T 0c434afb0b164ab5b38dea54bfcebfe8 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:50.157367  1186 leader_election.cc:304] T 0c434afb0b164ab5b38dea54bfcebfe8 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 937efeddef934b2b8bc8632594903085; no voters: 8fa35514a8d84740b1b46ae496307f20, aa098a557d34433896712068efd0d9a8
I20260709 12:26:50.160851  1700 raft_consensus.cc:2749] T 0c434afb0b164ab5b38dea54bfcebfe8 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:50.167304  1110 leader_election.cc:304] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 8fa35514a8d84740b1b46ae496307f20; no voters: aa098a557d34433896712068efd0d9a8
I20260709 12:26:50.171023  1266 tablet_bootstrap.cc:654] T ac8f3ce8c750468c966a23ea2787b888 P aa098a557d34433896712068efd0d9a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:50.171546  1651 raft_consensus.cc:2804] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:50.181639  1651 raft_consensus.cc:493] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:50.184373  1651 raft_consensus.cc:3060] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:50.235891  1682 raft_consensus.cc:493] T 348d7f300dcb474b8b012e01d0af067f P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.271158  1694 raft_consensus.cc:515] T ec806598903e4f88a40176e07ca4fad0 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
W20260709 12:26:50.284828  1720 log.cc:927] Time spent T c97b34e374ed4aec812cc43e2a5f07de P aa098a557d34433896712068efd0d9a8: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 12:26:50.285908  1694 leader_election.cc:290] T ec806598903e4f88a40176e07ca4fad0 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 election: Requested vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:50.286737   992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec806598903e4f88a40176e07ca4fad0" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8"
W20260709 12:26:50.288224  1112 leader_election.cc:343] T ec806598903e4f88a40176e07ca4fad0 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:50.289438  1066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec806598903e4f88a40176e07ca4fad0" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
I20260709 12:26:50.264443  1682 raft_consensus.cc:515] T 348d7f300dcb474b8b012e01d0af067f P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:50.297066  1699 raft_consensus.cc:493] T 348d7f300dcb474b8b012e01d0af067f P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.327389  1267 tablet_bootstrap.cc:492] T de3dd28c345442b38f399c5db383c5b2 P 8fa35514a8d84740b1b46ae496307f20: No bootstrap required, opened a new log
I20260709 12:26:50.327876  1267 ts_tablet_manager.cc:1403] T de3dd28c345442b38f399c5db383c5b2 P 8fa35514a8d84740b1b46ae496307f20: Time spent bootstrapping tablet: real 0.433s	user 0.019s	sys 0.004s
I20260709 12:26:50.302603  1066 raft_consensus.cc:3060] T ec806598903e4f88a40176e07ca4fad0 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:50.333119  1682 leader_election.cc:290] T 348d7f300dcb474b8b012e01d0af067f P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:50.332069  1699 raft_consensus.cc:515] T 348d7f300dcb474b8b012e01d0af067f P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:50.340636  1699 leader_election.cc:290] T 348d7f300dcb474b8b012e01d0af067f P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:50.344192  1072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348d7f300dcb474b8b012e01d0af067f" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:50.344837  1072 raft_consensus.cc:2468] T 348d7f300dcb474b8b012e01d0af067f P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa098a557d34433896712068efd0d9a8 in term 0.
I20260709 12:26:50.345758   995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348d7f300dcb474b8b012e01d0af067f" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
I20260709 12:26:50.346438   995 raft_consensus.cc:2468] T 348d7f300dcb474b8b012e01d0af067f P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 0.
I20260709 12:26:50.348188   961 leader_election.cc:304] T 348d7f300dcb474b8b012e01d0af067f P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, aa098a557d34433896712068efd0d9a8; no voters: 
I20260709 12:26:50.349072  1686 raft_consensus.cc:2804] T 348d7f300dcb474b8b012e01d0af067f P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:50.349551  1686 raft_consensus.cc:493] T 348d7f300dcb474b8b012e01d0af067f P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:50.349879  1686 raft_consensus.cc:3060] T 348d7f300dcb474b8b012e01d0af067f P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:50.350661  1267 raft_consensus.cc:359] T de3dd28c345442b38f399c5db383c5b2 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:50.351361  1267 raft_consensus.cc:385] T de3dd28c345442b38f399c5db383c5b2 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:50.351112  1651 raft_consensus.cc:515] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:50.351648  1267 raft_consensus.cc:740] T de3dd28c345442b38f399c5db383c5b2 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Initialized, Role: FOLLOWER
I20260709 12:26:50.349112  1586 raft_consensus.cc:493] T 040ea9f986ee4ed29b941698c802c501 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.352198  1586 raft_consensus.cc:515] T 040ea9f986ee4ed29b941698c802c501 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:50.354266  1586 leader_election.cc:290] T 040ea9f986ee4ed29b941698c802c501 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:50.355899  1651 leader_election.cc:290] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 election: Requested vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:50.356539   995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "040ea9f986ee4ed29b941698c802c501" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
I20260709 12:26:50.357196   995 raft_consensus.cc:2468] T 040ea9f986ee4ed29b941698c802c501 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 1.
I20260709 12:26:50.357841  1219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "040ea9f986ee4ed29b941698c802c501" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:50.358089  1066 raft_consensus.cc:2468] T ec806598903e4f88a40176e07ca4fad0 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 1.
I20260709 12:26:50.358517  1219 raft_consensus.cc:2468] T 040ea9f986ee4ed29b941698c802c501 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 1.
I20260709 12:26:50.359287  1110 leader_election.cc:304] T ec806598903e4f88a40176e07ca4fad0 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 8fa35514a8d84740b1b46ae496307f20; no voters: aa098a557d34433896712068efd0d9a8
I20260709 12:26:50.360186  1112 leader_election.cc:304] T 040ea9f986ee4ed29b941698c802c501 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20, aa098a557d34433896712068efd0d9a8; no voters: 
I20260709 12:26:50.363071  1651 raft_consensus.cc:2804] T ec806598903e4f88a40176e07ca4fad0 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:50.363534  1651 raft_consensus.cc:697] T ec806598903e4f88a40176e07ca4fad0 P 8fa35514a8d84740b1b46ae496307f20 [term 1 LEADER]: Becoming Leader. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Running, Role: LEADER
I20260709 12:26:50.364316  1651 consensus_queue.cc:237] T ec806598903e4f88a40176e07ca4fad0 P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:50.366994  1266 tablet_bootstrap.cc:492] T ac8f3ce8c750468c966a23ea2787b888 P aa098a557d34433896712068efd0d9a8: No bootstrap required, opened a new log
I20260709 12:26:50.367498  1266 ts_tablet_manager.cc:1403] T ac8f3ce8c750468c966a23ea2787b888 P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.359s	user 0.015s	sys 0.006s
I20260709 12:26:50.367985  1706 raft_consensus.cc:2804] T 040ea9f986ee4ed29b941698c802c501 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:50.368415  1706 raft_consensus.cc:493] T 040ea9f986ee4ed29b941698c802c501 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:50.368734  1706 raft_consensus.cc:3060] T 040ea9f986ee4ed29b941698c802c501 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:50.370925   995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb44e6d7d92f49eb9758d5a5f6ce50b6" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8"
I20260709 12:26:50.375502  1266 raft_consensus.cc:359] T ac8f3ce8c750468c966a23ea2787b888 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:50.380507  1266 raft_consensus.cc:385] T ac8f3ce8c750468c966a23ea2787b888 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:50.380789  1266 raft_consensus.cc:740] T ac8f3ce8c750468c966a23ea2787b888 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:50.382326  1186 leader_election.cc:304] T 348d7f300dcb474b8b012e01d0af067f P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 937efeddef934b2b8bc8632594903085, aa098a557d34433896712068efd0d9a8; no voters: 
I20260709 12:26:50.384466  1709 raft_consensus.cc:2804] T 348d7f300dcb474b8b012e01d0af067f P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:50.384850  1709 raft_consensus.cc:493] T 348d7f300dcb474b8b012e01d0af067f P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:50.385211  1709 raft_consensus.cc:3060] T 348d7f300dcb474b8b012e01d0af067f P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:50.386648  1266 consensus_queue.cc:260] T ac8f3ce8c750468c966a23ea2787b888 P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:50.391994  1266 ts_tablet_manager.cc:1434] T ac8f3ce8c750468c966a23ea2787b888 P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.003s
I20260709 12:26:50.392970  1266 tablet_bootstrap.cc:492] T ec806598903e4f88a40176e07ca4fad0 P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:50.402529  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348d7f300dcb474b8b012e01d0af067f" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
W20260709 12:26:50.403724  1112 leader_election.cc:343] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:50.404659  1072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb44e6d7d92f49eb9758d5a5f6ce50b6" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
I20260709 12:26:50.405269  1072 raft_consensus.cc:3060] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:50.408376  1267 consensus_queue.cc:260] T de3dd28c345442b38f399c5db383c5b2 P 8fa35514a8d84740b1b46ae496307f20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:50.377535  1686 raft_consensus.cc:515] T 348d7f300dcb474b8b012e01d0af067f P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:50.414719  1219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348d7f300dcb474b8b012e01d0af067f" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085"
I20260709 12:26:50.415423  1267 ts_tablet_manager.cc:1434] T de3dd28c345442b38f399c5db383c5b2 P 8fa35514a8d84740b1b46ae496307f20: Time spent starting tablet: real 0.087s	user 0.002s	sys 0.003s
I20260709 12:26:50.417948  1709 raft_consensus.cc:515] T 348d7f300dcb474b8b012e01d0af067f P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:50.423568  1266 tablet_bootstrap.cc:654] T ec806598903e4f88a40176e07ca4fad0 P aa098a557d34433896712068efd0d9a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:50.425272  1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348d7f300dcb474b8b012e01d0af067f" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
I20260709 12:26:50.426597  1220 raft_consensus.cc:2393] T 348d7f300dcb474b8b012e01d0af067f P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aa098a557d34433896712068efd0d9a8 in current term 1: Already voted for candidate 937efeddef934b2b8bc8632594903085 in this term.
I20260709 12:26:50.427345  1064 raft_consensus.cc:3060] T 348d7f300dcb474b8b012e01d0af067f P 7f9cbe40e40d429aa004e4a7fb42f132 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:50.430388  1706 raft_consensus.cc:515] T 040ea9f986ee4ed29b941698c802c501 P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:50.434893  1709 leader_election.cc:290] T 348d7f300dcb474b8b012e01d0af067f P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Requested vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:50.424541  1686 leader_election.cc:290] T 348d7f300dcb474b8b012e01d0af067f P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 election: Requested vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:50.439781  1266 tablet_bootstrap.cc:492] T ec806598903e4f88a40176e07ca4fad0 P aa098a557d34433896712068efd0d9a8: No bootstrap required, opened a new log
I20260709 12:26:50.443048  1266 ts_tablet_manager.cc:1403] T ec806598903e4f88a40176e07ca4fad0 P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.050s	user 0.011s	sys 0.000s
I20260709 12:26:50.445675  1266 raft_consensus.cc:359] T ec806598903e4f88a40176e07ca4fad0 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:50.446324  1266 raft_consensus.cc:385] T ec806598903e4f88a40176e07ca4fad0 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:50.446575  1266 raft_consensus.cc:740] T ec806598903e4f88a40176e07ca4fad0 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:50.452210  1266 consensus_queue.cc:260] T ec806598903e4f88a40176e07ca4fad0 P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:50.455191  1266 ts_tablet_manager.cc:1434] T ec806598903e4f88a40176e07ca4fad0 P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:26:50.456267  1266 tablet_bootstrap.cc:492] T a943f9cb8fef49e6a38b910ff1bb9076 P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:50.460153  1706 leader_election.cc:290] T 040ea9f986ee4ed29b941698c802c501 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 2 election: Requested vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:50.465312   995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "040ea9f986ee4ed29b941698c802c501" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8"
I20260709 12:26:50.466233   995 raft_consensus.cc:3060] T 040ea9f986ee4ed29b941698c802c501 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:50.468477  1267 tablet_bootstrap.cc:492] T 0c434afb0b164ab5b38dea54bfcebfe8 P 8fa35514a8d84740b1b46ae496307f20: Bootstrap starting.
I20260709 12:26:50.471369  1266 tablet_bootstrap.cc:654] T a943f9cb8fef49e6a38b910ff1bb9076 P aa098a557d34433896712068efd0d9a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:50.472295  1219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "040ea9f986ee4ed29b941698c802c501" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085"
I20260709 12:26:50.472954  1219 raft_consensus.cc:3060] T 040ea9f986ee4ed29b941698c802c501 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:50.498742  1184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:43679, user_credentials={real_user=slave}} blocked reactor thread for 163529us
I20260709 12:26:50.500936  1066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348d7f300dcb474b8b012e01d0af067f" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:50.509078  1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348d7f300dcb474b8b012e01d0af067f" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
I20260709 12:26:50.513157  1072 raft_consensus.cc:2468] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 1.
I20260709 12:26:50.514472  1110 leader_election.cc:304] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 8fa35514a8d84740b1b46ae496307f20; no voters: aa098a557d34433896712068efd0d9a8
I20260709 12:26:50.519594  1064 raft_consensus.cc:2468] T 348d7f300dcb474b8b012e01d0af067f P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa098a557d34433896712068efd0d9a8 in term 1.
I20260709 12:26:50.520216  1707 raft_consensus.cc:2804] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:50.521039   961 leader_election.cc:304] T 348d7f300dcb474b8b012e01d0af067f P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, aa098a557d34433896712068efd0d9a8; no voters: 937efeddef934b2b8bc8632594903085
I20260709 12:26:50.522210  1686 raft_consensus.cc:2804] T 348d7f300dcb474b8b012e01d0af067f P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:50.521013  1707 raft_consensus.cc:697] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P 8fa35514a8d84740b1b46ae496307f20 [term 1 LEADER]: Becoming Leader. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Running, Role: LEADER
I20260709 12:26:50.522666  1686 raft_consensus.cc:697] T 348d7f300dcb474b8b012e01d0af067f P aa098a557d34433896712068efd0d9a8 [term 1 LEADER]: Becoming Leader. State: Replica: aa098a557d34433896712068efd0d9a8, State: Running, Role: LEADER
I20260709 12:26:50.523142   894 catalog_manager.cc:5697] T ec806598903e4f88a40176e07ca4fad0 P 8fa35514a8d84740b1b46ae496307f20 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131). New cstate: current_term: 1 leader_uuid: "8fa35514a8d84740b1b46ae496307f20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:50.523829  1686 consensus_queue.cc:237] T 348d7f300dcb474b8b012e01d0af067f P aa098a557d34433896712068efd0d9a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:50.527859   992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348d7f300dcb474b8b012e01d0af067f" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8"
I20260709 12:26:50.523528  1707 consensus_queue.cc:237] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:50.536162  1267 tablet_bootstrap.cc:654] T 0c434afb0b164ab5b38dea54bfcebfe8 P 8fa35514a8d84740b1b46ae496307f20: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:50.541208  1186 leader_election.cc:304] T 348d7f300dcb474b8b012e01d0af067f P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 937efeddef934b2b8bc8632594903085; no voters: 7f9cbe40e40d429aa004e4a7fb42f132, aa098a557d34433896712068efd0d9a8
I20260709 12:26:50.554405  1699 raft_consensus.cc:2749] T 348d7f300dcb474b8b012e01d0af067f P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:26:50.564415   995 raft_consensus.cc:2468] T 040ea9f986ee4ed29b941698c802c501 P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 2.
I20260709 12:26:50.565769  1112 leader_election.cc:304] T 040ea9f986ee4ed29b941698c802c501 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20, aa098a557d34433896712068efd0d9a8; no voters: 
I20260709 12:26:50.566763  1706 raft_consensus.cc:2804] T 040ea9f986ee4ed29b941698c802c501 P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:50.567004  1508 raft_consensus.cc:493] T de3dd28c345442b38f399c5db383c5b2 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.567315  1706 raft_consensus.cc:697] T 040ea9f986ee4ed29b941698c802c501 P 8fa35514a8d84740b1b46ae496307f20 [term 2 LEADER]: Becoming Leader. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Running, Role: LEADER
I20260709 12:26:50.567605  1508 raft_consensus.cc:515] T de3dd28c345442b38f399c5db383c5b2 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:50.568248  1706 consensus_queue.cc:237] T 040ea9f986ee4ed29b941698c802c501 P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:50.569857  1508 leader_election.cc:290] T de3dd28c345442b38f399c5db383c5b2 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:50.570847   996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3dd28c345442b38f399c5db383c5b2" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
W20260709 12:26:50.572364  1186 leader_election.cc:343] T de3dd28c345442b38f399c5db383c5b2 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:50.573247  1219 raft_consensus.cc:2468] T 040ea9f986ee4ed29b941698c802c501 P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 2.
I20260709 12:26:50.575021  1266 tablet_bootstrap.cc:492] T a943f9cb8fef49e6a38b910ff1bb9076 P aa098a557d34433896712068efd0d9a8: No bootstrap required, opened a new log
I20260709 12:26:50.575600  1266 ts_tablet_manager.cc:1403] T a943f9cb8fef49e6a38b910ff1bb9076 P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.120s	user 0.015s	sys 0.020s
I20260709 12:26:50.579457  1266 raft_consensus.cc:359] T a943f9cb8fef49e6a38b910ff1bb9076 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:50.581997  1266 raft_consensus.cc:385] T a943f9cb8fef49e6a38b910ff1bb9076 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:50.582837  1266 raft_consensus.cc:740] T a943f9cb8fef49e6a38b910ff1bb9076 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:50.583635  1266 consensus_queue.cc:260] T a943f9cb8fef49e6a38b910ff1bb9076 P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:50.584331  1267 tablet_bootstrap.cc:492] T 0c434afb0b164ab5b38dea54bfcebfe8 P 8fa35514a8d84740b1b46ae496307f20: No bootstrap required, opened a new log
I20260709 12:26:50.586112  1266 ts_tablet_manager.cc:1434] T a943f9cb8fef49e6a38b910ff1bb9076 P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 12:26:50.587280  1266 tablet_bootstrap.cc:492] T 0c434afb0b164ab5b38dea54bfcebfe8 P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:50.586083  1267 ts_tablet_manager.cc:1403] T 0c434afb0b164ab5b38dea54bfcebfe8 P 8fa35514a8d84740b1b46ae496307f20: Time spent bootstrapping tablet: real 0.118s	user 0.008s	sys 0.004s
I20260709 12:26:50.587720  1141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3dd28c345442b38f399c5db383c5b2" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:50.588469  1141 raft_consensus.cc:2468] T de3dd28c345442b38f399c5db383c5b2 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 0.
I20260709 12:26:50.590361  1186 leader_election.cc:304] T de3dd28c345442b38f399c5db383c5b2 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085; no voters: aa098a557d34433896712068efd0d9a8
I20260709 12:26:50.590273  1267 raft_consensus.cc:359] T 0c434afb0b164ab5b38dea54bfcebfe8 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:50.591374  1267 raft_consensus.cc:385] T 0c434afb0b164ab5b38dea54bfcebfe8 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:50.591563  1682 raft_consensus.cc:493] T ac8f3ce8c750468c966a23ea2787b888 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.592346  1682 raft_consensus.cc:515] T ac8f3ce8c750468c966a23ea2787b888 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:50.593186  1266 tablet_bootstrap.cc:654] T 0c434afb0b164ab5b38dea54bfcebfe8 P aa098a557d34433896712068efd0d9a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:50.595146  1682 leader_election.cc:290] T ac8f3ce8c750468c966a23ea2787b888 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:50.596174  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac8f3ce8c750468c966a23ea2787b888" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:50.597080  1508 raft_consensus.cc:2804] T de3dd28c345442b38f399c5db383c5b2 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:50.597759  1508 raft_consensus.cc:493] T de3dd28c345442b38f399c5db383c5b2 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:50.598649  1508 raft_consensus.cc:3060] T de3dd28c345442b38f399c5db383c5b2 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:50.601953  1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac8f3ce8c750468c966a23ea2787b888" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:50.604979   961 leader_election.cc:304] T ac8f3ce8c750468c966a23ea2787b888 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa098a557d34433896712068efd0d9a8; no voters: 7f9cbe40e40d429aa004e4a7fb42f132, 937efeddef934b2b8bc8632594903085
I20260709 12:26:50.606297  1682 raft_consensus.cc:2749] T ac8f3ce8c750468c966a23ea2787b888 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:50.591655  1267 raft_consensus.cc:740] T 0c434afb0b164ab5b38dea54bfcebfe8 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Initialized, Role: FOLLOWER
I20260709 12:26:50.616811  1267 consensus_queue.cc:260] T 0c434afb0b164ab5b38dea54bfcebfe8 P 8fa35514a8d84740b1b46ae496307f20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:50.619500  1267 ts_tablet_manager.cc:1434] T 0c434afb0b164ab5b38dea54bfcebfe8 P 8fa35514a8d84740b1b46ae496307f20: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.001s
I20260709 12:26:50.621659  1508 raft_consensus.cc:515] T de3dd28c345442b38f399c5db383c5b2 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:50.624231  1508 leader_election.cc:290] T de3dd28c345442b38f399c5db383c5b2 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Requested vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:50.625020  1141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3dd28c345442b38f399c5db383c5b2" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20"
I20260709 12:26:50.625428   996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3dd28c345442b38f399c5db383c5b2" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8"
I20260709 12:26:50.625715  1141 raft_consensus.cc:3060] T de3dd28c345442b38f399c5db383c5b2 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:26:50.626925  1186 leader_election.cc:343] T de3dd28c345442b38f399c5db383c5b2 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:50.632682   890 catalog_manager.cc:5697] T 348d7f300dcb474b8b012e01d0af067f P aa098a557d34433896712068efd0d9a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to aa098a557d34433896712068efd0d9a8 (127.23.245.129). New cstate: current_term: 1 leader_uuid: "aa098a557d34433896712068efd0d9a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:50.634101  1141 raft_consensus.cc:2468] T de3dd28c345442b38f399c5db383c5b2 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 1.
I20260709 12:26:50.635618  1186 leader_election.cc:304] T de3dd28c345442b38f399c5db383c5b2 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085; no voters: aa098a557d34433896712068efd0d9a8
I20260709 12:26:50.637238  1508 raft_consensus.cc:2804] T de3dd28c345442b38f399c5db383c5b2 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:50.637723  1508 raft_consensus.cc:697] T de3dd28c345442b38f399c5db383c5b2 P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Becoming Leader. State: Replica: 937efeddef934b2b8bc8632594903085, State: Running, Role: LEADER
I20260709 12:26:50.638471   996 raft_consensus.cc:3060] T ac8f3ce8c750468c966a23ea2787b888 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:50.638604  1508 consensus_queue.cc:237] T de3dd28c345442b38f399c5db383c5b2 P 937efeddef934b2b8bc8632594903085 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:50.646241  1266 tablet_bootstrap.cc:492] T 0c434afb0b164ab5b38dea54bfcebfe8 P aa098a557d34433896712068efd0d9a8: No bootstrap required, opened a new log
I20260709 12:26:50.646982  1266 ts_tablet_manager.cc:1403] T 0c434afb0b164ab5b38dea54bfcebfe8 P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.060s	user 0.018s	sys 0.005s
I20260709 12:26:50.650776  1266 raft_consensus.cc:359] T 0c434afb0b164ab5b38dea54bfcebfe8 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:50.651695  1266 raft_consensus.cc:385] T 0c434afb0b164ab5b38dea54bfcebfe8 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:50.660475  1266 raft_consensus.cc:740] T 0c434afb0b164ab5b38dea54bfcebfe8 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:50.661479  1266 consensus_queue.cc:260] T 0c434afb0b164ab5b38dea54bfcebfe8 P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:50.663820  1266 ts_tablet_manager.cc:1434] T 0c434afb0b164ab5b38dea54bfcebfe8 P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:26:50.664898  1266 tablet_bootstrap.cc:492] T de3dd28c345442b38f399c5db383c5b2 P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:50.664528   895 catalog_manager.cc:5697] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P 8fa35514a8d84740b1b46ae496307f20 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131). New cstate: current_term: 1 leader_uuid: "8fa35514a8d84740b1b46ae496307f20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:50.666224   895 catalog_manager.cc:5697] T 040ea9f986ee4ed29b941698c802c501 P 8fa35514a8d84740b1b46ae496307f20 reported cstate change: term changed from 0 to 2, leader changed from <none> to 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131). New cstate: current_term: 2 leader_uuid: "8fa35514a8d84740b1b46ae496307f20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:50.678547  1266 tablet_bootstrap.cc:654] T de3dd28c345442b38f399c5db383c5b2 P aa098a557d34433896712068efd0d9a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:50.694057  1266 tablet_bootstrap.cc:492] T de3dd28c345442b38f399c5db383c5b2 P aa098a557d34433896712068efd0d9a8: No bootstrap required, opened a new log
I20260709 12:26:50.694439  1266 ts_tablet_manager.cc:1403] T de3dd28c345442b38f399c5db383c5b2 P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.000s
I20260709 12:26:50.695894  1682 raft_consensus.cc:493] T ec806598903e4f88a40176e07ca4fad0 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.696380  1682 raft_consensus.cc:515] T ec806598903e4f88a40176e07ca4fad0 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:50.696815  1266 raft_consensus.cc:359] T de3dd28c345442b38f399c5db383c5b2 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:50.697608  1266 raft_consensus.cc:385] T de3dd28c345442b38f399c5db383c5b2 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:50.697870  1266 raft_consensus.cc:740] T de3dd28c345442b38f399c5db383c5b2 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:50.698519  1682 leader_election.cc:290] T ec806598903e4f88a40176e07ca4fad0 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679), 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341)
I20260709 12:26:50.698740  1266 consensus_queue.cc:260] T de3dd28c345442b38f399c5db383c5b2 P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:50.700918  1141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec806598903e4f88a40176e07ca4fad0" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:50.701162  1266 ts_tablet_manager.cc:1434] T de3dd28c345442b38f399c5db383c5b2 P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:26:50.702207  1266 tablet_bootstrap.cc:492] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:50.703136   892 catalog_manager.cc:5697] T de3dd28c345442b38f399c5db383c5b2 P 937efeddef934b2b8bc8632594903085 reported cstate change: term changed from 0 to 1, leader changed from <none> to 937efeddef934b2b8bc8632594903085 (127.23.245.132). New cstate: current_term: 1 leader_uuid: "937efeddef934b2b8bc8632594903085" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:50.704957  1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec806598903e4f88a40176e07ca4fad0" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:50.705797  1064 raft_consensus.cc:2393] T ec806598903e4f88a40176e07ca4fad0 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aa098a557d34433896712068efd0d9a8 in current term 1: Already voted for candidate 8fa35514a8d84740b1b46ae496307f20 in this term.
I20260709 12:26:50.708209  1266 tablet_bootstrap.cc:654] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P aa098a557d34433896712068efd0d9a8: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:50.708690   961 leader_election.cc:304] T ec806598903e4f88a40176e07ca4fad0 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa098a557d34433896712068efd0d9a8; no voters: 7f9cbe40e40d429aa004e4a7fb42f132, 8fa35514a8d84740b1b46ae496307f20
I20260709 12:26:50.710121  1682 raft_consensus.cc:3060] T ec806598903e4f88a40176e07ca4fad0 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:50.721657  1682 raft_consensus.cc:2749] T ec806598903e4f88a40176e07ca4fad0 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:50.728678  1266 tablet_bootstrap.cc:492] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P aa098a557d34433896712068efd0d9a8: No bootstrap required, opened a new log
I20260709 12:26:50.729234  1266 ts_tablet_manager.cc:1403] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.007s
I20260709 12:26:50.744881  1266 raft_consensus.cc:359] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:50.745638  1266 raft_consensus.cc:385] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:50.745903  1266 raft_consensus.cc:740] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:50.746558  1266 consensus_queue.cc:260] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:50.748788  1266 ts_tablet_manager.cc:1434] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
W20260709 12:26:50.775136   943 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:50.777494  1651 raft_consensus.cc:493] T 0c434afb0b164ab5b38dea54bfcebfe8 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.778080  1651 raft_consensus.cc:515] T 0c434afb0b164ab5b38dea54bfcebfe8 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:50.781111  1219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c434afb0b164ab5b38dea54bfcebfe8" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:50.781816  1219 raft_consensus.cc:2468] T 0c434afb0b164ab5b38dea54bfcebfe8 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 0.
I20260709 12:26:50.783025  1109 leader_election.cc:304] T 0c434afb0b164ab5b38dea54bfcebfe8 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085; no voters: 
I20260709 12:26:50.783883  1706 raft_consensus.cc:2804] T 0c434afb0b164ab5b38dea54bfcebfe8 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:50.784327  1706 raft_consensus.cc:493] T 0c434afb0b164ab5b38dea54bfcebfe8 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:50.784624  1706 raft_consensus.cc:3060] T 0c434afb0b164ab5b38dea54bfcebfe8 P 8fa35514a8d84740b1b46ae496307f20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:50.786679   996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c434afb0b164ab5b38dea54bfcebfe8" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8" is_pre_election: true
I20260709 12:26:50.786943  1651 leader_election.cc:290] T 0c434afb0b164ab5b38dea54bfcebfe8 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:50.787377   996 raft_consensus.cc:2468] T 0c434afb0b164ab5b38dea54bfcebfe8 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 0.
I20260709 12:26:50.792068  1706 raft_consensus.cc:515] T 0c434afb0b164ab5b38dea54bfcebfe8 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:50.793998  1706 leader_election.cc:290] T 0c434afb0b164ab5b38dea54bfcebfe8 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 election: Requested vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:50.794471  1219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c434afb0b164ab5b38dea54bfcebfe8" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085"
I20260709 12:26:50.795048  1219 raft_consensus.cc:3060] T 0c434afb0b164ab5b38dea54bfcebfe8 P 937efeddef934b2b8bc8632594903085 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:50.795048   996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c434afb0b164ab5b38dea54bfcebfe8" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa098a557d34433896712068efd0d9a8"
I20260709 12:26:50.795799   996 raft_consensus.cc:3060] T 0c434afb0b164ab5b38dea54bfcebfe8 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:50.802385   996 raft_consensus.cc:2468] T 0c434afb0b164ab5b38dea54bfcebfe8 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 1.
I20260709 12:26:50.802385  1219 raft_consensus.cc:2468] T 0c434afb0b164ab5b38dea54bfcebfe8 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 1.
I20260709 12:26:50.803750  1112 leader_election.cc:304] T 0c434afb0b164ab5b38dea54bfcebfe8 P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20, aa098a557d34433896712068efd0d9a8; no voters: 
I20260709 12:26:50.804845  1706 raft_consensus.cc:2804] T 0c434afb0b164ab5b38dea54bfcebfe8 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:50.805359  1706 raft_consensus.cc:697] T 0c434afb0b164ab5b38dea54bfcebfe8 P 8fa35514a8d84740b1b46ae496307f20 [term 1 LEADER]: Becoming Leader. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Running, Role: LEADER
I20260709 12:26:50.806183  1706 consensus_queue.cc:237] T 0c434afb0b164ab5b38dea54bfcebfe8 P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:50.818795   895 catalog_manager.cc:5697] T 0c434afb0b164ab5b38dea54bfcebfe8 P 8fa35514a8d84740b1b46ae496307f20 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131). New cstate: current_term: 1 leader_uuid: "8fa35514a8d84740b1b46ae496307f20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:50.850251  1706 consensus_queue.cc:1048] T ec806598903e4f88a40176e07ca4fad0 P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:50.857915  1706 consensus_queue.cc:1048] T ec806598903e4f88a40176e07ca4fad0 P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:50.881960  1686 raft_consensus.cc:493] T de3dd28c345442b38f399c5db383c5b2 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.882484  1686 raft_consensus.cc:515] T de3dd28c345442b38f399c5db383c5b2 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:50.884637  1686 leader_election.cc:290] T de3dd28c345442b38f399c5db383c5b2 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:26:50.886066  1219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3dd28c345442b38f399c5db383c5b2" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:50.888455  1141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3dd28c345442b38f399c5db383c5b2" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:50.889293  1141 raft_consensus.cc:2393] T de3dd28c345442b38f399c5db383c5b2 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aa098a557d34433896712068efd0d9a8 in current term 1: Already voted for candidate 937efeddef934b2b8bc8632594903085 in this term.
I20260709 12:26:50.890363   963 leader_election.cc:304] T de3dd28c345442b38f399c5db383c5b2 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa098a557d34433896712068efd0d9a8; no voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085
I20260709 12:26:50.891184  1686 raft_consensus.cc:3060] T de3dd28c345442b38f399c5db383c5b2 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:50.896327   995 raft_consensus.cc:3060] T a943f9cb8fef49e6a38b910ff1bb9076 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:50.907029  1686 raft_consensus.cc:2749] T de3dd28c345442b38f399c5db383c5b2 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:50.960566   995 raft_consensus.cc:3060] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P aa098a557d34433896712068efd0d9a8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:50.967180  1707 consensus_queue.cc:1048] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:50.973023  1686 consensus_queue.cc:1048] T 348d7f300dcb474b8b012e01d0af067f P aa098a557d34433896712068efd0d9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:50.984813  1706 consensus_queue.cc:1048] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:50.992297  1682 consensus_queue.cc:1048] T 348d7f300dcb474b8b012e01d0af067f P aa098a557d34433896712068efd0d9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:51.009573   992 raft_consensus.cc:1275] T 040ea9f986ee4ed29b941698c802c501 P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Refusing update from remote peer 8fa35514a8d84740b1b46ae496307f20: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:26:51.018364  1764 consensus_queue.cc:1048] T 040ea9f986ee4ed29b941698c802c501 P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:51.035162  1220 raft_consensus.cc:1275] T 040ea9f986ee4ed29b941698c802c501 P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Refusing update from remote peer 8fa35514a8d84740b1b46ae496307f20: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:26:51.041241  1707 consensus_queue.cc:1048] T 040ea9f986ee4ed29b941698c802c501 P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:51.112903  1508 consensus_queue.cc:1048] T de3dd28c345442b38f399c5db383c5b2 P 937efeddef934b2b8bc8632594903085 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:51.124817  1709 consensus_queue.cc:1048] T de3dd28c345442b38f399c5db383c5b2 P 937efeddef934b2b8bc8632594903085 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:51.221246  1651 consensus_queue.cc:1048] T 0c434afb0b164ab5b38dea54bfcebfe8 P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:51.231743  1651 consensus_queue.cc:1048] T 0c434afb0b164ab5b38dea54bfcebfe8 P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:52.738296 24534 tablet_server.cc:179] TabletServer@127.23.245.129:0 shutting down...
W20260709 12:26:52.742974  1112 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 239 similar messages]
W20260709 12:26:52.749629  1112 consensus_peers.cc:597] T 343e626d0073462fa2020fcf2e2f8ffb P 8fa35514a8d84740b1b46ae496307f20 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:52.753091  1186 consensus_peers.cc:597] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P 937efeddef934b2b8bc8632594903085 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:52.766708  1112 consensus_peers.cc:597] T 0e2eae4c387445f39a059befe390fe45 P 8fa35514a8d84740b1b46ae496307f20 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:52.785003 24534 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:52.786329 24534 tablet_replica.cc:333] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P aa098a557d34433896712068efd0d9a8: stopping tablet replica
I20260709 12:26:52.787370 24534 raft_consensus.cc:2243] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.788008 24534 raft_consensus.cc:2272] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.790024 24534 tablet_replica.cc:333] T c97b34e374ed4aec812cc43e2a5f07de P aa098a557d34433896712068efd0d9a8: stopping tablet replica
I20260709 12:26:52.790625 24534 raft_consensus.cc:2243] T c97b34e374ed4aec812cc43e2a5f07de P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.791039 24534 raft_consensus.cc:2272] T c97b34e374ed4aec812cc43e2a5f07de P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.792846 24534 tablet_replica.cc:333] T 3d2ccd742ac442419de89cb38ee12d37 P aa098a557d34433896712068efd0d9a8: stopping tablet replica
I20260709 12:26:52.793402 24534 raft_consensus.cc:2243] T 3d2ccd742ac442419de89cb38ee12d37 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.793865 24534 raft_consensus.cc:2272] T 3d2ccd742ac442419de89cb38ee12d37 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.795899 24534 tablet_replica.cc:333] T 0017925ea1bb4374b09c9e692a17f87e P aa098a557d34433896712068efd0d9a8: stopping tablet replica
I20260709 12:26:52.796672 24534 raft_consensus.cc:2243] T 0017925ea1bb4374b09c9e692a17f87e P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.797135 24534 raft_consensus.cc:2272] T 0017925ea1bb4374b09c9e692a17f87e P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.799021 24534 tablet_replica.cc:333] T 040ea9f986ee4ed29b941698c802c501 P aa098a557d34433896712068efd0d9a8: stopping tablet replica
I20260709 12:26:52.799612 24534 raft_consensus.cc:2243] T 040ea9f986ee4ed29b941698c802c501 P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.800048 24534 raft_consensus.cc:2272] T 040ea9f986ee4ed29b941698c802c501 P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.801851 24534 tablet_replica.cc:333] T c36d0201599a49169424a6b75f5349f2 P aa098a557d34433896712068efd0d9a8: stopping tablet replica
I20260709 12:26:52.802369 24534 raft_consensus.cc:2243] T c36d0201599a49169424a6b75f5349f2 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.802796 24534 raft_consensus.cc:2272] T c36d0201599a49169424a6b75f5349f2 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.805666 24534 tablet_replica.cc:333] T a1c303d40c6a4cae88aa89d681ae7b76 P aa098a557d34433896712068efd0d9a8: stopping tablet replica
I20260709 12:26:52.806541 24534 raft_consensus.cc:2243] T a1c303d40c6a4cae88aa89d681ae7b76 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.807060 24534 raft_consensus.cc:2272] T a1c303d40c6a4cae88aa89d681ae7b76 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.809372 24534 tablet_replica.cc:333] T 1d925407b8314f5b95a8c940f195433a P aa098a557d34433896712068efd0d9a8: stopping tablet replica
I20260709 12:26:52.810168 24534 raft_consensus.cc:2243] T 1d925407b8314f5b95a8c940f195433a P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.810652 24534 raft_consensus.cc:2272] T 1d925407b8314f5b95a8c940f195433a P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.812952 24534 tablet_replica.cc:333] T 74e3cbe3521a46cfb42a6cb7ba98430c P aa098a557d34433896712068efd0d9a8: stopping tablet replica
I20260709 12:26:52.813683 24534 raft_consensus.cc:2243] T 74e3cbe3521a46cfb42a6cb7ba98430c P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.814111 24534 raft_consensus.cc:2272] T 74e3cbe3521a46cfb42a6cb7ba98430c P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.816226 24534 tablet_replica.cc:333] T a943f9cb8fef49e6a38b910ff1bb9076 P aa098a557d34433896712068efd0d9a8: stopping tablet replica
I20260709 12:26:52.816808 24534 raft_consensus.cc:2243] T a943f9cb8fef49e6a38b910ff1bb9076 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.817209 24534 raft_consensus.cc:2272] T a943f9cb8fef49e6a38b910ff1bb9076 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.818935 24534 tablet_replica.cc:333] T a93df19c4206495e971bc5e95a2111bc P aa098a557d34433896712068efd0d9a8: stopping tablet replica
I20260709 12:26:52.819480 24534 raft_consensus.cc:2243] T a93df19c4206495e971bc5e95a2111bc P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.819864 24534 raft_consensus.cc:2272] T a93df19c4206495e971bc5e95a2111bc P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.821964 24534 tablet_replica.cc:333] T c5197f4025d94ce096c14c6ca011b47b P aa098a557d34433896712068efd0d9a8: stopping tablet replica
I20260709 12:26:52.822688 24534 raft_consensus.cc:2243] T c5197f4025d94ce096c14c6ca011b47b P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.823158 24534 raft_consensus.cc:2272] T c5197f4025d94ce096c14c6ca011b47b P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.825158 24534 tablet_replica.cc:333] T 95743acb416b403b9bfb59afe5bf2fe7 P aa098a557d34433896712068efd0d9a8: stopping tablet replica
I20260709 12:26:52.825889 24534 raft_consensus.cc:2243] T 95743acb416b403b9bfb59afe5bf2fe7 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.826344 24534 raft_consensus.cc:2272] T 95743acb416b403b9bfb59afe5bf2fe7 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:52.827663  1112 consensus_peers.cc:597] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P 8fa35514a8d84740b1b46ae496307f20 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:52.828402  1112 consensus_peers.cc:597] T e281f15348944cc1ab51fce7c1653aac P 8fa35514a8d84740b1b46ae496307f20 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:52.828728 24534 tablet_replica.cc:333] T b364263cacab4add984e2b6c912fb62e P aa098a557d34433896712068efd0d9a8: stopping tablet replica
I20260709 12:26:52.829546 24534 raft_consensus.cc:2243] T b364263cacab4add984e2b6c912fb62e P aa098a557d34433896712068efd0d9a8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:52.830251 24534 raft_consensus.cc:2272] T b364263cacab4add984e2b6c912fb62e P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.831902 24534 tablet_replica.cc:333] T 343e626d0073462fa2020fcf2e2f8ffb P aa098a557d34433896712068efd0d9a8: stopping tablet replica
I20260709 12:26:52.832505 24534 raft_consensus.cc:2243] T 343e626d0073462fa2020fcf2e2f8ffb P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.832893 24534 raft_consensus.cc:2272] T 343e626d0073462fa2020fcf2e2f8ffb P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.834503 24534 tablet_replica.cc:333] T 333930b9df5744d59ab498b170a35315 P aa098a557d34433896712068efd0d9a8: stopping tablet replica
I20260709 12:26:52.835064 24534 raft_consensus.cc:2243] T 333930b9df5744d59ab498b170a35315 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.835455 24534 raft_consensus.cc:2272] T 333930b9df5744d59ab498b170a35315 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.837347 24534 tablet_replica.cc:333] T c495ce9da627479e92d7b24b3be3641a P aa098a557d34433896712068efd0d9a8: stopping tablet replica
I20260709 12:26:52.838106 24534 raft_consensus.cc:2243] T c495ce9da627479e92d7b24b3be3641a P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.838621 24534 raft_consensus.cc:2272] T c495ce9da627479e92d7b24b3be3641a P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.840791 24534 tablet_replica.cc:333] T 6715731f9a31415a98fa8a0ab9944eec P aa098a557d34433896712068efd0d9a8: stopping tablet replica
I20260709 12:26:52.841550 24534 raft_consensus.cc:2243] T 6715731f9a31415a98fa8a0ab9944eec P aa098a557d34433896712068efd0d9a8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:52.842466 24534 raft_consensus.cc:2272] T 6715731f9a31415a98fa8a0ab9944eec P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.844712 24534 tablet_replica.cc:333] T de3dd28c345442b38f399c5db383c5b2 P aa098a557d34433896712068efd0d9a8: stopping tablet replica
I20260709 12:26:52.845464 24534 raft_consensus.cc:2243] T de3dd28c345442b38f399c5db383c5b2 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.845937 24534 raft_consensus.cc:2272] T de3dd28c345442b38f399c5db383c5b2 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.848117 24534 tablet_replica.cc:333] T 0c434afb0b164ab5b38dea54bfcebfe8 P aa098a557d34433896712068efd0d9a8: stopping tablet replica
I20260709 12:26:52.848915 24534 raft_consensus.cc:2243] T 0c434afb0b164ab5b38dea54bfcebfe8 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.849395 24534 raft_consensus.cc:2272] T 0c434afb0b164ab5b38dea54bfcebfe8 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:52.850455  1186 consensus_peers.cc:597] T e2ef4b262fac46fe9f9111b609547aa3 P 937efeddef934b2b8bc8632594903085 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:52.851706 24534 tablet_replica.cc:333] T ec806598903e4f88a40176e07ca4fad0 P aa098a557d34433896712068efd0d9a8: stopping tablet replica
I20260709 12:26:52.852663 24534 raft_consensus.cc:2243] T ec806598903e4f88a40176e07ca4fad0 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.853166 24534 raft_consensus.cc:2272] T ec806598903e4f88a40176e07ca4fad0 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.855532 24534 tablet_replica.cc:333] T ec47b02d68674e2386a86244d9026b78 P aa098a557d34433896712068efd0d9a8: stopping tablet replica
I20260709 12:26:52.856328 24534 raft_consensus.cc:2243] T ec47b02d68674e2386a86244d9026b78 P aa098a557d34433896712068efd0d9a8 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:26:52.857029  1186 consensus_peers.cc:597] T ac8f3ce8c750468c966a23ea2787b888 P 937efeddef934b2b8bc8632594903085 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:52.857241 24534 raft_consensus.cc:2272] T ec47b02d68674e2386a86244d9026b78 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.859688 24534 tablet_replica.cc:333] T 580f367489064e218eef65b4654744b8 P aa098a557d34433896712068efd0d9a8: stopping tablet replica
I20260709 12:26:52.860499 24534 raft_consensus.cc:2243] T 580f367489064e218eef65b4654744b8 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.860981 24534 raft_consensus.cc:2272] T 580f367489064e218eef65b4654744b8 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.863204 24534 tablet_replica.cc:333] T c4234c6cf75048c5a6cdf34e43c9bd1e P aa098a557d34433896712068efd0d9a8: stopping tablet replica
I20260709 12:26:52.864017 24534 raft_consensus.cc:2243] T c4234c6cf75048c5a6cdf34e43c9bd1e P aa098a557d34433896712068efd0d9a8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:52.864976 24534 raft_consensus.cc:2272] T c4234c6cf75048c5a6cdf34e43c9bd1e P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.867269 24534 tablet_replica.cc:333] T e12f4bd1b2ed49988317684782c8616b P aa098a557d34433896712068efd0d9a8: stopping tablet replica
I20260709 12:26:52.868109 24534 raft_consensus.cc:2243] T e12f4bd1b2ed49988317684782c8616b P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.868641 24534 raft_consensus.cc:2272] T e12f4bd1b2ed49988317684782c8616b P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.871433 24534 tablet_replica.cc:333] T 5302c354091f4926812eb90f518b9d6a P aa098a557d34433896712068efd0d9a8: stopping tablet replica
I20260709 12:26:52.872206 24534 raft_consensus.cc:2243] T 5302c354091f4926812eb90f518b9d6a P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.872692 24534 raft_consensus.cc:2272] T 5302c354091f4926812eb90f518b9d6a P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.874953 24534 tablet_replica.cc:333] T 5b3d71845177478a9e2510c82e0cf9d1 P aa098a557d34433896712068efd0d9a8: stopping tablet replica
I20260709 12:26:52.875692 24534 raft_consensus.cc:2243] T 5b3d71845177478a9e2510c82e0cf9d1 P aa098a557d34433896712068efd0d9a8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:52.876780 24534 raft_consensus.cc:2272] T 5b3d71845177478a9e2510c82e0cf9d1 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.880257 24534 tablet_replica.cc:333] T e81f2374d9904e93bf2941ff8b241c09 P aa098a557d34433896712068efd0d9a8: stopping tablet replica
I20260709 12:26:52.881116 24534 raft_consensus.cc:2243] T e81f2374d9904e93bf2941ff8b241c09 P aa098a557d34433896712068efd0d9a8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:52.882110 24534 raft_consensus.cc:2272] T e81f2374d9904e93bf2941ff8b241c09 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.884801 24534 tablet_replica.cc:333] T 329e639d23154fb6bd4ccdf095dbd0e0 P aa098a557d34433896712068efd0d9a8: stopping tablet replica
I20260709 12:26:52.885594 24534 raft_consensus.cc:2243] T 329e639d23154fb6bd4ccdf095dbd0e0 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.886127 24534 raft_consensus.cc:2272] T 329e639d23154fb6bd4ccdf095dbd0e0 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.888477 24534 tablet_replica.cc:333] T c9d72f2a6ae046cb9d4e6277d13e34e6 P aa098a557d34433896712068efd0d9a8: stopping tablet replica
I20260709 12:26:52.889215 24534 raft_consensus.cc:2243] T c9d72f2a6ae046cb9d4e6277d13e34e6 P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.889731 24534 raft_consensus.cc:2272] T c9d72f2a6ae046cb9d4e6277d13e34e6 P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.892377 24534 tablet_replica.cc:333] T 284ea666431c4339998eb885cd31facb P aa098a557d34433896712068efd0d9a8: stopping tablet replica
W20260709 12:26:52.892189  1186 consensus_peers.cc:597] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 937efeddef934b2b8bc8632594903085 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:52.893234  1186 consensus_peers.cc:597] T a93df19c4206495e971bc5e95a2111bc P 937efeddef934b2b8bc8632594903085 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:52.893290 24534 raft_consensus.cc:2243] T 284ea666431c4339998eb885cd31facb P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.894217 24534 raft_consensus.cc:2272] T 284ea666431c4339998eb885cd31facb P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:52.898152  1186 consensus_peers.cc:597] T a1c303d40c6a4cae88aa89d681ae7b76 P 937efeddef934b2b8bc8632594903085 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:52.899092 24534 tablet_replica.cc:333] T 2f2713fe1c7148f0b6d9a69c53ec3515 P aa098a557d34433896712068efd0d9a8: stopping tablet replica
I20260709 12:26:52.900959 24534 raft_consensus.cc:2243] T 2f2713fe1c7148f0b6d9a69c53ec3515 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.901535 24534 raft_consensus.cc:2272] T 2f2713fe1c7148f0b6d9a69c53ec3515 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:52.902537  1038 consensus_peers.cc:597] T a943f9cb8fef49e6a38b910ff1bb9076 P 7f9cbe40e40d429aa004e4a7fb42f132 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:52.909637 24534 tablet_replica.cc:333] T 3a19a87d91404b73bdba7121512bf7aa P aa098a557d34433896712068efd0d9a8: stopping tablet replica
I20260709 12:26:52.910482 24534 raft_consensus.cc:2243] T 3a19a87d91404b73bdba7121512bf7aa P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.911084 24534 raft_consensus.cc:2272] T 3a19a87d91404b73bdba7121512bf7aa P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.913727 24534 tablet_replica.cc:333] T e281f15348944cc1ab51fce7c1653aac P aa098a557d34433896712068efd0d9a8: stopping tablet replica
I20260709 12:26:52.914480 24534 raft_consensus.cc:2243] T e281f15348944cc1ab51fce7c1653aac P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.914987 24534 raft_consensus.cc:2272] T e281f15348944cc1ab51fce7c1653aac P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.918254 24534 tablet_replica.cc:333] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P aa098a557d34433896712068efd0d9a8: stopping tablet replica
W20260709 12:26:52.918622  1112 consensus_peers.cc:597] T ec806598903e4f88a40176e07ca4fad0 P 8fa35514a8d84740b1b46ae496307f20 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:52.919181 24534 raft_consensus.cc:2243] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.920560 24534 raft_consensus.cc:2272] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.923414 24534 tablet_replica.cc:333] T 348d7f300dcb474b8b012e01d0af067f P aa098a557d34433896712068efd0d9a8: stopping tablet replica
W20260709 12:26:52.923874  1186 consensus_peers.cc:597] T de3dd28c345442b38f399c5db383c5b2 P 937efeddef934b2b8bc8632594903085 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:52.924235 24534 raft_consensus.cc:2243] T 348d7f300dcb474b8b012e01d0af067f P aa098a557d34433896712068efd0d9a8 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:26:52.924584  1112 consensus_peers.cc:597] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 8fa35514a8d84740b1b46ae496307f20 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:52.925262 24534 raft_consensus.cc:2272] T 348d7f300dcb474b8b012e01d0af067f P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.927773 24534 tablet_replica.cc:333] T e2ef4b262fac46fe9f9111b609547aa3 P aa098a557d34433896712068efd0d9a8: stopping tablet replica
I20260709 12:26:52.928563 24534 raft_consensus.cc:2243] T e2ef4b262fac46fe9f9111b609547aa3 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.929036 24534 raft_consensus.cc:2272] T e2ef4b262fac46fe9f9111b609547aa3 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.931349 24534 tablet_replica.cc:333] T 4d899bdd8a44422ca2a8036f84e9f9f3 P aa098a557d34433896712068efd0d9a8: stopping tablet replica
I20260709 12:26:52.932060 24534 raft_consensus.cc:2243] T 4d899bdd8a44422ca2a8036f84e9f9f3 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.932546 24534 raft_consensus.cc:2272] T 4d899bdd8a44422ca2a8036f84e9f9f3 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.935117 24534 tablet_replica.cc:333] T e5af913e96004f3b8cac5fbe6ac655ac P aa098a557d34433896712068efd0d9a8: stopping tablet replica
W20260709 12:26:52.935956  1112 consensus_peers.cc:597] T 3d2ccd742ac442419de89cb38ee12d37 P 8fa35514a8d84740b1b46ae496307f20 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:52.936187 24534 raft_consensus.cc:2243] T e5af913e96004f3b8cac5fbe6ac655ac P aa098a557d34433896712068efd0d9a8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:52.937283 24534 raft_consensus.cc:2272] T e5af913e96004f3b8cac5fbe6ac655ac P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.939877 24534 tablet_replica.cc:333] T 98b5b180139845c99c537cd675a60830 P aa098a557d34433896712068efd0d9a8: stopping tablet replica
I20260709 12:26:52.940658 24534 raft_consensus.cc:2243] T 98b5b180139845c99c537cd675a60830 P aa098a557d34433896712068efd0d9a8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:52.941582 24534 raft_consensus.cc:2272] T 98b5b180139845c99c537cd675a60830 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.943945 24534 tablet_replica.cc:333] T ac8f3ce8c750468c966a23ea2787b888 P aa098a557d34433896712068efd0d9a8: stopping tablet replica
I20260709 12:26:52.944634 24534 raft_consensus.cc:2243] T ac8f3ce8c750468c966a23ea2787b888 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.945228 24534 raft_consensus.cc:2272] T ac8f3ce8c750468c966a23ea2787b888 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:52.945297  1112 consensus_peers.cc:597] T 0c434afb0b164ab5b38dea54bfcebfe8 P 8fa35514a8d84740b1b46ae496307f20 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:52.947717 24534 tablet_replica.cc:333] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P aa098a557d34433896712068efd0d9a8: stopping tablet replica
I20260709 12:26:52.948369 24534 raft_consensus.cc:2243] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.948832 24534 raft_consensus.cc:2272] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.950718 24534 tablet_replica.cc:333] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P aa098a557d34433896712068efd0d9a8: stopping tablet replica
I20260709 12:26:52.951277 24534 raft_consensus.cc:2243] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.951721 24534 raft_consensus.cc:2272] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.953580 24534 tablet_replica.cc:333] T 0e2eae4c387445f39a059befe390fe45 P aa098a557d34433896712068efd0d9a8: stopping tablet replica
I20260709 12:26:52.954098 24534 raft_consensus.cc:2243] T 0e2eae4c387445f39a059befe390fe45 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:52.954499 24534 raft_consensus.cc:2272] T 0e2eae4c387445f39a059befe390fe45 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:52.956288 24534 tablet_replica.cc:333] T 70720af8528947a89c03ec468c1235eb P aa098a557d34433896712068efd0d9a8: stopping tablet replica
I20260709 12:26:52.956936 24534 raft_consensus.cc:2243] T 70720af8528947a89c03ec468c1235eb P aa098a557d34433896712068efd0d9a8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:52.957816 24534 raft_consensus.cc:2272] T 70720af8528947a89c03ec468c1235eb P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:52.972384  1038 consensus_peers.cc:597] T 284ea666431c4339998eb885cd31facb P 7f9cbe40e40d429aa004e4a7fb42f132 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:52.985790  1186 consensus_peers.cc:597] T c495ce9da627479e92d7b24b3be3641a P 937efeddef934b2b8bc8632594903085 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:53.013377  1038 consensus_peers.cc:597] T 3a19a87d91404b73bdba7121512bf7aa P 7f9cbe40e40d429aa004e4a7fb42f132 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:53.013424  1112 consensus_peers.cc:597] T 0017925ea1bb4374b09c9e692a17f87e P 8fa35514a8d84740b1b46ae496307f20 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:53.026417  1186 consensus_peers.cc:597] T 4d899bdd8a44422ca2a8036f84e9f9f3 P 937efeddef934b2b8bc8632594903085 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:53.027585  1112 consensus_peers.cc:597] T 5302c354091f4926812eb90f518b9d6a P 8fa35514a8d84740b1b46ae496307f20 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:53.032541 24534 tablet_server.cc:196] TabletServer@127.23.245.129:0 shutdown complete.
W20260709 12:26:53.041376  1186 consensus_peers.cc:597] T c5197f4025d94ce096c14c6ca011b47b P 937efeddef934b2b8bc8632594903085 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:53.097848 24534 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:53.099772  1186 consensus_peers.cc:597] T e12f4bd1b2ed49988317684782c8616b P 937efeddef934b2b8bc8632594903085 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:53.106604  1779 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:53.106623  1780 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:53.106690  1782 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:53.109609 24534 server_base.cc:1061] running on GCE node
I20260709 12:26:53.112238 24534 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:53.112550 24534 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:53.112773 24534 hybrid_clock.cc:648] HybridClock initialized: now 1783600013112757 us; error 0 us; skew 500 ppm
I20260709 12:26:53.113305 24534 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:53.116117 24534 webserver.cc:533] Webserver started at http://127.23.245.129:35951/ using document root <none> and password file <none>
I20260709 12:26:53.116596 24534 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:53.116819 24534 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:26:53.120777 24534 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.000s	sys 0.004s
I20260709 12:26:53.128742  1787 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:53.129714 24534 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.004s
I20260709 12:26:53.130132 24534 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599704270295-24534-0/minicluster-data/ts-0-root
uuid: "aa098a557d34433896712068efd0d9a8"
format_stamp: "Formatted at 2026-07-09 12:26:39 on dist-test-slave-mlt7"
I20260709 12:26:53.130692 24534 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599704270295-24534-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599704270295-24534-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599704270295-24534-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 12:26:53.142474  1112 consensus_peers.cc:597] T 040ea9f986ee4ed29b941698c802c501 P 8fa35514a8d84740b1b46ae496307f20 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:53.150892 24534 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:53.152441 24534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:53.153970 24534 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:53.158562  1794 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 12:26:53.174044  1186 consensus_peers.cc:597] T c97b34e374ed4aec812cc43e2a5f07de P 937efeddef934b2b8bc8632594903085 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:53.177194  1112 consensus_peers.cc:597] T 333930b9df5744d59ab498b170a35315 P 8fa35514a8d84740b1b46ae496307f20 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:53.190304  1186 consensus_peers.cc:597] T c36d0201599a49169424a6b75f5349f2 P 937efeddef934b2b8bc8632594903085 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:53.253554  1112 consensus_peers.cc:597] T 95743acb416b403b9bfb59afe5bf2fe7 P 8fa35514a8d84740b1b46ae496307f20 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:53.253588  1186 consensus_peers.cc:597] T 580f367489064e218eef65b4654744b8 P 937efeddef934b2b8bc8632594903085 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:53.264752  1112 consensus_peers.cc:597] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P 8fa35514a8d84740b1b46ae496307f20 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:53.285578  1038 consensus_peers.cc:597] T 329e639d23154fb6bd4ccdf095dbd0e0 P 7f9cbe40e40d429aa004e4a7fb42f132 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:53.324759  1112 consensus_peers.cc:597] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 8fa35514a8d84740b1b46ae496307f20 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:53.326833  1038 consensus_peers.cc:597] T 74e3cbe3521a46cfb42a6cb7ba98430c P 7f9cbe40e40d429aa004e4a7fb42f132 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:53.329734  1112 consensus_peers.cc:597] T 1d925407b8314f5b95a8c940f195433a P 8fa35514a8d84740b1b46ae496307f20 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:53.455217 24534 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 12:26:53.455598 24534 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.298s	user 0.007s	sys 0.002s
I20260709 12:26:53.455991 24534 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 12:26:53.461308  1794 tablet_bootstrap.cc:492] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:53.500257  1794 tablet_bootstrap.cc:492] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P aa098a557d34433896712068efd0d9a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:53.501291  1794 tablet_bootstrap.cc:492] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P aa098a557d34433896712068efd0d9a8: Bootstrap complete.
I20260709 12:26:53.502002  1794 ts_tablet_manager.cc:1403] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.041s	user 0.020s	sys 0.012s
I20260709 12:26:53.504647  1794 raft_consensus.cc:359] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:53.505429  1794 raft_consensus.cc:740] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.506094  1794 consensus_queue.cc:260] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:53.508965  1794 ts_tablet_manager.cc:1434] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:26:53.509785  1794 tablet_bootstrap.cc:492] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:53.522135  1794 tablet_bootstrap.cc:492] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P aa098a557d34433896712068efd0d9a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:53.523002  1794 tablet_bootstrap.cc:492] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P aa098a557d34433896712068efd0d9a8: Bootstrap complete.
I20260709 12:26:53.523536  1794 ts_tablet_manager.cc:1403] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 12:26:53.525557  1794 raft_consensus.cc:359] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:53.526103  1794 raft_consensus.cc:740] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.526863  1794 consensus_queue.cc:260] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:53.528645  1794 ts_tablet_manager.cc:1434] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.004s
I20260709 12:26:53.533004  1794 tablet_bootstrap.cc:492] T de3dd28c345442b38f399c5db383c5b2 P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:53.566560  1794 tablet_bootstrap.cc:492] T de3dd28c345442b38f399c5db383c5b2 P aa098a557d34433896712068efd0d9a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:53.567600  1794 tablet_bootstrap.cc:492] T de3dd28c345442b38f399c5db383c5b2 P aa098a557d34433896712068efd0d9a8: Bootstrap complete.
I20260709 12:26:53.568244  1794 ts_tablet_manager.cc:1403] T de3dd28c345442b38f399c5db383c5b2 P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.035s	user 0.018s	sys 0.006s
I20260709 12:26:53.570719  1794 raft_consensus.cc:359] T de3dd28c345442b38f399c5db383c5b2 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:53.571394  1794 raft_consensus.cc:740] T de3dd28c345442b38f399c5db383c5b2 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.572101  1794 consensus_queue.cc:260] T de3dd28c345442b38f399c5db383c5b2 P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:53.573473  1794 ts_tablet_manager.cc:1434] T de3dd28c345442b38f399c5db383c5b2 P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:26:53.574007  1794 tablet_bootstrap.cc:492] T 329e639d23154fb6bd4ccdf095dbd0e0 P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:53.588192  1794 tablet_bootstrap.cc:492] T 329e639d23154fb6bd4ccdf095dbd0e0 P aa098a557d34433896712068efd0d9a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:53.589193  1794 tablet_bootstrap.cc:492] T 329e639d23154fb6bd4ccdf095dbd0e0 P aa098a557d34433896712068efd0d9a8: Bootstrap complete.
I20260709 12:26:53.589833  1794 ts_tablet_manager.cc:1403] T 329e639d23154fb6bd4ccdf095dbd0e0 P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.008s
I20260709 12:26:53.591876  1794 raft_consensus.cc:359] T 329e639d23154fb6bd4ccdf095dbd0e0 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:53.592597  1794 raft_consensus.cc:740] T 329e639d23154fb6bd4ccdf095dbd0e0 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.593253  1794 consensus_queue.cc:260] T 329e639d23154fb6bd4ccdf095dbd0e0 P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:53.595109  1794 ts_tablet_manager.cc:1434] T 329e639d23154fb6bd4ccdf095dbd0e0 P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 12:26:53.595890  1794 tablet_bootstrap.cc:492] T 1d925407b8314f5b95a8c940f195433a P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:53.609014  1794 tablet_bootstrap.cc:492] T 1d925407b8314f5b95a8c940f195433a P aa098a557d34433896712068efd0d9a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:53.609859  1794 tablet_bootstrap.cc:492] T 1d925407b8314f5b95a8c940f195433a P aa098a557d34433896712068efd0d9a8: Bootstrap complete.
I20260709 12:26:53.610389  1794 ts_tablet_manager.cc:1403] T 1d925407b8314f5b95a8c940f195433a P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.004s
I20260709 12:26:53.612390  1794 raft_consensus.cc:359] T 1d925407b8314f5b95a8c940f195433a P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:53.612913  1794 raft_consensus.cc:740] T 1d925407b8314f5b95a8c940f195433a P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.613510  1794 consensus_queue.cc:260] T 1d925407b8314f5b95a8c940f195433a P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:53.614882  1794 ts_tablet_manager.cc:1434] T 1d925407b8314f5b95a8c940f195433a P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:26:53.615522  1794 tablet_bootstrap.cc:492] T 6715731f9a31415a98fa8a0ab9944eec P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:53.626808  1794 tablet_bootstrap.cc:492] T 6715731f9a31415a98fa8a0ab9944eec P aa098a557d34433896712068efd0d9a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:53.627763  1794 tablet_bootstrap.cc:492] T 6715731f9a31415a98fa8a0ab9944eec P aa098a557d34433896712068efd0d9a8: Bootstrap complete.
I20260709 12:26:53.628435  1794 ts_tablet_manager.cc:1403] T 6715731f9a31415a98fa8a0ab9944eec P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 12:26:53.630687  1794 raft_consensus.cc:359] T 6715731f9a31415a98fa8a0ab9944eec P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:53.631366  1794 raft_consensus.cc:740] T 6715731f9a31415a98fa8a0ab9944eec P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.632037  1794 consensus_queue.cc:260] T 6715731f9a31415a98fa8a0ab9944eec P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:53.633922  1794 ts_tablet_manager.cc:1434] T 6715731f9a31415a98fa8a0ab9944eec P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:26:53.634599  1794 tablet_bootstrap.cc:492] T 3d2ccd742ac442419de89cb38ee12d37 P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:53.649674  1794 tablet_bootstrap.cc:492] T 3d2ccd742ac442419de89cb38ee12d37 P aa098a557d34433896712068efd0d9a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:53.651003  1794 tablet_bootstrap.cc:492] T 3d2ccd742ac442419de89cb38ee12d37 P aa098a557d34433896712068efd0d9a8: Bootstrap complete.
I20260709 12:26:53.651633  1794 ts_tablet_manager.cc:1403] T 3d2ccd742ac442419de89cb38ee12d37 P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.004s
I20260709 12:26:53.653892  1794 raft_consensus.cc:359] T 3d2ccd742ac442419de89cb38ee12d37 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:53.654592  1794 raft_consensus.cc:740] T 3d2ccd742ac442419de89cb38ee12d37 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.655494  1794 consensus_queue.cc:260] T 3d2ccd742ac442419de89cb38ee12d37 P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:53.657646  1794 ts_tablet_manager.cc:1434] T 3d2ccd742ac442419de89cb38ee12d37 P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:26:53.658481  1794 tablet_bootstrap.cc:492] T 5302c354091f4926812eb90f518b9d6a P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:53.672092  1794 tablet_bootstrap.cc:492] T 5302c354091f4926812eb90f518b9d6a P aa098a557d34433896712068efd0d9a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:53.672981  1794 tablet_bootstrap.cc:492] T 5302c354091f4926812eb90f518b9d6a P aa098a557d34433896712068efd0d9a8: Bootstrap complete.
I20260709 12:26:53.673568  1794 ts_tablet_manager.cc:1403] T 5302c354091f4926812eb90f518b9d6a P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.004s
I20260709 12:26:53.675901  1794 raft_consensus.cc:359] T 5302c354091f4926812eb90f518b9d6a P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:53.676563  1794 raft_consensus.cc:740] T 5302c354091f4926812eb90f518b9d6a P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.677301  1794 consensus_queue.cc:260] T 5302c354091f4926812eb90f518b9d6a P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:53.681061  1794 ts_tablet_manager.cc:1434] T 5302c354091f4926812eb90f518b9d6a P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:26:53.681926  1794 tablet_bootstrap.cc:492] T 74e3cbe3521a46cfb42a6cb7ba98430c P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:53.696735  1794 tablet_bootstrap.cc:492] T 74e3cbe3521a46cfb42a6cb7ba98430c P aa098a557d34433896712068efd0d9a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:53.697438  1794 tablet_bootstrap.cc:492] T 74e3cbe3521a46cfb42a6cb7ba98430c P aa098a557d34433896712068efd0d9a8: Bootstrap complete.
I20260709 12:26:53.697944  1794 ts_tablet_manager.cc:1403] T 74e3cbe3521a46cfb42a6cb7ba98430c P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.006s
I20260709 12:26:53.699730  1794 raft_consensus.cc:359] T 74e3cbe3521a46cfb42a6cb7ba98430c P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:53.700331  1794 raft_consensus.cc:740] T 74e3cbe3521a46cfb42a6cb7ba98430c P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.700839  1794 consensus_queue.cc:260] T 74e3cbe3521a46cfb42a6cb7ba98430c P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:53.702265  1794 ts_tablet_manager.cc:1434] T 74e3cbe3521a46cfb42a6cb7ba98430c P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.002s
I20260709 12:26:53.702909  1794 tablet_bootstrap.cc:492] T 343e626d0073462fa2020fcf2e2f8ffb P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:53.738184  1794 tablet_bootstrap.cc:492] T 343e626d0073462fa2020fcf2e2f8ffb P aa098a557d34433896712068efd0d9a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:53.739073  1794 tablet_bootstrap.cc:492] T 343e626d0073462fa2020fcf2e2f8ffb P aa098a557d34433896712068efd0d9a8: Bootstrap complete.
I20260709 12:26:53.739682  1794 ts_tablet_manager.cc:1403] T 343e626d0073462fa2020fcf2e2f8ffb P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.037s	user 0.016s	sys 0.004s
I20260709 12:26:53.741423 24534 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 12:26:53.741796 24534 ts_tablet_manager.cc:595] Time spent register tablets: real 0.286s	user 0.227s	sys 0.001s
I20260709 12:26:53.741854  1794 raft_consensus.cc:359] T 343e626d0073462fa2020fcf2e2f8ffb P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:53.742658  1794 raft_consensus.cc:740] T 343e626d0073462fa2020fcf2e2f8ffb P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.743438  1794 consensus_queue.cc:260] T 343e626d0073462fa2020fcf2e2f8ffb P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:53.745486  1794 ts_tablet_manager.cc:1434] T 343e626d0073462fa2020fcf2e2f8ffb P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:26:53.746219  1794 tablet_bootstrap.cc:492] T 5b3d71845177478a9e2510c82e0cf9d1 P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:53.829216  1797 raft_consensus.cc:493] T b364263cacab4add984e2b6c912fb62e P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aa098a557d34433896712068efd0d9a8)
I20260709 12:26:53.829952  1797 raft_consensus.cc:515] T b364263cacab4add984e2b6c912fb62e P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:53.838981  1794 tablet_bootstrap.cc:492] T 5b3d71845177478a9e2510c82e0cf9d1 P aa098a557d34433896712068efd0d9a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:53.840087  1794 tablet_bootstrap.cc:492] T 5b3d71845177478a9e2510c82e0cf9d1 P aa098a557d34433896712068efd0d9a8: Bootstrap complete.
I20260709 12:26:53.840770  1794 ts_tablet_manager.cc:1403] T 5b3d71845177478a9e2510c82e0cf9d1 P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.095s	user 0.045s	sys 0.035s
W20260709 12:26:53.842932  1038 leader_election.cc:336] T b364263cacab4add984e2b6c912fb62e P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111)
I20260709 12:26:53.843653  1794 raft_consensus.cc:359] T 5b3d71845177478a9e2510c82e0cf9d1 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:53.844022  1797 leader_election.cc:290] T b364263cacab4add984e2b6c912fb62e P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341)
I20260709 12:26:53.844470  1794 raft_consensus.cc:740] T 5b3d71845177478a9e2510c82e0cf9d1 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.845309  1794 consensus_queue.cc:260] T 5b3d71845177478a9e2510c82e0cf9d1 P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:53.847259  1794 ts_tablet_manager.cc:1434] T 5b3d71845177478a9e2510c82e0cf9d1 P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:26:53.848073  1794 tablet_bootstrap.cc:492] T ec806598903e4f88a40176e07ca4fad0 P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:53.867662  1142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b364263cacab4add984e2b6c912fb62e" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:53.873426  1508 raft_consensus.cc:493] T 98b5b180139845c99c537cd675a60830 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aa098a557d34433896712068efd0d9a8)
I20260709 12:26:53.874008  1508 raft_consensus.cc:515] T 98b5b180139845c99c537cd675a60830 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:53.876435  1795 raft_consensus.cc:493] T c4234c6cf75048c5a6cdf34e43c9bd1e P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aa098a557d34433896712068efd0d9a8)
I20260709 12:26:53.877009  1795 raft_consensus.cc:515] T c4234c6cf75048c5a6cdf34e43c9bd1e P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:53.879303  1795 leader_election.cc:290] T c4234c6cf75048c5a6cdf34e43c9bd1e P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:53.879990  1038 leader_election.cc:304] T b364263cacab4add984e2b6c912fb62e P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132; no voters: 8fa35514a8d84740b1b46ae496307f20, aa098a557d34433896712068efd0d9a8
I20260709 12:26:53.880448  1072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b5b180139845c99c537cd675a60830" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:53.881945  1794 tablet_bootstrap.cc:492] T ec806598903e4f88a40176e07ca4fad0 P aa098a557d34433896712068efd0d9a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:53.881866  1142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4234c6cf75048c5a6cdf34e43c9bd1e" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:53.883241  1794 tablet_bootstrap.cc:492] T ec806598903e4f88a40176e07ca4fad0 P aa098a557d34433896712068efd0d9a8: Bootstrap complete.
I20260709 12:26:53.884148  1794 ts_tablet_manager.cc:1403] T ec806598903e4f88a40176e07ca4fad0 P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.036s	user 0.029s	sys 0.004s
I20260709 12:26:53.881976  1797 raft_consensus.cc:2749] T b364263cacab4add984e2b6c912fb62e P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:53.888724  1508 leader_election.cc:290] T 98b5b180139845c99c537cd675a60830 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
W20260709 12:26:53.889946  1186 leader_election.cc:336] T 98b5b180139845c99c537cd675a60830 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111)
I20260709 12:26:53.889798  1794 raft_consensus.cc:359] T ec806598903e4f88a40176e07ca4fad0 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:53.890722  1186 leader_election.cc:304] T 98b5b180139845c99c537cd675a60830 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 937efeddef934b2b8bc8632594903085; no voters: 7f9cbe40e40d429aa004e4a7fb42f132, aa098a557d34433896712068efd0d9a8
I20260709 12:26:53.890873  1794 raft_consensus.cc:740] T ec806598903e4f88a40176e07ca4fad0 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.891629  1508 raft_consensus.cc:2749] T 98b5b180139845c99c537cd675a60830 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:53.891932  1794 consensus_queue.cc:260] T ec806598903e4f88a40176e07ca4fad0 P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:53.894816  1794 ts_tablet_manager.cc:1434] T ec806598903e4f88a40176e07ca4fad0 P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
W20260709 12:26:53.895448  1186 leader_election.cc:336] T c4234c6cf75048c5a6cdf34e43c9bd1e P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111)
I20260709 12:26:53.895815  1794 tablet_bootstrap.cc:492] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:53.895888  1186 leader_election.cc:304] T c4234c6cf75048c5a6cdf34e43c9bd1e P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 937efeddef934b2b8bc8632594903085; no voters: 8fa35514a8d84740b1b46ae496307f20, aa098a557d34433896712068efd0d9a8
I20260709 12:26:53.898809  1795 raft_consensus.cc:2749] T c4234c6cf75048c5a6cdf34e43c9bd1e P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:53.914526  1794 tablet_bootstrap.cc:492] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P aa098a557d34433896712068efd0d9a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:53.915527  1794 tablet_bootstrap.cc:492] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P aa098a557d34433896712068efd0d9a8: Bootstrap complete.
I20260709 12:26:53.916220  1794 ts_tablet_manager.cc:1403] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.007s
I20260709 12:26:53.918593  1794 raft_consensus.cc:359] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:53.919214  1794 raft_consensus.cc:740] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.919844  1794 consensus_queue.cc:260] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:53.922008  1794 ts_tablet_manager.cc:1434] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:26:53.922791  1794 tablet_bootstrap.cc:492] T c36d0201599a49169424a6b75f5349f2 P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:53.936094  1794 tablet_bootstrap.cc:492] T c36d0201599a49169424a6b75f5349f2 P aa098a557d34433896712068efd0d9a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:53.937093  1794 tablet_bootstrap.cc:492] T c36d0201599a49169424a6b75f5349f2 P aa098a557d34433896712068efd0d9a8: Bootstrap complete.
I20260709 12:26:53.937765  1794 ts_tablet_manager.cc:1403] T c36d0201599a49169424a6b75f5349f2 P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 12:26:53.940310  1794 raft_consensus.cc:359] T c36d0201599a49169424a6b75f5349f2 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:53.941016  1794 raft_consensus.cc:740] T c36d0201599a49169424a6b75f5349f2 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:53.941831  1794 consensus_queue.cc:260] T c36d0201599a49169424a6b75f5349f2 P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:53.944133  1794 ts_tablet_manager.cc:1434] T c36d0201599a49169424a6b75f5349f2 P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:26:53.944896  1794 tablet_bootstrap.cc:492] T e281f15348944cc1ab51fce7c1653aac P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:53.956064  1706 raft_consensus.cc:493] T b364263cacab4add984e2b6c912fb62e P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aa098a557d34433896712068efd0d9a8)
I20260709 12:26:53.956873  1706 raft_consensus.cc:515] T b364263cacab4add984e2b6c912fb62e P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:53.968961  1794 tablet_bootstrap.cc:492] T e281f15348944cc1ab51fce7c1653aac P aa098a557d34433896712068efd0d9a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:26:53.969415  1112 leader_election.cc:336] T b364263cacab4add984e2b6c912fb62e P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111)
I20260709 12:26:53.969969  1794 tablet_bootstrap.cc:492] T e281f15348944cc1ab51fce7c1653aac P aa098a557d34433896712068efd0d9a8: Bootstrap complete.
I20260709 12:26:53.972409  1794 ts_tablet_manager.cc:1403] T e281f15348944cc1ab51fce7c1653aac P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.009s
I20260709 12:26:53.972508  1706 leader_election.cc:290] T b364263cacab4add984e2b6c912fb62e P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:53.974129  1072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b364263cacab4add984e2b6c912fb62e" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:53.974808  1072 raft_consensus.cc:2468] T b364263cacab4add984e2b6c912fb62e P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 1.
I20260709 12:26:53.975960  1110 leader_election.cc:304] T b364263cacab4add984e2b6c912fb62e P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 8fa35514a8d84740b1b46ae496307f20; no voters: aa098a557d34433896712068efd0d9a8
I20260709 12:26:53.977005  1706 raft_consensus.cc:2804] T b364263cacab4add984e2b6c912fb62e P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:53.977412  1706 raft_consensus.cc:493] T b364263cacab4add984e2b6c912fb62e P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Starting leader election (detected failure of leader aa098a557d34433896712068efd0d9a8)
I20260709 12:26:53.977777  1706 raft_consensus.cc:3060] T b364263cacab4add984e2b6c912fb62e P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:53.978710  1508 raft_consensus.cc:493] T 6715731f9a31415a98fa8a0ab9944eec P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aa098a557d34433896712068efd0d9a8)
I20260709 12:26:53.979204  1508 raft_consensus.cc:515] T 6715731f9a31415a98fa8a0ab9944eec P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:53.981241  1508 leader_election.cc:290] T 6715731f9a31415a98fa8a0ab9944eec P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:53.986243  1797 raft_consensus.cc:493] T 5b3d71845177478a9e2510c82e0cf9d1 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aa098a557d34433896712068efd0d9a8)
I20260709 12:26:53.986848  1797 raft_consensus.cc:515] T 5b3d71845177478a9e2510c82e0cf9d1 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:53.995671  1142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6715731f9a31415a98fa8a0ab9944eec" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:53.996301  1797 leader_election.cc:290] T 5b3d71845177478a9e2510c82e0cf9d1 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:53.998028  1776 raft_consensus.cc:493] T 348d7f300dcb474b8b012e01d0af067f P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aa098a557d34433896712068efd0d9a8)
I20260709 12:26:53.998638  1776 raft_consensus.cc:515] T 348d7f300dcb474b8b012e01d0af067f P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:54.000380  1794 raft_consensus.cc:359] T e281f15348944cc1ab51fce7c1653aac P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:54.001142  1794 raft_consensus.cc:740] T e281f15348944cc1ab51fce7c1653aac P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.001823  1794 consensus_queue.cc:260] T e281f15348944cc1ab51fce7c1653aac P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:54.003615  1794 ts_tablet_manager.cc:1434] T e281f15348944cc1ab51fce7c1653aac P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.001s
I20260709 12:26:54.004376  1794 tablet_bootstrap.cc:492] T c4234c6cf75048c5a6cdf34e43c9bd1e P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:54.005852  1706 raft_consensus.cc:515] T b364263cacab4add984e2b6c912fb62e P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
W20260709 12:26:54.009670  1038 leader_election.cc:336] T 5b3d71845177478a9e2510c82e0cf9d1 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111)
I20260709 12:26:54.010067  1776 leader_election.cc:290] T 348d7f300dcb474b8b012e01d0af067f P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
W20260709 12:26:54.012223  1186 leader_election.cc:336] T 6715731f9a31415a98fa8a0ab9944eec P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111)
I20260709 12:26:54.012396  1219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348d7f300dcb474b8b012e01d0af067f" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:54.012735  1186 leader_election.cc:304] T 6715731f9a31415a98fa8a0ab9944eec P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 937efeddef934b2b8bc8632594903085; no voters: 8fa35514a8d84740b1b46ae496307f20, aa098a557d34433896712068efd0d9a8
W20260709 12:26:54.013051  1112 leader_election.cc:336] T b364263cacab4add984e2b6c912fb62e P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111)
I20260709 12:26:54.013396  1508 raft_consensus.cc:2749] T 6715731f9a31415a98fa8a0ab9944eec P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:54.012272  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3d71845177478a9e2510c82e0cf9d1" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:54.015198  1072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b364263cacab4add984e2b6c912fb62e" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
I20260709 12:26:54.015771  1072 raft_consensus.cc:3060] T b364263cacab4add984e2b6c912fb62e P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:54.018364  1038 leader_election.cc:336] T 348d7f300dcb474b8b012e01d0af067f P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111)
I20260709 12:26:54.019042  1038 leader_election.cc:304] T 348d7f300dcb474b8b012e01d0af067f P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132; no voters: 937efeddef934b2b8bc8632594903085, aa098a557d34433896712068efd0d9a8
I20260709 12:26:54.019865  1797 raft_consensus.cc:2749] T 348d7f300dcb474b8b012e01d0af067f P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:54.019207  1776 raft_consensus.cc:493] T ec47b02d68674e2386a86244d9026b78 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aa098a557d34433896712068efd0d9a8)
I20260709 12:26:54.023947  1035 leader_election.cc:304] T 5b3d71845177478a9e2510c82e0cf9d1 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132; no voters: 937efeddef934b2b8bc8632594903085, aa098a557d34433896712068efd0d9a8
I20260709 12:26:54.025385  1072 raft_consensus.cc:2468] T b364263cacab4add984e2b6c912fb62e P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 2.
I20260709 12:26:54.026225  1797 raft_consensus.cc:2749] T 5b3d71845177478a9e2510c82e0cf9d1 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:54.026235  1706 leader_election.cc:290] T b364263cacab4add984e2b6c912fb62e P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 2 election: Requested vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:54.021734  1776 raft_consensus.cc:515] T ec47b02d68674e2386a86244d9026b78 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:54.029570  1110 leader_election.cc:304] T b364263cacab4add984e2b6c912fb62e P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 8fa35514a8d84740b1b46ae496307f20; no voters: aa098a557d34433896712068efd0d9a8
I20260709 12:26:54.030653  1706 raft_consensus.cc:2804] T b364263cacab4add984e2b6c912fb62e P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:54.031260  1706 raft_consensus.cc:697] T b364263cacab4add984e2b6c912fb62e P 8fa35514a8d84740b1b46ae496307f20 [term 2 LEADER]: Becoming Leader. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Running, Role: LEADER
I20260709 12:26:54.032147  1735 raft_consensus.cc:493] T 348d7f300dcb474b8b012e01d0af067f P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aa098a557d34433896712068efd0d9a8)
I20260709 12:26:54.032603  1735 raft_consensus.cc:515] T 348d7f300dcb474b8b012e01d0af067f P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:54.033013  1799 raft_consensus.cc:493] T 6715731f9a31415a98fa8a0ab9944eec P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aa098a557d34433896712068efd0d9a8)
I20260709 12:26:54.033690  1799 raft_consensus.cc:515] T 6715731f9a31415a98fa8a0ab9944eec P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
W20260709 12:26:54.036722  1038 leader_election.cc:336] T ec47b02d68674e2386a86244d9026b78 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111)
I20260709 12:26:54.040995  1776 leader_election.cc:290] T ec47b02d68674e2386a86244d9026b78 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:54.032006  1706 consensus_queue.cc:237] T b364263cacab4add984e2b6c912fb62e P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:54.050855  1735 leader_election.cc:290] T 348d7f300dcb474b8b012e01d0af067f P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:54.052340  1219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6715731f9a31415a98fa8a0ab9944eec" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:54.053192  1219 raft_consensus.cc:2468] T 6715731f9a31415a98fa8a0ab9944eec P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 1.
I20260709 12:26:54.055002  1072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348d7f300dcb474b8b012e01d0af067f" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:54.055840  1072 raft_consensus.cc:2468] T 348d7f300dcb474b8b012e01d0af067f P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 1.
I20260709 12:26:54.057668  1184 leader_election.cc:304] T 348d7f300dcb474b8b012e01d0af067f P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 937efeddef934b2b8bc8632594903085; no voters: 
I20260709 12:26:54.058808  1735 raft_consensus.cc:2804] T 348d7f300dcb474b8b012e01d0af067f P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:26:54.059055  1112 leader_election.cc:336] T 6715731f9a31415a98fa8a0ab9944eec P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111)
I20260709 12:26:54.060606  1109 leader_election.cc:304] T 6715731f9a31415a98fa8a0ab9944eec P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085; no voters: aa098a557d34433896712068efd0d9a8
I20260709 12:26:54.061753  1800 raft_consensus.cc:2804] T 6715731f9a31415a98fa8a0ab9944eec P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:54.062266  1800 raft_consensus.cc:493] T 6715731f9a31415a98fa8a0ab9944eec P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Starting leader election (detected failure of leader aa098a557d34433896712068efd0d9a8)
I20260709 12:26:54.059201  1735 raft_consensus.cc:493] T 348d7f300dcb474b8b012e01d0af067f P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Starting leader election (detected failure of leader aa098a557d34433896712068efd0d9a8)
I20260709 12:26:54.062520  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec47b02d68674e2386a86244d9026b78" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:54.062880  1735 raft_consensus.cc:3060] T 348d7f300dcb474b8b012e01d0af067f P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:54.072831  1800 raft_consensus.cc:3060] T 6715731f9a31415a98fa8a0ab9944eec P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:54.077857  1508 raft_consensus.cc:493] T 70720af8528947a89c03ec468c1235eb P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aa098a557d34433896712068efd0d9a8)
I20260709 12:26:54.078408  1508 raft_consensus.cc:515] T 70720af8528947a89c03ec468c1235eb P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:54.080436  1508 leader_election.cc:290] T 70720af8528947a89c03ec468c1235eb P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:54.086383  1508 raft_consensus.cc:493] T 5b3d71845177478a9e2510c82e0cf9d1 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aa098a557d34433896712068efd0d9a8)
I20260709 12:26:54.087157  1795 raft_consensus.cc:493] T e81f2374d9904e93bf2941ff8b241c09 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aa098a557d34433896712068efd0d9a8)
I20260709 12:26:54.088207  1795 raft_consensus.cc:515] T e81f2374d9904e93bf2941ff8b241c09 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:54.089139  1799 leader_election.cc:290] T 6715731f9a31415a98fa8a0ab9944eec P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:54.090293  1795 leader_election.cc:290] T e81f2374d9904e93bf2941ff8b241c09 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:54.094185  1800 raft_consensus.cc:515] T 6715731f9a31415a98fa8a0ab9944eec P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:54.091699  1508 raft_consensus.cc:515] T 5b3d71845177478a9e2510c82e0cf9d1 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:54.097690  1508 leader_election.cc:290] T 5b3d71845177478a9e2510c82e0cf9d1 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:54.101092  1142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70720af8528947a89c03ec468c1235eb" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:54.106128  1735 raft_consensus.cc:515] T 348d7f300dcb474b8b012e01d0af067f P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:54.111032  1735 leader_election.cc:290] T 348d7f300dcb474b8b012e01d0af067f P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 2 election: Requested vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:54.115094  1800 leader_election.cc:290] T 6715731f9a31415a98fa8a0ab9944eec P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 2 election: Requested vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:54.157829  1035 leader_election.cc:304] T ec47b02d68674e2386a86244d9026b78 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132; no voters: 937efeddef934b2b8bc8632594903085, aa098a557d34433896712068efd0d9a8
I20260709 12:26:54.160583  1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "348d7f300dcb474b8b012e01d0af067f" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
I20260709 12:26:54.162194  1063 raft_consensus.cc:3060] T 348d7f300dcb474b8b012e01d0af067f P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:54.164917  1064 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3d71845177478a9e2510c82e0cf9d1" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:54.166415  1064 raft_consensus.cc:2468] T 5b3d71845177478a9e2510c82e0cf9d1 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 1.
I20260709 12:26:54.185322  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6715731f9a31415a98fa8a0ab9944eec" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085"
I20260709 12:26:54.186359  1220 raft_consensus.cc:3060] T 6715731f9a31415a98fa8a0ab9944eec P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:54.188536  1072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81f2374d9904e93bf2941ff8b241c09" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:54.190768  1184 leader_election.cc:304] T 5b3d71845177478a9e2510c82e0cf9d1 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 937efeddef934b2b8bc8632594903085; no voters: 
I20260709 12:26:54.194226  1797 raft_consensus.cc:2749] T ec47b02d68674e2386a86244d9026b78 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:54.198043  1508 raft_consensus.cc:493] T ec47b02d68674e2386a86244d9026b78 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aa098a557d34433896712068efd0d9a8)
I20260709 12:26:54.199309  1795 raft_consensus.cc:2804] T 5b3d71845177478a9e2510c82e0cf9d1 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:26:54.218185  1186 leader_election.cc:336] T 348d7f300dcb474b8b012e01d0af067f P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111)
I20260709 12:26:54.221956  1794 tablet_bootstrap.cc:492] T c4234c6cf75048c5a6cdf34e43c9bd1e P aa098a557d34433896712068efd0d9a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:54.202157  1795 raft_consensus.cc:493] T 5b3d71845177478a9e2510c82e0cf9d1 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Starting leader election (detected failure of leader aa098a557d34433896712068efd0d9a8)
I20260709 12:26:54.241276  1795 raft_consensus.cc:3060] T 5b3d71845177478a9e2510c82e0cf9d1 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:54.248039  1800 raft_consensus.cc:493] T e5af913e96004f3b8cac5fbe6ac655ac P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aa098a557d34433896712068efd0d9a8)
I20260709 12:26:54.251042  1800 raft_consensus.cc:515] T e5af913e96004f3b8cac5fbe6ac655ac P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:54.255239  1800 leader_election.cc:290] T e5af913e96004f3b8cac5fbe6ac655ac P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
W20260709 12:26:54.265466  1186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:32981, user_credentials={real_user=slave}} blocked reactor thread for 47488us
I20260709 12:26:54.264791   894 catalog_manager.cc:5697] T b364263cacab4add984e2b6c912fb62e P 8fa35514a8d84740b1b46ae496307f20 reported cstate change: term changed from 1 to 2, leader changed from aa098a557d34433896712068efd0d9a8 (127.23.245.129) to 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131). New cstate: current_term: 2 leader_uuid: "8fa35514a8d84740b1b46ae496307f20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:54.276162  1508 raft_consensus.cc:515] T ec47b02d68674e2386a86244d9026b78 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:54.249799  1794 tablet_bootstrap.cc:492] T c4234c6cf75048c5a6cdf34e43c9bd1e P aa098a557d34433896712068efd0d9a8: Bootstrap complete.
I20260709 12:26:54.297013  1794 ts_tablet_manager.cc:1403] T c4234c6cf75048c5a6cdf34e43c9bd1e P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.293s	user 0.016s	sys 0.005s
I20260709 12:26:54.298138  1508 leader_election.cc:290] T ec47b02d68674e2386a86244d9026b78 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:54.284137  1854 raft_consensus.cc:493] T 98b5b180139845c99c537cd675a60830 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aa098a557d34433896712068efd0d9a8)
I20260709 12:26:54.303663  1072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5af913e96004f3b8cac5fbe6ac655ac" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:54.304759  1220 raft_consensus.cc:2468] T 6715731f9a31415a98fa8a0ab9944eec P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 2.
I20260709 12:26:54.295277  1063 raft_consensus.cc:2468] T 348d7f300dcb474b8b012e01d0af067f P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 2.
I20260709 12:26:54.314271  1707 raft_consensus.cc:493] T c4234c6cf75048c5a6cdf34e43c9bd1e P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aa098a557d34433896712068efd0d9a8)
I20260709 12:26:54.315274  1707 raft_consensus.cc:515] T c4234c6cf75048c5a6cdf34e43c9bd1e P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:54.300578  1854 raft_consensus.cc:515] T 98b5b180139845c99c537cd675a60830 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:54.318953  1707 leader_election.cc:290] T c4234c6cf75048c5a6cdf34e43c9bd1e P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:54.321480  1854 leader_election.cc:290] T 98b5b180139845c99c537cd675a60830 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:54.322610  1066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec47b02d68674e2386a86244d9026b78" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:54.323623  1066 raft_consensus.cc:2468] T ec47b02d68674e2386a86244d9026b78 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 1.
I20260709 12:26:54.329830  1795 raft_consensus.cc:515] T 5b3d71845177478a9e2510c82e0cf9d1 P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
W20260709 12:26:54.330509  1038 leader_election.cc:336] T 98b5b180139845c99c537cd675a60830 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111)
I20260709 12:26:54.331513  1706 raft_consensus.cc:493] T 70720af8528947a89c03ec468c1235eb P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aa098a557d34433896712068efd0d9a8)
I20260709 12:26:54.339545  1795 leader_election.cc:290] T 5b3d71845177478a9e2510c82e0cf9d1 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 2 election: Requested vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:54.332434  1706 raft_consensus.cc:515] T 70720af8528947a89c03ec468c1235eb P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:54.339154  1794 raft_consensus.cc:359] T c4234c6cf75048c5a6cdf34e43c9bd1e P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:54.342239  1794 raft_consensus.cc:740] T c4234c6cf75048c5a6cdf34e43c9bd1e P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.352702  1794 consensus_queue.cc:260] T c4234c6cf75048c5a6cdf34e43c9bd1e P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:54.359304  1706 leader_election.cc:290] T 70720af8528947a89c03ec468c1235eb P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:54.377818  1794 ts_tablet_manager.cc:1434] T c4234c6cf75048c5a6cdf34e43c9bd1e P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.080s	user 0.012s	sys 0.000s
I20260709 12:26:54.378254  1855 raft_consensus.cc:493] T e81f2374d9904e93bf2941ff8b241c09 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aa098a557d34433896712068efd0d9a8)
W20260709 12:26:54.378816  1112 leader_election.cc:336] T 6715731f9a31415a98fa8a0ab9944eec P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111)
I20260709 12:26:54.386276  1794 tablet_bootstrap.cc:492] T a93df19c4206495e971bc5e95a2111bc P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:54.388314  1589 raft_consensus.cc:493] T e5af913e96004f3b8cac5fbe6ac655ac P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader aa098a557d34433896712068efd0d9a8)
I20260709 12:26:54.388342  1216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b5b180139845c99c537cd675a60830" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:54.389462  1216 raft_consensus.cc:2468] T 98b5b180139845c99c537cd675a60830 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f9cbe40e40d429aa004e4a7fb42f132 in term 1.
I20260709 12:26:54.389209  1589 raft_consensus.cc:515] T e5af913e96004f3b8cac5fbe6ac655ac P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:54.379138  1855 raft_consensus.cc:515] T e81f2374d9904e93bf2941ff8b241c09 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:54.397751  1855 leader_election.cc:290] T e81f2374d9904e93bf2941ff8b241c09 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
W20260709 12:26:54.406183  1184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:43679, user_credentials={real_user=slave}} blocked reactor thread for 65450.4us
I20260709 12:26:54.409041  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4234c6cf75048c5a6cdf34e43c9bd1e" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:54.409847  1220 raft_consensus.cc:2468] T c4234c6cf75048c5a6cdf34e43c9bd1e P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 1.
I20260709 12:26:54.411064  1217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70720af8528947a89c03ec468c1235eb" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:54.411906  1217 raft_consensus.cc:2468] T 70720af8528947a89c03ec468c1235eb P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 1.
I20260709 12:26:54.415573  1109 leader_election.cc:304] T 6715731f9a31415a98fa8a0ab9944eec P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085; no voters: aa098a557d34433896712068efd0d9a8
W20260709 12:26:54.416949  1112 leader_election.cc:336] T e5af913e96004f3b8cac5fbe6ac655ac P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111)
I20260709 12:26:54.417487  1112 leader_election.cc:304] T e5af913e96004f3b8cac5fbe6ac655ac P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20; no voters: 7f9cbe40e40d429aa004e4a7fb42f132, aa098a557d34433896712068efd0d9a8
I20260709 12:26:54.418133  1860 raft_consensus.cc:2804] T 6715731f9a31415a98fa8a0ab9944eec P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:54.419994  1860 raft_consensus.cc:697] T 6715731f9a31415a98fa8a0ab9944eec P 8fa35514a8d84740b1b46ae496307f20 [term 2 LEADER]: Becoming Leader. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Running, Role: LEADER
I20260709 12:26:54.421787  1141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5af913e96004f3b8cac5fbe6ac655ac" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:54.422410  1860 consensus_queue.cc:237] T 6715731f9a31415a98fa8a0ab9944eec P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:54.422910  1141 raft_consensus.cc:2468] T e5af913e96004f3b8cac5fbe6ac655ac P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f9cbe40e40d429aa004e4a7fb42f132 in term 1.
I20260709 12:26:54.405746  1589 leader_election.cc:290] T e5af913e96004f3b8cac5fbe6ac655ac P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341)
I20260709 12:26:54.424937  1859 raft_consensus.cc:2749] T e5af913e96004f3b8cac5fbe6ac655ac P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:54.425884  1184 leader_election.cc:304] T ec47b02d68674e2386a86244d9026b78 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 937efeddef934b2b8bc8632594903085; no voters: 
I20260709 12:26:54.441699  1184 leader_election.cc:304] T 348d7f300dcb474b8b012e01d0af067f P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 937efeddef934b2b8bc8632594903085; no voters: 
W20260709 12:26:54.444909  1186 leader_election.cc:336] T 70720af8528947a89c03ec468c1235eb P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111)
I20260709 12:26:54.447576  1186 leader_election.cc:304] T 70720af8528947a89c03ec468c1235eb P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 937efeddef934b2b8bc8632594903085; no voters: 8fa35514a8d84740b1b46ae496307f20, aa098a557d34433896712068efd0d9a8
I20260709 12:26:54.448634  1851 raft_consensus.cc:2749] T 70720af8528947a89c03ec468c1235eb P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:26:54.449957  1186 leader_election.cc:336] T e81f2374d9904e93bf2941ff8b241c09 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111)
I20260709 12:26:54.450466  1186 leader_election.cc:304] T e81f2374d9904e93bf2941ff8b241c09 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 937efeddef934b2b8bc8632594903085; no voters: 7f9cbe40e40d429aa004e4a7fb42f132, aa098a557d34433896712068efd0d9a8
W20260709 12:26:54.451747  1038 leader_election.cc:336] T e5af913e96004f3b8cac5fbe6ac655ac P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111)
I20260709 12:26:54.445204  1109 leader_election.cc:304] T c4234c6cf75048c5a6cdf34e43c9bd1e P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085; no voters: 
I20260709 12:26:54.456641  1109 leader_election.cc:304] T 70720af8528947a89c03ec468c1235eb P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085; no voters: 
I20260709 12:26:54.456915  1863 raft_consensus.cc:2749] T e81f2374d9904e93bf2941ff8b241c09 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:54.457753  1856 raft_consensus.cc:2804] T c4234c6cf75048c5a6cdf34e43c9bd1e P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:54.458240  1856 raft_consensus.cc:493] T c4234c6cf75048c5a6cdf34e43c9bd1e P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Starting leader election (detected failure of leader aa098a557d34433896712068efd0d9a8)
I20260709 12:26:54.458657  1856 raft_consensus.cc:3060] T c4234c6cf75048c5a6cdf34e43c9bd1e P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:54.459555  1186 leader_election.cc:336] T 5b3d71845177478a9e2510c82e0cf9d1 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111)
I20260709 12:26:54.447067  1795 raft_consensus.cc:2804] T 348d7f300dcb474b8b012e01d0af067f P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:54.446921  1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3d71845177478a9e2510c82e0cf9d1" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
I20260709 12:26:54.468098  1063 raft_consensus.cc:3060] T 5b3d71845177478a9e2510c82e0cf9d1 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:54.446007  1735 raft_consensus.cc:2804] T ec47b02d68674e2386a86244d9026b78 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:54.469117  1735 raft_consensus.cc:493] T ec47b02d68674e2386a86244d9026b78 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Starting leader election (detected failure of leader aa098a557d34433896712068efd0d9a8)
I20260709 12:26:54.469521  1735 raft_consensus.cc:3060] T ec47b02d68674e2386a86244d9026b78 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:54.472625  1038 leader_election.cc:336] T e81f2374d9904e93bf2941ff8b241c09 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111)
I20260709 12:26:54.475545  1035 leader_election.cc:304] T 98b5b180139845c99c537cd675a60830 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 937efeddef934b2b8bc8632594903085; no voters: aa098a557d34433896712068efd0d9a8
I20260709 12:26:54.477810  1776 raft_consensus.cc:2804] T 98b5b180139845c99c537cd675a60830 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:54.478169  1776 raft_consensus.cc:493] T 98b5b180139845c99c537cd675a60830 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Starting leader election (detected failure of leader aa098a557d34433896712068efd0d9a8)
I20260709 12:26:54.478562  1776 raft_consensus.cc:3060] T 98b5b180139845c99c537cd675a60830 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:54.479442  1072 raft_consensus.cc:1275] T b364263cacab4add984e2b6c912fb62e P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Refusing update from remote peer 8fa35514a8d84740b1b46ae496307f20: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:54.473173  1795 raft_consensus.cc:697] T 348d7f300dcb474b8b012e01d0af067f P 937efeddef934b2b8bc8632594903085 [term 2 LEADER]: Becoming Leader. State: Replica: 937efeddef934b2b8bc8632594903085, State: Running, Role: LEADER
I20260709 12:26:54.481312  1795 consensus_queue.cc:237] T 348d7f300dcb474b8b012e01d0af067f P 937efeddef934b2b8bc8632594903085 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:54.464406  1800 raft_consensus.cc:2804] T 70720af8528947a89c03ec468c1235eb P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:54.490142  1799 consensus_queue.cc:1048] T b364263cacab4add984e2b6c912fb62e P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:54.492343  1216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81f2374d9904e93bf2941ff8b241c09" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
W20260709 12:26:54.493163  1186 leader_election.cc:336] T 348d7f300dcb474b8b012e01d0af067f P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111)
I20260709 12:26:54.492894  1856 raft_consensus.cc:515] T c4234c6cf75048c5a6cdf34e43c9bd1e P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:54.488446  1735 raft_consensus.cc:515] T ec47b02d68674e2386a86244d9026b78 P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:54.509826  1038 leader_election.cc:304] T e5af913e96004f3b8cac5fbe6ac655ac P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 8fa35514a8d84740b1b46ae496307f20; no voters: aa098a557d34433896712068efd0d9a8
I20260709 12:26:54.512804  1216 raft_consensus.cc:2468] T e81f2374d9904e93bf2941ff8b241c09 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f9cbe40e40d429aa004e4a7fb42f132 in term 1.
W20260709 12:26:54.514148  1186 leader_election.cc:336] T ec47b02d68674e2386a86244d9026b78 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111)
W20260709 12:26:54.515515  1112 leader_election.cc:336] T c4234c6cf75048c5a6cdf34e43c9bd1e P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111)
I20260709 12:26:54.516757  1735 leader_election.cc:290] T ec47b02d68674e2386a86244d9026b78 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 2 election: Requested vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
W20260709 12:26:54.517072  1112 leader_election.cc:336] T 70720af8528947a89c03ec468c1235eb P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111)
I20260709 12:26:54.521958  1035 leader_election.cc:304] T e81f2374d9904e93bf2941ff8b241c09 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 937efeddef934b2b8bc8632594903085; no voters: aa098a557d34433896712068efd0d9a8
I20260709 12:26:54.523073  1854 raft_consensus.cc:2804] T e81f2374d9904e93bf2941ff8b241c09 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:54.523531  1854 raft_consensus.cc:493] T e81f2374d9904e93bf2941ff8b241c09 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Starting leader election (detected failure of leader aa098a557d34433896712068efd0d9a8)
I20260709 12:26:54.507597  1776 raft_consensus.cc:515] T 98b5b180139845c99c537cd675a60830 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:54.523965  1854 raft_consensus.cc:3060] T e81f2374d9904e93bf2941ff8b241c09 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:54.530496  1112 consensus_peers.cc:597] T b364263cacab4add984e2b6c912fb62e P 8fa35514a8d84740b1b46ae496307f20 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:54.537631  1186 leader_election.cc:336] T 5b3d71845177478a9e2510c82e0cf9d1 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111)
I20260709 12:26:54.505602  1800 raft_consensus.cc:493] T 70720af8528947a89c03ec468c1235eb P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Starting leader election (detected failure of leader aa098a557d34433896712068efd0d9a8)
I20260709 12:26:54.545568  1800 raft_consensus.cc:3060] T 70720af8528947a89c03ec468c1235eb P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:54.546279  1856 leader_election.cc:290] T c4234c6cf75048c5a6cdf34e43c9bd1e P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 2 election: Requested vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:54.548251  1589 raft_consensus.cc:2804] T e5af913e96004f3b8cac5fbe6ac655ac P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:26:54.549567  1589 raft_consensus.cc:493] T e5af913e96004f3b8cac5fbe6ac655ac P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Starting leader election (detected failure of leader aa098a557d34433896712068efd0d9a8)
I20260709 12:26:54.549990  1589 raft_consensus.cc:3060] T e5af913e96004f3b8cac5fbe6ac655ac P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:54.548950  1216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4234c6cf75048c5a6cdf34e43c9bd1e" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085"
W20260709 12:26:54.556622  1038 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:40341, user_credentials={real_user=slave}} blocked reactor thread for 47957.1us
I20260709 12:26:54.557076  1776 leader_election.cc:290] T 98b5b180139845c99c537cd675a60830 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 2 election: Requested vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:54.559441  1854 raft_consensus.cc:515] T e81f2374d9904e93bf2941ff8b241c09 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
W20260709 12:26:54.593102  1112 leader_election.cc:336] T c4234c6cf75048c5a6cdf34e43c9bd1e P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111)
I20260709 12:26:54.594885  1854 leader_election.cc:290] T e81f2374d9904e93bf2941ff8b241c09 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 2 election: Requested vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:54.551647  1216 raft_consensus.cc:3060] T c4234c6cf75048c5a6cdf34e43c9bd1e P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:54.569150  1063 raft_consensus.cc:2468] T 5b3d71845177478a9e2510c82e0cf9d1 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 2.
I20260709 12:26:54.619849  1069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec47b02d68674e2386a86244d9026b78" candidate_uuid: "937efeddef934b2b8bc8632594903085" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
I20260709 12:26:54.621162  1215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98b5b180139845c99c537cd675a60830" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085"
I20260709 12:26:54.626984  1794 tablet_bootstrap.cc:492] T a93df19c4206495e971bc5e95a2111bc P aa098a557d34433896712068efd0d9a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:54.551704   895 catalog_manager.cc:5697] T 348d7f300dcb474b8b012e01d0af067f P 937efeddef934b2b8bc8632594903085 reported cstate change: term changed from 1 to 2, leader changed from aa098a557d34433896712068efd0d9a8 (127.23.245.129) to 937efeddef934b2b8bc8632594903085 (127.23.245.132). New cstate: current_term: 2 leader_uuid: "937efeddef934b2b8bc8632594903085" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:54.633090  1069 raft_consensus.cc:3060] T ec47b02d68674e2386a86244d9026b78 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:54.640084  1218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e81f2374d9904e93bf2941ff8b241c09" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085"
I20260709 12:26:54.640925  1218 raft_consensus.cc:3060] T e81f2374d9904e93bf2941ff8b241c09 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:54.636406  1800 raft_consensus.cc:515] T 70720af8528947a89c03ec468c1235eb P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:54.646063  1800 leader_election.cc:290] T 70720af8528947a89c03ec468c1235eb P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 2 election: Requested vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:54.649185  1794 tablet_bootstrap.cc:492] T a93df19c4206495e971bc5e95a2111bc P aa098a557d34433896712068efd0d9a8: Bootstrap complete.
I20260709 12:26:54.649624  1219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70720af8528947a89c03ec468c1235eb" candidate_uuid: "8fa35514a8d84740b1b46ae496307f20" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085"
I20260709 12:26:54.650244  1794 ts_tablet_manager.cc:1403] T a93df19c4206495e971bc5e95a2111bc P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.271s	user 0.027s	sys 0.024s
I20260709 12:26:54.658675  1794 raft_consensus.cc:359] T a93df19c4206495e971bc5e95a2111bc P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:54.667677  1794 raft_consensus.cc:740] T a93df19c4206495e971bc5e95a2111bc P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.668735  1794 consensus_queue.cc:260] T a93df19c4206495e971bc5e95a2111bc P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:54.639565  1184 leader_election.cc:304] T 5b3d71845177478a9e2510c82e0cf9d1 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 937efeddef934b2b8bc8632594903085; no voters: aa098a557d34433896712068efd0d9a8
I20260709 12:26:54.650210  1219 raft_consensus.cc:3060] T 70720af8528947a89c03ec468c1235eb P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:54.637383  1215 raft_consensus.cc:3060] T 98b5b180139845c99c537cd675a60830 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:54.672504  1186 leader_election.cc:336] T ec47b02d68674e2386a86244d9026b78 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111)
I20260709 12:26:54.682847  1863 raft_consensus.cc:2804] T 5b3d71845177478a9e2510c82e0cf9d1 P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:54.655423  1216 raft_consensus.cc:2468] T c4234c6cf75048c5a6cdf34e43c9bd1e P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 2.
I20260709 12:26:54.659440  1589 raft_consensus.cc:515] T e5af913e96004f3b8cac5fbe6ac655ac P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
W20260709 12:26:54.663157  1112 leader_election.cc:336] T 70720af8528947a89c03ec468c1235eb P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111)
I20260709 12:26:54.688228  1863 raft_consensus.cc:697] T 5b3d71845177478a9e2510c82e0cf9d1 P 937efeddef934b2b8bc8632594903085 [term 2 LEADER]: Becoming Leader. State: Replica: 937efeddef934b2b8bc8632594903085, State: Running, Role: LEADER
I20260709 12:26:54.697463  1109 leader_election.cc:304] T c4234c6cf75048c5a6cdf34e43c9bd1e P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085; no voters: aa098a557d34433896712068efd0d9a8
I20260709 12:26:54.655316  1069 raft_consensus.cc:2468] T ec47b02d68674e2386a86244d9026b78 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 937efeddef934b2b8bc8632594903085 in term 2.
I20260709 12:26:54.667034  1218 raft_consensus.cc:2468] T e81f2374d9904e93bf2941ff8b241c09 P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f9cbe40e40d429aa004e4a7fb42f132 in term 2.
I20260709 12:26:54.699378  1707 raft_consensus.cc:2804] T c4234c6cf75048c5a6cdf34e43c9bd1e P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:54.702288  1589 leader_election.cc:290] T e5af913e96004f3b8cac5fbe6ac655ac P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 2 election: Requested vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341)
I20260709 12:26:54.703644  1794 ts_tablet_manager.cc:1434] T a93df19c4206495e971bc5e95a2111bc P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.000s
I20260709 12:26:54.705329  1707 raft_consensus.cc:697] T c4234c6cf75048c5a6cdf34e43c9bd1e P 8fa35514a8d84740b1b46ae496307f20 [term 2 LEADER]: Becoming Leader. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Running, Role: LEADER
I20260709 12:26:54.709911  1035 leader_election.cc:304] T e81f2374d9904e93bf2941ff8b241c09 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 937efeddef934b2b8bc8632594903085; no voters: 
I20260709 12:26:54.710402  1184 leader_election.cc:304] T ec47b02d68674e2386a86244d9026b78 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 937efeddef934b2b8bc8632594903085; no voters: aa098a557d34433896712068efd0d9a8
I20260709 12:26:54.714458  1865 raft_consensus.cc:2804] T ec47b02d68674e2386a86244d9026b78 P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:54.718484  1219 raft_consensus.cc:2468] T 70720af8528947a89c03ec468c1235eb P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8fa35514a8d84740b1b46ae496307f20 in term 2.
I20260709 12:26:54.720144  1109 leader_election.cc:304] T 70720af8528947a89c03ec468c1235eb P 8fa35514a8d84740b1b46ae496307f20 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085; no voters: aa098a557d34433896712068efd0d9a8
I20260709 12:26:54.716393  1589 raft_consensus.cc:2804] T e81f2374d9904e93bf2941ff8b241c09 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:54.722425  1589 raft_consensus.cc:697] T e81f2374d9904e93bf2941ff8b241c09 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 LEADER]: Becoming Leader. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Running, Role: LEADER
I20260709 12:26:54.722632  1707 consensus_queue.cc:237] T c4234c6cf75048c5a6cdf34e43c9bd1e P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:54.723548  1589 consensus_queue.cc:237] T e81f2374d9904e93bf2941ff8b241c09 P 7f9cbe40e40d429aa004e4a7fb42f132 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:54.727017  1794 tablet_bootstrap.cc:492] T c5197f4025d94ce096c14c6ca011b47b P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:54.714979  1865 raft_consensus.cc:697] T ec47b02d68674e2386a86244d9026b78 P 937efeddef934b2b8bc8632594903085 [term 2 LEADER]: Becoming Leader. State: Replica: 937efeddef934b2b8bc8632594903085, State: Running, Role: LEADER
W20260709 12:26:54.730376  1038 leader_election.cc:336] T 98b5b180139845c99c537cd675a60830 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111)
I20260709 12:26:54.734449  1143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5af913e96004f3b8cac5fbe6ac655ac" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20"
I20260709 12:26:54.735126  1143 raft_consensus.cc:3060] T e5af913e96004f3b8cac5fbe6ac655ac P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:54.728984  1799 raft_consensus.cc:2804] T 70720af8528947a89c03ec468c1235eb P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:54.726712  1802 raft_consensus.cc:493] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:54.732970  1038 leader_election.cc:336] T e81f2374d9904e93bf2941ff8b241c09 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111)
I20260709 12:26:54.722664  1863 consensus_queue.cc:237] T 5b3d71845177478a9e2510c82e0cf9d1 P 937efeddef934b2b8bc8632594903085 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
W20260709 12:26:54.751796  1038 leader_election.cc:336] T e5af913e96004f3b8cac5fbe6ac655ac P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111)
I20260709 12:26:54.751456  1802 raft_consensus.cc:515] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:54.754591  1802 leader_election.cc:290] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:26:54.741043  1799 raft_consensus.cc:697] T 70720af8528947a89c03ec468c1235eb P 8fa35514a8d84740b1b46ae496307f20 [term 2 LEADER]: Becoming Leader. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Running, Role: LEADER
I20260709 12:26:54.783361  1143 raft_consensus.cc:2468] T e5af913e96004f3b8cac5fbe6ac655ac P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f9cbe40e40d429aa004e4a7fb42f132 in term 2.
I20260709 12:26:54.784168  1215 raft_consensus.cc:2468] T 98b5b180139845c99c537cd675a60830 P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f9cbe40e40d429aa004e4a7fb42f132 in term 2.
I20260709 12:26:54.784850  1038 leader_election.cc:304] T e5af913e96004f3b8cac5fbe6ac655ac P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 8fa35514a8d84740b1b46ae496307f20; no voters: aa098a557d34433896712068efd0d9a8
I20260709 12:26:54.779307  1865 consensus_queue.cc:237] T ec47b02d68674e2386a86244d9026b78 P 937efeddef934b2b8bc8632594903085 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:54.790091  1776 raft_consensus.cc:2804] T e5af913e96004f3b8cac5fbe6ac655ac P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:54.790598  1776 raft_consensus.cc:697] T e5af913e96004f3b8cac5fbe6ac655ac P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 LEADER]: Becoming Leader. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Running, Role: LEADER
I20260709 12:26:54.791553  1776 consensus_queue.cc:237] T e5af913e96004f3b8cac5fbe6ac655ac P 7f9cbe40e40d429aa004e4a7fb42f132 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:54.804822  1799 consensus_queue.cc:237] T 70720af8528947a89c03ec468c1235eb P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:54.858530  1035 leader_election.cc:304] T 98b5b180139845c99c537cd675a60830 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 937efeddef934b2b8bc8632594903085; no voters: aa098a557d34433896712068efd0d9a8
I20260709 12:26:54.867395  1802 raft_consensus.cc:493] T 1d925407b8314f5b95a8c940f195433a P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.868242  1854 raft_consensus.cc:2804] T 98b5b180139845c99c537cd675a60830 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:26:54.868096  1802 raft_consensus.cc:515] T 1d925407b8314f5b95a8c940f195433a P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:54.868758  1854 raft_consensus.cc:697] T 98b5b180139845c99c537cd675a60830 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 LEADER]: Becoming Leader. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Running, Role: LEADER
I20260709 12:26:54.869699  1854 consensus_queue.cc:237] T 98b5b180139845c99c537cd675a60830 P 7f9cbe40e40d429aa004e4a7fb42f132 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:54.870352  1802 leader_election.cc:290] T 1d925407b8314f5b95a8c940f195433a P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:26:54.890573  1218 raft_consensus.cc:1275] T 6715731f9a31415a98fa8a0ab9944eec P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Refusing update from remote peer 8fa35514a8d84740b1b46ae496307f20: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:54.894433  1856 consensus_queue.cc:1048] T 6715731f9a31415a98fa8a0ab9944eec P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:26:54.901320  1794 tablet_bootstrap.cc:492] T c5197f4025d94ce096c14c6ca011b47b P aa098a557d34433896712068efd0d9a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:54.902380  1794 tablet_bootstrap.cc:492] T c5197f4025d94ce096c14c6ca011b47b P aa098a557d34433896712068efd0d9a8: Bootstrap complete.
I20260709 12:26:54.903123  1794 ts_tablet_manager.cc:1403] T c5197f4025d94ce096c14c6ca011b47b P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.188s	user 0.019s	sys 0.004s
I20260709 12:26:54.882232  1802 raft_consensus.cc:493] T 329e639d23154fb6bd4ccdf095dbd0e0 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.938519  1897 raft_consensus.cc:493] T de3dd28c345442b38f399c5db383c5b2 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.939198  1897 raft_consensus.cc:515] T de3dd28c345442b38f399c5db383c5b2 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:54.942799  1897 leader_election.cc:290] T de3dd28c345442b38f399c5db383c5b2 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:26:54.943506  1897 raft_consensus.cc:493] T 343e626d0073462fa2020fcf2e2f8ffb P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.944142  1897 raft_consensus.cc:515] T 343e626d0073462fa2020fcf2e2f8ffb P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:54.955757   892 catalog_manager.cc:5697] T 5b3d71845177478a9e2510c82e0cf9d1 P 937efeddef934b2b8bc8632594903085 reported cstate change: term changed from 1 to 2, leader changed from aa098a557d34433896712068efd0d9a8 (127.23.245.129) to 937efeddef934b2b8bc8632594903085 (127.23.245.132). New cstate: current_term: 2 leader_uuid: "937efeddef934b2b8bc8632594903085" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:54.959364  1794 raft_consensus.cc:359] T c5197f4025d94ce096c14c6ca011b47b P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:54.960428  1794 raft_consensus.cc:740] T c5197f4025d94ce096c14c6ca011b47b P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:54.961431  1794 consensus_queue.cc:260] T c5197f4025d94ce096c14c6ca011b47b P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:54.957657   892 catalog_manager.cc:5697] T ec47b02d68674e2386a86244d9026b78 P 937efeddef934b2b8bc8632594903085 reported cstate change: term changed from 1 to 2, leader changed from aa098a557d34433896712068efd0d9a8 (127.23.245.129) to 937efeddef934b2b8bc8632594903085 (127.23.245.132). New cstate: current_term: 2 leader_uuid: "937efeddef934b2b8bc8632594903085" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:54.975746   895 catalog_manager.cc:5697] T e81f2374d9904e93bf2941ff8b241c09 P 7f9cbe40e40d429aa004e4a7fb42f132 reported cstate change: term changed from 1 to 2, leader changed from aa098a557d34433896712068efd0d9a8 (127.23.245.129) to 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130). New cstate: current_term: 2 leader_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:54.936885  1802 raft_consensus.cc:515] T 329e639d23154fb6bd4ccdf095dbd0e0 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:54.981385  1794 ts_tablet_manager.cc:1434] T c5197f4025d94ce096c14c6ca011b47b P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.078s	user 0.009s	sys 0.002s
W20260709 12:26:54.982990  1184 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:43679, user_credentials={real_user=slave}} blocked reactor thread for 78839.4us
I20260709 12:26:54.994029  1069 raft_consensus.cc:1275] T 348d7f300dcb474b8b012e01d0af067f P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Refusing update from remote peer 937efeddef934b2b8bc8632594903085: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:54.993832  1897 leader_election.cc:290] T 343e626d0073462fa2020fcf2e2f8ffb P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:26:55.007890  1143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e22afc1ef634aaabf17a4e5a3bf0be3" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:55.008220  1146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3dd28c345442b38f399c5db383c5b2" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:55.007944  1144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d925407b8314f5b95a8c940f195433a" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:55.009596  1142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343e626d0073462fa2020fcf2e2f8ffb" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:55.024053  1794 tablet_bootstrap.cc:492] T 333930b9df5744d59ab498b170a35315 P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
W20260709 12:26:55.024214  1902 log.cc:927] Time spent T 70720af8528947a89c03ec468c1235eb P 8fa35514a8d84740b1b46ae496307f20: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 12:26:55.030004  1904 consensus_queue.cc:1048] T 348d7f300dcb474b8b012e01d0af067f P 937efeddef934b2b8bc8632594903085 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:26:55.042096  1112 consensus_peers.cc:597] T 6715731f9a31415a98fa8a0ab9944eec P 8fa35514a8d84740b1b46ae496307f20 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:55.045598   894 catalog_manager.cc:5697] T 6715731f9a31415a98fa8a0ab9944eec P 8fa35514a8d84740b1b46ae496307f20 reported cstate change: term changed from 1 to 2, leader changed from aa098a557d34433896712068efd0d9a8 (127.23.245.129) to 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131). New cstate: current_term: 2 leader_uuid: "8fa35514a8d84740b1b46ae496307f20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:55.047566   894 catalog_manager.cc:5697] T c4234c6cf75048c5a6cdf34e43c9bd1e P 8fa35514a8d84740b1b46ae496307f20 reported cstate change: term changed from 1 to 2, leader changed from aa098a557d34433896712068efd0d9a8 (127.23.245.129) to 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131). New cstate: current_term: 2 leader_uuid: "8fa35514a8d84740b1b46ae496307f20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:55.049633   894 catalog_manager.cc:5697] T 70720af8528947a89c03ec468c1235eb P 8fa35514a8d84740b1b46ae496307f20 reported cstate change: term changed from 1 to 2, leader changed from aa098a557d34433896712068efd0d9a8 (127.23.245.129) to 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131). New cstate: current_term: 2 leader_uuid: "8fa35514a8d84740b1b46ae496307f20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:55.020769  1802 leader_election.cc:290] T 329e639d23154fb6bd4ccdf095dbd0e0 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:55.132408  1215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e22afc1ef634aaabf17a4e5a3bf0be3" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:55.136413  1219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de3dd28c345442b38f399c5db383c5b2" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:55.136935  1217 raft_consensus.cc:1275] T c4234c6cf75048c5a6cdf34e43c9bd1e P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Refusing update from remote peer 8fa35514a8d84740b1b46ae496307f20: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:55.139328  1707 consensus_queue.cc:1048] T c4234c6cf75048c5a6cdf34e43c9bd1e P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:26:55.139788  1215 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d925407b8314f5b95a8c940f195433a" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:55.214793  1216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343e626d0073462fa2020fcf2e2f8ffb" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:55.242040  1905 raft_consensus.cc:493] T 3d2ccd742ac442419de89cb38ee12d37 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.242720  1905 raft_consensus.cc:515] T 3d2ccd742ac442419de89cb38ee12d37 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:55.244047  1802 raft_consensus.cc:493] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.245043  1905 leader_election.cc:290] T 3d2ccd742ac442419de89cb38ee12d37 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679), 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341)
I20260709 12:26:55.244658  1802 raft_consensus.cc:515] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:55.245901  1217 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "329e639d23154fb6bd4ccdf095dbd0e0" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:55.248603  1802 leader_election.cc:290] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679), 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341)
W20260709 12:26:55.250375  1186 consensus_peers.cc:597] T ac8f3ce8c750468c966a23ea2787b888 P 937efeddef934b2b8bc8632594903085 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:55.252266  1186 consensus_peers.cc:597] T 348d7f300dcb474b8b012e01d0af067f P 937efeddef934b2b8bc8632594903085 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:55.262022  1144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2ccd742ac442419de89cb38ee12d37" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:55.263684  1146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7d578ba2eb41f7a38f15c5dd34b8cb" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:55.266171  1788 leader_election.cc:304] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa098a557d34433896712068efd0d9a8; no voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085
I20260709 12:26:55.266219  1802 raft_consensus.cc:493] T 6715731f9a31415a98fa8a0ab9944eec P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:55.260278  1112 consensus_peers.cc:597] T 0e2eae4c387445f39a059befe390fe45 P 8fa35514a8d84740b1b46ae496307f20 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:55.290007  1220 raft_consensus.cc:1275] T 98b5b180139845c99c537cd675a60830 P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Refusing update from remote peer 7f9cbe40e40d429aa004e4a7fb42f132: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:55.269068  1788 leader_election.cc:304] T de3dd28c345442b38f399c5db383c5b2 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa098a557d34433896712068efd0d9a8; no voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085
I20260709 12:26:55.293411  1897 raft_consensus.cc:2749] T de3dd28c345442b38f399c5db383c5b2 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:55.294032  1217 raft_consensus.cc:1275] T 70720af8528947a89c03ec468c1235eb P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Refusing update from remote peer 8fa35514a8d84740b1b46ae496307f20: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:55.293828  1788 leader_election.cc:304] T 1d925407b8314f5b95a8c940f195433a P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa098a557d34433896712068efd0d9a8; no voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085
I20260709 12:26:55.294907  1218 raft_consensus.cc:1275] T e81f2374d9904e93bf2941ff8b241c09 P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Refusing update from remote peer 7f9cbe40e40d429aa004e4a7fb42f132: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:55.295480  1859 consensus_queue.cc:1048] T 70720af8528947a89c03ec468c1235eb P 8fa35514a8d84740b1b46ae496307f20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:55.295900  1788 leader_election.cc:304] T 343e626d0073462fa2020fcf2e2f8ffb P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa098a557d34433896712068efd0d9a8; no voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085
I20260709 12:26:55.296101  1897 raft_consensus.cc:2749] T 1d925407b8314f5b95a8c940f195433a P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:55.297642  1897 raft_consensus.cc:2749] T 343e626d0073462fa2020fcf2e2f8ffb P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:55.298624  1067 raft_consensus.cc:1275] T 5b3d71845177478a9e2510c82e0cf9d1 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Refusing update from remote peer 937efeddef934b2b8bc8632594903085: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:55.279714  1802 raft_consensus.cc:515] T 6715731f9a31415a98fa8a0ab9944eec P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:55.268513  1905 raft_consensus.cc:2749] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:55.305625  1802 leader_election.cc:290] T 6715731f9a31415a98fa8a0ab9944eec P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:26:55.310585  1146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6715731f9a31415a98fa8a0ab9944eec" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:55.319883  1794 tablet_bootstrap.cc:492] T 333930b9df5744d59ab498b170a35315 P aa098a557d34433896712068efd0d9a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:26:55.325119  1186 consensus_peers.cc:597] T 5b3d71845177478a9e2510c82e0cf9d1 P 937efeddef934b2b8bc8632594903085 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:55.332132  1589 consensus_queue.cc:1048] T 98b5b180139845c99c537cd675a60830 P 7f9cbe40e40d429aa004e4a7fb42f132 [LEADER]: Connected to new peer: Peer: permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:55.333984  1794 tablet_bootstrap.cc:492] T 333930b9df5744d59ab498b170a35315 P aa098a557d34433896712068efd0d9a8: Bootstrap complete.
W20260709 12:26:55.328752  1186 consensus_peers.cc:597] T a1c303d40c6a4cae88aa89d681ae7b76 P 937efeddef934b2b8bc8632594903085 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:55.334714  1794 ts_tablet_manager.cc:1403] T 333930b9df5744d59ab498b170a35315 P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.311s	user 0.025s	sys 0.019s
I20260709 12:26:55.338904  1068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d2ccd742ac442419de89cb38ee12d37" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:55.340600  1067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "329e639d23154fb6bd4ccdf095dbd0e0" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:55.343832  1802 raft_consensus.cc:493] T 5302c354091f4926812eb90f518b9d6a P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.344381  1802 raft_consensus.cc:515] T 5302c354091f4926812eb90f518b9d6a P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:55.344591  1789 leader_election.cc:304] T 3d2ccd742ac442419de89cb38ee12d37 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa098a557d34433896712068efd0d9a8; no voters: 7f9cbe40e40d429aa004e4a7fb42f132, 8fa35514a8d84740b1b46ae496307f20
I20260709 12:26:55.345868  1789 leader_election.cc:304] T 329e639d23154fb6bd4ccdf095dbd0e0 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa098a557d34433896712068efd0d9a8; no voters: 7f9cbe40e40d429aa004e4a7fb42f132, 937efeddef934b2b8bc8632594903085
I20260709 12:26:55.346416  1802 leader_election.cc:290] T 5302c354091f4926812eb90f518b9d6a P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:26:55.346927  1802 raft_consensus.cc:2749] T 3d2ccd742ac442419de89cb38ee12d37 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:55.347499  1802 raft_consensus.cc:2749] T 329e639d23154fb6bd4ccdf095dbd0e0 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:55.348059  1067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7d578ba2eb41f7a38f15c5dd34b8cb" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:55.348179  1776 consensus_queue.cc:1048] T e81f2374d9904e93bf2941ff8b241c09 P 7f9cbe40e40d429aa004e4a7fb42f132 [LEADER]: Connected to new peer: Peer: permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:26:55.351260  1901 consensus_queue.cc:1048] T 5b3d71845177478a9e2510c82e0cf9d1 P 937efeddef934b2b8bc8632594903085 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:55.351686  1143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302c354091f4926812eb90f518b9d6a" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:55.354997  1794 raft_consensus.cc:359] T 333930b9df5744d59ab498b170a35315 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:55.355243  1789 leader_election.cc:304] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa098a557d34433896712068efd0d9a8; no voters: 7f9cbe40e40d429aa004e4a7fb42f132, 8fa35514a8d84740b1b46ae496307f20
W20260709 12:26:55.334714  1186 consensus_peers.cc:597] T c97b34e374ed4aec812cc43e2a5f07de P 937efeddef934b2b8bc8632594903085 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:55.355778  1794 raft_consensus.cc:740] T 333930b9df5744d59ab498b170a35315 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
W20260709 12:26:55.359782  1038 consensus_peers.cc:597] T e81f2374d9904e93bf2941ff8b241c09 P 7f9cbe40e40d429aa004e4a7fb42f132 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:55.360608   894 catalog_manager.cc:5697] T e5af913e96004f3b8cac5fbe6ac655ac P 7f9cbe40e40d429aa004e4a7fb42f132 reported cstate change: term changed from 1 to 2, leader changed from aa098a557d34433896712068efd0d9a8 (127.23.245.129) to 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130). New cstate: current_term: 2 leader_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:55.363600   894 catalog_manager.cc:5697] T 98b5b180139845c99c537cd675a60830 P 7f9cbe40e40d429aa004e4a7fb42f132 reported cstate change: term changed from 1 to 2, leader changed from aa098a557d34433896712068efd0d9a8 (127.23.245.129) to 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130). New cstate: current_term: 2 leader_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:55.366130  1794 consensus_queue.cc:260] T 333930b9df5744d59ab498b170a35315 P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:55.365530  1905 raft_consensus.cc:2749] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:55.362844  1802 raft_consensus.cc:493] T 5b3d71845177478a9e2510c82e0cf9d1 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.374444  1802 raft_consensus.cc:515] T 5b3d71845177478a9e2510c82e0cf9d1 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
W20260709 12:26:55.381002  1186 consensus_peers.cc:597] T ec47b02d68674e2386a86244d9026b78 P 937efeddef934b2b8bc8632594903085 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:55.381389  1038 consensus_peers.cc:597] T 98b5b180139845c99c537cd675a60830 P 7f9cbe40e40d429aa004e4a7fb42f132 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:55.382186  1112 consensus_peers.cc:597] T 343e626d0073462fa2020fcf2e2f8ffb P 8fa35514a8d84740b1b46ae496307f20 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:55.386390  1112 consensus_peers.cc:597] T c4234c6cf75048c5a6cdf34e43c9bd1e P 8fa35514a8d84740b1b46ae496307f20 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:55.387035  1112 consensus_peers.cc:597] T 70720af8528947a89c03ec468c1235eb P 8fa35514a8d84740b1b46ae496307f20 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:55.412035  1112 consensus_peers.cc:597] T 3d2ccd742ac442419de89cb38ee12d37 P 8fa35514a8d84740b1b46ae496307f20 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:55.380908  1788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:33909, user_credentials={real_user=slave}} blocked reactor thread for 85072.4us
I20260709 12:26:55.398893  1069 raft_consensus.cc:1275] T ec47b02d68674e2386a86244d9026b78 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Refusing update from remote peer 937efeddef934b2b8bc8632594903085: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:26:55.421098  1038 consensus_peers.cc:597] T a943f9cb8fef49e6a38b910ff1bb9076 P 7f9cbe40e40d429aa004e4a7fb42f132 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:55.419368  1905 raft_consensus.cc:493] T ec806598903e4f88a40176e07ca4fad0 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.426154  1919 raft_consensus.cc:493] T c36d0201599a49169424a6b75f5349f2 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.426288  1905 raft_consensus.cc:515] T ec806598903e4f88a40176e07ca4fad0 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:55.426847  1919 raft_consensus.cc:515] T c36d0201599a49169424a6b75f5349f2 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:55.429124  1919 leader_election.cc:290] T c36d0201599a49169424a6b75f5349f2 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:55.431528  1072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0201599a49169424a6b75f5349f2" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:55.437816  1508 consensus_queue.cc:1048] T ec47b02d68674e2386a86244d9026b78 P 937efeddef934b2b8bc8632594903085 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:26:55.438697  1794 ts_tablet_manager.cc:1434] T 333930b9df5744d59ab498b170a35315 P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.104s	user 0.008s	sys 0.000s
I20260709 12:26:55.441411  1067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec806598903e4f88a40176e07ca4fad0" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:55.441447  1142 raft_consensus.cc:1275] T e5af913e96004f3b8cac5fbe6ac655ac P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Refusing update from remote peer 7f9cbe40e40d429aa004e4a7fb42f132: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:26:55.453786  1216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6715731f9a31415a98fa8a0ab9944eec" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:55.454695  1068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3d71845177478a9e2510c82e0cf9d1" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:55.458810  1794 tablet_bootstrap.cc:492] T 70720af8528947a89c03ec468c1235eb P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:55.462780  1146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec806598903e4f88a40176e07ca4fad0" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:55.431594  1905 leader_election.cc:290] T ec806598903e4f88a40176e07ca4fad0 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679), 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341)
I20260709 12:26:55.439740  1802 leader_election.cc:290] T 5b3d71845177478a9e2510c82e0cf9d1 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:55.473639  1219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302c354091f4926812eb90f518b9d6a" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
I20260709 12:26:55.495664  1216 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3d71845177478a9e2510c82e0cf9d1" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
W20260709 12:26:55.496621  1038 consensus_peers.cc:597] T e5af913e96004f3b8cac5fbe6ac655ac P 7f9cbe40e40d429aa004e4a7fb42f132 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:55.504014  1791 leader_election.cc:304] T ec806598903e4f88a40176e07ca4fad0 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa098a557d34433896712068efd0d9a8; no voters: 7f9cbe40e40d429aa004e4a7fb42f132, 8fa35514a8d84740b1b46ae496307f20
I20260709 12:26:55.514878  1788 leader_election.cc:304] T 6715731f9a31415a98fa8a0ab9944eec P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa098a557d34433896712068efd0d9a8; no voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085
I20260709 12:26:55.516745  1788 leader_election.cc:304] T 5302c354091f4926812eb90f518b9d6a P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa098a557d34433896712068efd0d9a8; no voters: 8fa35514a8d84740b1b46ae496307f20, 937efeddef934b2b8bc8632594903085
W20260709 12:26:55.517970  1038 consensus_peers.cc:597] T 3a19a87d91404b73bdba7121512bf7aa P 7f9cbe40e40d429aa004e4a7fb42f132 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:55.535980  1219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0201599a49169424a6b75f5349f2" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "937efeddef934b2b8bc8632594903085" is_pre_election: true
W20260709 12:26:55.545397  1791 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:40341, user_credentials={real_user=slave}} blocked reactor thread for 73681.8us
I20260709 12:26:55.538465  1919 raft_consensus.cc:493] T 74e3cbe3521a46cfb42a6cb7ba98430c P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.548470  1919 raft_consensus.cc:515] T 74e3cbe3521a46cfb42a6cb7ba98430c P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:55.550637  1919 leader_election.cc:290] T 74e3cbe3521a46cfb42a6cb7ba98430c P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679), 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341)
I20260709 12:26:55.537313  1776 consensus_queue.cc:1048] T e5af913e96004f3b8cac5fbe6ac655ac P 7f9cbe40e40d429aa004e4a7fb42f132 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:26:55.554447  1788 leader_election.cc:304] T 5b3d71845177478a9e2510c82e0cf9d1 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa098a557d34433896712068efd0d9a8; no voters: 7f9cbe40e40d429aa004e4a7fb42f132, 937efeddef934b2b8bc8632594903085
I20260709 12:26:55.556501  1802 raft_consensus.cc:2749] T 6715731f9a31415a98fa8a0ab9944eec P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:55.557224  1802 raft_consensus.cc:2749] T 5b3d71845177478a9e2510c82e0cf9d1 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:55.557859  1905 raft_consensus.cc:2749] T 5302c354091f4926812eb90f518b9d6a P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:55.538200  1897 raft_consensus.cc:2749] T ec806598903e4f88a40176e07ca4fad0 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:55.559655  1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74e3cbe3521a46cfb42a6cb7ba98430c" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:55.563653  1146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74e3cbe3521a46cfb42a6cb7ba98430c" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
W20260709 12:26:55.567000  1186 consensus_peers.cc:597] T e12f4bd1b2ed49988317684782c8616b P 937efeddef934b2b8bc8632594903085 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:55.555739  1788 leader_election.cc:304] T c36d0201599a49169424a6b75f5349f2 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa098a557d34433896712068efd0d9a8; no voters: 7f9cbe40e40d429aa004e4a7fb42f132, 937efeddef934b2b8bc8632594903085
I20260709 12:26:55.590097  1919 raft_consensus.cc:2749] T c36d0201599a49169424a6b75f5349f2 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:55.580996  1791 leader_election.cc:304] T 74e3cbe3521a46cfb42a6cb7ba98430c P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa098a557d34433896712068efd0d9a8; no voters: 7f9cbe40e40d429aa004e4a7fb42f132, 8fa35514a8d84740b1b46ae496307f20
I20260709 12:26:55.600461  1897 raft_consensus.cc:2749] T 74e3cbe3521a46cfb42a6cb7ba98430c P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:55.601343  1897 raft_consensus.cc:493] T e281f15348944cc1ab51fce7c1653aac P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.601949  1897 raft_consensus.cc:515] T e281f15348944cc1ab51fce7c1653aac P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
W20260709 12:26:55.610918  1788 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.132:33909, user_credentials={real_user=slave}} blocked reactor thread for 55270.9us
I20260709 12:26:55.614596  1897 leader_election.cc:290] T e281f15348944cc1ab51fce7c1653aac P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:26:55.618301  1143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e281f15348944cc1ab51fce7c1653aac" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:55.616541  1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e281f15348944cc1ab51fce7c1653aac" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:55.620427  1789 leader_election.cc:304] T e281f15348944cc1ab51fce7c1653aac P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa098a557d34433896712068efd0d9a8; no voters: 7f9cbe40e40d429aa004e4a7fb42f132, 8fa35514a8d84740b1b46ae496307f20
I20260709 12:26:55.623145  1897 raft_consensus.cc:2749] T e281f15348944cc1ab51fce7c1653aac P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:26:55.632400  1794 tablet_bootstrap.cc:492] T 70720af8528947a89c03ec468c1235eb P aa098a557d34433896712068efd0d9a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:55.633634  1794 tablet_bootstrap.cc:492] T 70720af8528947a89c03ec468c1235eb P aa098a557d34433896712068efd0d9a8: Bootstrap complete.
I20260709 12:26:55.634687  1794 ts_tablet_manager.cc:1403] T 70720af8528947a89c03ec468c1235eb P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.176s	user 0.039s	sys 0.015s
I20260709 12:26:55.640014  1794 raft_consensus.cc:359] T 70720af8528947a89c03ec468c1235eb P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:55.640913  1794 raft_consensus.cc:740] T 70720af8528947a89c03ec468c1235eb P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:55.641865  1794 consensus_queue.cc:260] T 70720af8528947a89c03ec468c1235eb P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:55.644695  1794 ts_tablet_manager.cc:1434] T 70720af8528947a89c03ec468c1235eb P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:26:55.645412  1933 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.245.129:32981 every 8 connection(s)
I20260709 12:26:55.646020  1794 tablet_bootstrap.cc:492] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:55.651690 24534 rpc_server.cc:307] RPC server started. Bound to: 127.23.245.129:32981
W20260709 12:26:55.722112  1038 consensus_peers.cc:597] T 284ea666431c4339998eb885cd31facb P 7f9cbe40e40d429aa004e4a7fb42f132 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:55.730195  1897 raft_consensus.cc:493] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.730854  1844 raft_consensus.cc:3060] T 6715731f9a31415a98fa8a0ab9944eec P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:55.735051  1897 raft_consensus.cc:515] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:55.739403  1068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb44e6d7d92f49eb9758d5a5f6ce50b6" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" is_pre_election: true
I20260709 12:26:55.748855  1897 leader_election.cc:290] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679), 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341)
W20260709 12:26:55.760032  1186 consensus_peers.cc:597] T 4d899bdd8a44422ca2a8036f84e9f9f3 P 937efeddef934b2b8bc8632594903085 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:55.761484  1852 raft_consensus.cc:3060] T c4234c6cf75048c5a6cdf34e43c9bd1e P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:55.761260  1142 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb44e6d7d92f49eb9758d5a5f6ce50b6" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8fa35514a8d84740b1b46ae496307f20" is_pre_election: true
I20260709 12:26:55.764425  1791 leader_election.cc:304] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa098a557d34433896712068efd0d9a8; no voters: 7f9cbe40e40d429aa004e4a7fb42f132, 8fa35514a8d84740b1b46ae496307f20
I20260709 12:26:55.765281  1905 raft_consensus.cc:2749] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:26:55.764590  1186 consensus_peers.cc:597] T e2ef4b262fac46fe9f9111b609547aa3 P 937efeddef934b2b8bc8632594903085 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:55.767768  1186 consensus_peers.cc:597] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P 937efeddef934b2b8bc8632594903085 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:55.768489  1112 consensus_peers.cc:597] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 8fa35514a8d84740b1b46ae496307f20 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:55.768824  1186 consensus_peers.cc:597] T c495ce9da627479e92d7b24b3be3641a P 937efeddef934b2b8bc8632594903085 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:55.772487  1853 raft_consensus.cc:3060] T 70720af8528947a89c03ec468c1235eb P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:55.774438  1112 consensus_peers.cc:597] T 0c434afb0b164ab5b38dea54bfcebfe8 P 8fa35514a8d84740b1b46ae496307f20 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:55.775122  1112 consensus_peers.cc:597] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 8fa35514a8d84740b1b46ae496307f20 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:55.776124  1112 consensus_peers.cc:597] T 0017925ea1bb4374b09c9e692a17f87e P 8fa35514a8d84740b1b46ae496307f20 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:55.791477  1794 tablet_bootstrap.cc:492] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P aa098a557d34433896712068efd0d9a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:55.792546  1794 tablet_bootstrap.cc:492] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P aa098a557d34433896712068efd0d9a8: Bootstrap complete.
I20260709 12:26:55.793203  1794 ts_tablet_manager.cc:1403] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.148s	user 0.018s	sys 0.005s
I20260709 12:26:55.796555  1794 raft_consensus.cc:359] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:55.797477  1794 raft_consensus.cc:740] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:55.798597  1794 consensus_queue.cc:260] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:55.801712  1794 ts_tablet_manager.cc:1434] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:26:55.806726  1794 tablet_bootstrap.cc:492] T 95743acb416b403b9bfb59afe5bf2fe7 P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:55.820147  1853 raft_consensus.cc:3060] T 5b3d71845177478a9e2510c82e0cf9d1 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:26:55.830505  1112 consensus_peers.cc:597] T 040ea9f986ee4ed29b941698c802c501 P 8fa35514a8d84740b1b46ae496307f20 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:55.834702  1186 consensus_peers.cc:597] T 580f367489064e218eef65b4654744b8 P 937efeddef934b2b8bc8632594903085 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:55.842037  1794 tablet_bootstrap.cc:492] T 95743acb416b403b9bfb59afe5bf2fe7 P aa098a557d34433896712068efd0d9a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:55.843077  1794 tablet_bootstrap.cc:492] T 95743acb416b403b9bfb59afe5bf2fe7 P aa098a557d34433896712068efd0d9a8: Bootstrap complete.
I20260709 12:26:55.843709  1794 ts_tablet_manager.cc:1403] T 95743acb416b403b9bfb59afe5bf2fe7 P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.009s
I20260709 12:26:55.846208  1794 raft_consensus.cc:359] T 95743acb416b403b9bfb59afe5bf2fe7 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:55.847779  1794 raft_consensus.cc:740] T 95743acb416b403b9bfb59afe5bf2fe7 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:55.848738  1794 consensus_queue.cc:260] T 95743acb416b403b9bfb59afe5bf2fe7 P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:55.852938  1794 ts_tablet_manager.cc:1434] T 95743acb416b403b9bfb59afe5bf2fe7 P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 12:26:55.853914  1794 tablet_bootstrap.cc:492] T c495ce9da627479e92d7b24b3be3641a P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:55.859510  1938 heartbeater.cc:344] Connected to a master server at 127.23.245.190:34325
I20260709 12:26:55.860050  1938 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:55.860956  1938 heartbeater.cc:507] Master 127.23.245.190:34325 requested a full tablet report, sending...
I20260709 12:26:55.878253  1794 tablet_bootstrap.cc:492] T c495ce9da627479e92d7b24b3be3641a P aa098a557d34433896712068efd0d9a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:55.879141  1794 tablet_bootstrap.cc:492] T c495ce9da627479e92d7b24b3be3641a P aa098a557d34433896712068efd0d9a8: Bootstrap complete.
I20260709 12:26:55.879683  1794 ts_tablet_manager.cc:1403] T c495ce9da627479e92d7b24b3be3641a P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.001s
I20260709 12:26:55.880664   895 ts_manager.cc:194] Re-registered known tserver with Master: aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
I20260709 12:26:55.882241  1794 raft_consensus.cc:359] T c495ce9da627479e92d7b24b3be3641a P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:55.882994  1794 raft_consensus.cc:740] T c495ce9da627479e92d7b24b3be3641a P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:55.883948  1794 consensus_queue.cc:260] T c495ce9da627479e92d7b24b3be3641a P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:55.886288  1794 ts_tablet_manager.cc:1434] T c495ce9da627479e92d7b24b3be3641a P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:26:55.886951  1794 tablet_bootstrap.cc:492] T ec47b02d68674e2386a86244d9026b78 P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:55.899577  1794 tablet_bootstrap.cc:492] T ec47b02d68674e2386a86244d9026b78 P aa098a557d34433896712068efd0d9a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:55.900527  1794 tablet_bootstrap.cc:492] T ec47b02d68674e2386a86244d9026b78 P aa098a557d34433896712068efd0d9a8: Bootstrap complete.
I20260709 12:26:55.901141  1794 ts_tablet_manager.cc:1403] T ec47b02d68674e2386a86244d9026b78 P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.014s	user 0.002s	sys 0.011s
I20260709 12:26:55.905464  1794 raft_consensus.cc:359] T ec47b02d68674e2386a86244d9026b78 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:55.906138  1794 raft_consensus.cc:740] T ec47b02d68674e2386a86244d9026b78 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:55.906777  1794 consensus_queue.cc:260] T ec47b02d68674e2386a86244d9026b78 P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:55.908728  1794 ts_tablet_manager.cc:1434] T ec47b02d68674e2386a86244d9026b78 P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:26:55.909504  1794 tablet_bootstrap.cc:492] T 348d7f300dcb474b8b012e01d0af067f P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:55.925518  1794 tablet_bootstrap.cc:492] T 348d7f300dcb474b8b012e01d0af067f P aa098a557d34433896712068efd0d9a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:55.926503  1794 tablet_bootstrap.cc:492] T 348d7f300dcb474b8b012e01d0af067f P aa098a557d34433896712068efd0d9a8: Bootstrap complete.
I20260709 12:26:55.927152  1794 ts_tablet_manager.cc:1403] T 348d7f300dcb474b8b012e01d0af067f P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.004s
I20260709 12:26:55.929854  1794 raft_consensus.cc:359] T 348d7f300dcb474b8b012e01d0af067f P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:55.930538  1794 raft_consensus.cc:740] T 348d7f300dcb474b8b012e01d0af067f P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:55.931651  1794 consensus_queue.cc:260] T 348d7f300dcb474b8b012e01d0af067f P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:55.932590   895 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49968
I20260709 12:26:55.933956  1794 ts_tablet_manager.cc:1434] T 348d7f300dcb474b8b012e01d0af067f P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:26:55.934716  1794 tablet_bootstrap.cc:492] T c9d72f2a6ae046cb9d4e6277d13e34e6 P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:55.937708  1938 heartbeater.cc:499] Master 127.23.245.190:34325 was elected leader, sending a full tablet report...
I20260709 12:26:55.949894  1794 tablet_bootstrap.cc:492] T c9d72f2a6ae046cb9d4e6277d13e34e6 P aa098a557d34433896712068efd0d9a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:55.950889  1794 tablet_bootstrap.cc:492] T c9d72f2a6ae046cb9d4e6277d13e34e6 P aa098a557d34433896712068efd0d9a8: Bootstrap complete.
I20260709 12:26:55.951555  1794 ts_tablet_manager.cc:1403] T c9d72f2a6ae046cb9d4e6277d13e34e6 P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.005s
I20260709 12:26:55.954229  1794 raft_consensus.cc:359] T c9d72f2a6ae046cb9d4e6277d13e34e6 P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:55.954932  1794 raft_consensus.cc:740] T c9d72f2a6ae046cb9d4e6277d13e34e6 P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:55.955562  1794 consensus_queue.cc:260] T c9d72f2a6ae046cb9d4e6277d13e34e6 P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:55.957685  1794 ts_tablet_manager.cc:1434] T c9d72f2a6ae046cb9d4e6277d13e34e6 P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.006s
I20260709 12:26:55.958441  1794 tablet_bootstrap.cc:492] T 284ea666431c4339998eb885cd31facb P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:55.977758  1794 tablet_bootstrap.cc:492] T 284ea666431c4339998eb885cd31facb P aa098a557d34433896712068efd0d9a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:55.978998  1794 tablet_bootstrap.cc:492] T 284ea666431c4339998eb885cd31facb P aa098a557d34433896712068efd0d9a8: Bootstrap complete.
I20260709 12:26:55.979633  1794 ts_tablet_manager.cc:1403] T 284ea666431c4339998eb885cd31facb P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.004s
I20260709 12:26:55.982178  1794 raft_consensus.cc:359] T 284ea666431c4339998eb885cd31facb P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:55.982889  1794 raft_consensus.cc:740] T 284ea666431c4339998eb885cd31facb P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:55.983574  1794 consensus_queue.cc:260] T 284ea666431c4339998eb885cd31facb P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:55.985654  1794 ts_tablet_manager.cc:1434] T 284ea666431c4339998eb885cd31facb P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:26:55.986389  1794 tablet_bootstrap.cc:492] T 98b5b180139845c99c537cd675a60830 P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:56.002117  1794 tablet_bootstrap.cc:492] T 98b5b180139845c99c537cd675a60830 P aa098a557d34433896712068efd0d9a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:56.003088  1794 tablet_bootstrap.cc:492] T 98b5b180139845c99c537cd675a60830 P aa098a557d34433896712068efd0d9a8: Bootstrap complete.
I20260709 12:26:56.003713  1794 ts_tablet_manager.cc:1403] T 98b5b180139845c99c537cd675a60830 P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 12:26:56.006239  1794 raft_consensus.cc:359] T 98b5b180139845c99c537cd675a60830 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:56.006924  1794 raft_consensus.cc:740] T 98b5b180139845c99c537cd675a60830 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:56.007596  1794 consensus_queue.cc:260] T 98b5b180139845c99c537cd675a60830 P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:56.009729  1794 ts_tablet_manager.cc:1434] T 98b5b180139845c99c537cd675a60830 P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:26:56.010550  1794 tablet_bootstrap.cc:492] T c97b34e374ed4aec812cc43e2a5f07de P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:56.025104  1794 tablet_bootstrap.cc:492] T c97b34e374ed4aec812cc43e2a5f07de P aa098a557d34433896712068efd0d9a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:56.025997  1794 tablet_bootstrap.cc:492] T c97b34e374ed4aec812cc43e2a5f07de P aa098a557d34433896712068efd0d9a8: Bootstrap complete.
I20260709 12:26:56.026679  1794 ts_tablet_manager.cc:1403] T c97b34e374ed4aec812cc43e2a5f07de P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.003s
I20260709 12:26:56.029125  1794 raft_consensus.cc:359] T c97b34e374ed4aec812cc43e2a5f07de P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:56.029620  1794 raft_consensus.cc:740] T c97b34e374ed4aec812cc43e2a5f07de P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:56.030378  1794 consensus_queue.cc:260] T c97b34e374ed4aec812cc43e2a5f07de P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:56.032039  1794 ts_tablet_manager.cc:1434] T c97b34e374ed4aec812cc43e2a5f07de P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:26:56.032756  1794 tablet_bootstrap.cc:492] T a943f9cb8fef49e6a38b910ff1bb9076 P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:56.050511  1794 tablet_bootstrap.cc:492] T a943f9cb8fef49e6a38b910ff1bb9076 P aa098a557d34433896712068efd0d9a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:56.051573  1794 tablet_bootstrap.cc:492] T a943f9cb8fef49e6a38b910ff1bb9076 P aa098a557d34433896712068efd0d9a8: Bootstrap complete.
I20260709 12:26:56.052311  1794 ts_tablet_manager.cc:1403] T a943f9cb8fef49e6a38b910ff1bb9076 P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.011s
I20260709 12:26:56.054880  1794 raft_consensus.cc:359] T a943f9cb8fef49e6a38b910ff1bb9076 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:56.055613  1794 raft_consensus.cc:740] T a943f9cb8fef49e6a38b910ff1bb9076 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:56.056411  1794 consensus_queue.cc:260] T a943f9cb8fef49e6a38b910ff1bb9076 P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:56.058446  1794 ts_tablet_manager.cc:1434] T a943f9cb8fef49e6a38b910ff1bb9076 P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:26:56.060561  1794 tablet_bootstrap.cc:492] T e5af913e96004f3b8cac5fbe6ac655ac P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:56.084365  1794 tablet_bootstrap.cc:492] T e5af913e96004f3b8cac5fbe6ac655ac P aa098a557d34433896712068efd0d9a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:56.085309  1794 tablet_bootstrap.cc:492] T e5af913e96004f3b8cac5fbe6ac655ac P aa098a557d34433896712068efd0d9a8: Bootstrap complete.
I20260709 12:26:56.085970  1794 ts_tablet_manager.cc:1403] T e5af913e96004f3b8cac5fbe6ac655ac P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.008s
I20260709 12:26:56.088088  1794 raft_consensus.cc:359] T e5af913e96004f3b8cac5fbe6ac655ac P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:56.088542  1794 raft_consensus.cc:740] T e5af913e96004f3b8cac5fbe6ac655ac P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:56.089082  1794 consensus_queue.cc:260] T e5af913e96004f3b8cac5fbe6ac655ac P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:56.091210  1794 ts_tablet_manager.cc:1434] T e5af913e96004f3b8cac5fbe6ac655ac P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:26:56.092300  1794 tablet_bootstrap.cc:492] T 4d899bdd8a44422ca2a8036f84e9f9f3 P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:56.109081  1794 tablet_bootstrap.cc:492] T 4d899bdd8a44422ca2a8036f84e9f9f3 P aa098a557d34433896712068efd0d9a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:56.109313  1853 raft_consensus.cc:3060] T 348d7f300dcb474b8b012e01d0af067f P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:56.110070  1794 tablet_bootstrap.cc:492] T 4d899bdd8a44422ca2a8036f84e9f9f3 P aa098a557d34433896712068efd0d9a8: Bootstrap complete.
I20260709 12:26:56.110859  1794 ts_tablet_manager.cc:1403] T 4d899bdd8a44422ca2a8036f84e9f9f3 P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.009s
I20260709 12:26:56.113674  1794 raft_consensus.cc:359] T 4d899bdd8a44422ca2a8036f84e9f9f3 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:56.114406  1794 raft_consensus.cc:740] T 4d899bdd8a44422ca2a8036f84e9f9f3 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:56.115209  1794 consensus_queue.cc:260] T 4d899bdd8a44422ca2a8036f84e9f9f3 P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:56.117400  1794 ts_tablet_manager.cc:1434] T 4d899bdd8a44422ca2a8036f84e9f9f3 P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:26:56.119771  1794 tablet_bootstrap.cc:492] T ac8f3ce8c750468c966a23ea2787b888 P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:56.160449  1794 tablet_bootstrap.cc:492] T ac8f3ce8c750468c966a23ea2787b888 P aa098a557d34433896712068efd0d9a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:56.161332  1794 tablet_bootstrap.cc:492] T ac8f3ce8c750468c966a23ea2787b888 P aa098a557d34433896712068efd0d9a8: Bootstrap complete.
I20260709 12:26:56.161988  1794 ts_tablet_manager.cc:1403] T ac8f3ce8c750468c966a23ea2787b888 P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.042s	user 0.026s	sys 0.011s
I20260709 12:26:56.164516  1794 raft_consensus.cc:359] T ac8f3ce8c750468c966a23ea2787b888 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:56.165171  1794 raft_consensus.cc:740] T ac8f3ce8c750468c966a23ea2787b888 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:56.165889  1794 consensus_queue.cc:260] T ac8f3ce8c750468c966a23ea2787b888 P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:56.168121  1794 ts_tablet_manager.cc:1434] T ac8f3ce8c750468c966a23ea2787b888 P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:26:56.168910  1794 tablet_bootstrap.cc:492] T a1c303d40c6a4cae88aa89d681ae7b76 P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:56.196714  1794 tablet_bootstrap.cc:492] T a1c303d40c6a4cae88aa89d681ae7b76 P aa098a557d34433896712068efd0d9a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:56.197657  1794 tablet_bootstrap.cc:492] T a1c303d40c6a4cae88aa89d681ae7b76 P aa098a557d34433896712068efd0d9a8: Bootstrap complete.
I20260709 12:26:56.198347  1794 ts_tablet_manager.cc:1403] T a1c303d40c6a4cae88aa89d681ae7b76 P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.008s
I20260709 12:26:56.201557  1794 raft_consensus.cc:359] T a1c303d40c6a4cae88aa89d681ae7b76 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:56.202332  1794 raft_consensus.cc:740] T a1c303d40c6a4cae88aa89d681ae7b76 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:56.203106  1794 consensus_queue.cc:260] T a1c303d40c6a4cae88aa89d681ae7b76 P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:56.204918  1794 ts_tablet_manager.cc:1434] T a1c303d40c6a4cae88aa89d681ae7b76 P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:26:56.205468  1794 tablet_bootstrap.cc:492] T e81f2374d9904e93bf2941ff8b241c09 P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:56.232695  1853 raft_consensus.cc:3060] T ec47b02d68674e2386a86244d9026b78 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:56.237525  1794 tablet_bootstrap.cc:492] T e81f2374d9904e93bf2941ff8b241c09 P aa098a557d34433896712068efd0d9a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:56.238315  1794 tablet_bootstrap.cc:492] T e81f2374d9904e93bf2941ff8b241c09 P aa098a557d34433896712068efd0d9a8: Bootstrap complete.
I20260709 12:26:56.238946  1794 ts_tablet_manager.cc:1403] T e81f2374d9904e93bf2941ff8b241c09 P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.034s	user 0.019s	sys 0.009s
I20260709 12:26:56.241323  1794 raft_consensus.cc:359] T e81f2374d9904e93bf2941ff8b241c09 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:56.241981  1794 raft_consensus.cc:740] T e81f2374d9904e93bf2941ff8b241c09 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:56.242738  1794 consensus_queue.cc:260] T e81f2374d9904e93bf2941ff8b241c09 P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:56.245285  1794 ts_tablet_manager.cc:1434] T e81f2374d9904e93bf2941ff8b241c09 P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:26:56.246403  1794 tablet_bootstrap.cc:492] T 040ea9f986ee4ed29b941698c802c501 P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:56.263348  1794 tablet_bootstrap.cc:492] T 040ea9f986ee4ed29b941698c802c501 P aa098a557d34433896712068efd0d9a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:56.264330  1794 tablet_bootstrap.cc:492] T 040ea9f986ee4ed29b941698c802c501 P aa098a557d34433896712068efd0d9a8: Bootstrap complete.
I20260709 12:26:56.265000  1794 ts_tablet_manager.cc:1403] T 040ea9f986ee4ed29b941698c802c501 P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 12:26:56.267411  1794 raft_consensus.cc:359] T 040ea9f986ee4ed29b941698c802c501 P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:56.267954  1794 raft_consensus.cc:740] T 040ea9f986ee4ed29b941698c802c501 P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:56.268636  1794 consensus_queue.cc:260] T 040ea9f986ee4ed29b941698c802c501 P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:56.270483  1794 ts_tablet_manager.cc:1434] T 040ea9f986ee4ed29b941698c802c501 P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:26:56.271306  1794 tablet_bootstrap.cc:492] T 0017925ea1bb4374b09c9e692a17f87e P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:56.286559  1794 tablet_bootstrap.cc:492] T 0017925ea1bb4374b09c9e692a17f87e P aa098a557d34433896712068efd0d9a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:56.287535  1794 tablet_bootstrap.cc:492] T 0017925ea1bb4374b09c9e692a17f87e P aa098a557d34433896712068efd0d9a8: Bootstrap complete.
I20260709 12:26:56.288151  1794 ts_tablet_manager.cc:1403] T 0017925ea1bb4374b09c9e692a17f87e P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.003s
I20260709 12:26:56.290158  1794 raft_consensus.cc:359] T 0017925ea1bb4374b09c9e692a17f87e P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:56.290665  1794 raft_consensus.cc:740] T 0017925ea1bb4374b09c9e692a17f87e P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:56.291252  1794 consensus_queue.cc:260] T 0017925ea1bb4374b09c9e692a17f87e P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:56.292975  1794 ts_tablet_manager.cc:1434] T 0017925ea1bb4374b09c9e692a17f87e P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:26:56.293627  1794 tablet_bootstrap.cc:492] T e2ef4b262fac46fe9f9111b609547aa3 P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:56.310046  1794 tablet_bootstrap.cc:492] T e2ef4b262fac46fe9f9111b609547aa3 P aa098a557d34433896712068efd0d9a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:56.310930  1794 tablet_bootstrap.cc:492] T e2ef4b262fac46fe9f9111b609547aa3 P aa098a557d34433896712068efd0d9a8: Bootstrap complete.
I20260709 12:26:56.311477  1794 ts_tablet_manager.cc:1403] T e2ef4b262fac46fe9f9111b609547aa3 P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.018s	user 0.006s	sys 0.008s
I20260709 12:26:56.313341  1794 raft_consensus.cc:359] T e2ef4b262fac46fe9f9111b609547aa3 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:56.313858  1794 raft_consensus.cc:740] T e2ef4b262fac46fe9f9111b609547aa3 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:56.314507  1794 consensus_queue.cc:260] T e2ef4b262fac46fe9f9111b609547aa3 P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:56.315954  1794 ts_tablet_manager.cc:1434] T e2ef4b262fac46fe9f9111b609547aa3 P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.004s	user 0.001s	sys 0.003s
I20260709 12:26:56.317591  1794 tablet_bootstrap.cc:492] T 2f2713fe1c7148f0b6d9a69c53ec3515 P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:56.341285  1852 raft_consensus.cc:3060] T e5af913e96004f3b8cac5fbe6ac655ac P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:56.343207  1794 tablet_bootstrap.cc:492] T 2f2713fe1c7148f0b6d9a69c53ec3515 P aa098a557d34433896712068efd0d9a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:56.344302  1794 tablet_bootstrap.cc:492] T 2f2713fe1c7148f0b6d9a69c53ec3515 P aa098a557d34433896712068efd0d9a8: Bootstrap complete.
I20260709 12:26:56.344954  1794 ts_tablet_manager.cc:1403] T 2f2713fe1c7148f0b6d9a69c53ec3515 P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.010s
I20260709 12:26:56.347441  1794 raft_consensus.cc:359] T 2f2713fe1c7148f0b6d9a69c53ec3515 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:56.348114  1794 raft_consensus.cc:740] T 2f2713fe1c7148f0b6d9a69c53ec3515 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:56.348764  1794 consensus_queue.cc:260] T 2f2713fe1c7148f0b6d9a69c53ec3515 P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:56.351037  1794 ts_tablet_manager.cc:1434] T 2f2713fe1c7148f0b6d9a69c53ec3515 P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:26:56.352355  1794 tablet_bootstrap.cc:492] T b364263cacab4add984e2b6c912fb62e P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:56.357877  1853 raft_consensus.cc:3060] T 98b5b180139845c99c537cd675a60830 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:56.392731  1794 tablet_bootstrap.cc:492] T b364263cacab4add984e2b6c912fb62e P aa098a557d34433896712068efd0d9a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:56.393779  1794 tablet_bootstrap.cc:492] T b364263cacab4add984e2b6c912fb62e P aa098a557d34433896712068efd0d9a8: Bootstrap complete.
I20260709 12:26:56.394511  1794 ts_tablet_manager.cc:1403] T b364263cacab4add984e2b6c912fb62e P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.042s	user 0.020s	sys 0.019s
I20260709 12:26:56.397033  1794 raft_consensus.cc:359] T b364263cacab4add984e2b6c912fb62e P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:56.397830  1794 raft_consensus.cc:740] T b364263cacab4add984e2b6c912fb62e P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:56.398519  1794 consensus_queue.cc:260] T b364263cacab4add984e2b6c912fb62e P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:56.400702  1794 ts_tablet_manager.cc:1434] T b364263cacab4add984e2b6c912fb62e P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.004s
I20260709 12:26:56.401582  1794 tablet_bootstrap.cc:492] T 0c434afb0b164ab5b38dea54bfcebfe8 P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:56.430254  1794 tablet_bootstrap.cc:492] T 0c434afb0b164ab5b38dea54bfcebfe8 P aa098a557d34433896712068efd0d9a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:56.431032  1794 tablet_bootstrap.cc:492] T 0c434afb0b164ab5b38dea54bfcebfe8 P aa098a557d34433896712068efd0d9a8: Bootstrap complete.
I20260709 12:26:56.431946  1794 ts_tablet_manager.cc:1403] T 0c434afb0b164ab5b38dea54bfcebfe8 P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.031s	user 0.021s	sys 0.008s
I20260709 12:26:56.434557  1794 raft_consensus.cc:359] T 0c434afb0b164ab5b38dea54bfcebfe8 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:56.435087  1794 raft_consensus.cc:740] T 0c434afb0b164ab5b38dea54bfcebfe8 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:56.435598  1794 consensus_queue.cc:260] T 0c434afb0b164ab5b38dea54bfcebfe8 P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:56.437342  1794 ts_tablet_manager.cc:1434] T 0c434afb0b164ab5b38dea54bfcebfe8 P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:26:56.438197  1794 tablet_bootstrap.cc:492] T 0e2eae4c387445f39a059befe390fe45 P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:56.453416  1794 tablet_bootstrap.cc:492] T 0e2eae4c387445f39a059befe390fe45 P aa098a557d34433896712068efd0d9a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:56.454222  1794 tablet_bootstrap.cc:492] T 0e2eae4c387445f39a059befe390fe45 P aa098a557d34433896712068efd0d9a8: Bootstrap complete.
I20260709 12:26:56.454713  1794 ts_tablet_manager.cc:1403] T 0e2eae4c387445f39a059befe390fe45 P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 12:26:56.456732  1794 raft_consensus.cc:359] T 0e2eae4c387445f39a059befe390fe45 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:56.457438  1794 raft_consensus.cc:740] T 0e2eae4c387445f39a059befe390fe45 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:56.457916  1794 consensus_queue.cc:260] T 0e2eae4c387445f39a059befe390fe45 P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:26:56.459441  1794 ts_tablet_manager.cc:1434] T 0e2eae4c387445f39a059befe390fe45 P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:26:56.460506  1794 tablet_bootstrap.cc:492] T 580f367489064e218eef65b4654744b8 P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:56.481263  1794 tablet_bootstrap.cc:492] T 580f367489064e218eef65b4654744b8 P aa098a557d34433896712068efd0d9a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:56.482223  1794 tablet_bootstrap.cc:492] T 580f367489064e218eef65b4654744b8 P aa098a557d34433896712068efd0d9a8: Bootstrap complete.
I20260709 12:26:56.482837  1794 ts_tablet_manager.cc:1403] T 580f367489064e218eef65b4654744b8 P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.008s
I20260709 12:26:56.484835  1794 raft_consensus.cc:359] T 580f367489064e218eef65b4654744b8 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:56.485293  1794 raft_consensus.cc:740] T 580f367489064e218eef65b4654744b8 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:56.485808  1794 consensus_queue.cc:260] T 580f367489064e218eef65b4654744b8 P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:26:56.487216  1794 ts_tablet_manager.cc:1434] T 580f367489064e218eef65b4654744b8 P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:26:56.488190  1794 tablet_bootstrap.cc:492] T 3a19a87d91404b73bdba7121512bf7aa P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:56.504313  1794 tablet_bootstrap.cc:492] T 3a19a87d91404b73bdba7121512bf7aa P aa098a557d34433896712068efd0d9a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:56.505236  1794 tablet_bootstrap.cc:492] T 3a19a87d91404b73bdba7121512bf7aa P aa098a557d34433896712068efd0d9a8: Bootstrap complete.
I20260709 12:26:56.505897  1794 ts_tablet_manager.cc:1403] T 3a19a87d91404b73bdba7121512bf7aa P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.001s
I20260709 12:26:56.508391  1794 raft_consensus.cc:359] T 3a19a87d91404b73bdba7121512bf7aa P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:56.509019  1794 raft_consensus.cc:740] T 3a19a87d91404b73bdba7121512bf7aa P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:56.509640  1794 consensus_queue.cc:260] T 3a19a87d91404b73bdba7121512bf7aa P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:56.511672  1794 ts_tablet_manager.cc:1434] T 3a19a87d91404b73bdba7121512bf7aa P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:26:56.513125  1794 tablet_bootstrap.cc:492] T e12f4bd1b2ed49988317684782c8616b P aa098a557d34433896712068efd0d9a8: Bootstrap starting.
I20260709 12:26:56.543360  1794 tablet_bootstrap.cc:492] T e12f4bd1b2ed49988317684782c8616b P aa098a557d34433896712068efd0d9a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:56.544329  1794 tablet_bootstrap.cc:492] T e12f4bd1b2ed49988317684782c8616b P aa098a557d34433896712068efd0d9a8: Bootstrap complete.
I20260709 12:26:56.544978  1794 ts_tablet_manager.cc:1403] T e12f4bd1b2ed49988317684782c8616b P aa098a557d34433896712068efd0d9a8: Time spent bootstrapping tablet: real 0.032s	user 0.005s	sys 0.023s
I20260709 12:26:56.547537  1794 raft_consensus.cc:359] T e12f4bd1b2ed49988317684782c8616b P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:56.548243  1794 raft_consensus.cc:740] T e12f4bd1b2ed49988317684782c8616b P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa098a557d34433896712068efd0d9a8, State: Initialized, Role: FOLLOWER
I20260709 12:26:56.548902  1794 consensus_queue.cc:260] T e12f4bd1b2ed49988317684782c8616b P aa098a557d34433896712068efd0d9a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:26:56.550927  1794 ts_tablet_manager.cc:1434] T e12f4bd1b2ed49988317684782c8616b P aa098a557d34433896712068efd0d9a8: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:26:56.631036  1853 raft_consensus.cc:3060] T e81f2374d9904e93bf2941ff8b241c09 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:26:56.954658  1853 raft_consensus.cc:3060] T b364263cacab4add984e2b6c912fb62e P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:05.741837 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:05.803994  1142 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f2713fe1c7148f0b6d9a69c53ec3515"
dest_uuid: "8fa35514a8d84740b1b46ae496307f20"
mode: GRACEFUL
new_leader_uuid: "aa098a557d34433896712068efd0d9a8"
 from {username='slave'} at 127.0.0.1:38342
I20260709 12:27:05.805063  1142 raft_consensus.cc:606] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 8fa35514a8d84740b1b46ae496307f20 [term 1 LEADER]: Received request to transfer leadership to TS aa098a557d34433896712068efd0d9a8
I20260709 12:27:05.808286  1142 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "343e626d0073462fa2020fcf2e2f8ffb"
dest_uuid: "8fa35514a8d84740b1b46ae496307f20"
mode: GRACEFUL
new_leader_uuid: "aa098a557d34433896712068efd0d9a8"
 from {username='slave'} at 127.0.0.1:38342
I20260709 12:27:05.808890  1142 raft_consensus.cc:606] T 343e626d0073462fa2020fcf2e2f8ffb P 8fa35514a8d84740b1b46ae496307f20 [term 1 LEADER]: Received request to transfer leadership to TS aa098a557d34433896712068efd0d9a8
I20260709 12:27:05.813856  2003 raft_consensus.cc:993] T 343e626d0073462fa2020fcf2e2f8ffb P 8fa35514a8d84740b1b46ae496307f20: : Instructing follower aa098a557d34433896712068efd0d9a8 to start an election
I20260709 12:27:05.814620  1989 raft_consensus.cc:1081] T 343e626d0073462fa2020fcf2e2f8ffb P 8fa35514a8d84740b1b46ae496307f20 [term 1 LEADER]: Signalling peer aa098a557d34433896712068efd0d9a8 to start an election
I20260709 12:27:05.816612  1844 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "343e626d0073462fa2020fcf2e2f8ffb"
dest_uuid: "aa098a557d34433896712068efd0d9a8"
 from {username='slave'} at 127.0.0.1:57604
I20260709 12:27:05.817176  1844 raft_consensus.cc:493] T 343e626d0073462fa2020fcf2e2f8ffb P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:05.817548  1844 raft_consensus.cc:3060] T 343e626d0073462fa2020fcf2e2f8ffb P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:05.825822  1218 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5b3d71845177478a9e2510c82e0cf9d1"
dest_uuid: "937efeddef934b2b8bc8632594903085"
mode: GRACEFUL
new_leader_uuid: "aa098a557d34433896712068efd0d9a8"
 from {username='slave'} at 127.0.0.1:34930
I20260709 12:27:05.826488  1218 raft_consensus.cc:606] T 5b3d71845177478a9e2510c82e0cf9d1 P 937efeddef934b2b8bc8632594903085 [term 2 LEADER]: Received request to transfer leadership to TS aa098a557d34433896712068efd0d9a8
I20260709 12:27:05.828119  1844 raft_consensus.cc:515] T 343e626d0073462fa2020fcf2e2f8ffb P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:27:05.829747  1142 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a7d578ba2eb41f7a38f15c5dd34b8cb"
dest_uuid: "8fa35514a8d84740b1b46ae496307f20"
mode: GRACEFUL
new_leader_uuid: "aa098a557d34433896712068efd0d9a8"
 from {username='slave'} at 127.0.0.1:38342
I20260709 12:27:05.830353  1142 raft_consensus.cc:606] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P 8fa35514a8d84740b1b46ae496307f20 [term 1 LEADER]: Received request to transfer leadership to TS aa098a557d34433896712068efd0d9a8
I20260709 12:27:05.831383  1844 leader_election.cc:290] T 343e626d0073462fa2020fcf2e2f8ffb P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 election: Requested vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:27:05.832208  1218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343e626d0073462fa2020fcf2e2f8ffb" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "937efeddef934b2b8bc8632594903085"
I20260709 12:27:05.832500  1143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "343e626d0073462fa2020fcf2e2f8ffb" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8fa35514a8d84740b1b46ae496307f20"
I20260709 12:27:05.833302  1218 raft_consensus.cc:3060] T 343e626d0073462fa2020fcf2e2f8ffb P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:05.833390  1143 raft_consensus.cc:3055] T 343e626d0073462fa2020fcf2e2f8ffb P 8fa35514a8d84740b1b46ae496307f20 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:05.833846  1143 raft_consensus.cc:740] T 343e626d0073462fa2020fcf2e2f8ffb P 8fa35514a8d84740b1b46ae496307f20 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Running, Role: LEADER
I20260709 12:27:05.834829  1143 consensus_queue.cc:260] T 343e626d0073462fa2020fcf2e2f8ffb P 8fa35514a8d84740b1b46ae496307f20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:27:05.841115  1143 raft_consensus.cc:3060] T 343e626d0073462fa2020fcf2e2f8ffb P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:05.842239  1218 raft_consensus.cc:2468] T 343e626d0073462fa2020fcf2e2f8ffb P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa098a557d34433896712068efd0d9a8 in term 2.
I20260709 12:27:05.843712  1788 leader_election.cc:304] T 343e626d0073462fa2020fcf2e2f8ffb P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 937efeddef934b2b8bc8632594903085, aa098a557d34433896712068efd0d9a8; no voters: 
I20260709 12:27:05.844907  1144 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4234c6cf75048c5a6cdf34e43c9bd1e"
dest_uuid: "8fa35514a8d84740b1b46ae496307f20"
mode: GRACEFUL
new_leader_uuid: "aa098a557d34433896712068efd0d9a8"
 from {username='slave'} at 127.0.0.1:38342
I20260709 12:27:05.846011  1144 raft_consensus.cc:606] T c4234c6cf75048c5a6cdf34e43c9bd1e P 8fa35514a8d84740b1b46ae496307f20 [term 2 LEADER]: Received request to transfer leadership to TS aa098a557d34433896712068efd0d9a8
I20260709 12:27:05.852022  1143 raft_consensus.cc:2468] T 343e626d0073462fa2020fcf2e2f8ffb P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa098a557d34433896712068efd0d9a8 in term 2.
I20260709 12:27:05.853381  1144 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e6de424e08ed4b1d8f6d32d17a44025d"
dest_uuid: "8fa35514a8d84740b1b46ae496307f20"
mode: GRACEFUL
new_leader_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
 from {username='slave'} at 127.0.0.1:38342
I20260709 12:27:05.854287  1144 raft_consensus.cc:606] T e6de424e08ed4b1d8f6d32d17a44025d P 8fa35514a8d84740b1b46ae496307f20 [term 1 LEADER]: Received request to transfer leadership to TS 7f9cbe40e40d429aa004e4a7fb42f132
I20260709 12:27:05.855783 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:27:05.856011  2008 raft_consensus.cc:2804] T 343e626d0073462fa2020fcf2e2f8ffb P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:05.857342 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:05.858563 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:05.867373  2008 raft_consensus.cc:697] T 343e626d0073462fa2020fcf2e2f8ffb P aa098a557d34433896712068efd0d9a8 [term 2 LEADER]: Becoming Leader. State: Replica: aa098a557d34433896712068efd0d9a8, State: Running, Role: LEADER
I20260709 12:27:05.868897  2008 consensus_queue.cc:237] T 343e626d0073462fa2020fcf2e2f8ffb P aa098a557d34433896712068efd0d9a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:27:05.889163   895 catalog_manager.cc:5697] T 343e626d0073462fa2020fcf2e2f8ffb P aa098a557d34433896712068efd0d9a8 reported cstate change: term changed from 1 to 2, leader changed from 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131) to aa098a557d34433896712068efd0d9a8 (127.23.245.129). New cstate: current_term: 2 leader_uuid: "aa098a557d34433896712068efd0d9a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:05.991425  2003 raft_consensus.cc:993] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 8fa35514a8d84740b1b46ae496307f20: : Instructing follower aa098a557d34433896712068efd0d9a8 to start an election
I20260709 12:27:05.992101  1999 raft_consensus.cc:1081] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 8fa35514a8d84740b1b46ae496307f20 [term 1 LEADER]: Signalling peer aa098a557d34433896712068efd0d9a8 to start an election
I20260709 12:27:05.994155  1852 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f2713fe1c7148f0b6d9a69c53ec3515"
dest_uuid: "aa098a557d34433896712068efd0d9a8"
 from {username='slave'} at 127.0.0.1:57604
I20260709 12:27:05.994670  1852 raft_consensus.cc:493] T 2f2713fe1c7148f0b6d9a69c53ec3515 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:05.994990  1852 raft_consensus.cc:3060] T 2f2713fe1c7148f0b6d9a69c53ec3515 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:06.000782  1852 raft_consensus.cc:515] T 2f2713fe1c7148f0b6d9a69c53ec3515 P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:27:06.002243  1852 leader_election.cc:290] T 2f2713fe1c7148f0b6d9a69c53ec3515 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 election: Requested vote from peers 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679), 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341)
I20260709 12:27:06.003129  1144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2713fe1c7148f0b6d9a69c53ec3515" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8fa35514a8d84740b1b46ae496307f20"
I20260709 12:27:06.003226  1068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2713fe1c7148f0b6d9a69c53ec3515" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
I20260709 12:27:06.003757  1144 raft_consensus.cc:3055] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 8fa35514a8d84740b1b46ae496307f20 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:06.003873  1068 raft_consensus.cc:3060] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:06.004140  1144 raft_consensus.cc:740] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 8fa35514a8d84740b1b46ae496307f20 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Running, Role: LEADER
I20260709 12:27:06.005014  1144 consensus_queue.cc:260] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 8fa35514a8d84740b1b46ae496307f20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:27:06.006011  1144 raft_consensus.cc:3060] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:06.010182  1068 raft_consensus.cc:2468] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa098a557d34433896712068efd0d9a8 in term 2.
I20260709 12:27:06.011672  1789 leader_election.cc:304] T 2f2713fe1c7148f0b6d9a69c53ec3515 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, aa098a557d34433896712068efd0d9a8; no voters: 
I20260709 12:27:06.012547  2008 raft_consensus.cc:2804] T 2f2713fe1c7148f0b6d9a69c53ec3515 P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:06.013108  2008 raft_consensus.cc:697] T 2f2713fe1c7148f0b6d9a69c53ec3515 P aa098a557d34433896712068efd0d9a8 [term 2 LEADER]: Becoming Leader. State: Replica: aa098a557d34433896712068efd0d9a8, State: Running, Role: LEADER
I20260709 12:27:06.013988  2008 consensus_queue.cc:237] T 2f2713fe1c7148f0b6d9a69c53ec3515 P aa098a557d34433896712068efd0d9a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:27:06.016294  1144 raft_consensus.cc:2468] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa098a557d34433896712068efd0d9a8 in term 2.
I20260709 12:27:06.027001   895 catalog_manager.cc:5697] T 2f2713fe1c7148f0b6d9a69c53ec3515 P aa098a557d34433896712068efd0d9a8 reported cstate change: term changed from 1 to 2, leader changed from 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131) to aa098a557d34433896712068efd0d9a8 (127.23.245.129). New cstate: current_term: 2 leader_uuid: "aa098a557d34433896712068efd0d9a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:06.050582  2003 raft_consensus.cc:993] T c4234c6cf75048c5a6cdf34e43c9bd1e P 8fa35514a8d84740b1b46ae496307f20: : Instructing follower aa098a557d34433896712068efd0d9a8 to start an election
I20260709 12:27:06.051187  1999 raft_consensus.cc:1081] T c4234c6cf75048c5a6cdf34e43c9bd1e P 8fa35514a8d84740b1b46ae496307f20 [term 2 LEADER]: Signalling peer aa098a557d34433896712068efd0d9a8 to start an election
I20260709 12:27:06.052739  1852 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4234c6cf75048c5a6cdf34e43c9bd1e"
dest_uuid: "aa098a557d34433896712068efd0d9a8"
 from {username='slave'} at 127.0.0.1:57604
I20260709 12:27:06.053154  1852 raft_consensus.cc:493] T c4234c6cf75048c5a6cdf34e43c9bd1e P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:06.053386  1852 raft_consensus.cc:3060] T c4234c6cf75048c5a6cdf34e43c9bd1e P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:06.059090  1852 raft_consensus.cc:515] T c4234c6cf75048c5a6cdf34e43c9bd1e P aa098a557d34433896712068efd0d9a8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:27:06.061276  1852 leader_election.cc:290] T c4234c6cf75048c5a6cdf34e43c9bd1e P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 3 election: Requested vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:27:06.061905  1144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4234c6cf75048c5a6cdf34e43c9bd1e" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8fa35514a8d84740b1b46ae496307f20"
I20260709 12:27:06.061947  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4234c6cf75048c5a6cdf34e43c9bd1e" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "937efeddef934b2b8bc8632594903085"
I20260709 12:27:06.062578  1144 raft_consensus.cc:3055] T c4234c6cf75048c5a6cdf34e43c9bd1e P 8fa35514a8d84740b1b46ae496307f20 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:06.062932  1144 raft_consensus.cc:740] T c4234c6cf75048c5a6cdf34e43c9bd1e P 8fa35514a8d84740b1b46ae496307f20 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Running, Role: LEADER
I20260709 12:27:06.062966  1220 raft_consensus.cc:3060] T c4234c6cf75048c5a6cdf34e43c9bd1e P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:06.064883  1144 consensus_queue.cc:260] T c4234c6cf75048c5a6cdf34e43c9bd1e P 8fa35514a8d84740b1b46ae496307f20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:27:06.066206  1144 raft_consensus.cc:3060] T c4234c6cf75048c5a6cdf34e43c9bd1e P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:06.071244  1220 raft_consensus.cc:2468] T c4234c6cf75048c5a6cdf34e43c9bd1e P 937efeddef934b2b8bc8632594903085 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa098a557d34433896712068efd0d9a8 in term 3.
I20260709 12:27:06.072461  1788 leader_election.cc:304] T c4234c6cf75048c5a6cdf34e43c9bd1e P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 937efeddef934b2b8bc8632594903085, aa098a557d34433896712068efd0d9a8; no voters: 
I20260709 12:27:06.072801  1144 raft_consensus.cc:2468] T c4234c6cf75048c5a6cdf34e43c9bd1e P 8fa35514a8d84740b1b46ae496307f20 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa098a557d34433896712068efd0d9a8 in term 3.
I20260709 12:27:06.073468  2008 raft_consensus.cc:2804] T c4234c6cf75048c5a6cdf34e43c9bd1e P aa098a557d34433896712068efd0d9a8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:06.074059  2008 raft_consensus.cc:697] T c4234c6cf75048c5a6cdf34e43c9bd1e P aa098a557d34433896712068efd0d9a8 [term 3 LEADER]: Becoming Leader. State: Replica: aa098a557d34433896712068efd0d9a8, State: Running, Role: LEADER
I20260709 12:27:06.075062  2008 consensus_queue.cc:237] T c4234c6cf75048c5a6cdf34e43c9bd1e P aa098a557d34433896712068efd0d9a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:27:06.086755   895 catalog_manager.cc:5697] T c4234c6cf75048c5a6cdf34e43c9bd1e P aa098a557d34433896712068efd0d9a8 reported cstate change: term changed from 2 to 3, leader changed from 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131) to aa098a557d34433896712068efd0d9a8 (127.23.245.129). New cstate: current_term: 3 leader_uuid: "aa098a557d34433896712068efd0d9a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:06.147620  1989 raft_consensus.cc:993] T e6de424e08ed4b1d8f6d32d17a44025d P 8fa35514a8d84740b1b46ae496307f20: : Instructing follower 7f9cbe40e40d429aa004e4a7fb42f132 to start an election
I20260709 12:27:06.148109  1989 raft_consensus.cc:1081] T e6de424e08ed4b1d8f6d32d17a44025d P 8fa35514a8d84740b1b46ae496307f20 [term 1 LEADER]: Signalling peer 7f9cbe40e40d429aa004e4a7fb42f132 to start an election
I20260709 12:27:06.150534  1068 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e6de424e08ed4b1d8f6d32d17a44025d"
dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
 from {username='slave'} at 127.0.0.1:43456
I20260709 12:27:06.151248  1068 raft_consensus.cc:493] T e6de424e08ed4b1d8f6d32d17a44025d P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:06.151662  1068 raft_consensus.cc:3060] T e6de424e08ed4b1d8f6d32d17a44025d P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:06.158326  1068 raft_consensus.cc:515] T e6de424e08ed4b1d8f6d32d17a44025d P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:27:06.160470  1068 leader_election.cc:290] T e6de424e08ed4b1d8f6d32d17a44025d P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 2 election: Requested vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:27:06.161401  1144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6de424e08ed4b1d8f6d32d17a44025d" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8fa35514a8d84740b1b46ae496307f20"
I20260709 12:27:06.161530  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e6de424e08ed4b1d8f6d32d17a44025d" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "937efeddef934b2b8bc8632594903085"
I20260709 12:27:06.162227  1144 raft_consensus.cc:3055] T e6de424e08ed4b1d8f6d32d17a44025d P 8fa35514a8d84740b1b46ae496307f20 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:06.162242  1220 raft_consensus.cc:3060] T e6de424e08ed4b1d8f6d32d17a44025d P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:06.162611  1144 raft_consensus.cc:740] T e6de424e08ed4b1d8f6d32d17a44025d P 8fa35514a8d84740b1b46ae496307f20 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Running, Role: LEADER
I20260709 12:27:06.163506  1144 consensus_queue.cc:260] T e6de424e08ed4b1d8f6d32d17a44025d P 8fa35514a8d84740b1b46ae496307f20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:27:06.164476  1144 raft_consensus.cc:3060] T e6de424e08ed4b1d8f6d32d17a44025d P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:06.169625  1220 raft_consensus.cc:2468] T e6de424e08ed4b1d8f6d32d17a44025d P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f9cbe40e40d429aa004e4a7fb42f132 in term 2.
I20260709 12:27:06.171227  1144 raft_consensus.cc:2468] T e6de424e08ed4b1d8f6d32d17a44025d P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f9cbe40e40d429aa004e4a7fb42f132 in term 2.
I20260709 12:27:06.171763  1035 leader_election.cc:304] T e6de424e08ed4b1d8f6d32d17a44025d P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 937efeddef934b2b8bc8632594903085; no voters: 
I20260709 12:27:06.172878  2001 raft_consensus.cc:2804] T e6de424e08ed4b1d8f6d32d17a44025d P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:06.173481  2001 raft_consensus.cc:697] T e6de424e08ed4b1d8f6d32d17a44025d P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 LEADER]: Becoming Leader. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Running, Role: LEADER
I20260709 12:27:06.174683  2001 consensus_queue.cc:237] T e6de424e08ed4b1d8f6d32d17a44025d P 7f9cbe40e40d429aa004e4a7fb42f132 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:27:06.186307   895 catalog_manager.cc:5697] T e6de424e08ed4b1d8f6d32d17a44025d P 7f9cbe40e40d429aa004e4a7fb42f132 reported cstate change: term changed from 1 to 2, leader changed from 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131) to 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130). New cstate: current_term: 2 leader_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:06.273221  1996 raft_consensus.cc:993] T 5b3d71845177478a9e2510c82e0cf9d1 P 937efeddef934b2b8bc8632594903085: : Instructing follower aa098a557d34433896712068efd0d9a8 to start an election
I20260709 12:27:06.273861  2016 raft_consensus.cc:1081] T 5b3d71845177478a9e2510c82e0cf9d1 P 937efeddef934b2b8bc8632594903085 [term 2 LEADER]: Signalling peer aa098a557d34433896712068efd0d9a8 to start an election
I20260709 12:27:06.276305  1844 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5b3d71845177478a9e2510c82e0cf9d1"
dest_uuid: "aa098a557d34433896712068efd0d9a8"
 from {username='slave'} at 127.0.0.1:57606
I20260709 12:27:06.276893  1844 raft_consensus.cc:493] T 5b3d71845177478a9e2510c82e0cf9d1 P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:06.277212  1844 raft_consensus.cc:3060] T 5b3d71845177478a9e2510c82e0cf9d1 P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:06.283771  1844 raft_consensus.cc:515] T 5b3d71845177478a9e2510c82e0cf9d1 P aa098a557d34433896712068efd0d9a8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:27:06.285662  1844 leader_election.cc:290] T 5b3d71845177478a9e2510c82e0cf9d1 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 3 election: Requested vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:27:06.286798  1063 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3d71845177478a9e2510c82e0cf9d1" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
I20260709 12:27:06.287515  1063 raft_consensus.cc:3060] T 5b3d71845177478a9e2510c82e0cf9d1 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:06.287364  1220 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b3d71845177478a9e2510c82e0cf9d1" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "937efeddef934b2b8bc8632594903085"
I20260709 12:27:06.288123  1220 raft_consensus.cc:3055] T 5b3d71845177478a9e2510c82e0cf9d1 P 937efeddef934b2b8bc8632594903085 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:06.288380  1220 raft_consensus.cc:740] T 5b3d71845177478a9e2510c82e0cf9d1 P 937efeddef934b2b8bc8632594903085 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 937efeddef934b2b8bc8632594903085, State: Running, Role: LEADER
I20260709 12:27:06.289099  1220 consensus_queue.cc:260] T 5b3d71845177478a9e2510c82e0cf9d1 P 937efeddef934b2b8bc8632594903085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:27:06.290253  1220 raft_consensus.cc:3060] T 5b3d71845177478a9e2510c82e0cf9d1 P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:06.295488  1063 raft_consensus.cc:2468] T 5b3d71845177478a9e2510c82e0cf9d1 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa098a557d34433896712068efd0d9a8 in term 3.
I20260709 12:27:06.306722  2003 raft_consensus.cc:993] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P 8fa35514a8d84740b1b46ae496307f20: : Instructing follower aa098a557d34433896712068efd0d9a8 to start an election
I20260709 12:27:06.307298  2003 raft_consensus.cc:1081] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P 8fa35514a8d84740b1b46ae496307f20 [term 1 LEADER]: Signalling peer aa098a557d34433896712068efd0d9a8 to start an election
I20260709 12:27:06.308005  1789 leader_election.cc:304] T 5b3d71845177478a9e2510c82e0cf9d1 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, aa098a557d34433896712068efd0d9a8; no voters: 
I20260709 12:27:06.308923  2008 raft_consensus.cc:2804] T 5b3d71845177478a9e2510c82e0cf9d1 P aa098a557d34433896712068efd0d9a8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:06.308986  1844 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9a7d578ba2eb41f7a38f15c5dd34b8cb"
dest_uuid: "aa098a557d34433896712068efd0d9a8"
 from {username='slave'} at 127.0.0.1:57604
I20260709 12:27:06.309482  2008 raft_consensus.cc:697] T 5b3d71845177478a9e2510c82e0cf9d1 P aa098a557d34433896712068efd0d9a8 [term 3 LEADER]: Becoming Leader. State: Replica: aa098a557d34433896712068efd0d9a8, State: Running, Role: LEADER
I20260709 12:27:06.309662  1844 raft_consensus.cc:493] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:06.310083  1844 raft_consensus.cc:3060] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:06.310459  2008 consensus_queue.cc:237] T 5b3d71845177478a9e2510c82e0cf9d1 P aa098a557d34433896712068efd0d9a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:27:06.316556  1220 raft_consensus.cc:2468] T 5b3d71845177478a9e2510c82e0cf9d1 P 937efeddef934b2b8bc8632594903085 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa098a557d34433896712068efd0d9a8 in term 3.
I20260709 12:27:06.323233  1144 raft_consensus.cc:1275] T 343e626d0073462fa2020fcf2e2f8ffb P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Refusing update from remote peer aa098a557d34433896712068efd0d9a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:06.326179  2009 consensus_queue.cc:1048] T 343e626d0073462fa2020fcf2e2f8ffb P aa098a557d34433896712068efd0d9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:06.326251  1844 raft_consensus.cc:515] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:27:06.367336  1844 leader_election.cc:290] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 election: Requested vote from peers 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679), 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341)
I20260709 12:27:06.375780  1067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7d578ba2eb41f7a38f15c5dd34b8cb" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
I20260709 12:27:06.377950  1067 raft_consensus.cc:3060] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:06.386868   895 catalog_manager.cc:5697] T 5b3d71845177478a9e2510c82e0cf9d1 P aa098a557d34433896712068efd0d9a8 reported cstate change: term changed from 2 to 3, leader changed from 937efeddef934b2b8bc8632594903085 (127.23.245.132) to aa098a557d34433896712068efd0d9a8 (127.23.245.129). New cstate: current_term: 3 leader_uuid: "aa098a557d34433896712068efd0d9a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:06.395840  1219 raft_consensus.cc:1275] T 343e626d0073462fa2020fcf2e2f8ffb P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Refusing update from remote peer aa098a557d34433896712068efd0d9a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:06.413138  1067 raft_consensus.cc:2468] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa098a557d34433896712068efd0d9a8 in term 2.
I20260709 12:27:06.415746  1789 leader_election.cc:304] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, aa098a557d34433896712068efd0d9a8; no voters: 
I20260709 12:27:06.416746  2008 raft_consensus.cc:2804] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:06.417562  2008 raft_consensus.cc:697] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P aa098a557d34433896712068efd0d9a8 [term 2 LEADER]: Becoming Leader. State: Replica: aa098a557d34433896712068efd0d9a8, State: Running, Role: LEADER
I20260709 12:27:06.418836  2008 consensus_queue.cc:237] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P aa098a557d34433896712068efd0d9a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:27:06.422801  2009 consensus_queue.cc:1048] T 343e626d0073462fa2020fcf2e2f8ffb P aa098a557d34433896712068efd0d9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:06.430039  1144 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a7d578ba2eb41f7a38f15c5dd34b8cb" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8fa35514a8d84740b1b46ae496307f20"
I20260709 12:27:06.430635  1144 raft_consensus.cc:3055] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P 8fa35514a8d84740b1b46ae496307f20 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:06.430845  1144 raft_consensus.cc:740] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P 8fa35514a8d84740b1b46ae496307f20 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Running, Role: LEADER
I20260709 12:27:06.431638  1144 consensus_queue.cc:260] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P 8fa35514a8d84740b1b46ae496307f20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:27:06.433902  1144 raft_consensus.cc:3060] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:06.439050  1067 raft_consensus.cc:1275] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Refusing update from remote peer aa098a557d34433896712068efd0d9a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:06.439227   895 catalog_manager.cc:5697] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P aa098a557d34433896712068efd0d9a8 reported cstate change: term changed from 1 to 2, leader changed from 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131) to aa098a557d34433896712068efd0d9a8 (127.23.245.129). New cstate: current_term: 2 leader_uuid: "aa098a557d34433896712068efd0d9a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:06.442729  2008 consensus_queue.cc:1048] T 2f2713fe1c7148f0b6d9a69c53ec3515 P aa098a557d34433896712068efd0d9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:06.457532  1144 raft_consensus.cc:2468] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa098a557d34433896712068efd0d9a8 in term 2.
W20260709 12:27:06.588263  1186 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:32981, user_credentials={real_user=slave}} blocked reactor thread for 103568us
I20260709 12:27:06.621114  1220 raft_consensus.cc:1275] T c4234c6cf75048c5a6cdf34e43c9bd1e P 937efeddef934b2b8bc8632594903085 [term 3 FOLLOWER]: Refusing update from remote peer aa098a557d34433896712068efd0d9a8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:06.625605  2009 consensus_queue.cc:1048] T c4234c6cf75048c5a6cdf34e43c9bd1e P aa098a557d34433896712068efd0d9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:06.637231  1144 raft_consensus.cc:1275] T e6de424e08ed4b1d8f6d32d17a44025d P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Refusing update from remote peer 7f9cbe40e40d429aa004e4a7fb42f132: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:06.643488  2001 consensus_queue.cc:1048] T e6de424e08ed4b1d8f6d32d17a44025d P 7f9cbe40e40d429aa004e4a7fb42f132 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:06.665735  1141 raft_consensus.cc:1275] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Refusing update from remote peer aa098a557d34433896712068efd0d9a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:06.667973  1141 raft_consensus.cc:1275] T c4234c6cf75048c5a6cdf34e43c9bd1e P 8fa35514a8d84740b1b46ae496307f20 [term 3 FOLLOWER]: Refusing update from remote peer aa098a557d34433896712068efd0d9a8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:06.669548  2008 consensus_queue.cc:1048] T 2f2713fe1c7148f0b6d9a69c53ec3515 P aa098a557d34433896712068efd0d9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:06.671764  2008 consensus_queue.cc:1048] T c4234c6cf75048c5a6cdf34e43c9bd1e P aa098a557d34433896712068efd0d9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:06.709583  1219 raft_consensus.cc:1275] T e6de424e08ed4b1d8f6d32d17a44025d P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Refusing update from remote peer 7f9cbe40e40d429aa004e4a7fb42f132: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:06.747885  2032 consensus_queue.cc:1048] T e6de424e08ed4b1d8f6d32d17a44025d P 7f9cbe40e40d429aa004e4a7fb42f132 [LEADER]: Connected to new peer: Peer: permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:06.775382  1218 raft_consensus.cc:1275] T 5b3d71845177478a9e2510c82e0cf9d1 P 937efeddef934b2b8bc8632594903085 [term 3 FOLLOWER]: Refusing update from remote peer aa098a557d34433896712068efd0d9a8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:06.778617  2008 consensus_queue.cc:1048] T 5b3d71845177478a9e2510c82e0cf9d1 P aa098a557d34433896712068efd0d9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:06.809687  1067 raft_consensus.cc:1275] T 5b3d71845177478a9e2510c82e0cf9d1 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 3 FOLLOWER]: Refusing update from remote peer aa098a557d34433896712068efd0d9a8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:06.813192  2023 consensus_queue.cc:1048] T 5b3d71845177478a9e2510c82e0cf9d1 P aa098a557d34433896712068efd0d9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:06.870477  1141 raft_consensus.cc:1275] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Refusing update from remote peer aa098a557d34433896712068efd0d9a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:06.872016  2023 consensus_queue.cc:1048] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P aa098a557d34433896712068efd0d9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:06.882891  1068 raft_consensus.cc:1275] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Refusing update from remote peer aa098a557d34433896712068efd0d9a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:06.886250  2023 consensus_queue.cc:1048] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P aa098a557d34433896712068efd0d9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:06.920564 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:06.965946  1141 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0017925ea1bb4374b09c9e692a17f87e"
dest_uuid: "8fa35514a8d84740b1b46ae496307f20"
mode: GRACEFUL
new_leader_uuid: "aa098a557d34433896712068efd0d9a8"
 from {username='slave'} at 127.0.0.1:38342
I20260709 12:27:06.966565  1141 raft_consensus.cc:606] T 0017925ea1bb4374b09c9e692a17f87e P 8fa35514a8d84740b1b46ae496307f20 [term 1 LEADER]: Received request to transfer leadership to TS aa098a557d34433896712068efd0d9a8
I20260709 12:27:06.969291  1141 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d2d9d3061d24ab1aac189e9a8b0a12d"
dest_uuid: "8fa35514a8d84740b1b46ae496307f20"
mode: GRACEFUL
new_leader_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
 from {username='slave'} at 127.0.0.1:38342
I20260709 12:27:06.969931  1141 raft_consensus.cc:606] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 8fa35514a8d84740b1b46ae496307f20 [term 1 LEADER]: Received request to transfer leadership to TS 7f9cbe40e40d429aa004e4a7fb42f132
I20260709 12:27:06.972757  1141 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5302c354091f4926812eb90f518b9d6a"
dest_uuid: "8fa35514a8d84740b1b46ae496307f20"
mode: GRACEFUL
new_leader_uuid: "aa098a557d34433896712068efd0d9a8"
 from {username='slave'} at 127.0.0.1:38342
I20260709 12:27:06.973347  1141 raft_consensus.cc:606] T 5302c354091f4926812eb90f518b9d6a P 8fa35514a8d84740b1b46ae496307f20 [term 1 LEADER]: Received request to transfer leadership to TS aa098a557d34433896712068efd0d9a8
I20260709 12:27:06.976004  1143 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6715731f9a31415a98fa8a0ab9944eec"
dest_uuid: "8fa35514a8d84740b1b46ae496307f20"
mode: GRACEFUL
new_leader_uuid: "aa098a557d34433896712068efd0d9a8"
 from {username='slave'} at 127.0.0.1:38342
I20260709 12:27:06.976595  1143 raft_consensus.cc:606] T 6715731f9a31415a98fa8a0ab9944eec P 8fa35514a8d84740b1b46ae496307f20 [term 2 LEADER]: Received request to transfer leadership to TS aa098a557d34433896712068efd0d9a8
I20260709 12:27:06.979266  1220 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8c7002e5875a494e8e845023cc05503f"
dest_uuid: "937efeddef934b2b8bc8632594903085"
mode: GRACEFUL
new_leader_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
 from {username='slave'} at 127.0.0.1:34930
I20260709 12:27:06.979800  1220 raft_consensus.cc:606] T 8c7002e5875a494e8e845023cc05503f P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Received request to transfer leadership to TS 7f9cbe40e40d429aa004e4a7fb42f132
I20260709 12:27:06.980971 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:27:06.982128 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:06.982877 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:07.235724  2003 raft_consensus.cc:993] T 0017925ea1bb4374b09c9e692a17f87e P 8fa35514a8d84740b1b46ae496307f20: : Instructing follower aa098a557d34433896712068efd0d9a8 to start an election
I20260709 12:27:07.236300  1989 raft_consensus.cc:1081] T 0017925ea1bb4374b09c9e692a17f87e P 8fa35514a8d84740b1b46ae496307f20 [term 1 LEADER]: Signalling peer aa098a557d34433896712068efd0d9a8 to start an election
I20260709 12:27:07.237670  1852 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0017925ea1bb4374b09c9e692a17f87e"
dest_uuid: "aa098a557d34433896712068efd0d9a8"
 from {username='slave'} at 127.0.0.1:57604
I20260709 12:27:07.238211  1852 raft_consensus.cc:493] T 0017925ea1bb4374b09c9e692a17f87e P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:07.238617  1852 raft_consensus.cc:3060] T 0017925ea1bb4374b09c9e692a17f87e P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:07.245581  1852 raft_consensus.cc:515] T 0017925ea1bb4374b09c9e692a17f87e P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:27:07.248656  1852 leader_election.cc:290] T 0017925ea1bb4374b09c9e692a17f87e P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 election: Requested vote from peers 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679), 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341)
I20260709 12:27:07.250573  1143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0017925ea1bb4374b09c9e692a17f87e" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8fa35514a8d84740b1b46ae496307f20"
I20260709 12:27:07.251246  1143 raft_consensus.cc:3055] T 0017925ea1bb4374b09c9e692a17f87e P 8fa35514a8d84740b1b46ae496307f20 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:07.251556  1143 raft_consensus.cc:740] T 0017925ea1bb4374b09c9e692a17f87e P 8fa35514a8d84740b1b46ae496307f20 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Running, Role: LEADER
I20260709 12:27:07.252307  1067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0017925ea1bb4374b09c9e692a17f87e" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
I20260709 12:27:07.252451  1143 consensus_queue.cc:260] T 0017925ea1bb4374b09c9e692a17f87e P 8fa35514a8d84740b1b46ae496307f20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:27:07.253912  1143 raft_consensus.cc:3060] T 0017925ea1bb4374b09c9e692a17f87e P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:07.252985  1067 raft_consensus.cc:3060] T 0017925ea1bb4374b09c9e692a17f87e P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:07.261298  1143 raft_consensus.cc:2468] T 0017925ea1bb4374b09c9e692a17f87e P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa098a557d34433896712068efd0d9a8 in term 2.
I20260709 12:27:07.261472  1067 raft_consensus.cc:2468] T 0017925ea1bb4374b09c9e692a17f87e P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa098a557d34433896712068efd0d9a8 in term 2.
I20260709 12:27:07.262706  1791 leader_election.cc:304] T 0017925ea1bb4374b09c9e692a17f87e P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20, aa098a557d34433896712068efd0d9a8; no voters: 
I20260709 12:27:07.263518  2023 raft_consensus.cc:2804] T 0017925ea1bb4374b09c9e692a17f87e P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:07.264091  2023 raft_consensus.cc:697] T 0017925ea1bb4374b09c9e692a17f87e P aa098a557d34433896712068efd0d9a8 [term 2 LEADER]: Becoming Leader. State: Replica: aa098a557d34433896712068efd0d9a8, State: Running, Role: LEADER
I20260709 12:27:07.264863  2023 consensus_queue.cc:237] T 0017925ea1bb4374b09c9e692a17f87e P aa098a557d34433896712068efd0d9a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } }
I20260709 12:27:07.275503   895 catalog_manager.cc:5697] T 0017925ea1bb4374b09c9e692a17f87e P aa098a557d34433896712068efd0d9a8 reported cstate change: term changed from 1 to 2, leader changed from 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131) to aa098a557d34433896712068efd0d9a8 (127.23.245.129). New cstate: current_term: 2 leader_uuid: "aa098a557d34433896712068efd0d9a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:07.307560  2003 raft_consensus.cc:993] T 5302c354091f4926812eb90f518b9d6a P 8fa35514a8d84740b1b46ae496307f20: : Instructing follower aa098a557d34433896712068efd0d9a8 to start an election
I20260709 12:27:07.308162  1989 raft_consensus.cc:1081] T 5302c354091f4926812eb90f518b9d6a P 8fa35514a8d84740b1b46ae496307f20 [term 1 LEADER]: Signalling peer aa098a557d34433896712068efd0d9a8 to start an election
I20260709 12:27:07.309584  1852 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5302c354091f4926812eb90f518b9d6a"
dest_uuid: "aa098a557d34433896712068efd0d9a8"
 from {username='slave'} at 127.0.0.1:57604
I20260709 12:27:07.310117  1852 raft_consensus.cc:493] T 5302c354091f4926812eb90f518b9d6a P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:07.310367  1852 raft_consensus.cc:3060] T 5302c354091f4926812eb90f518b9d6a P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:07.317018  1852 raft_consensus.cc:515] T 5302c354091f4926812eb90f518b9d6a P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:27:07.319226  1143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302c354091f4926812eb90f518b9d6a" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8fa35514a8d84740b1b46ae496307f20"
I20260709 12:27:07.318607  1852 leader_election.cc:290] T 5302c354091f4926812eb90f518b9d6a P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 election: Requested vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:27:07.319578  1218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5302c354091f4926812eb90f518b9d6a" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "937efeddef934b2b8bc8632594903085"
I20260709 12:27:07.320024  1143 raft_consensus.cc:3055] T 5302c354091f4926812eb90f518b9d6a P 8fa35514a8d84740b1b46ae496307f20 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:07.320322  1218 raft_consensus.cc:3060] T 5302c354091f4926812eb90f518b9d6a P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:07.320398  1143 raft_consensus.cc:740] T 5302c354091f4926812eb90f518b9d6a P 8fa35514a8d84740b1b46ae496307f20 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Running, Role: LEADER
I20260709 12:27:07.321295  1143 consensus_queue.cc:260] T 5302c354091f4926812eb90f518b9d6a P 8fa35514a8d84740b1b46ae496307f20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:27:07.322580  1143 raft_consensus.cc:3060] T 5302c354091f4926812eb90f518b9d6a P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:07.327275  1218 raft_consensus.cc:2468] T 5302c354091f4926812eb90f518b9d6a P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa098a557d34433896712068efd0d9a8 in term 2.
I20260709 12:27:07.328608  1788 leader_election.cc:304] T 5302c354091f4926812eb90f518b9d6a P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 937efeddef934b2b8bc8632594903085, aa098a557d34433896712068efd0d9a8; no voters: 
I20260709 12:27:07.329440  2023 raft_consensus.cc:2804] T 5302c354091f4926812eb90f518b9d6a P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:07.329571  1143 raft_consensus.cc:2468] T 5302c354091f4926812eb90f518b9d6a P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa098a557d34433896712068efd0d9a8 in term 2.
I20260709 12:27:07.330067  2023 raft_consensus.cc:697] T 5302c354091f4926812eb90f518b9d6a P aa098a557d34433896712068efd0d9a8 [term 2 LEADER]: Becoming Leader. State: Replica: aa098a557d34433896712068efd0d9a8, State: Running, Role: LEADER
I20260709 12:27:07.332017  2023 consensus_queue.cc:237] T 5302c354091f4926812eb90f518b9d6a P aa098a557d34433896712068efd0d9a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:27:07.333742  2003 raft_consensus.cc:993] T 6715731f9a31415a98fa8a0ab9944eec P 8fa35514a8d84740b1b46ae496307f20: : Instructing follower aa098a557d34433896712068efd0d9a8 to start an election
I20260709 12:27:07.334257  2003 raft_consensus.cc:1081] T 6715731f9a31415a98fa8a0ab9944eec P 8fa35514a8d84740b1b46ae496307f20 [term 2 LEADER]: Signalling peer aa098a557d34433896712068efd0d9a8 to start an election
I20260709 12:27:07.335963  1852 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6715731f9a31415a98fa8a0ab9944eec"
dest_uuid: "aa098a557d34433896712068efd0d9a8"
 from {username='slave'} at 127.0.0.1:57604
I20260709 12:27:07.336602  1852 raft_consensus.cc:493] T 6715731f9a31415a98fa8a0ab9944eec P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:07.336959  1852 raft_consensus.cc:3060] T 6715731f9a31415a98fa8a0ab9944eec P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:07.343575  1852 raft_consensus.cc:515] T 6715731f9a31415a98fa8a0ab9944eec P aa098a557d34433896712068efd0d9a8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:27:07.343562   895 catalog_manager.cc:5697] T 5302c354091f4926812eb90f518b9d6a P aa098a557d34433896712068efd0d9a8 reported cstate change: term changed from 1 to 2, leader changed from 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131) to aa098a557d34433896712068efd0d9a8 (127.23.245.129). New cstate: current_term: 2 leader_uuid: "aa098a557d34433896712068efd0d9a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:07.348551  1852 leader_election.cc:290] T 6715731f9a31415a98fa8a0ab9944eec P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 3 election: Requested vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:27:07.349175  1143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6715731f9a31415a98fa8a0ab9944eec" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8fa35514a8d84740b1b46ae496307f20"
I20260709 12:27:07.349874  1143 raft_consensus.cc:3055] T 6715731f9a31415a98fa8a0ab9944eec P 8fa35514a8d84740b1b46ae496307f20 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:07.350095  1143 raft_consensus.cc:740] T 6715731f9a31415a98fa8a0ab9944eec P 8fa35514a8d84740b1b46ae496307f20 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Running, Role: LEADER
I20260709 12:27:07.350934  1143 consensus_queue.cc:260] T 6715731f9a31415a98fa8a0ab9944eec P 8fa35514a8d84740b1b46ae496307f20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:27:07.352062  1218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6715731f9a31415a98fa8a0ab9944eec" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "937efeddef934b2b8bc8632594903085"
I20260709 12:27:07.352718  1218 raft_consensus.cc:3060] T 6715731f9a31415a98fa8a0ab9944eec P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:07.352985  1143 raft_consensus.cc:3060] T 6715731f9a31415a98fa8a0ab9944eec P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:07.358460  1143 raft_consensus.cc:2468] T 6715731f9a31415a98fa8a0ab9944eec P 8fa35514a8d84740b1b46ae496307f20 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa098a557d34433896712068efd0d9a8 in term 3.
I20260709 12:27:07.359447  1791 leader_election.cc:304] T 6715731f9a31415a98fa8a0ab9944eec P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20, aa098a557d34433896712068efd0d9a8; no voters: 
I20260709 12:27:07.359457  1218 raft_consensus.cc:2468] T 6715731f9a31415a98fa8a0ab9944eec P 937efeddef934b2b8bc8632594903085 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa098a557d34433896712068efd0d9a8 in term 3.
I20260709 12:27:07.360360  2023 raft_consensus.cc:2804] T 6715731f9a31415a98fa8a0ab9944eec P aa098a557d34433896712068efd0d9a8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:07.360834  2023 raft_consensus.cc:697] T 6715731f9a31415a98fa8a0ab9944eec P aa098a557d34433896712068efd0d9a8 [term 3 LEADER]: Becoming Leader. State: Replica: aa098a557d34433896712068efd0d9a8, State: Running, Role: LEADER
I20260709 12:27:07.361640  2023 consensus_queue.cc:237] T 6715731f9a31415a98fa8a0ab9944eec P aa098a557d34433896712068efd0d9a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:27:07.375619  2002 raft_consensus.cc:993] T 8c7002e5875a494e8e845023cc05503f P 937efeddef934b2b8bc8632594903085: : Instructing follower 7f9cbe40e40d429aa004e4a7fb42f132 to start an election
I20260709 12:27:07.376312  2002 raft_consensus.cc:1081] T 8c7002e5875a494e8e845023cc05503f P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Signalling peer 7f9cbe40e40d429aa004e4a7fb42f132 to start an election
I20260709 12:27:07.378018  1067 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8c7002e5875a494e8e845023cc05503f"
dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
 from {username='slave'} at 127.0.0.1:43454
I20260709 12:27:07.378609  1067 raft_consensus.cc:493] T 8c7002e5875a494e8e845023cc05503f P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:07.378979  1067 raft_consensus.cc:3060] T 8c7002e5875a494e8e845023cc05503f P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:07.388095  1067 raft_consensus.cc:515] T 8c7002e5875a494e8e845023cc05503f P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:27:07.390373  1067 leader_election.cc:290] T 8c7002e5875a494e8e845023cc05503f P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 2 election: Requested vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:27:07.392235   895 catalog_manager.cc:5697] T 6715731f9a31415a98fa8a0ab9944eec P aa098a557d34433896712068efd0d9a8 reported cstate change: term changed from 2 to 3, leader changed from 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131) to aa098a557d34433896712068efd0d9a8 (127.23.245.129). New cstate: current_term: 3 leader_uuid: "aa098a557d34433896712068efd0d9a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:07.396528  1143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7002e5875a494e8e845023cc05503f" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8fa35514a8d84740b1b46ae496307f20"
I20260709 12:27:07.397177  1143 raft_consensus.cc:3060] T 8c7002e5875a494e8e845023cc05503f P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:07.401480  1218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c7002e5875a494e8e845023cc05503f" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "937efeddef934b2b8bc8632594903085"
I20260709 12:27:07.402539  1218 raft_consensus.cc:3055] T 8c7002e5875a494e8e845023cc05503f P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:07.402848  1218 raft_consensus.cc:740] T 8c7002e5875a494e8e845023cc05503f P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 937efeddef934b2b8bc8632594903085, State: Running, Role: LEADER
I20260709 12:27:07.403591  1218 consensus_queue.cc:260] T 8c7002e5875a494e8e845023cc05503f P 937efeddef934b2b8bc8632594903085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:27:07.405923  1218 raft_consensus.cc:3060] T 8c7002e5875a494e8e845023cc05503f P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:07.409142  1143 raft_consensus.cc:2468] T 8c7002e5875a494e8e845023cc05503f P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f9cbe40e40d429aa004e4a7fb42f132 in term 2.
I20260709 12:27:07.410465  1038 leader_election.cc:304] T 8c7002e5875a494e8e845023cc05503f P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 8fa35514a8d84740b1b46ae496307f20; no voters: 
I20260709 12:27:07.411223  2049 raft_consensus.cc:2804] T 8c7002e5875a494e8e845023cc05503f P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:07.411747  2049 raft_consensus.cc:697] T 8c7002e5875a494e8e845023cc05503f P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 LEADER]: Becoming Leader. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Running, Role: LEADER
I20260709 12:27:07.412696  2049 consensus_queue.cc:237] T 8c7002e5875a494e8e845023cc05503f P 7f9cbe40e40d429aa004e4a7fb42f132 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:27:07.415141  1218 raft_consensus.cc:2468] T 8c7002e5875a494e8e845023cc05503f P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f9cbe40e40d429aa004e4a7fb42f132 in term 2.
I20260709 12:27:07.422660   895 catalog_manager.cc:5697] T 8c7002e5875a494e8e845023cc05503f P 7f9cbe40e40d429aa004e4a7fb42f132 reported cstate change: term changed from 1 to 2, leader changed from 937efeddef934b2b8bc8632594903085 (127.23.245.132) to 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130). New cstate: current_term: 2 leader_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:07.442284  1989 raft_consensus.cc:993] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 8fa35514a8d84740b1b46ae496307f20: : Instructing follower 7f9cbe40e40d429aa004e4a7fb42f132 to start an election
I20260709 12:27:07.442763  1989 raft_consensus.cc:1081] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 8fa35514a8d84740b1b46ae496307f20 [term 1 LEADER]: Signalling peer 7f9cbe40e40d429aa004e4a7fb42f132 to start an election
I20260709 12:27:07.444341  1068 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d2d9d3061d24ab1aac189e9a8b0a12d"
dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
 from {username='slave'} at 127.0.0.1:43456
I20260709 12:27:07.444856  1068 raft_consensus.cc:493] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:07.445201  1068 raft_consensus.cc:3060] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:07.456580  1068 raft_consensus.cc:515] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:27:07.458314  1068 leader_election.cc:290] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 2 election: Requested vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:27:07.459262  1143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2d9d3061d24ab1aac189e9a8b0a12d" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8fa35514a8d84740b1b46ae496307f20"
I20260709 12:27:07.459966  1143 raft_consensus.cc:3055] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 8fa35514a8d84740b1b46ae496307f20 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:07.460270  1143 raft_consensus.cc:740] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 8fa35514a8d84740b1b46ae496307f20 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8fa35514a8d84740b1b46ae496307f20, State: Running, Role: LEADER
I20260709 12:27:07.461004  1143 consensus_queue.cc:260] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 8fa35514a8d84740b1b46ae496307f20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:27:07.461917  1143 raft_consensus.cc:3060] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:07.464129  1218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d2d9d3061d24ab1aac189e9a8b0a12d" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "937efeddef934b2b8bc8632594903085"
I20260709 12:27:07.464854  1218 raft_consensus.cc:3060] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:07.474665  1218 raft_consensus.cc:2468] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f9cbe40e40d429aa004e4a7fb42f132 in term 2.
I20260709 12:27:07.476920  1143 raft_consensus.cc:2468] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f9cbe40e40d429aa004e4a7fb42f132 in term 2.
I20260709 12:27:07.477612  1035 leader_election.cc:304] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 937efeddef934b2b8bc8632594903085; no voters: 
I20260709 12:27:07.478452  2049 raft_consensus.cc:2804] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:07.478955  2049 raft_consensus.cc:697] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 LEADER]: Becoming Leader. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Running, Role: LEADER
I20260709 12:27:07.479848  2049 consensus_queue.cc:237] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 7f9cbe40e40d429aa004e4a7fb42f132 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:27:07.490190   895 catalog_manager.cc:5697] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 7f9cbe40e40d429aa004e4a7fb42f132 reported cstate change: term changed from 1 to 2, leader changed from 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131) to 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130). New cstate: current_term: 2 leader_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:07.791188  1218 raft_consensus.cc:1275] T 6715731f9a31415a98fa8a0ab9944eec P 937efeddef934b2b8bc8632594903085 [term 3 FOLLOWER]: Refusing update from remote peer aa098a557d34433896712068efd0d9a8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:07.792572  2023 consensus_queue.cc:1048] T 6715731f9a31415a98fa8a0ab9944eec P aa098a557d34433896712068efd0d9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:07.809424  1141 raft_consensus.cc:1275] T 6715731f9a31415a98fa8a0ab9944eec P 8fa35514a8d84740b1b46ae496307f20 [term 3 FOLLOWER]: Refusing update from remote peer aa098a557d34433896712068efd0d9a8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:07.810742  2023 consensus_queue.cc:1048] T 6715731f9a31415a98fa8a0ab9944eec P aa098a557d34433896712068efd0d9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:07.831246  1141 raft_consensus.cc:1275] T 0017925ea1bb4374b09c9e692a17f87e P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Refusing update from remote peer aa098a557d34433896712068efd0d9a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:07.832665  2023 consensus_queue.cc:1048] T 0017925ea1bb4374b09c9e692a17f87e P aa098a557d34433896712068efd0d9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:07.863379  1067 raft_consensus.cc:1275] T 0017925ea1bb4374b09c9e692a17f87e P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Refusing update from remote peer aa098a557d34433896712068efd0d9a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:07.869655  1218 raft_consensus.cc:1275] T 5302c354091f4926812eb90f518b9d6a P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Refusing update from remote peer aa098a557d34433896712068efd0d9a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:07.870728  2041 consensus_queue.cc:1048] T 0017925ea1bb4374b09c9e692a17f87e P aa098a557d34433896712068efd0d9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:07.872557  2041 consensus_queue.cc:1048] T 5302c354091f4926812eb90f518b9d6a P aa098a557d34433896712068efd0d9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:07.893697  1141 raft_consensus.cc:1275] T 5302c354091f4926812eb90f518b9d6a P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Refusing update from remote peer aa098a557d34433896712068efd0d9a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:07.895800  2041 consensus_queue.cc:1048] T 5302c354091f4926812eb90f518b9d6a P aa098a557d34433896712068efd0d9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:07.902701  1143 raft_consensus.cc:1275] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Refusing update from remote peer 7f9cbe40e40d429aa004e4a7fb42f132: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:07.904932  2049 consensus_queue.cc:1048] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 7f9cbe40e40d429aa004e4a7fb42f132 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:07.917750  1141 raft_consensus.cc:1275] T 8c7002e5875a494e8e845023cc05503f P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Refusing update from remote peer 7f9cbe40e40d429aa004e4a7fb42f132: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:07.919503  2032 consensus_queue.cc:1048] T 8c7002e5875a494e8e845023cc05503f P 7f9cbe40e40d429aa004e4a7fb42f132 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:07.922772  1218 raft_consensus.cc:1275] T 8c7002e5875a494e8e845023cc05503f P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Refusing update from remote peer 7f9cbe40e40d429aa004e4a7fb42f132: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:07.927309  2032 consensus_queue.cc:1048] T 8c7002e5875a494e8e845023cc05503f P 7f9cbe40e40d429aa004e4a7fb42f132 [LEADER]: Connected to new peer: Peer: permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:07.978391  1220 raft_consensus.cc:1275] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Refusing update from remote peer 7f9cbe40e40d429aa004e4a7fb42f132: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:07.982411  2068 consensus_queue.cc:1048] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 7f9cbe40e40d429aa004e4a7fb42f132 [LEADER]: Connected to new peer: Peer: permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:08.025801 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:08.068637  1220 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b6df135b8494d0d916747b8994b5cf9"
dest_uuid: "937efeddef934b2b8bc8632594903085"
mode: GRACEFUL
new_leader_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
 from {username='slave'} at 127.0.0.1:34930
I20260709 12:27:08.069259  1220 raft_consensus.cc:606] T 1b6df135b8494d0d916747b8994b5cf9 P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Received request to transfer leadership to TS 7f9cbe40e40d429aa004e4a7fb42f132
I20260709 12:27:08.072134  1220 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c97b34e374ed4aec812cc43e2a5f07de"
dest_uuid: "937efeddef934b2b8bc8632594903085"
mode: GRACEFUL
new_leader_uuid: "aa098a557d34433896712068efd0d9a8"
 from {username='slave'} at 127.0.0.1:34930
I20260709 12:27:08.072642  1220 raft_consensus.cc:606] T c97b34e374ed4aec812cc43e2a5f07de P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Received request to transfer leadership to TS aa098a557d34433896712068efd0d9a8
I20260709 12:27:08.075026  1220 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc91bacc3de44d21bc62d8b9a003fdcf"
dest_uuid: "937efeddef934b2b8bc8632594903085"
mode: GRACEFUL
new_leader_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
 from {username='slave'} at 127.0.0.1:34930
I20260709 12:27:08.075474  1220 raft_consensus.cc:606] T dc91bacc3de44d21bc62d8b9a003fdcf P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Received request to transfer leadership to TS 7f9cbe40e40d429aa004e4a7fb42f132
I20260709 12:27:08.077859  1220 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e12f4bd1b2ed49988317684782c8616b"
dest_uuid: "937efeddef934b2b8bc8632594903085"
mode: GRACEFUL
new_leader_uuid: "aa098a557d34433896712068efd0d9a8"
 from {username='slave'} at 127.0.0.1:34930
I20260709 12:27:08.078420  1220 raft_consensus.cc:606] T e12f4bd1b2ed49988317684782c8616b P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Received request to transfer leadership to TS aa098a557d34433896712068efd0d9a8
I20260709 12:27:08.080875  1220 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e2ef4b262fac46fe9f9111b609547aa3"
dest_uuid: "937efeddef934b2b8bc8632594903085"
mode: GRACEFUL
new_leader_uuid: "aa098a557d34433896712068efd0d9a8"
 from {username='slave'} at 127.0.0.1:34930
I20260709 12:27:08.081274  1220 raft_consensus.cc:606] T e2ef4b262fac46fe9f9111b609547aa3 P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Received request to transfer leadership to TS aa098a557d34433896712068efd0d9a8
I20260709 12:27:08.082368 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:27:08.084506 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:08.085839 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:08.154611  2002 raft_consensus.cc:993] T 1b6df135b8494d0d916747b8994b5cf9 P 937efeddef934b2b8bc8632594903085: : Instructing follower 7f9cbe40e40d429aa004e4a7fb42f132 to start an election
I20260709 12:27:08.155378  2016 raft_consensus.cc:1081] T 1b6df135b8494d0d916747b8994b5cf9 P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Signalling peer 7f9cbe40e40d429aa004e4a7fb42f132 to start an election
I20260709 12:27:08.157001  1067 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1b6df135b8494d0d916747b8994b5cf9"
dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
 from {username='slave'} at 127.0.0.1:43454
I20260709 12:27:08.157559  1067 raft_consensus.cc:493] T 1b6df135b8494d0d916747b8994b5cf9 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:08.157986  1067 raft_consensus.cc:3060] T 1b6df135b8494d0d916747b8994b5cf9 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:08.167467  1067 raft_consensus.cc:515] T 1b6df135b8494d0d916747b8994b5cf9 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:27:08.170288  1067 leader_election.cc:290] T 1b6df135b8494d0d916747b8994b5cf9 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 2 election: Requested vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:27:08.170842  1141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b6df135b8494d0d916747b8994b5cf9" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8fa35514a8d84740b1b46ae496307f20"
I20260709 12:27:08.171495  1218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b6df135b8494d0d916747b8994b5cf9" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "937efeddef934b2b8bc8632594903085"
I20260709 12:27:08.171988  1141 raft_consensus.cc:3060] T 1b6df135b8494d0d916747b8994b5cf9 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:08.172160  1218 raft_consensus.cc:3055] T 1b6df135b8494d0d916747b8994b5cf9 P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:08.172665  1218 raft_consensus.cc:740] T 1b6df135b8494d0d916747b8994b5cf9 P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 937efeddef934b2b8bc8632594903085, State: Running, Role: LEADER
I20260709 12:27:08.173544  1218 consensus_queue.cc:260] T 1b6df135b8494d0d916747b8994b5cf9 P 937efeddef934b2b8bc8632594903085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:27:08.175151  1218 raft_consensus.cc:3060] T 1b6df135b8494d0d916747b8994b5cf9 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:08.180078  2022 raft_consensus.cc:993] T e12f4bd1b2ed49988317684782c8616b P 937efeddef934b2b8bc8632594903085: : Instructing follower aa098a557d34433896712068efd0d9a8 to start an election
I20260709 12:27:08.180966  2022 raft_consensus.cc:1081] T e12f4bd1b2ed49988317684782c8616b P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Signalling peer aa098a557d34433896712068efd0d9a8 to start an election
I20260709 12:27:08.182214  1141 raft_consensus.cc:2468] T 1b6df135b8494d0d916747b8994b5cf9 P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f9cbe40e40d429aa004e4a7fb42f132 in term 2.
I20260709 12:27:08.182951  1852 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e12f4bd1b2ed49988317684782c8616b"
dest_uuid: "aa098a557d34433896712068efd0d9a8"
 from {username='slave'} at 127.0.0.1:57606
I20260709 12:27:08.183581  1852 raft_consensus.cc:493] T e12f4bd1b2ed49988317684782c8616b P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:08.183483  1038 leader_election.cc:304] T 1b6df135b8494d0d916747b8994b5cf9 P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 8fa35514a8d84740b1b46ae496307f20; no voters: 
I20260709 12:27:08.184052  1852 raft_consensus.cc:3060] T e12f4bd1b2ed49988317684782c8616b P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:08.184830  2068 raft_consensus.cc:2804] T 1b6df135b8494d0d916747b8994b5cf9 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:08.185513  2068 raft_consensus.cc:697] T 1b6df135b8494d0d916747b8994b5cf9 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 LEADER]: Becoming Leader. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Running, Role: LEADER
I20260709 12:27:08.186728  2068 consensus_queue.cc:237] T 1b6df135b8494d0d916747b8994b5cf9 P 7f9cbe40e40d429aa004e4a7fb42f132 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:27:08.189852  1218 raft_consensus.cc:2468] T 1b6df135b8494d0d916747b8994b5cf9 P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f9cbe40e40d429aa004e4a7fb42f132 in term 2.
I20260709 12:27:08.194628  1852 raft_consensus.cc:515] T e12f4bd1b2ed49988317684782c8616b P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:27:08.197495  1852 leader_election.cc:290] T e12f4bd1b2ed49988317684782c8616b P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 election: Requested vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:27:08.198168  1218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e12f4bd1b2ed49988317684782c8616b" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "937efeddef934b2b8bc8632594903085"
I20260709 12:27:08.198453  1068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e12f4bd1b2ed49988317684782c8616b" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
I20260709 12:27:08.199025  1218 raft_consensus.cc:3055] T e12f4bd1b2ed49988317684782c8616b P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:08.199148  1068 raft_consensus.cc:3060] T e12f4bd1b2ed49988317684782c8616b P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:08.199360  1218 raft_consensus.cc:740] T e12f4bd1b2ed49988317684782c8616b P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 937efeddef934b2b8bc8632594903085, State: Running, Role: LEADER
I20260709 12:27:08.200992  1218 consensus_queue.cc:260] T e12f4bd1b2ed49988317684782c8616b P 937efeddef934b2b8bc8632594903085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:27:08.202373  1218 raft_consensus.cc:3060] T e12f4bd1b2ed49988317684782c8616b P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:08.201449   894 catalog_manager.cc:5697] T 1b6df135b8494d0d916747b8994b5cf9 P 7f9cbe40e40d429aa004e4a7fb42f132 reported cstate change: term changed from 1 to 2, leader changed from 937efeddef934b2b8bc8632594903085 (127.23.245.132) to 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130). New cstate: current_term: 2 leader_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:08.213510  1218 raft_consensus.cc:2468] T e12f4bd1b2ed49988317684782c8616b P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa098a557d34433896712068efd0d9a8 in term 2.
I20260709 12:27:08.215596  1788 leader_election.cc:304] T e12f4bd1b2ed49988317684782c8616b P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 937efeddef934b2b8bc8632594903085, aa098a557d34433896712068efd0d9a8; no voters: 
I20260709 12:27:08.217305  2023 raft_consensus.cc:2804] T e12f4bd1b2ed49988317684782c8616b P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:08.218225  2023 raft_consensus.cc:697] T e12f4bd1b2ed49988317684782c8616b P aa098a557d34433896712068efd0d9a8 [term 2 LEADER]: Becoming Leader. State: Replica: aa098a557d34433896712068efd0d9a8, State: Running, Role: LEADER
I20260709 12:27:08.218504  1068 raft_consensus.cc:2468] T e12f4bd1b2ed49988317684782c8616b P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa098a557d34433896712068efd0d9a8 in term 2.
I20260709 12:27:08.219633  2023 consensus_queue.cc:237] T e12f4bd1b2ed49988317684782c8616b P aa098a557d34433896712068efd0d9a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:27:08.240202   894 catalog_manager.cc:5697] T e12f4bd1b2ed49988317684782c8616b P aa098a557d34433896712068efd0d9a8 reported cstate change: term changed from 1 to 2, leader changed from 937efeddef934b2b8bc8632594903085 (127.23.245.132) to aa098a557d34433896712068efd0d9a8 (127.23.245.129). New cstate: current_term: 2 leader_uuid: "aa098a557d34433896712068efd0d9a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:08.411752  2002 raft_consensus.cc:993] T dc91bacc3de44d21bc62d8b9a003fdcf P 937efeddef934b2b8bc8632594903085: : Instructing follower 7f9cbe40e40d429aa004e4a7fb42f132 to start an election
I20260709 12:27:08.412453  2002 raft_consensus.cc:1081] T dc91bacc3de44d21bc62d8b9a003fdcf P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Signalling peer 7f9cbe40e40d429aa004e4a7fb42f132 to start an election
I20260709 12:27:08.414258  1068 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc91bacc3de44d21bc62d8b9a003fdcf"
dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
 from {username='slave'} at 127.0.0.1:43454
I20260709 12:27:08.414883  1068 raft_consensus.cc:493] T dc91bacc3de44d21bc62d8b9a003fdcf P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:08.415256  1068 raft_consensus.cc:3060] T dc91bacc3de44d21bc62d8b9a003fdcf P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:08.423533  1068 raft_consensus.cc:515] T dc91bacc3de44d21bc62d8b9a003fdcf P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:27:08.425525  1068 leader_election.cc:290] T dc91bacc3de44d21bc62d8b9a003fdcf P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 2 election: Requested vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:27:08.425792  1141 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc91bacc3de44d21bc62d8b9a003fdcf" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8fa35514a8d84740b1b46ae496307f20"
I20260709 12:27:08.425995  1218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc91bacc3de44d21bc62d8b9a003fdcf" candidate_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "937efeddef934b2b8bc8632594903085"
I20260709 12:27:08.426501  1141 raft_consensus.cc:3060] T dc91bacc3de44d21bc62d8b9a003fdcf P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:08.426613  1218 raft_consensus.cc:3055] T dc91bacc3de44d21bc62d8b9a003fdcf P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:08.427081  1218 raft_consensus.cc:740] T dc91bacc3de44d21bc62d8b9a003fdcf P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 937efeddef934b2b8bc8632594903085, State: Running, Role: LEADER
I20260709 12:27:08.427750  1218 consensus_queue.cc:260] T dc91bacc3de44d21bc62d8b9a003fdcf P 937efeddef934b2b8bc8632594903085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:27:08.428977  1218 raft_consensus.cc:3060] T dc91bacc3de44d21bc62d8b9a003fdcf P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:08.432576  1141 raft_consensus.cc:2468] T dc91bacc3de44d21bc62d8b9a003fdcf P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f9cbe40e40d429aa004e4a7fb42f132 in term 2.
I20260709 12:27:08.433964  1038 leader_election.cc:304] T dc91bacc3de44d21bc62d8b9a003fdcf P 7f9cbe40e40d429aa004e4a7fb42f132 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, 8fa35514a8d84740b1b46ae496307f20; no voters: 
I20260709 12:27:08.436091  2068 raft_consensus.cc:2804] T dc91bacc3de44d21bc62d8b9a003fdcf P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:08.436785  2068 raft_consensus.cc:697] T dc91bacc3de44d21bc62d8b9a003fdcf P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 LEADER]: Becoming Leader. State: Replica: 7f9cbe40e40d429aa004e4a7fb42f132, State: Running, Role: LEADER
I20260709 12:27:08.437873  2068 consensus_queue.cc:237] T dc91bacc3de44d21bc62d8b9a003fdcf P 7f9cbe40e40d429aa004e4a7fb42f132 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } }
I20260709 12:27:08.436144  1218 raft_consensus.cc:2468] T dc91bacc3de44d21bc62d8b9a003fdcf P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f9cbe40e40d429aa004e4a7fb42f132 in term 2.
I20260709 12:27:08.453842   894 catalog_manager.cc:5697] T dc91bacc3de44d21bc62d8b9a003fdcf P 7f9cbe40e40d429aa004e4a7fb42f132 reported cstate change: term changed from 1 to 2, leader changed from 937efeddef934b2b8bc8632594903085 (127.23.245.132) to 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130). New cstate: current_term: 2 leader_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:08.475518  2002 raft_consensus.cc:993] T e2ef4b262fac46fe9f9111b609547aa3 P 937efeddef934b2b8bc8632594903085: : Instructing follower aa098a557d34433896712068efd0d9a8 to start an election
I20260709 12:27:08.476202  2022 raft_consensus.cc:1081] T e2ef4b262fac46fe9f9111b609547aa3 P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Signalling peer aa098a557d34433896712068efd0d9a8 to start an election
I20260709 12:27:08.478667  1853 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e2ef4b262fac46fe9f9111b609547aa3"
dest_uuid: "aa098a557d34433896712068efd0d9a8"
 from {username='slave'} at 127.0.0.1:57606
I20260709 12:27:08.479548  1853 raft_consensus.cc:493] T e2ef4b262fac46fe9f9111b609547aa3 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:08.479882  1853 raft_consensus.cc:3060] T e2ef4b262fac46fe9f9111b609547aa3 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:08.489639  1853 raft_consensus.cc:515] T e2ef4b262fac46fe9f9111b609547aa3 P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:27:08.492914  1068 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ef4b262fac46fe9f9111b609547aa3" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
I20260709 12:27:08.492491  1853 leader_election.cc:290] T e2ef4b262fac46fe9f9111b609547aa3 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 election: Requested vote from peers 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:27:08.493592  1068 raft_consensus.cc:3060] T e2ef4b262fac46fe9f9111b609547aa3 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:08.493502  1218 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e2ef4b262fac46fe9f9111b609547aa3" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "937efeddef934b2b8bc8632594903085"
I20260709 12:27:08.494405  1218 raft_consensus.cc:3055] T e2ef4b262fac46fe9f9111b609547aa3 P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:08.495143  1218 raft_consensus.cc:740] T e2ef4b262fac46fe9f9111b609547aa3 P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 937efeddef934b2b8bc8632594903085, State: Running, Role: LEADER
I20260709 12:27:08.495976  1218 consensus_queue.cc:260] T e2ef4b262fac46fe9f9111b609547aa3 P 937efeddef934b2b8bc8632594903085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:27:08.497547  1218 raft_consensus.cc:3060] T e2ef4b262fac46fe9f9111b609547aa3 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:08.502750  1068 raft_consensus.cc:2468] T e2ef4b262fac46fe9f9111b609547aa3 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa098a557d34433896712068efd0d9a8 in term 2.
I20260709 12:27:08.503961  1789 leader_election.cc:304] T e2ef4b262fac46fe9f9111b609547aa3 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f9cbe40e40d429aa004e4a7fb42f132, aa098a557d34433896712068efd0d9a8; no voters: 
I20260709 12:27:08.504921  2023 raft_consensus.cc:2804] T e2ef4b262fac46fe9f9111b609547aa3 P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:08.505453  2023 raft_consensus.cc:697] T e2ef4b262fac46fe9f9111b609547aa3 P aa098a557d34433896712068efd0d9a8 [term 2 LEADER]: Becoming Leader. State: Replica: aa098a557d34433896712068efd0d9a8, State: Running, Role: LEADER
I20260709 12:27:08.506342  2023 consensus_queue.cc:237] T e2ef4b262fac46fe9f9111b609547aa3 P aa098a557d34433896712068efd0d9a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:27:08.509018  1218 raft_consensus.cc:2468] T e2ef4b262fac46fe9f9111b609547aa3 P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa098a557d34433896712068efd0d9a8 in term 2.
I20260709 12:27:08.521587   895 catalog_manager.cc:5697] T e2ef4b262fac46fe9f9111b609547aa3 P aa098a557d34433896712068efd0d9a8 reported cstate change: term changed from 1 to 2, leader changed from 937efeddef934b2b8bc8632594903085 (127.23.245.132) to aa098a557d34433896712068efd0d9a8 (127.23.245.129). New cstate: current_term: 2 leader_uuid: "aa098a557d34433896712068efd0d9a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:08.610328  2022 raft_consensus.cc:993] T c97b34e374ed4aec812cc43e2a5f07de P 937efeddef934b2b8bc8632594903085: : Instructing follower aa098a557d34433896712068efd0d9a8 to start an election
I20260709 12:27:08.610809  2002 raft_consensus.cc:1081] T c97b34e374ed4aec812cc43e2a5f07de P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Signalling peer aa098a557d34433896712068efd0d9a8 to start an election
I20260709 12:27:08.612949  1853 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c97b34e374ed4aec812cc43e2a5f07de"
dest_uuid: "aa098a557d34433896712068efd0d9a8"
 from {username='slave'} at 127.0.0.1:57606
I20260709 12:27:08.613435  1853 raft_consensus.cc:493] T c97b34e374ed4aec812cc43e2a5f07de P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:08.613734  1853 raft_consensus.cc:3060] T c97b34e374ed4aec812cc43e2a5f07de P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:08.620143  1853 raft_consensus.cc:515] T c97b34e374ed4aec812cc43e2a5f07de P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:27:08.621817  1853 leader_election.cc:290] T c97b34e374ed4aec812cc43e2a5f07de P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 election: Requested vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:27:08.622611  1143 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97b34e374ed4aec812cc43e2a5f07de" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8fa35514a8d84740b1b46ae496307f20"
I20260709 12:27:08.622985  1219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c97b34e374ed4aec812cc43e2a5f07de" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "937efeddef934b2b8bc8632594903085"
I20260709 12:27:08.623376  1143 raft_consensus.cc:3060] T c97b34e374ed4aec812cc43e2a5f07de P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:08.623587  1219 raft_consensus.cc:3055] T c97b34e374ed4aec812cc43e2a5f07de P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:08.623965  1219 raft_consensus.cc:740] T c97b34e374ed4aec812cc43e2a5f07de P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 937efeddef934b2b8bc8632594903085, State: Running, Role: LEADER
I20260709 12:27:08.625219  1219 consensus_queue.cc:260] T c97b34e374ed4aec812cc43e2a5f07de P 937efeddef934b2b8bc8632594903085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:27:08.626353  1219 raft_consensus.cc:3060] T c97b34e374ed4aec812cc43e2a5f07de P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:08.629295  1143 raft_consensus.cc:2468] T c97b34e374ed4aec812cc43e2a5f07de P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa098a557d34433896712068efd0d9a8 in term 2.
I20260709 12:27:08.630395  1791 leader_election.cc:304] T c97b34e374ed4aec812cc43e2a5f07de P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20, aa098a557d34433896712068efd0d9a8; no voters: 
I20260709 12:27:08.631207  2023 raft_consensus.cc:2804] T c97b34e374ed4aec812cc43e2a5f07de P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:08.631693  2023 raft_consensus.cc:697] T c97b34e374ed4aec812cc43e2a5f07de P aa098a557d34433896712068efd0d9a8 [term 2 LEADER]: Becoming Leader. State: Replica: aa098a557d34433896712068efd0d9a8, State: Running, Role: LEADER
I20260709 12:27:08.631989  1219 raft_consensus.cc:2468] T c97b34e374ed4aec812cc43e2a5f07de P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa098a557d34433896712068efd0d9a8 in term 2.
I20260709 12:27:08.632788  2023 consensus_queue.cc:237] T c97b34e374ed4aec812cc43e2a5f07de P aa098a557d34433896712068efd0d9a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:27:08.635895  1219 raft_consensus.cc:1275] T e12f4bd1b2ed49988317684782c8616b P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Refusing update from remote peer aa098a557d34433896712068efd0d9a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:08.637348  2009 consensus_queue.cc:1048] T e12f4bd1b2ed49988317684782c8616b P aa098a557d34433896712068efd0d9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:08.649519   895 catalog_manager.cc:5697] T c97b34e374ed4aec812cc43e2a5f07de P aa098a557d34433896712068efd0d9a8 reported cstate change: term changed from 1 to 2, leader changed from 937efeddef934b2b8bc8632594903085 (127.23.245.132) to aa098a557d34433896712068efd0d9a8 (127.23.245.129). New cstate: current_term: 2 leader_uuid: "aa098a557d34433896712068efd0d9a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:08.651100  1219 raft_consensus.cc:1275] T 1b6df135b8494d0d916747b8994b5cf9 P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Refusing update from remote peer 7f9cbe40e40d429aa004e4a7fb42f132: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:08.653939  2032 consensus_queue.cc:1048] T 1b6df135b8494d0d916747b8994b5cf9 P 7f9cbe40e40d429aa004e4a7fb42f132 [LEADER]: Connected to new peer: Peer: permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:08.682114  1068 raft_consensus.cc:1275] T e12f4bd1b2ed49988317684782c8616b P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Refusing update from remote peer aa098a557d34433896712068efd0d9a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:08.690863  2023 consensus_queue.cc:1048] T e12f4bd1b2ed49988317684782c8616b P aa098a557d34433896712068efd0d9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:08.700328  1143 raft_consensus.cc:1275] T 1b6df135b8494d0d916747b8994b5cf9 P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Refusing update from remote peer 7f9cbe40e40d429aa004e4a7fb42f132: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:08.702271  2068 consensus_queue.cc:1048] T 1b6df135b8494d0d916747b8994b5cf9 P 7f9cbe40e40d429aa004e4a7fb42f132 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:08.898190  1218 raft_consensus.cc:1275] T dc91bacc3de44d21bc62d8b9a003fdcf P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Refusing update from remote peer 7f9cbe40e40d429aa004e4a7fb42f132: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:08.900903  2032 consensus_queue.cc:1048] T dc91bacc3de44d21bc62d8b9a003fdcf P 7f9cbe40e40d429aa004e4a7fb42f132 [LEADER]: Connected to new peer: Peer: permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:08.917886  1143 raft_consensus.cc:1275] T dc91bacc3de44d21bc62d8b9a003fdcf P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Refusing update from remote peer 7f9cbe40e40d429aa004e4a7fb42f132: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:08.922640  2068 consensus_queue.cc:1048] T dc91bacc3de44d21bc62d8b9a003fdcf P 7f9cbe40e40d429aa004e4a7fb42f132 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:08.930821  1068 raft_consensus.cc:1275] T e2ef4b262fac46fe9f9111b609547aa3 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Refusing update from remote peer aa098a557d34433896712068efd0d9a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:08.933518  2041 consensus_queue.cc:1048] T e2ef4b262fac46fe9f9111b609547aa3 P aa098a557d34433896712068efd0d9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:08.963836  1218 raft_consensus.cc:1275] T e2ef4b262fac46fe9f9111b609547aa3 P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Refusing update from remote peer aa098a557d34433896712068efd0d9a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:08.966325  2009 consensus_queue.cc:1048] T e2ef4b262fac46fe9f9111b609547aa3 P aa098a557d34433896712068efd0d9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:09.134289 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:09.136094  1143 raft_consensus.cc:1275] T c97b34e374ed4aec812cc43e2a5f07de P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Refusing update from remote peer aa098a557d34433896712068efd0d9a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:09.138445  2009 consensus_queue.cc:1048] T c97b34e374ed4aec812cc43e2a5f07de P aa098a557d34433896712068efd0d9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:09.163880  1219 raft_consensus.cc:1275] T c97b34e374ed4aec812cc43e2a5f07de P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Refusing update from remote peer aa098a557d34433896712068efd0d9a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:09.167793  2009 consensus_queue.cc:1048] T c97b34e374ed4aec812cc43e2a5f07de P aa098a557d34433896712068efd0d9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:09.213096  1220 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e22afc1ef634aaabf17a4e5a3bf0be3"
dest_uuid: "937efeddef934b2b8bc8632594903085"
mode: GRACEFUL
new_leader_uuid: "aa098a557d34433896712068efd0d9a8"
 from {username='slave'} at 127.0.0.1:34930
I20260709 12:27:09.213699  1220 raft_consensus.cc:606] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Received request to transfer leadership to TS aa098a557d34433896712068efd0d9a8
I20260709 12:27:09.216260  1220 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a1c303d40c6a4cae88aa89d681ae7b76"
dest_uuid: "937efeddef934b2b8bc8632594903085"
mode: GRACEFUL
new_leader_uuid: "aa098a557d34433896712068efd0d9a8"
 from {username='slave'} at 127.0.0.1:34930
I20260709 12:27:09.216945  1220 raft_consensus.cc:606] T a1c303d40c6a4cae88aa89d681ae7b76 P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Received request to transfer leadership to TS aa098a557d34433896712068efd0d9a8
I20260709 12:27:09.219508  1220 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c36d0201599a49169424a6b75f5349f2"
dest_uuid: "937efeddef934b2b8bc8632594903085"
mode: GRACEFUL
new_leader_uuid: "aa098a557d34433896712068efd0d9a8"
 from {username='slave'} at 127.0.0.1:34930
I20260709 12:27:09.220120  1220 raft_consensus.cc:606] T c36d0201599a49169424a6b75f5349f2 P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Received request to transfer leadership to TS aa098a557d34433896712068efd0d9a8
I20260709 12:27:09.222080 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:27:09.223554 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:09.224319 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:09.367496  2022 raft_consensus.cc:993] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 937efeddef934b2b8bc8632594903085: : Instructing follower aa098a557d34433896712068efd0d9a8 to start an election
I20260709 12:27:09.368065  2022 raft_consensus.cc:1081] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Signalling peer aa098a557d34433896712068efd0d9a8 to start an election
I20260709 12:27:09.369556  1852 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3e22afc1ef634aaabf17a4e5a3bf0be3"
dest_uuid: "aa098a557d34433896712068efd0d9a8"
 from {username='slave'} at 127.0.0.1:57606
I20260709 12:27:09.370123  1852 raft_consensus.cc:493] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:09.370369  1852 raft_consensus.cc:3060] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.378300  1852 raft_consensus.cc:515] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:27:09.380759  1146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e22afc1ef634aaabf17a4e5a3bf0be3" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8fa35514a8d84740b1b46ae496307f20"
I20260709 12:27:09.381299  1146 raft_consensus.cc:3060] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.386612  1852 leader_election.cc:290] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 election: Requested vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:27:09.387589  1146 raft_consensus.cc:2468] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa098a557d34433896712068efd0d9a8 in term 2.
I20260709 12:27:09.388345  1219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e22afc1ef634aaabf17a4e5a3bf0be3" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "937efeddef934b2b8bc8632594903085"
I20260709 12:27:09.388995  1791 leader_election.cc:304] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20, aa098a557d34433896712068efd0d9a8; no voters: 
I20260709 12:27:09.389156  1219 raft_consensus.cc:3055] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:09.389565  1219 raft_consensus.cc:740] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 937efeddef934b2b8bc8632594903085, State: Running, Role: LEADER
I20260709 12:27:09.390451  2092 raft_consensus.cc:2804] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:09.390399  1219 consensus_queue.cc:260] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 937efeddef934b2b8bc8632594903085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:27:09.391014  2092 raft_consensus.cc:697] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P aa098a557d34433896712068efd0d9a8 [term 2 LEADER]: Becoming Leader. State: Replica: aa098a557d34433896712068efd0d9a8, State: Running, Role: LEADER
I20260709 12:27:09.392493  1219 raft_consensus.cc:3060] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.392505  2092 consensus_queue.cc:237] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P aa098a557d34433896712068efd0d9a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:27:09.399456  1219 raft_consensus.cc:2468] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa098a557d34433896712068efd0d9a8 in term 2.
I20260709 12:27:09.405289   892 catalog_manager.cc:5697] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P aa098a557d34433896712068efd0d9a8 reported cstate change: term changed from 1 to 2, leader changed from 937efeddef934b2b8bc8632594903085 (127.23.245.132) to aa098a557d34433896712068efd0d9a8 (127.23.245.129). New cstate: current_term: 2 leader_uuid: "aa098a557d34433896712068efd0d9a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:09.458431  2094 raft_consensus.cc:993] T a1c303d40c6a4cae88aa89d681ae7b76 P 937efeddef934b2b8bc8632594903085: : Instructing follower aa098a557d34433896712068efd0d9a8 to start an election
I20260709 12:27:09.459084  2022 raft_consensus.cc:1081] T a1c303d40c6a4cae88aa89d681ae7b76 P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Signalling peer aa098a557d34433896712068efd0d9a8 to start an election
I20260709 12:27:09.460599  1852 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a1c303d40c6a4cae88aa89d681ae7b76"
dest_uuid: "aa098a557d34433896712068efd0d9a8"
 from {username='slave'} at 127.0.0.1:57606
I20260709 12:27:09.461061  1852 raft_consensus.cc:493] T a1c303d40c6a4cae88aa89d681ae7b76 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:09.461356  1852 raft_consensus.cc:3060] T a1c303d40c6a4cae88aa89d681ae7b76 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.467154  1852 raft_consensus.cc:515] T a1c303d40c6a4cae88aa89d681ae7b76 P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:27:09.469010  1852 leader_election.cc:290] T a1c303d40c6a4cae88aa89d681ae7b76 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 election: Requested vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909)
I20260709 12:27:09.469796  1146 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1c303d40c6a4cae88aa89d681ae7b76" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8fa35514a8d84740b1b46ae496307f20"
I20260709 12:27:09.470055  1219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1c303d40c6a4cae88aa89d681ae7b76" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "937efeddef934b2b8bc8632594903085"
I20260709 12:27:09.470500  1146 raft_consensus.cc:3060] T a1c303d40c6a4cae88aa89d681ae7b76 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.470700  1219 raft_consensus.cc:3055] T a1c303d40c6a4cae88aa89d681ae7b76 P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:09.471112  1219 raft_consensus.cc:740] T a1c303d40c6a4cae88aa89d681ae7b76 P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 937efeddef934b2b8bc8632594903085, State: Running, Role: LEADER
I20260709 12:27:09.471836  1219 consensus_queue.cc:260] T a1c303d40c6a4cae88aa89d681ae7b76 P 937efeddef934b2b8bc8632594903085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:27:09.472865  1219 raft_consensus.cc:3060] T a1c303d40c6a4cae88aa89d681ae7b76 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.475507  1146 raft_consensus.cc:2468] T a1c303d40c6a4cae88aa89d681ae7b76 P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa098a557d34433896712068efd0d9a8 in term 2.
I20260709 12:27:09.477030  1791 leader_election.cc:304] T a1c303d40c6a4cae88aa89d681ae7b76 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8fa35514a8d84740b1b46ae496307f20, aa098a557d34433896712068efd0d9a8; no voters: 
I20260709 12:27:09.478070  2092 raft_consensus.cc:2804] T a1c303d40c6a4cae88aa89d681ae7b76 P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:09.479482  1219 raft_consensus.cc:2468] T a1c303d40c6a4cae88aa89d681ae7b76 P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa098a557d34433896712068efd0d9a8 in term 2.
I20260709 12:27:09.479952  2092 raft_consensus.cc:697] T a1c303d40c6a4cae88aa89d681ae7b76 P aa098a557d34433896712068efd0d9a8 [term 2 LEADER]: Becoming Leader. State: Replica: aa098a557d34433896712068efd0d9a8, State: Running, Role: LEADER
I20260709 12:27:09.480933  2092 consensus_queue.cc:237] T a1c303d40c6a4cae88aa89d681ae7b76 P aa098a557d34433896712068efd0d9a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:27:09.492811   892 catalog_manager.cc:5697] T a1c303d40c6a4cae88aa89d681ae7b76 P aa098a557d34433896712068efd0d9a8 reported cstate change: term changed from 1 to 2, leader changed from 937efeddef934b2b8bc8632594903085 (127.23.245.132) to aa098a557d34433896712068efd0d9a8 (127.23.245.129). New cstate: current_term: 2 leader_uuid: "aa098a557d34433896712068efd0d9a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:09.600420  2094 raft_consensus.cc:993] T c36d0201599a49169424a6b75f5349f2 P 937efeddef934b2b8bc8632594903085: : Instructing follower aa098a557d34433896712068efd0d9a8 to start an election
I20260709 12:27:09.600978  2094 raft_consensus.cc:1081] T c36d0201599a49169424a6b75f5349f2 P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Signalling peer aa098a557d34433896712068efd0d9a8 to start an election
I20260709 12:27:09.602829  1844 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c36d0201599a49169424a6b75f5349f2"
dest_uuid: "aa098a557d34433896712068efd0d9a8"
 from {username='slave'} at 127.0.0.1:57606
I20260709 12:27:09.603875  1844 raft_consensus.cc:493] T c36d0201599a49169424a6b75f5349f2 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:09.604485  1844 raft_consensus.cc:3060] T c36d0201599a49169424a6b75f5349f2 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.613756  1844 raft_consensus.cc:515] T c36d0201599a49169424a6b75f5349f2 P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:27:09.616358  1844 leader_election.cc:290] T c36d0201599a49169424a6b75f5349f2 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 election: Requested vote from peers 937efeddef934b2b8bc8632594903085 (127.23.245.132:33909), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:27:09.617645  1067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0201599a49169424a6b75f5349f2" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7f9cbe40e40d429aa004e4a7fb42f132"
I20260709 12:27:09.618826  1067 raft_consensus.cc:3060] T c36d0201599a49169424a6b75f5349f2 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.619107  1219 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c36d0201599a49169424a6b75f5349f2" candidate_uuid: "aa098a557d34433896712068efd0d9a8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "937efeddef934b2b8bc8632594903085"
I20260709 12:27:09.619953  1219 raft_consensus.cc:3055] T c36d0201599a49169424a6b75f5349f2 P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:09.620252  1219 raft_consensus.cc:740] T c36d0201599a49169424a6b75f5349f2 P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 937efeddef934b2b8bc8632594903085, State: Running, Role: LEADER
I20260709 12:27:09.620970  1219 consensus_queue.cc:260] T c36d0201599a49169424a6b75f5349f2 P 937efeddef934b2b8bc8632594903085 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:27:09.622349  1219 raft_consensus.cc:3060] T c36d0201599a49169424a6b75f5349f2 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.629781  1219 raft_consensus.cc:2468] T c36d0201599a49169424a6b75f5349f2 P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa098a557d34433896712068efd0d9a8 in term 2.
I20260709 12:27:09.630962  1788 leader_election.cc:304] T c36d0201599a49169424a6b75f5349f2 P aa098a557d34433896712068efd0d9a8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 937efeddef934b2b8bc8632594903085, aa098a557d34433896712068efd0d9a8; no voters: 
I20260709 12:27:09.632180  2092 raft_consensus.cc:2804] T c36d0201599a49169424a6b75f5349f2 P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:09.632946  2092 raft_consensus.cc:697] T c36d0201599a49169424a6b75f5349f2 P aa098a557d34433896712068efd0d9a8 [term 2 LEADER]: Becoming Leader. State: Replica: aa098a557d34433896712068efd0d9a8, State: Running, Role: LEADER
I20260709 12:27:09.634131  2092 consensus_queue.cc:237] T c36d0201599a49169424a6b75f5349f2 P aa098a557d34433896712068efd0d9a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:27:09.640921  1067 raft_consensus.cc:2468] T c36d0201599a49169424a6b75f5349f2 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa098a557d34433896712068efd0d9a8 in term 2.
I20260709 12:27:09.651701   894 catalog_manager.cc:5697] T c36d0201599a49169424a6b75f5349f2 P aa098a557d34433896712068efd0d9a8 reported cstate change: term changed from 1 to 2, leader changed from 937efeddef934b2b8bc8632594903085 (127.23.245.132) to aa098a557d34433896712068efd0d9a8 (127.23.245.129). New cstate: current_term: 2 leader_uuid: "aa098a557d34433896712068efd0d9a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:09.871672  1146 raft_consensus.cc:1275] T a1c303d40c6a4cae88aa89d681ae7b76 P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Refusing update from remote peer aa098a557d34433896712068efd0d9a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:09.873283  2023 consensus_queue.cc:1048] T a1c303d40c6a4cae88aa89d681ae7b76 P aa098a557d34433896712068efd0d9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:09.888127  1219 raft_consensus.cc:1275] T a1c303d40c6a4cae88aa89d681ae7b76 P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Refusing update from remote peer aa098a557d34433896712068efd0d9a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:09.889575  2092 consensus_queue.cc:1048] T a1c303d40c6a4cae88aa89d681ae7b76 P aa098a557d34433896712068efd0d9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:09.947433  1146 raft_consensus.cc:1275] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Refusing update from remote peer aa098a557d34433896712068efd0d9a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:09.948750  2023 consensus_queue.cc:1048] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P aa098a557d34433896712068efd0d9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:09.959865  1220 raft_consensus.cc:1275] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Refusing update from remote peer aa098a557d34433896712068efd0d9a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:09.961829  2009 consensus_queue.cc:1048] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P aa098a557d34433896712068efd0d9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:10.056927  1220 raft_consensus.cc:1275] T c36d0201599a49169424a6b75f5349f2 P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Refusing update from remote peer aa098a557d34433896712068efd0d9a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:10.058751  2009 consensus_queue.cc:1048] T c36d0201599a49169424a6b75f5349f2 P aa098a557d34433896712068efd0d9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:10.068879  1068 raft_consensus.cc:1275] T c36d0201599a49169424a6b75f5349f2 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Refusing update from remote peer aa098a557d34433896712068efd0d9a8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:10.070415  2092 consensus_queue.cc:1048] T c36d0201599a49169424a6b75f5349f2 P aa098a557d34433896712068efd0d9a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:10.269439 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:10.303781 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:10.304747 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:10.305343 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:10.347235 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:10.394882 24534 tablet_server.cc:179] TabletServer@127.23.245.129:32981 shutting down...
W20260709 12:27:10.407330  1186 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 237 similar messages]
W20260709 12:27:10.411158  1186 consensus_peers.cc:597] T 580f367489064e218eef65b4654744b8 P 937efeddef934b2b8bc8632594903085 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:10.429028  1038 consensus_peers.cc:597] T a943f9cb8fef49e6a38b910ff1bb9076 P 7f9cbe40e40d429aa004e4a7fb42f132 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:10.431286  1038 consensus_peers.cc:597] T e81f2374d9904e93bf2941ff8b241c09 P 7f9cbe40e40d429aa004e4a7fb42f132 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:10.436844  1112 consensus_peers.cc:597] T 333930b9df5744d59ab498b170a35315 P 8fa35514a8d84740b1b46ae496307f20 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:10.456257  1112 consensus_peers.cc:597] T 040ea9f986ee4ed29b941698c802c501 P 8fa35514a8d84740b1b46ae496307f20 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:10.464355 24534 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:27:10.464948  1112 consensus_peers.cc:597] T 0e2eae4c387445f39a059befe390fe45 P 8fa35514a8d84740b1b46ae496307f20 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:10.465550 24534 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:10.466506 24534 raft_consensus.cc:2243] T 580f367489064e218eef65b4654744b8 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:27:10.464999  1186 consensus_peers.cc:597] T 348d7f300dcb474b8b012e01d0af067f P 937efeddef934b2b8bc8632594903085 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:10.467038 24534 raft_consensus.cc:2272] T 580f367489064e218eef65b4654744b8 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.470191 24534 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:10.471060 24534 raft_consensus.cc:2243] T 3a19a87d91404b73bdba7121512bf7aa P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.471484 24534 raft_consensus.cc:2272] T 3a19a87d91404b73bdba7121512bf7aa P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:10.471503  1186 consensus_peers.cc:597] T c5197f4025d94ce096c14c6ca011b47b P 937efeddef934b2b8bc8632594903085 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:10.473848 24534 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:10.474540 24534 raft_consensus.cc:2243] T 2f2713fe1c7148f0b6d9a69c53ec3515 P aa098a557d34433896712068efd0d9a8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:10.475303 24534 raft_consensus.cc:2272] T 2f2713fe1c7148f0b6d9a69c53ec3515 P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.478199 24534 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:10.479059 24534 raft_consensus.cc:2243] T 0017925ea1bb4374b09c9e692a17f87e P aa098a557d34433896712068efd0d9a8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:10.479928 24534 raft_consensus.cc:2272] T 0017925ea1bb4374b09c9e692a17f87e P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.482478 24534 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:10.483188 24534 raft_consensus.cc:2243] T e81f2374d9904e93bf2941ff8b241c09 P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.483799 24534 raft_consensus.cc:2272] T e81f2374d9904e93bf2941ff8b241c09 P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.486881 24534 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:10.487728 24534 raft_consensus.cc:2243] T c97b34e374ed4aec812cc43e2a5f07de P aa098a557d34433896712068efd0d9a8 [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:27:10.488395  1112 consensus_peers.cc:597] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P 8fa35514a8d84740b1b46ae496307f20 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:10.488622 24534 raft_consensus.cc:2272] T c97b34e374ed4aec812cc43e2a5f07de P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:10.490238  1186 consensus_peers.cc:597] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P 937efeddef934b2b8bc8632594903085 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:10.491820 24534 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:10.492581 24534 raft_consensus.cc:2243] T 4d899bdd8a44422ca2a8036f84e9f9f3 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.493062 24534 raft_consensus.cc:2272] T 4d899bdd8a44422ca2a8036f84e9f9f3 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.495811 24534 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:10.496482 24534 raft_consensus.cc:2243] T e5af913e96004f3b8cac5fbe6ac655ac P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.496915 24534 raft_consensus.cc:2272] T e5af913e96004f3b8cac5fbe6ac655ac P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.499102 24534 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:10.499707 24534 raft_consensus.cc:2243] T 98b5b180139845c99c537cd675a60830 P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.500140 24534 raft_consensus.cc:2272] T 98b5b180139845c99c537cd675a60830 P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.502079 24534 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:10.502638 24534 raft_consensus.cc:2243] T 284ea666431c4339998eb885cd31facb P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.503017 24534 raft_consensus.cc:2272] T 284ea666431c4339998eb885cd31facb P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.505050 24534 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:10.505641 24534 raft_consensus.cc:2243] T e2ef4b262fac46fe9f9111b609547aa3 P aa098a557d34433896712068efd0d9a8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:10.506403 24534 raft_consensus.cc:2272] T e2ef4b262fac46fe9f9111b609547aa3 P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.509203 24534 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:10.510013 24534 raft_consensus.cc:2243] T 348d7f300dcb474b8b012e01d0af067f P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.510658 24534 raft_consensus.cc:2272] T 348d7f300dcb474b8b012e01d0af067f P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.514889 24534 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:10.516007 24534 raft_consensus.cc:2243] T 333930b9df5744d59ab498b170a35315 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.516603 24534 raft_consensus.cc:2272] T 333930b9df5744d59ab498b170a35315 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.520649 24534 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:10.521529 24534 raft_consensus.cc:2243] T 343e626d0073462fa2020fcf2e2f8ffb P aa098a557d34433896712068efd0d9a8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:10.522652 24534 raft_consensus.cc:2272] T 343e626d0073462fa2020fcf2e2f8ffb P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.525332 24534 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:10.525965 24534 raft_consensus.cc:2243] T c495ce9da627479e92d7b24b3be3641a P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.526427 24534 raft_consensus.cc:2272] T c495ce9da627479e92d7b24b3be3641a P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.528903 24534 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:10.529667 24534 raft_consensus.cc:2243] T b364263cacab4add984e2b6c912fb62e P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.530190 24534 raft_consensus.cc:2272] T b364263cacab4add984e2b6c912fb62e P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.533129 24534 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:10.533892 24534 raft_consensus.cc:2243] T c5197f4025d94ce096c14c6ca011b47b P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.534403 24534 raft_consensus.cc:2272] T c5197f4025d94ce096c14c6ca011b47b P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:10.534961  1112 consensus_peers.cc:597] T 1d925407b8314f5b95a8c940f195433a P 8fa35514a8d84740b1b46ae496307f20 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:10.537242 24534 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:10.538342 24534 raft_consensus.cc:2243] T 95743acb416b403b9bfb59afe5bf2fe7 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.538921 24534 raft_consensus.cc:2272] T 95743acb416b403b9bfb59afe5bf2fe7 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.541402 24534 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:10.542012 24534 raft_consensus.cc:2243] T a943f9cb8fef49e6a38b910ff1bb9076 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.542429 24534 raft_consensus.cc:2272] T a943f9cb8fef49e6a38b910ff1bb9076 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.544533 24534 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:10.545150 24534 raft_consensus.cc:2243] T a93df19c4206495e971bc5e95a2111bc P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.545684 24534 raft_consensus.cc:2272] T a93df19c4206495e971bc5e95a2111bc P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.548493 24534 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:10.549265 24534 raft_consensus.cc:2243] T e281f15348944cc1ab51fce7c1653aac P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.549757 24534 raft_consensus.cc:2272] T e281f15348944cc1ab51fce7c1653aac P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.552742 24534 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:10.553684 24534 raft_consensus.cc:2243] T 040ea9f986ee4ed29b941698c802c501 P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.554126 24534 raft_consensus.cc:2272] T 040ea9f986ee4ed29b941698c802c501 P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.556144 24534 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:10.556732 24534 raft_consensus.cc:2243] T a1c303d40c6a4cae88aa89d681ae7b76 P aa098a557d34433896712068efd0d9a8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:10.557495 24534 raft_consensus.cc:2272] T a1c303d40c6a4cae88aa89d681ae7b76 P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.559852 24534 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:10.560462 24534 raft_consensus.cc:2243] T c36d0201599a49169424a6b75f5349f2 P aa098a557d34433896712068efd0d9a8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:10.561201 24534 raft_consensus.cc:2272] T c36d0201599a49169424a6b75f5349f2 P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.563663 24534 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:10.564294 24534 raft_consensus.cc:2243] T e12f4bd1b2ed49988317684782c8616b P aa098a557d34433896712068efd0d9a8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:10.564988 24534 raft_consensus.cc:2272] T e12f4bd1b2ed49988317684782c8616b P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.567168 24534 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:10.567672 24534 raft_consensus.cc:2243] T 5302c354091f4926812eb90f518b9d6a P aa098a557d34433896712068efd0d9a8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:10.568423 24534 raft_consensus.cc:2272] T 5302c354091f4926812eb90f518b9d6a P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.570386 24534 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:10.570883 24534 raft_consensus.cc:2243] T 5b3d71845177478a9e2510c82e0cf9d1 P aa098a557d34433896712068efd0d9a8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:10.571684 24534 raft_consensus.cc:2272] T 5b3d71845177478a9e2510c82e0cf9d1 P aa098a557d34433896712068efd0d9a8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.574091 24534 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:10.574765 24534 raft_consensus.cc:2243] T c9d72f2a6ae046cb9d4e6277d13e34e6 P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:27:10.575125  1112 consensus_peers.cc:597] T ec806598903e4f88a40176e07ca4fad0 P 8fa35514a8d84740b1b46ae496307f20 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:10.575253 24534 raft_consensus.cc:2272] T c9d72f2a6ae046cb9d4e6277d13e34e6 P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.577487 24534 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:10.578028 24534 raft_consensus.cc:2243] T 329e639d23154fb6bd4ccdf095dbd0e0 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.578395 24534 raft_consensus.cc:2272] T 329e639d23154fb6bd4ccdf095dbd0e0 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.580587 24534 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:10.581190 24534 raft_consensus.cc:2243] T 74e3cbe3521a46cfb42a6cb7ba98430c P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.581558 24534 raft_consensus.cc:2272] T 74e3cbe3521a46cfb42a6cb7ba98430c P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.583352 24534 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:10.584185 24534 raft_consensus.cc:2243] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.584841 24534 raft_consensus.cc:2272] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.587626 24534 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:10.588338 24534 raft_consensus.cc:2243] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.588732 24534 raft_consensus.cc:2272] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.590842 24534 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:10.591437 24534 raft_consensus.cc:2243] T 3d2ccd742ac442419de89cb38ee12d37 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.591902 24534 raft_consensus.cc:2272] T 3d2ccd742ac442419de89cb38ee12d37 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.594159 24534 tablet_replica.cc:333] stopping tablet replica
W20260709 12:27:10.594352  1112 consensus_peers.cc:597] T 70720af8528947a89c03ec468c1235eb P 8fa35514a8d84740b1b46ae496307f20 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:10.594746 24534 raft_consensus.cc:2243] T 0c434afb0b164ab5b38dea54bfcebfe8 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.595230 24534 raft_consensus.cc:2272] T 0c434afb0b164ab5b38dea54bfcebfe8 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.597323 24534 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:10.597872 24534 raft_consensus.cc:2243] T ec47b02d68674e2386a86244d9026b78 P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.598301 24534 raft_consensus.cc:2272] T ec47b02d68674e2386a86244d9026b78 P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.600538 24534 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:10.601195 24534 raft_consensus.cc:2243] T ec806598903e4f88a40176e07ca4fad0 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.601708 24534 raft_consensus.cc:2272] T ec806598903e4f88a40176e07ca4fad0 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.603660 24534 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:10.604380 24534 raft_consensus.cc:2243] T de3dd28c345442b38f399c5db383c5b2 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.604808 24534 raft_consensus.cc:2272] T de3dd28c345442b38f399c5db383c5b2 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.607337 24534 tablet_replica.cc:333] stopping tablet replica
W20260709 12:27:10.607980  1186 consensus_peers.cc:597] T de3dd28c345442b38f399c5db383c5b2 P 937efeddef934b2b8bc8632594903085 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:10.607982 24534 raft_consensus.cc:2243] T 0e2eae4c387445f39a059befe390fe45 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.608801 24534 raft_consensus.cc:2272] T 0e2eae4c387445f39a059befe390fe45 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.610780 24534 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:10.611328 24534 raft_consensus.cc:2243] T 70720af8528947a89c03ec468c1235eb P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.611756 24534 raft_consensus.cc:2272] T 70720af8528947a89c03ec468c1235eb P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.613962 24534 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:10.614602 24534 raft_consensus.cc:2243] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P aa098a557d34433896712068efd0d9a8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:10.615607 24534 raft_consensus.cc:2272] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.618175 24534 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:10.618793 24534 raft_consensus.cc:2243] T c4234c6cf75048c5a6cdf34e43c9bd1e P aa098a557d34433896712068efd0d9a8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:10.619601 24534 raft_consensus.cc:2272] T c4234c6cf75048c5a6cdf34e43c9bd1e P aa098a557d34433896712068efd0d9a8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.621697 24534 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:10.622474 24534 raft_consensus.cc:2243] T 1d925407b8314f5b95a8c940f195433a P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.622970 24534 raft_consensus.cc:2272] T 1d925407b8314f5b95a8c940f195433a P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.626116 24534 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:10.626746 24534 raft_consensus.cc:2243] T 6715731f9a31415a98fa8a0ab9944eec P aa098a557d34433896712068efd0d9a8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:10.627705 24534 raft_consensus.cc:2272] T 6715731f9a31415a98fa8a0ab9944eec P aa098a557d34433896712068efd0d9a8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.630522 24534 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:10.631352 24534 raft_consensus.cc:2243] T ac8f3ce8c750468c966a23ea2787b888 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.631832 24534 raft_consensus.cc:2272] T ac8f3ce8c750468c966a23ea2787b888 P aa098a557d34433896712068efd0d9a8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.635126 24534 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:10.635702 24534 raft_consensus.cc:2243] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P aa098a557d34433896712068efd0d9a8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:10.636626 24534 raft_consensus.cc:2272] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P aa098a557d34433896712068efd0d9a8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:10.686709  1038 consensus_peers.cc:597] T e5af913e96004f3b8cac5fbe6ac655ac P 7f9cbe40e40d429aa004e4a7fb42f132 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:10.690713  1112 consensus_peers.cc:597] T b364263cacab4add984e2b6c912fb62e P 8fa35514a8d84740b1b46ae496307f20 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:10.709957  1186 consensus_peers.cc:597] T 4d899bdd8a44422ca2a8036f84e9f9f3 P 937efeddef934b2b8bc8632594903085 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:10.714635 24534 tablet_server.cc:196] TabletServer@127.23.245.129:32981 shutdown complete.
W20260709 12:27:10.715620  1038 consensus_peers.cc:597] T 98b5b180139845c99c537cd675a60830 P 7f9cbe40e40d429aa004e4a7fb42f132 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:10.720283  1112 consensus_peers.cc:597] T 3d2ccd742ac442419de89cb38ee12d37 P 8fa35514a8d84740b1b46ae496307f20 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:10.734419  1038 consensus_peers.cc:597] T 74e3cbe3521a46cfb42a6cb7ba98430c P 7f9cbe40e40d429aa004e4a7fb42f132 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:10.746762  1112 consensus_peers.cc:597] T 95743acb416b403b9bfb59afe5bf2fe7 P 8fa35514a8d84740b1b46ae496307f20 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:10.747951  1112 consensus_peers.cc:597] T e281f15348944cc1ab51fce7c1653aac P 8fa35514a8d84740b1b46ae496307f20 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:10.753618  1112 consensus_peers.cc:597] T 0c434afb0b164ab5b38dea54bfcebfe8 P 8fa35514a8d84740b1b46ae496307f20 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:10.807053  1038 consensus_peers.cc:597] T 3a19a87d91404b73bdba7121512bf7aa P 7f9cbe40e40d429aa004e4a7fb42f132 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:10.814890 24534 tablet_server.cc:179] TabletServer@127.23.245.130:0 shutting down...
W20260709 12:27:10.819271  1186 consensus_peers.cc:597] T ac8f3ce8c750468c966a23ea2787b888 P 937efeddef934b2b8bc8632594903085 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:10.823061  1184 consensus_peers.cc:597] T a93df19c4206495e971bc5e95a2111bc P 937efeddef934b2b8bc8632594903085 -> Peer 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679): Couldn't send request to peer 7f9cbe40e40d429aa004e4a7fb42f132. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:10.845248  1112 consensus_peers.cc:597] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 8fa35514a8d84740b1b46ae496307f20 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:10.850430  1110 consensus_peers.cc:597] T 3d2ccd742ac442419de89cb38ee12d37 P 8fa35514a8d84740b1b46ae496307f20 -> Peer 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679): Couldn't send request to peer 7f9cbe40e40d429aa004e4a7fb42f132. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:10.851863  1186 consensus_peers.cc:597] T ec47b02d68674e2386a86244d9026b78 P 937efeddef934b2b8bc8632594903085 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:10.858748 24534 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:10.859776 24534 tablet_replica.cc:333] T 0e2eae4c387445f39a059befe390fe45 P 7f9cbe40e40d429aa004e4a7fb42f132: stopping tablet replica
I20260709 12:27:10.860702 24534 raft_consensus.cc:2243] T 0e2eae4c387445f39a059befe390fe45 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.861281 24534 raft_consensus.cc:2272] T 0e2eae4c387445f39a059befe390fe45 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.863857 24534 tablet_replica.cc:333] T 3d2ccd742ac442419de89cb38ee12d37 P 7f9cbe40e40d429aa004e4a7fb42f132: stopping tablet replica
I20260709 12:27:10.864751 24534 raft_consensus.cc:2243] T 3d2ccd742ac442419de89cb38ee12d37 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.865275 24534 raft_consensus.cc:2272] T 3d2ccd742ac442419de89cb38ee12d37 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:10.868532  1038 consensus_peers.cc:597] T 329e639d23154fb6bd4ccdf095dbd0e0 P 7f9cbe40e40d429aa004e4a7fb42f132 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:10.868660 24534 tablet_replica.cc:333] T 6474754cce8f4042bcab4ac631e9a82f P 7f9cbe40e40d429aa004e4a7fb42f132: stopping tablet replica
I20260709 12:27:10.869707 24534 raft_consensus.cc:2243] T 6474754cce8f4042bcab4ac631e9a82f P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.870285 24534 raft_consensus.cc:2272] T 6474754cce8f4042bcab4ac631e9a82f P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:10.871879  1038 consensus_peers.cc:597] T 284ea666431c4339998eb885cd31facb P 7f9cbe40e40d429aa004e4a7fb42f132 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:10.872895 24534 tablet_replica.cc:333] T 0017925ea1bb4374b09c9e692a17f87e P 7f9cbe40e40d429aa004e4a7fb42f132: stopping tablet replica
I20260709 12:27:10.873597 24534 raft_consensus.cc:2243] T 0017925ea1bb4374b09c9e692a17f87e P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.874022 24534 raft_consensus.cc:2272] T 0017925ea1bb4374b09c9e692a17f87e P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.875813 24534 tablet_replica.cc:333] T 7b2e497f1fcf4e40b4374fd2b5b261af P 7f9cbe40e40d429aa004e4a7fb42f132: stopping tablet replica
I20260709 12:27:10.876595 24534 raft_consensus.cc:2243] T 7b2e497f1fcf4e40b4374fd2b5b261af P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.877022 24534 raft_consensus.cc:2272] T 7b2e497f1fcf4e40b4374fd2b5b261af P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.879179 24534 tablet_replica.cc:333] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 7f9cbe40e40d429aa004e4a7fb42f132: stopping tablet replica
I20260709 12:27:10.879977 24534 raft_consensus.cc:2243] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:10.880748 24534 raft_consensus.cc:2272] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.883304 24534 tablet_replica.cc:333] T dc91bacc3de44d21bc62d8b9a003fdcf P 7f9cbe40e40d429aa004e4a7fb42f132: stopping tablet replica
I20260709 12:27:10.883955 24534 raft_consensus.cc:2243] T dc91bacc3de44d21bc62d8b9a003fdcf P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:10.884917 24534 raft_consensus.cc:2272] T dc91bacc3de44d21bc62d8b9a003fdcf P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.887362 24534 tablet_replica.cc:333] T a943f9cb8fef49e6a38b910ff1bb9076 P 7f9cbe40e40d429aa004e4a7fb42f132: stopping tablet replica
I20260709 12:27:10.888244 24534 raft_consensus.cc:2243] T a943f9cb8fef49e6a38b910ff1bb9076 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:27:10.888890  1184 consensus_peers.cc:597] T ec47b02d68674e2386a86244d9026b78 P 937efeddef934b2b8bc8632594903085 -> Peer 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679): Couldn't send request to peer 7f9cbe40e40d429aa004e4a7fb42f132. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:10.889158 24534 raft_consensus.cc:2272] T a943f9cb8fef49e6a38b910ff1bb9076 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.892256 24534 tablet_replica.cc:333] T a93df19c4206495e971bc5e95a2111bc P 7f9cbe40e40d429aa004e4a7fb42f132: stopping tablet replica
I20260709 12:27:10.892962 24534 raft_consensus.cc:2243] T a93df19c4206495e971bc5e95a2111bc P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.893518 24534 raft_consensus.cc:2272] T a93df19c4206495e971bc5e95a2111bc P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:10.894098  1110 consensus_peers.cc:597] T f84cb753a9bd4fdd91824bb2d5050621 P 8fa35514a8d84740b1b46ae496307f20 -> Peer 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679): Couldn't send request to peer 7f9cbe40e40d429aa004e4a7fb42f132. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:10.896474 24534 tablet_replica.cc:333] T 74e3cbe3521a46cfb42a6cb7ba98430c P 7f9cbe40e40d429aa004e4a7fb42f132: stopping tablet replica
I20260709 12:27:10.897440 24534 raft_consensus.cc:2243] T 74e3cbe3521a46cfb42a6cb7ba98430c P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:10.898473 24534 raft_consensus.cc:2272] T 74e3cbe3521a46cfb42a6cb7ba98430c P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:10.899466  1184 consensus_peers.cc:597] T c5197f4025d94ce096c14c6ca011b47b P 937efeddef934b2b8bc8632594903085 -> Peer 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679): Couldn't send request to peer 7f9cbe40e40d429aa004e4a7fb42f132. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:10.902519 24534 tablet_replica.cc:333] T e6de424e08ed4b1d8f6d32d17a44025d P 7f9cbe40e40d429aa004e4a7fb42f132: stopping tablet replica
I20260709 12:27:10.903378 24534 raft_consensus.cc:2243] T e6de424e08ed4b1d8f6d32d17a44025d P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:27:10.904410  1110 consensus_peers.cc:597] T b364263cacab4add984e2b6c912fb62e P 8fa35514a8d84740b1b46ae496307f20 -> Peer 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679): Couldn't send request to peer 7f9cbe40e40d429aa004e4a7fb42f132. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:10.904378 24534 raft_consensus.cc:2272] T e6de424e08ed4b1d8f6d32d17a44025d P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.907598 24534 tablet_replica.cc:333] T c77af7e1c2044a8eacfe0e76ee974591 P 7f9cbe40e40d429aa004e4a7fb42f132: stopping tablet replica
I20260709 12:27:10.908547 24534 raft_consensus.cc:2243] T c77af7e1c2044a8eacfe0e76ee974591 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.909103 24534 raft_consensus.cc:2272] T c77af7e1c2044a8eacfe0e76ee974591 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.911985 24534 tablet_replica.cc:333] T 333930b9df5744d59ab498b170a35315 P 7f9cbe40e40d429aa004e4a7fb42f132: stopping tablet replica
I20260709 12:27:10.912797 24534 raft_consensus.cc:2243] T 333930b9df5744d59ab498b170a35315 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.913376 24534 raft_consensus.cc:2272] T 333930b9df5744d59ab498b170a35315 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.916111 24534 tablet_replica.cc:333] T c495ce9da627479e92d7b24b3be3641a P 7f9cbe40e40d429aa004e4a7fb42f132: stopping tablet replica
W20260709 12:27:10.916158  1110 consensus_peers.cc:597] T 7b2e497f1fcf4e40b4374fd2b5b261af P 8fa35514a8d84740b1b46ae496307f20 -> Peer 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679): Couldn't send request to peer 7f9cbe40e40d429aa004e4a7fb42f132. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:10.916985 24534 raft_consensus.cc:2243] T c495ce9da627479e92d7b24b3be3641a P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.918918 24534 raft_consensus.cc:2272] T c495ce9da627479e92d7b24b3be3641a P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.922044 24534 tablet_replica.cc:333] T ec806598903e4f88a40176e07ca4fad0 P 7f9cbe40e40d429aa004e4a7fb42f132: stopping tablet replica
I20260709 12:27:10.922868 24534 raft_consensus.cc:2243] T ec806598903e4f88a40176e07ca4fad0 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.923604 24534 raft_consensus.cc:2272] T ec806598903e4f88a40176e07ca4fad0 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.926550 24534 tablet_replica.cc:333] T edea2a0a3c264f2b810295aea0acfb73 P 7f9cbe40e40d429aa004e4a7fb42f132: stopping tablet replica
I20260709 12:27:10.927274 24534 raft_consensus.cc:2243] T edea2a0a3c264f2b810295aea0acfb73 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.927753 24534 raft_consensus.cc:2272] T edea2a0a3c264f2b810295aea0acfb73 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.930426 24534 tablet_replica.cc:333] T c9793ebdadaa4da18e4e2c2fe6dae825 P 7f9cbe40e40d429aa004e4a7fb42f132: stopping tablet replica
I20260709 12:27:10.931353 24534 raft_consensus.cc:2243] T c9793ebdadaa4da18e4e2c2fe6dae825 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:10.932821 24534 raft_consensus.cc:2272] T c9793ebdadaa4da18e4e2c2fe6dae825 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.936384 24534 tablet_replica.cc:333] T ec47b02d68674e2386a86244d9026b78 P 7f9cbe40e40d429aa004e4a7fb42f132: stopping tablet replica
I20260709 12:27:10.937220 24534 raft_consensus.cc:2243] T ec47b02d68674e2386a86244d9026b78 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.937876 24534 raft_consensus.cc:2272] T ec47b02d68674e2386a86244d9026b78 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.940672 24534 tablet_replica.cc:333] T c5197f4025d94ce096c14c6ca011b47b P 7f9cbe40e40d429aa004e4a7fb42f132: stopping tablet replica
I20260709 12:27:10.941535 24534 raft_consensus.cc:2243] T c5197f4025d94ce096c14c6ca011b47b P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.942114 24534 raft_consensus.cc:2272] T c5197f4025d94ce096c14c6ca011b47b P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:10.943722  1184 consensus_peers.cc:597] T 8c9afd5af68441ffa4c3f90cbd33d977 P 937efeddef934b2b8bc8632594903085 -> Peer 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679): Couldn't send request to peer 7f9cbe40e40d429aa004e4a7fb42f132. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:10.944639 24534 tablet_replica.cc:333] T 95743acb416b403b9bfb59afe5bf2fe7 P 7f9cbe40e40d429aa004e4a7fb42f132: stopping tablet replica
I20260709 12:27:10.945569 24534 raft_consensus.cc:2243] T 95743acb416b403b9bfb59afe5bf2fe7 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.946106 24534 raft_consensus.cc:2272] T 95743acb416b403b9bfb59afe5bf2fe7 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:10.948215  1186 consensus_peers.cc:597] T a93df19c4206495e971bc5e95a2111bc P 937efeddef934b2b8bc8632594903085 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:10.948807 24534 tablet_replica.cc:333] T b364263cacab4add984e2b6c912fb62e P 7f9cbe40e40d429aa004e4a7fb42f132: stopping tablet replica
I20260709 12:27:10.949662 24534 raft_consensus.cc:2243] T b364263cacab4add984e2b6c912fb62e P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.950158 24534 raft_consensus.cc:2272] T b364263cacab4add984e2b6c912fb62e P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.953517 24534 tablet_replica.cc:333] T c36d0201599a49169424a6b75f5349f2 P 7f9cbe40e40d429aa004e4a7fb42f132: stopping tablet replica
I20260709 12:27:10.954082 24534 raft_consensus.cc:2243] T c36d0201599a49169424a6b75f5349f2 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.954475 24534 raft_consensus.cc:2272] T c36d0201599a49169424a6b75f5349f2 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:10.957357  1186 consensus_peers.cc:597] T c495ce9da627479e92d7b24b3be3641a P 937efeddef934b2b8bc8632594903085 -> Peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Couldn't send request to peer aa098a557d34433896712068efd0d9a8. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:10.958387 24534 tablet_replica.cc:333] T acc6ab0dce1640e380b433b32a874108 P 7f9cbe40e40d429aa004e4a7fb42f132: stopping tablet replica
I20260709 12:27:10.959156 24534 raft_consensus.cc:2243] T acc6ab0dce1640e380b433b32a874108 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:10.960040 24534 raft_consensus.cc:2272] T acc6ab0dce1640e380b433b32a874108 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.962946 24534 tablet_replica.cc:333] T e5af913e96004f3b8cac5fbe6ac655ac P 7f9cbe40e40d429aa004e4a7fb42f132: stopping tablet replica
I20260709 12:27:10.963738 24534 raft_consensus.cc:2243] T e5af913e96004f3b8cac5fbe6ac655ac P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:10.964551 24534 raft_consensus.cc:2272] T e5af913e96004f3b8cac5fbe6ac655ac P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.966682 24534 tablet_replica.cc:333] T 98b5b180139845c99c537cd675a60830 P 7f9cbe40e40d429aa004e4a7fb42f132: stopping tablet replica
I20260709 12:27:10.967275 24534 raft_consensus.cc:2243] T 98b5b180139845c99c537cd675a60830 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:10.968137 24534 raft_consensus.cc:2272] T 98b5b180139845c99c537cd675a60830 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.970223 24534 tablet_replica.cc:333] T ac8f3ce8c750468c966a23ea2787b888 P 7f9cbe40e40d429aa004e4a7fb42f132: stopping tablet replica
I20260709 12:27:10.970809 24534 raft_consensus.cc:2243] T ac8f3ce8c750468c966a23ea2787b888 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.971382 24534 raft_consensus.cc:2272] T ac8f3ce8c750468c966a23ea2787b888 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.975828 24534 tablet_replica.cc:333] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P 7f9cbe40e40d429aa004e4a7fb42f132: stopping tablet replica
I20260709 12:27:10.976714 24534 raft_consensus.cc:2243] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.977402 24534 raft_consensus.cc:2272] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:10.979270  1184 consensus_peers.cc:597] T edea2a0a3c264f2b810295aea0acfb73 P 937efeddef934b2b8bc8632594903085 -> Peer 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679): Couldn't send request to peer 7f9cbe40e40d429aa004e4a7fb42f132. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:10.980670 24534 tablet_replica.cc:333] T 5b3d71845177478a9e2510c82e0cf9d1 P 7f9cbe40e40d429aa004e4a7fb42f132: stopping tablet replica
I20260709 12:27:10.981570 24534 raft_consensus.cc:2243] T 5b3d71845177478a9e2510c82e0cf9d1 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.982136 24534 raft_consensus.cc:2272] T 5b3d71845177478a9e2510c82e0cf9d1 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.984884 24534 tablet_replica.cc:333] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P 7f9cbe40e40d429aa004e4a7fb42f132: stopping tablet replica
I20260709 12:27:10.985634 24534 raft_consensus.cc:2243] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.986150 24534 raft_consensus.cc:2272] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.988543 24534 tablet_replica.cc:333] T 1b6df135b8494d0d916747b8994b5cf9 P 7f9cbe40e40d429aa004e4a7fb42f132: stopping tablet replica
I20260709 12:27:10.989379 24534 raft_consensus.cc:2243] T 1b6df135b8494d0d916747b8994b5cf9 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:10.990203 24534 raft_consensus.cc:2272] T 1b6df135b8494d0d916747b8994b5cf9 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.992619 24534 tablet_replica.cc:333] T e81f2374d9904e93bf2941ff8b241c09 P 7f9cbe40e40d429aa004e4a7fb42f132: stopping tablet replica
I20260709 12:27:10.993340 24534 raft_consensus.cc:2243] T e81f2374d9904e93bf2941ff8b241c09 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:10.994341 24534 raft_consensus.cc:2272] T e81f2374d9904e93bf2941ff8b241c09 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:10.997133 24534 tablet_replica.cc:333] T 8c9afd5af68441ffa4c3f90cbd33d977 P 7f9cbe40e40d429aa004e4a7fb42f132: stopping tablet replica
I20260709 12:27:10.997712 24534 raft_consensus.cc:2243] T 8c9afd5af68441ffa4c3f90cbd33d977 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:10.998155 24534 raft_consensus.cc:2272] T 8c9afd5af68441ffa4c3f90cbd33d977 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.000419 24534 tablet_replica.cc:333] T b8e49440650449f49e5303568f2f19c0 P 7f9cbe40e40d429aa004e4a7fb42f132: stopping tablet replica
I20260709 12:27:11.000947 24534 raft_consensus.cc:2243] T b8e49440650449f49e5303568f2f19c0 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.001358 24534 raft_consensus.cc:2272] T b8e49440650449f49e5303568f2f19c0 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.003341 24534 tablet_replica.cc:333] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 7f9cbe40e40d429aa004e4a7fb42f132: stopping tablet replica
I20260709 12:27:11.003988 24534 raft_consensus.cc:2243] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.004468 24534 raft_consensus.cc:2272] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.006897 24534 tablet_replica.cc:333] T 3a19a87d91404b73bdba7121512bf7aa P 7f9cbe40e40d429aa004e4a7fb42f132: stopping tablet replica
I20260709 12:27:11.007490 24534 raft_consensus.cc:2243] T 3a19a87d91404b73bdba7121512bf7aa P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:11.008500 24534 raft_consensus.cc:2272] T 3a19a87d91404b73bdba7121512bf7aa P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:11.009917  1184 consensus_peers.cc:597] T c495ce9da627479e92d7b24b3be3641a P 937efeddef934b2b8bc8632594903085 -> Peer 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679): Couldn't send request to peer 7f9cbe40e40d429aa004e4a7fb42f132. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:11.010803 24534 tablet_replica.cc:333] T 284ea666431c4339998eb885cd31facb P 7f9cbe40e40d429aa004e4a7fb42f132: stopping tablet replica
I20260709 12:27:11.011456 24534 raft_consensus.cc:2243] T 284ea666431c4339998eb885cd31facb P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:11.012290 24534 raft_consensus.cc:2272] T 284ea666431c4339998eb885cd31facb P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.014184 24534 tablet_replica.cc:333] T f84cb753a9bd4fdd91824bb2d5050621 P 7f9cbe40e40d429aa004e4a7fb42f132: stopping tablet replica
I20260709 12:27:11.014737 24534 raft_consensus.cc:2243] T f84cb753a9bd4fdd91824bb2d5050621 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.015136 24534 raft_consensus.cc:2272] T f84cb753a9bd4fdd91824bb2d5050621 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.017129 24534 tablet_replica.cc:333] T 329e639d23154fb6bd4ccdf095dbd0e0 P 7f9cbe40e40d429aa004e4a7fb42f132: stopping tablet replica
I20260709 12:27:11.017657 24534 raft_consensus.cc:2243] T 329e639d23154fb6bd4ccdf095dbd0e0 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:11.018441 24534 raft_consensus.cc:2272] T 329e639d23154fb6bd4ccdf095dbd0e0 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.020584 24534 tablet_replica.cc:333] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 7f9cbe40e40d429aa004e4a7fb42f132: stopping tablet replica
I20260709 12:27:11.021121 24534 raft_consensus.cc:2243] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.021564 24534 raft_consensus.cc:2272] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.023403 24534 tablet_replica.cc:333] T e12f4bd1b2ed49988317684782c8616b P 7f9cbe40e40d429aa004e4a7fb42f132: stopping tablet replica
I20260709 12:27:11.023864 24534 raft_consensus.cc:2243] T e12f4bd1b2ed49988317684782c8616b P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.024350 24534 raft_consensus.cc:2272] T e12f4bd1b2ed49988317684782c8616b P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.026077 24534 tablet_replica.cc:333] T 8c7002e5875a494e8e845023cc05503f P 7f9cbe40e40d429aa004e4a7fb42f132: stopping tablet replica
I20260709 12:27:11.026535 24534 raft_consensus.cc:2243] T 8c7002e5875a494e8e845023cc05503f P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:11.027328 24534 raft_consensus.cc:2272] T 8c7002e5875a494e8e845023cc05503f P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.029271 24534 tablet_replica.cc:333] T 348d7f300dcb474b8b012e01d0af067f P 7f9cbe40e40d429aa004e4a7fb42f132: stopping tablet replica
I20260709 12:27:11.029778 24534 raft_consensus.cc:2243] T 348d7f300dcb474b8b012e01d0af067f P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.030228 24534 raft_consensus.cc:2272] T 348d7f300dcb474b8b012e01d0af067f P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.032459 24534 tablet_replica.cc:333] T e2ef4b262fac46fe9f9111b609547aa3 P 7f9cbe40e40d429aa004e4a7fb42f132: stopping tablet replica
I20260709 12:27:11.033030 24534 raft_consensus.cc:2243] T e2ef4b262fac46fe9f9111b609547aa3 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.033445 24534 raft_consensus.cc:2272] T e2ef4b262fac46fe9f9111b609547aa3 P 7f9cbe40e40d429aa004e4a7fb42f132 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.035251 24534 tablet_replica.cc:333] T e281f15348944cc1ab51fce7c1653aac P 7f9cbe40e40d429aa004e4a7fb42f132: stopping tablet replica
I20260709 12:27:11.035778 24534 raft_consensus.cc:2243] T e281f15348944cc1ab51fce7c1653aac P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.036193 24534 raft_consensus.cc:2272] T e281f15348944cc1ab51fce7c1653aac P 7f9cbe40e40d429aa004e4a7fb42f132 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:11.061658  1184 consensus_peers.cc:597] T c77af7e1c2044a8eacfe0e76ee974591 P 937efeddef934b2b8bc8632594903085 -> Peer 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679): Couldn't send request to peer 7f9cbe40e40d429aa004e4a7fb42f132. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:11.116848 24534 tablet_server.cc:196] TabletServer@127.23.245.130:0 shutdown complete.
W20260709 12:27:11.119432  1110 consensus_peers.cc:597] T ec806598903e4f88a40176e07ca4fad0 P 8fa35514a8d84740b1b46ae496307f20 -> Peer 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679): Couldn't send request to peer 7f9cbe40e40d429aa004e4a7fb42f132. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:43679: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:11.135878  1110 consensus_peers.cc:597] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P 8fa35514a8d84740b1b46ae496307f20 -> Peer 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679): Couldn't send request to peer 7f9cbe40e40d429aa004e4a7fb42f132. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:43679: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:11.159904  1110 consensus_peers.cc:597] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 8fa35514a8d84740b1b46ae496307f20 -> Peer 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679): Couldn't send request to peer 7f9cbe40e40d429aa004e4a7fb42f132. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:43679: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:11.203835  1184 consensus_peers.cc:597] T 348d7f300dcb474b8b012e01d0af067f P 937efeddef934b2b8bc8632594903085 -> Peer 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679): Couldn't send request to peer 7f9cbe40e40d429aa004e4a7fb42f132. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:43679: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:11.212952 24534 tablet_server.cc:179] TabletServer@127.23.245.131:0 shutting down...
W20260709 12:27:11.223318  1186 consensus_peers.cc:597] T c77af7e1c2044a8eacfe0e76ee974591 P 937efeddef934b2b8bc8632594903085 -> Peer 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341): Couldn't send request to peer 8fa35514a8d84740b1b46ae496307f20. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:11.226199  1186 consensus_peers.cc:597] T edea2a0a3c264f2b810295aea0acfb73 P 937efeddef934b2b8bc8632594903085 -> Peer 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341): Couldn't send request to peer 8fa35514a8d84740b1b46ae496307f20. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:11.234731  1184 consensus_peers.cc:597] T 6474754cce8f4042bcab4ac631e9a82f P 937efeddef934b2b8bc8632594903085 -> Peer 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679): Couldn't send request to peer 7f9cbe40e40d429aa004e4a7fb42f132. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:43679: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:11.261773  1110 consensus_peers.cc:597] T 0e2eae4c387445f39a059befe390fe45 P 8fa35514a8d84740b1b46ae496307f20 -> Peer 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679): Couldn't send request to peer 7f9cbe40e40d429aa004e4a7fb42f132. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:43679: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:11.262573  1110 consensus_peers.cc:597] T 333930b9df5744d59ab498b170a35315 P 8fa35514a8d84740b1b46ae496307f20 -> Peer 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679): Couldn't send request to peer 7f9cbe40e40d429aa004e4a7fb42f132. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:43679: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:11.266711  1186 consensus_peers.cc:597] T de3dd28c345442b38f399c5db383c5b2 P 937efeddef934b2b8bc8632594903085 -> Peer 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341): Couldn't send request to peer 8fa35514a8d84740b1b46ae496307f20. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:11.280634  1184 consensus_peers.cc:597] T ac8f3ce8c750468c966a23ea2787b888 P 937efeddef934b2b8bc8632594903085 -> Peer 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679): Couldn't send request to peer 7f9cbe40e40d429aa004e4a7fb42f132. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:43679: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:11.281219  1184 consensus_peers.cc:597] T b8e49440650449f49e5303568f2f19c0 P 937efeddef934b2b8bc8632594903085 -> Peer 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679): Couldn't send request to peer 7f9cbe40e40d429aa004e4a7fb42f132. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:43679: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:11.291090  1110 consensus_peers.cc:597] T 95743acb416b403b9bfb59afe5bf2fe7 P 8fa35514a8d84740b1b46ae496307f20 -> Peer 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679): Couldn't send request to peer 7f9cbe40e40d429aa004e4a7fb42f132. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:43679: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:11.321096 24534 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:11.322248 24534 tablet_replica.cc:333] T 3d2ccd742ac442419de89cb38ee12d37 P 8fa35514a8d84740b1b46ae496307f20: stopping tablet replica
W20260709 12:27:11.322583  1186 consensus_peers.cc:597] T b8e49440650449f49e5303568f2f19c0 P 937efeddef934b2b8bc8632594903085 -> Peer 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341): Couldn't send request to peer 8fa35514a8d84740b1b46ae496307f20. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:11.323164 24534 raft_consensus.cc:2243] T 3d2ccd742ac442419de89cb38ee12d37 P 8fa35514a8d84740b1b46ae496307f20 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:11.324191 24534 raft_consensus.cc:2272] T 3d2ccd742ac442419de89cb38ee12d37 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.326764 24534 tablet_replica.cc:333] T 6474754cce8f4042bcab4ac631e9a82f P 8fa35514a8d84740b1b46ae496307f20: stopping tablet replica
I20260709 12:27:11.327581 24534 raft_consensus.cc:2243] T 6474754cce8f4042bcab4ac631e9a82f P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.328169 24534 raft_consensus.cc:2272] T 6474754cce8f4042bcab4ac631e9a82f P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.330983 24534 tablet_replica.cc:333] T 0017925ea1bb4374b09c9e692a17f87e P 8fa35514a8d84740b1b46ae496307f20: stopping tablet replica
I20260709 12:27:11.332000 24534 raft_consensus.cc:2243] T 0017925ea1bb4374b09c9e692a17f87e P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.332521 24534 raft_consensus.cc:2272] T 0017925ea1bb4374b09c9e692a17f87e P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.335018 24534 tablet_replica.cc:333] T c97b34e374ed4aec812cc43e2a5f07de P 8fa35514a8d84740b1b46ae496307f20: stopping tablet replica
I20260709 12:27:11.335826 24534 raft_consensus.cc:2243] T c97b34e374ed4aec812cc43e2a5f07de P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.336406 24534 raft_consensus.cc:2272] T c97b34e374ed4aec812cc43e2a5f07de P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.339000 24534 tablet_replica.cc:333] T 7b2e497f1fcf4e40b4374fd2b5b261af P 8fa35514a8d84740b1b46ae496307f20: stopping tablet replica
I20260709 12:27:11.339649 24534 raft_consensus.cc:2243] T 7b2e497f1fcf4e40b4374fd2b5b261af P 8fa35514a8d84740b1b46ae496307f20 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:11.340523 24534 raft_consensus.cc:2272] T 7b2e497f1fcf4e40b4374fd2b5b261af P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.342572 24534 tablet_replica.cc:333] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 8fa35514a8d84740b1b46ae496307f20: stopping tablet replica
I20260709 12:27:11.343142 24534 raft_consensus.cc:2243] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.343606 24534 raft_consensus.cc:2272] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.345468 24534 tablet_replica.cc:333] T dc91bacc3de44d21bc62d8b9a003fdcf P 8fa35514a8d84740b1b46ae496307f20: stopping tablet replica
I20260709 12:27:11.346026 24534 raft_consensus.cc:2243] T dc91bacc3de44d21bc62d8b9a003fdcf P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.346504 24534 raft_consensus.cc:2272] T dc91bacc3de44d21bc62d8b9a003fdcf P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.348448 24534 tablet_replica.cc:333] T 1d925407b8314f5b95a8c940f195433a P 8fa35514a8d84740b1b46ae496307f20: stopping tablet replica
I20260709 12:27:11.348985 24534 raft_consensus.cc:2243] T 1d925407b8314f5b95a8c940f195433a P 8fa35514a8d84740b1b46ae496307f20 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:11.349871 24534 raft_consensus.cc:2272] T 1d925407b8314f5b95a8c940f195433a P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.352727 24534 tablet_replica.cc:333] T 95743acb416b403b9bfb59afe5bf2fe7 P 8fa35514a8d84740b1b46ae496307f20: stopping tablet replica
I20260709 12:27:11.353358 24534 raft_consensus.cc:2243] T 95743acb416b403b9bfb59afe5bf2fe7 P 8fa35514a8d84740b1b46ae496307f20 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:11.354146 24534 raft_consensus.cc:2272] T 95743acb416b403b9bfb59afe5bf2fe7 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.356591 24534 tablet_replica.cc:333] T b364263cacab4add984e2b6c912fb62e P 8fa35514a8d84740b1b46ae496307f20: stopping tablet replica
I20260709 12:27:11.357360 24534 raft_consensus.cc:2243] T b364263cacab4add984e2b6c912fb62e P 8fa35514a8d84740b1b46ae496307f20 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:11.358328 24534 raft_consensus.cc:2272] T b364263cacab4add984e2b6c912fb62e P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.361126 24534 tablet_replica.cc:333] T 74e3cbe3521a46cfb42a6cb7ba98430c P 8fa35514a8d84740b1b46ae496307f20: stopping tablet replica
I20260709 12:27:11.361709 24534 raft_consensus.cc:2243] T 74e3cbe3521a46cfb42a6cb7ba98430c P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.362169 24534 raft_consensus.cc:2272] T 74e3cbe3521a46cfb42a6cb7ba98430c P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.364244 24534 tablet_replica.cc:333] T 580f367489064e218eef65b4654744b8 P 8fa35514a8d84740b1b46ae496307f20: stopping tablet replica
I20260709 12:27:11.364887 24534 raft_consensus.cc:2243] T 580f367489064e218eef65b4654744b8 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.365255 24534 raft_consensus.cc:2272] T 580f367489064e218eef65b4654744b8 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.367069 24534 tablet_replica.cc:333] T c77af7e1c2044a8eacfe0e76ee974591 P 8fa35514a8d84740b1b46ae496307f20: stopping tablet replica
I20260709 12:27:11.367712 24534 raft_consensus.cc:2243] T c77af7e1c2044a8eacfe0e76ee974591 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.368185 24534 raft_consensus.cc:2272] T c77af7e1c2044a8eacfe0e76ee974591 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.370157 24534 tablet_replica.cc:333] T 343e626d0073462fa2020fcf2e2f8ffb P 8fa35514a8d84740b1b46ae496307f20: stopping tablet replica
I20260709 12:27:11.370713 24534 raft_consensus.cc:2243] T 343e626d0073462fa2020fcf2e2f8ffb P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:27:11.371071  1186 consensus_peers.cc:597] T 8c9afd5af68441ffa4c3f90cbd33d977 P 937efeddef934b2b8bc8632594903085 -> Peer 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341): Couldn't send request to peer 8fa35514a8d84740b1b46ae496307f20. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:11.371362 24534 raft_consensus.cc:2272] T 343e626d0073462fa2020fcf2e2f8ffb P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.373818 24534 tablet_replica.cc:333] T 333930b9df5744d59ab498b170a35315 P 8fa35514a8d84740b1b46ae496307f20: stopping tablet replica
I20260709 12:27:11.374645 24534 raft_consensus.cc:2243] T 333930b9df5744d59ab498b170a35315 P 8fa35514a8d84740b1b46ae496307f20 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:11.375728 24534 raft_consensus.cc:2272] T 333930b9df5744d59ab498b170a35315 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.378314 24534 tablet_replica.cc:333] T 0c434afb0b164ab5b38dea54bfcebfe8 P 8fa35514a8d84740b1b46ae496307f20: stopping tablet replica
I20260709 12:27:11.379165 24534 raft_consensus.cc:2243] T 0c434afb0b164ab5b38dea54bfcebfe8 P 8fa35514a8d84740b1b46ae496307f20 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:11.380051 24534 raft_consensus.cc:2272] T 0c434afb0b164ab5b38dea54bfcebfe8 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:11.380771  1110 consensus_peers.cc:597] T e281f15348944cc1ab51fce7c1653aac P 8fa35514a8d84740b1b46ae496307f20 -> Peer 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679): Couldn't send request to peer 7f9cbe40e40d429aa004e4a7fb42f132. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:43679: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:11.381942 24534 tablet_replica.cc:333] T de3dd28c345442b38f399c5db383c5b2 P 8fa35514a8d84740b1b46ae496307f20: stopping tablet replica
I20260709 12:27:11.382622 24534 raft_consensus.cc:2243] T de3dd28c345442b38f399c5db383c5b2 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.383038 24534 raft_consensus.cc:2272] T de3dd28c345442b38f399c5db383c5b2 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.384930 24534 tablet_replica.cc:333] T ec806598903e4f88a40176e07ca4fad0 P 8fa35514a8d84740b1b46ae496307f20: stopping tablet replica
I20260709 12:27:11.385576 24534 raft_consensus.cc:2243] T ec806598903e4f88a40176e07ca4fad0 P 8fa35514a8d84740b1b46ae496307f20 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:11.386319 24534 raft_consensus.cc:2272] T ec806598903e4f88a40176e07ca4fad0 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.388167 24534 tablet_replica.cc:333] T c9793ebdadaa4da18e4e2c2fe6dae825 P 8fa35514a8d84740b1b46ae496307f20: stopping tablet replica
I20260709 12:27:11.388705 24534 raft_consensus.cc:2243] T c9793ebdadaa4da18e4e2c2fe6dae825 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.389155 24534 raft_consensus.cc:2272] T c9793ebdadaa4da18e4e2c2fe6dae825 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.391148 24534 tablet_replica.cc:333] T edea2a0a3c264f2b810295aea0acfb73 P 8fa35514a8d84740b1b46ae496307f20: stopping tablet replica
I20260709 12:27:11.391690 24534 raft_consensus.cc:2243] T edea2a0a3c264f2b810295aea0acfb73 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.392186 24534 raft_consensus.cc:2272] T edea2a0a3c264f2b810295aea0acfb73 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.394513 24534 tablet_replica.cc:333] T 8c9afd5af68441ffa4c3f90cbd33d977 P 8fa35514a8d84740b1b46ae496307f20: stopping tablet replica
I20260709 12:27:11.395203 24534 raft_consensus.cc:2243] T 8c9afd5af68441ffa4c3f90cbd33d977 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.395702 24534 raft_consensus.cc:2272] T 8c9afd5af68441ffa4c3f90cbd33d977 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.397567 24534 tablet_replica.cc:333] T b8e49440650449f49e5303568f2f19c0 P 8fa35514a8d84740b1b46ae496307f20: stopping tablet replica
I20260709 12:27:11.398072 24534 raft_consensus.cc:2243] T b8e49440650449f49e5303568f2f19c0 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.398537 24534 raft_consensus.cc:2272] T b8e49440650449f49e5303568f2f19c0 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.400324 24534 tablet_replica.cc:333] T 040ea9f986ee4ed29b941698c802c501 P 8fa35514a8d84740b1b46ae496307f20: stopping tablet replica
I20260709 12:27:11.400810 24534 raft_consensus.cc:2243] T 040ea9f986ee4ed29b941698c802c501 P 8fa35514a8d84740b1b46ae496307f20 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:11.401527 24534 raft_consensus.cc:2272] T 040ea9f986ee4ed29b941698c802c501 P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.403486 24534 tablet_replica.cc:333] T a1c303d40c6a4cae88aa89d681ae7b76 P 8fa35514a8d84740b1b46ae496307f20: stopping tablet replica
I20260709 12:27:11.404064 24534 raft_consensus.cc:2243] T a1c303d40c6a4cae88aa89d681ae7b76 P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.404460 24534 raft_consensus.cc:2272] T a1c303d40c6a4cae88aa89d681ae7b76 P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.406299 24534 tablet_replica.cc:333] T acc6ab0dce1640e380b433b32a874108 P 8fa35514a8d84740b1b46ae496307f20: stopping tablet replica
I20260709 12:27:11.406816 24534 raft_consensus.cc:2243] T acc6ab0dce1640e380b433b32a874108 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.407272 24534 raft_consensus.cc:2272] T acc6ab0dce1640e380b433b32a874108 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.410841 24534 tablet_replica.cc:333] T 4d899bdd8a44422ca2a8036f84e9f9f3 P 8fa35514a8d84740b1b46ae496307f20: stopping tablet replica
I20260709 12:27:11.411780 24534 raft_consensus.cc:2243] T 4d899bdd8a44422ca2a8036f84e9f9f3 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.412644 24534 raft_consensus.cc:2272] T 4d899bdd8a44422ca2a8036f84e9f9f3 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:11.413043  1186 consensus_peers.cc:597] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P 937efeddef934b2b8bc8632594903085 -> Peer 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341): Couldn't send request to peer 8fa35514a8d84740b1b46ae496307f20. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:11.415190 24534 tablet_replica.cc:333] T e5af913e96004f3b8cac5fbe6ac655ac P 8fa35514a8d84740b1b46ae496307f20: stopping tablet replica
I20260709 12:27:11.416376 24534 raft_consensus.cc:2243] T e5af913e96004f3b8cac5fbe6ac655ac P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.417321 24534 raft_consensus.cc:2272] T e5af913e96004f3b8cac5fbe6ac655ac P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.419838 24534 tablet_replica.cc:333] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P 8fa35514a8d84740b1b46ae496307f20: stopping tablet replica
I20260709 12:27:11.420555 24534 raft_consensus.cc:2243] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.420989 24534 raft_consensus.cc:2272] T 9a7d578ba2eb41f7a38f15c5dd34b8cb P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.422947 24534 tablet_replica.cc:333] T c4234c6cf75048c5a6cdf34e43c9bd1e P 8fa35514a8d84740b1b46ae496307f20: stopping tablet replica
I20260709 12:27:11.423485 24534 raft_consensus.cc:2243] T c4234c6cf75048c5a6cdf34e43c9bd1e P 8fa35514a8d84740b1b46ae496307f20 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.423996 24534 raft_consensus.cc:2272] T c4234c6cf75048c5a6cdf34e43c9bd1e P 8fa35514a8d84740b1b46ae496307f20 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.425930 24534 tablet_replica.cc:333] T f84cb753a9bd4fdd91824bb2d5050621 P 8fa35514a8d84740b1b46ae496307f20: stopping tablet replica
I20260709 12:27:11.426496 24534 raft_consensus.cc:2243] T f84cb753a9bd4fdd91824bb2d5050621 P 8fa35514a8d84740b1b46ae496307f20 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:11.427315 24534 raft_consensus.cc:2272] T f84cb753a9bd4fdd91824bb2d5050621 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.429695 24534 tablet_replica.cc:333] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 8fa35514a8d84740b1b46ae496307f20: stopping tablet replica
I20260709 12:27:11.430184 24534 raft_consensus.cc:2243] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 8fa35514a8d84740b1b46ae496307f20 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:11.430904 24534 raft_consensus.cc:2272] T c9d72f2a6ae046cb9d4e6277d13e34e6 P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.433013 24534 tablet_replica.cc:333] T 284ea666431c4339998eb885cd31facb P 8fa35514a8d84740b1b46ae496307f20: stopping tablet replica
I20260709 12:27:11.433477 24534 raft_consensus.cc:2243] T 284ea666431c4339998eb885cd31facb P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.433925 24534 raft_consensus.cc:2272] T 284ea666431c4339998eb885cd31facb P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.435812 24534 tablet_replica.cc:333] T 0e2eae4c387445f39a059befe390fe45 P 8fa35514a8d84740b1b46ae496307f20: stopping tablet replica
I20260709 12:27:11.436499 24534 raft_consensus.cc:2243] T 0e2eae4c387445f39a059befe390fe45 P 8fa35514a8d84740b1b46ae496307f20 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:11.437325 24534 raft_consensus.cc:2272] T 0e2eae4c387445f39a059befe390fe45 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.439910 24534 tablet_replica.cc:333] T 70720af8528947a89c03ec468c1235eb P 8fa35514a8d84740b1b46ae496307f20: stopping tablet replica
I20260709 12:27:11.440639 24534 raft_consensus.cc:2243] T 70720af8528947a89c03ec468c1235eb P 8fa35514a8d84740b1b46ae496307f20 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:11.441602 24534 raft_consensus.cc:2272] T 70720af8528947a89c03ec468c1235eb P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.444214 24534 tablet_replica.cc:333] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 8fa35514a8d84740b1b46ae496307f20: stopping tablet replica
I20260709 12:27:11.444945 24534 raft_consensus.cc:2243] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.445694 24534 raft_consensus.cc:2272] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.448535 24534 tablet_replica.cc:333] T e6de424e08ed4b1d8f6d32d17a44025d P 8fa35514a8d84740b1b46ae496307f20: stopping tablet replica
I20260709 12:27:11.449254 24534 raft_consensus.cc:2243] T e6de424e08ed4b1d8f6d32d17a44025d P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.449736 24534 raft_consensus.cc:2272] T e6de424e08ed4b1d8f6d32d17a44025d P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.452369 24534 tablet_replica.cc:333] T 6715731f9a31415a98fa8a0ab9944eec P 8fa35514a8d84740b1b46ae496307f20: stopping tablet replica
I20260709 12:27:11.453054 24534 raft_consensus.cc:2243] T 6715731f9a31415a98fa8a0ab9944eec P 8fa35514a8d84740b1b46ae496307f20 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.453533 24534 raft_consensus.cc:2272] T 6715731f9a31415a98fa8a0ab9944eec P 8fa35514a8d84740b1b46ae496307f20 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.456082 24534 tablet_replica.cc:333] T 8c7002e5875a494e8e845023cc05503f P 8fa35514a8d84740b1b46ae496307f20: stopping tablet replica
I20260709 12:27:11.456732 24534 raft_consensus.cc:2243] T 8c7002e5875a494e8e845023cc05503f P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.457326 24534 raft_consensus.cc:2272] T 8c7002e5875a494e8e845023cc05503f P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.459206 24534 tablet_replica.cc:333] T 5302c354091f4926812eb90f518b9d6a P 8fa35514a8d84740b1b46ae496307f20: stopping tablet replica
I20260709 12:27:11.459725 24534 raft_consensus.cc:2243] T 5302c354091f4926812eb90f518b9d6a P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.460198 24534 raft_consensus.cc:2272] T 5302c354091f4926812eb90f518b9d6a P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.462638 24534 tablet_replica.cc:333] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P 8fa35514a8d84740b1b46ae496307f20: stopping tablet replica
I20260709 12:27:11.463238 24534 raft_consensus.cc:2243] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P 8fa35514a8d84740b1b46ae496307f20 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:11.464095 24534 raft_consensus.cc:2272] T eb44e6d7d92f49eb9758d5a5f6ce50b6 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.466306 24534 tablet_replica.cc:333] T 1b6df135b8494d0d916747b8994b5cf9 P 8fa35514a8d84740b1b46ae496307f20: stopping tablet replica
I20260709 12:27:11.466742 24534 raft_consensus.cc:2243] T 1b6df135b8494d0d916747b8994b5cf9 P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.467085 24534 raft_consensus.cc:2272] T 1b6df135b8494d0d916747b8994b5cf9 P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.468920 24534 tablet_replica.cc:333] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 8fa35514a8d84740b1b46ae496307f20: stopping tablet replica
I20260709 12:27:11.469352 24534 raft_consensus.cc:2243] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.469698 24534 raft_consensus.cc:2272] T 2f2713fe1c7148f0b6d9a69c53ec3515 P 8fa35514a8d84740b1b46ae496307f20 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.471557 24534 tablet_replica.cc:333] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P 8fa35514a8d84740b1b46ae496307f20: stopping tablet replica
I20260709 12:27:11.472312 24534 raft_consensus.cc:2243] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.472790 24534 raft_consensus.cc:2272] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.475428 24534 tablet_replica.cc:333] T e281f15348944cc1ab51fce7c1653aac P 8fa35514a8d84740b1b46ae496307f20: stopping tablet replica
I20260709 12:27:11.476028 24534 raft_consensus.cc:2243] T e281f15348944cc1ab51fce7c1653aac P 8fa35514a8d84740b1b46ae496307f20 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:11.476994 24534 raft_consensus.cc:2272] T e281f15348944cc1ab51fce7c1653aac P 8fa35514a8d84740b1b46ae496307f20 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:11.482419  1186 consensus_peers.cc:597] T 4d899bdd8a44422ca2a8036f84e9f9f3 P 937efeddef934b2b8bc8632594903085 -> Peer 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341): Couldn't send request to peer 8fa35514a8d84740b1b46ae496307f20. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:11.543658 24534 tablet_server.cc:196] TabletServer@127.23.245.131:0 shutdown complete.
I20260709 12:27:11.571959  2002 raft_consensus.cc:493] T c4234c6cf75048c5a6cdf34e43c9bd1e P 937efeddef934b2b8bc8632594903085 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aa098a557d34433896712068efd0d9a8)
I20260709 12:27:11.572641  2002 raft_consensus.cc:515] T c4234c6cf75048c5a6cdf34e43c9bd1e P 937efeddef934b2b8bc8632594903085 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:27:11.574759  2002 leader_election.cc:290] T c4234c6cf75048c5a6cdf34e43c9bd1e P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
W20260709 12:27:11.580313  1186 leader_election.cc:336] T c4234c6cf75048c5a6cdf34e43c9bd1e P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341): Network error: Client connection negotiation failed: client connection to 127.23.245.131:40341: connect: Connection refused (error 111)
W20260709 12:27:11.581139  1186 leader_election.cc:336] T c4234c6cf75048c5a6cdf34e43c9bd1e P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111)
I20260709 12:27:11.581626  1186 leader_election.cc:304] T c4234c6cf75048c5a6cdf34e43c9bd1e P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 937efeddef934b2b8bc8632594903085; no voters: 8fa35514a8d84740b1b46ae496307f20, aa098a557d34433896712068efd0d9a8
I20260709 12:27:11.582376  2002 raft_consensus.cc:2749] T c4234c6cf75048c5a6cdf34e43c9bd1e P 937efeddef934b2b8bc8632594903085 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:11.630074 24534 tablet_server.cc:179] TabletServer@127.23.245.132:0 shutting down...
I20260709 12:27:11.632272  2002 raft_consensus.cc:493] T 343e626d0073462fa2020fcf2e2f8ffb P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader aa098a557d34433896712068efd0d9a8)
I20260709 12:27:11.632817  2002 raft_consensus.cc:515] T 343e626d0073462fa2020fcf2e2f8ffb P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8fa35514a8d84740b1b46ae496307f20" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 40341 } } peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } }
I20260709 12:27:11.634688  2002 leader_election.cc:290] T 343e626d0073462fa2020fcf2e2f8ffb P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341), aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981)
W20260709 12:27:11.641690  1186 leader_election.cc:336] T 343e626d0073462fa2020fcf2e2f8ffb P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 8fa35514a8d84740b1b46ae496307f20 (127.23.245.131:40341): Network error: Client connection negotiation failed: client connection to 127.23.245.131:40341: connect: Connection refused (error 111)
W20260709 12:27:11.642913  1186 leader_election.cc:336] T 343e626d0073462fa2020fcf2e2f8ffb P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111)
I20260709 12:27:11.643317  1186 leader_election.cc:304] T 343e626d0073462fa2020fcf2e2f8ffb P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 937efeddef934b2b8bc8632594903085; no voters: 8fa35514a8d84740b1b46ae496307f20, aa098a557d34433896712068efd0d9a8
I20260709 12:27:11.644137  2002 raft_consensus.cc:2749] T 343e626d0073462fa2020fcf2e2f8ffb P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:11.674767 24534 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:11.675616 24534 tablet_replica.cc:333] T ac8f3ce8c750468c966a23ea2787b888 P 937efeddef934b2b8bc8632594903085: stopping tablet replica
I20260709 12:27:11.676364 24534 raft_consensus.cc:2243] T ac8f3ce8c750468c966a23ea2787b888 P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:11.677222 24534 raft_consensus.cc:2272] T ac8f3ce8c750468c966a23ea2787b888 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.679457 24534 tablet_replica.cc:333] T 6474754cce8f4042bcab4ac631e9a82f P 937efeddef934b2b8bc8632594903085: stopping tablet replica
I20260709 12:27:11.680087 24534 raft_consensus.cc:2243] T 6474754cce8f4042bcab4ac631e9a82f P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:11.681041 24534 raft_consensus.cc:2272] T 6474754cce8f4042bcab4ac631e9a82f P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.683064 24534 tablet_replica.cc:333] T c5197f4025d94ce096c14c6ca011b47b P 937efeddef934b2b8bc8632594903085: stopping tablet replica
I20260709 12:27:11.683703 24534 raft_consensus.cc:2243] T c5197f4025d94ce096c14c6ca011b47b P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:11.684475 24534 raft_consensus.cc:2272] T c5197f4025d94ce096c14c6ca011b47b P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.686417 24534 tablet_replica.cc:333] T c97b34e374ed4aec812cc43e2a5f07de P 937efeddef934b2b8bc8632594903085: stopping tablet replica
I20260709 12:27:11.686991 24534 raft_consensus.cc:2243] T c97b34e374ed4aec812cc43e2a5f07de P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.687407 24534 raft_consensus.cc:2272] T c97b34e374ed4aec812cc43e2a5f07de P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.689406 24534 tablet_replica.cc:333] T 7b2e497f1fcf4e40b4374fd2b5b261af P 937efeddef934b2b8bc8632594903085: stopping tablet replica
I20260709 12:27:11.690394 24534 raft_consensus.cc:2243] T 7b2e497f1fcf4e40b4374fd2b5b261af P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.690968 24534 raft_consensus.cc:2272] T 7b2e497f1fcf4e40b4374fd2b5b261af P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.693233 24534 tablet_replica.cc:333] T f84cb753a9bd4fdd91824bb2d5050621 P 937efeddef934b2b8bc8632594903085: stopping tablet replica
I20260709 12:27:11.693941 24534 raft_consensus.cc:2243] T f84cb753a9bd4fdd91824bb2d5050621 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.694408 24534 raft_consensus.cc:2272] T f84cb753a9bd4fdd91824bb2d5050621 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.696455 24534 tablet_replica.cc:333] T 329e639d23154fb6bd4ccdf095dbd0e0 P 937efeddef934b2b8bc8632594903085: stopping tablet replica
I20260709 12:27:11.697063 24534 raft_consensus.cc:2243] T 329e639d23154fb6bd4ccdf095dbd0e0 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.697503 24534 raft_consensus.cc:2272] T 329e639d23154fb6bd4ccdf095dbd0e0 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.699391 24534 tablet_replica.cc:333] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 937efeddef934b2b8bc8632594903085: stopping tablet replica
I20260709 12:27:11.700361 24534 raft_consensus.cc:2243] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.700822 24534 raft_consensus.cc:2272] T 1d2d9d3061d24ab1aac189e9a8b0a12d P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.702627 24534 tablet_replica.cc:333] T dc91bacc3de44d21bc62d8b9a003fdcf P 937efeddef934b2b8bc8632594903085: stopping tablet replica
I20260709 12:27:11.703210 24534 raft_consensus.cc:2243] T dc91bacc3de44d21bc62d8b9a003fdcf P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.703621 24534 raft_consensus.cc:2272] T dc91bacc3de44d21bc62d8b9a003fdcf P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.705890 24534 tablet_replica.cc:333] T 1d925407b8314f5b95a8c940f195433a P 937efeddef934b2b8bc8632594903085: stopping tablet replica
I20260709 12:27:11.706557 24534 raft_consensus.cc:2243] T 1d925407b8314f5b95a8c940f195433a P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.707170 24534 raft_consensus.cc:2272] T 1d925407b8314f5b95a8c940f195433a P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.709383 24534 tablet_replica.cc:333] T a943f9cb8fef49e6a38b910ff1bb9076 P 937efeddef934b2b8bc8632594903085: stopping tablet replica
I20260709 12:27:11.709975 24534 raft_consensus.cc:2243] T a943f9cb8fef49e6a38b910ff1bb9076 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.710412 24534 raft_consensus.cc:2272] T a943f9cb8fef49e6a38b910ff1bb9076 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.713550 24534 tablet_replica.cc:333] T a93df19c4206495e971bc5e95a2111bc P 937efeddef934b2b8bc8632594903085: stopping tablet replica
I20260709 12:27:11.714424 24534 raft_consensus.cc:2243] T a93df19c4206495e971bc5e95a2111bc P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:11.715556 24534 raft_consensus.cc:2272] T a93df19c4206495e971bc5e95a2111bc P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.718405 24534 tablet_replica.cc:333] T 4d899bdd8a44422ca2a8036f84e9f9f3 P 937efeddef934b2b8bc8632594903085: stopping tablet replica
I20260709 12:27:11.719228 24534 raft_consensus.cc:2243] T 4d899bdd8a44422ca2a8036f84e9f9f3 P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:11.720165 24534 raft_consensus.cc:2272] T 4d899bdd8a44422ca2a8036f84e9f9f3 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.721978 24534 tablet_replica.cc:333] T 98b5b180139845c99c537cd675a60830 P 937efeddef934b2b8bc8632594903085: stopping tablet replica
I20260709 12:27:11.722508 24534 raft_consensus.cc:2243] T 98b5b180139845c99c537cd675a60830 P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.722900 24534 raft_consensus.cc:2272] T 98b5b180139845c99c537cd675a60830 P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.724898 24534 tablet_replica.cc:333] T 580f367489064e218eef65b4654744b8 P 937efeddef934b2b8bc8632594903085: stopping tablet replica
I20260709 12:27:11.725404 24534 raft_consensus.cc:2243] T 580f367489064e218eef65b4654744b8 P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:11.726214 24534 raft_consensus.cc:2272] T 580f367489064e218eef65b4654744b8 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.729168 24534 tablet_replica.cc:333] T c77af7e1c2044a8eacfe0e76ee974591 P 937efeddef934b2b8bc8632594903085: stopping tablet replica
I20260709 12:27:11.730060 24534 raft_consensus.cc:2243] T c77af7e1c2044a8eacfe0e76ee974591 P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:11.731122 24534 raft_consensus.cc:2272] T c77af7e1c2044a8eacfe0e76ee974591 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.733036 24534 tablet_replica.cc:333] T c4234c6cf75048c5a6cdf34e43c9bd1e P 937efeddef934b2b8bc8632594903085: stopping tablet replica
I20260709 12:27:11.733599 24534 raft_consensus.cc:2243] T c4234c6cf75048c5a6cdf34e43c9bd1e P 937efeddef934b2b8bc8632594903085 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.733996 24534 raft_consensus.cc:2272] T c4234c6cf75048c5a6cdf34e43c9bd1e P 937efeddef934b2b8bc8632594903085 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.735829 24534 tablet_replica.cc:333] T de3dd28c345442b38f399c5db383c5b2 P 937efeddef934b2b8bc8632594903085: stopping tablet replica
I20260709 12:27:11.736419 24534 raft_consensus.cc:2243] T de3dd28c345442b38f399c5db383c5b2 P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:11.737146 24534 raft_consensus.cc:2272] T de3dd28c345442b38f399c5db383c5b2 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.739445 24534 tablet_replica.cc:333] T 0c434afb0b164ab5b38dea54bfcebfe8 P 937efeddef934b2b8bc8632594903085: stopping tablet replica
I20260709 12:27:11.740005  2002 raft_consensus.cc:493] T 5b3d71845177478a9e2510c82e0cf9d1 P 937efeddef934b2b8bc8632594903085 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader aa098a557d34433896712068efd0d9a8)
I20260709 12:27:11.740298 24534 raft_consensus.cc:2243] T 0c434afb0b164ab5b38dea54bfcebfe8 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.740577  2002 raft_consensus.cc:515] T 5b3d71845177478a9e2510c82e0cf9d1 P 937efeddef934b2b8bc8632594903085 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "937efeddef934b2b8bc8632594903085" member_type: VOTER last_known_addr { host: "127.23.245.132" port: 33909 } } peers { permanent_uuid: "aa098a557d34433896712068efd0d9a8" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 32981 } } peers { permanent_uuid: "7f9cbe40e40d429aa004e4a7fb42f132" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 43679 } }
I20260709 12:27:11.740972 24534 raft_consensus.cc:2272] T 0c434afb0b164ab5b38dea54bfcebfe8 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.742440  2002 leader_election.cc:290] T 5b3d71845177478a9e2510c82e0cf9d1 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981), 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679)
I20260709 12:27:11.744005 24534 tablet_replica.cc:333] T edea2a0a3c264f2b810295aea0acfb73 P 937efeddef934b2b8bc8632594903085: stopping tablet replica
I20260709 12:27:11.745136 24534 raft_consensus.cc:2243] T edea2a0a3c264f2b810295aea0acfb73 P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:11.746111 24534 raft_consensus.cc:2272] T edea2a0a3c264f2b810295aea0acfb73 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:11.746791  1184 leader_election.cc:336] T 5b3d71845177478a9e2510c82e0cf9d1 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7f9cbe40e40d429aa004e4a7fb42f132 (127.23.245.130:43679): Network error: Client connection negotiation failed: client connection to 127.23.245.130:43679: connect: Connection refused (error 111)
W20260709 12:27:11.747403  1186 leader_election.cc:336] T 5b3d71845177478a9e2510c82e0cf9d1 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer aa098a557d34433896712068efd0d9a8 (127.23.245.129:32981): Network error: Client connection negotiation failed: client connection to 127.23.245.129:32981: connect: Connection refused (error 111)
I20260709 12:27:11.747793  1186 leader_election.cc:304] T 5b3d71845177478a9e2510c82e0cf9d1 P 937efeddef934b2b8bc8632594903085 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 937efeddef934b2b8bc8632594903085; no voters: 7f9cbe40e40d429aa004e4a7fb42f132, aa098a557d34433896712068efd0d9a8
I20260709 12:27:11.748472  2002 raft_consensus.cc:2749] T 5b3d71845177478a9e2510c82e0cf9d1 P 937efeddef934b2b8bc8632594903085 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:11.748971 24534 tablet_replica.cc:333] T c9793ebdadaa4da18e4e2c2fe6dae825 P 937efeddef934b2b8bc8632594903085: stopping tablet replica
I20260709 12:27:11.749765 24534 raft_consensus.cc:2243] T c9793ebdadaa4da18e4e2c2fe6dae825 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.750247 24534 raft_consensus.cc:2272] T c9793ebdadaa4da18e4e2c2fe6dae825 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.752583 24534 tablet_replica.cc:333] T ec47b02d68674e2386a86244d9026b78 P 937efeddef934b2b8bc8632594903085: stopping tablet replica
I20260709 12:27:11.753173 24534 raft_consensus.cc:2243] T ec47b02d68674e2386a86244d9026b78 P 937efeddef934b2b8bc8632594903085 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:11.753975 24534 raft_consensus.cc:2272] T ec47b02d68674e2386a86244d9026b78 P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.756053 24534 tablet_replica.cc:333] T 040ea9f986ee4ed29b941698c802c501 P 937efeddef934b2b8bc8632594903085: stopping tablet replica
I20260709 12:27:11.756618 24534 raft_consensus.cc:2243] T 040ea9f986ee4ed29b941698c802c501 P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.757061 24534 raft_consensus.cc:2272] T 040ea9f986ee4ed29b941698c802c501 P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.759382 24534 tablet_replica.cc:333] T c36d0201599a49169424a6b75f5349f2 P 937efeddef934b2b8bc8632594903085: stopping tablet replica
I20260709 12:27:11.760035 24534 raft_consensus.cc:2243] T c36d0201599a49169424a6b75f5349f2 P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.760453 24534 raft_consensus.cc:2272] T c36d0201599a49169424a6b75f5349f2 P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.762966 24534 tablet_replica.cc:333] T a1c303d40c6a4cae88aa89d681ae7b76 P 937efeddef934b2b8bc8632594903085: stopping tablet replica
I20260709 12:27:11.763700 24534 raft_consensus.cc:2243] T a1c303d40c6a4cae88aa89d681ae7b76 P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.764250 24534 raft_consensus.cc:2272] T a1c303d40c6a4cae88aa89d681ae7b76 P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.766094 24534 tablet_replica.cc:333] T acc6ab0dce1640e380b433b32a874108 P 937efeddef934b2b8bc8632594903085: stopping tablet replica
I20260709 12:27:11.766651 24534 raft_consensus.cc:2243] T acc6ab0dce1640e380b433b32a874108 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.767104 24534 raft_consensus.cc:2272] T acc6ab0dce1640e380b433b32a874108 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.769068 24534 tablet_replica.cc:333] T 343e626d0073462fa2020fcf2e2f8ffb P 937efeddef934b2b8bc8632594903085: stopping tablet replica
I20260709 12:27:11.769630 24534 raft_consensus.cc:2243] T 343e626d0073462fa2020fcf2e2f8ffb P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.770093 24534 raft_consensus.cc:2272] T 343e626d0073462fa2020fcf2e2f8ffb P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.772082 24534 tablet_replica.cc:333] T c495ce9da627479e92d7b24b3be3641a P 937efeddef934b2b8bc8632594903085: stopping tablet replica
I20260709 12:27:11.772608 24534 raft_consensus.cc:2243] T c495ce9da627479e92d7b24b3be3641a P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:11.773388 24534 raft_consensus.cc:2272] T c495ce9da627479e92d7b24b3be3641a P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.775272 24534 tablet_replica.cc:333] T 8c9afd5af68441ffa4c3f90cbd33d977 P 937efeddef934b2b8bc8632594903085: stopping tablet replica
I20260709 12:27:11.776283 24534 raft_consensus.cc:2243] T 8c9afd5af68441ffa4c3f90cbd33d977 P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:11.777071 24534 raft_consensus.cc:2272] T 8c9afd5af68441ffa4c3f90cbd33d977 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.779018 24534 tablet_replica.cc:333] T b8e49440650449f49e5303568f2f19c0 P 937efeddef934b2b8bc8632594903085: stopping tablet replica
I20260709 12:27:11.779651 24534 raft_consensus.cc:2243] T b8e49440650449f49e5303568f2f19c0 P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:11.780424 24534 raft_consensus.cc:2272] T b8e49440650449f49e5303568f2f19c0 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.782361 24534 tablet_replica.cc:333] T 70720af8528947a89c03ec468c1235eb P 937efeddef934b2b8bc8632594903085: stopping tablet replica
I20260709 12:27:11.782949 24534 raft_consensus.cc:2243] T 70720af8528947a89c03ec468c1235eb P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.783413 24534 raft_consensus.cc:2272] T 70720af8528947a89c03ec468c1235eb P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.785559 24534 tablet_replica.cc:333] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 937efeddef934b2b8bc8632594903085: stopping tablet replica
I20260709 12:27:11.786090 24534 raft_consensus.cc:2243] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.786580 24534 raft_consensus.cc:2272] T 3e22afc1ef634aaabf17a4e5a3bf0be3 P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.788522 24534 tablet_replica.cc:333] T 3a19a87d91404b73bdba7121512bf7aa P 937efeddef934b2b8bc8632594903085: stopping tablet replica
I20260709 12:27:11.789031 24534 raft_consensus.cc:2243] T 3a19a87d91404b73bdba7121512bf7aa P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.789469 24534 raft_consensus.cc:2272] T 3a19a87d91404b73bdba7121512bf7aa P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.791762 24534 tablet_replica.cc:333] T e12f4bd1b2ed49988317684782c8616b P 937efeddef934b2b8bc8632594903085: stopping tablet replica
I20260709 12:27:11.792508 24534 raft_consensus.cc:2243] T e12f4bd1b2ed49988317684782c8616b P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.792971 24534 raft_consensus.cc:2272] T e12f4bd1b2ed49988317684782c8616b P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.794834 24534 tablet_replica.cc:333] T 5302c354091f4926812eb90f518b9d6a P 937efeddef934b2b8bc8632594903085: stopping tablet replica
I20260709 12:27:11.795352 24534 raft_consensus.cc:2243] T 5302c354091f4926812eb90f518b9d6a P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.795782 24534 raft_consensus.cc:2272] T 5302c354091f4926812eb90f518b9d6a P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.797668 24534 tablet_replica.cc:333] T e81f2374d9904e93bf2941ff8b241c09 P 937efeddef934b2b8bc8632594903085: stopping tablet replica
I20260709 12:27:11.798220 24534 raft_consensus.cc:2243] T e81f2374d9904e93bf2941ff8b241c09 P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.798676 24534 raft_consensus.cc:2272] T e81f2374d9904e93bf2941ff8b241c09 P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.800582 24534 tablet_replica.cc:333] T 5b3d71845177478a9e2510c82e0cf9d1 P 937efeddef934b2b8bc8632594903085: stopping tablet replica
I20260709 12:27:11.801121 24534 raft_consensus.cc:2243] T 5b3d71845177478a9e2510c82e0cf9d1 P 937efeddef934b2b8bc8632594903085 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.801518 24534 raft_consensus.cc:2272] T 5b3d71845177478a9e2510c82e0cf9d1 P 937efeddef934b2b8bc8632594903085 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.803372 24534 tablet_replica.cc:333] T 1b6df135b8494d0d916747b8994b5cf9 P 937efeddef934b2b8bc8632594903085: stopping tablet replica
I20260709 12:27:11.803874 24534 raft_consensus.cc:2243] T 1b6df135b8494d0d916747b8994b5cf9 P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.804390 24534 raft_consensus.cc:2272] T 1b6df135b8494d0d916747b8994b5cf9 P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.806141 24534 tablet_replica.cc:333] T e6de424e08ed4b1d8f6d32d17a44025d P 937efeddef934b2b8bc8632594903085: stopping tablet replica
I20260709 12:27:11.806586 24534 raft_consensus.cc:2243] T e6de424e08ed4b1d8f6d32d17a44025d P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.806924 24534 raft_consensus.cc:2272] T e6de424e08ed4b1d8f6d32d17a44025d P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.808679 24534 tablet_replica.cc:333] T 6715731f9a31415a98fa8a0ab9944eec P 937efeddef934b2b8bc8632594903085: stopping tablet replica
I20260709 12:27:11.809091 24534 raft_consensus.cc:2243] T 6715731f9a31415a98fa8a0ab9944eec P 937efeddef934b2b8bc8632594903085 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.809449 24534 raft_consensus.cc:2272] T 6715731f9a31415a98fa8a0ab9944eec P 937efeddef934b2b8bc8632594903085 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.811224 24534 tablet_replica.cc:333] T 8c7002e5875a494e8e845023cc05503f P 937efeddef934b2b8bc8632594903085: stopping tablet replica
I20260709 12:27:11.811640 24534 raft_consensus.cc:2243] T 8c7002e5875a494e8e845023cc05503f P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.812117 24534 raft_consensus.cc:2272] T 8c7002e5875a494e8e845023cc05503f P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.813763 24534 tablet_replica.cc:333] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P 937efeddef934b2b8bc8632594903085: stopping tablet replica
I20260709 12:27:11.814183 24534 raft_consensus.cc:2243] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P 937efeddef934b2b8bc8632594903085 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:11.814881 24534 raft_consensus.cc:2272] T b2ae9b52b5bd4abf9b47e9e7f86a9519 P 937efeddef934b2b8bc8632594903085 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.816781 24534 tablet_replica.cc:333] T 348d7f300dcb474b8b012e01d0af067f P 937efeddef934b2b8bc8632594903085: stopping tablet replica
I20260709 12:27:11.817227 24534 raft_consensus.cc:2243] T 348d7f300dcb474b8b012e01d0af067f P 937efeddef934b2b8bc8632594903085 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:11.817863 24534 raft_consensus.cc:2272] T 348d7f300dcb474b8b012e01d0af067f P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.819643 24534 tablet_replica.cc:333] T e2ef4b262fac46fe9f9111b609547aa3 P 937efeddef934b2b8bc8632594903085: stopping tablet replica
I20260709 12:27:11.820109 24534 raft_consensus.cc:2243] T e2ef4b262fac46fe9f9111b609547aa3 P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:11.820457 24534 raft_consensus.cc:2272] T e2ef4b262fac46fe9f9111b609547aa3 P 937efeddef934b2b8bc8632594903085 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.891676 24534 tablet_server.cc:196] TabletServer@127.23.245.132:0 shutdown complete.
I20260709 12:27:11.953238 24534 master.cc:562] Master@127.23.245.190:34325 shutting down...
I20260709 12:27:11.984781 24534 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 0c6302794b2d42eea2f95fe038fb037f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:11.985414 24534 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 0c6302794b2d42eea2f95fe038fb037f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:11.985805 24534 tablet_replica.cc:333] T 00000000000000000000000000000000 P 0c6302794b2d42eea2f95fe038fb037f: stopping tablet replica
I20260709 12:27:12.010177 24534 master.cc:584] Master@127.23.245.190:34325 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (32650 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 12:27:12.110742 24534 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.23.245.190:40151
I20260709 12:27:12.112247 24534 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:12.118943  2126 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:12.118983  2125 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:12.120446  2128 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:12.121387 24534 server_base.cc:1061] running on GCE node
I20260709 12:27:12.122586 24534 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:12.122793 24534 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:12.122912 24534 hybrid_clock.cc:648] HybridClock initialized: now 1783600032122901 us; error 0 us; skew 500 ppm
I20260709 12:27:12.123386 24534 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:12.126457 24534 webserver.cc:533] Webserver started at http://127.23.245.190:35139/ using document root <none> and password file <none>
I20260709 12:27:12.127012 24534 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:12.127193 24534 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:12.127406 24534 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:12.128993 24534 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599704270295-24534-0/minicluster-data/master-0-root/instance:
uuid: "9002fddf210845ba83d26455cfa528bb"
format_stamp: "Formatted at 2026-07-09 12:27:12 on dist-test-slave-mlt7"
I20260709 12:27:12.133689 24534 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 12:27:12.137609  2133 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:12.138641 24534 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:27:12.138979 24534 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599704270295-24534-0/minicluster-data/master-0-root
uuid: "9002fddf210845ba83d26455cfa528bb"
format_stamp: "Formatted at 2026-07-09 12:27:12 on dist-test-slave-mlt7"
I20260709 12:27:12.139283 24534 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599704270295-24534-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599704270295-24534-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599704270295-24534-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:12.165853 24534 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:12.167222 24534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:12.213941 24534 rpc_server.cc:307] RPC server started. Bound to: 127.23.245.190:40151
I20260709 12:27:12.214026  2184 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.245.190:40151 every 8 connection(s)
I20260709 12:27:12.218659  2185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:12.234138  2185 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9002fddf210845ba83d26455cfa528bb: Bootstrap starting.
I20260709 12:27:12.239246  2185 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9002fddf210845ba83d26455cfa528bb: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:12.243664  2185 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9002fddf210845ba83d26455cfa528bb: No bootstrap required, opened a new log
I20260709 12:27:12.245865  2185 raft_consensus.cc:359] T 00000000000000000000000000000000 P 9002fddf210845ba83d26455cfa528bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9002fddf210845ba83d26455cfa528bb" member_type: VOTER }
I20260709 12:27:12.246243  2185 raft_consensus.cc:385] T 00000000000000000000000000000000 P 9002fddf210845ba83d26455cfa528bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:12.246419  2185 raft_consensus.cc:740] T 00000000000000000000000000000000 P 9002fddf210845ba83d26455cfa528bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9002fddf210845ba83d26455cfa528bb, State: Initialized, Role: FOLLOWER
I20260709 12:27:12.246922  2185 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9002fddf210845ba83d26455cfa528bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9002fddf210845ba83d26455cfa528bb" member_type: VOTER }
I20260709 12:27:12.247400  2185 raft_consensus.cc:399] T 00000000000000000000000000000000 P 9002fddf210845ba83d26455cfa528bb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:27:12.247645  2185 raft_consensus.cc:493] T 00000000000000000000000000000000 P 9002fddf210845ba83d26455cfa528bb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:27:12.247861  2185 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 9002fddf210845ba83d26455cfa528bb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:12.252624  2185 raft_consensus.cc:515] T 00000000000000000000000000000000 P 9002fddf210845ba83d26455cfa528bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9002fddf210845ba83d26455cfa528bb" member_type: VOTER }
I20260709 12:27:12.253131  2185 leader_election.cc:304] T 00000000000000000000000000000000 P 9002fddf210845ba83d26455cfa528bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9002fddf210845ba83d26455cfa528bb; no voters: 
I20260709 12:27:12.254310  2185 leader_election.cc:290] T 00000000000000000000000000000000 P 9002fddf210845ba83d26455cfa528bb [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:27:12.254802  2188 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 9002fddf210845ba83d26455cfa528bb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:12.256405  2188 raft_consensus.cc:697] T 00000000000000000000000000000000 P 9002fddf210845ba83d26455cfa528bb [term 1 LEADER]: Becoming Leader. State: Replica: 9002fddf210845ba83d26455cfa528bb, State: Running, Role: LEADER
I20260709 12:27:12.257148  2188 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9002fddf210845ba83d26455cfa528bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9002fddf210845ba83d26455cfa528bb" member_type: VOTER }
I20260709 12:27:12.257859  2185 sys_catalog.cc:565] T 00000000000000000000000000000000 P 9002fddf210845ba83d26455cfa528bb [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:27:12.263091  2189 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9002fddf210845ba83d26455cfa528bb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9002fddf210845ba83d26455cfa528bb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9002fddf210845ba83d26455cfa528bb" member_type: VOTER } }
I20260709 12:27:12.263240  2190 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9002fddf210845ba83d26455cfa528bb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9002fddf210845ba83d26455cfa528bb. Latest consensus state: current_term: 1 leader_uuid: "9002fddf210845ba83d26455cfa528bb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9002fddf210845ba83d26455cfa528bb" member_type: VOTER } }
I20260709 12:27:12.264379  2190 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9002fddf210845ba83d26455cfa528bb [sys.catalog]: This master's current role is: LEADER
I20260709 12:27:12.264147  2189 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9002fddf210845ba83d26455cfa528bb [sys.catalog]: This master's current role is: LEADER
I20260709 12:27:12.272336  2194 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:27:12.277423  2194 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:27:12.278879 24534 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:27:12.287264  2194 catalog_manager.cc:1383] Generated new cluster ID: 7f0a752dab7b41848189e408a65d4ecf
I20260709 12:27:12.287597  2194 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:27:12.303366  2194 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:27:12.304731  2194 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:27:12.317006  2194 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 9002fddf210845ba83d26455cfa528bb: Generated new TSK 0
I20260709 12:27:12.317656  2194 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:27:12.345731 24534 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:12.352393  2206 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:12.353314  2207 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:12.355322  2209 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:12.356379 24534 server_base.cc:1061] running on GCE node
I20260709 12:27:12.357385 24534 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:12.357570 24534 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:12.357712 24534 hybrid_clock.cc:648] HybridClock initialized: now 1783600032357701 us; error 0 us; skew 500 ppm
I20260709 12:27:12.358191 24534 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:12.360710 24534 webserver.cc:533] Webserver started at http://127.23.245.129:33917/ using document root <none> and password file <none>
I20260709 12:27:12.361172 24534 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:12.361455 24534 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:12.361774 24534 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:12.362986 24534 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599704270295-24534-0/minicluster-data/ts-0-root/instance:
uuid: "129c763b69224d7e9b2187721e58adeb"
format_stamp: "Formatted at 2026-07-09 12:27:12 on dist-test-slave-mlt7"
I20260709 12:27:12.367470 24534 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:27:12.371053  2214 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:12.372303 24534 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:27:12.372601 24534 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599704270295-24534-0/minicluster-data/ts-0-root
uuid: "129c763b69224d7e9b2187721e58adeb"
format_stamp: "Formatted at 2026-07-09 12:27:12 on dist-test-slave-mlt7"
I20260709 12:27:12.372869 24534 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599704270295-24534-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599704270295-24534-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599704270295-24534-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:12.399847 24534 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:12.401110 24534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:12.402585 24534 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:12.404917 24534 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:12.405092 24534 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:12.405426 24534 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:12.405591 24534 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:12.447180 24534 rpc_server.cc:307] RPC server started. Bound to: 127.23.245.129:35605
I20260709 12:27:12.447306  2276 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.245.129:35605 every 8 connection(s)
I20260709 12:27:12.452239 24534 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:12.459481  2281 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:12.460542  2282 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:12.463995  2284 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:12.464368 24534 server_base.cc:1061] running on GCE node
I20260709 12:27:12.465646 24534 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:12.465876 24534 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:12.466122 24534 hybrid_clock.cc:648] HybridClock initialized: now 1783600032466095 us; error 0 us; skew 500 ppm
I20260709 12:27:12.466840 24534 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:12.469791 24534 webserver.cc:533] Webserver started at http://127.23.245.130:41659/ using document root <none> and password file <none>
I20260709 12:27:12.470394 24534 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:12.470530  2277 heartbeater.cc:344] Connected to a master server at 127.23.245.190:40151
I20260709 12:27:12.470588 24534 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:12.471099  2277 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:12.471372 24534 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:12.472049  2277 heartbeater.cc:507] Master 127.23.245.190:40151 requested a full tablet report, sending...
I20260709 12:27:12.472815 24534 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599704270295-24534-0/minicluster-data/ts-1-root/instance:
uuid: "72d4afb41b7245b4b382fb9e2c6edf59"
format_stamp: "Formatted at 2026-07-09 12:27:12 on dist-test-slave-mlt7"
I20260709 12:27:12.474514  2150 ts_manager.cc:194] Registered new tserver with Master: 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605)
I20260709 12:27:12.477085  2150 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34882
I20260709 12:27:12.478909 24534 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.003s
I20260709 12:27:12.482458  2289 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:12.483417 24534 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:27:12.483778 24534 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599704270295-24534-0/minicluster-data/ts-1-root
uuid: "72d4afb41b7245b4b382fb9e2c6edf59"
format_stamp: "Formatted at 2026-07-09 12:27:12 on dist-test-slave-mlt7"
I20260709 12:27:12.484131 24534 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599704270295-24534-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599704270295-24534-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599704270295-24534-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:12.494966 24534 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:12.496348 24534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:12.497895 24534 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:12.500213 24534 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:12.500445 24534 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:12.500685 24534 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:12.500860 24534 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:12.542431 24534 rpc_server.cc:307] RPC server started. Bound to: 127.23.245.130:42771
I20260709 12:27:12.542557  2351 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.245.130:42771 every 8 connection(s)
I20260709 12:27:12.547164 24534 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:12.554984  2355 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:12.556383  2356 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:12.561158  2358 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:12.562310  2352 heartbeater.cc:344] Connected to a master server at 127.23.245.190:40151
I20260709 12:27:12.562925  2352 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:12.564100  2352 heartbeater.cc:507] Master 127.23.245.190:40151 requested a full tablet report, sending...
I20260709 12:27:12.565865 24534 server_base.cc:1061] running on GCE node
I20260709 12:27:12.566470  2150 ts_manager.cc:194] Registered new tserver with Master: 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130:42771)
I20260709 12:27:12.566982 24534 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:12.567301 24534 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:12.567510 24534 hybrid_clock.cc:648] HybridClock initialized: now 1783600032567491 us; error 0 us; skew 500 ppm
I20260709 12:27:12.568308 24534 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:12.568387  2150 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34894
I20260709 12:27:12.571089 24534 webserver.cc:533] Webserver started at http://127.23.245.131:37455/ using document root <none> and password file <none>
I20260709 12:27:12.571538 24534 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:12.571786 24534 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:12.572149 24534 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:12.573414 24534 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599704270295-24534-0/minicluster-data/ts-2-root/instance:
uuid: "19566de89ecf48aca9903d8bfdd5d936"
format_stamp: "Formatted at 2026-07-09 12:27:12 on dist-test-slave-mlt7"
I20260709 12:27:12.578673 24534 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.002s
I20260709 12:27:12.583372  2363 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:12.584470 24534 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:27:12.584928 24534 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599704270295-24534-0/minicluster-data/ts-2-root
uuid: "19566de89ecf48aca9903d8bfdd5d936"
format_stamp: "Formatted at 2026-07-09 12:27:12 on dist-test-slave-mlt7"
I20260709 12:27:12.585427 24534 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599704270295-24534-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599704270295-24534-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599704270295-24534-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:12.611439 24534 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:12.612784 24534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:12.614302 24534 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:12.616839 24534 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:12.617084 24534 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:12.617329 24534 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:12.617503 24534 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:12.661911 24534 rpc_server.cc:307] RPC server started. Bound to: 127.23.245.131:38763
I20260709 12:27:12.662011  2425 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.245.131:38763 every 8 connection(s)
I20260709 12:27:12.676862  2426 heartbeater.cc:344] Connected to a master server at 127.23.245.190:40151
I20260709 12:27:12.677335  2426 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:12.678205  2426 heartbeater.cc:507] Master 127.23.245.190:40151 requested a full tablet report, sending...
I20260709 12:27:12.680335  2150 ts_manager.cc:194] Registered new tserver with Master: 19566de89ecf48aca9903d8bfdd5d936 (127.23.245.131:38763)
I20260709 12:27:12.681432 24534 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016074801s
I20260709 12:27:12.681875  2150 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34910
I20260709 12:27:12.709446  2150 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34912:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:27:12.712450  2150 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:27:12.806219  2242 tablet_service.cc:1511] Processing CreateTablet for tablet 1523f5077995462b83bfa389d020880b (DEFAULT_TABLE table=test-workload [id=871d869f0d77467bb9df3b9384ef542f]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:27:12.807708  2242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1523f5077995462b83bfa389d020880b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:12.808594  2317 tablet_service.cc:1511] Processing CreateTablet for tablet 1523f5077995462b83bfa389d020880b (DEFAULT_TABLE table=test-workload [id=871d869f0d77467bb9df3b9384ef542f]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:27:12.816411  2313 tablet_service.cc:1511] Processing CreateTablet for tablet 4915b590d3df467182d6ec1e3e5b7b9d (DEFAULT_TABLE table=test-workload [id=871d869f0d77467bb9df3b9384ef542f]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:27:12.816936  2317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1523f5077995462b83bfa389d020880b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:12.817767  2313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4915b590d3df467182d6ec1e3e5b7b9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:12.809403  2241 tablet_service.cc:1511] Processing CreateTablet for tablet 100dcbf9addf448bba05f170b5051802 (DEFAULT_TABLE table=test-workload [id=871d869f0d77467bb9df3b9384ef542f]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:27:12.810524  2316 tablet_service.cc:1511] Processing CreateTablet for tablet 100dcbf9addf448bba05f170b5051802 (DEFAULT_TABLE table=test-workload [id=871d869f0d77467bb9df3b9384ef542f]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:27:12.821291  2316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 100dcbf9addf448bba05f170b5051802. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:12.821117  2391 tablet_service.cc:1511] Processing CreateTablet for tablet 1523f5077995462b83bfa389d020880b (DEFAULT_TABLE table=test-workload [id=871d869f0d77467bb9df3b9384ef542f]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:27:12.812275  2315 tablet_service.cc:1511] Processing CreateTablet for tablet ea09120684274446b5c0965e6a6a9b4c (DEFAULT_TABLE table=test-workload [id=871d869f0d77467bb9df3b9384ef542f]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:27:12.822911  2391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1523f5077995462b83bfa389d020880b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:12.823453  2315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea09120684274446b5c0965e6a6a9b4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:12.824618  2390 tablet_service.cc:1511] Processing CreateTablet for tablet 100dcbf9addf448bba05f170b5051802 (DEFAULT_TABLE table=test-workload [id=871d869f0d77467bb9df3b9384ef542f]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:27:12.825666  2390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 100dcbf9addf448bba05f170b5051802. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:12.814713  2314 tablet_service.cc:1511] Processing CreateTablet for tablet d36e6c0657bd486b939805a704e580af (DEFAULT_TABLE table=test-workload [id=871d869f0d77467bb9df3b9384ef542f]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:27:12.827260  2314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d36e6c0657bd486b939805a704e580af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:12.826849  2237 tablet_service.cc:1511] Processing CreateTablet for tablet de5c5dbcf4844dab833043ea584da490 (DEFAULT_TABLE table=test-workload [id=871d869f0d77467bb9df3b9384ef542f]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:27:12.815011  2239 tablet_service.cc:1511] Processing CreateTablet for tablet d36e6c0657bd486b939805a704e580af (DEFAULT_TABLE table=test-workload [id=871d869f0d77467bb9df3b9384ef542f]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:27:12.814899  2238 tablet_service.cc:1511] Processing CreateTablet for tablet 4915b590d3df467182d6ec1e3e5b7b9d (DEFAULT_TABLE table=test-workload [id=871d869f0d77467bb9df3b9384ef542f]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:27:12.811523  2240 tablet_service.cc:1511] Processing CreateTablet for tablet ea09120684274446b5c0965e6a6a9b4c (DEFAULT_TABLE table=test-workload [id=871d869f0d77467bb9df3b9384ef542f]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:27:12.819722  2241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 100dcbf9addf448bba05f170b5051802. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:12.831079  2238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4915b590d3df467182d6ec1e3e5b7b9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:12.832007  2239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d36e6c0657bd486b939805a704e580af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:12.833056  2240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea09120684274446b5c0965e6a6a9b4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:12.833967  2237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de5c5dbcf4844dab833043ea584da490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:12.841718  2389 tablet_service.cc:1511] Processing CreateTablet for tablet ea09120684274446b5c0965e6a6a9b4c (DEFAULT_TABLE table=test-workload [id=871d869f0d77467bb9df3b9384ef542f]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:27:12.843343  2389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea09120684274446b5c0965e6a6a9b4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:12.844480  2236 tablet_service.cc:1511] Processing CreateTablet for tablet a4decfc5493a43e9bb1dca65d85388e7 (DEFAULT_TABLE table=test-workload [id=871d869f0d77467bb9df3b9384ef542f]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:27:12.845969  2236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4decfc5493a43e9bb1dca65d85388e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:12.846045  2388 tablet_service.cc:1511] Processing CreateTablet for tablet d36e6c0657bd486b939805a704e580af (DEFAULT_TABLE table=test-workload [id=871d869f0d77467bb9df3b9384ef542f]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:27:12.847637  2388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d36e6c0657bd486b939805a704e580af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:12.850081  2235 tablet_service.cc:1511] Processing CreateTablet for tablet 1797eb20c76642c3912213b96a0156bb (DEFAULT_TABLE table=test-workload [id=871d869f0d77467bb9df3b9384ef542f]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:27:12.850162  2387 tablet_service.cc:1511] Processing CreateTablet for tablet 4915b590d3df467182d6ec1e3e5b7b9d (DEFAULT_TABLE table=test-workload [id=871d869f0d77467bb9df3b9384ef542f]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:27:12.852759  2386 tablet_service.cc:1511] Processing CreateTablet for tablet de5c5dbcf4844dab833043ea584da490 (DEFAULT_TABLE table=test-workload [id=871d869f0d77467bb9df3b9384ef542f]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:27:12.853878  2387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4915b590d3df467182d6ec1e3e5b7b9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:12.856252  2235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1797eb20c76642c3912213b96a0156bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:12.860859  2384 tablet_service.cc:1511] Processing CreateTablet for tablet 1797eb20c76642c3912213b96a0156bb (DEFAULT_TABLE table=test-workload [id=871d869f0d77467bb9df3b9384ef542f]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:27:12.862623  2385 tablet_service.cc:1511] Processing CreateTablet for tablet a4decfc5493a43e9bb1dca65d85388e7 (DEFAULT_TABLE table=test-workload [id=871d869f0d77467bb9df3b9384ef542f]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:27:12.864984  2386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de5c5dbcf4844dab833043ea584da490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:12.868736  2385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4decfc5493a43e9bb1dca65d85388e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:12.873865  2384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1797eb20c76642c3912213b96a0156bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:12.884922  2234 tablet_service.cc:1511] Processing CreateTablet for tablet 372666c8d7a84b429fe9df7c121e0bcf (DEFAULT_TABLE table=test-workload [id=871d869f0d77467bb9df3b9384ef542f]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:27:12.887003  2234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 372666c8d7a84b429fe9df7c121e0bcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:12.890153  2311 tablet_service.cc:1511] Processing CreateTablet for tablet a4decfc5493a43e9bb1dca65d85388e7 (DEFAULT_TABLE table=test-workload [id=871d869f0d77467bb9df3b9384ef542f]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:27:12.891674  2311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4decfc5493a43e9bb1dca65d85388e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:12.899726  2312 tablet_service.cc:1511] Processing CreateTablet for tablet de5c5dbcf4844dab833043ea584da490 (DEFAULT_TABLE table=test-workload [id=871d869f0d77467bb9df3b9384ef542f]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:27:12.902030  2312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de5c5dbcf4844dab833043ea584da490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:12.905867  2310 tablet_service.cc:1511] Processing CreateTablet for tablet 1797eb20c76642c3912213b96a0156bb (DEFAULT_TABLE table=test-workload [id=871d869f0d77467bb9df3b9384ef542f]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:27:12.908171  2310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1797eb20c76642c3912213b96a0156bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:12.913842  2309 tablet_service.cc:1511] Processing CreateTablet for tablet 372666c8d7a84b429fe9df7c121e0bcf (DEFAULT_TABLE table=test-workload [id=871d869f0d77467bb9df3b9384ef542f]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:27:12.915432  2309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 372666c8d7a84b429fe9df7c121e0bcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:12.960758  2441 tablet_bootstrap.cc:492] T ea09120684274446b5c0965e6a6a9b4c P 129c763b69224d7e9b2187721e58adeb: Bootstrap starting.
I20260709 12:27:12.961911  2383 tablet_service.cc:1511] Processing CreateTablet for tablet 372666c8d7a84b429fe9df7c121e0bcf (DEFAULT_TABLE table=test-workload [id=871d869f0d77467bb9df3b9384ef542f]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:27:12.963459  2383 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 372666c8d7a84b429fe9df7c121e0bcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:12.991086  2443 tablet_bootstrap.cc:492] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59: Bootstrap starting.
I20260709 12:27:12.981400  2238 tablet_service.cc:1511] Processing CreateTablet for tablet cb73a7a0e4004a1bbab977eb0c11d8dd (DEFAULT_TABLE table=test-workload [id=871d869f0d77467bb9df3b9384ef542f]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:27:13.009217  2443 tablet_bootstrap.cc:654] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:13.010061  2238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb73a7a0e4004a1bbab977eb0c11d8dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:12.997480  2308 tablet_service.cc:1511] Processing CreateTablet for tablet cb73a7a0e4004a1bbab977eb0c11d8dd (DEFAULT_TABLE table=test-workload [id=871d869f0d77467bb9df3b9384ef542f]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:27:13.011212  2308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb73a7a0e4004a1bbab977eb0c11d8dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:13.021828  2442 tablet_bootstrap.cc:492] T de5c5dbcf4844dab833043ea584da490 P 19566de89ecf48aca9903d8bfdd5d936: Bootstrap starting.
I20260709 12:27:13.022542  2386 tablet_service.cc:1511] Processing CreateTablet for tablet cb73a7a0e4004a1bbab977eb0c11d8dd (DEFAULT_TABLE table=test-workload [id=871d869f0d77467bb9df3b9384ef542f]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:27:13.023900  2386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb73a7a0e4004a1bbab977eb0c11d8dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:13.028584  2442 tablet_bootstrap.cc:654] T de5c5dbcf4844dab833043ea584da490 P 19566de89ecf48aca9903d8bfdd5d936: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:13.058822  2443 tablet_bootstrap.cc:492] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59: No bootstrap required, opened a new log
I20260709 12:27:13.059369  2443 ts_tablet_manager.cc:1403] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59: Time spent bootstrapping tablet: real 0.069s	user 0.022s	sys 0.008s
I20260709 12:27:13.059404  2441 tablet_bootstrap.cc:654] T ea09120684274446b5c0965e6a6a9b4c P 129c763b69224d7e9b2187721e58adeb: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:13.065186  2443 raft_consensus.cc:359] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.065946  2443 raft_consensus.cc:385] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:13.066253  2443 raft_consensus.cc:740] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d4afb41b7245b4b382fb9e2c6edf59, State: Initialized, Role: FOLLOWER
I20260709 12:27:13.066373  2442 tablet_bootstrap.cc:492] T de5c5dbcf4844dab833043ea584da490 P 19566de89ecf48aca9903d8bfdd5d936: No bootstrap required, opened a new log
I20260709 12:27:13.066915  2442 ts_tablet_manager.cc:1403] T de5c5dbcf4844dab833043ea584da490 P 19566de89ecf48aca9903d8bfdd5d936: Time spent bootstrapping tablet: real 0.045s	user 0.013s	sys 0.019s
I20260709 12:27:13.067046  2443 consensus_queue.cc:260] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.069932  2442 raft_consensus.cc:359] T de5c5dbcf4844dab833043ea584da490 P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.070799  2442 raft_consensus.cc:385] T de5c5dbcf4844dab833043ea584da490 P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:13.071108  2442 raft_consensus.cc:740] T de5c5dbcf4844dab833043ea584da490 P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19566de89ecf48aca9903d8bfdd5d936, State: Initialized, Role: FOLLOWER
I20260709 12:27:13.072784  2442 consensus_queue.cc:260] T de5c5dbcf4844dab833043ea584da490 P 19566de89ecf48aca9903d8bfdd5d936 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.082590  2441 tablet_bootstrap.cc:492] T ea09120684274446b5c0965e6a6a9b4c P 129c763b69224d7e9b2187721e58adeb: No bootstrap required, opened a new log
I20260709 12:27:13.083611  2441 ts_tablet_manager.cc:1403] T ea09120684274446b5c0965e6a6a9b4c P 129c763b69224d7e9b2187721e58adeb: Time spent bootstrapping tablet: real 0.123s	user 0.005s	sys 0.012s
I20260709 12:27:13.087199  2441 raft_consensus.cc:359] T ea09120684274446b5c0965e6a6a9b4c P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.088011  2352 heartbeater.cc:499] Master 127.23.245.190:40151 was elected leader, sending a full tablet report...
I20260709 12:27:13.088469  2441 raft_consensus.cc:385] T ea09120684274446b5c0965e6a6a9b4c P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:13.088855  2441 raft_consensus.cc:740] T ea09120684274446b5c0965e6a6a9b4c P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 129c763b69224d7e9b2187721e58adeb, State: Initialized, Role: FOLLOWER
I20260709 12:27:13.089813  2441 consensus_queue.cc:260] T ea09120684274446b5c0965e6a6a9b4c P 129c763b69224d7e9b2187721e58adeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.092165  2426 heartbeater.cc:499] Master 127.23.245.190:40151 was elected leader, sending a full tablet report...
I20260709 12:27:13.092587  2442 ts_tablet_manager.cc:1434] T de5c5dbcf4844dab833043ea584da490 P 19566de89ecf48aca9903d8bfdd5d936: Time spent starting tablet: real 0.025s	user 0.011s	sys 0.002s
I20260709 12:27:13.093658  2442 tablet_bootstrap.cc:492] T 100dcbf9addf448bba05f170b5051802 P 19566de89ecf48aca9903d8bfdd5d936: Bootstrap starting.
I20260709 12:27:13.100175  2441 ts_tablet_manager.cc:1434] T ea09120684274446b5c0965e6a6a9b4c P 129c763b69224d7e9b2187721e58adeb: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.002s
I20260709 12:27:13.101003  2277 heartbeater.cc:499] Master 127.23.245.190:40151 was elected leader, sending a full tablet report...
I20260709 12:27:13.101346  2442 tablet_bootstrap.cc:654] T 100dcbf9addf448bba05f170b5051802 P 19566de89ecf48aca9903d8bfdd5d936: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:13.087990  2443 ts_tablet_manager.cc:1434] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.000s
I20260709 12:27:13.103057  2443 tablet_bootstrap.cc:492] T 1797eb20c76642c3912213b96a0156bb P 72d4afb41b7245b4b382fb9e2c6edf59: Bootstrap starting.
I20260709 12:27:13.104907  2441 tablet_bootstrap.cc:492] T 4915b590d3df467182d6ec1e3e5b7b9d P 129c763b69224d7e9b2187721e58adeb: Bootstrap starting.
I20260709 12:27:13.112258  2441 tablet_bootstrap.cc:654] T 4915b590d3df467182d6ec1e3e5b7b9d P 129c763b69224d7e9b2187721e58adeb: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:13.112413  2443 tablet_bootstrap.cc:654] T 1797eb20c76642c3912213b96a0156bb P 72d4afb41b7245b4b382fb9e2c6edf59: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:13.119349  2442 tablet_bootstrap.cc:492] T 100dcbf9addf448bba05f170b5051802 P 19566de89ecf48aca9903d8bfdd5d936: No bootstrap required, opened a new log
I20260709 12:27:13.120071  2442 ts_tablet_manager.cc:1403] T 100dcbf9addf448bba05f170b5051802 P 19566de89ecf48aca9903d8bfdd5d936: Time spent bootstrapping tablet: real 0.027s	user 0.022s	sys 0.003s
I20260709 12:27:13.122359  2441 tablet_bootstrap.cc:492] T 4915b590d3df467182d6ec1e3e5b7b9d P 129c763b69224d7e9b2187721e58adeb: No bootstrap required, opened a new log
I20260709 12:27:13.122668  2443 tablet_bootstrap.cc:492] T 1797eb20c76642c3912213b96a0156bb P 72d4afb41b7245b4b382fb9e2c6edf59: No bootstrap required, opened a new log
I20260709 12:27:13.122947  2441 ts_tablet_manager.cc:1403] T 4915b590d3df467182d6ec1e3e5b7b9d P 129c763b69224d7e9b2187721e58adeb: Time spent bootstrapping tablet: real 0.018s	user 0.005s	sys 0.010s
I20260709 12:27:13.123178  2443 ts_tablet_manager.cc:1403] T 1797eb20c76642c3912213b96a0156bb P 72d4afb41b7245b4b382fb9e2c6edf59: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.000s
I20260709 12:27:13.123513  2442 raft_consensus.cc:359] T 100dcbf9addf448bba05f170b5051802 P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.124601  2442 raft_consensus.cc:385] T 100dcbf9addf448bba05f170b5051802 P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:13.124981  2442 raft_consensus.cc:740] T 100dcbf9addf448bba05f170b5051802 P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19566de89ecf48aca9903d8bfdd5d936, State: Initialized, Role: FOLLOWER
I20260709 12:27:13.125967  2442 consensus_queue.cc:260] T 100dcbf9addf448bba05f170b5051802 P 19566de89ecf48aca9903d8bfdd5d936 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.126049  2443 raft_consensus.cc:359] T 1797eb20c76642c3912213b96a0156bb P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.127049  2443 raft_consensus.cc:385] T 1797eb20c76642c3912213b96a0156bb P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:13.127372  2443 raft_consensus.cc:740] T 1797eb20c76642c3912213b96a0156bb P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d4afb41b7245b4b382fb9e2c6edf59, State: Initialized, Role: FOLLOWER
I20260709 12:27:13.128152  2443 consensus_queue.cc:260] T 1797eb20c76642c3912213b96a0156bb P 72d4afb41b7245b4b382fb9e2c6edf59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.129379  2442 ts_tablet_manager.cc:1434] T 100dcbf9addf448bba05f170b5051802 P 19566de89ecf48aca9903d8bfdd5d936: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 12:27:13.130362  2443 ts_tablet_manager.cc:1434] T 1797eb20c76642c3912213b96a0156bb P 72d4afb41b7245b4b382fb9e2c6edf59: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:27:13.130388  2442 tablet_bootstrap.cc:492] T a4decfc5493a43e9bb1dca65d85388e7 P 19566de89ecf48aca9903d8bfdd5d936: Bootstrap starting.
I20260709 12:27:13.126235  2441 raft_consensus.cc:359] T 4915b590d3df467182d6ec1e3e5b7b9d P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.131708  2443 tablet_bootstrap.cc:492] T 1523f5077995462b83bfa389d020880b P 72d4afb41b7245b4b382fb9e2c6edf59: Bootstrap starting.
I20260709 12:27:13.132365  2441 raft_consensus.cc:385] T 4915b590d3df467182d6ec1e3e5b7b9d P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:13.132783  2441 raft_consensus.cc:740] T 4915b590d3df467182d6ec1e3e5b7b9d P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 129c763b69224d7e9b2187721e58adeb, State: Initialized, Role: FOLLOWER
I20260709 12:27:13.133785  2441 consensus_queue.cc:260] T 4915b590d3df467182d6ec1e3e5b7b9d P 129c763b69224d7e9b2187721e58adeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.138343  2442 tablet_bootstrap.cc:654] T a4decfc5493a43e9bb1dca65d85388e7 P 19566de89ecf48aca9903d8bfdd5d936: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:13.139698  2443 tablet_bootstrap.cc:654] T 1523f5077995462b83bfa389d020880b P 72d4afb41b7245b4b382fb9e2c6edf59: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:13.143092  2441 ts_tablet_manager.cc:1434] T 4915b590d3df467182d6ec1e3e5b7b9d P 129c763b69224d7e9b2187721e58adeb: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.003s
I20260709 12:27:13.145924  2441 tablet_bootstrap.cc:492] T de5c5dbcf4844dab833043ea584da490 P 129c763b69224d7e9b2187721e58adeb: Bootstrap starting.
I20260709 12:27:13.155602  2441 tablet_bootstrap.cc:654] T de5c5dbcf4844dab833043ea584da490 P 129c763b69224d7e9b2187721e58adeb: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:13.164158  2447 raft_consensus.cc:493] T 1797eb20c76642c3912213b96a0156bb P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.164783  2447 raft_consensus.cc:515] T 1797eb20c76642c3912213b96a0156bb P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
W20260709 12:27:13.166489  2427 tablet.cc:2406] T 100dcbf9addf448bba05f170b5051802 P 19566de89ecf48aca9903d8bfdd5d936: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:27:13.170984  2447 leader_election.cc:290] T 1797eb20c76642c3912213b96a0156bb P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605), 19566de89ecf48aca9903d8bfdd5d936 (127.23.245.131:38763)
I20260709 12:27:13.189414  2441 tablet_bootstrap.cc:492] T de5c5dbcf4844dab833043ea584da490 P 129c763b69224d7e9b2187721e58adeb: No bootstrap required, opened a new log
I20260709 12:27:13.190189  2441 ts_tablet_manager.cc:1403] T de5c5dbcf4844dab833043ea584da490 P 129c763b69224d7e9b2187721e58adeb: Time spent bootstrapping tablet: real 0.045s	user 0.021s	sys 0.007s
I20260709 12:27:13.193878  2441 raft_consensus.cc:359] T de5c5dbcf4844dab833043ea584da490 P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.194743  2441 raft_consensus.cc:385] T de5c5dbcf4844dab833043ea584da490 P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:13.195127  2441 raft_consensus.cc:740] T de5c5dbcf4844dab833043ea584da490 P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 129c763b69224d7e9b2187721e58adeb, State: Initialized, Role: FOLLOWER
I20260709 12:27:13.196991  2442 tablet_bootstrap.cc:492] T a4decfc5493a43e9bb1dca65d85388e7 P 19566de89ecf48aca9903d8bfdd5d936: No bootstrap required, opened a new log
I20260709 12:27:13.196440  2441 consensus_queue.cc:260] T de5c5dbcf4844dab833043ea584da490 P 129c763b69224d7e9b2187721e58adeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.197937  2442 ts_tablet_manager.cc:1403] T a4decfc5493a43e9bb1dca65d85388e7 P 19566de89ecf48aca9903d8bfdd5d936: Time spent bootstrapping tablet: real 0.068s	user 0.031s	sys 0.014s
I20260709 12:27:13.198976  2449 raft_consensus.cc:493] T ea09120684274446b5c0965e6a6a9b4c P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.199575  2449 raft_consensus.cc:515] T ea09120684274446b5c0965e6a6a9b4c P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.202008  2442 raft_consensus.cc:359] T a4decfc5493a43e9bb1dca65d85388e7 P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.203408  2442 raft_consensus.cc:385] T a4decfc5493a43e9bb1dca65d85388e7 P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:13.203845  2442 raft_consensus.cc:740] T a4decfc5493a43e9bb1dca65d85388e7 P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19566de89ecf48aca9903d8bfdd5d936, State: Initialized, Role: FOLLOWER
I20260709 12:27:13.205181  2442 consensus_queue.cc:260] T a4decfc5493a43e9bb1dca65d85388e7 P 19566de89ecf48aca9903d8bfdd5d936 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.208125  2442 ts_tablet_manager.cc:1434] T a4decfc5493a43e9bb1dca65d85388e7 P 19566de89ecf48aca9903d8bfdd5d936: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.003s
I20260709 12:27:13.209445  2442 tablet_bootstrap.cc:492] T 1797eb20c76642c3912213b96a0156bb P 19566de89ecf48aca9903d8bfdd5d936: Bootstrap starting.
I20260709 12:27:13.211398  2448 raft_consensus.cc:493] T a4decfc5493a43e9bb1dca65d85388e7 P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.212983  2448 raft_consensus.cc:515] T a4decfc5493a43e9bb1dca65d85388e7 P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.213073  2449 leader_election.cc:290] T ea09120684274446b5c0965e6a6a9b4c P 129c763b69224d7e9b2187721e58adeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130:42771), 19566de89ecf48aca9903d8bfdd5d936 (127.23.245.131:38763)
I20260709 12:27:13.215080  2441 ts_tablet_manager.cc:1434] T de5c5dbcf4844dab833043ea584da490 P 129c763b69224d7e9b2187721e58adeb: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.001s
I20260709 12:27:13.219069  2447 raft_consensus.cc:493] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.219830  2447 raft_consensus.cc:515] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.223040  2447 leader_election.cc:290] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605), 19566de89ecf48aca9903d8bfdd5d936 (127.23.245.131:38763)
I20260709 12:27:13.223323  2441 tablet_bootstrap.cc:492] T 1523f5077995462b83bfa389d020880b P 129c763b69224d7e9b2187721e58adeb: Bootstrap starting.
I20260709 12:27:13.226974  2448 leader_election.cc:290] T a4decfc5493a43e9bb1dca65d85388e7 P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605), 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130:42771)
I20260709 12:27:13.198964  2443 tablet_bootstrap.cc:492] T 1523f5077995462b83bfa389d020880b P 72d4afb41b7245b4b382fb9e2c6edf59: No bootstrap required, opened a new log
I20260709 12:27:13.228673  2443 ts_tablet_manager.cc:1403] T 1523f5077995462b83bfa389d020880b P 72d4afb41b7245b4b382fb9e2c6edf59: Time spent bootstrapping tablet: real 0.097s	user 0.026s	sys 0.029s
I20260709 12:27:13.227713  2448 raft_consensus.cc:493] T 100dcbf9addf448bba05f170b5051802 P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.229842  2448 raft_consensus.cc:515] T 100dcbf9addf448bba05f170b5051802 P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.232470  2443 raft_consensus.cc:359] T 1523f5077995462b83bfa389d020880b P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.233453  2443 raft_consensus.cc:385] T 1523f5077995462b83bfa389d020880b P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:13.233822  2443 raft_consensus.cc:740] T 1523f5077995462b83bfa389d020880b P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d4afb41b7245b4b382fb9e2c6edf59, State: Initialized, Role: FOLLOWER
I20260709 12:27:13.234730  2443 consensus_queue.cc:260] T 1523f5077995462b83bfa389d020880b P 72d4afb41b7245b4b382fb9e2c6edf59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.235402  2448 leader_election.cc:290] T 100dcbf9addf448bba05f170b5051802 P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605), 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130:42771)
I20260709 12:27:13.236534  2441 tablet_bootstrap.cc:654] T 1523f5077995462b83bfa389d020880b P 129c763b69224d7e9b2187721e58adeb: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:13.250559  2401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1797eb20c76642c3912213b96a0156bb" candidate_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19566de89ecf48aca9903d8bfdd5d936" is_pre_election: true
I20260709 12:27:13.251264  2442 tablet_bootstrap.cc:654] T 1797eb20c76642c3912213b96a0156bb P 19566de89ecf48aca9903d8bfdd5d936: Neither blocks nor log segments found. Creating new log.
W20260709 12:27:13.252800  2292 leader_election.cc:343] T 1797eb20c76642c3912213b96a0156bb P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 19566de89ecf48aca9903d8bfdd5d936 (127.23.245.131:38763): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:13.253804  2401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372666c8d7a84b429fe9df7c121e0bcf" candidate_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19566de89ecf48aca9903d8bfdd5d936" is_pre_election: true
I20260709 12:27:13.256737  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1797eb20c76642c3912213b96a0156bb" candidate_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "129c763b69224d7e9b2187721e58adeb" is_pre_election: true
I20260709 12:27:13.257292  2251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372666c8d7a84b429fe9df7c121e0bcf" candidate_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "129c763b69224d7e9b2187721e58adeb" is_pre_election: true
W20260709 12:27:13.257337  2292 leader_election.cc:343] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 19566de89ecf48aca9903d8bfdd5d936 (127.23.245.131:38763): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:13.259678  2290 leader_election.cc:343] T 1797eb20c76642c3912213b96a0156bb P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:13.259904  2251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4decfc5493a43e9bb1dca65d85388e7" candidate_uuid: "19566de89ecf48aca9903d8bfdd5d936" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "129c763b69224d7e9b2187721e58adeb" is_pre_election: true
I20260709 12:27:13.260380  2290 leader_election.cc:304] T 1797eb20c76642c3912213b96a0156bb P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d4afb41b7245b4b382fb9e2c6edf59; no voters: 129c763b69224d7e9b2187721e58adeb, 19566de89ecf48aca9903d8bfdd5d936
I20260709 12:27:13.263875  2251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "100dcbf9addf448bba05f170b5051802" candidate_uuid: "19566de89ecf48aca9903d8bfdd5d936" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "129c763b69224d7e9b2187721e58adeb" is_pre_election: true
W20260709 12:27:13.265120  2364 leader_election.cc:343] T a4decfc5493a43e9bb1dca65d85388e7 P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:13.265306  2447 raft_consensus.cc:2749] T 1797eb20c76642c3912213b96a0156bb P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:27:13.265878  2364 leader_election.cc:343] T 100dcbf9addf448bba05f170b5051802 P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:13.265120  2443 ts_tablet_manager.cc:1434] T 1523f5077995462b83bfa389d020880b P 72d4afb41b7245b4b382fb9e2c6edf59: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
W20260709 12:27:13.266767  2290 leader_election.cc:343] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:13.269991  2401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09120684274446b5c0965e6a6a9b4c" candidate_uuid: "129c763b69224d7e9b2187721e58adeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19566de89ecf48aca9903d8bfdd5d936" is_pre_election: true
I20260709 12:27:13.270944  2443 tablet_bootstrap.cc:492] T de5c5dbcf4844dab833043ea584da490 P 72d4afb41b7245b4b382fb9e2c6edf59: Bootstrap starting.
W20260709 12:27:13.272779  2198 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:13.270363  2290 leader_election.cc:304] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d4afb41b7245b4b382fb9e2c6edf59; no voters: 129c763b69224d7e9b2187721e58adeb, 19566de89ecf48aca9903d8bfdd5d936
I20260709 12:27:13.274224  2447 raft_consensus.cc:2749] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:13.277084  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4decfc5493a43e9bb1dca65d85388e7" candidate_uuid: "19566de89ecf48aca9903d8bfdd5d936" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" is_pre_election: true
I20260709 12:27:13.278064  2443 tablet_bootstrap.cc:654] T de5c5dbcf4844dab833043ea584da490 P 72d4afb41b7245b4b382fb9e2c6edf59: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:13.278614  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "100dcbf9addf448bba05f170b5051802" candidate_uuid: "19566de89ecf48aca9903d8bfdd5d936" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" is_pre_election: true
W20260709 12:27:13.280705  2217 leader_election.cc:343] T ea09120684274446b5c0965e6a6a9b4c P 129c763b69224d7e9b2187721e58adeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 19566de89ecf48aca9903d8bfdd5d936 (127.23.245.131:38763): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:13.280833  2367 leader_election.cc:343] T a4decfc5493a43e9bb1dca65d85388e7 P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130:42771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:13.281529  2367 leader_election.cc:304] T a4decfc5493a43e9bb1dca65d85388e7 P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19566de89ecf48aca9903d8bfdd5d936; no voters: 129c763b69224d7e9b2187721e58adeb, 72d4afb41b7245b4b382fb9e2c6edf59
I20260709 12:27:13.282434  2448 raft_consensus.cc:493] T de5c5dbcf4844dab833043ea584da490 P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.283066  2462 raft_consensus.cc:2749] T a4decfc5493a43e9bb1dca65d85388e7 P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:13.283084  2448 raft_consensus.cc:515] T de5c5dbcf4844dab833043ea584da490 P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.286850  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09120684274446b5c0965e6a6a9b4c" candidate_uuid: "129c763b69224d7e9b2187721e58adeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" is_pre_election: true
I20260709 12:27:13.287209  2448 leader_election.cc:290] T de5c5dbcf4844dab833043ea584da490 P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605), 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130:42771)
W20260709 12:27:13.289278  2367 leader_election.cc:343] T 100dcbf9addf448bba05f170b5051802 P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130:42771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:13.289659  2251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5c5dbcf4844dab833043ea584da490" candidate_uuid: "19566de89ecf48aca9903d8bfdd5d936" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "129c763b69224d7e9b2187721e58adeb" is_pre_election: true
I20260709 12:27:13.289707  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5c5dbcf4844dab833043ea584da490" candidate_uuid: "19566de89ecf48aca9903d8bfdd5d936" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" is_pre_election: true
I20260709 12:27:13.289868  2367 leader_election.cc:304] T 100dcbf9addf448bba05f170b5051802 P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19566de89ecf48aca9903d8bfdd5d936; no voters: 129c763b69224d7e9b2187721e58adeb, 72d4afb41b7245b4b382fb9e2c6edf59
I20260709 12:27:13.290757  2251 raft_consensus.cc:2468] T de5c5dbcf4844dab833043ea584da490 P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19566de89ecf48aca9903d8bfdd5d936 in term 0.
I20260709 12:27:13.291775  2448 raft_consensus.cc:2749] T 100dcbf9addf448bba05f170b5051802 P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:27:13.292728  2218 leader_election.cc:343] T ea09120684274446b5c0965e6a6a9b4c P 129c763b69224d7e9b2187721e58adeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130:42771): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:13.292569  2367 leader_election.cc:343] T de5c5dbcf4844dab833043ea584da490 P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130:42771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:13.293987  2218 leader_election.cc:304] T ea09120684274446b5c0965e6a6a9b4c P 129c763b69224d7e9b2187721e58adeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 129c763b69224d7e9b2187721e58adeb; no voters: 19566de89ecf48aca9903d8bfdd5d936, 72d4afb41b7245b4b382fb9e2c6edf59
I20260709 12:27:13.294899  2458 raft_consensus.cc:2749] T ea09120684274446b5c0965e6a6a9b4c P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:13.295529  2364 leader_election.cc:304] T de5c5dbcf4844dab833043ea584da490 P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 129c763b69224d7e9b2187721e58adeb, 19566de89ecf48aca9903d8bfdd5d936; no voters: 72d4afb41b7245b4b382fb9e2c6edf59
I20260709 12:27:13.296788  2448 raft_consensus.cc:2804] T de5c5dbcf4844dab833043ea584da490 P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:13.296976  2443 tablet_bootstrap.cc:492] T de5c5dbcf4844dab833043ea584da490 P 72d4afb41b7245b4b382fb9e2c6edf59: No bootstrap required, opened a new log
I20260709 12:27:13.297169  2448 raft_consensus.cc:493] T de5c5dbcf4844dab833043ea584da490 P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:13.297538  2448 raft_consensus.cc:3060] T de5c5dbcf4844dab833043ea584da490 P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:13.297586  2443 ts_tablet_manager.cc:1403] T de5c5dbcf4844dab833043ea584da490 P 72d4afb41b7245b4b382fb9e2c6edf59: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.002s
I20260709 12:27:13.300889  2443 raft_consensus.cc:359] T de5c5dbcf4844dab833043ea584da490 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.301614  2443 raft_consensus.cc:385] T de5c5dbcf4844dab833043ea584da490 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:13.301908  2443 raft_consensus.cc:740] T de5c5dbcf4844dab833043ea584da490 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d4afb41b7245b4b382fb9e2c6edf59, State: Initialized, Role: FOLLOWER
I20260709 12:27:13.302735  2443 consensus_queue.cc:260] T de5c5dbcf4844dab833043ea584da490 P 72d4afb41b7245b4b382fb9e2c6edf59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.305522  2443 ts_tablet_manager.cc:1434] T de5c5dbcf4844dab833043ea584da490 P 72d4afb41b7245b4b382fb9e2c6edf59: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:27:13.306049  2448 raft_consensus.cc:515] T de5c5dbcf4844dab833043ea584da490 P 19566de89ecf48aca9903d8bfdd5d936 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.306833  2443 tablet_bootstrap.cc:492] T 100dcbf9addf448bba05f170b5051802 P 72d4afb41b7245b4b382fb9e2c6edf59: Bootstrap starting.
I20260709 12:27:13.303406  2442 tablet_bootstrap.cc:492] T 1797eb20c76642c3912213b96a0156bb P 19566de89ecf48aca9903d8bfdd5d936: No bootstrap required, opened a new log
I20260709 12:27:13.308552  2442 ts_tablet_manager.cc:1403] T 1797eb20c76642c3912213b96a0156bb P 19566de89ecf48aca9903d8bfdd5d936: Time spent bootstrapping tablet: real 0.099s	user 0.024s	sys 0.006s
I20260709 12:27:13.308991  2251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5c5dbcf4844dab833043ea584da490" candidate_uuid: "19566de89ecf48aca9903d8bfdd5d936" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "129c763b69224d7e9b2187721e58adeb"
I20260709 12:27:13.309634  2251 raft_consensus.cc:3060] T de5c5dbcf4844dab833043ea584da490 P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:13.312822  2448 leader_election.cc:290] T de5c5dbcf4844dab833043ea584da490 P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 1 election: Requested vote from peers 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605), 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130:42771)
I20260709 12:27:13.313848  2442 raft_consensus.cc:359] T 1797eb20c76642c3912213b96a0156bb P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.314620  2442 raft_consensus.cc:385] T 1797eb20c76642c3912213b96a0156bb P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:13.314453  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5c5dbcf4844dab833043ea584da490" candidate_uuid: "19566de89ecf48aca9903d8bfdd5d936" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d4afb41b7245b4b382fb9e2c6edf59"
I20260709 12:27:13.315116  2442 raft_consensus.cc:740] T 1797eb20c76642c3912213b96a0156bb P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19566de89ecf48aca9903d8bfdd5d936, State: Initialized, Role: FOLLOWER
I20260709 12:27:13.315454  2326 raft_consensus.cc:3060] T de5c5dbcf4844dab833043ea584da490 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:13.315987  2442 consensus_queue.cc:260] T 1797eb20c76642c3912213b96a0156bb P 19566de89ecf48aca9903d8bfdd5d936 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.318886  2442 ts_tablet_manager.cc:1434] T 1797eb20c76642c3912213b96a0156bb P 19566de89ecf48aca9903d8bfdd5d936: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:27:13.319936  2442 tablet_bootstrap.cc:492] T d36e6c0657bd486b939805a704e580af P 19566de89ecf48aca9903d8bfdd5d936: Bootstrap starting.
I20260709 12:27:13.323984  2251 raft_consensus.cc:2468] T de5c5dbcf4844dab833043ea584da490 P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19566de89ecf48aca9903d8bfdd5d936 in term 1.
I20260709 12:27:13.324229  2326 raft_consensus.cc:2468] T de5c5dbcf4844dab833043ea584da490 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19566de89ecf48aca9903d8bfdd5d936 in term 1.
I20260709 12:27:13.325356  2364 leader_election.cc:304] T de5c5dbcf4844dab833043ea584da490 P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 129c763b69224d7e9b2187721e58adeb, 19566de89ecf48aca9903d8bfdd5d936; no voters: 
I20260709 12:27:13.326123  2442 tablet_bootstrap.cc:654] T d36e6c0657bd486b939805a704e580af P 19566de89ecf48aca9903d8bfdd5d936: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:13.326538  2448 raft_consensus.cc:2804] T de5c5dbcf4844dab833043ea584da490 P 19566de89ecf48aca9903d8bfdd5d936 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:13.327098  2448 raft_consensus.cc:697] T de5c5dbcf4844dab833043ea584da490 P 19566de89ecf48aca9903d8bfdd5d936 [term 1 LEADER]: Becoming Leader. State: Replica: 19566de89ecf48aca9903d8bfdd5d936, State: Running, Role: LEADER
I20260709 12:27:13.327989  2448 consensus_queue.cc:237] T de5c5dbcf4844dab833043ea584da490 P 19566de89ecf48aca9903d8bfdd5d936 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.337666  2441 tablet_bootstrap.cc:492] T 1523f5077995462b83bfa389d020880b P 129c763b69224d7e9b2187721e58adeb: No bootstrap required, opened a new log
I20260709 12:27:13.338160  2441 ts_tablet_manager.cc:1403] T 1523f5077995462b83bfa389d020880b P 129c763b69224d7e9b2187721e58adeb: Time spent bootstrapping tablet: real 0.119s	user 0.018s	sys 0.034s
I20260709 12:27:13.340003  2442 tablet_bootstrap.cc:492] T d36e6c0657bd486b939805a704e580af P 19566de89ecf48aca9903d8bfdd5d936: No bootstrap required, opened a new log
I20260709 12:27:13.340571  2442 ts_tablet_manager.cc:1403] T d36e6c0657bd486b939805a704e580af P 19566de89ecf48aca9903d8bfdd5d936: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.008s
I20260709 12:27:13.341110  2443 tablet_bootstrap.cc:654] T 100dcbf9addf448bba05f170b5051802 P 72d4afb41b7245b4b382fb9e2c6edf59: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:13.341260  2441 raft_consensus.cc:359] T 1523f5077995462b83bfa389d020880b P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.342161  2441 raft_consensus.cc:385] T 1523f5077995462b83bfa389d020880b P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:13.342489  2441 raft_consensus.cc:740] T 1523f5077995462b83bfa389d020880b P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 129c763b69224d7e9b2187721e58adeb, State: Initialized, Role: FOLLOWER
I20260709 12:27:13.341668  2149 catalog_manager.cc:5697] T de5c5dbcf4844dab833043ea584da490 P 19566de89ecf48aca9903d8bfdd5d936 reported cstate change: term changed from 0 to 1, leader changed from <none> to 19566de89ecf48aca9903d8bfdd5d936 (127.23.245.131). New cstate: current_term: 1 leader_uuid: "19566de89ecf48aca9903d8bfdd5d936" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:13.343434  2441 consensus_queue.cc:260] T 1523f5077995462b83bfa389d020880b P 129c763b69224d7e9b2187721e58adeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.343613  2442 raft_consensus.cc:359] T d36e6c0657bd486b939805a704e580af P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.344730  2442 raft_consensus.cc:385] T d36e6c0657bd486b939805a704e580af P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:13.345109  2442 raft_consensus.cc:740] T d36e6c0657bd486b939805a704e580af P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19566de89ecf48aca9903d8bfdd5d936, State: Initialized, Role: FOLLOWER
I20260709 12:27:13.346267  2442 consensus_queue.cc:260] T d36e6c0657bd486b939805a704e580af P 19566de89ecf48aca9903d8bfdd5d936 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.349725  2442 ts_tablet_manager.cc:1434] T d36e6c0657bd486b939805a704e580af P 19566de89ecf48aca9903d8bfdd5d936: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:27:13.351068  2442 tablet_bootstrap.cc:492] T cb73a7a0e4004a1bbab977eb0c11d8dd P 19566de89ecf48aca9903d8bfdd5d936: Bootstrap starting.
I20260709 12:27:13.356770  2441 ts_tablet_manager.cc:1434] T 1523f5077995462b83bfa389d020880b P 129c763b69224d7e9b2187721e58adeb: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.004s
I20260709 12:27:13.357947  2441 tablet_bootstrap.cc:492] T a4decfc5493a43e9bb1dca65d85388e7 P 129c763b69224d7e9b2187721e58adeb: Bootstrap starting.
I20260709 12:27:13.358744  2443 tablet_bootstrap.cc:492] T 100dcbf9addf448bba05f170b5051802 P 72d4afb41b7245b4b382fb9e2c6edf59: No bootstrap required, opened a new log
I20260709 12:27:13.358847  2442 tablet_bootstrap.cc:654] T cb73a7a0e4004a1bbab977eb0c11d8dd P 19566de89ecf48aca9903d8bfdd5d936: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:13.359380  2443 ts_tablet_manager.cc:1403] T 100dcbf9addf448bba05f170b5051802 P 72d4afb41b7245b4b382fb9e2c6edf59: Time spent bootstrapping tablet: real 0.053s	user 0.016s	sys 0.005s
I20260709 12:27:13.362798  2443 raft_consensus.cc:359] T 100dcbf9addf448bba05f170b5051802 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.363543  2443 raft_consensus.cc:385] T 100dcbf9addf448bba05f170b5051802 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:13.363862  2443 raft_consensus.cc:740] T 100dcbf9addf448bba05f170b5051802 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d4afb41b7245b4b382fb9e2c6edf59, State: Initialized, Role: FOLLOWER
I20260709 12:27:13.364593  2441 tablet_bootstrap.cc:654] T a4decfc5493a43e9bb1dca65d85388e7 P 129c763b69224d7e9b2187721e58adeb: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:13.364610  2443 consensus_queue.cc:260] T 100dcbf9addf448bba05f170b5051802 P 72d4afb41b7245b4b382fb9e2c6edf59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.367183  2443 ts_tablet_manager.cc:1434] T 100dcbf9addf448bba05f170b5051802 P 72d4afb41b7245b4b382fb9e2c6edf59: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:27:13.368228  2443 tablet_bootstrap.cc:492] T a4decfc5493a43e9bb1dca65d85388e7 P 72d4afb41b7245b4b382fb9e2c6edf59: Bootstrap starting.
I20260709 12:27:13.373311  2442 tablet_bootstrap.cc:492] T cb73a7a0e4004a1bbab977eb0c11d8dd P 19566de89ecf48aca9903d8bfdd5d936: No bootstrap required, opened a new log
I20260709 12:27:13.373867  2443 tablet_bootstrap.cc:654] T a4decfc5493a43e9bb1dca65d85388e7 P 72d4afb41b7245b4b382fb9e2c6edf59: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:13.373916  2442 ts_tablet_manager.cc:1403] T cb73a7a0e4004a1bbab977eb0c11d8dd P 19566de89ecf48aca9903d8bfdd5d936: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.002s
I20260709 12:27:13.376948  2441 tablet_bootstrap.cc:492] T a4decfc5493a43e9bb1dca65d85388e7 P 129c763b69224d7e9b2187721e58adeb: No bootstrap required, opened a new log
I20260709 12:27:13.377486  2441 ts_tablet_manager.cc:1403] T a4decfc5493a43e9bb1dca65d85388e7 P 129c763b69224d7e9b2187721e58adeb: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.007s
I20260709 12:27:13.378161  2442 raft_consensus.cc:359] T cb73a7a0e4004a1bbab977eb0c11d8dd P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.379307  2442 raft_consensus.cc:385] T cb73a7a0e4004a1bbab977eb0c11d8dd P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:13.379846  2442 raft_consensus.cc:740] T cb73a7a0e4004a1bbab977eb0c11d8dd P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19566de89ecf48aca9903d8bfdd5d936, State: Initialized, Role: FOLLOWER
I20260709 12:27:13.380496  2441 raft_consensus.cc:359] T a4decfc5493a43e9bb1dca65d85388e7 P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.381443  2441 raft_consensus.cc:385] T a4decfc5493a43e9bb1dca65d85388e7 P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:13.381781  2441 raft_consensus.cc:740] T a4decfc5493a43e9bb1dca65d85388e7 P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 129c763b69224d7e9b2187721e58adeb, State: Initialized, Role: FOLLOWER
I20260709 12:27:13.381076  2442 consensus_queue.cc:260] T cb73a7a0e4004a1bbab977eb0c11d8dd P 19566de89ecf48aca9903d8bfdd5d936 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.382583  2441 consensus_queue.cc:260] T a4decfc5493a43e9bb1dca65d85388e7 P 129c763b69224d7e9b2187721e58adeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.384765  2442 ts_tablet_manager.cc:1434] T cb73a7a0e4004a1bbab977eb0c11d8dd P 19566de89ecf48aca9903d8bfdd5d936: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 12:27:13.386308  2442 tablet_bootstrap.cc:492] T 1523f5077995462b83bfa389d020880b P 19566de89ecf48aca9903d8bfdd5d936: Bootstrap starting.
I20260709 12:27:13.387952  2441 ts_tablet_manager.cc:1434] T a4decfc5493a43e9bb1dca65d85388e7 P 129c763b69224d7e9b2187721e58adeb: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 12:27:13.389230  2441 tablet_bootstrap.cc:492] T 372666c8d7a84b429fe9df7c121e0bcf P 129c763b69224d7e9b2187721e58adeb: Bootstrap starting.
I20260709 12:27:13.395641  2442 tablet_bootstrap.cc:654] T 1523f5077995462b83bfa389d020880b P 19566de89ecf48aca9903d8bfdd5d936: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:13.395668  2441 tablet_bootstrap.cc:654] T 372666c8d7a84b429fe9df7c121e0bcf P 129c763b69224d7e9b2187721e58adeb: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:13.404677  2441 tablet_bootstrap.cc:492] T 372666c8d7a84b429fe9df7c121e0bcf P 129c763b69224d7e9b2187721e58adeb: No bootstrap required, opened a new log
I20260709 12:27:13.405213  2441 ts_tablet_manager.cc:1403] T 372666c8d7a84b429fe9df7c121e0bcf P 129c763b69224d7e9b2187721e58adeb: Time spent bootstrapping tablet: real 0.016s	user 0.006s	sys 0.005s
I20260709 12:27:13.406728  2448 raft_consensus.cc:493] T d36e6c0657bd486b939805a704e580af P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.407258  2448 raft_consensus.cc:515] T d36e6c0657bd486b939805a704e580af P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.407862  2443 tablet_bootstrap.cc:492] T a4decfc5493a43e9bb1dca65d85388e7 P 72d4afb41b7245b4b382fb9e2c6edf59: No bootstrap required, opened a new log
I20260709 12:27:13.408058  2441 raft_consensus.cc:359] T 372666c8d7a84b429fe9df7c121e0bcf P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.408643  2443 ts_tablet_manager.cc:1403] T a4decfc5493a43e9bb1dca65d85388e7 P 72d4afb41b7245b4b382fb9e2c6edf59: Time spent bootstrapping tablet: real 0.041s	user 0.016s	sys 0.018s
I20260709 12:27:13.408892  2441 raft_consensus.cc:385] T 372666c8d7a84b429fe9df7c121e0bcf P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:13.409281  2441 raft_consensus.cc:740] T 372666c8d7a84b429fe9df7c121e0bcf P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 129c763b69224d7e9b2187721e58adeb, State: Initialized, Role: FOLLOWER
I20260709 12:27:13.410120  2441 consensus_queue.cc:260] T 372666c8d7a84b429fe9df7c121e0bcf P 129c763b69224d7e9b2187721e58adeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.411453  2448 leader_election.cc:290] T d36e6c0657bd486b939805a704e580af P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605), 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130:42771)
I20260709 12:27:13.413208  2251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36e6c0657bd486b939805a704e580af" candidate_uuid: "19566de89ecf48aca9903d8bfdd5d936" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "129c763b69224d7e9b2187721e58adeb" is_pre_election: true
I20260709 12:27:13.412832  2443 raft_consensus.cc:359] T a4decfc5493a43e9bb1dca65d85388e7 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.415284  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36e6c0657bd486b939805a704e580af" candidate_uuid: "19566de89ecf48aca9903d8bfdd5d936" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" is_pre_election: true
I20260709 12:27:13.413905  2443 raft_consensus.cc:385] T a4decfc5493a43e9bb1dca65d85388e7 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:27:13.415966  2364 leader_election.cc:343] T d36e6c0657bd486b939805a704e580af P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:13.419229  2442 tablet_bootstrap.cc:492] T 1523f5077995462b83bfa389d020880b P 19566de89ecf48aca9903d8bfdd5d936: No bootstrap required, opened a new log
W20260709 12:27:13.419673  2367 leader_election.cc:343] T d36e6c0657bd486b939805a704e580af P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130:42771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:13.419939  2442 ts_tablet_manager.cc:1403] T 1523f5077995462b83bfa389d020880b P 19566de89ecf48aca9903d8bfdd5d936: Time spent bootstrapping tablet: real 0.034s	user 0.024s	sys 0.004s
I20260709 12:27:13.420183  2367 leader_election.cc:304] T d36e6c0657bd486b939805a704e580af P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19566de89ecf48aca9903d8bfdd5d936; no voters: 129c763b69224d7e9b2187721e58adeb, 72d4afb41b7245b4b382fb9e2c6edf59
I20260709 12:27:13.421465  2448 raft_consensus.cc:2749] T d36e6c0657bd486b939805a704e580af P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:13.415376  2441 ts_tablet_manager.cc:1434] T 372666c8d7a84b429fe9df7c121e0bcf P 129c763b69224d7e9b2187721e58adeb: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 12:27:13.423373  2441 tablet_bootstrap.cc:492] T 1797eb20c76642c3912213b96a0156bb P 129c763b69224d7e9b2187721e58adeb: Bootstrap starting.
I20260709 12:27:13.423231  2442 raft_consensus.cc:359] T 1523f5077995462b83bfa389d020880b P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.424077  2442 raft_consensus.cc:385] T 1523f5077995462b83bfa389d020880b P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:13.424376  2442 raft_consensus.cc:740] T 1523f5077995462b83bfa389d020880b P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19566de89ecf48aca9903d8bfdd5d936, State: Initialized, Role: FOLLOWER
I20260709 12:27:13.419081  2443 raft_consensus.cc:740] T a4decfc5493a43e9bb1dca65d85388e7 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d4afb41b7245b4b382fb9e2c6edf59, State: Initialized, Role: FOLLOWER
I20260709 12:27:13.425573  2442 consensus_queue.cc:260] T 1523f5077995462b83bfa389d020880b P 19566de89ecf48aca9903d8bfdd5d936 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.426577  2443 consensus_queue.cc:260] T a4decfc5493a43e9bb1dca65d85388e7 P 72d4afb41b7245b4b382fb9e2c6edf59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.429000  2443 ts_tablet_manager.cc:1434] T a4decfc5493a43e9bb1dca65d85388e7 P 72d4afb41b7245b4b382fb9e2c6edf59: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:27:13.430007  2443 tablet_bootstrap.cc:492] T ea09120684274446b5c0965e6a6a9b4c P 72d4afb41b7245b4b382fb9e2c6edf59: Bootstrap starting.
I20260709 12:27:13.431485  2442 ts_tablet_manager.cc:1434] T 1523f5077995462b83bfa389d020880b P 19566de89ecf48aca9903d8bfdd5d936: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:27:13.432721  2442 tablet_bootstrap.cc:492] T ea09120684274446b5c0965e6a6a9b4c P 19566de89ecf48aca9903d8bfdd5d936: Bootstrap starting.
I20260709 12:27:13.436559  2443 tablet_bootstrap.cc:654] T ea09120684274446b5c0965e6a6a9b4c P 72d4afb41b7245b4b382fb9e2c6edf59: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:13.439741  2442 tablet_bootstrap.cc:654] T ea09120684274446b5c0965e6a6a9b4c P 19566de89ecf48aca9903d8bfdd5d936: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:13.444782  2441 tablet_bootstrap.cc:654] T 1797eb20c76642c3912213b96a0156bb P 129c763b69224d7e9b2187721e58adeb: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:13.447045  2442 tablet_bootstrap.cc:492] T ea09120684274446b5c0965e6a6a9b4c P 19566de89ecf48aca9903d8bfdd5d936: No bootstrap required, opened a new log
I20260709 12:27:13.447062  2443 tablet_bootstrap.cc:492] T ea09120684274446b5c0965e6a6a9b4c P 72d4afb41b7245b4b382fb9e2c6edf59: No bootstrap required, opened a new log
I20260709 12:27:13.447757  2442 ts_tablet_manager.cc:1403] T ea09120684274446b5c0965e6a6a9b4c P 19566de89ecf48aca9903d8bfdd5d936: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.004s
I20260709 12:27:13.447757  2443 ts_tablet_manager.cc:1403] T ea09120684274446b5c0965e6a6a9b4c P 72d4afb41b7245b4b382fb9e2c6edf59: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.005s
I20260709 12:27:13.450188  2441 tablet_bootstrap.cc:492] T 1797eb20c76642c3912213b96a0156bb P 129c763b69224d7e9b2187721e58adeb: No bootstrap required, opened a new log
I20260709 12:27:13.450690  2441 ts_tablet_manager.cc:1403] T 1797eb20c76642c3912213b96a0156bb P 129c763b69224d7e9b2187721e58adeb: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.003s
I20260709 12:27:13.451102  2442 raft_consensus.cc:359] T ea09120684274446b5c0965e6a6a9b4c P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.451332  2443 raft_consensus.cc:359] T ea09120684274446b5c0965e6a6a9b4c P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.451870  2442 raft_consensus.cc:385] T ea09120684274446b5c0965e6a6a9b4c P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:13.452028  2443 raft_consensus.cc:385] T ea09120684274446b5c0965e6a6a9b4c P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:13.452220  2442 raft_consensus.cc:740] T ea09120684274446b5c0965e6a6a9b4c P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19566de89ecf48aca9903d8bfdd5d936, State: Initialized, Role: FOLLOWER
I20260709 12:27:13.452412  2443 raft_consensus.cc:740] T ea09120684274446b5c0965e6a6a9b4c P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d4afb41b7245b4b382fb9e2c6edf59, State: Initialized, Role: FOLLOWER
I20260709 12:27:13.453080  2442 consensus_queue.cc:260] T ea09120684274446b5c0965e6a6a9b4c P 19566de89ecf48aca9903d8bfdd5d936 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.453126  2443 consensus_queue.cc:260] T ea09120684274446b5c0965e6a6a9b4c P 72d4afb41b7245b4b382fb9e2c6edf59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.453316  2441 raft_consensus.cc:359] T 1797eb20c76642c3912213b96a0156bb P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.454068  2441 raft_consensus.cc:385] T 1797eb20c76642c3912213b96a0156bb P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:13.454356  2441 raft_consensus.cc:740] T 1797eb20c76642c3912213b96a0156bb P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 129c763b69224d7e9b2187721e58adeb, State: Initialized, Role: FOLLOWER
I20260709 12:27:13.455119  2442 ts_tablet_manager.cc:1434] T ea09120684274446b5c0965e6a6a9b4c P 19566de89ecf48aca9903d8bfdd5d936: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:27:13.455170  2441 consensus_queue.cc:260] T 1797eb20c76642c3912213b96a0156bb P 129c763b69224d7e9b2187721e58adeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.456310  2442 tablet_bootstrap.cc:492] T 4915b590d3df467182d6ec1e3e5b7b9d P 19566de89ecf48aca9903d8bfdd5d936: Bootstrap starting.
I20260709 12:27:13.457494  2443 ts_tablet_manager.cc:1434] T ea09120684274446b5c0965e6a6a9b4c P 72d4afb41b7245b4b382fb9e2c6edf59: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:27:13.458660  2443 tablet_bootstrap.cc:492] T d36e6c0657bd486b939805a704e580af P 72d4afb41b7245b4b382fb9e2c6edf59: Bootstrap starting.
I20260709 12:27:13.460683  2441 ts_tablet_manager.cc:1434] T 1797eb20c76642c3912213b96a0156bb P 129c763b69224d7e9b2187721e58adeb: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:27:13.461858  2441 tablet_bootstrap.cc:492] T 100dcbf9addf448bba05f170b5051802 P 129c763b69224d7e9b2187721e58adeb: Bootstrap starting.
I20260709 12:27:13.462527  2442 tablet_bootstrap.cc:654] T 4915b590d3df467182d6ec1e3e5b7b9d P 19566de89ecf48aca9903d8bfdd5d936: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:13.464939  2443 tablet_bootstrap.cc:654] T d36e6c0657bd486b939805a704e580af P 72d4afb41b7245b4b382fb9e2c6edf59: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:13.468825  2441 tablet_bootstrap.cc:654] T 100dcbf9addf448bba05f170b5051802 P 129c763b69224d7e9b2187721e58adeb: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:13.482555  2441 tablet_bootstrap.cc:492] T 100dcbf9addf448bba05f170b5051802 P 129c763b69224d7e9b2187721e58adeb: No bootstrap required, opened a new log
I20260709 12:27:13.483408  2441 ts_tablet_manager.cc:1403] T 100dcbf9addf448bba05f170b5051802 P 129c763b69224d7e9b2187721e58adeb: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.003s
I20260709 12:27:13.488003  2441 raft_consensus.cc:359] T 100dcbf9addf448bba05f170b5051802 P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.489068  2441 raft_consensus.cc:385] T 100dcbf9addf448bba05f170b5051802 P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:13.489500  2441 raft_consensus.cc:740] T 100dcbf9addf448bba05f170b5051802 P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 129c763b69224d7e9b2187721e58adeb, State: Initialized, Role: FOLLOWER
I20260709 12:27:13.490794  2441 consensus_queue.cc:260] T 100dcbf9addf448bba05f170b5051802 P 129c763b69224d7e9b2187721e58adeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.499657  2441 ts_tablet_manager.cc:1434] T 100dcbf9addf448bba05f170b5051802 P 129c763b69224d7e9b2187721e58adeb: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.002s
I20260709 12:27:13.501312  2441 tablet_bootstrap.cc:492] T d36e6c0657bd486b939805a704e580af P 129c763b69224d7e9b2187721e58adeb: Bootstrap starting.
I20260709 12:27:13.503966  2448 raft_consensus.cc:493] T cb73a7a0e4004a1bbab977eb0c11d8dd P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.504758  2448 raft_consensus.cc:515] T cb73a7a0e4004a1bbab977eb0c11d8dd P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.508854  2448 leader_election.cc:290] T cb73a7a0e4004a1bbab977eb0c11d8dd P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605), 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130:42771)
I20260709 12:27:13.509429  2458 raft_consensus.cc:493] T 1523f5077995462b83bfa389d020880b P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.510186  2458 raft_consensus.cc:515] T 1523f5077995462b83bfa389d020880b P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.510794  2251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb73a7a0e4004a1bbab977eb0c11d8dd" candidate_uuid: "19566de89ecf48aca9903d8bfdd5d936" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "129c763b69224d7e9b2187721e58adeb" is_pre_election: true
I20260709 12:27:13.512454  2447 raft_consensus.cc:493] T ea09120684274446b5c0965e6a6a9b4c P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.513242  2447 raft_consensus.cc:515] T ea09120684274446b5c0965e6a6a9b4c P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.514935  2401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1523f5077995462b83bfa389d020880b" candidate_uuid: "129c763b69224d7e9b2187721e58adeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19566de89ecf48aca9903d8bfdd5d936" is_pre_election: true
I20260709 12:27:13.515848  2401 raft_consensus.cc:2468] T 1523f5077995462b83bfa389d020880b P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 129c763b69224d7e9b2187721e58adeb in term 0.
I20260709 12:27:13.517557  2217 leader_election.cc:304] T 1523f5077995462b83bfa389d020880b P 129c763b69224d7e9b2187721e58adeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 129c763b69224d7e9b2187721e58adeb, 19566de89ecf48aca9903d8bfdd5d936; no voters: 
I20260709 12:27:13.518250  2447 leader_election.cc:290] T ea09120684274446b5c0965e6a6a9b4c P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605), 19566de89ecf48aca9903d8bfdd5d936 (127.23.245.131:38763)
I20260709 12:27:13.518787  2449 raft_consensus.cc:2804] T 1523f5077995462b83bfa389d020880b P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:13.519352  2449 raft_consensus.cc:493] T 1523f5077995462b83bfa389d020880b P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:13.519793  2449 raft_consensus.cc:3060] T 1523f5077995462b83bfa389d020880b P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:27:13.520329  2364 leader_election.cc:343] T cb73a7a0e4004a1bbab977eb0c11d8dd P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:13.522307  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1523f5077995462b83bfa389d020880b" candidate_uuid: "129c763b69224d7e9b2187721e58adeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" is_pre_election: true
I20260709 12:27:13.523427  2326 raft_consensus.cc:2468] T 1523f5077995462b83bfa389d020880b P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 129c763b69224d7e9b2187721e58adeb in term 0.
I20260709 12:27:13.524061  2458 leader_election.cc:290] T 1523f5077995462b83bfa389d020880b P 129c763b69224d7e9b2187721e58adeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130:42771), 19566de89ecf48aca9903d8bfdd5d936 (127.23.245.131:38763)
I20260709 12:27:13.525068  2251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09120684274446b5c0965e6a6a9b4c" candidate_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "129c763b69224d7e9b2187721e58adeb" is_pre_election: true
I20260709 12:27:13.525974  2251 raft_consensus.cc:2468] T ea09120684274446b5c0965e6a6a9b4c P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d4afb41b7245b4b382fb9e2c6edf59 in term 0.
I20260709 12:27:13.527588  2290 leader_election.cc:304] T ea09120684274446b5c0965e6a6a9b4c P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 129c763b69224d7e9b2187721e58adeb, 72d4afb41b7245b4b382fb9e2c6edf59; no voters: 
I20260709 12:27:13.530414  2401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09120684274446b5c0965e6a6a9b4c" candidate_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19566de89ecf48aca9903d8bfdd5d936" is_pre_election: true
I20260709 12:27:13.531378  2401 raft_consensus.cc:2468] T ea09120684274446b5c0965e6a6a9b4c P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d4afb41b7245b4b382fb9e2c6edf59 in term 0.
I20260709 12:27:13.532310  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb73a7a0e4004a1bbab977eb0c11d8dd" candidate_uuid: "19566de89ecf48aca9903d8bfdd5d936" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" is_pre_election: true
I20260709 12:27:13.509438  2441 tablet_bootstrap.cc:654] T d36e6c0657bd486b939805a704e580af P 129c763b69224d7e9b2187721e58adeb: Neither blocks nor log segments found. Creating new log.
W20260709 12:27:13.534335  2367 leader_election.cc:343] T cb73a7a0e4004a1bbab977eb0c11d8dd P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130:42771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:13.535029  2367 leader_election.cc:304] T cb73a7a0e4004a1bbab977eb0c11d8dd P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19566de89ecf48aca9903d8bfdd5d936; no voters: 129c763b69224d7e9b2187721e58adeb, 72d4afb41b7245b4b382fb9e2c6edf59
I20260709 12:27:13.536599  2447 raft_consensus.cc:2804] T ea09120684274446b5c0965e6a6a9b4c P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:13.537273  2447 raft_consensus.cc:493] T ea09120684274446b5c0965e6a6a9b4c P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:13.537740  2447 raft_consensus.cc:3060] T ea09120684274446b5c0965e6a6a9b4c P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:13.539103  2449 raft_consensus.cc:515] T 1523f5077995462b83bfa389d020880b P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.540125  2448 raft_consensus.cc:2749] T cb73a7a0e4004a1bbab977eb0c11d8dd P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:13.544773  2401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1523f5077995462b83bfa389d020880b" candidate_uuid: "129c763b69224d7e9b2187721e58adeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19566de89ecf48aca9903d8bfdd5d936"
I20260709 12:27:13.545620  2401 raft_consensus.cc:3060] T 1523f5077995462b83bfa389d020880b P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:13.548398  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1523f5077995462b83bfa389d020880b" candidate_uuid: "129c763b69224d7e9b2187721e58adeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d4afb41b7245b4b382fb9e2c6edf59"
I20260709 12:27:13.549254  2326 raft_consensus.cc:3060] T 1523f5077995462b83bfa389d020880b P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:13.556272  2458 raft_consensus.cc:493] T 4915b590d3df467182d6ec1e3e5b7b9d P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.556988  2458 raft_consensus.cc:515] T 4915b590d3df467182d6ec1e3e5b7b9d P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.560962  2400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4915b590d3df467182d6ec1e3e5b7b9d" candidate_uuid: "129c763b69224d7e9b2187721e58adeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19566de89ecf48aca9903d8bfdd5d936" is_pre_election: true
W20260709 12:27:13.564308  2217 leader_election.cc:343] T 4915b590d3df467182d6ec1e3e5b7b9d P 129c763b69224d7e9b2187721e58adeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 19566de89ecf48aca9903d8bfdd5d936 (127.23.245.131:38763): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:13.559460  2458 leader_election.cc:290] T 4915b590d3df467182d6ec1e3e5b7b9d P 129c763b69224d7e9b2187721e58adeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130:42771), 19566de89ecf48aca9903d8bfdd5d936 (127.23.245.131:38763)
I20260709 12:27:13.566995  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4915b590d3df467182d6ec1e3e5b7b9d" candidate_uuid: "129c763b69224d7e9b2187721e58adeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" is_pre_election: true
W20260709 12:27:13.568888  2218 leader_election.cc:343] T 4915b590d3df467182d6ec1e3e5b7b9d P 129c763b69224d7e9b2187721e58adeb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130:42771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:13.569308  2218 leader_election.cc:304] T 4915b590d3df467182d6ec1e3e5b7b9d P 129c763b69224d7e9b2187721e58adeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 129c763b69224d7e9b2187721e58adeb; no voters: 19566de89ecf48aca9903d8bfdd5d936, 72d4afb41b7245b4b382fb9e2c6edf59
I20260709 12:27:13.570356  2458 raft_consensus.cc:2749] T 4915b590d3df467182d6ec1e3e5b7b9d P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:13.572453  2448 raft_consensus.cc:493] T 1797eb20c76642c3912213b96a0156bb P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.573103  2448 raft_consensus.cc:515] T 1797eb20c76642c3912213b96a0156bb P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.570300  2326 raft_consensus.cc:2468] T 1523f5077995462b83bfa389d020880b P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 129c763b69224d7e9b2187721e58adeb in term 1.
I20260709 12:27:13.576071  2448 leader_election.cc:290] T 1797eb20c76642c3912213b96a0156bb P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605), 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130:42771)
I20260709 12:27:13.577389  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1797eb20c76642c3912213b96a0156bb" candidate_uuid: "19566de89ecf48aca9903d8bfdd5d936" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" is_pre_election: true
I20260709 12:27:13.577628  2251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1797eb20c76642c3912213b96a0156bb" candidate_uuid: "19566de89ecf48aca9903d8bfdd5d936" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "129c763b69224d7e9b2187721e58adeb" is_pre_election: true
I20260709 12:27:13.578244  2327 raft_consensus.cc:2468] T 1797eb20c76642c3912213b96a0156bb P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19566de89ecf48aca9903d8bfdd5d936 in term 0.
I20260709 12:27:13.578357  2251 raft_consensus.cc:2468] T 1797eb20c76642c3912213b96a0156bb P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19566de89ecf48aca9903d8bfdd5d936 in term 0.
I20260709 12:27:13.578960  2443 tablet_bootstrap.cc:492] T d36e6c0657bd486b939805a704e580af P 72d4afb41b7245b4b382fb9e2c6edf59: No bootstrap required, opened a new log
I20260709 12:27:13.579514  2443 ts_tablet_manager.cc:1403] T d36e6c0657bd486b939805a704e580af P 72d4afb41b7245b4b382fb9e2c6edf59: Time spent bootstrapping tablet: real 0.121s	user 0.029s	sys 0.072s
I20260709 12:27:13.580163  2442 tablet_bootstrap.cc:492] T 4915b590d3df467182d6ec1e3e5b7b9d P 19566de89ecf48aca9903d8bfdd5d936: No bootstrap required, opened a new log
I20260709 12:27:13.580039  2364 leader_election.cc:304] T 1797eb20c76642c3912213b96a0156bb P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 129c763b69224d7e9b2187721e58adeb, 19566de89ecf48aca9903d8bfdd5d936; no voters: 
I20260709 12:27:13.572052  2449 leader_election.cc:290] T 1523f5077995462b83bfa389d020880b P 129c763b69224d7e9b2187721e58adeb [CANDIDATE]: Term 1 election: Requested vote from peers 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130:42771), 19566de89ecf48aca9903d8bfdd5d936 (127.23.245.131:38763)
I20260709 12:27:13.581375  2448 raft_consensus.cc:2804] T 1797eb20c76642c3912213b96a0156bb P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:13.581812  2448 raft_consensus.cc:493] T 1797eb20c76642c3912213b96a0156bb P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:13.582067  2401 raft_consensus.cc:2468] T 1523f5077995462b83bfa389d020880b P 19566de89ecf48aca9903d8bfdd5d936 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 129c763b69224d7e9b2187721e58adeb in term 1.
I20260709 12:27:13.582208  2448 raft_consensus.cc:3060] T 1797eb20c76642c3912213b96a0156bb P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:13.583424  2443 raft_consensus.cc:359] T d36e6c0657bd486b939805a704e580af P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.586827  2442 ts_tablet_manager.cc:1403] T 4915b590d3df467182d6ec1e3e5b7b9d P 19566de89ecf48aca9903d8bfdd5d936: Time spent bootstrapping tablet: real 0.131s	user 0.038s	sys 0.076s
I20260709 12:27:13.584668  2441 tablet_bootstrap.cc:492] T d36e6c0657bd486b939805a704e580af P 129c763b69224d7e9b2187721e58adeb: No bootstrap required, opened a new log
I20260709 12:27:13.587517  2441 ts_tablet_manager.cc:1403] T d36e6c0657bd486b939805a704e580af P 129c763b69224d7e9b2187721e58adeb: Time spent bootstrapping tablet: real 0.086s	user 0.011s	sys 0.004s
I20260709 12:27:13.586874  2443 raft_consensus.cc:385] T d36e6c0657bd486b939805a704e580af P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:13.589177  2447 raft_consensus.cc:515] T ea09120684274446b5c0965e6a6a9b4c P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.590018  2442 raft_consensus.cc:359] T 4915b590d3df467182d6ec1e3e5b7b9d P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.589614  2443 raft_consensus.cc:740] T d36e6c0657bd486b939805a704e580af P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d4afb41b7245b4b382fb9e2c6edf59, State: Initialized, Role: FOLLOWER
I20260709 12:27:13.590724  2442 raft_consensus.cc:385] T 4915b590d3df467182d6ec1e3e5b7b9d P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:13.591377  2443 consensus_queue.cc:260] T d36e6c0657bd486b939805a704e580af P 72d4afb41b7245b4b382fb9e2c6edf59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.583473  2217 leader_election.cc:304] T 1523f5077995462b83bfa389d020880b P 129c763b69224d7e9b2187721e58adeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 129c763b69224d7e9b2187721e58adeb, 19566de89ecf48aca9903d8bfdd5d936; no voters: 
I20260709 12:27:13.592519  2251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09120684274446b5c0965e6a6a9b4c" candidate_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "129c763b69224d7e9b2187721e58adeb"
I20260709 12:27:13.592830  2441 raft_consensus.cc:359] T d36e6c0657bd486b939805a704e580af P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.594378  2251 raft_consensus.cc:3060] T ea09120684274446b5c0965e6a6a9b4c P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:13.594411  2441 raft_consensus.cc:385] T d36e6c0657bd486b939805a704e580af P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:13.595067  2441 raft_consensus.cc:740] T d36e6c0657bd486b939805a704e580af P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 129c763b69224d7e9b2187721e58adeb, State: Initialized, Role: FOLLOWER
I20260709 12:27:13.591058  2442 raft_consensus.cc:740] T 4915b590d3df467182d6ec1e3e5b7b9d P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19566de89ecf48aca9903d8bfdd5d936, State: Initialized, Role: FOLLOWER
I20260709 12:27:13.596028  2441 consensus_queue.cc:260] T d36e6c0657bd486b939805a704e580af P 129c763b69224d7e9b2187721e58adeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.596756  2442 consensus_queue.cc:260] T 4915b590d3df467182d6ec1e3e5b7b9d P 19566de89ecf48aca9903d8bfdd5d936 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.597487  2458 raft_consensus.cc:2804] T 1523f5077995462b83bfa389d020880b P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:13.598994  2442 ts_tablet_manager.cc:1434] T 4915b590d3df467182d6ec1e3e5b7b9d P 19566de89ecf48aca9903d8bfdd5d936: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.001s
I20260709 12:27:13.599881  2447 leader_election.cc:290] T ea09120684274446b5c0965e6a6a9b4c P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 1 election: Requested vote from peers 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605), 19566de89ecf48aca9903d8bfdd5d936 (127.23.245.131:38763)
I20260709 12:27:13.600760  2448 raft_consensus.cc:515] T 1797eb20c76642c3912213b96a0156bb P 19566de89ecf48aca9903d8bfdd5d936 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.603731  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1797eb20c76642c3912213b96a0156bb" candidate_uuid: "19566de89ecf48aca9903d8bfdd5d936" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "129c763b69224d7e9b2187721e58adeb"
I20260709 12:27:13.604194  2442 tablet_bootstrap.cc:492] T 372666c8d7a84b429fe9df7c121e0bcf P 19566de89ecf48aca9903d8bfdd5d936: Bootstrap starting.
I20260709 12:27:13.604384  2252 raft_consensus.cc:3060] T 1797eb20c76642c3912213b96a0156bb P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:13.610773  2442 tablet_bootstrap.cc:654] T 372666c8d7a84b429fe9df7c121e0bcf P 19566de89ecf48aca9903d8bfdd5d936: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:13.612548  2448 leader_election.cc:290] T 1797eb20c76642c3912213b96a0156bb P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 1 election: Requested vote from peers 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605), 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130:42771)
I20260709 12:27:13.614099  2251 raft_consensus.cc:2468] T ea09120684274446b5c0965e6a6a9b4c P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d4afb41b7245b4b382fb9e2c6edf59 in term 1.
I20260709 12:27:13.615064  2441 ts_tablet_manager.cc:1434] T d36e6c0657bd486b939805a704e580af P 129c763b69224d7e9b2187721e58adeb: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 12:27:13.615893  2441 tablet_bootstrap.cc:492] T cb73a7a0e4004a1bbab977eb0c11d8dd P 129c763b69224d7e9b2187721e58adeb: Bootstrap starting.
I20260709 12:27:13.617134  2443 ts_tablet_manager.cc:1434] T d36e6c0657bd486b939805a704e580af P 72d4afb41b7245b4b382fb9e2c6edf59: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.004s
I20260709 12:27:13.618124  2443 tablet_bootstrap.cc:492] T 4915b590d3df467182d6ec1e3e5b7b9d P 72d4afb41b7245b4b382fb9e2c6edf59: Bootstrap starting.
I20260709 12:27:13.620191  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1797eb20c76642c3912213b96a0156bb" candidate_uuid: "19566de89ecf48aca9903d8bfdd5d936" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d4afb41b7245b4b382fb9e2c6edf59"
I20260709 12:27:13.616150  2290 leader_election.cc:304] T ea09120684274446b5c0965e6a6a9b4c P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 129c763b69224d7e9b2187721e58adeb, 72d4afb41b7245b4b382fb9e2c6edf59; no voters: 
I20260709 12:27:13.625202  2441 tablet_bootstrap.cc:654] T cb73a7a0e4004a1bbab977eb0c11d8dd P 129c763b69224d7e9b2187721e58adeb: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:13.626425  2443 tablet_bootstrap.cc:654] T 4915b590d3df467182d6ec1e3e5b7b9d P 72d4afb41b7245b4b382fb9e2c6edf59: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:13.628782  2447 raft_consensus.cc:2804] T ea09120684274446b5c0965e6a6a9b4c P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:13.629309  2447 raft_consensus.cc:697] T ea09120684274446b5c0965e6a6a9b4c P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 LEADER]: Becoming Leader. State: Replica: 72d4afb41b7245b4b382fb9e2c6edf59, State: Running, Role: LEADER
I20260709 12:27:13.630159  2447 consensus_queue.cc:237] T ea09120684274446b5c0965e6a6a9b4c P 72d4afb41b7245b4b382fb9e2c6edf59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.632781  2488 raft_consensus.cc:493] T a4decfc5493a43e9bb1dca65d85388e7 P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.633503  2488 raft_consensus.cc:515] T a4decfc5493a43e9bb1dca65d85388e7 P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.638137  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4decfc5493a43e9bb1dca65d85388e7" candidate_uuid: "129c763b69224d7e9b2187721e58adeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" is_pre_election: true
I20260709 12:27:13.639142  2327 raft_consensus.cc:2468] T a4decfc5493a43e9bb1dca65d85388e7 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 129c763b69224d7e9b2187721e58adeb in term 0.
I20260709 12:27:13.641326  2218 leader_election.cc:304] T a4decfc5493a43e9bb1dca65d85388e7 P 129c763b69224d7e9b2187721e58adeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 129c763b69224d7e9b2187721e58adeb, 72d4afb41b7245b4b382fb9e2c6edf59; no voters: 
I20260709 12:27:13.642508  2449 raft_consensus.cc:2804] T a4decfc5493a43e9bb1dca65d85388e7 P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:13.643002  2449 raft_consensus.cc:493] T a4decfc5493a43e9bb1dca65d85388e7 P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:13.643402  2449 raft_consensus.cc:3060] T a4decfc5493a43e9bb1dca65d85388e7 P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:13.649211  2326 raft_consensus.cc:3060] T 1797eb20c76642c3912213b96a0156bb P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:13.651885  2400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4decfc5493a43e9bb1dca65d85388e7" candidate_uuid: "129c763b69224d7e9b2187721e58adeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19566de89ecf48aca9903d8bfdd5d936" is_pre_election: true
I20260709 12:27:13.652887  2400 raft_consensus.cc:2468] T a4decfc5493a43e9bb1dca65d85388e7 P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 129c763b69224d7e9b2187721e58adeb in term 0.
I20260709 12:27:13.654912  2488 leader_election.cc:290] T a4decfc5493a43e9bb1dca65d85388e7 P 129c763b69224d7e9b2187721e58adeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130:42771), 19566de89ecf48aca9903d8bfdd5d936 (127.23.245.131:38763)
I20260709 12:27:13.616392  2458 raft_consensus.cc:697] T 1523f5077995462b83bfa389d020880b P 129c763b69224d7e9b2187721e58adeb [term 1 LEADER]: Becoming Leader. State: Replica: 129c763b69224d7e9b2187721e58adeb, State: Running, Role: LEADER
I20260709 12:27:13.661228  2458 consensus_queue.cc:237] T 1523f5077995462b83bfa389d020880b P 129c763b69224d7e9b2187721e58adeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.662328  2252 raft_consensus.cc:2468] T 1797eb20c76642c3912213b96a0156bb P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19566de89ecf48aca9903d8bfdd5d936 in term 1.
I20260709 12:27:13.664197  2364 leader_election.cc:304] T 1797eb20c76642c3912213b96a0156bb P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 129c763b69224d7e9b2187721e58adeb, 19566de89ecf48aca9903d8bfdd5d936; no voters: 
I20260709 12:27:13.665668  2448 raft_consensus.cc:2804] T 1797eb20c76642c3912213b96a0156bb P 19566de89ecf48aca9903d8bfdd5d936 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:13.666330  2448 raft_consensus.cc:697] T 1797eb20c76642c3912213b96a0156bb P 19566de89ecf48aca9903d8bfdd5d936 [term 1 LEADER]: Becoming Leader. State: Replica: 19566de89ecf48aca9903d8bfdd5d936, State: Running, Role: LEADER
I20260709 12:27:13.667353  2448 consensus_queue.cc:237] T 1797eb20c76642c3912213b96a0156bb P 19566de89ecf48aca9903d8bfdd5d936 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.619256  2401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09120684274446b5c0965e6a6a9b4c" candidate_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19566de89ecf48aca9903d8bfdd5d936"
I20260709 12:27:13.673105  2401 raft_consensus.cc:3060] T ea09120684274446b5c0965e6a6a9b4c P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:13.677300  2442 tablet_bootstrap.cc:492] T 372666c8d7a84b429fe9df7c121e0bcf P 19566de89ecf48aca9903d8bfdd5d936: No bootstrap required, opened a new log
I20260709 12:27:13.678254  2442 ts_tablet_manager.cc:1403] T 372666c8d7a84b429fe9df7c121e0bcf P 19566de89ecf48aca9903d8bfdd5d936: Time spent bootstrapping tablet: real 0.074s	user 0.032s	sys 0.036s
I20260709 12:27:13.685072  2462 raft_consensus.cc:493] T 4915b590d3df467182d6ec1e3e5b7b9d P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.686919  2462 raft_consensus.cc:515] T 4915b590d3df467182d6ec1e3e5b7b9d P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.690883  2462 leader_election.cc:290] T 4915b590d3df467182d6ec1e3e5b7b9d P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605), 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130:42771)
I20260709 12:27:13.695192  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4915b590d3df467182d6ec1e3e5b7b9d" candidate_uuid: "19566de89ecf48aca9903d8bfdd5d936" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" is_pre_election: true
I20260709 12:27:13.695430  2252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4915b590d3df467182d6ec1e3e5b7b9d" candidate_uuid: "19566de89ecf48aca9903d8bfdd5d936" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "129c763b69224d7e9b2187721e58adeb" is_pre_election: true
I20260709 12:27:13.696187  2252 raft_consensus.cc:2468] T 4915b590d3df467182d6ec1e3e5b7b9d P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19566de89ecf48aca9903d8bfdd5d936 in term 0.
W20260709 12:27:13.698192  2367 leader_election.cc:343] T 4915b590d3df467182d6ec1e3e5b7b9d P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130:42771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:13.699456  2364 leader_election.cc:304] T 4915b590d3df467182d6ec1e3e5b7b9d P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 129c763b69224d7e9b2187721e58adeb, 19566de89ecf48aca9903d8bfdd5d936; no voters: 72d4afb41b7245b4b382fb9e2c6edf59
I20260709 12:27:13.699601  2148 catalog_manager.cc:5697] T ea09120684274446b5c0965e6a6a9b4c P 72d4afb41b7245b4b382fb9e2c6edf59 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130). New cstate: current_term: 1 leader_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:13.700533  2448 raft_consensus.cc:2804] T 4915b590d3df467182d6ec1e3e5b7b9d P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:13.700937  2448 raft_consensus.cc:493] T 4915b590d3df467182d6ec1e3e5b7b9d P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:13.701272  2448 raft_consensus.cc:3060] T 4915b590d3df467182d6ec1e3e5b7b9d P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:13.703591  2401 raft_consensus.cc:2468] T ea09120684274446b5c0965e6a6a9b4c P 19566de89ecf48aca9903d8bfdd5d936 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d4afb41b7245b4b382fb9e2c6edf59 in term 1.
I20260709 12:27:13.706221  2326 raft_consensus.cc:2468] T 1797eb20c76642c3912213b96a0156bb P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19566de89ecf48aca9903d8bfdd5d936 in term 1.
I20260709 12:27:13.685648  2449 raft_consensus.cc:515] T a4decfc5493a43e9bb1dca65d85388e7 P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.708652  2449 leader_election.cc:290] T a4decfc5493a43e9bb1dca65d85388e7 P 129c763b69224d7e9b2187721e58adeb [CANDIDATE]: Term 1 election: Requested vote from peers 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130:42771), 19566de89ecf48aca9903d8bfdd5d936 (127.23.245.131:38763)
I20260709 12:27:13.709800  2401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4decfc5493a43e9bb1dca65d85388e7" candidate_uuid: "129c763b69224d7e9b2187721e58adeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19566de89ecf48aca9903d8bfdd5d936"
I20260709 12:27:13.711544  2150 catalog_manager.cc:5697] T 1523f5077995462b83bfa389d020880b P 129c763b69224d7e9b2187721e58adeb reported cstate change: term changed from 0 to 1, leader changed from <none> to 129c763b69224d7e9b2187721e58adeb (127.23.245.129). New cstate: current_term: 1 leader_uuid: "129c763b69224d7e9b2187721e58adeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:13.712464  2401 raft_consensus.cc:3060] T a4decfc5493a43e9bb1dca65d85388e7 P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:13.712323  2462 consensus_queue.cc:1048] T de5c5dbcf4844dab833043ea584da490 P 19566de89ecf48aca9903d8bfdd5d936 [LEADER]: Connected to new peer: Peer: permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:13.716796  2448 raft_consensus.cc:515] T 4915b590d3df467182d6ec1e3e5b7b9d P 19566de89ecf48aca9903d8bfdd5d936 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.717675  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4decfc5493a43e9bb1dca65d85388e7" candidate_uuid: "129c763b69224d7e9b2187721e58adeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d4afb41b7245b4b382fb9e2c6edf59"
I20260709 12:27:13.718974  2448 leader_election.cc:290] T 4915b590d3df467182d6ec1e3e5b7b9d P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 1 election: Requested vote from peers 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605), 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130:42771)
I20260709 12:27:13.711758  2441 tablet_bootstrap.cc:492] T cb73a7a0e4004a1bbab977eb0c11d8dd P 129c763b69224d7e9b2187721e58adeb: No bootstrap required, opened a new log
I20260709 12:27:13.720023  2441 ts_tablet_manager.cc:1403] T cb73a7a0e4004a1bbab977eb0c11d8dd P 129c763b69224d7e9b2187721e58adeb: Time spent bootstrapping tablet: real 0.104s	user 0.012s	sys 0.009s
I20260709 12:27:13.719964  2251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4915b590d3df467182d6ec1e3e5b7b9d" candidate_uuid: "19566de89ecf48aca9903d8bfdd5d936" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "129c763b69224d7e9b2187721e58adeb"
I20260709 12:27:13.720343  2447 raft_consensus.cc:493] T d36e6c0657bd486b939805a704e580af P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.720723  2251 raft_consensus.cc:3060] T 4915b590d3df467182d6ec1e3e5b7b9d P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:13.720937  2442 raft_consensus.cc:359] T 372666c8d7a84b429fe9df7c121e0bcf P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.721618  2442 raft_consensus.cc:385] T 372666c8d7a84b429fe9df7c121e0bcf P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:13.721881  2442 raft_consensus.cc:740] T 372666c8d7a84b429fe9df7c121e0bcf P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19566de89ecf48aca9903d8bfdd5d936, State: Initialized, Role: FOLLOWER
I20260709 12:27:13.722494  2442 consensus_queue.cc:260] T 372666c8d7a84b429fe9df7c121e0bcf P 19566de89ecf48aca9903d8bfdd5d936 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.722851  2441 raft_consensus.cc:359] T cb73a7a0e4004a1bbab977eb0c11d8dd P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.723877  2441 raft_consensus.cc:385] T cb73a7a0e4004a1bbab977eb0c11d8dd P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:13.720836  2447 raft_consensus.cc:515] T d36e6c0657bd486b939805a704e580af P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.724181  2441 raft_consensus.cc:740] T cb73a7a0e4004a1bbab977eb0c11d8dd P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 129c763b69224d7e9b2187721e58adeb, State: Initialized, Role: FOLLOWER
I20260709 12:27:13.724579  2442 ts_tablet_manager.cc:1434] T 372666c8d7a84b429fe9df7c121e0bcf P 19566de89ecf48aca9903d8bfdd5d936: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.000s
I20260709 12:27:13.725008  2441 consensus_queue.cc:260] T cb73a7a0e4004a1bbab977eb0c11d8dd P 129c763b69224d7e9b2187721e58adeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.726258  2447 leader_election.cc:290] T d36e6c0657bd486b939805a704e580af P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605), 19566de89ecf48aca9903d8bfdd5d936 (127.23.245.131:38763)
I20260709 12:27:13.726534  2401 raft_consensus.cc:2468] T a4decfc5493a43e9bb1dca65d85388e7 P 19566de89ecf48aca9903d8bfdd5d936 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 129c763b69224d7e9b2187721e58adeb in term 1.
I20260709 12:27:13.727213  2250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36e6c0657bd486b939805a704e580af" candidate_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "129c763b69224d7e9b2187721e58adeb" is_pre_election: true
I20260709 12:27:13.727890  2250 raft_consensus.cc:2468] T d36e6c0657bd486b939805a704e580af P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d4afb41b7245b4b382fb9e2c6edf59 in term 0.
I20260709 12:27:13.727807  2217 leader_election.cc:304] T a4decfc5493a43e9bb1dca65d85388e7 P 129c763b69224d7e9b2187721e58adeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 129c763b69224d7e9b2187721e58adeb, 19566de89ecf48aca9903d8bfdd5d936; no voters: 
I20260709 12:27:13.728411  2400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36e6c0657bd486b939805a704e580af" candidate_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19566de89ecf48aca9903d8bfdd5d936" is_pre_election: true
I20260709 12:27:13.729058  2400 raft_consensus.cc:2468] T d36e6c0657bd486b939805a704e580af P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d4afb41b7245b4b382fb9e2c6edf59 in term 0.
I20260709 12:27:13.729238  2458 raft_consensus.cc:2804] T a4decfc5493a43e9bb1dca65d85388e7 P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:13.729806  2458 raft_consensus.cc:697] T a4decfc5493a43e9bb1dca65d85388e7 P 129c763b69224d7e9b2187721e58adeb [term 1 LEADER]: Becoming Leader. State: Replica: 129c763b69224d7e9b2187721e58adeb, State: Running, Role: LEADER
I20260709 12:27:13.730333  2290 leader_election.cc:304] T d36e6c0657bd486b939805a704e580af P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 129c763b69224d7e9b2187721e58adeb, 72d4afb41b7245b4b382fb9e2c6edf59; no voters: 
I20260709 12:27:13.730008  2148 catalog_manager.cc:5697] T 1797eb20c76642c3912213b96a0156bb P 19566de89ecf48aca9903d8bfdd5d936 reported cstate change: term changed from 0 to 1, leader changed from <none> to 19566de89ecf48aca9903d8bfdd5d936 (127.23.245.131). New cstate: current_term: 1 leader_uuid: "19566de89ecf48aca9903d8bfdd5d936" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:13.730628  2458 consensus_queue.cc:237] T a4decfc5493a43e9bb1dca65d85388e7 P 129c763b69224d7e9b2187721e58adeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.731842  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4915b590d3df467182d6ec1e3e5b7b9d" candidate_uuid: "19566de89ecf48aca9903d8bfdd5d936" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d4afb41b7245b4b382fb9e2c6edf59"
W20260709 12:27:13.733501  2367 leader_election.cc:343] T 4915b590d3df467182d6ec1e3e5b7b9d P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130:42771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:13.731230  2447 raft_consensus.cc:2804] T d36e6c0657bd486b939805a704e580af P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:13.734159  2447 raft_consensus.cc:493] T d36e6c0657bd486b939805a704e580af P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:13.734714  2443 tablet_bootstrap.cc:492] T 4915b590d3df467182d6ec1e3e5b7b9d P 72d4afb41b7245b4b382fb9e2c6edf59: No bootstrap required, opened a new log
I20260709 12:27:13.734651  2447 raft_consensus.cc:3060] T d36e6c0657bd486b939805a704e580af P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:13.739614  2443 ts_tablet_manager.cc:1403] T 4915b590d3df467182d6ec1e3e5b7b9d P 72d4afb41b7245b4b382fb9e2c6edf59: Time spent bootstrapping tablet: real 0.122s	user 0.035s	sys 0.023s
I20260709 12:27:13.718272  2326 raft_consensus.cc:3060] T a4decfc5493a43e9bb1dca65d85388e7 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:13.745850  2447 raft_consensus.cc:515] T d36e6c0657bd486b939805a704e580af P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.730556  2441 ts_tablet_manager.cc:1434] T cb73a7a0e4004a1bbab977eb0c11d8dd P 129c763b69224d7e9b2187721e58adeb: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:27:13.752579  2443 raft_consensus.cc:359] T 4915b590d3df467182d6ec1e3e5b7b9d P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.753399  2443 raft_consensus.cc:385] T 4915b590d3df467182d6ec1e3e5b7b9d P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:13.753669  2443 raft_consensus.cc:740] T 4915b590d3df467182d6ec1e3e5b7b9d P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d4afb41b7245b4b382fb9e2c6edf59, State: Initialized, Role: FOLLOWER
I20260709 12:27:13.754536  2443 consensus_queue.cc:260] T 4915b590d3df467182d6ec1e3e5b7b9d P 72d4afb41b7245b4b382fb9e2c6edf59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.756738  2326 raft_consensus.cc:2468] T a4decfc5493a43e9bb1dca65d85388e7 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 129c763b69224d7e9b2187721e58adeb in term 1.
I20260709 12:27:13.774904  2443 ts_tablet_manager.cc:1434] T 4915b590d3df467182d6ec1e3e5b7b9d P 72d4afb41b7245b4b382fb9e2c6edf59: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.001s
I20260709 12:27:13.776232  2443 tablet_bootstrap.cc:492] T cb73a7a0e4004a1bbab977eb0c11d8dd P 72d4afb41b7245b4b382fb9e2c6edf59: Bootstrap starting.
I20260709 12:27:13.779318  2250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36e6c0657bd486b939805a704e580af" candidate_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "129c763b69224d7e9b2187721e58adeb"
I20260709 12:27:13.780093  2250 raft_consensus.cc:3060] T d36e6c0657bd486b939805a704e580af P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:13.782368  2447 leader_election.cc:290] T d36e6c0657bd486b939805a704e580af P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 1 election: Requested vote from peers 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605), 19566de89ecf48aca9903d8bfdd5d936 (127.23.245.131:38763)
I20260709 12:27:13.782723  2443 tablet_bootstrap.cc:654] T cb73a7a0e4004a1bbab977eb0c11d8dd P 72d4afb41b7245b4b382fb9e2c6edf59: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:13.784173  2487 raft_consensus.cc:493] T 100dcbf9addf448bba05f170b5051802 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.784930  2401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36e6c0657bd486b939805a704e580af" candidate_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19566de89ecf48aca9903d8bfdd5d936"
I20260709 12:27:13.785617  2401 raft_consensus.cc:3060] T d36e6c0657bd486b939805a704e580af P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:13.784901  2487 raft_consensus.cc:515] T 100dcbf9addf448bba05f170b5051802 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.788756  2251 raft_consensus.cc:2468] T 4915b590d3df467182d6ec1e3e5b7b9d P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19566de89ecf48aca9903d8bfdd5d936 in term 1.
I20260709 12:27:13.807232  2364 leader_election.cc:304] T 4915b590d3df467182d6ec1e3e5b7b9d P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 129c763b69224d7e9b2187721e58adeb, 19566de89ecf48aca9903d8bfdd5d936; no voters: 72d4afb41b7245b4b382fb9e2c6edf59
I20260709 12:27:13.810545  2448 raft_consensus.cc:2804] T 4915b590d3df467182d6ec1e3e5b7b9d P 19566de89ecf48aca9903d8bfdd5d936 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:13.811990  2251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "100dcbf9addf448bba05f170b5051802" candidate_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "129c763b69224d7e9b2187721e58adeb" is_pre_election: true
I20260709 12:27:13.812678  2400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "100dcbf9addf448bba05f170b5051802" candidate_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19566de89ecf48aca9903d8bfdd5d936" is_pre_election: true
I20260709 12:27:13.813552  2400 raft_consensus.cc:2468] T 100dcbf9addf448bba05f170b5051802 P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d4afb41b7245b4b382fb9e2c6edf59 in term 0.
I20260709 12:27:13.814949  2462 consensus_queue.cc:1048] T de5c5dbcf4844dab833043ea584da490 P 19566de89ecf48aca9903d8bfdd5d936 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:13.816074  2292 leader_election.cc:304] T 100dcbf9addf448bba05f170b5051802 P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19566de89ecf48aca9903d8bfdd5d936, 72d4afb41b7245b4b382fb9e2c6edf59; no voters: 
I20260709 12:27:13.812703  2251 raft_consensus.cc:2468] T 100dcbf9addf448bba05f170b5051802 P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d4afb41b7245b4b382fb9e2c6edf59 in term 0.
I20260709 12:27:13.817001  2447 raft_consensus.cc:2804] T 100dcbf9addf448bba05f170b5051802 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:13.817368  2447 raft_consensus.cc:493] T 100dcbf9addf448bba05f170b5051802 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:13.817682  2447 raft_consensus.cc:3060] T 100dcbf9addf448bba05f170b5051802 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:13.822732  2401 raft_consensus.cc:2468] T d36e6c0657bd486b939805a704e580af P 19566de89ecf48aca9903d8bfdd5d936 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d4afb41b7245b4b382fb9e2c6edf59 in term 1.
I20260709 12:27:13.825906  2292 leader_election.cc:304] T d36e6c0657bd486b939805a704e580af P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19566de89ecf48aca9903d8bfdd5d936, 72d4afb41b7245b4b382fb9e2c6edf59; no voters: 
I20260709 12:27:13.828869  2250 raft_consensus.cc:2468] T d36e6c0657bd486b939805a704e580af P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d4afb41b7245b4b382fb9e2c6edf59 in term 1.
I20260709 12:27:13.829735  2458 raft_consensus.cc:493] T 372666c8d7a84b429fe9df7c121e0bcf P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.830430  2458 raft_consensus.cc:515] T 372666c8d7a84b429fe9df7c121e0bcf P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.833797  2458 leader_election.cc:290] T 372666c8d7a84b429fe9df7c121e0bcf P 129c763b69224d7e9b2187721e58adeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130:42771), 19566de89ecf48aca9903d8bfdd5d936 (127.23.245.131:38763)
I20260709 12:27:13.833911  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372666c8d7a84b429fe9df7c121e0bcf" candidate_uuid: "129c763b69224d7e9b2187721e58adeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" is_pre_election: true
I20260709 12:27:13.834326  2401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372666c8d7a84b429fe9df7c121e0bcf" candidate_uuid: "129c763b69224d7e9b2187721e58adeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19566de89ecf48aca9903d8bfdd5d936" is_pre_election: true
I20260709 12:27:13.834654  2327 raft_consensus.cc:2468] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 129c763b69224d7e9b2187721e58adeb in term 0.
I20260709 12:27:13.834951  2401 raft_consensus.cc:2468] T 372666c8d7a84b429fe9df7c121e0bcf P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 129c763b69224d7e9b2187721e58adeb in term 0.
I20260709 12:27:13.835945  2218 leader_election.cc:304] T 372666c8d7a84b429fe9df7c121e0bcf P 129c763b69224d7e9b2187721e58adeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 129c763b69224d7e9b2187721e58adeb, 72d4afb41b7245b4b382fb9e2c6edf59; no voters: 
I20260709 12:27:13.824200  2487 leader_election.cc:290] T 100dcbf9addf448bba05f170b5051802 P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605), 19566de89ecf48aca9903d8bfdd5d936 (127.23.245.131:38763)
I20260709 12:27:13.837327  2458 raft_consensus.cc:2804] T 372666c8d7a84b429fe9df7c121e0bcf P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:13.837728  2458 raft_consensus.cc:493] T 372666c8d7a84b429fe9df7c121e0bcf P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:13.838080  2458 raft_consensus.cc:3060] T 372666c8d7a84b429fe9df7c121e0bcf P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:13.838954  2487 raft_consensus.cc:2804] T d36e6c0657bd486b939805a704e580af P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:13.842707  2487 raft_consensus.cc:697] T d36e6c0657bd486b939805a704e580af P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 LEADER]: Becoming Leader. State: Replica: 72d4afb41b7245b4b382fb9e2c6edf59, State: Running, Role: LEADER
I20260709 12:27:13.844408  2487 consensus_queue.cc:237] T d36e6c0657bd486b939805a704e580af P 72d4afb41b7245b4b382fb9e2c6edf59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.839459  2447 raft_consensus.cc:515] T 100dcbf9addf448bba05f170b5051802 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.848129  2443 tablet_bootstrap.cc:492] T cb73a7a0e4004a1bbab977eb0c11d8dd P 72d4afb41b7245b4b382fb9e2c6edf59: No bootstrap required, opened a new log
I20260709 12:27:13.840852  2150 catalog_manager.cc:5697] T a4decfc5493a43e9bb1dca65d85388e7 P 129c763b69224d7e9b2187721e58adeb reported cstate change: term changed from 0 to 1, leader changed from <none> to 129c763b69224d7e9b2187721e58adeb (127.23.245.129). New cstate: current_term: 1 leader_uuid: "129c763b69224d7e9b2187721e58adeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:13.848829  2443 ts_tablet_manager.cc:1403] T cb73a7a0e4004a1bbab977eb0c11d8dd P 72d4afb41b7245b4b382fb9e2c6edf59: Time spent bootstrapping tablet: real 0.073s	user 0.024s	sys 0.008s
I20260709 12:27:13.852890  2447 leader_election.cc:290] T 100dcbf9addf448bba05f170b5051802 P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 1 election: Requested vote from peers 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605), 19566de89ecf48aca9903d8bfdd5d936 (127.23.245.131:38763)
I20260709 12:27:13.855114  2401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "100dcbf9addf448bba05f170b5051802" candidate_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19566de89ecf48aca9903d8bfdd5d936"
I20260709 12:27:13.856232  2401 raft_consensus.cc:3060] T 100dcbf9addf448bba05f170b5051802 P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:13.852696  2443 raft_consensus.cc:359] T cb73a7a0e4004a1bbab977eb0c11d8dd P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.857542  2443 raft_consensus.cc:385] T cb73a7a0e4004a1bbab977eb0c11d8dd P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:13.857825  2443 raft_consensus.cc:740] T cb73a7a0e4004a1bbab977eb0c11d8dd P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 72d4afb41b7245b4b382fb9e2c6edf59, State: Initialized, Role: FOLLOWER
I20260709 12:27:13.857847  2458 raft_consensus.cc:515] T 372666c8d7a84b429fe9df7c121e0bcf P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.859823  2448 raft_consensus.cc:697] T 4915b590d3df467182d6ec1e3e5b7b9d P 19566de89ecf48aca9903d8bfdd5d936 [term 1 LEADER]: Becoming Leader. State: Replica: 19566de89ecf48aca9903d8bfdd5d936, State: Running, Role: LEADER
I20260709 12:27:13.859774  2443 consensus_queue.cc:260] T cb73a7a0e4004a1bbab977eb0c11d8dd P 72d4afb41b7245b4b382fb9e2c6edf59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.860901  2448 consensus_queue.cc:237] T 4915b590d3df467182d6ec1e3e5b7b9d P 19566de89ecf48aca9903d8bfdd5d936 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.862073  2443 ts_tablet_manager.cc:1434] T cb73a7a0e4004a1bbab977eb0c11d8dd P 72d4afb41b7245b4b382fb9e2c6edf59: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:27:13.864998  2401 raft_consensus.cc:2468] T 100dcbf9addf448bba05f170b5051802 P 19566de89ecf48aca9903d8bfdd5d936 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d4afb41b7245b4b382fb9e2c6edf59 in term 1.
I20260709 12:27:13.868793  2292 leader_election.cc:304] T 100dcbf9addf448bba05f170b5051802 P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19566de89ecf48aca9903d8bfdd5d936, 72d4afb41b7245b4b382fb9e2c6edf59; no voters: 
I20260709 12:27:13.870205  2447 raft_consensus.cc:2804] T 100dcbf9addf448bba05f170b5051802 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:13.871901  2447 raft_consensus.cc:697] T 100dcbf9addf448bba05f170b5051802 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 LEADER]: Becoming Leader. State: Replica: 72d4afb41b7245b4b382fb9e2c6edf59, State: Running, Role: LEADER
I20260709 12:27:13.873070  2447 consensus_queue.cc:237] T 100dcbf9addf448bba05f170b5051802 P 72d4afb41b7245b4b382fb9e2c6edf59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.877139  2458 leader_election.cc:290] T 372666c8d7a84b429fe9df7c121e0bcf P 129c763b69224d7e9b2187721e58adeb [CANDIDATE]: Term 1 election: Requested vote from peers 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130:42771), 19566de89ecf48aca9903d8bfdd5d936 (127.23.245.131:38763)
I20260709 12:27:13.878352  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372666c8d7a84b429fe9df7c121e0bcf" candidate_uuid: "129c763b69224d7e9b2187721e58adeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d4afb41b7245b4b382fb9e2c6edf59"
I20260709 12:27:13.879200  2325 raft_consensus.cc:3060] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:13.879477  2401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372666c8d7a84b429fe9df7c121e0bcf" candidate_uuid: "129c763b69224d7e9b2187721e58adeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19566de89ecf48aca9903d8bfdd5d936"
I20260709 12:27:13.880136  2401 raft_consensus.cc:3060] T 372666c8d7a84b429fe9df7c121e0bcf P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:13.892227  2250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "100dcbf9addf448bba05f170b5051802" candidate_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "129c763b69224d7e9b2187721e58adeb"
I20260709 12:27:13.892887  2250 raft_consensus.cc:3060] T 100dcbf9addf448bba05f170b5051802 P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:13.890149  2147 catalog_manager.cc:5697] T 4915b590d3df467182d6ec1e3e5b7b9d P 19566de89ecf48aca9903d8bfdd5d936 reported cstate change: term changed from 0 to 1, leader changed from <none> to 19566de89ecf48aca9903d8bfdd5d936 (127.23.245.131). New cstate: current_term: 1 leader_uuid: "19566de89ecf48aca9903d8bfdd5d936" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:13.911126  2150 catalog_manager.cc:5697] T d36e6c0657bd486b939805a704e580af P 72d4afb41b7245b4b382fb9e2c6edf59 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130). New cstate: current_term: 1 leader_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:13.912848  2325 raft_consensus.cc:2468] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 129c763b69224d7e9b2187721e58adeb in term 1.
I20260709 12:27:13.913309  2150 catalog_manager.cc:5697] T 100dcbf9addf448bba05f170b5051802 P 72d4afb41b7245b4b382fb9e2c6edf59 reported cstate change: term changed from 0 to 1, leader changed from <none> to 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130). New cstate: current_term: 1 leader_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:13.914265  2218 leader_election.cc:304] T 372666c8d7a84b429fe9df7c121e0bcf P 129c763b69224d7e9b2187721e58adeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 129c763b69224d7e9b2187721e58adeb, 72d4afb41b7245b4b382fb9e2c6edf59; no voters: 
I20260709 12:27:13.914745  2401 raft_consensus.cc:2468] T 372666c8d7a84b429fe9df7c121e0bcf P 19566de89ecf48aca9903d8bfdd5d936 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 129c763b69224d7e9b2187721e58adeb in term 1.
I20260709 12:27:13.915205  2488 raft_consensus.cc:2804] T 372666c8d7a84b429fe9df7c121e0bcf P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:13.915752  2488 raft_consensus.cc:697] T 372666c8d7a84b429fe9df7c121e0bcf P 129c763b69224d7e9b2187721e58adeb [term 1 LEADER]: Becoming Leader. State: Replica: 129c763b69224d7e9b2187721e58adeb, State: Running, Role: LEADER
I20260709 12:27:13.916612  2488 consensus_queue.cc:237] T 372666c8d7a84b429fe9df7c121e0bcf P 129c763b69224d7e9b2187721e58adeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:13.919785  2250 raft_consensus.cc:2468] T 100dcbf9addf448bba05f170b5051802 P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d4afb41b7245b4b382fb9e2c6edf59 in term 1.
I20260709 12:27:13.929486  2147 catalog_manager.cc:5697] T 372666c8d7a84b429fe9df7c121e0bcf P 129c763b69224d7e9b2187721e58adeb reported cstate change: term changed from 0 to 1, leader changed from <none> to 129c763b69224d7e9b2187721e58adeb (127.23.245.129). New cstate: current_term: 1 leader_uuid: "129c763b69224d7e9b2187721e58adeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:14.071576  2500 consensus_queue.cc:1048] T ea09120684274446b5c0965e6a6a9b4c P 72d4afb41b7245b4b382fb9e2c6edf59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:14.074720  2500 consensus_queue.cc:1048] T ea09120684274446b5c0965e6a6a9b4c P 72d4afb41b7245b4b382fb9e2c6edf59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:14.092428  2488 consensus_queue.cc:1048] T 1523f5077995462b83bfa389d020880b P 129c763b69224d7e9b2187721e58adeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:14.104213  2500 raft_consensus.cc:493] T 4915b590d3df467182d6ec1e3e5b7b9d P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.104818  2500 raft_consensus.cc:515] T 4915b590d3df467182d6ec1e3e5b7b9d P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:14.106666  2500 leader_election.cc:290] T 4915b590d3df467182d6ec1e3e5b7b9d P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605), 19566de89ecf48aca9903d8bfdd5d936 (127.23.245.131:38763)
I20260709 12:27:14.107491  2488 consensus_queue.cc:1048] T 1523f5077995462b83bfa389d020880b P 129c763b69224d7e9b2187721e58adeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:14.107699  2250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4915b590d3df467182d6ec1e3e5b7b9d" candidate_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "129c763b69224d7e9b2187721e58adeb" is_pre_election: true
I20260709 12:27:14.108913  2250 raft_consensus.cc:2393] T 4915b590d3df467182d6ec1e3e5b7b9d P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 72d4afb41b7245b4b382fb9e2c6edf59 in current term 1: Already voted for candidate 19566de89ecf48aca9903d8bfdd5d936 in this term.
I20260709 12:27:14.107703  2401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4915b590d3df467182d6ec1e3e5b7b9d" candidate_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19566de89ecf48aca9903d8bfdd5d936" is_pre_election: true
I20260709 12:27:14.110836  2292 leader_election.cc:304] T 4915b590d3df467182d6ec1e3e5b7b9d P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d4afb41b7245b4b382fb9e2c6edf59; no voters: 129c763b69224d7e9b2187721e58adeb, 19566de89ecf48aca9903d8bfdd5d936
I20260709 12:27:14.111680  2500 raft_consensus.cc:3060] T 4915b590d3df467182d6ec1e3e5b7b9d P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:14.118865  2500 raft_consensus.cc:2749] T 4915b590d3df467182d6ec1e3e5b7b9d P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:14.121981  2506 consensus_queue.cc:1048] T 1797eb20c76642c3912213b96a0156bb P 19566de89ecf48aca9903d8bfdd5d936 [LEADER]: Connected to new peer: Peer: permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:14.124280  2488 consensus_queue.cc:1048] T a4decfc5493a43e9bb1dca65d85388e7 P 129c763b69224d7e9b2187721e58adeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:14.135574  2498 consensus_queue.cc:1048] T 1797eb20c76642c3912213b96a0156bb P 19566de89ecf48aca9903d8bfdd5d936 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:14.139878  2488 raft_consensus.cc:493] T cb73a7a0e4004a1bbab977eb0c11d8dd P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.140482  2488 raft_consensus.cc:515] T cb73a7a0e4004a1bbab977eb0c11d8dd P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:14.143229  2488 leader_election.cc:290] T cb73a7a0e4004a1bbab977eb0c11d8dd P 129c763b69224d7e9b2187721e58adeb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130:42771), 19566de89ecf48aca9903d8bfdd5d936 (127.23.245.131:38763)
I20260709 12:27:14.144568  2400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb73a7a0e4004a1bbab977eb0c11d8dd" candidate_uuid: "129c763b69224d7e9b2187721e58adeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19566de89ecf48aca9903d8bfdd5d936" is_pre_election: true
I20260709 12:27:14.145498  2400 raft_consensus.cc:2468] T cb73a7a0e4004a1bbab977eb0c11d8dd P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 129c763b69224d7e9b2187721e58adeb in term 0.
I20260709 12:27:14.147156  2217 leader_election.cc:304] T cb73a7a0e4004a1bbab977eb0c11d8dd P 129c763b69224d7e9b2187721e58adeb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 129c763b69224d7e9b2187721e58adeb, 19566de89ecf48aca9903d8bfdd5d936; no voters: 
I20260709 12:27:14.148577  2488 raft_consensus.cc:2804] T cb73a7a0e4004a1bbab977eb0c11d8dd P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:14.149060  2488 raft_consensus.cc:493] T cb73a7a0e4004a1bbab977eb0c11d8dd P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:14.149487  2488 raft_consensus.cc:3060] T cb73a7a0e4004a1bbab977eb0c11d8dd P 129c763b69224d7e9b2187721e58adeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:14.150251  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb73a7a0e4004a1bbab977eb0c11d8dd" candidate_uuid: "129c763b69224d7e9b2187721e58adeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" is_pre_election: true
I20260709 12:27:14.151104  2327 raft_consensus.cc:2468] T cb73a7a0e4004a1bbab977eb0c11d8dd P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 129c763b69224d7e9b2187721e58adeb in term 0.
I20260709 12:27:14.162797  2488 raft_consensus.cc:515] T cb73a7a0e4004a1bbab977eb0c11d8dd P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:14.164012  2458 consensus_queue.cc:1048] T a4decfc5493a43e9bb1dca65d85388e7 P 129c763b69224d7e9b2187721e58adeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:14.170696  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb73a7a0e4004a1bbab977eb0c11d8dd" candidate_uuid: "129c763b69224d7e9b2187721e58adeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "72d4afb41b7245b4b382fb9e2c6edf59"
I20260709 12:27:14.171553  2327 raft_consensus.cc:3060] T cb73a7a0e4004a1bbab977eb0c11d8dd P 72d4afb41b7245b4b382fb9e2c6edf59 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:14.171518  2401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb73a7a0e4004a1bbab977eb0c11d8dd" candidate_uuid: "129c763b69224d7e9b2187721e58adeb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19566de89ecf48aca9903d8bfdd5d936"
I20260709 12:27:14.178840  2401 raft_consensus.cc:3060] T cb73a7a0e4004a1bbab977eb0c11d8dd P 19566de89ecf48aca9903d8bfdd5d936 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:14.179589  2327 raft_consensus.cc:2468] T cb73a7a0e4004a1bbab977eb0c11d8dd P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 129c763b69224d7e9b2187721e58adeb in term 1.
I20260709 12:27:14.180866  2218 leader_election.cc:304] T cb73a7a0e4004a1bbab977eb0c11d8dd P 129c763b69224d7e9b2187721e58adeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 129c763b69224d7e9b2187721e58adeb, 72d4afb41b7245b4b382fb9e2c6edf59; no voters: 
I20260709 12:27:14.181648  2458 raft_consensus.cc:2804] T cb73a7a0e4004a1bbab977eb0c11d8dd P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:14.182138  2458 raft_consensus.cc:697] T cb73a7a0e4004a1bbab977eb0c11d8dd P 129c763b69224d7e9b2187721e58adeb [term 1 LEADER]: Becoming Leader. State: Replica: 129c763b69224d7e9b2187721e58adeb, State: Running, Role: LEADER
I20260709 12:27:14.183007  2458 consensus_queue.cc:237] T cb73a7a0e4004a1bbab977eb0c11d8dd P 129c763b69224d7e9b2187721e58adeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:14.184759  2488 leader_election.cc:290] T cb73a7a0e4004a1bbab977eb0c11d8dd P 129c763b69224d7e9b2187721e58adeb [CANDIDATE]: Term 1 election: Requested vote from peers 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130:42771), 19566de89ecf48aca9903d8bfdd5d936 (127.23.245.131:38763)
I20260709 12:27:14.188927  2401 raft_consensus.cc:2468] T cb73a7a0e4004a1bbab977eb0c11d8dd P 19566de89ecf48aca9903d8bfdd5d936 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 129c763b69224d7e9b2187721e58adeb in term 1.
I20260709 12:27:14.192937  2148 catalog_manager.cc:5697] T cb73a7a0e4004a1bbab977eb0c11d8dd P 129c763b69224d7e9b2187721e58adeb reported cstate change: term changed from 0 to 1, leader changed from <none> to 129c763b69224d7e9b2187721e58adeb (127.23.245.129). New cstate: current_term: 1 leader_uuid: "129c763b69224d7e9b2187721e58adeb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:14.268862  2500 consensus_queue.cc:1048] T 100dcbf9addf448bba05f170b5051802 P 72d4afb41b7245b4b382fb9e2c6edf59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:14.280035  2499 consensus_queue.cc:1048] T 100dcbf9addf448bba05f170b5051802 P 72d4afb41b7245b4b382fb9e2c6edf59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:14.300261  2499 consensus_queue.cc:1048] T d36e6c0657bd486b939805a704e580af P 72d4afb41b7245b4b382fb9e2c6edf59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:14.313184  2499 consensus_queue.cc:1048] T d36e6c0657bd486b939805a704e580af P 72d4afb41b7245b4b382fb9e2c6edf59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:14.378284  2462 consensus_queue.cc:1048] T 4915b590d3df467182d6ec1e3e5b7b9d P 19566de89ecf48aca9903d8bfdd5d936 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:27:14.388257  2498 consensus_queue.cc:1048] T 4915b590d3df467182d6ec1e3e5b7b9d P 19566de89ecf48aca9903d8bfdd5d936 [LEADER]: Connected to new peer: Peer: permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:14.393945 24534 ts_manager.cc:295] Set tserver state for 129c763b69224d7e9b2187721e58adeb to MAINTENANCE_MODE
I20260709 12:27:14.395642 24534 tablet_server.cc:179] TabletServer@127.23.245.129:0 shutting down...
W20260709 12:27:14.419631  2364 consensus_peers.cc:597] T 4915b590d3df467182d6ec1e3e5b7b9d P 19566de89ecf48aca9903d8bfdd5d936 -> Peer 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605): Couldn't send request to peer 129c763b69224d7e9b2187721e58adeb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:14.475713  2458 consensus_queue.cc:1048] T 372666c8d7a84b429fe9df7c121e0bcf P 129c763b69224d7e9b2187721e58adeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:14.476871 24534 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:14.477804 24534 tablet_replica.cc:333] T 100dcbf9addf448bba05f170b5051802 P 129c763b69224d7e9b2187721e58adeb: stopping tablet replica
I20260709 12:27:14.478953 24534 raft_consensus.cc:2243] T 100dcbf9addf448bba05f170b5051802 P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:14.480072 24534 raft_consensus.cc:2272] T 100dcbf9addf448bba05f170b5051802 P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:14.488596 24534 tablet_replica.cc:333] T 1797eb20c76642c3912213b96a0156bb P 129c763b69224d7e9b2187721e58adeb: stopping tablet replica
I20260709 12:27:14.489913 24534 raft_consensus.cc:2243] T 1797eb20c76642c3912213b96a0156bb P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:14.491256 24534 raft_consensus.cc:2272] T 1797eb20c76642c3912213b96a0156bb P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:14.493921  2488 consensus_queue.cc:1048] T 372666c8d7a84b429fe9df7c121e0bcf P 129c763b69224d7e9b2187721e58adeb [LEADER]: Connected to new peer: Peer: permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:14.498039 24534 tablet_replica.cc:333] T 372666c8d7a84b429fe9df7c121e0bcf P 129c763b69224d7e9b2187721e58adeb: stopping tablet replica
I20260709 12:27:14.499279 24534 raft_consensus.cc:2243] T 372666c8d7a84b429fe9df7c121e0bcf P 129c763b69224d7e9b2187721e58adeb [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:14.500660 24534 raft_consensus.cc:2272] T 372666c8d7a84b429fe9df7c121e0bcf P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:14.505199 24534 tablet_replica.cc:333] T a4decfc5493a43e9bb1dca65d85388e7 P 129c763b69224d7e9b2187721e58adeb: stopping tablet replica
I20260709 12:27:14.506412 24534 raft_consensus.cc:2243] T a4decfc5493a43e9bb1dca65d85388e7 P 129c763b69224d7e9b2187721e58adeb [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:14.508463 24534 raft_consensus.cc:2272] T a4decfc5493a43e9bb1dca65d85388e7 P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:14.513386 24534 tablet_replica.cc:333] T 4915b590d3df467182d6ec1e3e5b7b9d P 129c763b69224d7e9b2187721e58adeb: stopping tablet replica
I20260709 12:27:14.514225 24534 raft_consensus.cc:2243] T 4915b590d3df467182d6ec1e3e5b7b9d P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:27:14.514698  2290 consensus_peers.cc:597] T ea09120684274446b5c0965e6a6a9b4c P 72d4afb41b7245b4b382fb9e2c6edf59 -> Peer 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605): Couldn't send request to peer 129c763b69224d7e9b2187721e58adeb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:14.516122 24534 pending_rounds.cc:70] T 4915b590d3df467182d6ec1e3e5b7b9d P 129c763b69224d7e9b2187721e58adeb: Trying to abort 1 pending ops.
I20260709 12:27:14.516463 24534 pending_rounds.cc:77] T 4915b590d3df467182d6ec1e3e5b7b9d P 129c763b69224d7e9b2187721e58adeb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305625738744606720 op_type: NO_OP noop_request { }
I20260709 12:27:14.516896 24534 raft_consensus.cc:2889] T 4915b590d3df467182d6ec1e3e5b7b9d P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:27:14.517249 24534 raft_consensus.cc:2272] T 4915b590d3df467182d6ec1e3e5b7b9d P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:14.520750 24534 tablet_replica.cc:333] T 1523f5077995462b83bfa389d020880b P 129c763b69224d7e9b2187721e58adeb: stopping tablet replica
I20260709 12:27:14.521610 24534 raft_consensus.cc:2243] T 1523f5077995462b83bfa389d020880b P 129c763b69224d7e9b2187721e58adeb [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:14.523528 24534 raft_consensus.cc:2272] T 1523f5077995462b83bfa389d020880b P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:14.527460 24534 tablet_replica.cc:333] T d36e6c0657bd486b939805a704e580af P 129c763b69224d7e9b2187721e58adeb: stopping tablet replica
I20260709 12:27:14.528291 24534 raft_consensus.cc:2243] T d36e6c0657bd486b939805a704e580af P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:14.528848 24534 raft_consensus.cc:2272] T d36e6c0657bd486b939805a704e580af P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:14.532078 24534 tablet_replica.cc:333] T de5c5dbcf4844dab833043ea584da490 P 129c763b69224d7e9b2187721e58adeb: stopping tablet replica
I20260709 12:27:14.532563 24534 raft_consensus.cc:2243] T de5c5dbcf4844dab833043ea584da490 P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:14.533001 24534 raft_consensus.cc:2272] T de5c5dbcf4844dab833043ea584da490 P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:14.535840 24534 tablet_replica.cc:333] T cb73a7a0e4004a1bbab977eb0c11d8dd P 129c763b69224d7e9b2187721e58adeb: stopping tablet replica
I20260709 12:27:14.536693 24534 raft_consensus.cc:2243] T cb73a7a0e4004a1bbab977eb0c11d8dd P 129c763b69224d7e9b2187721e58adeb [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:14.537550 24534 pending_rounds.cc:70] T cb73a7a0e4004a1bbab977eb0c11d8dd P 129c763b69224d7e9b2187721e58adeb: Trying to abort 1 pending ops.
I20260709 12:27:14.537773 24534 pending_rounds.cc:77] T cb73a7a0e4004a1bbab977eb0c11d8dd P 129c763b69224d7e9b2187721e58adeb: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305625740021653504 op_type: NO_OP noop_request { }
I20260709 12:27:14.538074 24534 raft_consensus.cc:2889] T cb73a7a0e4004a1bbab977eb0c11d8dd P 129c763b69224d7e9b2187721e58adeb [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:27:14.538403 24534 raft_consensus.cc:2272] T cb73a7a0e4004a1bbab977eb0c11d8dd P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:14.541705 24534 tablet_replica.cc:333] T ea09120684274446b5c0965e6a6a9b4c P 129c763b69224d7e9b2187721e58adeb: stopping tablet replica
I20260709 12:27:14.542248 24534 raft_consensus.cc:2243] T ea09120684274446b5c0965e6a6a9b4c P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:14.542872 24534 raft_consensus.cc:2272] T ea09120684274446b5c0965e6a6a9b4c P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:14.559588  2364 consensus_peers.cc:597] T 1797eb20c76642c3912213b96a0156bb P 19566de89ecf48aca9903d8bfdd5d936 -> Peer 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605): Couldn't send request to peer 129c763b69224d7e9b2187721e58adeb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:14.581605 24534 tablet_server.cc:196] TabletServer@127.23.245.129:0 shutdown complete.
W20260709 12:27:14.681892  2290 consensus_peers.cc:597] T 100dcbf9addf448bba05f170b5051802 P 72d4afb41b7245b4b382fb9e2c6edf59 -> Peer 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605): Couldn't send request to peer 129c763b69224d7e9b2187721e58adeb. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:35605: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:14.769068  2364 consensus_peers.cc:597] T de5c5dbcf4844dab833043ea584da490 P 19566de89ecf48aca9903d8bfdd5d936 -> Peer 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605): Couldn't send request to peer 129c763b69224d7e9b2187721e58adeb. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:35605: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:14.846872  2290 consensus_peers.cc:597] T d36e6c0657bd486b939805a704e580af P 72d4afb41b7245b4b382fb9e2c6edf59 -> Peer 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605): Couldn't send request to peer 129c763b69224d7e9b2187721e58adeb. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:35605: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:15.299113  2198 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:27:15.426797  2364 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.245.129:35605: connect: Connection refused (error 111) [suppressed 122 similar messages]
I20260709 12:27:15.615859  2499 raft_consensus.cc:493] T 1523f5077995462b83bfa389d020880b P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 129c763b69224d7e9b2187721e58adeb)
I20260709 12:27:15.616466  2499 raft_consensus.cc:515] T 1523f5077995462b83bfa389d020880b P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:15.618484  2499 leader_election.cc:290] T 1523f5077995462b83bfa389d020880b P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605), 19566de89ecf48aca9903d8bfdd5d936 (127.23.245.131:38763)
I20260709 12:27:15.619743  2401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1523f5077995462b83bfa389d020880b" candidate_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "19566de89ecf48aca9903d8bfdd5d936" is_pre_election: true
W20260709 12:27:15.622176  2290 leader_election.cc:336] T 1523f5077995462b83bfa389d020880b P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605): Network error: Client connection negotiation failed: client connection to 127.23.245.129:35605: connect: Connection refused (error 111)
I20260709 12:27:15.622628  2290 leader_election.cc:304] T 1523f5077995462b83bfa389d020880b P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d4afb41b7245b4b382fb9e2c6edf59; no voters: 129c763b69224d7e9b2187721e58adeb, 19566de89ecf48aca9903d8bfdd5d936
I20260709 12:27:15.623301  2499 raft_consensus.cc:2749] T 1523f5077995462b83bfa389d020880b P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:15.666915  2462 raft_consensus.cc:493] T a4decfc5493a43e9bb1dca65d85388e7 P 19566de89ecf48aca9903d8bfdd5d936 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 129c763b69224d7e9b2187721e58adeb)
I20260709 12:27:15.667577  2462 raft_consensus.cc:515] T a4decfc5493a43e9bb1dca65d85388e7 P 19566de89ecf48aca9903d8bfdd5d936 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:15.668362  2499 raft_consensus.cc:493] T a4decfc5493a43e9bb1dca65d85388e7 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 129c763b69224d7e9b2187721e58adeb)
I20260709 12:27:15.669134  2499 raft_consensus.cc:515] T a4decfc5493a43e9bb1dca65d85388e7 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:15.669965  2462 leader_election.cc:290] T a4decfc5493a43e9bb1dca65d85388e7 P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605), 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130:42771)
I20260709 12:27:15.671279  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4decfc5493a43e9bb1dca65d85388e7" candidate_uuid: "19566de89ecf48aca9903d8bfdd5d936" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" is_pre_election: true
I20260709 12:27:15.671794  2499 leader_election.cc:290] T a4decfc5493a43e9bb1dca65d85388e7 P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605), 19566de89ecf48aca9903d8bfdd5d936 (127.23.245.131:38763)
I20260709 12:27:15.672013  2325 raft_consensus.cc:2468] T a4decfc5493a43e9bb1dca65d85388e7 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19566de89ecf48aca9903d8bfdd5d936 in term 1.
I20260709 12:27:15.672502  2401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4decfc5493a43e9bb1dca65d85388e7" candidate_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "19566de89ecf48aca9903d8bfdd5d936" is_pre_election: true
I20260709 12:27:15.673111  2401 raft_consensus.cc:2468] T a4decfc5493a43e9bb1dca65d85388e7 P 19566de89ecf48aca9903d8bfdd5d936 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d4afb41b7245b4b382fb9e2c6edf59 in term 1.
I20260709 12:27:15.673976  2367 leader_election.cc:304] T a4decfc5493a43e9bb1dca65d85388e7 P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19566de89ecf48aca9903d8bfdd5d936, 72d4afb41b7245b4b382fb9e2c6edf59; no voters: 
I20260709 12:27:15.674851  2462 raft_consensus.cc:2804] T a4decfc5493a43e9bb1dca65d85388e7 P 19566de89ecf48aca9903d8bfdd5d936 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:15.675247  2462 raft_consensus.cc:493] T a4decfc5493a43e9bb1dca65d85388e7 P 19566de89ecf48aca9903d8bfdd5d936 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 129c763b69224d7e9b2187721e58adeb)
I20260709 12:27:15.675266  2292 leader_election.cc:304] T a4decfc5493a43e9bb1dca65d85388e7 P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19566de89ecf48aca9903d8bfdd5d936, 72d4afb41b7245b4b382fb9e2c6edf59; no voters: 
I20260709 12:27:15.675674  2462 raft_consensus.cc:3060] T a4decfc5493a43e9bb1dca65d85388e7 P 19566de89ecf48aca9903d8bfdd5d936 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:15.676257  2499 raft_consensus.cc:2804] T a4decfc5493a43e9bb1dca65d85388e7 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:27:15.676446  2364 leader_election.cc:336] T a4decfc5493a43e9bb1dca65d85388e7 P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605): Network error: Client connection negotiation failed: client connection to 127.23.245.129:35605: connect: Connection refused (error 111)
W20260709 12:27:15.676548  2290 leader_election.cc:336] T a4decfc5493a43e9bb1dca65d85388e7 P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605): Network error: Client connection negotiation failed: client connection to 127.23.245.129:35605: connect: Connection refused (error 111)
I20260709 12:27:15.676690  2499 raft_consensus.cc:493] T a4decfc5493a43e9bb1dca65d85388e7 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 129c763b69224d7e9b2187721e58adeb)
I20260709 12:27:15.677853  2499 raft_consensus.cc:3060] T a4decfc5493a43e9bb1dca65d85388e7 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:15.684810  2462 raft_consensus.cc:515] T a4decfc5493a43e9bb1dca65d85388e7 P 19566de89ecf48aca9903d8bfdd5d936 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:15.685667  2499 raft_consensus.cc:515] T a4decfc5493a43e9bb1dca65d85388e7 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:15.686758  2462 leader_election.cc:290] T a4decfc5493a43e9bb1dca65d85388e7 P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 2 election: Requested vote from peers 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605), 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130:42771)
I20260709 12:27:15.688045  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4decfc5493a43e9bb1dca65d85388e7" candidate_uuid: "19566de89ecf48aca9903d8bfdd5d936" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d4afb41b7245b4b382fb9e2c6edf59"
I20260709 12:27:15.688589  2499 leader_election.cc:290] T a4decfc5493a43e9bb1dca65d85388e7 P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 2 election: Requested vote from peers 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605), 19566de89ecf48aca9903d8bfdd5d936 (127.23.245.131:38763)
I20260709 12:27:15.688884  2325 raft_consensus.cc:2393] T a4decfc5493a43e9bb1dca65d85388e7 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 19566de89ecf48aca9903d8bfdd5d936 in current term 2: Already voted for candidate 72d4afb41b7245b4b382fb9e2c6edf59 in this term.
I20260709 12:27:15.689900  2401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4decfc5493a43e9bb1dca65d85388e7" candidate_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "19566de89ecf48aca9903d8bfdd5d936"
I20260709 12:27:15.690750  2401 raft_consensus.cc:2393] T a4decfc5493a43e9bb1dca65d85388e7 P 19566de89ecf48aca9903d8bfdd5d936 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 72d4afb41b7245b4b382fb9e2c6edf59 in current term 2: Already voted for candidate 19566de89ecf48aca9903d8bfdd5d936 in this term.
W20260709 12:27:15.691532  2364 leader_election.cc:336] T a4decfc5493a43e9bb1dca65d85388e7 P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605): Network error: Client connection negotiation failed: client connection to 127.23.245.129:35605: connect: Connection refused (error 111)
I20260709 12:27:15.691980  2364 leader_election.cc:304] T a4decfc5493a43e9bb1dca65d85388e7 P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19566de89ecf48aca9903d8bfdd5d936; no voters: 129c763b69224d7e9b2187721e58adeb, 72d4afb41b7245b4b382fb9e2c6edf59
I20260709 12:27:15.692620  2462 raft_consensus.cc:2749] T a4decfc5493a43e9bb1dca65d85388e7 P 19566de89ecf48aca9903d8bfdd5d936 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:27:15.692906  2290 leader_election.cc:336] T a4decfc5493a43e9bb1dca65d85388e7 P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605): Network error: Client connection negotiation failed: client connection to 127.23.245.129:35605: connect: Connection refused (error 111)
I20260709 12:27:15.693344  2290 leader_election.cc:304] T a4decfc5493a43e9bb1dca65d85388e7 P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 72d4afb41b7245b4b382fb9e2c6edf59; no voters: 129c763b69224d7e9b2187721e58adeb, 19566de89ecf48aca9903d8bfdd5d936
I20260709 12:27:15.693920  2499 raft_consensus.cc:2749] T a4decfc5493a43e9bb1dca65d85388e7 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:27:15.995764  2499 raft_consensus.cc:493] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 129c763b69224d7e9b2187721e58adeb)
I20260709 12:27:15.996263  2499 raft_consensus.cc:515] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:15.998070  2499 leader_election.cc:290] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605), 19566de89ecf48aca9903d8bfdd5d936 (127.23.245.131:38763)
I20260709 12:27:15.998834  2462 raft_consensus.cc:493] T 372666c8d7a84b429fe9df7c121e0bcf P 19566de89ecf48aca9903d8bfdd5d936 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 129c763b69224d7e9b2187721e58adeb)
I20260709 12:27:15.999495  2401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372666c8d7a84b429fe9df7c121e0bcf" candidate_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "19566de89ecf48aca9903d8bfdd5d936" is_pre_election: true
I20260709 12:27:15.999394  2462 raft_consensus.cc:515] T 372666c8d7a84b429fe9df7c121e0bcf P 19566de89ecf48aca9903d8bfdd5d936 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:16.000910  2401 raft_consensus.cc:2468] T 372666c8d7a84b429fe9df7c121e0bcf P 19566de89ecf48aca9903d8bfdd5d936 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d4afb41b7245b4b382fb9e2c6edf59 in term 1.
I20260709 12:27:16.002053  2462 leader_election.cc:290] T 372666c8d7a84b429fe9df7c121e0bcf P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605), 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130:42771)
I20260709 12:27:16.002326  2292 leader_election.cc:304] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19566de89ecf48aca9903d8bfdd5d936, 72d4afb41b7245b4b382fb9e2c6edf59; no voters: 
W20260709 12:27:16.002946  2290 leader_election.cc:336] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605): Network error: Client connection negotiation failed: client connection to 127.23.245.129:35605: connect: Connection refused (error 111)
I20260709 12:27:16.003247  2499 raft_consensus.cc:2804] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:16.003646  2499 raft_consensus.cc:493] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 129c763b69224d7e9b2187721e58adeb)
I20260709 12:27:16.004010  2499 raft_consensus.cc:3060] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:16.004900  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372666c8d7a84b429fe9df7c121e0bcf" candidate_uuid: "19566de89ecf48aca9903d8bfdd5d936" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" is_pre_election: true
W20260709 12:27:16.006048  2364 leader_election.cc:336] T 372666c8d7a84b429fe9df7c121e0bcf P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605): Network error: Client connection negotiation failed: client connection to 127.23.245.129:35605: connect: Connection refused (error 111)
I20260709 12:27:16.010803  2499 raft_consensus.cc:515] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:16.011854  2325 raft_consensus.cc:2393] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 19566de89ecf48aca9903d8bfdd5d936 in current term 2: Already voted for candidate 72d4afb41b7245b4b382fb9e2c6edf59 in this term.
I20260709 12:27:16.012926  2499 leader_election.cc:290] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 2 election: Requested vote from peers 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605), 19566de89ecf48aca9903d8bfdd5d936 (127.23.245.131:38763)
I20260709 12:27:16.014231  2401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372666c8d7a84b429fe9df7c121e0bcf" candidate_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "19566de89ecf48aca9903d8bfdd5d936"
I20260709 12:27:16.014835  2401 raft_consensus.cc:3060] T 372666c8d7a84b429fe9df7c121e0bcf P 19566de89ecf48aca9903d8bfdd5d936 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:16.015290  2367 leader_election.cc:304] T 372666c8d7a84b429fe9df7c121e0bcf P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 19566de89ecf48aca9903d8bfdd5d936; no voters: 129c763b69224d7e9b2187721e58adeb, 72d4afb41b7245b4b382fb9e2c6edf59
W20260709 12:27:16.017027  2290 leader_election.cc:336] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605): Network error: Client connection negotiation failed: client connection to 127.23.245.129:35605: connect: Connection refused (error 111)
I20260709 12:27:16.019073  2533 raft_consensus.cc:493] T 1523f5077995462b83bfa389d020880b P 19566de89ecf48aca9903d8bfdd5d936 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 129c763b69224d7e9b2187721e58adeb)
I20260709 12:27:16.019642  2533 raft_consensus.cc:515] T 1523f5077995462b83bfa389d020880b P 19566de89ecf48aca9903d8bfdd5d936 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:16.021953  2533 leader_election.cc:290] T 1523f5077995462b83bfa389d020880b P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605), 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130:42771)
I20260709 12:27:16.023056  2401 raft_consensus.cc:2468] T 372666c8d7a84b429fe9df7c121e0bcf P 19566de89ecf48aca9903d8bfdd5d936 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d4afb41b7245b4b382fb9e2c6edf59 in term 2.
I20260709 12:27:16.023137  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1523f5077995462b83bfa389d020880b" candidate_uuid: "19566de89ecf48aca9903d8bfdd5d936" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" is_pre_election: true
I20260709 12:27:16.023736  2462 raft_consensus.cc:2749] T 372666c8d7a84b429fe9df7c121e0bcf P 19566de89ecf48aca9903d8bfdd5d936 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:16.024022  2325 raft_consensus.cc:2468] T 1523f5077995462b83bfa389d020880b P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 19566de89ecf48aca9903d8bfdd5d936 in term 1.
I20260709 12:27:16.024593  2292 leader_election.cc:304] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19566de89ecf48aca9903d8bfdd5d936, 72d4afb41b7245b4b382fb9e2c6edf59; no voters: 129c763b69224d7e9b2187721e58adeb
I20260709 12:27:16.025509  2367 leader_election.cc:304] T 1523f5077995462b83bfa389d020880b P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19566de89ecf48aca9903d8bfdd5d936, 72d4afb41b7245b4b382fb9e2c6edf59; no voters: 
I20260709 12:27:16.025813  2499 raft_consensus.cc:2804] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:27:16.026229  2364 leader_election.cc:336] T 1523f5077995462b83bfa389d020880b P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605): Network error: Client connection negotiation failed: client connection to 127.23.245.129:35605: connect: Connection refused (error 111)
I20260709 12:27:16.026407  2462 raft_consensus.cc:2804] T 1523f5077995462b83bfa389d020880b P 19566de89ecf48aca9903d8bfdd5d936 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:16.026541  2499 raft_consensus.cc:697] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [term 2 LEADER]: Becoming Leader. State: Replica: 72d4afb41b7245b4b382fb9e2c6edf59, State: Running, Role: LEADER
I20260709 12:27:16.026872  2462 raft_consensus.cc:493] T 1523f5077995462b83bfa389d020880b P 19566de89ecf48aca9903d8bfdd5d936 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 129c763b69224d7e9b2187721e58adeb)
I20260709 12:27:16.027347  2462 raft_consensus.cc:3060] T 1523f5077995462b83bfa389d020880b P 19566de89ecf48aca9903d8bfdd5d936 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:16.027842  2499 consensus_queue.cc:237] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:16.034973  2462 raft_consensus.cc:515] T 1523f5077995462b83bfa389d020880b P 19566de89ecf48aca9903d8bfdd5d936 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:16.035073  2150 catalog_manager.cc:5697] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 reported cstate change: term changed from 1 to 2, leader changed from 129c763b69224d7e9b2187721e58adeb (127.23.245.129) to 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130). New cstate: current_term: 2 leader_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:16.036912  2462 leader_election.cc:290] T 1523f5077995462b83bfa389d020880b P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 2 election: Requested vote from peers 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605), 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130:42771)
I20260709 12:27:16.039496  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1523f5077995462b83bfa389d020880b" candidate_uuid: "19566de89ecf48aca9903d8bfdd5d936" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "72d4afb41b7245b4b382fb9e2c6edf59"
I20260709 12:27:16.041570  2325 raft_consensus.cc:3060] T 1523f5077995462b83bfa389d020880b P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:27:16.041707  2364 leader_election.cc:336] T 1523f5077995462b83bfa389d020880b P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605): Network error: Client connection negotiation failed: client connection to 127.23.245.129:35605: connect: Connection refused (error 111)
I20260709 12:27:16.049773  2325 raft_consensus.cc:2468] T 1523f5077995462b83bfa389d020880b P 72d4afb41b7245b4b382fb9e2c6edf59 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19566de89ecf48aca9903d8bfdd5d936 in term 2.
I20260709 12:27:16.050945  2367 leader_election.cc:304] T 1523f5077995462b83bfa389d020880b P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19566de89ecf48aca9903d8bfdd5d936, 72d4afb41b7245b4b382fb9e2c6edf59; no voters: 129c763b69224d7e9b2187721e58adeb
I20260709 12:27:16.052376  2462 raft_consensus.cc:2804] T 1523f5077995462b83bfa389d020880b P 19566de89ecf48aca9903d8bfdd5d936 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:16.052850  2462 raft_consensus.cc:697] T 1523f5077995462b83bfa389d020880b P 19566de89ecf48aca9903d8bfdd5d936 [term 2 LEADER]: Becoming Leader. State: Replica: 19566de89ecf48aca9903d8bfdd5d936, State: Running, Role: LEADER
I20260709 12:27:16.053989  2462 consensus_queue.cc:237] T 1523f5077995462b83bfa389d020880b P 19566de89ecf48aca9903d8bfdd5d936 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:16.063745  2150 catalog_manager.cc:5697] T 1523f5077995462b83bfa389d020880b P 19566de89ecf48aca9903d8bfdd5d936 reported cstate change: term changed from 1 to 2, leader changed from 129c763b69224d7e9b2187721e58adeb (127.23.245.129) to 19566de89ecf48aca9903d8bfdd5d936 (127.23.245.131). New cstate: current_term: 2 leader_uuid: "19566de89ecf48aca9903d8bfdd5d936" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } health_report { overall_health: HEALTHY } } }
W20260709 12:27:16.300074  2198 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:27:16.368027  2499 raft_consensus.cc:493] T cb73a7a0e4004a1bbab977eb0c11d8dd P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.368676  2499 raft_consensus.cc:515] T cb73a7a0e4004a1bbab977eb0c11d8dd P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:16.370500  2499 leader_election.cc:290] T cb73a7a0e4004a1bbab977eb0c11d8dd P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605), 19566de89ecf48aca9903d8bfdd5d936 (127.23.245.131:38763)
I20260709 12:27:16.371810  2401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb73a7a0e4004a1bbab977eb0c11d8dd" candidate_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19566de89ecf48aca9903d8bfdd5d936" is_pre_election: true
I20260709 12:27:16.372630  2401 raft_consensus.cc:2468] T cb73a7a0e4004a1bbab977eb0c11d8dd P 19566de89ecf48aca9903d8bfdd5d936 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d4afb41b7245b4b382fb9e2c6edf59 in term 1.
I20260709 12:27:16.373781  2292 leader_election.cc:304] T cb73a7a0e4004a1bbab977eb0c11d8dd P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19566de89ecf48aca9903d8bfdd5d936, 72d4afb41b7245b4b382fb9e2c6edf59; no voters: 
I20260709 12:27:16.374581  2499 raft_consensus.cc:2804] T cb73a7a0e4004a1bbab977eb0c11d8dd P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:27:16.374583  2290 leader_election.cc:336] T cb73a7a0e4004a1bbab977eb0c11d8dd P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605): Network error: Client connection negotiation failed: client connection to 127.23.245.129:35605: connect: Connection refused (error 111)
I20260709 12:27:16.375030  2499 raft_consensus.cc:493] T cb73a7a0e4004a1bbab977eb0c11d8dd P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:16.375393  2499 raft_consensus.cc:3060] T cb73a7a0e4004a1bbab977eb0c11d8dd P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:16.381337  2499 raft_consensus.cc:515] T cb73a7a0e4004a1bbab977eb0c11d8dd P 72d4afb41b7245b4b382fb9e2c6edf59 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:16.383028  2499 leader_election.cc:290] T cb73a7a0e4004a1bbab977eb0c11d8dd P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 2 election: Requested vote from peers 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605), 19566de89ecf48aca9903d8bfdd5d936 (127.23.245.131:38763)
I20260709 12:27:16.384433  2401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb73a7a0e4004a1bbab977eb0c11d8dd" candidate_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "19566de89ecf48aca9903d8bfdd5d936"
I20260709 12:27:16.385128  2401 raft_consensus.cc:3060] T cb73a7a0e4004a1bbab977eb0c11d8dd P 19566de89ecf48aca9903d8bfdd5d936 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:27:16.386978  2290 leader_election.cc:336] T cb73a7a0e4004a1bbab977eb0c11d8dd P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605): Network error: Client connection negotiation failed: client connection to 127.23.245.129:35605: connect: Connection refused (error 111)
I20260709 12:27:16.391240  2401 raft_consensus.cc:2468] T cb73a7a0e4004a1bbab977eb0c11d8dd P 19566de89ecf48aca9903d8bfdd5d936 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d4afb41b7245b4b382fb9e2c6edf59 in term 2.
I20260709 12:27:16.392433  2292 leader_election.cc:304] T cb73a7a0e4004a1bbab977eb0c11d8dd P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19566de89ecf48aca9903d8bfdd5d936, 72d4afb41b7245b4b382fb9e2c6edf59; no voters: 129c763b69224d7e9b2187721e58adeb
I20260709 12:27:16.393136  2499 raft_consensus.cc:2804] T cb73a7a0e4004a1bbab977eb0c11d8dd P 72d4afb41b7245b4b382fb9e2c6edf59 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:16.393671  2499 raft_consensus.cc:697] T cb73a7a0e4004a1bbab977eb0c11d8dd P 72d4afb41b7245b4b382fb9e2c6edf59 [term 2 LEADER]: Becoming Leader. State: Replica: 72d4afb41b7245b4b382fb9e2c6edf59, State: Running, Role: LEADER
I20260709 12:27:16.394742  2499 consensus_queue.cc:237] T cb73a7a0e4004a1bbab977eb0c11d8dd P 72d4afb41b7245b4b382fb9e2c6edf59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:16.402611  2150 catalog_manager.cc:5697] T cb73a7a0e4004a1bbab977eb0c11d8dd P 72d4afb41b7245b4b382fb9e2c6edf59 reported cstate change: term changed from 1 to 2, leader changed from 129c763b69224d7e9b2187721e58adeb (127.23.245.129) to 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130). New cstate: current_term: 2 leader_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } health_report { overall_health: UNKNOWN } } }
W20260709 12:27:16.510130  2364 consensus_peers.cc:597] T 1523f5077995462b83bfa389d020880b P 19566de89ecf48aca9903d8bfdd5d936 -> Peer 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605): Couldn't send request to peer 129c763b69224d7e9b2187721e58adeb. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:35605: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:16.551471  2401 raft_consensus.cc:1275] T 372666c8d7a84b429fe9df7c121e0bcf P 19566de89ecf48aca9903d8bfdd5d936 [term 2 FOLLOWER]: Refusing update from remote peer 72d4afb41b7245b4b382fb9e2c6edf59: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:16.553233  2500 consensus_queue.cc:1048] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:27:16.566962  2290 consensus_peers.cc:597] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 -> Peer 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605): Couldn't send request to peer 129c763b69224d7e9b2187721e58adeb. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:35605: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:16.679103  2325 raft_consensus.cc:1275] T 1523f5077995462b83bfa389d020880b P 72d4afb41b7245b4b382fb9e2c6edf59 [term 2 FOLLOWER]: Refusing update from remote peer 19566de89ecf48aca9903d8bfdd5d936: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:16.680449  2462 consensus_queue.cc:1048] T 1523f5077995462b83bfa389d020880b P 19566de89ecf48aca9903d8bfdd5d936 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:27:16.697795  2364 consensus_peers.cc:597] T 4915b590d3df467182d6ec1e3e5b7b9d P 19566de89ecf48aca9903d8bfdd5d936 -> Peer 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605): Couldn't send request to peer 129c763b69224d7e9b2187721e58adeb. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:35605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:16.786914  2401 raft_consensus.cc:1275] T cb73a7a0e4004a1bbab977eb0c11d8dd P 19566de89ecf48aca9903d8bfdd5d936 [term 2 FOLLOWER]: Refusing update from remote peer 72d4afb41b7245b4b382fb9e2c6edf59: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:27:16.788585  2499 consensus_queue.cc:1048] T cb73a7a0e4004a1bbab977eb0c11d8dd P 72d4afb41b7245b4b382fb9e2c6edf59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:27:16.803321  2290 consensus_peers.cc:597] T cb73a7a0e4004a1bbab977eb0c11d8dd P 72d4afb41b7245b4b382fb9e2c6edf59 -> Peer 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605): Couldn't send request to peer 129c763b69224d7e9b2187721e58adeb. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:35605: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:16.898197  2290 consensus_peers.cc:597] T ea09120684274446b5c0965e6a6a9b4c P 72d4afb41b7245b4b382fb9e2c6edf59 -> Peer 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605): Couldn't send request to peer 129c763b69224d7e9b2187721e58adeb. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:35605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:17.180351  2364 consensus_peers.cc:597] T de5c5dbcf4844dab833043ea584da490 P 19566de89ecf48aca9903d8bfdd5d936 -> Peer 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605): Couldn't send request to peer 129c763b69224d7e9b2187721e58adeb. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:35605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:17.291735  2364 consensus_peers.cc:597] T 1797eb20c76642c3912213b96a0156bb P 19566de89ecf48aca9903d8bfdd5d936 -> Peer 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605): Couldn't send request to peer 129c763b69224d7e9b2187721e58adeb. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:35605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:17.300963  2198 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:27:17.405417  2290 consensus_peers.cc:597] T 100dcbf9addf448bba05f170b5051802 P 72d4afb41b7245b4b382fb9e2c6edf59 -> Peer 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605): Couldn't send request to peer 129c763b69224d7e9b2187721e58adeb. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:35605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:17.429795  2290 consensus_peers.cc:597] T d36e6c0657bd486b939805a704e580af P 72d4afb41b7245b4b382fb9e2c6edf59 -> Peer 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605): Couldn't send request to peer 129c763b69224d7e9b2187721e58adeb. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:35605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:17.589535  2500 raft_consensus.cc:493] T a4decfc5493a43e9bb1dca65d85388e7 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:17.590102  2500 raft_consensus.cc:515] T a4decfc5493a43e9bb1dca65d85388e7 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:17.592334  2500 leader_election.cc:290] T a4decfc5493a43e9bb1dca65d85388e7 P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605), 19566de89ecf48aca9903d8bfdd5d936 (127.23.245.131:38763)
I20260709 12:27:17.593343  2401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4decfc5493a43e9bb1dca65d85388e7" candidate_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "19566de89ecf48aca9903d8bfdd5d936" is_pre_election: true
I20260709 12:27:17.594040  2401 raft_consensus.cc:2468] T a4decfc5493a43e9bb1dca65d85388e7 P 19566de89ecf48aca9903d8bfdd5d936 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 72d4afb41b7245b4b382fb9e2c6edf59 in term 2.
I20260709 12:27:17.595156  2292 leader_election.cc:304] T a4decfc5493a43e9bb1dca65d85388e7 P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 19566de89ecf48aca9903d8bfdd5d936, 72d4afb41b7245b4b382fb9e2c6edf59; no voters: 
I20260709 12:27:17.596011  2500 raft_consensus.cc:2804] T a4decfc5493a43e9bb1dca65d85388e7 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:17.596418  2500 raft_consensus.cc:493] T a4decfc5493a43e9bb1dca65d85388e7 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:17.596545  2290 leader_election.cc:336] T a4decfc5493a43e9bb1dca65d85388e7 P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605): Network error: Client connection negotiation failed: client connection to 127.23.245.129:35605: connect: Connection refused (error 111)
I20260709 12:27:17.596764  2500 raft_consensus.cc:3060] T a4decfc5493a43e9bb1dca65d85388e7 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:17.604310  2500 raft_consensus.cc:515] T a4decfc5493a43e9bb1dca65d85388e7 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:17.606158  2500 leader_election.cc:290] T a4decfc5493a43e9bb1dca65d85388e7 P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 3 election: Requested vote from peers 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605), 19566de89ecf48aca9903d8bfdd5d936 (127.23.245.131:38763)
I20260709 12:27:17.607254  2401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4decfc5493a43e9bb1dca65d85388e7" candidate_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "19566de89ecf48aca9903d8bfdd5d936"
I20260709 12:27:17.607951  2401 raft_consensus.cc:3060] T a4decfc5493a43e9bb1dca65d85388e7 P 19566de89ecf48aca9903d8bfdd5d936 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:27:17.610033  2290 leader_election.cc:336] T a4decfc5493a43e9bb1dca65d85388e7 P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605): Network error: Client connection negotiation failed: client connection to 127.23.245.129:35605: connect: Connection refused (error 111)
I20260709 12:27:17.613200  2401 raft_consensus.cc:2468] T a4decfc5493a43e9bb1dca65d85388e7 P 19566de89ecf48aca9903d8bfdd5d936 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d4afb41b7245b4b382fb9e2c6edf59 in term 3.
I20260709 12:27:17.614253  2292 leader_election.cc:304] T a4decfc5493a43e9bb1dca65d85388e7 P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 19566de89ecf48aca9903d8bfdd5d936, 72d4afb41b7245b4b382fb9e2c6edf59; no voters: 129c763b69224d7e9b2187721e58adeb
I20260709 12:27:17.614981  2500 raft_consensus.cc:2804] T a4decfc5493a43e9bb1dca65d85388e7 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:17.615406  2500 raft_consensus.cc:697] T a4decfc5493a43e9bb1dca65d85388e7 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 3 LEADER]: Becoming Leader. State: Replica: 72d4afb41b7245b4b382fb9e2c6edf59, State: Running, Role: LEADER
I20260709 12:27:17.616350  2500 consensus_queue.cc:237] T a4decfc5493a43e9bb1dca65d85388e7 P 72d4afb41b7245b4b382fb9e2c6edf59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:17.628602  2148 catalog_manager.cc:5697] T a4decfc5493a43e9bb1dca65d85388e7 P 72d4afb41b7245b4b382fb9e2c6edf59 reported cstate change: term changed from 1 to 3, leader changed from 129c763b69224d7e9b2187721e58adeb (127.23.245.129) to 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130). New cstate: current_term: 3 leader_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } health_report { overall_health: UNKNOWN } } }
W20260709 12:27:18.043296  2290 consensus_peers.cc:597] T a4decfc5493a43e9bb1dca65d85388e7 P 72d4afb41b7245b4b382fb9e2c6edf59 -> Peer 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605): Couldn't send request to peer 129c763b69224d7e9b2187721e58adeb. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:35605: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:18.046203  2401 raft_consensus.cc:1275] T a4decfc5493a43e9bb1dca65d85388e7 P 19566de89ecf48aca9903d8bfdd5d936 [term 3 FOLLOWER]: Refusing update from remote peer 72d4afb41b7245b4b382fb9e2c6edf59: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:18.047425  2500 consensus_queue.cc:1048] T a4decfc5493a43e9bb1dca65d85388e7 P 72d4afb41b7245b4b382fb9e2c6edf59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:27:18.301998  2198 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:27:18.802436  2364 consensus_peers.cc:597] T 1523f5077995462b83bfa389d020880b P 19566de89ecf48aca9903d8bfdd5d936 -> Peer 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605): Couldn't send request to peer 129c763b69224d7e9b2187721e58adeb. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:35605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:19.176210  2290 consensus_peers.cc:597] T ea09120684274446b5c0965e6a6a9b4c P 72d4afb41b7245b4b382fb9e2c6edf59 -> Peer 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605): Couldn't send request to peer 129c763b69224d7e9b2187721e58adeb. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:35605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:19.266769  2290 consensus_peers.cc:597] T cb73a7a0e4004a1bbab977eb0c11d8dd P 72d4afb41b7245b4b382fb9e2c6edf59 -> Peer 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605): Couldn't send request to peer 129c763b69224d7e9b2187721e58adeb. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:35605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:19.302879  2198 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:27:19.305871  2364 consensus_peers.cc:597] T 4915b590d3df467182d6ec1e3e5b7b9d P 19566de89ecf48aca9903d8bfdd5d936 -> Peer 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605): Couldn't send request to peer 129c763b69224d7e9b2187721e58adeb. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:35605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:19.353726  2290 consensus_peers.cc:597] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 -> Peer 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605): Couldn't send request to peer 129c763b69224d7e9b2187721e58adeb. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:35605: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:19.612118 24534 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:19.619849  2559 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:19.619877  2558 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:19.620846  2561 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:19.622920 24534 server_base.cc:1061] running on GCE node
I20260709 12:27:19.624562 24534 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:19.624846 24534 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:19.625046 24534 hybrid_clock.cc:648] HybridClock initialized: now 1783600039625026 us; error 0 us; skew 500 ppm
I20260709 12:27:19.625641 24534 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:19.629055 24534 webserver.cc:533] Webserver started at http://127.23.245.129:33917/ using document root <none> and password file <none>
I20260709 12:27:19.629733 24534 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:19.629974 24534 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:27:19.634724 24534 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.004s	sys 0.001s
I20260709 12:27:19.639288  2567 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:19.640242 24534 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:27:19.640568 24534 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599704270295-24534-0/minicluster-data/ts-0-root
uuid: "129c763b69224d7e9b2187721e58adeb"
format_stamp: "Formatted at 2026-07-09 12:27:12 on dist-test-slave-mlt7"
I20260709 12:27:19.640947 24534 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599704270295-24534-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599704270295-24534-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599704270295-24534-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:19.664520 24534 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:19.666065 24534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:19.667892 24534 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:19.671564  2574 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 12:27:19.718961  2290 consensus_peers.cc:597] T 100dcbf9addf448bba05f170b5051802 P 72d4afb41b7245b4b382fb9e2c6edf59 -> Peer 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605): Couldn't send request to peer 129c763b69224d7e9b2187721e58adeb. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:35605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:19.721740 24534 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 12:27:19.722113 24534 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.052s	user 0.000s	sys 0.002s
I20260709 12:27:19.722427 24534 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 12:27:19.727414  2574 tablet_bootstrap.cc:492] T 372666c8d7a84b429fe9df7c121e0bcf P 129c763b69224d7e9b2187721e58adeb: Bootstrap starting.
I20260709 12:27:19.740732  2574 tablet_bootstrap.cc:492] T 372666c8d7a84b429fe9df7c121e0bcf P 129c763b69224d7e9b2187721e58adeb: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:19.741605  2574 tablet_bootstrap.cc:492] T 372666c8d7a84b429fe9df7c121e0bcf P 129c763b69224d7e9b2187721e58adeb: Bootstrap complete.
I20260709 12:27:19.742241  2574 ts_tablet_manager.cc:1403] T 372666c8d7a84b429fe9df7c121e0bcf P 129c763b69224d7e9b2187721e58adeb: Time spent bootstrapping tablet: real 0.015s	user 0.000s	sys 0.012s
I20260709 12:27:19.744410  2574 raft_consensus.cc:359] T 372666c8d7a84b429fe9df7c121e0bcf P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:19.744974  2574 raft_consensus.cc:740] T 372666c8d7a84b429fe9df7c121e0bcf P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 129c763b69224d7e9b2187721e58adeb, State: Initialized, Role: FOLLOWER
I20260709 12:27:19.745579  2574 consensus_queue.cc:260] T 372666c8d7a84b429fe9df7c121e0bcf P 129c763b69224d7e9b2187721e58adeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:19.747860  2574 ts_tablet_manager.cc:1434] T 372666c8d7a84b429fe9df7c121e0bcf P 129c763b69224d7e9b2187721e58adeb: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.003s
I20260709 12:27:19.748600  2574 tablet_bootstrap.cc:492] T 1797eb20c76642c3912213b96a0156bb P 129c763b69224d7e9b2187721e58adeb: Bootstrap starting.
I20260709 12:27:19.763756  2574 tablet_bootstrap.cc:492] T 1797eb20c76642c3912213b96a0156bb P 129c763b69224d7e9b2187721e58adeb: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:19.763863 24534 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 12:27:19.764314 24534 ts_tablet_manager.cc:595] Time spent register tablets: real 0.042s	user 0.042s	sys 0.000s
I20260709 12:27:19.764659  2574 tablet_bootstrap.cc:492] T 1797eb20c76642c3912213b96a0156bb P 129c763b69224d7e9b2187721e58adeb: Bootstrap complete.
I20260709 12:27:19.765437  2574 ts_tablet_manager.cc:1403] T 1797eb20c76642c3912213b96a0156bb P 129c763b69224d7e9b2187721e58adeb: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 12:27:19.768325  2574 raft_consensus.cc:359] T 1797eb20c76642c3912213b96a0156bb P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:19.769140  2574 raft_consensus.cc:740] T 1797eb20c76642c3912213b96a0156bb P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 129c763b69224d7e9b2187721e58adeb, State: Initialized, Role: FOLLOWER
I20260709 12:27:19.770069  2574 consensus_queue.cc:260] T 1797eb20c76642c3912213b96a0156bb P 129c763b69224d7e9b2187721e58adeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:19.772238  2574 ts_tablet_manager.cc:1434] T 1797eb20c76642c3912213b96a0156bb P 129c763b69224d7e9b2187721e58adeb: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.004s
I20260709 12:27:19.773178  2574 tablet_bootstrap.cc:492] T 1523f5077995462b83bfa389d020880b P 129c763b69224d7e9b2187721e58adeb: Bootstrap starting.
W20260709 12:27:19.775369  2364 consensus_peers.cc:597] T de5c5dbcf4844dab833043ea584da490 P 19566de89ecf48aca9903d8bfdd5d936 -> Peer 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605): Couldn't send request to peer 129c763b69224d7e9b2187721e58adeb. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:35605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:19.788493  2574 tablet_bootstrap.cc:492] T 1523f5077995462b83bfa389d020880b P 129c763b69224d7e9b2187721e58adeb: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:19.789383  2574 tablet_bootstrap.cc:492] T 1523f5077995462b83bfa389d020880b P 129c763b69224d7e9b2187721e58adeb: Bootstrap complete.
I20260709 12:27:19.789979  2574 ts_tablet_manager.cc:1403] T 1523f5077995462b83bfa389d020880b P 129c763b69224d7e9b2187721e58adeb: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.004s
I20260709 12:27:19.792390  2574 raft_consensus.cc:359] T 1523f5077995462b83bfa389d020880b P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:19.793112  2574 raft_consensus.cc:740] T 1523f5077995462b83bfa389d020880b P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 129c763b69224d7e9b2187721e58adeb, State: Initialized, Role: FOLLOWER
I20260709 12:27:19.793941  2574 consensus_queue.cc:260] T 1523f5077995462b83bfa389d020880b P 129c763b69224d7e9b2187721e58adeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:19.796236  2574 ts_tablet_manager.cc:1434] T 1523f5077995462b83bfa389d020880b P 129c763b69224d7e9b2187721e58adeb: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:27:19.796888  2574 tablet_bootstrap.cc:492] T d36e6c0657bd486b939805a704e580af P 129c763b69224d7e9b2187721e58adeb: Bootstrap starting.
I20260709 12:27:19.811062  2574 tablet_bootstrap.cc:492] T d36e6c0657bd486b939805a704e580af P 129c763b69224d7e9b2187721e58adeb: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:19.811851  2574 tablet_bootstrap.cc:492] T d36e6c0657bd486b939805a704e580af P 129c763b69224d7e9b2187721e58adeb: Bootstrap complete.
I20260709 12:27:19.812438  2574 ts_tablet_manager.cc:1403] T d36e6c0657bd486b939805a704e580af P 129c763b69224d7e9b2187721e58adeb: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 12:27:19.814543  2574 raft_consensus.cc:359] T d36e6c0657bd486b939805a704e580af P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:19.815236  2574 raft_consensus.cc:740] T d36e6c0657bd486b939805a704e580af P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 129c763b69224d7e9b2187721e58adeb, State: Initialized, Role: FOLLOWER
I20260709 12:27:19.815876  2574 consensus_queue.cc:260] T d36e6c0657bd486b939805a704e580af P 129c763b69224d7e9b2187721e58adeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:19.817699  2574 ts_tablet_manager.cc:1434] T d36e6c0657bd486b939805a704e580af P 129c763b69224d7e9b2187721e58adeb: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:27:19.818336  2574 tablet_bootstrap.cc:492] T 4915b590d3df467182d6ec1e3e5b7b9d P 129c763b69224d7e9b2187721e58adeb: Bootstrap starting.
W20260709 12:27:19.825453  2364 consensus_peers.cc:597] T 1797eb20c76642c3912213b96a0156bb P 19566de89ecf48aca9903d8bfdd5d936 -> Peer 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605): Couldn't send request to peer 129c763b69224d7e9b2187721e58adeb. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:35605: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:19.831070  2574 tablet_bootstrap.cc:492] T 4915b590d3df467182d6ec1e3e5b7b9d P 129c763b69224d7e9b2187721e58adeb: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:27:19.831964  2574 tablet_bootstrap.cc:492] T 4915b590d3df467182d6ec1e3e5b7b9d P 129c763b69224d7e9b2187721e58adeb: Bootstrap complete.
I20260709 12:27:19.832516  2574 ts_tablet_manager.cc:1403] T 4915b590d3df467182d6ec1e3e5b7b9d P 129c763b69224d7e9b2187721e58adeb: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.004s
I20260709 12:27:19.833192 24534 rpc_server.cc:307] RPC server started. Bound to: 127.23.245.129:35605
I20260709 12:27:19.833364  2636 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.245.129:35605 every 8 connection(s)
I20260709 12:27:19.834745  2574 raft_consensus.cc:359] T 4915b590d3df467182d6ec1e3e5b7b9d P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:19.835443  2574 raft_consensus.cc:740] T 4915b590d3df467182d6ec1e3e5b7b9d P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 129c763b69224d7e9b2187721e58adeb, State: Initialized, Role: FOLLOWER
I20260709 12:27:19.836066  2574 consensus_queue.cc:260] T 4915b590d3df467182d6ec1e3e5b7b9d P 129c763b69224d7e9b2187721e58adeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:19.837720  2574 ts_tablet_manager.cc:1434] T 4915b590d3df467182d6ec1e3e5b7b9d P 129c763b69224d7e9b2187721e58adeb: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:27:19.838093 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:19.838601  2574 tablet_bootstrap.cc:492] T 100dcbf9addf448bba05f170b5051802 P 129c763b69224d7e9b2187721e58adeb: Bootstrap starting.
I20260709 12:27:19.859218  2574 tablet_bootstrap.cc:492] T 100dcbf9addf448bba05f170b5051802 P 129c763b69224d7e9b2187721e58adeb: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:19.860167  2574 tablet_bootstrap.cc:492] T 100dcbf9addf448bba05f170b5051802 P 129c763b69224d7e9b2187721e58adeb: Bootstrap complete.
I20260709 12:27:19.860873  2574 ts_tablet_manager.cc:1403] T 100dcbf9addf448bba05f170b5051802 P 129c763b69224d7e9b2187721e58adeb: Time spent bootstrapping tablet: real 0.022s	user 0.018s	sys 0.002s
I20260709 12:27:19.863538  2574 raft_consensus.cc:359] T 100dcbf9addf448bba05f170b5051802 P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:19.864140  2574 raft_consensus.cc:740] T 100dcbf9addf448bba05f170b5051802 P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 129c763b69224d7e9b2187721e58adeb, State: Initialized, Role: FOLLOWER
I20260709 12:27:19.864898  2574 consensus_queue.cc:260] T 100dcbf9addf448bba05f170b5051802 P 129c763b69224d7e9b2187721e58adeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:19.866396  2574 ts_tablet_manager.cc:1434] T 100dcbf9addf448bba05f170b5051802 P 129c763b69224d7e9b2187721e58adeb: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260709 12:27:19.867103  2574 tablet_bootstrap.cc:492] T de5c5dbcf4844dab833043ea584da490 P 129c763b69224d7e9b2187721e58adeb: Bootstrap starting.
I20260709 12:27:19.872628  2637 heartbeater.cc:344] Connected to a master server at 127.23.245.190:40151
I20260709 12:27:19.872339  2325 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb73a7a0e4004a1bbab977eb0c11d8dd"
dest_uuid: "72d4afb41b7245b4b382fb9e2c6edf59"
mode: GRACEFUL
new_leader_uuid: "19566de89ecf48aca9903d8bfdd5d936"
 from {username='slave'} at 127.0.0.1:39756
I20260709 12:27:19.873160  2637 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:19.873279  2325 raft_consensus.cc:606] T cb73a7a0e4004a1bbab977eb0c11d8dd P 72d4afb41b7245b4b382fb9e2c6edf59 [term 2 LEADER]: Received request to transfer leadership to TS 19566de89ecf48aca9903d8bfdd5d936
I20260709 12:27:19.874102  2637 heartbeater.cc:507] Master 127.23.245.190:40151 requested a full tablet report, sending...
I20260709 12:27:19.876529  2325 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea09120684274446b5c0965e6a6a9b4c"
dest_uuid: "72d4afb41b7245b4b382fb9e2c6edf59"
mode: GRACEFUL
new_leader_uuid: "19566de89ecf48aca9903d8bfdd5d936"
 from {username='slave'} at 127.0.0.1:39756
I20260709 12:27:19.877256  2325 raft_consensus.cc:606] T ea09120684274446b5c0965e6a6a9b4c P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 LEADER]: Received request to transfer leadership to TS 19566de89ecf48aca9903d8bfdd5d936
I20260709 12:27:19.879889  2148 ts_manager.cc:194] Re-registered known tserver with Master: 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605)
I20260709 12:27:19.880729 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:27:19.881436 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:19.882198 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:19.884239  2574 tablet_bootstrap.cc:492] T de5c5dbcf4844dab833043ea584da490 P 129c763b69224d7e9b2187721e58adeb: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:19.885354  2574 tablet_bootstrap.cc:492] T de5c5dbcf4844dab833043ea584da490 P 129c763b69224d7e9b2187721e58adeb: Bootstrap complete.
I20260709 12:27:19.886023  2574 ts_tablet_manager.cc:1403] T de5c5dbcf4844dab833043ea584da490 P 129c763b69224d7e9b2187721e58adeb: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.005s
I20260709 12:27:19.888983  2148 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34926
I20260709 12:27:19.888996  2574 raft_consensus.cc:359] T de5c5dbcf4844dab833043ea584da490 P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:19.889981  2574 raft_consensus.cc:740] T de5c5dbcf4844dab833043ea584da490 P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 129c763b69224d7e9b2187721e58adeb, State: Initialized, Role: FOLLOWER
I20260709 12:27:19.890847  2574 consensus_queue.cc:260] T de5c5dbcf4844dab833043ea584da490 P 129c763b69224d7e9b2187721e58adeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:19.892539  2637 heartbeater.cc:499] Master 127.23.245.190:40151 was elected leader, sending a full tablet report...
I20260709 12:27:19.892923  2574 ts_tablet_manager.cc:1434] T de5c5dbcf4844dab833043ea584da490 P 129c763b69224d7e9b2187721e58adeb: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:27:19.893720  2574 tablet_bootstrap.cc:492] T cb73a7a0e4004a1bbab977eb0c11d8dd P 129c763b69224d7e9b2187721e58adeb: Bootstrap starting.
I20260709 12:27:19.906188  2574 tablet_bootstrap.cc:492] T cb73a7a0e4004a1bbab977eb0c11d8dd P 129c763b69224d7e9b2187721e58adeb: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:27:19.907058  2574 tablet_bootstrap.cc:492] T cb73a7a0e4004a1bbab977eb0c11d8dd P 129c763b69224d7e9b2187721e58adeb: Bootstrap complete.
I20260709 12:27:19.907687  2574 ts_tablet_manager.cc:1403] T cb73a7a0e4004a1bbab977eb0c11d8dd P 129c763b69224d7e9b2187721e58adeb: Time spent bootstrapping tablet: real 0.014s	user 0.006s	sys 0.004s
I20260709 12:27:19.910167  2574 raft_consensus.cc:359] T cb73a7a0e4004a1bbab977eb0c11d8dd P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:19.910856  2574 raft_consensus.cc:740] T cb73a7a0e4004a1bbab977eb0c11d8dd P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 129c763b69224d7e9b2187721e58adeb, State: Initialized, Role: FOLLOWER
I20260709 12:27:19.911669  2574 consensus_queue.cc:260] T cb73a7a0e4004a1bbab977eb0c11d8dd P 129c763b69224d7e9b2187721e58adeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:19.913838  2574 ts_tablet_manager.cc:1434] T cb73a7a0e4004a1bbab977eb0c11d8dd P 129c763b69224d7e9b2187721e58adeb: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:27:19.914754  2574 tablet_bootstrap.cc:492] T a4decfc5493a43e9bb1dca65d85388e7 P 129c763b69224d7e9b2187721e58adeb: Bootstrap starting.
I20260709 12:27:19.929605  2574 tablet_bootstrap.cc:492] T a4decfc5493a43e9bb1dca65d85388e7 P 129c763b69224d7e9b2187721e58adeb: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:19.930506  2574 tablet_bootstrap.cc:492] T a4decfc5493a43e9bb1dca65d85388e7 P 129c763b69224d7e9b2187721e58adeb: Bootstrap complete.
I20260709 12:27:19.932500  2574 ts_tablet_manager.cc:1403] T a4decfc5493a43e9bb1dca65d85388e7 P 129c763b69224d7e9b2187721e58adeb: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.008s
I20260709 12:27:19.934693  2574 raft_consensus.cc:359] T a4decfc5493a43e9bb1dca65d85388e7 P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:19.935515  2574 raft_consensus.cc:740] T a4decfc5493a43e9bb1dca65d85388e7 P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 129c763b69224d7e9b2187721e58adeb, State: Initialized, Role: FOLLOWER
I20260709 12:27:19.936303  2574 consensus_queue.cc:260] T a4decfc5493a43e9bb1dca65d85388e7 P 129c763b69224d7e9b2187721e58adeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:19.938292  2574 ts_tablet_manager.cc:1434] T a4decfc5493a43e9bb1dca65d85388e7 P 129c763b69224d7e9b2187721e58adeb: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:27:19.939469  2574 tablet_bootstrap.cc:492] T ea09120684274446b5c0965e6a6a9b4c P 129c763b69224d7e9b2187721e58adeb: Bootstrap starting.
I20260709 12:27:19.941604  2611 raft_consensus.cc:3060] T a4decfc5493a43e9bb1dca65d85388e7 P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:27:19.954313  2574 tablet_bootstrap.cc:492] T ea09120684274446b5c0965e6a6a9b4c P 129c763b69224d7e9b2187721e58adeb: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:19.955269  2574 tablet_bootstrap.cc:492] T ea09120684274446b5c0965e6a6a9b4c P 129c763b69224d7e9b2187721e58adeb: Bootstrap complete.
I20260709 12:27:19.955955  2574 ts_tablet_manager.cc:1403] T ea09120684274446b5c0965e6a6a9b4c P 129c763b69224d7e9b2187721e58adeb: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.000s
I20260709 12:27:19.958209  2574 raft_consensus.cc:359] T ea09120684274446b5c0965e6a6a9b4c P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:19.958710  2574 raft_consensus.cc:740] T ea09120684274446b5c0965e6a6a9b4c P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 129c763b69224d7e9b2187721e58adeb, State: Initialized, Role: FOLLOWER
I20260709 12:27:19.959362  2574 consensus_queue.cc:260] T ea09120684274446b5c0965e6a6a9b4c P 129c763b69224d7e9b2187721e58adeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:19.960989  2574 ts_tablet_manager.cc:1434] T ea09120684274446b5c0965e6a6a9b4c P 129c763b69224d7e9b2187721e58adeb: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:27:19.998482  2611 raft_consensus.cc:3060] T 1523f5077995462b83bfa389d020880b P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:20.273770  2611 raft_consensus.cc:3060] T 372666c8d7a84b429fe9df7c121e0bcf P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:27:20.304078  2198 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:27:20.351768  2611 raft_consensus.cc:3060] T cb73a7a0e4004a1bbab977eb0c11d8dd P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:20.357348  2611 pending_rounds.cc:85] T cb73a7a0e4004a1bbab977eb0c11d8dd P 129c763b69224d7e9b2187721e58adeb: Aborting all ops after (but not including) 0
I20260709 12:27:20.357638  2611 pending_rounds.cc:107] T cb73a7a0e4004a1bbab977eb0c11d8dd P 129c763b69224d7e9b2187721e58adeb: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:27:20.357892  2611 raft_consensus.cc:2889] T cb73a7a0e4004a1bbab977eb0c11d8dd P 129c763b69224d7e9b2187721e58adeb [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:20.380460  2565 raft_consensus.cc:993] T ea09120684274446b5c0965e6a6a9b4c P 72d4afb41b7245b4b382fb9e2c6edf59: : Instructing follower 19566de89ecf48aca9903d8bfdd5d936 to start an election
I20260709 12:27:20.380970  2499 raft_consensus.cc:1081] T ea09120684274446b5c0965e6a6a9b4c P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 LEADER]: Signalling peer 19566de89ecf48aca9903d8bfdd5d936 to start an election
I20260709 12:27:20.382411  2401 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea09120684274446b5c0965e6a6a9b4c"
dest_uuid: "19566de89ecf48aca9903d8bfdd5d936"
 from {username='slave'} at 127.0.0.1:40600
I20260709 12:27:20.382896  2401 raft_consensus.cc:493] T ea09120684274446b5c0965e6a6a9b4c P 19566de89ecf48aca9903d8bfdd5d936 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:20.383126  2401 raft_consensus.cc:3060] T ea09120684274446b5c0965e6a6a9b4c P 19566de89ecf48aca9903d8bfdd5d936 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:20.388300  2401 raft_consensus.cc:515] T ea09120684274446b5c0965e6a6a9b4c P 19566de89ecf48aca9903d8bfdd5d936 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:20.389633  2401 leader_election.cc:290] T ea09120684274446b5c0965e6a6a9b4c P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 2 election: Requested vote from peers 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605), 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130:42771)
I20260709 12:27:20.390672  2611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09120684274446b5c0965e6a6a9b4c" candidate_uuid: "19566de89ecf48aca9903d8bfdd5d936" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "129c763b69224d7e9b2187721e58adeb"
I20260709 12:27:20.390695  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea09120684274446b5c0965e6a6a9b4c" candidate_uuid: "19566de89ecf48aca9903d8bfdd5d936" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "72d4afb41b7245b4b382fb9e2c6edf59"
I20260709 12:27:20.391268  2611 raft_consensus.cc:3060] T ea09120684274446b5c0965e6a6a9b4c P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:20.391382  2325 raft_consensus.cc:3055] T ea09120684274446b5c0965e6a6a9b4c P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:20.391808  2325 raft_consensus.cc:740] T ea09120684274446b5c0965e6a6a9b4c P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72d4afb41b7245b4b382fb9e2c6edf59, State: Running, Role: LEADER
I20260709 12:27:20.392611  2325 consensus_queue.cc:260] T ea09120684274446b5c0965e6a6a9b4c P 72d4afb41b7245b4b382fb9e2c6edf59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:20.393646  2325 raft_consensus.cc:3060] T ea09120684274446b5c0965e6a6a9b4c P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:20.396500  2611 raft_consensus.cc:2468] T ea09120684274446b5c0965e6a6a9b4c P 129c763b69224d7e9b2187721e58adeb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19566de89ecf48aca9903d8bfdd5d936 in term 2.
I20260709 12:27:20.397680  2364 leader_election.cc:304] T ea09120684274446b5c0965e6a6a9b4c P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 129c763b69224d7e9b2187721e58adeb, 19566de89ecf48aca9903d8bfdd5d936; no voters: 
I20260709 12:27:20.398546  2546 raft_consensus.cc:2804] T ea09120684274446b5c0965e6a6a9b4c P 19566de89ecf48aca9903d8bfdd5d936 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:20.398931  2325 raft_consensus.cc:2468] T ea09120684274446b5c0965e6a6a9b4c P 72d4afb41b7245b4b382fb9e2c6edf59 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19566de89ecf48aca9903d8bfdd5d936 in term 2.
I20260709 12:27:20.399554  2546 raft_consensus.cc:697] T ea09120684274446b5c0965e6a6a9b4c P 19566de89ecf48aca9903d8bfdd5d936 [term 2 LEADER]: Becoming Leader. State: Replica: 19566de89ecf48aca9903d8bfdd5d936, State: Running, Role: LEADER
I20260709 12:27:20.400668  2546 consensus_queue.cc:237] T ea09120684274446b5c0965e6a6a9b4c P 19566de89ecf48aca9903d8bfdd5d936 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:20.407006  2150 catalog_manager.cc:5697] T ea09120684274446b5c0965e6a6a9b4c P 19566de89ecf48aca9903d8bfdd5d936 reported cstate change: term changed from 1 to 2, leader changed from 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130) to 19566de89ecf48aca9903d8bfdd5d936 (127.23.245.131). New cstate: current_term: 2 leader_uuid: "19566de89ecf48aca9903d8bfdd5d936" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:20.457403  2565 raft_consensus.cc:993] T cb73a7a0e4004a1bbab977eb0c11d8dd P 72d4afb41b7245b4b382fb9e2c6edf59: : Instructing follower 19566de89ecf48aca9903d8bfdd5d936 to start an election
I20260709 12:27:20.457864  2499 raft_consensus.cc:1081] T cb73a7a0e4004a1bbab977eb0c11d8dd P 72d4afb41b7245b4b382fb9e2c6edf59 [term 2 LEADER]: Signalling peer 19566de89ecf48aca9903d8bfdd5d936 to start an election
I20260709 12:27:20.459458  2401 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb73a7a0e4004a1bbab977eb0c11d8dd"
dest_uuid: "19566de89ecf48aca9903d8bfdd5d936"
 from {username='slave'} at 127.0.0.1:40600
I20260709 12:27:20.459859  2401 raft_consensus.cc:493] T cb73a7a0e4004a1bbab977eb0c11d8dd P 19566de89ecf48aca9903d8bfdd5d936 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:20.460168  2401 raft_consensus.cc:3060] T cb73a7a0e4004a1bbab977eb0c11d8dd P 19566de89ecf48aca9903d8bfdd5d936 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:20.465026  2401 raft_consensus.cc:515] T cb73a7a0e4004a1bbab977eb0c11d8dd P 19566de89ecf48aca9903d8bfdd5d936 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:20.466374  2401 leader_election.cc:290] T cb73a7a0e4004a1bbab977eb0c11d8dd P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 3 election: Requested vote from peers 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605), 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130:42771)
I20260709 12:27:20.467334  2611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb73a7a0e4004a1bbab977eb0c11d8dd" candidate_uuid: "19566de89ecf48aca9903d8bfdd5d936" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "129c763b69224d7e9b2187721e58adeb"
I20260709 12:27:20.467422  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb73a7a0e4004a1bbab977eb0c11d8dd" candidate_uuid: "19566de89ecf48aca9903d8bfdd5d936" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "72d4afb41b7245b4b382fb9e2c6edf59"
I20260709 12:27:20.468019  2611 raft_consensus.cc:3060] T cb73a7a0e4004a1bbab977eb0c11d8dd P 129c763b69224d7e9b2187721e58adeb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:20.468102  2325 raft_consensus.cc:3055] T cb73a7a0e4004a1bbab977eb0c11d8dd P 72d4afb41b7245b4b382fb9e2c6edf59 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:20.468523  2325 raft_consensus.cc:740] T cb73a7a0e4004a1bbab977eb0c11d8dd P 72d4afb41b7245b4b382fb9e2c6edf59 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 72d4afb41b7245b4b382fb9e2c6edf59, State: Running, Role: LEADER
I20260709 12:27:20.469249  2325 consensus_queue.cc:260] T cb73a7a0e4004a1bbab977eb0c11d8dd P 72d4afb41b7245b4b382fb9e2c6edf59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:20.470194  2325 raft_consensus.cc:3060] T cb73a7a0e4004a1bbab977eb0c11d8dd P 72d4afb41b7245b4b382fb9e2c6edf59 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:20.473222  2611 raft_consensus.cc:2468] T cb73a7a0e4004a1bbab977eb0c11d8dd P 129c763b69224d7e9b2187721e58adeb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19566de89ecf48aca9903d8bfdd5d936 in term 3.
I20260709 12:27:20.474341  2364 leader_election.cc:304] T cb73a7a0e4004a1bbab977eb0c11d8dd P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 129c763b69224d7e9b2187721e58adeb, 19566de89ecf48aca9903d8bfdd5d936; no voters: 
I20260709 12:27:20.475169  2661 raft_consensus.cc:2804] T cb73a7a0e4004a1bbab977eb0c11d8dd P 19566de89ecf48aca9903d8bfdd5d936 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:20.475601  2661 raft_consensus.cc:697] T cb73a7a0e4004a1bbab977eb0c11d8dd P 19566de89ecf48aca9903d8bfdd5d936 [term 3 LEADER]: Becoming Leader. State: Replica: 19566de89ecf48aca9903d8bfdd5d936, State: Running, Role: LEADER
I20260709 12:27:20.476332  2325 raft_consensus.cc:2468] T cb73a7a0e4004a1bbab977eb0c11d8dd P 72d4afb41b7245b4b382fb9e2c6edf59 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19566de89ecf48aca9903d8bfdd5d936 in term 3.
I20260709 12:27:20.476475  2661 consensus_queue.cc:237] T cb73a7a0e4004a1bbab977eb0c11d8dd P 19566de89ecf48aca9903d8bfdd5d936 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:20.483644  2150 catalog_manager.cc:5697] T cb73a7a0e4004a1bbab977eb0c11d8dd P 19566de89ecf48aca9903d8bfdd5d936 reported cstate change: term changed from 2 to 3, leader changed from 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130) to 19566de89ecf48aca9903d8bfdd5d936 (127.23.245.131). New cstate: current_term: 3 leader_uuid: "19566de89ecf48aca9903d8bfdd5d936" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:20.848467  2611 raft_consensus.cc:1275] T ea09120684274446b5c0965e6a6a9b4c P 129c763b69224d7e9b2187721e58adeb [term 2 FOLLOWER]: Refusing update from remote peer 19566de89ecf48aca9903d8bfdd5d936: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:20.849852  2661 consensus_queue.cc:1048] T ea09120684274446b5c0965e6a6a9b4c P 19566de89ecf48aca9903d8bfdd5d936 [LEADER]: Connected to new peer: Peer: permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:20.860713  2325 raft_consensus.cc:1275] T ea09120684274446b5c0965e6a6a9b4c P 72d4afb41b7245b4b382fb9e2c6edf59 [term 2 FOLLOWER]: Refusing update from remote peer 19566de89ecf48aca9903d8bfdd5d936: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:20.862114  2661 consensus_queue.cc:1048] T ea09120684274446b5c0965e6a6a9b4c P 19566de89ecf48aca9903d8bfdd5d936 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:20.893244 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:20.909560  2401 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1523f5077995462b83bfa389d020880b"
dest_uuid: "19566de89ecf48aca9903d8bfdd5d936"
mode: GRACEFUL
new_leader_uuid: "72d4afb41b7245b4b382fb9e2c6edf59"
 from {username='slave'} at 127.0.0.1:40606
I20260709 12:27:20.910084  2401 raft_consensus.cc:606] T 1523f5077995462b83bfa389d020880b P 19566de89ecf48aca9903d8bfdd5d936 [term 2 LEADER]: Received request to transfer leadership to TS 72d4afb41b7245b4b382fb9e2c6edf59
I20260709 12:27:20.912487  2401 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1797eb20c76642c3912213b96a0156bb"
dest_uuid: "19566de89ecf48aca9903d8bfdd5d936"
mode: GRACEFUL
new_leader_uuid: "72d4afb41b7245b4b382fb9e2c6edf59"
 from {username='slave'} at 127.0.0.1:40606
I20260709 12:27:20.912931  2401 raft_consensus.cc:606] T 1797eb20c76642c3912213b96a0156bb P 19566de89ecf48aca9903d8bfdd5d936 [term 1 LEADER]: Received request to transfer leadership to TS 72d4afb41b7245b4b382fb9e2c6edf59
I20260709 12:27:20.915329  2325 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "372666c8d7a84b429fe9df7c121e0bcf"
dest_uuid: "72d4afb41b7245b4b382fb9e2c6edf59"
mode: GRACEFUL
new_leader_uuid: "19566de89ecf48aca9903d8bfdd5d936"
 from {username='slave'} at 127.0.0.1:39756
I20260709 12:27:20.915844  2325 raft_consensus.cc:606] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [term 2 LEADER]: Received request to transfer leadership to TS 19566de89ecf48aca9903d8bfdd5d936
I20260709 12:27:20.917109 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:27:20.917594 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:20.918195 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:20.921787  2655 raft_consensus.cc:993] T 1797eb20c76642c3912213b96a0156bb P 19566de89ecf48aca9903d8bfdd5d936: : Instructing follower 72d4afb41b7245b4b382fb9e2c6edf59 to start an election
I20260709 12:27:20.922322  2661 raft_consensus.cc:1081] T 1797eb20c76642c3912213b96a0156bb P 19566de89ecf48aca9903d8bfdd5d936 [term 1 LEADER]: Signalling peer 72d4afb41b7245b4b382fb9e2c6edf59 to start an election
I20260709 12:27:20.923910  2325 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1797eb20c76642c3912213b96a0156bb"
dest_uuid: "72d4afb41b7245b4b382fb9e2c6edf59"
 from {username='slave'} at 127.0.0.1:39744
I20260709 12:27:20.924496  2325 raft_consensus.cc:493] T 1797eb20c76642c3912213b96a0156bb P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:20.924902  2325 raft_consensus.cc:3060] T 1797eb20c76642c3912213b96a0156bb P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:20.934614  2325 raft_consensus.cc:515] T 1797eb20c76642c3912213b96a0156bb P 72d4afb41b7245b4b382fb9e2c6edf59 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:20.936267  2325 leader_election.cc:290] T 1797eb20c76642c3912213b96a0156bb P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 2 election: Requested vote from peers 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605), 19566de89ecf48aca9903d8bfdd5d936 (127.23.245.131:38763)
I20260709 12:27:20.936944  2611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1797eb20c76642c3912213b96a0156bb" candidate_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "129c763b69224d7e9b2187721e58adeb"
I20260709 12:27:20.937281  2401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1797eb20c76642c3912213b96a0156bb" candidate_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "19566de89ecf48aca9903d8bfdd5d936"
I20260709 12:27:20.937657  2611 raft_consensus.cc:3060] T 1797eb20c76642c3912213b96a0156bb P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:20.937865  2401 raft_consensus.cc:3055] T 1797eb20c76642c3912213b96a0156bb P 19566de89ecf48aca9903d8bfdd5d936 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:20.938237  2401 raft_consensus.cc:740] T 1797eb20c76642c3912213b96a0156bb P 19566de89ecf48aca9903d8bfdd5d936 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 19566de89ecf48aca9903d8bfdd5d936, State: Running, Role: LEADER
I20260709 12:27:20.938915  2401 consensus_queue.cc:260] T 1797eb20c76642c3912213b96a0156bb P 19566de89ecf48aca9903d8bfdd5d936 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:20.939846  2401 raft_consensus.cc:3060] T 1797eb20c76642c3912213b96a0156bb P 19566de89ecf48aca9903d8bfdd5d936 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:20.943672  2611 raft_consensus.cc:2468] T 1797eb20c76642c3912213b96a0156bb P 129c763b69224d7e9b2187721e58adeb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d4afb41b7245b4b382fb9e2c6edf59 in term 2.
I20260709 12:27:20.944880  2290 leader_election.cc:304] T 1797eb20c76642c3912213b96a0156bb P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 129c763b69224d7e9b2187721e58adeb, 72d4afb41b7245b4b382fb9e2c6edf59; no voters: 
I20260709 12:27:20.945700  2663 raft_consensus.cc:2804] T 1797eb20c76642c3912213b96a0156bb P 72d4afb41b7245b4b382fb9e2c6edf59 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:20.946153  2663 raft_consensus.cc:697] T 1797eb20c76642c3912213b96a0156bb P 72d4afb41b7245b4b382fb9e2c6edf59 [term 2 LEADER]: Becoming Leader. State: Replica: 72d4afb41b7245b4b382fb9e2c6edf59, State: Running, Role: LEADER
I20260709 12:27:20.946198  2401 raft_consensus.cc:2468] T 1797eb20c76642c3912213b96a0156bb P 19566de89ecf48aca9903d8bfdd5d936 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d4afb41b7245b4b382fb9e2c6edf59 in term 2.
I20260709 12:27:20.947139  2663 consensus_queue.cc:237] T 1797eb20c76642c3912213b96a0156bb P 72d4afb41b7245b4b382fb9e2c6edf59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:20.954666  2148 catalog_manager.cc:5697] T 1797eb20c76642c3912213b96a0156bb P 72d4afb41b7245b4b382fb9e2c6edf59 reported cstate change: term changed from 1 to 2, leader changed from 19566de89ecf48aca9903d8bfdd5d936 (127.23.245.131) to 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130). New cstate: current_term: 2 leader_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:21.009903  2611 raft_consensus.cc:1275] T cb73a7a0e4004a1bbab977eb0c11d8dd P 129c763b69224d7e9b2187721e58adeb [term 3 FOLLOWER]: Refusing update from remote peer 19566de89ecf48aca9903d8bfdd5d936: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:21.011440  2661 consensus_queue.cc:1048] T cb73a7a0e4004a1bbab977eb0c11d8dd P 19566de89ecf48aca9903d8bfdd5d936 [LEADER]: Connected to new peer: Peer: permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:21.018795  2325 raft_consensus.cc:1275] T cb73a7a0e4004a1bbab977eb0c11d8dd P 72d4afb41b7245b4b382fb9e2c6edf59 [term 3 FOLLOWER]: Refusing update from remote peer 19566de89ecf48aca9903d8bfdd5d936: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:21.020596  2546 consensus_queue.cc:1048] T cb73a7a0e4004a1bbab977eb0c11d8dd P 19566de89ecf48aca9903d8bfdd5d936 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:21.141166  2499 raft_consensus.cc:993] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59: : Instructing follower 19566de89ecf48aca9903d8bfdd5d936 to start an election
I20260709 12:27:21.141794  2663 raft_consensus.cc:1081] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [term 2 LEADER]: Signalling peer 19566de89ecf48aca9903d8bfdd5d936 to start an election
I20260709 12:27:21.143219  2401 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "372666c8d7a84b429fe9df7c121e0bcf"
dest_uuid: "19566de89ecf48aca9903d8bfdd5d936"
 from {username='slave'} at 127.0.0.1:40600
I20260709 12:27:21.143635  2401 raft_consensus.cc:493] T 372666c8d7a84b429fe9df7c121e0bcf P 19566de89ecf48aca9903d8bfdd5d936 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:21.143862  2401 raft_consensus.cc:3060] T 372666c8d7a84b429fe9df7c121e0bcf P 19566de89ecf48aca9903d8bfdd5d936 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:21.148247  2401 raft_consensus.cc:515] T 372666c8d7a84b429fe9df7c121e0bcf P 19566de89ecf48aca9903d8bfdd5d936 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:21.149585  2401 leader_election.cc:290] T 372666c8d7a84b429fe9df7c121e0bcf P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 3 election: Requested vote from peers 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605), 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130:42771)
I20260709 12:27:21.150517  2611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372666c8d7a84b429fe9df7c121e0bcf" candidate_uuid: "19566de89ecf48aca9903d8bfdd5d936" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "129c763b69224d7e9b2187721e58adeb"
I20260709 12:27:21.150579  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372666c8d7a84b429fe9df7c121e0bcf" candidate_uuid: "19566de89ecf48aca9903d8bfdd5d936" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "72d4afb41b7245b4b382fb9e2c6edf59"
I20260709 12:27:21.151132  2611 raft_consensus.cc:3060] T 372666c8d7a84b429fe9df7c121e0bcf P 129c763b69224d7e9b2187721e58adeb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:21.151234  2325 raft_consensus.cc:3055] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:21.151633  2325 raft_consensus.cc:740] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 72d4afb41b7245b4b382fb9e2c6edf59, State: Running, Role: LEADER
I20260709 12:27:21.152345  2325 consensus_queue.cc:260] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:21.153291  2325 raft_consensus.cc:3060] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:21.156317  2611 raft_consensus.cc:2468] T 372666c8d7a84b429fe9df7c121e0bcf P 129c763b69224d7e9b2187721e58adeb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19566de89ecf48aca9903d8bfdd5d936 in term 3.
I20260709 12:27:21.157470  2364 leader_election.cc:304] T 372666c8d7a84b429fe9df7c121e0bcf P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 129c763b69224d7e9b2187721e58adeb, 19566de89ecf48aca9903d8bfdd5d936; no voters: 
I20260709 12:27:21.158108  2546 raft_consensus.cc:2804] T 372666c8d7a84b429fe9df7c121e0bcf P 19566de89ecf48aca9903d8bfdd5d936 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:21.158591  2325 raft_consensus.cc:2468] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19566de89ecf48aca9903d8bfdd5d936 in term 3.
I20260709 12:27:21.158644  2546 raft_consensus.cc:697] T 372666c8d7a84b429fe9df7c121e0bcf P 19566de89ecf48aca9903d8bfdd5d936 [term 3 LEADER]: Becoming Leader. State: Replica: 19566de89ecf48aca9903d8bfdd5d936, State: Running, Role: LEADER
I20260709 12:27:21.159837  2546 consensus_queue.cc:237] T 372666c8d7a84b429fe9df7c121e0bcf P 19566de89ecf48aca9903d8bfdd5d936 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:21.166635  2150 catalog_manager.cc:5697] T 372666c8d7a84b429fe9df7c121e0bcf P 19566de89ecf48aca9903d8bfdd5d936 reported cstate change: term changed from 2 to 3, leader changed from 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130) to 19566de89ecf48aca9903d8bfdd5d936 (127.23.245.131). New cstate: current_term: 3 leader_uuid: "19566de89ecf48aca9903d8bfdd5d936" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } health_report { overall_health: HEALTHY } } }
W20260709 12:27:21.305234  2198 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:27:21.327615  2661 raft_consensus.cc:993] T 1523f5077995462b83bfa389d020880b P 19566de89ecf48aca9903d8bfdd5d936: : Instructing follower 72d4afb41b7245b4b382fb9e2c6edf59 to start an election
I20260709 12:27:21.328210  2546 raft_consensus.cc:1081] T 1523f5077995462b83bfa389d020880b P 19566de89ecf48aca9903d8bfdd5d936 [term 2 LEADER]: Signalling peer 72d4afb41b7245b4b382fb9e2c6edf59 to start an election
I20260709 12:27:21.329613  2325 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1523f5077995462b83bfa389d020880b"
dest_uuid: "72d4afb41b7245b4b382fb9e2c6edf59"
 from {username='slave'} at 127.0.0.1:39744
I20260709 12:27:21.330116  2325 raft_consensus.cc:493] T 1523f5077995462b83bfa389d020880b P 72d4afb41b7245b4b382fb9e2c6edf59 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:21.330430  2325 raft_consensus.cc:3060] T 1523f5077995462b83bfa389d020880b P 72d4afb41b7245b4b382fb9e2c6edf59 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:21.335184  2325 raft_consensus.cc:515] T 1523f5077995462b83bfa389d020880b P 72d4afb41b7245b4b382fb9e2c6edf59 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:21.336658  2325 leader_election.cc:290] T 1523f5077995462b83bfa389d020880b P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 3 election: Requested vote from peers 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605), 19566de89ecf48aca9903d8bfdd5d936 (127.23.245.131:38763)
I20260709 12:27:21.337612  2611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1523f5077995462b83bfa389d020880b" candidate_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "129c763b69224d7e9b2187721e58adeb"
I20260709 12:27:21.337661  2401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1523f5077995462b83bfa389d020880b" candidate_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "19566de89ecf48aca9903d8bfdd5d936"
I20260709 12:27:21.338254  2611 raft_consensus.cc:3060] T 1523f5077995462b83bfa389d020880b P 129c763b69224d7e9b2187721e58adeb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:21.338367  2401 raft_consensus.cc:3055] T 1523f5077995462b83bfa389d020880b P 19566de89ecf48aca9903d8bfdd5d936 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:21.338745  2401 raft_consensus.cc:740] T 1523f5077995462b83bfa389d020880b P 19566de89ecf48aca9903d8bfdd5d936 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 19566de89ecf48aca9903d8bfdd5d936, State: Running, Role: LEADER
I20260709 12:27:21.339385  2401 consensus_queue.cc:260] T 1523f5077995462b83bfa389d020880b P 19566de89ecf48aca9903d8bfdd5d936 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:21.340305  2401 raft_consensus.cc:3060] T 1523f5077995462b83bfa389d020880b P 19566de89ecf48aca9903d8bfdd5d936 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:21.343789  2611 raft_consensus.cc:2468] T 1523f5077995462b83bfa389d020880b P 129c763b69224d7e9b2187721e58adeb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d4afb41b7245b4b382fb9e2c6edf59 in term 3.
I20260709 12:27:21.344909  2290 leader_election.cc:304] T 1523f5077995462b83bfa389d020880b P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 129c763b69224d7e9b2187721e58adeb, 72d4afb41b7245b4b382fb9e2c6edf59; no voters: 
I20260709 12:27:21.345090  2401 raft_consensus.cc:2468] T 1523f5077995462b83bfa389d020880b P 19566de89ecf48aca9903d8bfdd5d936 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d4afb41b7245b4b382fb9e2c6edf59 in term 3.
I20260709 12:27:21.345778  2663 raft_consensus.cc:2804] T 1523f5077995462b83bfa389d020880b P 72d4afb41b7245b4b382fb9e2c6edf59 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:21.346287  2663 raft_consensus.cc:697] T 1523f5077995462b83bfa389d020880b P 72d4afb41b7245b4b382fb9e2c6edf59 [term 3 LEADER]: Becoming Leader. State: Replica: 72d4afb41b7245b4b382fb9e2c6edf59, State: Running, Role: LEADER
I20260709 12:27:21.347075  2663 consensus_queue.cc:237] T 1523f5077995462b83bfa389d020880b P 72d4afb41b7245b4b382fb9e2c6edf59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:21.353314  2150 catalog_manager.cc:5697] T 1523f5077995462b83bfa389d020880b P 72d4afb41b7245b4b382fb9e2c6edf59 reported cstate change: term changed from 2 to 3, leader changed from 19566de89ecf48aca9903d8bfdd5d936 (127.23.245.131) to 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130). New cstate: current_term: 3 leader_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:21.372987  2611 raft_consensus.cc:1275] T 1797eb20c76642c3912213b96a0156bb P 129c763b69224d7e9b2187721e58adeb [term 2 FOLLOWER]: Refusing update from remote peer 72d4afb41b7245b4b382fb9e2c6edf59: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:21.374185  2663 consensus_queue.cc:1048] T 1797eb20c76642c3912213b96a0156bb P 72d4afb41b7245b4b382fb9e2c6edf59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:21.384038  2401 raft_consensus.cc:1275] T 1797eb20c76642c3912213b96a0156bb P 19566de89ecf48aca9903d8bfdd5d936 [term 2 FOLLOWER]: Refusing update from remote peer 72d4afb41b7245b4b382fb9e2c6edf59: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:21.385375  2499 consensus_queue.cc:1048] T 1797eb20c76642c3912213b96a0156bb P 72d4afb41b7245b4b382fb9e2c6edf59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:21.548991  2611 raft_consensus.cc:1275] T 372666c8d7a84b429fe9df7c121e0bcf P 129c763b69224d7e9b2187721e58adeb [term 3 FOLLOWER]: Refusing update from remote peer 19566de89ecf48aca9903d8bfdd5d936: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:21.550210  2546 consensus_queue.cc:1048] T 372666c8d7a84b429fe9df7c121e0bcf P 19566de89ecf48aca9903d8bfdd5d936 [LEADER]: Connected to new peer: Peer: permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:21.560156  2325 raft_consensus.cc:1275] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [term 3 FOLLOWER]: Refusing update from remote peer 19566de89ecf48aca9903d8bfdd5d936: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:21.561594  2661 consensus_queue.cc:1048] T 372666c8d7a84b429fe9df7c121e0bcf P 19566de89ecf48aca9903d8bfdd5d936 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:21.811050  2611 raft_consensus.cc:1275] T 1523f5077995462b83bfa389d020880b P 129c763b69224d7e9b2187721e58adeb [term 3 FOLLOWER]: Refusing update from remote peer 72d4afb41b7245b4b382fb9e2c6edf59: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:21.812966  2676 consensus_queue.cc:1048] T 1523f5077995462b83bfa389d020880b P 72d4afb41b7245b4b382fb9e2c6edf59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:21.823825  2401 raft_consensus.cc:1275] T 1523f5077995462b83bfa389d020880b P 19566de89ecf48aca9903d8bfdd5d936 [term 3 FOLLOWER]: Refusing update from remote peer 72d4afb41b7245b4b382fb9e2c6edf59: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:21.825201  2664 consensus_queue.cc:1048] T 1523f5077995462b83bfa389d020880b P 72d4afb41b7245b4b382fb9e2c6edf59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:21.931321 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:21.938519  2325 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "100dcbf9addf448bba05f170b5051802"
dest_uuid: "72d4afb41b7245b4b382fb9e2c6edf59"
mode: GRACEFUL
new_leader_uuid: "19566de89ecf48aca9903d8bfdd5d936"
 from {username='slave'} at 127.0.0.1:39756
I20260709 12:27:21.939170  2325 raft_consensus.cc:606] T 100dcbf9addf448bba05f170b5051802 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 LEADER]: Received request to transfer leadership to TS 19566de89ecf48aca9903d8bfdd5d936
I20260709 12:27:21.942042  2401 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "372666c8d7a84b429fe9df7c121e0bcf"
dest_uuid: "19566de89ecf48aca9903d8bfdd5d936"
mode: GRACEFUL
new_leader_uuid: "72d4afb41b7245b4b382fb9e2c6edf59"
 from {username='slave'} at 127.0.0.1:40606
I20260709 12:27:21.942617  2401 raft_consensus.cc:606] T 372666c8d7a84b429fe9df7c121e0bcf P 19566de89ecf48aca9903d8bfdd5d936 [term 3 LEADER]: Received request to transfer leadership to TS 72d4afb41b7245b4b382fb9e2c6edf59
I20260709 12:27:21.945410  2325 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d36e6c0657bd486b939805a704e580af"
dest_uuid: "72d4afb41b7245b4b382fb9e2c6edf59"
mode: GRACEFUL
new_leader_uuid: "19566de89ecf48aca9903d8bfdd5d936"
 from {username='slave'} at 127.0.0.1:39756
I20260709 12:27:21.945951  2325 raft_consensus.cc:606] T d36e6c0657bd486b939805a704e580af P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 LEADER]: Received request to transfer leadership to TS 19566de89ecf48aca9903d8bfdd5d936
I20260709 12:27:21.946964 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:27:21.947500 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:21.948099 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:22.124037  2546 raft_consensus.cc:993] T 372666c8d7a84b429fe9df7c121e0bcf P 19566de89ecf48aca9903d8bfdd5d936: : Instructing follower 72d4afb41b7245b4b382fb9e2c6edf59 to start an election
I20260709 12:27:22.124704  2661 raft_consensus.cc:1081] T 372666c8d7a84b429fe9df7c121e0bcf P 19566de89ecf48aca9903d8bfdd5d936 [term 3 LEADER]: Signalling peer 72d4afb41b7245b4b382fb9e2c6edf59 to start an election
I20260709 12:27:22.126154  2325 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "372666c8d7a84b429fe9df7c121e0bcf"
dest_uuid: "72d4afb41b7245b4b382fb9e2c6edf59"
 from {username='slave'} at 127.0.0.1:39744
I20260709 12:27:22.126660  2325 raft_consensus.cc:493] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:22.126919  2325 raft_consensus.cc:3060] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:22.131294  2325 raft_consensus.cc:515] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:22.132810  2325 leader_election.cc:290] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 4 election: Requested vote from peers 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605), 19566de89ecf48aca9903d8bfdd5d936 (127.23.245.131:38763)
I20260709 12:27:22.133668  2610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372666c8d7a84b429fe9df7c121e0bcf" candidate_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "129c763b69224d7e9b2187721e58adeb"
I20260709 12:27:22.133809  2401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372666c8d7a84b429fe9df7c121e0bcf" candidate_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "19566de89ecf48aca9903d8bfdd5d936"
I20260709 12:27:22.134367  2610 raft_consensus.cc:3060] T 372666c8d7a84b429fe9df7c121e0bcf P 129c763b69224d7e9b2187721e58adeb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:22.134404  2401 raft_consensus.cc:3055] T 372666c8d7a84b429fe9df7c121e0bcf P 19566de89ecf48aca9903d8bfdd5d936 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:22.134922  2401 raft_consensus.cc:740] T 372666c8d7a84b429fe9df7c121e0bcf P 19566de89ecf48aca9903d8bfdd5d936 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 19566de89ecf48aca9903d8bfdd5d936, State: Running, Role: LEADER
I20260709 12:27:22.135571  2401 consensus_queue.cc:260] T 372666c8d7a84b429fe9df7c121e0bcf P 19566de89ecf48aca9903d8bfdd5d936 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:22.136472  2401 raft_consensus.cc:3060] T 372666c8d7a84b429fe9df7c121e0bcf P 19566de89ecf48aca9903d8bfdd5d936 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:22.140129  2610 raft_consensus.cc:2468] T 372666c8d7a84b429fe9df7c121e0bcf P 129c763b69224d7e9b2187721e58adeb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d4afb41b7245b4b382fb9e2c6edf59 in term 4.
I20260709 12:27:22.140908  2401 raft_consensus.cc:2468] T 372666c8d7a84b429fe9df7c121e0bcf P 19566de89ecf48aca9903d8bfdd5d936 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d4afb41b7245b4b382fb9e2c6edf59 in term 4.
I20260709 12:27:22.141460  2290 leader_election.cc:304] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 129c763b69224d7e9b2187721e58adeb, 72d4afb41b7245b4b382fb9e2c6edf59; no voters: 
I20260709 12:27:22.142235  2664 raft_consensus.cc:2804] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:22.142782  2664 raft_consensus.cc:697] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [term 4 LEADER]: Becoming Leader. State: Replica: 72d4afb41b7245b4b382fb9e2c6edf59, State: Running, Role: LEADER
I20260709 12:27:22.143580  2664 consensus_queue.cc:237] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:22.149605  2148 catalog_manager.cc:5697] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 reported cstate change: term changed from 3 to 4, leader changed from 19566de89ecf48aca9903d8bfdd5d936 (127.23.245.131) to 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130). New cstate: current_term: 4 leader_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:22.203094  2676 raft_consensus.cc:993] T 100dcbf9addf448bba05f170b5051802 P 72d4afb41b7245b4b382fb9e2c6edf59: : Instructing follower 19566de89ecf48aca9903d8bfdd5d936 to start an election
I20260709 12:27:22.203596  2676 raft_consensus.cc:1081] T 100dcbf9addf448bba05f170b5051802 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 LEADER]: Signalling peer 19566de89ecf48aca9903d8bfdd5d936 to start an election
I20260709 12:27:22.205296  2401 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "100dcbf9addf448bba05f170b5051802"
dest_uuid: "19566de89ecf48aca9903d8bfdd5d936"
 from {username='slave'} at 127.0.0.1:40600
I20260709 12:27:22.205982  2401 raft_consensus.cc:493] T 100dcbf9addf448bba05f170b5051802 P 19566de89ecf48aca9903d8bfdd5d936 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:22.206310  2401 raft_consensus.cc:3060] T 100dcbf9addf448bba05f170b5051802 P 19566de89ecf48aca9903d8bfdd5d936 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:22.213104  2401 raft_consensus.cc:515] T 100dcbf9addf448bba05f170b5051802 P 19566de89ecf48aca9903d8bfdd5d936 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:22.215740  2610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "100dcbf9addf448bba05f170b5051802" candidate_uuid: "19566de89ecf48aca9903d8bfdd5d936" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "129c763b69224d7e9b2187721e58adeb"
I20260709 12:27:22.216413  2610 raft_consensus.cc:3060] T 100dcbf9addf448bba05f170b5051802 P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:22.216516  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "100dcbf9addf448bba05f170b5051802" candidate_uuid: "19566de89ecf48aca9903d8bfdd5d936" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "72d4afb41b7245b4b382fb9e2c6edf59"
I20260709 12:27:22.217238  2325 raft_consensus.cc:3055] T 100dcbf9addf448bba05f170b5051802 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:22.217527  2325 raft_consensus.cc:740] T 100dcbf9addf448bba05f170b5051802 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72d4afb41b7245b4b382fb9e2c6edf59, State: Running, Role: LEADER
I20260709 12:27:22.218436  2325 consensus_queue.cc:260] T 100dcbf9addf448bba05f170b5051802 P 72d4afb41b7245b4b382fb9e2c6edf59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:22.219571  2325 raft_consensus.cc:3060] T 100dcbf9addf448bba05f170b5051802 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:22.223852  2610 raft_consensus.cc:2468] T 100dcbf9addf448bba05f170b5051802 P 129c763b69224d7e9b2187721e58adeb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19566de89ecf48aca9903d8bfdd5d936 in term 2.
I20260709 12:27:22.215844  2401 leader_election.cc:290] T 100dcbf9addf448bba05f170b5051802 P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 2 election: Requested vote from peers 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605), 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130:42771)
I20260709 12:27:22.225185  2364 leader_election.cc:304] T 100dcbf9addf448bba05f170b5051802 P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 129c763b69224d7e9b2187721e58adeb, 19566de89ecf48aca9903d8bfdd5d936; no voters: 
I20260709 12:27:22.225363  2325 raft_consensus.cc:2468] T 100dcbf9addf448bba05f170b5051802 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19566de89ecf48aca9903d8bfdd5d936 in term 2.
I20260709 12:27:22.226051  2546 raft_consensus.cc:2804] T 100dcbf9addf448bba05f170b5051802 P 19566de89ecf48aca9903d8bfdd5d936 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:22.226600  2546 raft_consensus.cc:697] T 100dcbf9addf448bba05f170b5051802 P 19566de89ecf48aca9903d8bfdd5d936 [term 2 LEADER]: Becoming Leader. State: Replica: 19566de89ecf48aca9903d8bfdd5d936, State: Running, Role: LEADER
I20260709 12:27:22.227450  2546 consensus_queue.cc:237] T 100dcbf9addf448bba05f170b5051802 P 19566de89ecf48aca9903d8bfdd5d936 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:22.234211  2148 catalog_manager.cc:5697] T 100dcbf9addf448bba05f170b5051802 P 19566de89ecf48aca9903d8bfdd5d936 reported cstate change: term changed from 1 to 2, leader changed from 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130) to 19566de89ecf48aca9903d8bfdd5d936 (127.23.245.131). New cstate: current_term: 2 leader_uuid: "19566de89ecf48aca9903d8bfdd5d936" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } health_report { overall_health: HEALTHY } } }
W20260709 12:27:22.306181  2198 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:27:22.406834  2676 raft_consensus.cc:993] T d36e6c0657bd486b939805a704e580af P 72d4afb41b7245b4b382fb9e2c6edf59: : Instructing follower 19566de89ecf48aca9903d8bfdd5d936 to start an election
I20260709 12:27:22.407476  2499 raft_consensus.cc:1081] T d36e6c0657bd486b939805a704e580af P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 LEADER]: Signalling peer 19566de89ecf48aca9903d8bfdd5d936 to start an election
I20260709 12:27:22.408953  2401 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d36e6c0657bd486b939805a704e580af"
dest_uuid: "19566de89ecf48aca9903d8bfdd5d936"
 from {username='slave'} at 127.0.0.1:40600
I20260709 12:27:22.409439  2401 raft_consensus.cc:493] T d36e6c0657bd486b939805a704e580af P 19566de89ecf48aca9903d8bfdd5d936 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:22.409734  2401 raft_consensus.cc:3060] T d36e6c0657bd486b939805a704e580af P 19566de89ecf48aca9903d8bfdd5d936 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:22.414314  2401 raft_consensus.cc:515] T d36e6c0657bd486b939805a704e580af P 19566de89ecf48aca9903d8bfdd5d936 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:22.415980  2401 leader_election.cc:290] T d36e6c0657bd486b939805a704e580af P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 2 election: Requested vote from peers 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605), 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130:42771)
I20260709 12:27:22.416930  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36e6c0657bd486b939805a704e580af" candidate_uuid: "19566de89ecf48aca9903d8bfdd5d936" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "72d4afb41b7245b4b382fb9e2c6edf59"
I20260709 12:27:22.417384  2611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36e6c0657bd486b939805a704e580af" candidate_uuid: "19566de89ecf48aca9903d8bfdd5d936" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "129c763b69224d7e9b2187721e58adeb"
I20260709 12:27:22.417587  2325 raft_consensus.cc:3055] T d36e6c0657bd486b939805a704e580af P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:22.418036  2325 raft_consensus.cc:740] T d36e6c0657bd486b939805a704e580af P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 72d4afb41b7245b4b382fb9e2c6edf59, State: Running, Role: LEADER
I20260709 12:27:22.418051  2611 raft_consensus.cc:3060] T d36e6c0657bd486b939805a704e580af P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:22.418918  2325 consensus_queue.cc:260] T d36e6c0657bd486b939805a704e580af P 72d4afb41b7245b4b382fb9e2c6edf59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:22.419839  2325 raft_consensus.cc:3060] T d36e6c0657bd486b939805a704e580af P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:22.423491  2611 raft_consensus.cc:2468] T d36e6c0657bd486b939805a704e580af P 129c763b69224d7e9b2187721e58adeb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19566de89ecf48aca9903d8bfdd5d936 in term 2.
I20260709 12:27:22.424320  2325 raft_consensus.cc:2468] T d36e6c0657bd486b939805a704e580af P 72d4afb41b7245b4b382fb9e2c6edf59 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19566de89ecf48aca9903d8bfdd5d936 in term 2.
I20260709 12:27:22.424727  2364 leader_election.cc:304] T d36e6c0657bd486b939805a704e580af P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 129c763b69224d7e9b2187721e58adeb, 19566de89ecf48aca9903d8bfdd5d936; no voters: 
I20260709 12:27:22.425516  2546 raft_consensus.cc:2804] T d36e6c0657bd486b939805a704e580af P 19566de89ecf48aca9903d8bfdd5d936 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:22.425981  2546 raft_consensus.cc:697] T d36e6c0657bd486b939805a704e580af P 19566de89ecf48aca9903d8bfdd5d936 [term 2 LEADER]: Becoming Leader. State: Replica: 19566de89ecf48aca9903d8bfdd5d936, State: Running, Role: LEADER
I20260709 12:27:22.426857  2546 consensus_queue.cc:237] T d36e6c0657bd486b939805a704e580af P 19566de89ecf48aca9903d8bfdd5d936 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:22.433094  2148 catalog_manager.cc:5697] T d36e6c0657bd486b939805a704e580af P 19566de89ecf48aca9903d8bfdd5d936 reported cstate change: term changed from 1 to 2, leader changed from 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130) to 19566de89ecf48aca9903d8bfdd5d936 (127.23.245.131). New cstate: current_term: 2 leader_uuid: "19566de89ecf48aca9903d8bfdd5d936" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:22.523327  2401 raft_consensus.cc:1275] T 372666c8d7a84b429fe9df7c121e0bcf P 19566de89ecf48aca9903d8bfdd5d936 [term 4 FOLLOWER]: Refusing update from remote peer 72d4afb41b7245b4b382fb9e2c6edf59: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:27:22.524619  2499 consensus_queue.cc:1048] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:22.533062  2611 raft_consensus.cc:1275] T 372666c8d7a84b429fe9df7c121e0bcf P 129c763b69224d7e9b2187721e58adeb [term 4 FOLLOWER]: Refusing update from remote peer 72d4afb41b7245b4b382fb9e2c6edf59: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:27:22.535534  2676 consensus_queue.cc:1048] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:22.688401  2325 raft_consensus.cc:1275] T 100dcbf9addf448bba05f170b5051802 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 2 FOLLOWER]: Refusing update from remote peer 19566de89ecf48aca9903d8bfdd5d936: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:22.689519  2546 consensus_queue.cc:1048] T 100dcbf9addf448bba05f170b5051802 P 19566de89ecf48aca9903d8bfdd5d936 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:22.701781  2611 raft_consensus.cc:1275] T 100dcbf9addf448bba05f170b5051802 P 129c763b69224d7e9b2187721e58adeb [term 2 FOLLOWER]: Refusing update from remote peer 19566de89ecf48aca9903d8bfdd5d936: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:22.703668  2546 consensus_queue.cc:1048] T 100dcbf9addf448bba05f170b5051802 P 19566de89ecf48aca9903d8bfdd5d936 [LEADER]: Connected to new peer: Peer: permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:22.934541  2611 raft_consensus.cc:1275] T d36e6c0657bd486b939805a704e580af P 129c763b69224d7e9b2187721e58adeb [term 2 FOLLOWER]: Refusing update from remote peer 19566de89ecf48aca9903d8bfdd5d936: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:22.935853  2546 consensus_queue.cc:1048] T d36e6c0657bd486b939805a704e580af P 19566de89ecf48aca9903d8bfdd5d936 [LEADER]: Connected to new peer: Peer: permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:22.947304  2325 raft_consensus.cc:1275] T d36e6c0657bd486b939805a704e580af P 72d4afb41b7245b4b382fb9e2c6edf59 [term 2 FOLLOWER]: Refusing update from remote peer 19566de89ecf48aca9903d8bfdd5d936: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:22.949046  2692 consensus_queue.cc:1048] T d36e6c0657bd486b939805a704e580af P 19566de89ecf48aca9903d8bfdd5d936 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:22.954638 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:22.964897  2401 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "100dcbf9addf448bba05f170b5051802"
dest_uuid: "19566de89ecf48aca9903d8bfdd5d936"
mode: GRACEFUL
new_leader_uuid: "72d4afb41b7245b4b382fb9e2c6edf59"
 from {username='slave'} at 127.0.0.1:40606
I20260709 12:27:22.965449  2401 raft_consensus.cc:606] T 100dcbf9addf448bba05f170b5051802 P 19566de89ecf48aca9903d8bfdd5d936 [term 2 LEADER]: Received request to transfer leadership to TS 72d4afb41b7245b4b382fb9e2c6edf59
I20260709 12:27:22.967983  2325 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1797eb20c76642c3912213b96a0156bb"
dest_uuid: "72d4afb41b7245b4b382fb9e2c6edf59"
mode: GRACEFUL
new_leader_uuid: "19566de89ecf48aca9903d8bfdd5d936"
 from {username='slave'} at 127.0.0.1:39756
I20260709 12:27:22.968690  2325 raft_consensus.cc:606] T 1797eb20c76642c3912213b96a0156bb P 72d4afb41b7245b4b382fb9e2c6edf59 [term 2 LEADER]: Received request to transfer leadership to TS 19566de89ecf48aca9903d8bfdd5d936
I20260709 12:27:22.971012  2401 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de5c5dbcf4844dab833043ea584da490"
dest_uuid: "19566de89ecf48aca9903d8bfdd5d936"
mode: GRACEFUL
new_leader_uuid: "72d4afb41b7245b4b382fb9e2c6edf59"
 from {username='slave'} at 127.0.0.1:40606
I20260709 12:27:22.971441  2401 raft_consensus.cc:606] T de5c5dbcf4844dab833043ea584da490 P 19566de89ecf48aca9903d8bfdd5d936 [term 1 LEADER]: Received request to transfer leadership to TS 72d4afb41b7245b4b382fb9e2c6edf59
I20260709 12:27:22.972520 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:27:22.973042 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:22.973594 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:23.121497  2546 raft_consensus.cc:993] T de5c5dbcf4844dab833043ea584da490 P 19566de89ecf48aca9903d8bfdd5d936: : Instructing follower 72d4afb41b7245b4b382fb9e2c6edf59 to start an election
I20260709 12:27:23.122080  2692 raft_consensus.cc:1081] T de5c5dbcf4844dab833043ea584da490 P 19566de89ecf48aca9903d8bfdd5d936 [term 1 LEADER]: Signalling peer 72d4afb41b7245b4b382fb9e2c6edf59 to start an election
I20260709 12:27:23.124027  2325 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de5c5dbcf4844dab833043ea584da490"
dest_uuid: "72d4afb41b7245b4b382fb9e2c6edf59"
 from {username='slave'} at 127.0.0.1:39744
I20260709 12:27:23.124464  2325 raft_consensus.cc:493] T de5c5dbcf4844dab833043ea584da490 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:23.124753  2325 raft_consensus.cc:3060] T de5c5dbcf4844dab833043ea584da490 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:23.129349  2325 raft_consensus.cc:515] T de5c5dbcf4844dab833043ea584da490 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:23.130941  2325 leader_election.cc:290] T de5c5dbcf4844dab833043ea584da490 P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 2 election: Requested vote from peers 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605), 19566de89ecf48aca9903d8bfdd5d936 (127.23.245.131:38763)
I20260709 12:27:23.132062  2401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5c5dbcf4844dab833043ea584da490" candidate_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "19566de89ecf48aca9903d8bfdd5d936"
I20260709 12:27:23.132623  2401 raft_consensus.cc:3055] T de5c5dbcf4844dab833043ea584da490 P 19566de89ecf48aca9903d8bfdd5d936 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:23.132515  2611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de5c5dbcf4844dab833043ea584da490" candidate_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "129c763b69224d7e9b2187721e58adeb"
I20260709 12:27:23.133055  2401 raft_consensus.cc:740] T de5c5dbcf4844dab833043ea584da490 P 19566de89ecf48aca9903d8bfdd5d936 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 19566de89ecf48aca9903d8bfdd5d936, State: Running, Role: LEADER
I20260709 12:27:23.133258  2611 raft_consensus.cc:3060] T de5c5dbcf4844dab833043ea584da490 P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:23.133838  2401 consensus_queue.cc:260] T de5c5dbcf4844dab833043ea584da490 P 19566de89ecf48aca9903d8bfdd5d936 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:23.134977  2401 raft_consensus.cc:3060] T de5c5dbcf4844dab833043ea584da490 P 19566de89ecf48aca9903d8bfdd5d936 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:23.138692  2611 raft_consensus.cc:2468] T de5c5dbcf4844dab833043ea584da490 P 129c763b69224d7e9b2187721e58adeb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d4afb41b7245b4b382fb9e2c6edf59 in term 2.
I20260709 12:27:23.139387  2401 raft_consensus.cc:2468] T de5c5dbcf4844dab833043ea584da490 P 19566de89ecf48aca9903d8bfdd5d936 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d4afb41b7245b4b382fb9e2c6edf59 in term 2.
I20260709 12:27:23.139815  2290 leader_election.cc:304] T de5c5dbcf4844dab833043ea584da490 P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 129c763b69224d7e9b2187721e58adeb, 72d4afb41b7245b4b382fb9e2c6edf59; no voters: 
I20260709 12:27:23.140743  2698 raft_consensus.cc:2804] T de5c5dbcf4844dab833043ea584da490 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:23.141278  2698 raft_consensus.cc:697] T de5c5dbcf4844dab833043ea584da490 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 2 LEADER]: Becoming Leader. State: Replica: 72d4afb41b7245b4b382fb9e2c6edf59, State: Running, Role: LEADER
I20260709 12:27:23.142154  2698 consensus_queue.cc:237] T de5c5dbcf4844dab833043ea584da490 P 72d4afb41b7245b4b382fb9e2c6edf59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:23.149816  2150 catalog_manager.cc:5697] T de5c5dbcf4844dab833043ea584da490 P 72d4afb41b7245b4b382fb9e2c6edf59 reported cstate change: term changed from 1 to 2, leader changed from 19566de89ecf48aca9903d8bfdd5d936 (127.23.245.131) to 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130). New cstate: current_term: 2 leader_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:23.180898  2693 raft_consensus.cc:993] T 100dcbf9addf448bba05f170b5051802 P 19566de89ecf48aca9903d8bfdd5d936: : Instructing follower 72d4afb41b7245b4b382fb9e2c6edf59 to start an election
I20260709 12:27:23.181370  2693 raft_consensus.cc:1081] T 100dcbf9addf448bba05f170b5051802 P 19566de89ecf48aca9903d8bfdd5d936 [term 2 LEADER]: Signalling peer 72d4afb41b7245b4b382fb9e2c6edf59 to start an election
I20260709 12:27:23.182835  2325 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "100dcbf9addf448bba05f170b5051802"
dest_uuid: "72d4afb41b7245b4b382fb9e2c6edf59"
 from {username='slave'} at 127.0.0.1:39744
I20260709 12:27:23.183311  2325 raft_consensus.cc:493] T 100dcbf9addf448bba05f170b5051802 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:23.183560  2325 raft_consensus.cc:3060] T 100dcbf9addf448bba05f170b5051802 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:23.188690  2325 raft_consensus.cc:515] T 100dcbf9addf448bba05f170b5051802 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:23.190173  2325 leader_election.cc:290] T 100dcbf9addf448bba05f170b5051802 P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 3 election: Requested vote from peers 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605), 19566de89ecf48aca9903d8bfdd5d936 (127.23.245.131:38763)
I20260709 12:27:23.191022  2611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "100dcbf9addf448bba05f170b5051802" candidate_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "129c763b69224d7e9b2187721e58adeb"
I20260709 12:27:23.191239  2401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "100dcbf9addf448bba05f170b5051802" candidate_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "19566de89ecf48aca9903d8bfdd5d936"
I20260709 12:27:23.191684  2611 raft_consensus.cc:3060] T 100dcbf9addf448bba05f170b5051802 P 129c763b69224d7e9b2187721e58adeb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:23.191843  2401 raft_consensus.cc:3055] T 100dcbf9addf448bba05f170b5051802 P 19566de89ecf48aca9903d8bfdd5d936 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:23.192225  2401 raft_consensus.cc:740] T 100dcbf9addf448bba05f170b5051802 P 19566de89ecf48aca9903d8bfdd5d936 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 19566de89ecf48aca9903d8bfdd5d936, State: Running, Role: LEADER
I20260709 12:27:23.192896  2401 consensus_queue.cc:260] T 100dcbf9addf448bba05f170b5051802 P 19566de89ecf48aca9903d8bfdd5d936 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:23.193765  2401 raft_consensus.cc:3060] T 100dcbf9addf448bba05f170b5051802 P 19566de89ecf48aca9903d8bfdd5d936 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:23.196590  2611 raft_consensus.cc:2468] T 100dcbf9addf448bba05f170b5051802 P 129c763b69224d7e9b2187721e58adeb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d4afb41b7245b4b382fb9e2c6edf59 in term 3.
I20260709 12:27:23.197853  2290 leader_election.cc:304] T 100dcbf9addf448bba05f170b5051802 P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 129c763b69224d7e9b2187721e58adeb, 72d4afb41b7245b4b382fb9e2c6edf59; no voters: 
I20260709 12:27:23.198587  2401 raft_consensus.cc:2468] T 100dcbf9addf448bba05f170b5051802 P 19566de89ecf48aca9903d8bfdd5d936 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d4afb41b7245b4b382fb9e2c6edf59 in term 3.
I20260709 12:27:23.198611  2698 raft_consensus.cc:2804] T 100dcbf9addf448bba05f170b5051802 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:23.199326  2698 raft_consensus.cc:697] T 100dcbf9addf448bba05f170b5051802 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 3 LEADER]: Becoming Leader. State: Replica: 72d4afb41b7245b4b382fb9e2c6edf59, State: Running, Role: LEADER
I20260709 12:27:23.200233  2698 consensus_queue.cc:237] T 100dcbf9addf448bba05f170b5051802 P 72d4afb41b7245b4b382fb9e2c6edf59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:23.206101  2150 catalog_manager.cc:5697] T 100dcbf9addf448bba05f170b5051802 P 72d4afb41b7245b4b382fb9e2c6edf59 reported cstate change: term changed from 2 to 3, leader changed from 19566de89ecf48aca9903d8bfdd5d936 (127.23.245.131) to 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130). New cstate: current_term: 3 leader_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:23.278380  2697 raft_consensus.cc:993] T 1797eb20c76642c3912213b96a0156bb P 72d4afb41b7245b4b382fb9e2c6edf59: : Instructing follower 19566de89ecf48aca9903d8bfdd5d936 to start an election
I20260709 12:27:23.278895  2697 raft_consensus.cc:1081] T 1797eb20c76642c3912213b96a0156bb P 72d4afb41b7245b4b382fb9e2c6edf59 [term 2 LEADER]: Signalling peer 19566de89ecf48aca9903d8bfdd5d936 to start an election
I20260709 12:27:23.280351  2401 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1797eb20c76642c3912213b96a0156bb"
dest_uuid: "19566de89ecf48aca9903d8bfdd5d936"
 from {username='slave'} at 127.0.0.1:40600
I20260709 12:27:23.280797  2401 raft_consensus.cc:493] T 1797eb20c76642c3912213b96a0156bb P 19566de89ecf48aca9903d8bfdd5d936 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:23.281059  2401 raft_consensus.cc:3060] T 1797eb20c76642c3912213b96a0156bb P 19566de89ecf48aca9903d8bfdd5d936 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:23.285549  2401 raft_consensus.cc:515] T 1797eb20c76642c3912213b96a0156bb P 19566de89ecf48aca9903d8bfdd5d936 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:23.287009  2401 leader_election.cc:290] T 1797eb20c76642c3912213b96a0156bb P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 3 election: Requested vote from peers 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605), 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130:42771)
I20260709 12:27:23.287983  2611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1797eb20c76642c3912213b96a0156bb" candidate_uuid: "19566de89ecf48aca9903d8bfdd5d936" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "129c763b69224d7e9b2187721e58adeb"
I20260709 12:27:23.287999  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1797eb20c76642c3912213b96a0156bb" candidate_uuid: "19566de89ecf48aca9903d8bfdd5d936" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "72d4afb41b7245b4b382fb9e2c6edf59"
I20260709 12:27:23.288769  2611 raft_consensus.cc:3060] T 1797eb20c76642c3912213b96a0156bb P 129c763b69224d7e9b2187721e58adeb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:23.288789  2325 raft_consensus.cc:3055] T 1797eb20c76642c3912213b96a0156bb P 72d4afb41b7245b4b382fb9e2c6edf59 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:23.289297  2325 raft_consensus.cc:740] T 1797eb20c76642c3912213b96a0156bb P 72d4afb41b7245b4b382fb9e2c6edf59 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 72d4afb41b7245b4b382fb9e2c6edf59, State: Running, Role: LEADER
I20260709 12:27:23.290027  2325 consensus_queue.cc:260] T 1797eb20c76642c3912213b96a0156bb P 72d4afb41b7245b4b382fb9e2c6edf59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:23.291174  2325 raft_consensus.cc:3060] T 1797eb20c76642c3912213b96a0156bb P 72d4afb41b7245b4b382fb9e2c6edf59 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:23.295523  2611 raft_consensus.cc:2468] T 1797eb20c76642c3912213b96a0156bb P 129c763b69224d7e9b2187721e58adeb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19566de89ecf48aca9903d8bfdd5d936 in term 3.
I20260709 12:27:23.296759  2364 leader_election.cc:304] T 1797eb20c76642c3912213b96a0156bb P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 129c763b69224d7e9b2187721e58adeb, 19566de89ecf48aca9903d8bfdd5d936; no voters: 
I20260709 12:27:23.297375  2325 raft_consensus.cc:2468] T 1797eb20c76642c3912213b96a0156bb P 72d4afb41b7245b4b382fb9e2c6edf59 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19566de89ecf48aca9903d8bfdd5d936 in term 3.
I20260709 12:27:23.297446  2693 raft_consensus.cc:2804] T 1797eb20c76642c3912213b96a0156bb P 19566de89ecf48aca9903d8bfdd5d936 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:23.298048  2693 raft_consensus.cc:697] T 1797eb20c76642c3912213b96a0156bb P 19566de89ecf48aca9903d8bfdd5d936 [term 3 LEADER]: Becoming Leader. State: Replica: 19566de89ecf48aca9903d8bfdd5d936, State: Running, Role: LEADER
I20260709 12:27:23.298832  2693 consensus_queue.cc:237] T 1797eb20c76642c3912213b96a0156bb P 19566de89ecf48aca9903d8bfdd5d936 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:23.306128  2150 catalog_manager.cc:5697] T 1797eb20c76642c3912213b96a0156bb P 19566de89ecf48aca9903d8bfdd5d936 reported cstate change: term changed from 2 to 3, leader changed from 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130) to 19566de89ecf48aca9903d8bfdd5d936 (127.23.245.131). New cstate: current_term: 3 leader_uuid: "19566de89ecf48aca9903d8bfdd5d936" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } health_report { overall_health: HEALTHY } } }
W20260709 12:27:23.307173  2198 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:27:23.563473  2611 raft_consensus.cc:1275] T de5c5dbcf4844dab833043ea584da490 P 129c763b69224d7e9b2187721e58adeb [term 2 FOLLOWER]: Refusing update from remote peer 72d4afb41b7245b4b382fb9e2c6edf59: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:23.564914  2697 consensus_queue.cc:1048] T de5c5dbcf4844dab833043ea584da490 P 72d4afb41b7245b4b382fb9e2c6edf59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:23.576045  2401 raft_consensus.cc:1275] T de5c5dbcf4844dab833043ea584da490 P 19566de89ecf48aca9903d8bfdd5d936 [term 2 FOLLOWER]: Refusing update from remote peer 72d4afb41b7245b4b382fb9e2c6edf59: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:23.577399  2697 consensus_queue.cc:1048] T de5c5dbcf4844dab833043ea584da490 P 72d4afb41b7245b4b382fb9e2c6edf59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:23.640731  2610 raft_consensus.cc:1275] T 100dcbf9addf448bba05f170b5051802 P 129c763b69224d7e9b2187721e58adeb [term 3 FOLLOWER]: Refusing update from remote peer 72d4afb41b7245b4b382fb9e2c6edf59: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:23.642095  2697 consensus_queue.cc:1048] T 100dcbf9addf448bba05f170b5051802 P 72d4afb41b7245b4b382fb9e2c6edf59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:23.649542  2401 raft_consensus.cc:1275] T 100dcbf9addf448bba05f170b5051802 P 19566de89ecf48aca9903d8bfdd5d936 [term 3 FOLLOWER]: Refusing update from remote peer 72d4afb41b7245b4b382fb9e2c6edf59: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:23.651280  2697 consensus_queue.cc:1048] T 100dcbf9addf448bba05f170b5051802 P 72d4afb41b7245b4b382fb9e2c6edf59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:23.690846  2325 raft_consensus.cc:1275] T 1797eb20c76642c3912213b96a0156bb P 72d4afb41b7245b4b382fb9e2c6edf59 [term 3 FOLLOWER]: Refusing update from remote peer 19566de89ecf48aca9903d8bfdd5d936: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:23.692284  2692 consensus_queue.cc:1048] T 1797eb20c76642c3912213b96a0156bb P 19566de89ecf48aca9903d8bfdd5d936 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:23.700495  2610 raft_consensus.cc:1275] T 1797eb20c76642c3912213b96a0156bb P 129c763b69224d7e9b2187721e58adeb [term 3 FOLLOWER]: Refusing update from remote peer 19566de89ecf48aca9903d8bfdd5d936: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:23.702150  2546 consensus_queue.cc:1048] T 1797eb20c76642c3912213b96a0156bb P 19566de89ecf48aca9903d8bfdd5d936 [LEADER]: Connected to new peer: Peer: permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:23.979878 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:23.987332  2325 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1523f5077995462b83bfa389d020880b"
dest_uuid: "72d4afb41b7245b4b382fb9e2c6edf59"
mode: GRACEFUL
new_leader_uuid: "19566de89ecf48aca9903d8bfdd5d936"
 from {username='slave'} at 127.0.0.1:39756
I20260709 12:27:23.987965  2325 raft_consensus.cc:606] T 1523f5077995462b83bfa389d020880b P 72d4afb41b7245b4b382fb9e2c6edf59 [term 3 LEADER]: Received request to transfer leadership to TS 19566de89ecf48aca9903d8bfdd5d936
I20260709 12:27:23.990824  2325 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "372666c8d7a84b429fe9df7c121e0bcf"
dest_uuid: "72d4afb41b7245b4b382fb9e2c6edf59"
mode: GRACEFUL
new_leader_uuid: "19566de89ecf48aca9903d8bfdd5d936"
 from {username='slave'} at 127.0.0.1:39756
I20260709 12:27:23.991304  2325 raft_consensus.cc:606] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [term 4 LEADER]: Received request to transfer leadership to TS 19566de89ecf48aca9903d8bfdd5d936
I20260709 12:27:23.993688  2401 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb73a7a0e4004a1bbab977eb0c11d8dd"
dest_uuid: "19566de89ecf48aca9903d8bfdd5d936"
mode: GRACEFUL
new_leader_uuid: "72d4afb41b7245b4b382fb9e2c6edf59"
 from {username='slave'} at 127.0.0.1:40606
I20260709 12:27:23.994160  2401 raft_consensus.cc:606] T cb73a7a0e4004a1bbab977eb0c11d8dd P 19566de89ecf48aca9903d8bfdd5d936 [term 3 LEADER]: Received request to transfer leadership to TS 72d4afb41b7245b4b382fb9e2c6edf59
I20260709 12:27:23.995199 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:27:23.995702 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:23.996237 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:24.049902  2698 raft_consensus.cc:993] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59: : Instructing follower 19566de89ecf48aca9903d8bfdd5d936 to start an election
I20260709 12:27:24.050449  2676 raft_consensus.cc:1081] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [term 4 LEADER]: Signalling peer 19566de89ecf48aca9903d8bfdd5d936 to start an election
I20260709 12:27:24.051995  2401 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "372666c8d7a84b429fe9df7c121e0bcf"
dest_uuid: "19566de89ecf48aca9903d8bfdd5d936"
 from {username='slave'} at 127.0.0.1:40600
I20260709 12:27:24.052476  2401 raft_consensus.cc:493] T 372666c8d7a84b429fe9df7c121e0bcf P 19566de89ecf48aca9903d8bfdd5d936 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:24.052748  2401 raft_consensus.cc:3060] T 372666c8d7a84b429fe9df7c121e0bcf P 19566de89ecf48aca9903d8bfdd5d936 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:24.057348  2401 raft_consensus.cc:515] T 372666c8d7a84b429fe9df7c121e0bcf P 19566de89ecf48aca9903d8bfdd5d936 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:24.058797  2401 leader_election.cc:290] T 372666c8d7a84b429fe9df7c121e0bcf P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 5 election: Requested vote from peers 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605), 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130:42771)
I20260709 12:27:24.059803  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372666c8d7a84b429fe9df7c121e0bcf" candidate_uuid: "19566de89ecf48aca9903d8bfdd5d936" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "72d4afb41b7245b4b382fb9e2c6edf59"
I20260709 12:27:24.059820  2610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "372666c8d7a84b429fe9df7c121e0bcf" candidate_uuid: "19566de89ecf48aca9903d8bfdd5d936" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "129c763b69224d7e9b2187721e58adeb"
I20260709 12:27:24.060750  2325 raft_consensus.cc:3055] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:24.060758  2610 raft_consensus.cc:3060] T 372666c8d7a84b429fe9df7c121e0bcf P 129c763b69224d7e9b2187721e58adeb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:24.061062  2325 raft_consensus.cc:740] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 72d4afb41b7245b4b382fb9e2c6edf59, State: Running, Role: LEADER
I20260709 12:27:24.061868  2325 consensus_queue.cc:260] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:24.062790  2325 raft_consensus.cc:3060] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:24.065981  2610 raft_consensus.cc:2468] T 372666c8d7a84b429fe9df7c121e0bcf P 129c763b69224d7e9b2187721e58adeb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19566de89ecf48aca9903d8bfdd5d936 in term 5.
I20260709 12:27:24.067046  2364 leader_election.cc:304] T 372666c8d7a84b429fe9df7c121e0bcf P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 129c763b69224d7e9b2187721e58adeb, 19566de89ecf48aca9903d8bfdd5d936; no voters: 
I20260709 12:27:24.067538  2325 raft_consensus.cc:2468] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19566de89ecf48aca9903d8bfdd5d936 in term 5.
I20260709 12:27:24.067749  2693 raft_consensus.cc:2804] T 372666c8d7a84b429fe9df7c121e0bcf P 19566de89ecf48aca9903d8bfdd5d936 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:24.068347  2693 raft_consensus.cc:697] T 372666c8d7a84b429fe9df7c121e0bcf P 19566de89ecf48aca9903d8bfdd5d936 [term 5 LEADER]: Becoming Leader. State: Replica: 19566de89ecf48aca9903d8bfdd5d936, State: Running, Role: LEADER
I20260709 12:27:24.069204  2693 consensus_queue.cc:237] T 372666c8d7a84b429fe9df7c121e0bcf P 19566de89ecf48aca9903d8bfdd5d936 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:24.076035  2148 catalog_manager.cc:5697] T 372666c8d7a84b429fe9df7c121e0bcf P 19566de89ecf48aca9903d8bfdd5d936 reported cstate change: term changed from 4 to 5, leader changed from 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130) to 19566de89ecf48aca9903d8bfdd5d936 (127.23.245.131). New cstate: current_term: 5 leader_uuid: "19566de89ecf48aca9903d8bfdd5d936" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:24.085551  2697 raft_consensus.cc:993] T 1523f5077995462b83bfa389d020880b P 72d4afb41b7245b4b382fb9e2c6edf59: : Instructing follower 19566de89ecf48aca9903d8bfdd5d936 to start an election
I20260709 12:27:24.086117  2697 raft_consensus.cc:1081] T 1523f5077995462b83bfa389d020880b P 72d4afb41b7245b4b382fb9e2c6edf59 [term 3 LEADER]: Signalling peer 19566de89ecf48aca9903d8bfdd5d936 to start an election
I20260709 12:27:24.088009  2400 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1523f5077995462b83bfa389d020880b"
dest_uuid: "19566de89ecf48aca9903d8bfdd5d936"
 from {username='slave'} at 127.0.0.1:40600
I20260709 12:27:24.088585  2400 raft_consensus.cc:493] T 1523f5077995462b83bfa389d020880b P 19566de89ecf48aca9903d8bfdd5d936 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:24.088958  2400 raft_consensus.cc:3060] T 1523f5077995462b83bfa389d020880b P 19566de89ecf48aca9903d8bfdd5d936 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:24.094584  2400 raft_consensus.cc:515] T 1523f5077995462b83bfa389d020880b P 19566de89ecf48aca9903d8bfdd5d936 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:24.096431  2400 leader_election.cc:290] T 1523f5077995462b83bfa389d020880b P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 4 election: Requested vote from peers 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605), 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130:42771)
I20260709 12:27:24.097178  2610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1523f5077995462b83bfa389d020880b" candidate_uuid: "19566de89ecf48aca9903d8bfdd5d936" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "129c763b69224d7e9b2187721e58adeb"
I20260709 12:27:24.097364  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1523f5077995462b83bfa389d020880b" candidate_uuid: "19566de89ecf48aca9903d8bfdd5d936" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "72d4afb41b7245b4b382fb9e2c6edf59"
I20260709 12:27:24.097937  2610 raft_consensus.cc:3060] T 1523f5077995462b83bfa389d020880b P 129c763b69224d7e9b2187721e58adeb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:24.097952  2325 raft_consensus.cc:3055] T 1523f5077995462b83bfa389d020880b P 72d4afb41b7245b4b382fb9e2c6edf59 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:24.098502  2325 raft_consensus.cc:740] T 1523f5077995462b83bfa389d020880b P 72d4afb41b7245b4b382fb9e2c6edf59 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 72d4afb41b7245b4b382fb9e2c6edf59, State: Running, Role: LEADER
I20260709 12:27:24.099262  2325 consensus_queue.cc:260] T 1523f5077995462b83bfa389d020880b P 72d4afb41b7245b4b382fb9e2c6edf59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:24.100446  2325 raft_consensus.cc:3060] T 1523f5077995462b83bfa389d020880b P 72d4afb41b7245b4b382fb9e2c6edf59 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:24.105239  2610 raft_consensus.cc:2468] T 1523f5077995462b83bfa389d020880b P 129c763b69224d7e9b2187721e58adeb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19566de89ecf48aca9903d8bfdd5d936 in term 4.
I20260709 12:27:24.106475  2364 leader_election.cc:304] T 1523f5077995462b83bfa389d020880b P 19566de89ecf48aca9903d8bfdd5d936 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 129c763b69224d7e9b2187721e58adeb, 19566de89ecf48aca9903d8bfdd5d936; no voters: 
I20260709 12:27:24.106866  2325 raft_consensus.cc:2468] T 1523f5077995462b83bfa389d020880b P 72d4afb41b7245b4b382fb9e2c6edf59 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 19566de89ecf48aca9903d8bfdd5d936 in term 4.
I20260709 12:27:24.107187  2693 raft_consensus.cc:2804] T 1523f5077995462b83bfa389d020880b P 19566de89ecf48aca9903d8bfdd5d936 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:24.107723  2693 raft_consensus.cc:697] T 1523f5077995462b83bfa389d020880b P 19566de89ecf48aca9903d8bfdd5d936 [term 4 LEADER]: Becoming Leader. State: Replica: 19566de89ecf48aca9903d8bfdd5d936, State: Running, Role: LEADER
I20260709 12:27:24.108548  2693 consensus_queue.cc:237] T 1523f5077995462b83bfa389d020880b P 19566de89ecf48aca9903d8bfdd5d936 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:24.115978  2150 catalog_manager.cc:5697] T 1523f5077995462b83bfa389d020880b P 19566de89ecf48aca9903d8bfdd5d936 reported cstate change: term changed from 3 to 4, leader changed from 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130) to 19566de89ecf48aca9903d8bfdd5d936 (127.23.245.131). New cstate: current_term: 4 leader_uuid: "19566de89ecf48aca9903d8bfdd5d936" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } health_report { overall_health: HEALTHY } } }
W20260709 12:27:24.308359  2198 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:27:24.449014  2692 raft_consensus.cc:993] T cb73a7a0e4004a1bbab977eb0c11d8dd P 19566de89ecf48aca9903d8bfdd5d936: : Instructing follower 72d4afb41b7245b4b382fb9e2c6edf59 to start an election
I20260709 12:27:24.450042  2693 raft_consensus.cc:1081] T cb73a7a0e4004a1bbab977eb0c11d8dd P 19566de89ecf48aca9903d8bfdd5d936 [term 3 LEADER]: Signalling peer 72d4afb41b7245b4b382fb9e2c6edf59 to start an election
I20260709 12:27:24.452329  2325 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb73a7a0e4004a1bbab977eb0c11d8dd"
dest_uuid: "72d4afb41b7245b4b382fb9e2c6edf59"
 from {username='slave'} at 127.0.0.1:39744
I20260709 12:27:24.453015  2325 raft_consensus.cc:493] T cb73a7a0e4004a1bbab977eb0c11d8dd P 72d4afb41b7245b4b382fb9e2c6edf59 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:24.453372  2325 raft_consensus.cc:3060] T cb73a7a0e4004a1bbab977eb0c11d8dd P 72d4afb41b7245b4b382fb9e2c6edf59 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:24.462664  2325 raft_consensus.cc:515] T cb73a7a0e4004a1bbab977eb0c11d8dd P 72d4afb41b7245b4b382fb9e2c6edf59 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:24.464666  2325 leader_election.cc:290] T cb73a7a0e4004a1bbab977eb0c11d8dd P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 4 election: Requested vote from peers 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605), 19566de89ecf48aca9903d8bfdd5d936 (127.23.245.131:38763)
I20260709 12:27:24.466517  2610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb73a7a0e4004a1bbab977eb0c11d8dd" candidate_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "129c763b69224d7e9b2187721e58adeb"
I20260709 12:27:24.467136  2400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb73a7a0e4004a1bbab977eb0c11d8dd" candidate_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "19566de89ecf48aca9903d8bfdd5d936"
I20260709 12:27:24.468111  2400 raft_consensus.cc:3055] T cb73a7a0e4004a1bbab977eb0c11d8dd P 19566de89ecf48aca9903d8bfdd5d936 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:24.468120  2610 raft_consensus.cc:3060] T cb73a7a0e4004a1bbab977eb0c11d8dd P 129c763b69224d7e9b2187721e58adeb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:24.468505  2400 raft_consensus.cc:740] T cb73a7a0e4004a1bbab977eb0c11d8dd P 19566de89ecf48aca9903d8bfdd5d936 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 19566de89ecf48aca9903d8bfdd5d936, State: Running, Role: LEADER
I20260709 12:27:24.470053  2400 consensus_queue.cc:260] T cb73a7a0e4004a1bbab977eb0c11d8dd P 19566de89ecf48aca9903d8bfdd5d936 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:24.476533  2400 raft_consensus.cc:3060] T cb73a7a0e4004a1bbab977eb0c11d8dd P 19566de89ecf48aca9903d8bfdd5d936 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:24.479274  2610 raft_consensus.cc:2468] T cb73a7a0e4004a1bbab977eb0c11d8dd P 129c763b69224d7e9b2187721e58adeb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d4afb41b7245b4b382fb9e2c6edf59 in term 4.
I20260709 12:27:24.480118  2611 raft_consensus.cc:1240] T cb73a7a0e4004a1bbab977eb0c11d8dd P 129c763b69224d7e9b2187721e58adeb [term 4 FOLLOWER]: Rejecting Update request from peer 19566de89ecf48aca9903d8bfdd5d936 for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:24.481446  2290 leader_election.cc:304] T cb73a7a0e4004a1bbab977eb0c11d8dd P 72d4afb41b7245b4b382fb9e2c6edf59 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 129c763b69224d7e9b2187721e58adeb, 72d4afb41b7245b4b382fb9e2c6edf59; no voters: 
I20260709 12:27:24.482697  2697 raft_consensus.cc:2804] T cb73a7a0e4004a1bbab977eb0c11d8dd P 72d4afb41b7245b4b382fb9e2c6edf59 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:24.483376  2697 raft_consensus.cc:697] T cb73a7a0e4004a1bbab977eb0c11d8dd P 72d4afb41b7245b4b382fb9e2c6edf59 [term 4 LEADER]: Becoming Leader. State: Replica: 72d4afb41b7245b4b382fb9e2c6edf59, State: Running, Role: LEADER
I20260709 12:27:24.485131  2697 consensus_queue.cc:237] T cb73a7a0e4004a1bbab977eb0c11d8dd P 72d4afb41b7245b4b382fb9e2c6edf59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } }
I20260709 12:27:24.485853  2400 raft_consensus.cc:2468] T cb73a7a0e4004a1bbab977eb0c11d8dd P 19566de89ecf48aca9903d8bfdd5d936 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 72d4afb41b7245b4b382fb9e2c6edf59 in term 4.
I20260709 12:27:24.488495  2325 raft_consensus.cc:1275] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [term 5 FOLLOWER]: Refusing update from remote peer 19566de89ecf48aca9903d8bfdd5d936: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:27:24.490146  2692 consensus_queue.cc:1048] T 372666c8d7a84b429fe9df7c121e0bcf P 19566de89ecf48aca9903d8bfdd5d936 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:27:24.505306  2150 catalog_manager.cc:5697] T cb73a7a0e4004a1bbab977eb0c11d8dd P 72d4afb41b7245b4b382fb9e2c6edf59 reported cstate change: term changed from 3 to 4, leader changed from 19566de89ecf48aca9903d8bfdd5d936 (127.23.245.131) to 72d4afb41b7245b4b382fb9e2c6edf59 (127.23.245.130). New cstate: current_term: 4 leader_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:24.513255  2611 raft_consensus.cc:1275] T 372666c8d7a84b429fe9df7c121e0bcf P 129c763b69224d7e9b2187721e58adeb [term 5 FOLLOWER]: Refusing update from remote peer 19566de89ecf48aca9903d8bfdd5d936: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:27:24.515594  2692 consensus_queue.cc:1048] T 372666c8d7a84b429fe9df7c121e0bcf P 19566de89ecf48aca9903d8bfdd5d936 [LEADER]: Connected to new peer: Peer: permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:27:24.564901  2611 raft_consensus.cc:1275] T 1523f5077995462b83bfa389d020880b P 129c763b69224d7e9b2187721e58adeb [term 4 FOLLOWER]: Refusing update from remote peer 19566de89ecf48aca9903d8bfdd5d936: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:27:24.566066  2692 consensus_queue.cc:1048] T 1523f5077995462b83bfa389d020880b P 19566de89ecf48aca9903d8bfdd5d936 [LEADER]: Connected to new peer: Peer: permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:24.579504  2325 raft_consensus.cc:1275] T 1523f5077995462b83bfa389d020880b P 72d4afb41b7245b4b382fb9e2c6edf59 [term 4 FOLLOWER]: Refusing update from remote peer 19566de89ecf48aca9903d8bfdd5d936: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:27:24.581467  2546 consensus_queue.cc:1048] T 1523f5077995462b83bfa389d020880b P 19566de89ecf48aca9903d8bfdd5d936 [LEADER]: Connected to new peer: Peer: permanent_uuid: "72d4afb41b7245b4b382fb9e2c6edf59" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 42771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:27:24.922511  2610 raft_consensus.cc:1275] T cb73a7a0e4004a1bbab977eb0c11d8dd P 129c763b69224d7e9b2187721e58adeb [term 4 FOLLOWER]: Refusing update from remote peer 72d4afb41b7245b4b382fb9e2c6edf59: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:24.924029  2714 consensus_queue.cc:1048] T cb73a7a0e4004a1bbab977eb0c11d8dd P 72d4afb41b7245b4b382fb9e2c6edf59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "129c763b69224d7e9b2187721e58adeb" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 35605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:24.934044  2400 raft_consensus.cc:1275] T cb73a7a0e4004a1bbab977eb0c11d8dd P 19566de89ecf48aca9903d8bfdd5d936 [term 4 FOLLOWER]: Refusing update from remote peer 72d4afb41b7245b4b382fb9e2c6edf59: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:24.936122  2729 consensus_queue.cc:1048] T cb73a7a0e4004a1bbab977eb0c11d8dd P 72d4afb41b7245b4b382fb9e2c6edf59 [LEADER]: Connected to new peer: Peer: permanent_uuid: "19566de89ecf48aca9903d8bfdd5d936" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 38763 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:25.002993 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:25.037593 24534 tablet_server.cc:179] TabletServer@127.23.245.129:35605 shutting down...
I20260709 12:27:25.061117 24534 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:25.062096 24534 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:25.062939 24534 raft_consensus.cc:2243] T a4decfc5493a43e9bb1dca65d85388e7 P 129c763b69224d7e9b2187721e58adeb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:25.063522 24534 raft_consensus.cc:2272] T a4decfc5493a43e9bb1dca65d85388e7 P 129c763b69224d7e9b2187721e58adeb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:25.066155 24534 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:25.067098 24534 raft_consensus.cc:2243] T ea09120684274446b5c0965e6a6a9b4c P 129c763b69224d7e9b2187721e58adeb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:25.067711 24534 raft_consensus.cc:2272] T ea09120684274446b5c0965e6a6a9b4c P 129c763b69224d7e9b2187721e58adeb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:25.070799 24534 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:25.071461 24534 raft_consensus.cc:2243] T cb73a7a0e4004a1bbab977eb0c11d8dd P 129c763b69224d7e9b2187721e58adeb [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:25.072052 24534 raft_consensus.cc:2272] T cb73a7a0e4004a1bbab977eb0c11d8dd P 129c763b69224d7e9b2187721e58adeb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:25.074927 24534 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:25.075609 24534 raft_consensus.cc:2243] T 100dcbf9addf448bba05f170b5051802 P 129c763b69224d7e9b2187721e58adeb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:25.076196 24534 raft_consensus.cc:2272] T 100dcbf9addf448bba05f170b5051802 P 129c763b69224d7e9b2187721e58adeb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:25.078724 24534 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:25.079291 24534 raft_consensus.cc:2243] T de5c5dbcf4844dab833043ea584da490 P 129c763b69224d7e9b2187721e58adeb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:25.079782 24534 raft_consensus.cc:2272] T de5c5dbcf4844dab833043ea584da490 P 129c763b69224d7e9b2187721e58adeb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:25.082265 24534 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:25.082839 24534 raft_consensus.cc:2243] T d36e6c0657bd486b939805a704e580af P 129c763b69224d7e9b2187721e58adeb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:25.083426 24534 raft_consensus.cc:2272] T d36e6c0657bd486b939805a704e580af P 129c763b69224d7e9b2187721e58adeb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:25.086102 24534 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:25.086651 24534 raft_consensus.cc:2243] T 4915b590d3df467182d6ec1e3e5b7b9d P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:25.087172 24534 raft_consensus.cc:2272] T 4915b590d3df467182d6ec1e3e5b7b9d P 129c763b69224d7e9b2187721e58adeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:25.089568 24534 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:25.090132 24534 raft_consensus.cc:2243] T 1523f5077995462b83bfa389d020880b P 129c763b69224d7e9b2187721e58adeb [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:25.090730 24534 raft_consensus.cc:2272] T 1523f5077995462b83bfa389d020880b P 129c763b69224d7e9b2187721e58adeb [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:25.094197 24534 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:25.094817 24534 raft_consensus.cc:2243] T 1797eb20c76642c3912213b96a0156bb P 129c763b69224d7e9b2187721e58adeb [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:25.095396 24534 raft_consensus.cc:2272] T 1797eb20c76642c3912213b96a0156bb P 129c763b69224d7e9b2187721e58adeb [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:25.098060 24534 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:25.098619 24534 raft_consensus.cc:2243] T 372666c8d7a84b429fe9df7c121e0bcf P 129c763b69224d7e9b2187721e58adeb [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:25.099129 24534 raft_consensus.cc:2272] T 372666c8d7a84b429fe9df7c121e0bcf P 129c763b69224d7e9b2187721e58adeb [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:25.132797  2364 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.245.129:35605: connect: Connection refused (error 111) [suppressed 92 similar messages]
I20260709 12:27:25.134888 24534 tablet_server.cc:196] TabletServer@127.23.245.129:35605 shutdown complete.
W20260709 12:27:25.136915  2364 consensus_peers.cc:597] T d36e6c0657bd486b939805a704e580af P 19566de89ecf48aca9903d8bfdd5d936 -> Peer 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605): Couldn't send request to peer 129c763b69224d7e9b2187721e58adeb. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:35605: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:25.153597  2364 consensus_peers.cc:597] T 1523f5077995462b83bfa389d020880b P 19566de89ecf48aca9903d8bfdd5d936 -> Peer 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605): Couldn't send request to peer 129c763b69224d7e9b2187721e58adeb. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:35605: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:25.160445  2290 consensus_peers.cc:597] T de5c5dbcf4844dab833043ea584da490 P 72d4afb41b7245b4b382fb9e2c6edf59 -> Peer 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605): Couldn't send request to peer 129c763b69224d7e9b2187721e58adeb. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:35605: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:25.170359 24534 tablet_server.cc:179] TabletServer@127.23.245.130:0 shutting down...
I20260709 12:27:25.196641 24534 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:25.197454 24534 tablet_replica.cc:333] T cb73a7a0e4004a1bbab977eb0c11d8dd P 72d4afb41b7245b4b382fb9e2c6edf59: stopping tablet replica
I20260709 12:27:25.198673 24534 raft_consensus.cc:2243] T cb73a7a0e4004a1bbab977eb0c11d8dd P 72d4afb41b7245b4b382fb9e2c6edf59 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:27:25.199661 24534 raft_consensus.cc:2272] T cb73a7a0e4004a1bbab977eb0c11d8dd P 72d4afb41b7245b4b382fb9e2c6edf59 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:25.202589 24534 tablet_replica.cc:333] T ea09120684274446b5c0965e6a6a9b4c P 72d4afb41b7245b4b382fb9e2c6edf59: stopping tablet replica
I20260709 12:27:25.203200 24534 raft_consensus.cc:2243] T ea09120684274446b5c0965e6a6a9b4c P 72d4afb41b7245b4b382fb9e2c6edf59 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:25.203653 24534 raft_consensus.cc:2272] T ea09120684274446b5c0965e6a6a9b4c P 72d4afb41b7245b4b382fb9e2c6edf59 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:25.206072 24534 tablet_replica.cc:333] T a4decfc5493a43e9bb1dca65d85388e7 P 72d4afb41b7245b4b382fb9e2c6edf59: stopping tablet replica
I20260709 12:27:25.206588 24534 raft_consensus.cc:2243] T a4decfc5493a43e9bb1dca65d85388e7 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:25.207378 24534 raft_consensus.cc:2272] T a4decfc5493a43e9bb1dca65d85388e7 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:25.209548 24534 tablet_replica.cc:333] T 100dcbf9addf448bba05f170b5051802 P 72d4afb41b7245b4b382fb9e2c6edf59: stopping tablet replica
I20260709 12:27:25.210038 24534 raft_consensus.cc:2243] T 100dcbf9addf448bba05f170b5051802 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:25.210898 24534 raft_consensus.cc:2272] T 100dcbf9addf448bba05f170b5051802 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:25.213217 24534 tablet_replica.cc:333] T d36e6c0657bd486b939805a704e580af P 72d4afb41b7245b4b382fb9e2c6edf59: stopping tablet replica
I20260709 12:27:25.213717 24534 raft_consensus.cc:2243] T d36e6c0657bd486b939805a704e580af P 72d4afb41b7245b4b382fb9e2c6edf59 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:25.214170 24534 raft_consensus.cc:2272] T d36e6c0657bd486b939805a704e580af P 72d4afb41b7245b4b382fb9e2c6edf59 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:25.216423 24534 tablet_replica.cc:333] T de5c5dbcf4844dab833043ea584da490 P 72d4afb41b7245b4b382fb9e2c6edf59: stopping tablet replica
I20260709 12:27:25.216930 24534 raft_consensus.cc:2243] T de5c5dbcf4844dab833043ea584da490 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:25.217820 24534 raft_consensus.cc:2272] T de5c5dbcf4844dab833043ea584da490 P 72d4afb41b7245b4b382fb9e2c6edf59 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:25.220300 24534 tablet_replica.cc:333] T 4915b590d3df467182d6ec1e3e5b7b9d P 72d4afb41b7245b4b382fb9e2c6edf59: stopping tablet replica
I20260709 12:27:25.220897 24534 raft_consensus.cc:2243] T 4915b590d3df467182d6ec1e3e5b7b9d P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:25.221390 24534 raft_consensus.cc:2272] T 4915b590d3df467182d6ec1e3e5b7b9d P 72d4afb41b7245b4b382fb9e2c6edf59 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:25.223703 24534 tablet_replica.cc:333] T 1523f5077995462b83bfa389d020880b P 72d4afb41b7245b4b382fb9e2c6edf59: stopping tablet replica
I20260709 12:27:25.224236 24534 raft_consensus.cc:2243] T 1523f5077995462b83bfa389d020880b P 72d4afb41b7245b4b382fb9e2c6edf59 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:25.224665 24534 raft_consensus.cc:2272] T 1523f5077995462b83bfa389d020880b P 72d4afb41b7245b4b382fb9e2c6edf59 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:25.227550 24534 tablet_replica.cc:333] T 1797eb20c76642c3912213b96a0156bb P 72d4afb41b7245b4b382fb9e2c6edf59: stopping tablet replica
I20260709 12:27:25.228186 24534 raft_consensus.cc:2243] T 1797eb20c76642c3912213b96a0156bb P 72d4afb41b7245b4b382fb9e2c6edf59 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:25.228669 24534 raft_consensus.cc:2272] T 1797eb20c76642c3912213b96a0156bb P 72d4afb41b7245b4b382fb9e2c6edf59 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:25.230759 24534 tablet_replica.cc:333] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59: stopping tablet replica
I20260709 12:27:25.231235 24534 raft_consensus.cc:2243] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:25.231671 24534 raft_consensus.cc:2272] T 372666c8d7a84b429fe9df7c121e0bcf P 72d4afb41b7245b4b382fb9e2c6edf59 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:25.266544 24534 tablet_server.cc:196] TabletServer@127.23.245.130:0 shutdown complete.
W20260709 12:27:25.293869  2364 consensus_peers.cc:597] T 1797eb20c76642c3912213b96a0156bb P 19566de89ecf48aca9903d8bfdd5d936 -> Peer 129c763b69224d7e9b2187721e58adeb (127.23.245.129:35605): Couldn't send request to peer 129c763b69224d7e9b2187721e58adeb. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:35605: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:25.294512 24534 tablet_server.cc:179] TabletServer@127.23.245.131:0 shutting down...
W20260709 12:27:25.310111  2198 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:27:25.324594 24534 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:25.325408 24534 tablet_replica.cc:333] T 4915b590d3df467182d6ec1e3e5b7b9d P 19566de89ecf48aca9903d8bfdd5d936: stopping tablet replica
I20260709 12:27:25.326107 24534 raft_consensus.cc:2243] T 4915b590d3df467182d6ec1e3e5b7b9d P 19566de89ecf48aca9903d8bfdd5d936 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:25.327013 24534 raft_consensus.cc:2272] T 4915b590d3df467182d6ec1e3e5b7b9d P 19566de89ecf48aca9903d8bfdd5d936 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:25.329205 24534 tablet_replica.cc:333] T 1523f5077995462b83bfa389d020880b P 19566de89ecf48aca9903d8bfdd5d936: stopping tablet replica
I20260709 12:27:25.329775 24534 raft_consensus.cc:2243] T 1523f5077995462b83bfa389d020880b P 19566de89ecf48aca9903d8bfdd5d936 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:27:25.330542 24534 raft_consensus.cc:2272] T 1523f5077995462b83bfa389d020880b P 19566de89ecf48aca9903d8bfdd5d936 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:25.333220 24534 tablet_replica.cc:333] T ea09120684274446b5c0965e6a6a9b4c P 19566de89ecf48aca9903d8bfdd5d936: stopping tablet replica
I20260709 12:27:25.333786 24534 raft_consensus.cc:2243] T ea09120684274446b5c0965e6a6a9b4c P 19566de89ecf48aca9903d8bfdd5d936 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:25.334631 24534 raft_consensus.cc:2272] T ea09120684274446b5c0965e6a6a9b4c P 19566de89ecf48aca9903d8bfdd5d936 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:25.336728 24534 tablet_replica.cc:333] T cb73a7a0e4004a1bbab977eb0c11d8dd P 19566de89ecf48aca9903d8bfdd5d936: stopping tablet replica
I20260709 12:27:25.337284 24534 raft_consensus.cc:2243] T cb73a7a0e4004a1bbab977eb0c11d8dd P 19566de89ecf48aca9903d8bfdd5d936 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:25.337700 24534 raft_consensus.cc:2272] T cb73a7a0e4004a1bbab977eb0c11d8dd P 19566de89ecf48aca9903d8bfdd5d936 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:25.340373 24534 tablet_replica.cc:333] T de5c5dbcf4844dab833043ea584da490 P 19566de89ecf48aca9903d8bfdd5d936: stopping tablet replica
I20260709 12:27:25.341027 24534 raft_consensus.cc:2243] T de5c5dbcf4844dab833043ea584da490 P 19566de89ecf48aca9903d8bfdd5d936 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:25.341547 24534 raft_consensus.cc:2272] T de5c5dbcf4844dab833043ea584da490 P 19566de89ecf48aca9903d8bfdd5d936 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:25.343698 24534 tablet_replica.cc:333] T d36e6c0657bd486b939805a704e580af P 19566de89ecf48aca9903d8bfdd5d936: stopping tablet replica
I20260709 12:27:25.344275 24534 raft_consensus.cc:2243] T d36e6c0657bd486b939805a704e580af P 19566de89ecf48aca9903d8bfdd5d936 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:25.345157 24534 raft_consensus.cc:2272] T d36e6c0657bd486b939805a704e580af P 19566de89ecf48aca9903d8bfdd5d936 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:25.347222 24534 tablet_replica.cc:333] T 372666c8d7a84b429fe9df7c121e0bcf P 19566de89ecf48aca9903d8bfdd5d936: stopping tablet replica
I20260709 12:27:25.347765 24534 raft_consensus.cc:2243] T 372666c8d7a84b429fe9df7c121e0bcf P 19566de89ecf48aca9903d8bfdd5d936 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:27:25.348580 24534 raft_consensus.cc:2272] T 372666c8d7a84b429fe9df7c121e0bcf P 19566de89ecf48aca9903d8bfdd5d936 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:25.351047 24534 tablet_replica.cc:333] T 1797eb20c76642c3912213b96a0156bb P 19566de89ecf48aca9903d8bfdd5d936: stopping tablet replica
I20260709 12:27:25.351562 24534 raft_consensus.cc:2243] T 1797eb20c76642c3912213b96a0156bb P 19566de89ecf48aca9903d8bfdd5d936 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:25.352533 24534 raft_consensus.cc:2272] T 1797eb20c76642c3912213b96a0156bb P 19566de89ecf48aca9903d8bfdd5d936 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:25.354641 24534 tablet_replica.cc:333] T a4decfc5493a43e9bb1dca65d85388e7 P 19566de89ecf48aca9903d8bfdd5d936: stopping tablet replica
I20260709 12:27:25.355168 24534 raft_consensus.cc:2243] T a4decfc5493a43e9bb1dca65d85388e7 P 19566de89ecf48aca9903d8bfdd5d936 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:25.355649 24534 raft_consensus.cc:2272] T a4decfc5493a43e9bb1dca65d85388e7 P 19566de89ecf48aca9903d8bfdd5d936 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:25.357896 24534 tablet_replica.cc:333] T 100dcbf9addf448bba05f170b5051802 P 19566de89ecf48aca9903d8bfdd5d936: stopping tablet replica
I20260709 12:27:25.358371 24534 raft_consensus.cc:2243] T 100dcbf9addf448bba05f170b5051802 P 19566de89ecf48aca9903d8bfdd5d936 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:25.358860 24534 raft_consensus.cc:2272] T 100dcbf9addf448bba05f170b5051802 P 19566de89ecf48aca9903d8bfdd5d936 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:25.393410 24534 tablet_server.cc:196] TabletServer@127.23.245.131:0 shutdown complete.
I20260709 12:27:25.419818 24534 master.cc:562] Master@127.23.245.190:40151 shutting down...
I20260709 12:27:25.442909 24534 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 9002fddf210845ba83d26455cfa528bb [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:25.443475 24534 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 9002fddf210845ba83d26455cfa528bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:25.443823 24534 tablet_replica.cc:333] T 00000000000000000000000000000000 P 9002fddf210845ba83d26455cfa528bb: stopping tablet replica
I20260709 12:27:25.464488 24534 master.cc:584] Master@127.23.245.190:40151 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (13401 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 12:27:25.511830 24534 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.23.245.190:33079
I20260709 12:27:25.513021 24534 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:25.519526  2737 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:25.519594  2738 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:25.520450  2740 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:25.520857 24534 server_base.cc:1061] running on GCE node
I20260709 12:27:25.522058 24534 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:25.522260 24534 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:25.522382 24534 hybrid_clock.cc:648] HybridClock initialized: now 1783600045522367 us; error 0 us; skew 500 ppm
I20260709 12:27:25.523025 24534 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:25.526065 24534 webserver.cc:533] Webserver started at http://127.23.245.190:42421/ using document root <none> and password file <none>
I20260709 12:27:25.526578 24534 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:25.526749 24534 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:25.526997 24534 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:25.528278 24534 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599704270295-24534-0/minicluster-data/master-0-root/instance:
uuid: "dd4c0f3fefd44bb68783d2ac2a47493a"
format_stamp: "Formatted at 2026-07-09 12:27:25 on dist-test-slave-mlt7"
I20260709 12:27:25.532975 24534 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 12:27:25.536460  2745 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:25.537305 24534 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:27:25.537619 24534 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599704270295-24534-0/minicluster-data/master-0-root
uuid: "dd4c0f3fefd44bb68783d2ac2a47493a"
format_stamp: "Formatted at 2026-07-09 12:27:25 on dist-test-slave-mlt7"
I20260709 12:27:25.537935 24534 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599704270295-24534-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599704270295-24534-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599704270295-24534-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:25.564432 24534 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:25.566308 24534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:25.608594 24534 rpc_server.cc:307] RPC server started. Bound to: 127.23.245.190:33079
I20260709 12:27:25.608695  2796 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.245.190:33079 every 8 connection(s)
I20260709 12:27:25.612978  2797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:25.625092  2797 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd4c0f3fefd44bb68783d2ac2a47493a: Bootstrap starting.
I20260709 12:27:25.630107  2797 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dd4c0f3fefd44bb68783d2ac2a47493a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:25.634588  2797 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dd4c0f3fefd44bb68783d2ac2a47493a: No bootstrap required, opened a new log
I20260709 12:27:25.636804  2797 raft_consensus.cc:359] T 00000000000000000000000000000000 P dd4c0f3fefd44bb68783d2ac2a47493a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd4c0f3fefd44bb68783d2ac2a47493a" member_type: VOTER }
I20260709 12:27:25.637207  2797 raft_consensus.cc:385] T 00000000000000000000000000000000 P dd4c0f3fefd44bb68783d2ac2a47493a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:25.637423  2797 raft_consensus.cc:740] T 00000000000000000000000000000000 P dd4c0f3fefd44bb68783d2ac2a47493a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dd4c0f3fefd44bb68783d2ac2a47493a, State: Initialized, Role: FOLLOWER
I20260709 12:27:25.638103  2797 consensus_queue.cc:260] T 00000000000000000000000000000000 P dd4c0f3fefd44bb68783d2ac2a47493a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd4c0f3fefd44bb68783d2ac2a47493a" member_type: VOTER }
I20260709 12:27:25.638572  2797 raft_consensus.cc:399] T 00000000000000000000000000000000 P dd4c0f3fefd44bb68783d2ac2a47493a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:27:25.638782  2797 raft_consensus.cc:493] T 00000000000000000000000000000000 P dd4c0f3fefd44bb68783d2ac2a47493a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:27:25.639086  2797 raft_consensus.cc:3060] T 00000000000000000000000000000000 P dd4c0f3fefd44bb68783d2ac2a47493a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:25.644099  2797 raft_consensus.cc:515] T 00000000000000000000000000000000 P dd4c0f3fefd44bb68783d2ac2a47493a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd4c0f3fefd44bb68783d2ac2a47493a" member_type: VOTER }
I20260709 12:27:25.644622  2797 leader_election.cc:304] T 00000000000000000000000000000000 P dd4c0f3fefd44bb68783d2ac2a47493a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dd4c0f3fefd44bb68783d2ac2a47493a; no voters: 
I20260709 12:27:25.645779  2797 leader_election.cc:290] T 00000000000000000000000000000000 P dd4c0f3fefd44bb68783d2ac2a47493a [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:27:25.646236  2800 raft_consensus.cc:2804] T 00000000000000000000000000000000 P dd4c0f3fefd44bb68783d2ac2a47493a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:25.647610  2800 raft_consensus.cc:697] T 00000000000000000000000000000000 P dd4c0f3fefd44bb68783d2ac2a47493a [term 1 LEADER]: Becoming Leader. State: Replica: dd4c0f3fefd44bb68783d2ac2a47493a, State: Running, Role: LEADER
I20260709 12:27:25.648309  2800 consensus_queue.cc:237] T 00000000000000000000000000000000 P dd4c0f3fefd44bb68783d2ac2a47493a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd4c0f3fefd44bb68783d2ac2a47493a" member_type: VOTER }
I20260709 12:27:25.648634  2797 sys_catalog.cc:565] T 00000000000000000000000000000000 P dd4c0f3fefd44bb68783d2ac2a47493a [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:27:25.653054  2802 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd4c0f3fefd44bb68783d2ac2a47493a [sys.catalog]: SysCatalogTable state changed. Reason: New leader dd4c0f3fefd44bb68783d2ac2a47493a. Latest consensus state: current_term: 1 leader_uuid: "dd4c0f3fefd44bb68783d2ac2a47493a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd4c0f3fefd44bb68783d2ac2a47493a" member_type: VOTER } }
I20260709 12:27:25.652945  2801 sys_catalog.cc:455] T 00000000000000000000000000000000 P dd4c0f3fefd44bb68783d2ac2a47493a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dd4c0f3fefd44bb68783d2ac2a47493a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dd4c0f3fefd44bb68783d2ac2a47493a" member_type: VOTER } }
I20260709 12:27:25.653944  2802 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd4c0f3fefd44bb68783d2ac2a47493a [sys.catalog]: This master's current role is: LEADER
I20260709 12:27:25.653970  2801 sys_catalog.cc:458] T 00000000000000000000000000000000 P dd4c0f3fefd44bb68783d2ac2a47493a [sys.catalog]: This master's current role is: LEADER
I20260709 12:27:25.656683  2807 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:27:25.664981  2807 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:27:25.665964 24534 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:27:25.674043  2807 catalog_manager.cc:1383] Generated new cluster ID: 2f95d5d84e8b41c8bf65d4e0ad4b800b
I20260709 12:27:25.674412  2807 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:27:25.690215  2807 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:27:25.691529  2807 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:27:25.718967  2807 catalog_manager.cc:6070] T 00000000000000000000000000000000 P dd4c0f3fefd44bb68783d2ac2a47493a: Generated new TSK 0
I20260709 12:27:25.719869  2807 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:27:25.733283 24534 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:25.739732  2818 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:25.741181  2819 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:25.742911  2821 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:25.743781 24534 server_base.cc:1061] running on GCE node
I20260709 12:27:25.744891 24534 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:25.745114 24534 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:25.745338 24534 hybrid_clock.cc:648] HybridClock initialized: now 1783600045745289 us; error 0 us; skew 500 ppm
I20260709 12:27:25.746006 24534 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:25.748656 24534 webserver.cc:533] Webserver started at http://127.23.245.129:43341/ using document root <none> and password file <none>
I20260709 12:27:25.749203 24534 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:25.749411 24534 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:25.749732 24534 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:25.751012 24534 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599704270295-24534-0/minicluster-data/ts-0-root/instance:
uuid: "76255f1b0e964ed586eea61a3c98f5a4"
format_stamp: "Formatted at 2026-07-09 12:27:25 on dist-test-slave-mlt7"
I20260709 12:27:25.756007 24534 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 12:27:25.759544  2826 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:25.760468 24534 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:27:25.760814 24534 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599704270295-24534-0/minicluster-data/ts-0-root
uuid: "76255f1b0e964ed586eea61a3c98f5a4"
format_stamp: "Formatted at 2026-07-09 12:27:25 on dist-test-slave-mlt7"
I20260709 12:27:25.761143 24534 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599704270295-24534-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599704270295-24534-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599704270295-24534-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:25.774694 24534 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:25.776139 24534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:25.777737 24534 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:25.780346 24534 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:25.780700 24534 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:25.781052 24534 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:25.781280 24534 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:25.826956 24534 rpc_server.cc:307] RPC server started. Bound to: 127.23.245.129:36903
I20260709 12:27:25.827088  2888 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.245.129:36903 every 8 connection(s)
I20260709 12:27:25.832554 24534 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:25.840826  2893 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:25.841014  2894 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:25.844911  2896 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:25.844956 24534 server_base.cc:1061] running on GCE node
I20260709 12:27:25.845770  2889 heartbeater.cc:344] Connected to a master server at 127.23.245.190:33079
I20260709 12:27:25.846194  2889 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:25.846920 24534 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:27:25.846971  2889 heartbeater.cc:507] Master 127.23.245.190:33079 requested a full tablet report, sending...
W20260709 12:27:25.847293 24534 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:25.847600 24534 hybrid_clock.cc:648] HybridClock initialized: now 1783600045847571 us; error 0 us; skew 500 ppm
I20260709 12:27:25.848340 24534 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:25.849561  2762 ts_manager.cc:194] Registered new tserver with Master: 76255f1b0e964ed586eea61a3c98f5a4 (127.23.245.129:36903)
I20260709 12:27:25.851485 24534 webserver.cc:533] Webserver started at http://127.23.245.130:43201/ using document root <none> and password file <none>
I20260709 12:27:25.851729  2762 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52726
I20260709 12:27:25.852211 24534 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:25.852526 24534 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:25.852839 24534 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:25.854230 24534 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599704270295-24534-0/minicluster-data/ts-1-root/instance:
uuid: "e23f23f14d0443dbb402a267fafb37e9"
format_stamp: "Formatted at 2026-07-09 12:27:25 on dist-test-slave-mlt7"
I20260709 12:27:25.858944 24534 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 12:27:25.862951  2901 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:25.863888 24534 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:27:25.864293 24534 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599704270295-24534-0/minicluster-data/ts-1-root
uuid: "e23f23f14d0443dbb402a267fafb37e9"
format_stamp: "Formatted at 2026-07-09 12:27:25 on dist-test-slave-mlt7"
I20260709 12:27:25.864651 24534 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599704270295-24534-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599704270295-24534-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599704270295-24534-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:25.875900 24534 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:25.877233 24534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:25.878808 24534 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:25.881246 24534 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:25.881505 24534 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:25.881780 24534 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:25.881982 24534 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:25.925482 24534 rpc_server.cc:307] RPC server started. Bound to: 127.23.245.130:46085
I20260709 12:27:25.925587  2963 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.245.130:46085 every 8 connection(s)
I20260709 12:27:25.930866 24534 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:25.938450  2967 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:25.940286  2968 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:25.944135 24534 server_base.cc:1061] running on GCE node
W20260709 12:27:25.944164  2970 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:25.944727  2964 heartbeater.cc:344] Connected to a master server at 127.23.245.190:33079
I20260709 12:27:25.945298  2964 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:25.945595 24534 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:25.945921 24534 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:25.946157 24534 hybrid_clock.cc:648] HybridClock initialized: now 1783600045946135 us; error 0 us; skew 500 ppm
I20260709 12:27:25.946287  2964 heartbeater.cc:507] Master 127.23.245.190:33079 requested a full tablet report, sending...
I20260709 12:27:25.947041 24534 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:25.948936  2762 ts_manager.cc:194] Registered new tserver with Master: e23f23f14d0443dbb402a267fafb37e9 (127.23.245.130:46085)
I20260709 12:27:25.950095 24534 webserver.cc:533] Webserver started at http://127.23.245.131:41553/ using document root <none> and password file <none>
I20260709 12:27:25.950793 24534 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:25.950874  2762 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52732
I20260709 12:27:25.951068 24534 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:25.951435 24534 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:25.953028 24534 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599704270295-24534-0/minicluster-data/ts-2-root/instance:
uuid: "62a66f0b223a4d798efd4388568410ee"
format_stamp: "Formatted at 2026-07-09 12:27:25 on dist-test-slave-mlt7"
I20260709 12:27:25.957616 24534 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:27:25.961159  2975 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:25.962021 24534 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:27:25.962352 24534 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599704270295-24534-0/minicluster-data/ts-2-root
uuid: "62a66f0b223a4d798efd4388568410ee"
format_stamp: "Formatted at 2026-07-09 12:27:25 on dist-test-slave-mlt7"
I20260709 12:27:25.962733 24534 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599704270295-24534-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599704270295-24534-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599704270295-24534-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:25.977290 24534 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:25.978529 24534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:25.980057 24534 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:25.982206 24534 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:25.982437 24534 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:25.982698 24534 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:25.982875 24534 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:26.024430 24534 rpc_server.cc:307] RPC server started. Bound to: 127.23.245.131:44537
I20260709 12:27:26.024544  3037 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.245.131:44537 every 8 connection(s)
I20260709 12:27:26.039012  3038 heartbeater.cc:344] Connected to a master server at 127.23.245.190:33079
I20260709 12:27:26.039525  3038 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:26.040330  3038 heartbeater.cc:507] Master 127.23.245.190:33079 requested a full tablet report, sending...
I20260709 12:27:26.042296  2762 ts_manager.cc:194] Registered new tserver with Master: 62a66f0b223a4d798efd4388568410ee (127.23.245.131:44537)
I20260709 12:27:26.042811 24534 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014915815s
I20260709 12:27:26.043699  2762 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52738
I20260709 12:27:26.069963  2762 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52752:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:27:26.072439  2762 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:27:26.122485  2854 tablet_service.cc:1511] Processing CreateTablet for tablet 65453404455447639f31ecf47b696614 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=b6b9fbfe9950447797f8dd92ca7cb3b8]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:27:26.122709  2853 tablet_service.cc:1511] Processing CreateTablet for tablet 6b938decaa3e4f66b8d383cce8e8424b (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=b6b9fbfe9950447797f8dd92ca7cb3b8]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:27:26.124568  2854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65453404455447639f31ecf47b696614. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:26.125365  2853 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b938decaa3e4f66b8d383cce8e8424b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:26.132303  3003 tablet_service.cc:1511] Processing CreateTablet for tablet 65453404455447639f31ecf47b696614 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=b6b9fbfe9950447797f8dd92ca7cb3b8]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:27:26.134043  3003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65453404455447639f31ecf47b696614. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:26.138733  2929 tablet_service.cc:1511] Processing CreateTablet for tablet 65453404455447639f31ecf47b696614 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=b6b9fbfe9950447797f8dd92ca7cb3b8]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:27:26.140316  2929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65453404455447639f31ecf47b696614. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:26.141279  3002 tablet_service.cc:1511] Processing CreateTablet for tablet 6b938decaa3e4f66b8d383cce8e8424b (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=b6b9fbfe9950447797f8dd92ca7cb3b8]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:27:26.141721  2928 tablet_service.cc:1511] Processing CreateTablet for tablet 6b938decaa3e4f66b8d383cce8e8424b (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=b6b9fbfe9950447797f8dd92ca7cb3b8]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:27:26.142808  3002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b938decaa3e4f66b8d383cce8e8424b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:26.143047  2928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b938decaa3e4f66b8d383cce8e8424b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:26.161125  3053 tablet_bootstrap.cc:492] T 6b938decaa3e4f66b8d383cce8e8424b P 76255f1b0e964ed586eea61a3c98f5a4: Bootstrap starting.
I20260709 12:27:26.173118  3054 tablet_bootstrap.cc:492] T 65453404455447639f31ecf47b696614 P e23f23f14d0443dbb402a267fafb37e9: Bootstrap starting.
I20260709 12:27:26.178284  3053 tablet_bootstrap.cc:654] T 6b938decaa3e4f66b8d383cce8e8424b P 76255f1b0e964ed586eea61a3c98f5a4: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:26.180061  3055 tablet_bootstrap.cc:492] T 6b938decaa3e4f66b8d383cce8e8424b P 62a66f0b223a4d798efd4388568410ee: Bootstrap starting.
I20260709 12:27:26.180382  3054 tablet_bootstrap.cc:654] T 65453404455447639f31ecf47b696614 P e23f23f14d0443dbb402a267fafb37e9: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:26.183504  3053 tablet_bootstrap.cc:492] T 6b938decaa3e4f66b8d383cce8e8424b P 76255f1b0e964ed586eea61a3c98f5a4: No bootstrap required, opened a new log
I20260709 12:27:26.184120  3053 ts_tablet_manager.cc:1403] T 6b938decaa3e4f66b8d383cce8e8424b P 76255f1b0e964ed586eea61a3c98f5a4: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.004s
I20260709 12:27:26.185917  3054 tablet_bootstrap.cc:492] T 65453404455447639f31ecf47b696614 P e23f23f14d0443dbb402a267fafb37e9: No bootstrap required, opened a new log
I20260709 12:27:26.186441  3054 ts_tablet_manager.cc:1403] T 65453404455447639f31ecf47b696614 P e23f23f14d0443dbb402a267fafb37e9: Time spent bootstrapping tablet: real 0.014s	user 0.005s	sys 0.005s
I20260709 12:27:26.186822  3055 tablet_bootstrap.cc:654] T 6b938decaa3e4f66b8d383cce8e8424b P 62a66f0b223a4d798efd4388568410ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:26.187198  3053 raft_consensus.cc:359] T 6b938decaa3e4f66b8d383cce8e8424b P 76255f1b0e964ed586eea61a3c98f5a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } }
I20260709 12:27:26.188009  3053 raft_consensus.cc:385] T 6b938decaa3e4f66b8d383cce8e8424b P 76255f1b0e964ed586eea61a3c98f5a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:26.188308  3053 raft_consensus.cc:740] T 6b938decaa3e4f66b8d383cce8e8424b P 76255f1b0e964ed586eea61a3c98f5a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76255f1b0e964ed586eea61a3c98f5a4, State: Initialized, Role: FOLLOWER
I20260709 12:27:26.189083  3053 consensus_queue.cc:260] T 6b938decaa3e4f66b8d383cce8e8424b P 76255f1b0e964ed586eea61a3c98f5a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } }
I20260709 12:27:26.189289  3054 raft_consensus.cc:359] T 65453404455447639f31ecf47b696614 P e23f23f14d0443dbb402a267fafb37e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } }
I20260709 12:27:26.190022  3054 raft_consensus.cc:385] T 65453404455447639f31ecf47b696614 P e23f23f14d0443dbb402a267fafb37e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:26.190394  3054 raft_consensus.cc:740] T 65453404455447639f31ecf47b696614 P e23f23f14d0443dbb402a267fafb37e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e23f23f14d0443dbb402a267fafb37e9, State: Initialized, Role: FOLLOWER
I20260709 12:27:26.191431  3054 consensus_queue.cc:260] T 65453404455447639f31ecf47b696614 P e23f23f14d0443dbb402a267fafb37e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } }
I20260709 12:27:26.192584  3055 tablet_bootstrap.cc:492] T 6b938decaa3e4f66b8d383cce8e8424b P 62a66f0b223a4d798efd4388568410ee: No bootstrap required, opened a new log
I20260709 12:27:26.193077  3055 ts_tablet_manager.cc:1403] T 6b938decaa3e4f66b8d383cce8e8424b P 62a66f0b223a4d798efd4388568410ee: Time spent bootstrapping tablet: real 0.013s	user 0.004s	sys 0.007s
I20260709 12:27:26.195724  3055 raft_consensus.cc:359] T 6b938decaa3e4f66b8d383cce8e8424b P 62a66f0b223a4d798efd4388568410ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } }
I20260709 12:27:26.196380  3055 raft_consensus.cc:385] T 6b938decaa3e4f66b8d383cce8e8424b P 62a66f0b223a4d798efd4388568410ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:26.196712  3055 raft_consensus.cc:740] T 6b938decaa3e4f66b8d383cce8e8424b P 62a66f0b223a4d798efd4388568410ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62a66f0b223a4d798efd4388568410ee, State: Initialized, Role: FOLLOWER
I20260709 12:27:26.197157  2889 heartbeater.cc:499] Master 127.23.245.190:33079 was elected leader, sending a full tablet report...
I20260709 12:27:26.197631  3055 consensus_queue.cc:260] T 6b938decaa3e4f66b8d383cce8e8424b P 62a66f0b223a4d798efd4388568410ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } }
I20260709 12:27:26.198027  3053 ts_tablet_manager.cc:1434] T 6b938decaa3e4f66b8d383cce8e8424b P 76255f1b0e964ed586eea61a3c98f5a4: Time spent starting tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 12:27:26.199797  2964 heartbeater.cc:499] Master 127.23.245.190:33079 was elected leader, sending a full tablet report...
I20260709 12:27:26.199954  3053 tablet_bootstrap.cc:492] T 65453404455447639f31ecf47b696614 P 76255f1b0e964ed586eea61a3c98f5a4: Bootstrap starting.
I20260709 12:27:26.200325  3054 ts_tablet_manager.cc:1434] T 65453404455447639f31ecf47b696614 P e23f23f14d0443dbb402a267fafb37e9: Time spent starting tablet: real 0.014s	user 0.016s	sys 0.000s
I20260709 12:27:26.201293  3054 tablet_bootstrap.cc:492] T 6b938decaa3e4f66b8d383cce8e8424b P e23f23f14d0443dbb402a267fafb37e9: Bootstrap starting.
I20260709 12:27:26.207489  3053 tablet_bootstrap.cc:654] T 65453404455447639f31ecf47b696614 P 76255f1b0e964ed586eea61a3c98f5a4: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:26.210040  3054 tablet_bootstrap.cc:654] T 6b938decaa3e4f66b8d383cce8e8424b P e23f23f14d0443dbb402a267fafb37e9: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:26.220232  3060 raft_consensus.cc:493] T 65453404455447639f31ecf47b696614 P e23f23f14d0443dbb402a267fafb37e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.221027  3060 raft_consensus.cc:515] T 65453404455447639f31ecf47b696614 P e23f23f14d0443dbb402a267fafb37e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } }
I20260709 12:27:26.224375  3054 tablet_bootstrap.cc:492] T 6b938decaa3e4f66b8d383cce8e8424b P e23f23f14d0443dbb402a267fafb37e9: No bootstrap required, opened a new log
I20260709 12:27:26.225096  3054 ts_tablet_manager.cc:1403] T 6b938decaa3e4f66b8d383cce8e8424b P e23f23f14d0443dbb402a267fafb37e9: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.005s
I20260709 12:27:26.229416  3054 raft_consensus.cc:359] T 6b938decaa3e4f66b8d383cce8e8424b P e23f23f14d0443dbb402a267fafb37e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } }
I20260709 12:27:26.230357  3054 raft_consensus.cc:385] T 6b938decaa3e4f66b8d383cce8e8424b P e23f23f14d0443dbb402a267fafb37e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:26.230723  3054 raft_consensus.cc:740] T 6b938decaa3e4f66b8d383cce8e8424b P e23f23f14d0443dbb402a267fafb37e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e23f23f14d0443dbb402a267fafb37e9, State: Initialized, Role: FOLLOWER
I20260709 12:27:26.231940  3054 consensus_queue.cc:260] T 6b938decaa3e4f66b8d383cce8e8424b P e23f23f14d0443dbb402a267fafb37e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } }
I20260709 12:27:26.242370  3054 ts_tablet_manager.cc:1434] T 6b938decaa3e4f66b8d383cce8e8424b P e23f23f14d0443dbb402a267fafb37e9: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.007s
I20260709 12:27:26.245767  3060 leader_election.cc:290] T 65453404455447639f31ecf47b696614 P e23f23f14d0443dbb402a267fafb37e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76255f1b0e964ed586eea61a3c98f5a4 (127.23.245.129:36903), 62a66f0b223a4d798efd4388568410ee (127.23.245.131:44537)
I20260709 12:27:26.250164  3038 heartbeater.cc:499] Master 127.23.245.190:33079 was elected leader, sending a full tablet report...
I20260709 12:27:26.254586  3055 ts_tablet_manager.cc:1434] T 6b938decaa3e4f66b8d383cce8e8424b P 62a66f0b223a4d798efd4388568410ee: Time spent starting tablet: real 0.061s	user 0.016s	sys 0.034s
I20260709 12:27:26.255707  3055 tablet_bootstrap.cc:492] T 65453404455447639f31ecf47b696614 P 62a66f0b223a4d798efd4388568410ee: Bootstrap starting.
I20260709 12:27:26.258064  3060 raft_consensus.cc:493] T 6b938decaa3e4f66b8d383cce8e8424b P e23f23f14d0443dbb402a267fafb37e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.258464  3053 tablet_bootstrap.cc:492] T 65453404455447639f31ecf47b696614 P 76255f1b0e964ed586eea61a3c98f5a4: No bootstrap required, opened a new log
I20260709 12:27:26.259058  3053 ts_tablet_manager.cc:1403] T 65453404455447639f31ecf47b696614 P 76255f1b0e964ed586eea61a3c98f5a4: Time spent bootstrapping tablet: real 0.059s	user 0.026s	sys 0.027s
I20260709 12:27:26.258675  3060 raft_consensus.cc:515] T 6b938decaa3e4f66b8d383cce8e8424b P e23f23f14d0443dbb402a267fafb37e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } }
I20260709 12:27:26.261257  3060 leader_election.cc:290] T 6b938decaa3e4f66b8d383cce8e8424b P e23f23f14d0443dbb402a267fafb37e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76255f1b0e964ed586eea61a3c98f5a4 (127.23.245.129:36903), 62a66f0b223a4d798efd4388568410ee (127.23.245.131:44537)
I20260709 12:27:26.262166  3013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65453404455447639f31ecf47b696614" candidate_uuid: "e23f23f14d0443dbb402a267fafb37e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62a66f0b223a4d798efd4388568410ee" is_pre_election: true
I20260709 12:27:26.263248  3012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b938decaa3e4f66b8d383cce8e8424b" candidate_uuid: "e23f23f14d0443dbb402a267fafb37e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62a66f0b223a4d798efd4388568410ee" is_pre_election: true
I20260709 12:27:26.263983  3012 raft_consensus.cc:2468] T 6b938decaa3e4f66b8d383cce8e8424b P 62a66f0b223a4d798efd4388568410ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e23f23f14d0443dbb402a267fafb37e9 in term 0.
W20260709 12:27:26.264104  2903 leader_election.cc:343] T 65453404455447639f31ecf47b696614 P e23f23f14d0443dbb402a267fafb37e9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 62a66f0b223a4d798efd4388568410ee (127.23.245.131:44537): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:26.262208  3053 raft_consensus.cc:359] T 65453404455447639f31ecf47b696614 P 76255f1b0e964ed586eea61a3c98f5a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } }
I20260709 12:27:26.265262  2903 leader_election.cc:304] T 6b938decaa3e4f66b8d383cce8e8424b P e23f23f14d0443dbb402a267fafb37e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62a66f0b223a4d798efd4388568410ee, e23f23f14d0443dbb402a267fafb37e9; no voters: 
I20260709 12:27:26.266199  3055 tablet_bootstrap.cc:654] T 65453404455447639f31ecf47b696614 P 62a66f0b223a4d798efd4388568410ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:26.266237  3060 raft_consensus.cc:2804] T 6b938decaa3e4f66b8d383cce8e8424b P e23f23f14d0443dbb402a267fafb37e9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:26.265262  3053 raft_consensus.cc:385] T 65453404455447639f31ecf47b696614 P 76255f1b0e964ed586eea61a3c98f5a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:26.266848  3060 raft_consensus.cc:493] T 6b938decaa3e4f66b8d383cce8e8424b P e23f23f14d0443dbb402a267fafb37e9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:26.267385  3053 raft_consensus.cc:740] T 65453404455447639f31ecf47b696614 P 76255f1b0e964ed586eea61a3c98f5a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76255f1b0e964ed586eea61a3c98f5a4, State: Initialized, Role: FOLLOWER
I20260709 12:27:26.267517  3060 raft_consensus.cc:3060] T 6b938decaa3e4f66b8d383cce8e8424b P e23f23f14d0443dbb402a267fafb37e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:26.268363  3053 consensus_queue.cc:260] T 65453404455447639f31ecf47b696614 P 76255f1b0e964ed586eea61a3c98f5a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } }
I20260709 12:27:26.270360  2864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65453404455447639f31ecf47b696614" candidate_uuid: "e23f23f14d0443dbb402a267fafb37e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76255f1b0e964ed586eea61a3c98f5a4" is_pre_election: true
I20260709 12:27:26.270907  3053 ts_tablet_manager.cc:1434] T 65453404455447639f31ecf47b696614 P 76255f1b0e964ed586eea61a3c98f5a4: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:27:26.271111  2864 raft_consensus.cc:2468] T 65453404455447639f31ecf47b696614 P 76255f1b0e964ed586eea61a3c98f5a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e23f23f14d0443dbb402a267fafb37e9 in term 0.
I20260709 12:27:26.272535  2863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b938decaa3e4f66b8d383cce8e8424b" candidate_uuid: "e23f23f14d0443dbb402a267fafb37e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76255f1b0e964ed586eea61a3c98f5a4" is_pre_election: true
I20260709 12:27:26.272720  2905 leader_election.cc:304] T 65453404455447639f31ecf47b696614 P e23f23f14d0443dbb402a267fafb37e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 76255f1b0e964ed586eea61a3c98f5a4, e23f23f14d0443dbb402a267fafb37e9; no voters: 62a66f0b223a4d798efd4388568410ee
I20260709 12:27:26.273430  2863 raft_consensus.cc:2468] T 6b938decaa3e4f66b8d383cce8e8424b P 76255f1b0e964ed586eea61a3c98f5a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e23f23f14d0443dbb402a267fafb37e9 in term 0.
I20260709 12:27:26.273985  3064 raft_consensus.cc:2804] T 65453404455447639f31ecf47b696614 P e23f23f14d0443dbb402a267fafb37e9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:26.274420  3064 raft_consensus.cc:493] T 65453404455447639f31ecf47b696614 P e23f23f14d0443dbb402a267fafb37e9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:26.274757  3064 raft_consensus.cc:3060] T 65453404455447639f31ecf47b696614 P e23f23f14d0443dbb402a267fafb37e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:26.275869  3060 raft_consensus.cc:515] T 6b938decaa3e4f66b8d383cce8e8424b P e23f23f14d0443dbb402a267fafb37e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } }
I20260709 12:27:26.278573  3060 leader_election.cc:290] T 6b938decaa3e4f66b8d383cce8e8424b P e23f23f14d0443dbb402a267fafb37e9 [CANDIDATE]: Term 1 election: Requested vote from peers 76255f1b0e964ed586eea61a3c98f5a4 (127.23.245.129:36903), 62a66f0b223a4d798efd4388568410ee (127.23.245.131:44537)
I20260709 12:27:26.281068  3012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b938decaa3e4f66b8d383cce8e8424b" candidate_uuid: "e23f23f14d0443dbb402a267fafb37e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62a66f0b223a4d798efd4388568410ee"
I20260709 12:27:26.281715  3012 raft_consensus.cc:3060] T 6b938decaa3e4f66b8d383cce8e8424b P 62a66f0b223a4d798efd4388568410ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:26.283806  3055 tablet_bootstrap.cc:492] T 65453404455447639f31ecf47b696614 P 62a66f0b223a4d798efd4388568410ee: No bootstrap required, opened a new log
I20260709 12:27:26.284513  3055 ts_tablet_manager.cc:1403] T 65453404455447639f31ecf47b696614 P 62a66f0b223a4d798efd4388568410ee: Time spent bootstrapping tablet: real 0.029s	user 0.006s	sys 0.017s
I20260709 12:27:26.285989  3064 raft_consensus.cc:515] T 65453404455447639f31ecf47b696614 P e23f23f14d0443dbb402a267fafb37e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } }
I20260709 12:27:26.286656  2863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b938decaa3e4f66b8d383cce8e8424b" candidate_uuid: "e23f23f14d0443dbb402a267fafb37e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76255f1b0e964ed586eea61a3c98f5a4"
I20260709 12:27:26.287379  2863 raft_consensus.cc:3060] T 6b938decaa3e4f66b8d383cce8e8424b P 76255f1b0e964ed586eea61a3c98f5a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:26.288774  3055 raft_consensus.cc:359] T 65453404455447639f31ecf47b696614 P 62a66f0b223a4d798efd4388568410ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } }
I20260709 12:27:26.289746  3055 raft_consensus.cc:385] T 65453404455447639f31ecf47b696614 P 62a66f0b223a4d798efd4388568410ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:26.289834  3012 raft_consensus.cc:2468] T 6b938decaa3e4f66b8d383cce8e8424b P 62a66f0b223a4d798efd4388568410ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e23f23f14d0443dbb402a267fafb37e9 in term 1.
I20260709 12:27:26.289882  3013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65453404455447639f31ecf47b696614" candidate_uuid: "e23f23f14d0443dbb402a267fafb37e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62a66f0b223a4d798efd4388568410ee"
I20260709 12:27:26.290215  3055 raft_consensus.cc:740] T 65453404455447639f31ecf47b696614 P 62a66f0b223a4d798efd4388568410ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62a66f0b223a4d798efd4388568410ee, State: Initialized, Role: FOLLOWER
I20260709 12:27:26.290721  3064 leader_election.cc:290] T 65453404455447639f31ecf47b696614 P e23f23f14d0443dbb402a267fafb37e9 [CANDIDATE]: Term 1 election: Requested vote from peers 76255f1b0e964ed586eea61a3c98f5a4 (127.23.245.129:36903), 62a66f0b223a4d798efd4388568410ee (127.23.245.131:44537)
I20260709 12:27:26.291172  2903 leader_election.cc:304] T 6b938decaa3e4f66b8d383cce8e8424b P e23f23f14d0443dbb402a267fafb37e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62a66f0b223a4d798efd4388568410ee, e23f23f14d0443dbb402a267fafb37e9; no voters: 
I20260709 12:27:26.292109  3064 raft_consensus.cc:2804] T 6b938decaa3e4f66b8d383cce8e8424b P e23f23f14d0443dbb402a267fafb37e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:26.291589  3055 consensus_queue.cc:260] T 65453404455447639f31ecf47b696614 P 62a66f0b223a4d798efd4388568410ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } }
I20260709 12:27:26.292634  3064 raft_consensus.cc:697] T 6b938decaa3e4f66b8d383cce8e8424b P e23f23f14d0443dbb402a267fafb37e9 [term 1 LEADER]: Becoming Leader. State: Replica: e23f23f14d0443dbb402a267fafb37e9, State: Running, Role: LEADER
I20260709 12:27:26.292915  2864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65453404455447639f31ecf47b696614" candidate_uuid: "e23f23f14d0443dbb402a267fafb37e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76255f1b0e964ed586eea61a3c98f5a4"
I20260709 12:27:26.293497  2864 raft_consensus.cc:3060] T 65453404455447639f31ecf47b696614 P 76255f1b0e964ed586eea61a3c98f5a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:26.293582  3064 consensus_queue.cc:237] T 6b938decaa3e4f66b8d383cce8e8424b P e23f23f14d0443dbb402a267fafb37e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } }
I20260709 12:27:26.294936  3055 ts_tablet_manager.cc:1434] T 65453404455447639f31ecf47b696614 P 62a66f0b223a4d798efd4388568410ee: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:27:26.296262  2863 raft_consensus.cc:2468] T 6b938decaa3e4f66b8d383cce8e8424b P 76255f1b0e964ed586eea61a3c98f5a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e23f23f14d0443dbb402a267fafb37e9 in term 1.
I20260709 12:27:26.297286  3013 raft_consensus.cc:3060] T 65453404455447639f31ecf47b696614 P 62a66f0b223a4d798efd4388568410ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:26.302793  2864 raft_consensus.cc:2468] T 65453404455447639f31ecf47b696614 P 76255f1b0e964ed586eea61a3c98f5a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e23f23f14d0443dbb402a267fafb37e9 in term 1.
I20260709 12:27:26.304121  2905 leader_election.cc:304] T 65453404455447639f31ecf47b696614 P e23f23f14d0443dbb402a267fafb37e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76255f1b0e964ed586eea61a3c98f5a4, e23f23f14d0443dbb402a267fafb37e9; no voters: 
I20260709 12:27:26.305629  3060 raft_consensus.cc:2804] T 65453404455447639f31ecf47b696614 P e23f23f14d0443dbb402a267fafb37e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:26.306147  3013 raft_consensus.cc:2468] T 65453404455447639f31ecf47b696614 P 62a66f0b223a4d798efd4388568410ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e23f23f14d0443dbb402a267fafb37e9 in term 1.
I20260709 12:27:26.307317  3060 raft_consensus.cc:697] T 65453404455447639f31ecf47b696614 P e23f23f14d0443dbb402a267fafb37e9 [term 1 LEADER]: Becoming Leader. State: Replica: e23f23f14d0443dbb402a267fafb37e9, State: Running, Role: LEADER
I20260709 12:27:26.308511  3060 consensus_queue.cc:237] T 65453404455447639f31ecf47b696614 P e23f23f14d0443dbb402a267fafb37e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } }
I20260709 12:27:26.312800  2762 catalog_manager.cc:5697] T 6b938decaa3e4f66b8d383cce8e8424b P e23f23f14d0443dbb402a267fafb37e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to e23f23f14d0443dbb402a267fafb37e9 (127.23.245.130). New cstate: current_term: 1 leader_uuid: "e23f23f14d0443dbb402a267fafb37e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:26.324627  2762 catalog_manager.cc:5697] T 65453404455447639f31ecf47b696614 P e23f23f14d0443dbb402a267fafb37e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to e23f23f14d0443dbb402a267fafb37e9 (127.23.245.130). New cstate: current_term: 1 leader_uuid: "e23f23f14d0443dbb402a267fafb37e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:26.398165  2762 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52760:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:27:26.400121  2762 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:27:26.423166  2854 tablet_service.cc:1511] Processing CreateTablet for tablet 5dc00eddee2242c4bbc79dd80a12eaa1 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=88d5adcc733a43d2adc3fa8ce17b9be5]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:27:26.424520  2854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dc00eddee2242c4bbc79dd80a12eaa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:26.424468  2929 tablet_service.cc:1511] Processing CreateTablet for tablet 5dc00eddee2242c4bbc79dd80a12eaa1 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=88d5adcc733a43d2adc3fa8ce17b9be5]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:27:26.425981  2929 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dc00eddee2242c4bbc79dd80a12eaa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:26.425904  3002 tablet_service.cc:1511] Processing CreateTablet for tablet 5dc00eddee2242c4bbc79dd80a12eaa1 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=88d5adcc733a43d2adc3fa8ce17b9be5]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:27:26.427233  3002 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5dc00eddee2242c4bbc79dd80a12eaa1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:26.428889  2853 tablet_service.cc:1511] Processing CreateTablet for tablet 048820ced921458e8c9487fb036a75ce (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=88d5adcc733a43d2adc3fa8ce17b9be5]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:27:26.430096  2853 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 048820ced921458e8c9487fb036a75ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:26.432937  3003 tablet_service.cc:1511] Processing CreateTablet for tablet 048820ced921458e8c9487fb036a75ce (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=88d5adcc733a43d2adc3fa8ce17b9be5]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:27:26.434248  3003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 048820ced921458e8c9487fb036a75ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:26.435295  2928 tablet_service.cc:1511] Processing CreateTablet for tablet 048820ced921458e8c9487fb036a75ce (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=88d5adcc733a43d2adc3fa8ce17b9be5]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:27:26.436559  2928 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 048820ced921458e8c9487fb036a75ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:26.444684  3053 tablet_bootstrap.cc:492] T 5dc00eddee2242c4bbc79dd80a12eaa1 P 76255f1b0e964ed586eea61a3c98f5a4: Bootstrap starting.
I20260709 12:27:26.450129  3055 tablet_bootstrap.cc:492] T 048820ced921458e8c9487fb036a75ce P 62a66f0b223a4d798efd4388568410ee: Bootstrap starting.
I20260709 12:27:26.450991  3053 tablet_bootstrap.cc:654] T 5dc00eddee2242c4bbc79dd80a12eaa1 P 76255f1b0e964ed586eea61a3c98f5a4: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:26.454728  3054 tablet_bootstrap.cc:492] T 048820ced921458e8c9487fb036a75ce P e23f23f14d0443dbb402a267fafb37e9: Bootstrap starting.
I20260709 12:27:26.458902  3055 tablet_bootstrap.cc:654] T 048820ced921458e8c9487fb036a75ce P 62a66f0b223a4d798efd4388568410ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:26.462232  3054 tablet_bootstrap.cc:654] T 048820ced921458e8c9487fb036a75ce P e23f23f14d0443dbb402a267fafb37e9: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:26.472224  3055 tablet_bootstrap.cc:492] T 048820ced921458e8c9487fb036a75ce P 62a66f0b223a4d798efd4388568410ee: No bootstrap required, opened a new log
I20260709 12:27:26.472651  3053 tablet_bootstrap.cc:492] T 5dc00eddee2242c4bbc79dd80a12eaa1 P 76255f1b0e964ed586eea61a3c98f5a4: No bootstrap required, opened a new log
I20260709 12:27:26.472720  3055 ts_tablet_manager.cc:1403] T 048820ced921458e8c9487fb036a75ce P 62a66f0b223a4d798efd4388568410ee: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.006s
I20260709 12:27:26.473366  3053 ts_tablet_manager.cc:1403] T 5dc00eddee2242c4bbc79dd80a12eaa1 P 76255f1b0e964ed586eea61a3c98f5a4: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.001s
I20260709 12:27:26.472463  3054 tablet_bootstrap.cc:492] T 048820ced921458e8c9487fb036a75ce P e23f23f14d0443dbb402a267fafb37e9: No bootstrap required, opened a new log
I20260709 12:27:26.474738  3054 ts_tablet_manager.cc:1403] T 048820ced921458e8c9487fb036a75ce P e23f23f14d0443dbb402a267fafb37e9: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.008s
I20260709 12:27:26.476080  3055 raft_consensus.cc:359] T 048820ced921458e8c9487fb036a75ce P 62a66f0b223a4d798efd4388568410ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } }
I20260709 12:27:26.476289  3053 raft_consensus.cc:359] T 5dc00eddee2242c4bbc79dd80a12eaa1 P 76255f1b0e964ed586eea61a3c98f5a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } }
I20260709 12:27:26.476933  3055 raft_consensus.cc:385] T 048820ced921458e8c9487fb036a75ce P 62a66f0b223a4d798efd4388568410ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:26.477032  3053 raft_consensus.cc:385] T 5dc00eddee2242c4bbc79dd80a12eaa1 P 76255f1b0e964ed586eea61a3c98f5a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:26.477366  3055 raft_consensus.cc:740] T 048820ced921458e8c9487fb036a75ce P 62a66f0b223a4d798efd4388568410ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62a66f0b223a4d798efd4388568410ee, State: Initialized, Role: FOLLOWER
I20260709 12:27:26.477437  3053 raft_consensus.cc:740] T 5dc00eddee2242c4bbc79dd80a12eaa1 P 76255f1b0e964ed586eea61a3c98f5a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76255f1b0e964ed586eea61a3c98f5a4, State: Initialized, Role: FOLLOWER
I20260709 12:27:26.477288  3054 raft_consensus.cc:359] T 048820ced921458e8c9487fb036a75ce P e23f23f14d0443dbb402a267fafb37e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } }
I20260709 12:27:26.478330  3054 raft_consensus.cc:385] T 048820ced921458e8c9487fb036a75ce P e23f23f14d0443dbb402a267fafb37e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:26.478677  3054 raft_consensus.cc:740] T 048820ced921458e8c9487fb036a75ce P e23f23f14d0443dbb402a267fafb37e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e23f23f14d0443dbb402a267fafb37e9, State: Initialized, Role: FOLLOWER
I20260709 12:27:26.478626  3053 consensus_queue.cc:260] T 5dc00eddee2242c4bbc79dd80a12eaa1 P 76255f1b0e964ed586eea61a3c98f5a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } }
I20260709 12:27:26.478632  3055 consensus_queue.cc:260] T 048820ced921458e8c9487fb036a75ce P 62a66f0b223a4d798efd4388568410ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } }
I20260709 12:27:26.479884  3054 consensus_queue.cc:260] T 048820ced921458e8c9487fb036a75ce P e23f23f14d0443dbb402a267fafb37e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } }
I20260709 12:27:26.481129  3053 ts_tablet_manager.cc:1434] T 5dc00eddee2242c4bbc79dd80a12eaa1 P 76255f1b0e964ed586eea61a3c98f5a4: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:27:26.482187  3053 tablet_bootstrap.cc:492] T 048820ced921458e8c9487fb036a75ce P 76255f1b0e964ed586eea61a3c98f5a4: Bootstrap starting.
I20260709 12:27:26.482138  3054 ts_tablet_manager.cc:1434] T 048820ced921458e8c9487fb036a75ce P e23f23f14d0443dbb402a267fafb37e9: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:27:26.486688  3054 tablet_bootstrap.cc:492] T 5dc00eddee2242c4bbc79dd80a12eaa1 P e23f23f14d0443dbb402a267fafb37e9: Bootstrap starting.
I20260709 12:27:26.492113  3053 tablet_bootstrap.cc:654] T 048820ced921458e8c9487fb036a75ce P 76255f1b0e964ed586eea61a3c98f5a4: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:26.492880  3054 tablet_bootstrap.cc:654] T 5dc00eddee2242c4bbc79dd80a12eaa1 P e23f23f14d0443dbb402a267fafb37e9: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:26.498406  3055 ts_tablet_manager.cc:1434] T 048820ced921458e8c9487fb036a75ce P 62a66f0b223a4d798efd4388568410ee: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 12:27:26.499270  3054 tablet_bootstrap.cc:492] T 5dc00eddee2242c4bbc79dd80a12eaa1 P e23f23f14d0443dbb402a267fafb37e9: No bootstrap required, opened a new log
I20260709 12:27:26.499624  3055 tablet_bootstrap.cc:492] T 5dc00eddee2242c4bbc79dd80a12eaa1 P 62a66f0b223a4d798efd4388568410ee: Bootstrap starting.
I20260709 12:27:26.499927  3054 ts_tablet_manager.cc:1403] T 5dc00eddee2242c4bbc79dd80a12eaa1 P e23f23f14d0443dbb402a267fafb37e9: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.003s
I20260709 12:27:26.500329  3053 tablet_bootstrap.cc:492] T 048820ced921458e8c9487fb036a75ce P 76255f1b0e964ed586eea61a3c98f5a4: No bootstrap required, opened a new log
I20260709 12:27:26.500871  3053 ts_tablet_manager.cc:1403] T 048820ced921458e8c9487fb036a75ce P 76255f1b0e964ed586eea61a3c98f5a4: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.004s
I20260709 12:27:26.503283  3054 raft_consensus.cc:359] T 5dc00eddee2242c4bbc79dd80a12eaa1 P e23f23f14d0443dbb402a267fafb37e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } }
I20260709 12:27:26.503592  3053 raft_consensus.cc:359] T 048820ced921458e8c9487fb036a75ce P 76255f1b0e964ed586eea61a3c98f5a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } }
I20260709 12:27:26.504187  3054 raft_consensus.cc:385] T 5dc00eddee2242c4bbc79dd80a12eaa1 P e23f23f14d0443dbb402a267fafb37e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:26.504307  3053 raft_consensus.cc:385] T 048820ced921458e8c9487fb036a75ce P 76255f1b0e964ed586eea61a3c98f5a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:26.504702  3054 raft_consensus.cc:740] T 5dc00eddee2242c4bbc79dd80a12eaa1 P e23f23f14d0443dbb402a267fafb37e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e23f23f14d0443dbb402a267fafb37e9, State: Initialized, Role: FOLLOWER
I20260709 12:27:26.504712  3053 raft_consensus.cc:740] T 048820ced921458e8c9487fb036a75ce P 76255f1b0e964ed586eea61a3c98f5a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76255f1b0e964ed586eea61a3c98f5a4, State: Initialized, Role: FOLLOWER
I20260709 12:27:26.506338  3055 tablet_bootstrap.cc:654] T 5dc00eddee2242c4bbc79dd80a12eaa1 P 62a66f0b223a4d798efd4388568410ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:26.505801  3053 consensus_queue.cc:260] T 048820ced921458e8c9487fb036a75ce P 76255f1b0e964ed586eea61a3c98f5a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } }
I20260709 12:27:26.505801  3054 consensus_queue.cc:260] T 5dc00eddee2242c4bbc79dd80a12eaa1 P e23f23f14d0443dbb402a267fafb37e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } }
I20260709 12:27:26.508308  3054 ts_tablet_manager.cc:1434] T 5dc00eddee2242c4bbc79dd80a12eaa1 P e23f23f14d0443dbb402a267fafb37e9: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:27:26.508311  3053 ts_tablet_manager.cc:1434] T 048820ced921458e8c9487fb036a75ce P 76255f1b0e964ed586eea61a3c98f5a4: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:27:26.518016  3055 tablet_bootstrap.cc:492] T 5dc00eddee2242c4bbc79dd80a12eaa1 P 62a66f0b223a4d798efd4388568410ee: No bootstrap required, opened a new log
I20260709 12:27:26.518554  3055 ts_tablet_manager.cc:1403] T 5dc00eddee2242c4bbc79dd80a12eaa1 P 62a66f0b223a4d798efd4388568410ee: Time spent bootstrapping tablet: real 0.019s	user 0.004s	sys 0.008s
I20260709 12:27:26.521237  3055 raft_consensus.cc:359] T 5dc00eddee2242c4bbc79dd80a12eaa1 P 62a66f0b223a4d798efd4388568410ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } }
I20260709 12:27:26.521795  3055 raft_consensus.cc:385] T 5dc00eddee2242c4bbc79dd80a12eaa1 P 62a66f0b223a4d798efd4388568410ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:26.522044  3055 raft_consensus.cc:740] T 5dc00eddee2242c4bbc79dd80a12eaa1 P 62a66f0b223a4d798efd4388568410ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62a66f0b223a4d798efd4388568410ee, State: Initialized, Role: FOLLOWER
I20260709 12:27:26.522670  3055 consensus_queue.cc:260] T 5dc00eddee2242c4bbc79dd80a12eaa1 P 62a66f0b223a4d798efd4388568410ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } }
I20260709 12:27:26.524576  3055 ts_tablet_manager.cc:1434] T 5dc00eddee2242c4bbc79dd80a12eaa1 P 62a66f0b223a4d798efd4388568410ee: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 12:27:26.590235  3060 raft_consensus.cc:493] T 5dc00eddee2242c4bbc79dd80a12eaa1 P e23f23f14d0443dbb402a267fafb37e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.590764  3060 raft_consensus.cc:515] T 5dc00eddee2242c4bbc79dd80a12eaa1 P e23f23f14d0443dbb402a267fafb37e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } }
I20260709 12:27:26.592517  3060 leader_election.cc:290] T 5dc00eddee2242c4bbc79dd80a12eaa1 P e23f23f14d0443dbb402a267fafb37e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76255f1b0e964ed586eea61a3c98f5a4 (127.23.245.129:36903), 62a66f0b223a4d798efd4388568410ee (127.23.245.131:44537)
I20260709 12:27:26.593412  2864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dc00eddee2242c4bbc79dd80a12eaa1" candidate_uuid: "e23f23f14d0443dbb402a267fafb37e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76255f1b0e964ed586eea61a3c98f5a4" is_pre_election: true
I20260709 12:27:26.593637  3013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dc00eddee2242c4bbc79dd80a12eaa1" candidate_uuid: "e23f23f14d0443dbb402a267fafb37e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62a66f0b223a4d798efd4388568410ee" is_pre_election: true
I20260709 12:27:26.594134  2864 raft_consensus.cc:2468] T 5dc00eddee2242c4bbc79dd80a12eaa1 P 76255f1b0e964ed586eea61a3c98f5a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e23f23f14d0443dbb402a267fafb37e9 in term 0.
I20260709 12:27:26.594233  3013 raft_consensus.cc:2468] T 5dc00eddee2242c4bbc79dd80a12eaa1 P 62a66f0b223a4d798efd4388568410ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e23f23f14d0443dbb402a267fafb37e9 in term 0.
I20260709 12:27:26.595335  2903 leader_election.cc:304] T 5dc00eddee2242c4bbc79dd80a12eaa1 P e23f23f14d0443dbb402a267fafb37e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62a66f0b223a4d798efd4388568410ee, e23f23f14d0443dbb402a267fafb37e9; no voters: 
I20260709 12:27:26.596314  3060 raft_consensus.cc:2804] T 5dc00eddee2242c4bbc79dd80a12eaa1 P e23f23f14d0443dbb402a267fafb37e9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:26.596730  3060 raft_consensus.cc:493] T 5dc00eddee2242c4bbc79dd80a12eaa1 P e23f23f14d0443dbb402a267fafb37e9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:26.597054  3060 raft_consensus.cc:3060] T 5dc00eddee2242c4bbc79dd80a12eaa1 P e23f23f14d0443dbb402a267fafb37e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:26.602406  3060 raft_consensus.cc:515] T 5dc00eddee2242c4bbc79dd80a12eaa1 P e23f23f14d0443dbb402a267fafb37e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } }
I20260709 12:27:26.604197  3060 leader_election.cc:290] T 5dc00eddee2242c4bbc79dd80a12eaa1 P e23f23f14d0443dbb402a267fafb37e9 [CANDIDATE]: Term 1 election: Requested vote from peers 76255f1b0e964ed586eea61a3c98f5a4 (127.23.245.129:36903), 62a66f0b223a4d798efd4388568410ee (127.23.245.131:44537)
I20260709 12:27:26.605069  2864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dc00eddee2242c4bbc79dd80a12eaa1" candidate_uuid: "e23f23f14d0443dbb402a267fafb37e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76255f1b0e964ed586eea61a3c98f5a4"
I20260709 12:27:26.605244  3013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dc00eddee2242c4bbc79dd80a12eaa1" candidate_uuid: "e23f23f14d0443dbb402a267fafb37e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62a66f0b223a4d798efd4388568410ee"
I20260709 12:27:26.605631  2864 raft_consensus.cc:3060] T 5dc00eddee2242c4bbc79dd80a12eaa1 P 76255f1b0e964ed586eea61a3c98f5a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:26.605870  3013 raft_consensus.cc:3060] T 5dc00eddee2242c4bbc79dd80a12eaa1 P 62a66f0b223a4d798efd4388568410ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:26.611595  2864 raft_consensus.cc:2468] T 5dc00eddee2242c4bbc79dd80a12eaa1 P 76255f1b0e964ed586eea61a3c98f5a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e23f23f14d0443dbb402a267fafb37e9 in term 1.
I20260709 12:27:26.612299  3013 raft_consensus.cc:2468] T 5dc00eddee2242c4bbc79dd80a12eaa1 P 62a66f0b223a4d798efd4388568410ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e23f23f14d0443dbb402a267fafb37e9 in term 1.
I20260709 12:27:26.612664  2905 leader_election.cc:304] T 5dc00eddee2242c4bbc79dd80a12eaa1 P e23f23f14d0443dbb402a267fafb37e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76255f1b0e964ed586eea61a3c98f5a4, e23f23f14d0443dbb402a267fafb37e9; no voters: 
I20260709 12:27:26.613562  3060 raft_consensus.cc:2804] T 5dc00eddee2242c4bbc79dd80a12eaa1 P e23f23f14d0443dbb402a267fafb37e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:26.614089  3060 raft_consensus.cc:697] T 5dc00eddee2242c4bbc79dd80a12eaa1 P e23f23f14d0443dbb402a267fafb37e9 [term 1 LEADER]: Becoming Leader. State: Replica: e23f23f14d0443dbb402a267fafb37e9, State: Running, Role: LEADER
I20260709 12:27:26.614804  3060 consensus_queue.cc:237] T 5dc00eddee2242c4bbc79dd80a12eaa1 P e23f23f14d0443dbb402a267fafb37e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } }
I20260709 12:27:26.622437  2761 catalog_manager.cc:5697] T 5dc00eddee2242c4bbc79dd80a12eaa1 P e23f23f14d0443dbb402a267fafb37e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to e23f23f14d0443dbb402a267fafb37e9 (127.23.245.130). New cstate: current_term: 1 leader_uuid: "e23f23f14d0443dbb402a267fafb37e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } health_report { overall_health: UNKNOWN } } }
W20260709 12:27:26.660980  2810 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:26.731290  3061 raft_consensus.cc:493] T 048820ced921458e8c9487fb036a75ce P 62a66f0b223a4d798efd4388568410ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.731812  3061 raft_consensus.cc:515] T 048820ced921458e8c9487fb036a75ce P 62a66f0b223a4d798efd4388568410ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } }
I20260709 12:27:26.733953  3061 leader_election.cc:290] T 048820ced921458e8c9487fb036a75ce P 62a66f0b223a4d798efd4388568410ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76255f1b0e964ed586eea61a3c98f5a4 (127.23.245.129:36903), e23f23f14d0443dbb402a267fafb37e9 (127.23.245.130:46085)
I20260709 12:27:26.743403  3059 raft_consensus.cc:493] T 048820ced921458e8c9487fb036a75ce P 76255f1b0e964ed586eea61a3c98f5a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.744047  3059 raft_consensus.cc:515] T 048820ced921458e8c9487fb036a75ce P 76255f1b0e964ed586eea61a3c98f5a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } }
I20260709 12:27:26.745313  2864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048820ced921458e8c9487fb036a75ce" candidate_uuid: "62a66f0b223a4d798efd4388568410ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76255f1b0e964ed586eea61a3c98f5a4" is_pre_election: true
I20260709 12:27:26.746007  2864 raft_consensus.cc:2468] T 048820ced921458e8c9487fb036a75ce P 76255f1b0e964ed586eea61a3c98f5a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62a66f0b223a4d798efd4388568410ee in term 0.
I20260709 12:27:26.746506  2939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048820ced921458e8c9487fb036a75ce" candidate_uuid: "62a66f0b223a4d798efd4388568410ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23f23f14d0443dbb402a267fafb37e9" is_pre_election: true
I20260709 12:27:26.747053  2979 leader_election.cc:304] T 048820ced921458e8c9487fb036a75ce P 62a66f0b223a4d798efd4388568410ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62a66f0b223a4d798efd4388568410ee, 76255f1b0e964ed586eea61a3c98f5a4; no voters: 
I20260709 12:27:26.747251  2939 raft_consensus.cc:2468] T 048820ced921458e8c9487fb036a75ce P e23f23f14d0443dbb402a267fafb37e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62a66f0b223a4d798efd4388568410ee in term 0.
I20260709 12:27:26.747961  3061 raft_consensus.cc:2804] T 048820ced921458e8c9487fb036a75ce P 62a66f0b223a4d798efd4388568410ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:26.748368  3061 raft_consensus.cc:493] T 048820ced921458e8c9487fb036a75ce P 62a66f0b223a4d798efd4388568410ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:26.748746  3061 raft_consensus.cc:3060] T 048820ced921458e8c9487fb036a75ce P 62a66f0b223a4d798efd4388568410ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:26.749481  3059 leader_election.cc:290] T 048820ced921458e8c9487fb036a75ce P 76255f1b0e964ed586eea61a3c98f5a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e23f23f14d0443dbb402a267fafb37e9 (127.23.245.130:46085), 62a66f0b223a4d798efd4388568410ee (127.23.245.131:44537)
I20260709 12:27:26.758090  2939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048820ced921458e8c9487fb036a75ce" candidate_uuid: "76255f1b0e964ed586eea61a3c98f5a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23f23f14d0443dbb402a267fafb37e9" is_pre_election: true
I20260709 12:27:26.757869  3061 raft_consensus.cc:515] T 048820ced921458e8c9487fb036a75ce P 62a66f0b223a4d798efd4388568410ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } }
I20260709 12:27:26.758787  2939 raft_consensus.cc:2468] T 048820ced921458e8c9487fb036a75ce P e23f23f14d0443dbb402a267fafb37e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 76255f1b0e964ed586eea61a3c98f5a4 in term 0.
I20260709 12:27:26.760381  2829 leader_election.cc:304] T 048820ced921458e8c9487fb036a75ce P 76255f1b0e964ed586eea61a3c98f5a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76255f1b0e964ed586eea61a3c98f5a4, e23f23f14d0443dbb402a267fafb37e9; no voters: 
I20260709 12:27:26.761377  3059 raft_consensus.cc:2804] T 048820ced921458e8c9487fb036a75ce P 76255f1b0e964ed586eea61a3c98f5a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:26.761857  2864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048820ced921458e8c9487fb036a75ce" candidate_uuid: "62a66f0b223a4d798efd4388568410ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76255f1b0e964ed586eea61a3c98f5a4"
I20260709 12:27:26.762015  3059 raft_consensus.cc:493] T 048820ced921458e8c9487fb036a75ce P 76255f1b0e964ed586eea61a3c98f5a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:26.763092  3013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048820ced921458e8c9487fb036a75ce" candidate_uuid: "76255f1b0e964ed586eea61a3c98f5a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62a66f0b223a4d798efd4388568410ee" is_pre_election: true
I20260709 12:27:26.762264  3061 leader_election.cc:290] T 048820ced921458e8c9487fb036a75ce P 62a66f0b223a4d798efd4388568410ee [CANDIDATE]: Term 1 election: Requested vote from peers 76255f1b0e964ed586eea61a3c98f5a4 (127.23.245.129:36903), e23f23f14d0443dbb402a267fafb37e9 (127.23.245.130:46085)
I20260709 12:27:26.765583  3059 raft_consensus.cc:3060] T 048820ced921458e8c9487fb036a75ce P 76255f1b0e964ed586eea61a3c98f5a4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:26.765913  3013 raft_consensus.cc:2393] T 048820ced921458e8c9487fb036a75ce P 62a66f0b223a4d798efd4388568410ee [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 76255f1b0e964ed586eea61a3c98f5a4 in current term 1: Already voted for candidate 62a66f0b223a4d798efd4388568410ee in this term.
I20260709 12:27:26.764379  2939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048820ced921458e8c9487fb036a75ce" candidate_uuid: "62a66f0b223a4d798efd4388568410ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23f23f14d0443dbb402a267fafb37e9"
I20260709 12:27:26.766556  2939 raft_consensus.cc:3060] T 048820ced921458e8c9487fb036a75ce P e23f23f14d0443dbb402a267fafb37e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:26.771623  3059 raft_consensus.cc:515] T 048820ced921458e8c9487fb036a75ce P 76255f1b0e964ed586eea61a3c98f5a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } }
I20260709 12:27:26.772838  2864 raft_consensus.cc:2393] T 048820ced921458e8c9487fb036a75ce P 76255f1b0e964ed586eea61a3c98f5a4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 62a66f0b223a4d798efd4388568410ee in current term 1: Already voted for candidate 76255f1b0e964ed586eea61a3c98f5a4 in this term.
I20260709 12:27:26.772651  2939 raft_consensus.cc:2468] T 048820ced921458e8c9487fb036a75ce P e23f23f14d0443dbb402a267fafb37e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62a66f0b223a4d798efd4388568410ee in term 1.
I20260709 12:27:26.774386  2978 leader_election.cc:304] T 048820ced921458e8c9487fb036a75ce P 62a66f0b223a4d798efd4388568410ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62a66f0b223a4d798efd4388568410ee, e23f23f14d0443dbb402a267fafb37e9; no voters: 
I20260709 12:27:26.774722  2939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048820ced921458e8c9487fb036a75ce" candidate_uuid: "76255f1b0e964ed586eea61a3c98f5a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e23f23f14d0443dbb402a267fafb37e9"
I20260709 12:27:26.775147  3059 leader_election.cc:290] T 048820ced921458e8c9487fb036a75ce P 76255f1b0e964ed586eea61a3c98f5a4 [CANDIDATE]: Term 1 election: Requested vote from peers e23f23f14d0443dbb402a267fafb37e9 (127.23.245.130:46085), 62a66f0b223a4d798efd4388568410ee (127.23.245.131:44537)
I20260709 12:27:26.775357  3061 raft_consensus.cc:2804] T 048820ced921458e8c9487fb036a75ce P 62a66f0b223a4d798efd4388568410ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:26.775813  2939 raft_consensus.cc:2393] T 048820ced921458e8c9487fb036a75ce P e23f23f14d0443dbb402a267fafb37e9 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 76255f1b0e964ed586eea61a3c98f5a4 in current term 1: Already voted for candidate 62a66f0b223a4d798efd4388568410ee in this term.
I20260709 12:27:26.776252  3013 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048820ced921458e8c9487fb036a75ce" candidate_uuid: "76255f1b0e964ed586eea61a3c98f5a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62a66f0b223a4d798efd4388568410ee"
I20260709 12:27:26.776618  3061 raft_consensus.cc:697] T 048820ced921458e8c9487fb036a75ce P 62a66f0b223a4d798efd4388568410ee [term 1 LEADER]: Becoming Leader. State: Replica: 62a66f0b223a4d798efd4388568410ee, State: Running, Role: LEADER
I20260709 12:27:26.777519  3061 consensus_queue.cc:237] T 048820ced921458e8c9487fb036a75ce P 62a66f0b223a4d798efd4388568410ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } }
I20260709 12:27:26.781936  2828 leader_election.cc:304] T 048820ced921458e8c9487fb036a75ce P 76255f1b0e964ed586eea61a3c98f5a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 76255f1b0e964ed586eea61a3c98f5a4; no voters: 62a66f0b223a4d798efd4388568410ee, e23f23f14d0443dbb402a267fafb37e9
I20260709 12:27:26.782788  3059 raft_consensus.cc:2749] T 048820ced921458e8c9487fb036a75ce P 76255f1b0e964ed586eea61a3c98f5a4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:27:26.784909  2761 catalog_manager.cc:5697] T 048820ced921458e8c9487fb036a75ce P 62a66f0b223a4d798efd4388568410ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 62a66f0b223a4d798efd4388568410ee (127.23.245.131). New cstate: current_term: 1 leader_uuid: "62a66f0b223a4d798efd4388568410ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:26.793314  3060 consensus_queue.cc:1048] T 6b938decaa3e4f66b8d383cce8e8424b P e23f23f14d0443dbb402a267fafb37e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:26.805641  3064 consensus_queue.cc:1048] T 6b938decaa3e4f66b8d383cce8e8424b P e23f23f14d0443dbb402a267fafb37e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:26.840011  2939 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "65453404455447639f31ecf47b696614"
dest_uuid: "e23f23f14d0443dbb402a267fafb37e9"
mode: GRACEFUL
new_leader_uuid: "76255f1b0e964ed586eea61a3c98f5a4"
 from {username='slave'} at 127.0.0.1:46894
I20260709 12:27:26.840627  2939 raft_consensus.cc:606] T 65453404455447639f31ecf47b696614 P e23f23f14d0443dbb402a267fafb37e9 [term 1 LEADER]: Received request to transfer leadership to TS 76255f1b0e964ed586eea61a3c98f5a4
I20260709 12:27:26.845707  2939 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b938decaa3e4f66b8d383cce8e8424b"
dest_uuid: "e23f23f14d0443dbb402a267fafb37e9"
mode: GRACEFUL
new_leader_uuid: "62a66f0b223a4d798efd4388568410ee"
 from {username='slave'} at 127.0.0.1:46894
I20260709 12:27:26.846216  2939 raft_consensus.cc:606] T 6b938decaa3e4f66b8d383cce8e8424b P e23f23f14d0443dbb402a267fafb37e9 [term 1 LEADER]: Received request to transfer leadership to TS 62a66f0b223a4d798efd4388568410ee
I20260709 12:27:26.851433  2939 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5dc00eddee2242c4bbc79dd80a12eaa1"
dest_uuid: "e23f23f14d0443dbb402a267fafb37e9"
mode: GRACEFUL
new_leader_uuid: "76255f1b0e964ed586eea61a3c98f5a4"
 from {username='slave'} at 127.0.0.1:46894
I20260709 12:27:26.851969  2939 raft_consensus.cc:606] T 5dc00eddee2242c4bbc79dd80a12eaa1 P e23f23f14d0443dbb402a267fafb37e9 [term 1 LEADER]: Received request to transfer leadership to TS 76255f1b0e964ed586eea61a3c98f5a4
I20260709 12:27:26.855274  3064 consensus_queue.cc:1048] T 65453404455447639f31ecf47b696614 P e23f23f14d0443dbb402a267fafb37e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:26.863059  3067 raft_consensus.cc:993] T 65453404455447639f31ecf47b696614 P e23f23f14d0443dbb402a267fafb37e9: : Instructing follower 76255f1b0e964ed586eea61a3c98f5a4 to start an election
I20260709 12:27:26.863524  3060 raft_consensus.cc:1081] T 65453404455447639f31ecf47b696614 P e23f23f14d0443dbb402a267fafb37e9 [term 1 LEADER]: Signalling peer 76255f1b0e964ed586eea61a3c98f5a4 to start an election
I20260709 12:27:26.866308  2863 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "65453404455447639f31ecf47b696614"
dest_uuid: "76255f1b0e964ed586eea61a3c98f5a4"
 from {username='slave'} at 127.0.0.1:44934
I20260709 12:27:26.866931  2863 raft_consensus.cc:493] T 65453404455447639f31ecf47b696614 P 76255f1b0e964ed586eea61a3c98f5a4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:26.867354  2863 raft_consensus.cc:3060] T 65453404455447639f31ecf47b696614 P 76255f1b0e964ed586eea61a3c98f5a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:26.868805  3067 consensus_queue.cc:1048] T 65453404455447639f31ecf47b696614 P e23f23f14d0443dbb402a267fafb37e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:26.870950  3013 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "048820ced921458e8c9487fb036a75ce"
dest_uuid: "62a66f0b223a4d798efd4388568410ee"
mode: GRACEFUL
new_leader_uuid: "76255f1b0e964ed586eea61a3c98f5a4"
 from {username='slave'} at 127.0.0.1:46648
I20260709 12:27:26.871515  3013 raft_consensus.cc:606] T 048820ced921458e8c9487fb036a75ce P 62a66f0b223a4d798efd4388568410ee [term 1 LEADER]: Received request to transfer leadership to TS 76255f1b0e964ed586eea61a3c98f5a4
I20260709 12:27:26.878904  2863 raft_consensus.cc:515] T 65453404455447639f31ecf47b696614 P 76255f1b0e964ed586eea61a3c98f5a4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } }
I20260709 12:27:26.880155  2864 raft_consensus.cc:1240] T 65453404455447639f31ecf47b696614 P 76255f1b0e964ed586eea61a3c98f5a4 [term 2 FOLLOWER]: Rejecting Update request from peer e23f23f14d0443dbb402a267fafb37e9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:26.881300  2863 leader_election.cc:290] T 65453404455447639f31ecf47b696614 P 76255f1b0e964ed586eea61a3c98f5a4 [CANDIDATE]: Term 2 election: Requested vote from peers e23f23f14d0443dbb402a267fafb37e9 (127.23.245.130:46085), 62a66f0b223a4d798efd4388568410ee (127.23.245.131:44537)
I20260709 12:27:26.881937  2939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65453404455447639f31ecf47b696614" candidate_uuid: "76255f1b0e964ed586eea61a3c98f5a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e23f23f14d0443dbb402a267fafb37e9"
I20260709 12:27:26.882350  3012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65453404455447639f31ecf47b696614" candidate_uuid: "76255f1b0e964ed586eea61a3c98f5a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "62a66f0b223a4d798efd4388568410ee"
I20260709 12:27:26.882561  2939 raft_consensus.cc:3055] T 65453404455447639f31ecf47b696614 P e23f23f14d0443dbb402a267fafb37e9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:26.882998  2939 raft_consensus.cc:740] T 65453404455447639f31ecf47b696614 P e23f23f14d0443dbb402a267fafb37e9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e23f23f14d0443dbb402a267fafb37e9, State: Running, Role: LEADER
I20260709 12:27:26.882946  3012 raft_consensus.cc:3060] T 65453404455447639f31ecf47b696614 P 62a66f0b223a4d798efd4388568410ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:26.883992  2939 consensus_queue.cc:260] T 65453404455447639f31ecf47b696614 P e23f23f14d0443dbb402a267fafb37e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } }
I20260709 12:27:26.884824  3067 consensus_queue.cc:1059] T 65453404455447639f31ecf47b696614 P e23f23f14d0443dbb402a267fafb37e9 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:26.885929  2939 raft_consensus.cc:3060] T 65453404455447639f31ecf47b696614 P e23f23f14d0443dbb402a267fafb37e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:26.890533  3012 raft_consensus.cc:2468] T 65453404455447639f31ecf47b696614 P 62a66f0b223a4d798efd4388568410ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76255f1b0e964ed586eea61a3c98f5a4 in term 2.
I20260709 12:27:26.893188  2939 raft_consensus.cc:2468] T 65453404455447639f31ecf47b696614 P e23f23f14d0443dbb402a267fafb37e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76255f1b0e964ed586eea61a3c98f5a4 in term 2.
I20260709 12:27:26.894259  2829 leader_election.cc:304] T 65453404455447639f31ecf47b696614 P 76255f1b0e964ed586eea61a3c98f5a4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76255f1b0e964ed586eea61a3c98f5a4, e23f23f14d0443dbb402a267fafb37e9; no voters: 
I20260709 12:27:26.895375  3059 raft_consensus.cc:2804] T 65453404455447639f31ecf47b696614 P 76255f1b0e964ed586eea61a3c98f5a4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:26.896564  3059 raft_consensus.cc:697] T 65453404455447639f31ecf47b696614 P 76255f1b0e964ed586eea61a3c98f5a4 [term 2 LEADER]: Becoming Leader. State: Replica: 76255f1b0e964ed586eea61a3c98f5a4, State: Running, Role: LEADER
I20260709 12:27:26.897424  3059 consensus_queue.cc:237] T 65453404455447639f31ecf47b696614 P 76255f1b0e964ed586eea61a3c98f5a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } }
I20260709 12:27:26.904098  2760 catalog_manager.cc:5697] T 65453404455447639f31ecf47b696614 P 76255f1b0e964ed586eea61a3c98f5a4 reported cstate change: term changed from 1 to 2, leader changed from e23f23f14d0443dbb402a267fafb37e9 (127.23.245.130) to 76255f1b0e964ed586eea61a3c98f5a4 (127.23.245.129). New cstate: current_term: 2 leader_uuid: "76255f1b0e964ed586eea61a3c98f5a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:27.029822  3067 consensus_queue.cc:1048] T 5dc00eddee2242c4bbc79dd80a12eaa1 P e23f23f14d0443dbb402a267fafb37e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:27.037635  3060 raft_consensus.cc:993] T 5dc00eddee2242c4bbc79dd80a12eaa1 P e23f23f14d0443dbb402a267fafb37e9: : Instructing follower 76255f1b0e964ed586eea61a3c98f5a4 to start an election
I20260709 12:27:27.038156  3064 raft_consensus.cc:1081] T 5dc00eddee2242c4bbc79dd80a12eaa1 P e23f23f14d0443dbb402a267fafb37e9 [term 1 LEADER]: Signalling peer 76255f1b0e964ed586eea61a3c98f5a4 to start an election
I20260709 12:27:27.040921  2863 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5dc00eddee2242c4bbc79dd80a12eaa1"
dest_uuid: "76255f1b0e964ed586eea61a3c98f5a4"
 from {username='slave'} at 127.0.0.1:44934
I20260709 12:27:27.041507  2863 raft_consensus.cc:493] T 5dc00eddee2242c4bbc79dd80a12eaa1 P 76255f1b0e964ed586eea61a3c98f5a4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:27.041903  2863 raft_consensus.cc:3060] T 5dc00eddee2242c4bbc79dd80a12eaa1 P 76255f1b0e964ed586eea61a3c98f5a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:27.044446  3067 consensus_queue.cc:1048] T 5dc00eddee2242c4bbc79dd80a12eaa1 P e23f23f14d0443dbb402a267fafb37e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:27.053176  2863 raft_consensus.cc:515] T 5dc00eddee2242c4bbc79dd80a12eaa1 P 76255f1b0e964ed586eea61a3c98f5a4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } }
I20260709 12:27:27.054162  2864 raft_consensus.cc:1240] T 5dc00eddee2242c4bbc79dd80a12eaa1 P 76255f1b0e964ed586eea61a3c98f5a4 [term 2 FOLLOWER]: Rejecting Update request from peer e23f23f14d0443dbb402a267fafb37e9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:27.055291  2863 leader_election.cc:290] T 5dc00eddee2242c4bbc79dd80a12eaa1 P 76255f1b0e964ed586eea61a3c98f5a4 [CANDIDATE]: Term 2 election: Requested vote from peers e23f23f14d0443dbb402a267fafb37e9 (127.23.245.130:46085), 62a66f0b223a4d798efd4388568410ee (127.23.245.131:44537)
I20260709 12:27:27.056366  3012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dc00eddee2242c4bbc79dd80a12eaa1" candidate_uuid: "76255f1b0e964ed586eea61a3c98f5a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "62a66f0b223a4d798efd4388568410ee"
I20260709 12:27:27.056936  3067 consensus_queue.cc:1059] T 5dc00eddee2242c4bbc79dd80a12eaa1 P e23f23f14d0443dbb402a267fafb37e9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:27.056366  2939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5dc00eddee2242c4bbc79dd80a12eaa1" candidate_uuid: "76255f1b0e964ed586eea61a3c98f5a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e23f23f14d0443dbb402a267fafb37e9"
I20260709 12:27:27.057240  3012 raft_consensus.cc:3060] T 5dc00eddee2242c4bbc79dd80a12eaa1 P 62a66f0b223a4d798efd4388568410ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:27.057686  2939 raft_consensus.cc:3055] T 5dc00eddee2242c4bbc79dd80a12eaa1 P e23f23f14d0443dbb402a267fafb37e9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:27.058017  2939 raft_consensus.cc:740] T 5dc00eddee2242c4bbc79dd80a12eaa1 P e23f23f14d0443dbb402a267fafb37e9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e23f23f14d0443dbb402a267fafb37e9, State: Running, Role: LEADER
I20260709 12:27:27.058727  2939 consensus_queue.cc:260] T 5dc00eddee2242c4bbc79dd80a12eaa1 P e23f23f14d0443dbb402a267fafb37e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } }
I20260709 12:27:27.060150  2939 raft_consensus.cc:3060] T 5dc00eddee2242c4bbc79dd80a12eaa1 P e23f23f14d0443dbb402a267fafb37e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:27.063969  3012 raft_consensus.cc:2468] T 5dc00eddee2242c4bbc79dd80a12eaa1 P 62a66f0b223a4d798efd4388568410ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76255f1b0e964ed586eea61a3c98f5a4 in term 2.
I20260709 12:27:27.065275  2828 leader_election.cc:304] T 5dc00eddee2242c4bbc79dd80a12eaa1 P 76255f1b0e964ed586eea61a3c98f5a4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62a66f0b223a4d798efd4388568410ee, 76255f1b0e964ed586eea61a3c98f5a4; no voters: 
I20260709 12:27:27.066039  3059 raft_consensus.cc:2804] T 5dc00eddee2242c4bbc79dd80a12eaa1 P 76255f1b0e964ed586eea61a3c98f5a4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:27.066130  2939 raft_consensus.cc:2468] T 5dc00eddee2242c4bbc79dd80a12eaa1 P e23f23f14d0443dbb402a267fafb37e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76255f1b0e964ed586eea61a3c98f5a4 in term 2.
I20260709 12:27:27.066605  3059 raft_consensus.cc:697] T 5dc00eddee2242c4bbc79dd80a12eaa1 P 76255f1b0e964ed586eea61a3c98f5a4 [term 2 LEADER]: Becoming Leader. State: Replica: 76255f1b0e964ed586eea61a3c98f5a4, State: Running, Role: LEADER
W20260709 12:27:27.066890  3067 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:27:27.067559  3059 consensus_queue.cc:237] T 5dc00eddee2242c4bbc79dd80a12eaa1 P 76255f1b0e964ed586eea61a3c98f5a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } }
I20260709 12:27:27.074748  2761 catalog_manager.cc:5697] T 5dc00eddee2242c4bbc79dd80a12eaa1 P 76255f1b0e964ed586eea61a3c98f5a4 reported cstate change: term changed from 1 to 2, leader changed from e23f23f14d0443dbb402a267fafb37e9 (127.23.245.130) to 76255f1b0e964ed586eea61a3c98f5a4 (127.23.245.129). New cstate: current_term: 2 leader_uuid: "76255f1b0e964ed586eea61a3c98f5a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:27.264911  3098 raft_consensus.cc:993] T 6b938decaa3e4f66b8d383cce8e8424b P e23f23f14d0443dbb402a267fafb37e9: : Instructing follower 62a66f0b223a4d798efd4388568410ee to start an election
I20260709 12:27:27.265390  3067 raft_consensus.cc:1081] T 6b938decaa3e4f66b8d383cce8e8424b P e23f23f14d0443dbb402a267fafb37e9 [term 1 LEADER]: Signalling peer 62a66f0b223a4d798efd4388568410ee to start an election
I20260709 12:27:27.266875  3012 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6b938decaa3e4f66b8d383cce8e8424b"
dest_uuid: "62a66f0b223a4d798efd4388568410ee"
 from {username='slave'} at 127.0.0.1:46630
I20260709 12:27:27.267382  3012 raft_consensus.cc:493] T 6b938decaa3e4f66b8d383cce8e8424b P 62a66f0b223a4d798efd4388568410ee [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:27.267694  3012 raft_consensus.cc:3060] T 6b938decaa3e4f66b8d383cce8e8424b P 62a66f0b223a4d798efd4388568410ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:27.272711  3012 raft_consensus.cc:515] T 6b938decaa3e4f66b8d383cce8e8424b P 62a66f0b223a4d798efd4388568410ee [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } }
I20260709 12:27:27.274292  3012 leader_election.cc:290] T 6b938decaa3e4f66b8d383cce8e8424b P 62a66f0b223a4d798efd4388568410ee [CANDIDATE]: Term 2 election: Requested vote from peers 76255f1b0e964ed586eea61a3c98f5a4 (127.23.245.129:36903), e23f23f14d0443dbb402a267fafb37e9 (127.23.245.130:46085)
I20260709 12:27:27.275238  2864 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b938decaa3e4f66b8d383cce8e8424b" candidate_uuid: "62a66f0b223a4d798efd4388568410ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "76255f1b0e964ed586eea61a3c98f5a4"
I20260709 12:27:27.275418  2939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b938decaa3e4f66b8d383cce8e8424b" candidate_uuid: "62a66f0b223a4d798efd4388568410ee" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e23f23f14d0443dbb402a267fafb37e9"
I20260709 12:27:27.275880  2864 raft_consensus.cc:3060] T 6b938decaa3e4f66b8d383cce8e8424b P 76255f1b0e964ed586eea61a3c98f5a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:27.276118  2939 raft_consensus.cc:3055] T 6b938decaa3e4f66b8d383cce8e8424b P e23f23f14d0443dbb402a267fafb37e9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:27.276522  2939 raft_consensus.cc:740] T 6b938decaa3e4f66b8d383cce8e8424b P e23f23f14d0443dbb402a267fafb37e9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e23f23f14d0443dbb402a267fafb37e9, State: Running, Role: LEADER
I20260709 12:27:27.277251  2939 consensus_queue.cc:260] T 6b938decaa3e4f66b8d383cce8e8424b P e23f23f14d0443dbb402a267fafb37e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } }
I20260709 12:27:27.278458  2939 raft_consensus.cc:3060] T 6b938decaa3e4f66b8d383cce8e8424b P e23f23f14d0443dbb402a267fafb37e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:27.281337  2864 raft_consensus.cc:2468] T 6b938decaa3e4f66b8d383cce8e8424b P 76255f1b0e964ed586eea61a3c98f5a4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62a66f0b223a4d798efd4388568410ee in term 2.
I20260709 12:27:27.282552  2979 leader_election.cc:304] T 6b938decaa3e4f66b8d383cce8e8424b P 62a66f0b223a4d798efd4388568410ee [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62a66f0b223a4d798efd4388568410ee, 76255f1b0e964ed586eea61a3c98f5a4; no voters: 
I20260709 12:27:27.283428  3061 raft_consensus.cc:2804] T 6b938decaa3e4f66b8d383cce8e8424b P 62a66f0b223a4d798efd4388568410ee [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:27.284237  2939 raft_consensus.cc:2468] T 6b938decaa3e4f66b8d383cce8e8424b P e23f23f14d0443dbb402a267fafb37e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62a66f0b223a4d798efd4388568410ee in term 2.
I20260709 12:27:27.284431  3061 raft_consensus.cc:697] T 6b938decaa3e4f66b8d383cce8e8424b P 62a66f0b223a4d798efd4388568410ee [term 2 LEADER]: Becoming Leader. State: Replica: 62a66f0b223a4d798efd4388568410ee, State: Running, Role: LEADER
I20260709 12:27:27.286019  3061 consensus_queue.cc:237] T 6b938decaa3e4f66b8d383cce8e8424b P 62a66f0b223a4d798efd4388568410ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } }
I20260709 12:27:27.293191  2761 catalog_manager.cc:5697] T 6b938decaa3e4f66b8d383cce8e8424b P 62a66f0b223a4d798efd4388568410ee reported cstate change: term changed from 1 to 2, leader changed from e23f23f14d0443dbb402a267fafb37e9 (127.23.245.130) to 62a66f0b223a4d798efd4388568410ee (127.23.245.131). New cstate: current_term: 2 leader_uuid: "62a66f0b223a4d798efd4388568410ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:27.358027  3061 consensus_queue.cc:1048] T 048820ced921458e8c9487fb036a75ce P 62a66f0b223a4d798efd4388568410ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:27.364221  3061 consensus_queue.cc:1048] T 048820ced921458e8c9487fb036a75ce P 62a66f0b223a4d798efd4388568410ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:27.377019  3061 raft_consensus.cc:993] T 048820ced921458e8c9487fb036a75ce P 62a66f0b223a4d798efd4388568410ee: : Instructing follower 76255f1b0e964ed586eea61a3c98f5a4 to start an election
I20260709 12:27:27.377532  3100 raft_consensus.cc:1081] T 048820ced921458e8c9487fb036a75ce P 62a66f0b223a4d798efd4388568410ee [term 1 LEADER]: Signalling peer 76255f1b0e964ed586eea61a3c98f5a4 to start an election
I20260709 12:27:27.379243  2863 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "048820ced921458e8c9487fb036a75ce"
dest_uuid: "76255f1b0e964ed586eea61a3c98f5a4"
 from {username='slave'} at 127.0.0.1:44946
I20260709 12:27:27.379858  2863 raft_consensus.cc:493] T 048820ced921458e8c9487fb036a75ce P 76255f1b0e964ed586eea61a3c98f5a4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:27.380285  2863 raft_consensus.cc:3060] T 048820ced921458e8c9487fb036a75ce P 76255f1b0e964ed586eea61a3c98f5a4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:27.381264  3012 raft_consensus.cc:1275] T 65453404455447639f31ecf47b696614 P 62a66f0b223a4d798efd4388568410ee [term 2 FOLLOWER]: Refusing update from remote peer 76255f1b0e964ed586eea61a3c98f5a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:27.382766  3059 consensus_queue.cc:1048] T 65453404455447639f31ecf47b696614 P 76255f1b0e964ed586eea61a3c98f5a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:27.387065  2863 raft_consensus.cc:515] T 048820ced921458e8c9487fb036a75ce P 76255f1b0e964ed586eea61a3c98f5a4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } }
I20260709 12:27:27.388319  2864 raft_consensus.cc:1240] T 048820ced921458e8c9487fb036a75ce P 76255f1b0e964ed586eea61a3c98f5a4 [term 2 FOLLOWER]: Rejecting Update request from peer 62a66f0b223a4d798efd4388568410ee for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:27.390715  3100 consensus_queue.cc:1059] T 048820ced921458e8c9487fb036a75ce P 62a66f0b223a4d798efd4388568410ee [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:27.391556  3100 raft_consensus.cc:3055] T 048820ced921458e8c9487fb036a75ce P 62a66f0b223a4d798efd4388568410ee [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:27.391861  3100 raft_consensus.cc:740] T 048820ced921458e8c9487fb036a75ce P 62a66f0b223a4d798efd4388568410ee [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 62a66f0b223a4d798efd4388568410ee, State: Running, Role: LEADER
I20260709 12:27:27.392699  3100 consensus_queue.cc:260] T 048820ced921458e8c9487fb036a75ce P 62a66f0b223a4d798efd4388568410ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } }
I20260709 12:27:27.393556  3100 raft_consensus.cc:3060] T 048820ced921458e8c9487fb036a75ce P 62a66f0b223a4d798efd4388568410ee [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:27.395565  2863 leader_election.cc:290] T 048820ced921458e8c9487fb036a75ce P 76255f1b0e964ed586eea61a3c98f5a4 [CANDIDATE]: Term 2 election: Requested vote from peers e23f23f14d0443dbb402a267fafb37e9 (127.23.245.130:46085), 62a66f0b223a4d798efd4388568410ee (127.23.245.131:44537)
I20260709 12:27:27.396301  2939 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048820ced921458e8c9487fb036a75ce" candidate_uuid: "76255f1b0e964ed586eea61a3c98f5a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e23f23f14d0443dbb402a267fafb37e9"
I20260709 12:27:27.396948  2939 raft_consensus.cc:3060] T 048820ced921458e8c9487fb036a75ce P e23f23f14d0443dbb402a267fafb37e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:27.398285  3012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048820ced921458e8c9487fb036a75ce" candidate_uuid: "76255f1b0e964ed586eea61a3c98f5a4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "62a66f0b223a4d798efd4388568410ee"
I20260709 12:27:27.408205  2939 raft_consensus.cc:2468] T 048820ced921458e8c9487fb036a75ce P e23f23f14d0443dbb402a267fafb37e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76255f1b0e964ed586eea61a3c98f5a4 in term 2.
I20260709 12:27:27.409508  2829 leader_election.cc:304] T 048820ced921458e8c9487fb036a75ce P 76255f1b0e964ed586eea61a3c98f5a4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76255f1b0e964ed586eea61a3c98f5a4, e23f23f14d0443dbb402a267fafb37e9; no voters: 
I20260709 12:27:27.410502  3059 raft_consensus.cc:2804] T 048820ced921458e8c9487fb036a75ce P 76255f1b0e964ed586eea61a3c98f5a4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:27.410930  3059 raft_consensus.cc:697] T 048820ced921458e8c9487fb036a75ce P 76255f1b0e964ed586eea61a3c98f5a4 [term 2 LEADER]: Becoming Leader. State: Replica: 76255f1b0e964ed586eea61a3c98f5a4, State: Running, Role: LEADER
I20260709 12:27:27.411710  3059 consensus_queue.cc:237] T 048820ced921458e8c9487fb036a75ce P 76255f1b0e964ed586eea61a3c98f5a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } }
I20260709 12:27:27.412545  2938 raft_consensus.cc:1275] T 65453404455447639f31ecf47b696614 P e23f23f14d0443dbb402a267fafb37e9 [term 2 FOLLOWER]: Refusing update from remote peer 76255f1b0e964ed586eea61a3c98f5a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:27.414844  3096 consensus_queue.cc:1048] T 65453404455447639f31ecf47b696614 P 76255f1b0e964ed586eea61a3c98f5a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:27.417284  3012 raft_consensus.cc:2468] T 048820ced921458e8c9487fb036a75ce P 62a66f0b223a4d798efd4388568410ee [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 76255f1b0e964ed586eea61a3c98f5a4 in term 2.
I20260709 12:27:27.422753  2760 catalog_manager.cc:5697] T 048820ced921458e8c9487fb036a75ce P 76255f1b0e964ed586eea61a3c98f5a4 reported cstate change: term changed from 1 to 2, leader changed from 62a66f0b223a4d798efd4388568410ee (127.23.245.131) to 76255f1b0e964ed586eea61a3c98f5a4 (127.23.245.129). New cstate: current_term: 2 leader_uuid: "76255f1b0e964ed586eea61a3c98f5a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:27.612337 24534 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 12:27:27.613889 24534 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 12:27:27.614281 24534 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 12:27:27.625545  2863 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "048820ced921458e8c9487fb036a75ce"
dest_uuid: "76255f1b0e964ed586eea61a3c98f5a4"
mode: GRACEFUL
new_leader_uuid: "e23f23f14d0443dbb402a267fafb37e9"
 from {username='slave'} at 127.0.0.1:44962
I20260709 12:27:27.626103  2863 raft_consensus.cc:606] T 048820ced921458e8c9487fb036a75ce P 76255f1b0e964ed586eea61a3c98f5a4 [term 2 LEADER]: Received request to transfer leadership to TS e23f23f14d0443dbb402a267fafb37e9
I20260709 12:27:27.627291 24534 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 12:27:27.649585  2938 raft_consensus.cc:1275] T 5dc00eddee2242c4bbc79dd80a12eaa1 P e23f23f14d0443dbb402a267fafb37e9 [term 2 FOLLOWER]: Refusing update from remote peer 76255f1b0e964ed586eea61a3c98f5a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:27.649585  3012 raft_consensus.cc:1275] T 5dc00eddee2242c4bbc79dd80a12eaa1 P 62a66f0b223a4d798efd4388568410ee [term 2 FOLLOWER]: Refusing update from remote peer 76255f1b0e964ed586eea61a3c98f5a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:27.651209  3059 consensus_queue.cc:1048] T 5dc00eddee2242c4bbc79dd80a12eaa1 P 76255f1b0e964ed586eea61a3c98f5a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:27.651861  3096 consensus_queue.cc:1048] T 5dc00eddee2242c4bbc79dd80a12eaa1 P 76255f1b0e964ed586eea61a3c98f5a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:27.710480  2863 raft_consensus.cc:1275] T 6b938decaa3e4f66b8d383cce8e8424b P 76255f1b0e964ed586eea61a3c98f5a4 [term 2 FOLLOWER]: Refusing update from remote peer 62a66f0b223a4d798efd4388568410ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:27.711721  3100 consensus_queue.cc:1048] T 6b938decaa3e4f66b8d383cce8e8424b P 62a66f0b223a4d798efd4388568410ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:27.719055  2938 raft_consensus.cc:1275] T 6b938decaa3e4f66b8d383cce8e8424b P e23f23f14d0443dbb402a267fafb37e9 [term 2 FOLLOWER]: Refusing update from remote peer 62a66f0b223a4d798efd4388568410ee: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:27.720446  3102 consensus_queue.cc:1048] T 6b938decaa3e4f66b8d383cce8e8424b P 62a66f0b223a4d798efd4388568410ee [LEADER]: Connected to new peer: Peer: permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:27.808198  3012 raft_consensus.cc:1275] T 048820ced921458e8c9487fb036a75ce P 62a66f0b223a4d798efd4388568410ee [term 2 FOLLOWER]: Refusing update from remote peer 76255f1b0e964ed586eea61a3c98f5a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:27.809800  3059 consensus_queue.cc:1048] T 048820ced921458e8c9487fb036a75ce P 76255f1b0e964ed586eea61a3c98f5a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:27.818318  2938 raft_consensus.cc:1275] T 048820ced921458e8c9487fb036a75ce P e23f23f14d0443dbb402a267fafb37e9 [term 2 FOLLOWER]: Refusing update from remote peer 76255f1b0e964ed586eea61a3c98f5a4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:27.819846  3059 consensus_queue.cc:1048] T 048820ced921458e8c9487fb036a75ce P 76255f1b0e964ed586eea61a3c98f5a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:27.827749  3096 raft_consensus.cc:993] T 048820ced921458e8c9487fb036a75ce P 76255f1b0e964ed586eea61a3c98f5a4: : Instructing follower e23f23f14d0443dbb402a267fafb37e9 to start an election
I20260709 12:27:27.828318  3096 raft_consensus.cc:1081] T 048820ced921458e8c9487fb036a75ce P 76255f1b0e964ed586eea61a3c98f5a4 [term 2 LEADER]: Signalling peer e23f23f14d0443dbb402a267fafb37e9 to start an election
I20260709 12:27:27.830154  2939 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "048820ced921458e8c9487fb036a75ce"
dest_uuid: "e23f23f14d0443dbb402a267fafb37e9"
 from {username='slave'} at 127.0.0.1:46888
I20260709 12:27:27.830760  2939 raft_consensus.cc:493] T 048820ced921458e8c9487fb036a75ce P e23f23f14d0443dbb402a267fafb37e9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:27.831161  2939 raft_consensus.cc:3060] T 048820ced921458e8c9487fb036a75ce P e23f23f14d0443dbb402a267fafb37e9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:27.837229  2939 raft_consensus.cc:515] T 048820ced921458e8c9487fb036a75ce P e23f23f14d0443dbb402a267fafb37e9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } }
I20260709 12:27:27.839221  2939 leader_election.cc:290] T 048820ced921458e8c9487fb036a75ce P e23f23f14d0443dbb402a267fafb37e9 [CANDIDATE]: Term 3 election: Requested vote from peers 76255f1b0e964ed586eea61a3c98f5a4 (127.23.245.129:36903), 62a66f0b223a4d798efd4388568410ee (127.23.245.131:44537)
I20260709 12:27:27.840517  2863 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048820ced921458e8c9487fb036a75ce" candidate_uuid: "e23f23f14d0443dbb402a267fafb37e9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "76255f1b0e964ed586eea61a3c98f5a4"
I20260709 12:27:27.840514  3012 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "048820ced921458e8c9487fb036a75ce" candidate_uuid: "e23f23f14d0443dbb402a267fafb37e9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "62a66f0b223a4d798efd4388568410ee"
I20260709 12:27:27.841276  2863 raft_consensus.cc:3055] T 048820ced921458e8c9487fb036a75ce P 76255f1b0e964ed586eea61a3c98f5a4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:27.841579  3012 raft_consensus.cc:3060] T 048820ced921458e8c9487fb036a75ce P 62a66f0b223a4d798efd4388568410ee [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:27.841642  2863 raft_consensus.cc:740] T 048820ced921458e8c9487fb036a75ce P 76255f1b0e964ed586eea61a3c98f5a4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 76255f1b0e964ed586eea61a3c98f5a4, State: Running, Role: LEADER
I20260709 12:27:27.842901  2863 consensus_queue.cc:260] T 048820ced921458e8c9487fb036a75ce P 76255f1b0e964ed586eea61a3c98f5a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } }
I20260709 12:27:27.844368  2863 raft_consensus.cc:3060] T 048820ced921458e8c9487fb036a75ce P 76255f1b0e964ed586eea61a3c98f5a4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:27.848663  3012 raft_consensus.cc:2468] T 048820ced921458e8c9487fb036a75ce P 62a66f0b223a4d798efd4388568410ee [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e23f23f14d0443dbb402a267fafb37e9 in term 3.
I20260709 12:27:27.850185  2903 leader_election.cc:304] T 048820ced921458e8c9487fb036a75ce P e23f23f14d0443dbb402a267fafb37e9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 62a66f0b223a4d798efd4388568410ee, e23f23f14d0443dbb402a267fafb37e9; no voters: 
I20260709 12:27:27.850940  3067 raft_consensus.cc:2804] T 048820ced921458e8c9487fb036a75ce P e23f23f14d0443dbb402a267fafb37e9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:27.851158  2863 raft_consensus.cc:2468] T 048820ced921458e8c9487fb036a75ce P 76255f1b0e964ed586eea61a3c98f5a4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e23f23f14d0443dbb402a267fafb37e9 in term 3.
I20260709 12:27:27.852034  3067 raft_consensus.cc:697] T 048820ced921458e8c9487fb036a75ce P e23f23f14d0443dbb402a267fafb37e9 [term 3 LEADER]: Becoming Leader. State: Replica: e23f23f14d0443dbb402a267fafb37e9, State: Running, Role: LEADER
I20260709 12:27:27.853246  3067 consensus_queue.cc:237] T 048820ced921458e8c9487fb036a75ce P e23f23f14d0443dbb402a267fafb37e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } }
I20260709 12:27:27.861083  2760 catalog_manager.cc:5697] T 048820ced921458e8c9487fb036a75ce P e23f23f14d0443dbb402a267fafb37e9 reported cstate change: term changed from 2 to 3, leader changed from 76255f1b0e964ed586eea61a3c98f5a4 (127.23.245.129) to e23f23f14d0443dbb402a267fafb37e9 (127.23.245.130). New cstate: current_term: 3 leader_uuid: "e23f23f14d0443dbb402a267fafb37e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76255f1b0e964ed586eea61a3c98f5a4" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 36903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e23f23f14d0443dbb402a267fafb37e9" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "62a66f0b223a4d798efd4388568410ee" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 44537 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:27.994853 24534 tablet_server.cc:179] TabletServer@127.23.245.129:0 shutting down...
I20260709 12:27:28.017997 24534 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:28.018704 24534 tablet_replica.cc:333] T 048820ced921458e8c9487fb036a75ce P 76255f1b0e964ed586eea61a3c98f5a4: stopping tablet replica
I20260709 12:27:28.019304 24534 raft_consensus.cc:2243] T 048820ced921458e8c9487fb036a75ce P 76255f1b0e964ed586eea61a3c98f5a4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:28.019748 24534 raft_consensus.cc:2272] T 048820ced921458e8c9487fb036a75ce P 76255f1b0e964ed586eea61a3c98f5a4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:28.021894 24534 tablet_replica.cc:333] T 5dc00eddee2242c4bbc79dd80a12eaa1 P 76255f1b0e964ed586eea61a3c98f5a4: stopping tablet replica
I20260709 12:27:28.022418 24534 raft_consensus.cc:2243] T 5dc00eddee2242c4bbc79dd80a12eaa1 P 76255f1b0e964ed586eea61a3c98f5a4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:28.023142 24534 raft_consensus.cc:2272] T 5dc00eddee2242c4bbc79dd80a12eaa1 P 76255f1b0e964ed586eea61a3c98f5a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:28.025429 24534 tablet_replica.cc:333] T 65453404455447639f31ecf47b696614 P 76255f1b0e964ed586eea61a3c98f5a4: stopping tablet replica
I20260709 12:27:28.025939 24534 raft_consensus.cc:2243] T 65453404455447639f31ecf47b696614 P 76255f1b0e964ed586eea61a3c98f5a4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:28.026669 24534 raft_consensus.cc:2272] T 65453404455447639f31ecf47b696614 P 76255f1b0e964ed586eea61a3c98f5a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:28.028954 24534 tablet_replica.cc:333] T 6b938decaa3e4f66b8d383cce8e8424b P 76255f1b0e964ed586eea61a3c98f5a4: stopping tablet replica
I20260709 12:27:28.029426 24534 raft_consensus.cc:2243] T 6b938decaa3e4f66b8d383cce8e8424b P 76255f1b0e964ed586eea61a3c98f5a4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:28.029830 24534 raft_consensus.cc:2272] T 6b938decaa3e4f66b8d383cce8e8424b P 76255f1b0e964ed586eea61a3c98f5a4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:28.055370 24534 tablet_server.cc:196] TabletServer@127.23.245.129:0 shutdown complete.
I20260709 12:27:28.067545 24534 tablet_server.cc:179] TabletServer@127.23.245.130:0 shutting down...
I20260709 12:27:28.086794 24534 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:28.087476 24534 tablet_replica.cc:333] T 5dc00eddee2242c4bbc79dd80a12eaa1 P e23f23f14d0443dbb402a267fafb37e9: stopping tablet replica
I20260709 12:27:28.088176 24534 raft_consensus.cc:2243] T 5dc00eddee2242c4bbc79dd80a12eaa1 P e23f23f14d0443dbb402a267fafb37e9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:28.088672 24534 raft_consensus.cc:2272] T 5dc00eddee2242c4bbc79dd80a12eaa1 P e23f23f14d0443dbb402a267fafb37e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:28.090953 24534 tablet_replica.cc:333] T 048820ced921458e8c9487fb036a75ce P e23f23f14d0443dbb402a267fafb37e9: stopping tablet replica
I20260709 12:27:28.091493 24534 raft_consensus.cc:2243] T 048820ced921458e8c9487fb036a75ce P e23f23f14d0443dbb402a267fafb37e9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:28.092175 24534 pending_rounds.cc:70] T 048820ced921458e8c9487fb036a75ce P e23f23f14d0443dbb402a267fafb37e9: Trying to abort 1 pending ops.
I20260709 12:27:28.092334 24534 pending_rounds.cc:77] T 048820ced921458e8c9487fb036a75ce P e23f23f14d0443dbb402a267fafb37e9: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305625796017463296 op_type: NO_OP noop_request { }
I20260709 12:27:28.092648 24534 raft_consensus.cc:2889] T 048820ced921458e8c9487fb036a75ce P e23f23f14d0443dbb402a267fafb37e9 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:27:28.092963 24534 raft_consensus.cc:2272] T 048820ced921458e8c9487fb036a75ce P e23f23f14d0443dbb402a267fafb37e9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:28.095067 24534 tablet_replica.cc:333] T 6b938decaa3e4f66b8d383cce8e8424b P e23f23f14d0443dbb402a267fafb37e9: stopping tablet replica
I20260709 12:27:28.095561 24534 raft_consensus.cc:2243] T 6b938decaa3e4f66b8d383cce8e8424b P e23f23f14d0443dbb402a267fafb37e9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:28.096046 24534 raft_consensus.cc:2272] T 6b938decaa3e4f66b8d383cce8e8424b P e23f23f14d0443dbb402a267fafb37e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:28.098039 24534 tablet_replica.cc:333] T 65453404455447639f31ecf47b696614 P e23f23f14d0443dbb402a267fafb37e9: stopping tablet replica
I20260709 12:27:28.098528 24534 raft_consensus.cc:2243] T 65453404455447639f31ecf47b696614 P e23f23f14d0443dbb402a267fafb37e9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:28.098945 24534 raft_consensus.cc:2272] T 65453404455447639f31ecf47b696614 P e23f23f14d0443dbb402a267fafb37e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:28.122071 24534 tablet_server.cc:196] TabletServer@127.23.245.130:0 shutdown complete.
I20260709 12:27:28.133950 24534 tablet_server.cc:179] TabletServer@127.23.245.131:0 shutting down...
I20260709 12:27:28.151306 24534 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:28.151971 24534 tablet_replica.cc:333] T 5dc00eddee2242c4bbc79dd80a12eaa1 P 62a66f0b223a4d798efd4388568410ee: stopping tablet replica
I20260709 12:27:28.152525 24534 raft_consensus.cc:2243] T 5dc00eddee2242c4bbc79dd80a12eaa1 P 62a66f0b223a4d798efd4388568410ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:28.152932 24534 raft_consensus.cc:2272] T 5dc00eddee2242c4bbc79dd80a12eaa1 P 62a66f0b223a4d798efd4388568410ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:28.155048 24534 tablet_replica.cc:333] T 048820ced921458e8c9487fb036a75ce P 62a66f0b223a4d798efd4388568410ee: stopping tablet replica
I20260709 12:27:28.155529 24534 raft_consensus.cc:2243] T 048820ced921458e8c9487fb036a75ce P 62a66f0b223a4d798efd4388568410ee [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:28.155978 24534 raft_consensus.cc:2272] T 048820ced921458e8c9487fb036a75ce P 62a66f0b223a4d798efd4388568410ee [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:28.157899 24534 tablet_replica.cc:333] T 65453404455447639f31ecf47b696614 P 62a66f0b223a4d798efd4388568410ee: stopping tablet replica
I20260709 12:27:28.158353 24534 raft_consensus.cc:2243] T 65453404455447639f31ecf47b696614 P 62a66f0b223a4d798efd4388568410ee [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:28.158720 24534 raft_consensus.cc:2272] T 65453404455447639f31ecf47b696614 P 62a66f0b223a4d798efd4388568410ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:28.160864 24534 tablet_replica.cc:333] T 6b938decaa3e4f66b8d383cce8e8424b P 62a66f0b223a4d798efd4388568410ee: stopping tablet replica
I20260709 12:27:28.161283 24534 raft_consensus.cc:2243] T 6b938decaa3e4f66b8d383cce8e8424b P 62a66f0b223a4d798efd4388568410ee [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:28.162015 24534 raft_consensus.cc:2272] T 6b938decaa3e4f66b8d383cce8e8424b P 62a66f0b223a4d798efd4388568410ee [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:28.174736 24534 tablet_server.cc:196] TabletServer@127.23.245.131:0 shutdown complete.
I20260709 12:27:28.186313 24534 master.cc:562] Master@127.23.245.190:33079 shutting down...
I20260709 12:27:28.200945 24534 raft_consensus.cc:2243] T 00000000000000000000000000000000 P dd4c0f3fefd44bb68783d2ac2a47493a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:28.201454 24534 raft_consensus.cc:2272] T 00000000000000000000000000000000 P dd4c0f3fefd44bb68783d2ac2a47493a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:28.201716 24534 tablet_replica.cc:333] T 00000000000000000000000000000000 P dd4c0f3fefd44bb68783d2ac2a47493a: stopping tablet replica
I20260709 12:27:28.220171 24534 master.cc:584] Master@127.23.245.190:33079 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2737 ms)
[----------] 6 tests from LeaderRebalancerTest (343799 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 12:27:28.250250 24534 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.23.245.190:43735
I20260709 12:27:28.251343 24534 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:28.256558  3110 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:28.256886  3111 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:28.258190  3113 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:28.259244 24534 server_base.cc:1061] running on GCE node
I20260709 12:27:28.260303 24534 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:28.260478 24534 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:28.260663 24534 hybrid_clock.cc:648] HybridClock initialized: now 1783600048260650 us; error 0 us; skew 500 ppm
I20260709 12:27:28.261264 24534 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:28.263679 24534 webserver.cc:533] Webserver started at http://127.23.245.190:33755/ using document root <none> and password file <none>
I20260709 12:27:28.264375 24534 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:28.264575 24534 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:28.264882 24534 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:28.265965 24534 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599704270295-24534-0/minicluster-data/master-0-root/instance:
uuid: "59c475b718094d42b6d9bca928db8d52"
format_stamp: "Formatted at 2026-07-09 12:27:28 on dist-test-slave-mlt7"
I20260709 12:27:28.270349 24534 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:27:28.273749  3118 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:28.274564 24534 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:27:28.274868 24534 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599704270295-24534-0/minicluster-data/master-0-root
uuid: "59c475b718094d42b6d9bca928db8d52"
format_stamp: "Formatted at 2026-07-09 12:27:28 on dist-test-slave-mlt7"
I20260709 12:27:28.275177 24534 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599704270295-24534-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599704270295-24534-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599704270295-24534-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:28.294324 24534 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:28.295370 24534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:28.330559 24534 rpc_server.cc:307] RPC server started. Bound to: 127.23.245.190:43735
I20260709 12:27:28.330716  3169 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.245.190:43735 every 8 connection(s)
I20260709 12:27:28.334375  3170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:28.345649  3170 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59c475b718094d42b6d9bca928db8d52: Bootstrap starting.
I20260709 12:27:28.350088  3170 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 59c475b718094d42b6d9bca928db8d52: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:28.354163  3170 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59c475b718094d42b6d9bca928db8d52: No bootstrap required, opened a new log
I20260709 12:27:28.356338  3170 raft_consensus.cc:359] T 00000000000000000000000000000000 P 59c475b718094d42b6d9bca928db8d52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59c475b718094d42b6d9bca928db8d52" member_type: VOTER }
I20260709 12:27:28.356731  3170 raft_consensus.cc:385] T 00000000000000000000000000000000 P 59c475b718094d42b6d9bca928db8d52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:28.357016  3170 raft_consensus.cc:740] T 00000000000000000000000000000000 P 59c475b718094d42b6d9bca928db8d52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59c475b718094d42b6d9bca928db8d52, State: Initialized, Role: FOLLOWER
I20260709 12:27:28.357579  3170 consensus_queue.cc:260] T 00000000000000000000000000000000 P 59c475b718094d42b6d9bca928db8d52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59c475b718094d42b6d9bca928db8d52" member_type: VOTER }
I20260709 12:27:28.358042  3170 raft_consensus.cc:399] T 00000000000000000000000000000000 P 59c475b718094d42b6d9bca928db8d52 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:27:28.358246  3170 raft_consensus.cc:493] T 00000000000000000000000000000000 P 59c475b718094d42b6d9bca928db8d52 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:27:28.358546  3170 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 59c475b718094d42b6d9bca928db8d52 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:28.363425  3170 raft_consensus.cc:515] T 00000000000000000000000000000000 P 59c475b718094d42b6d9bca928db8d52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59c475b718094d42b6d9bca928db8d52" member_type: VOTER }
I20260709 12:27:28.363977  3170 leader_election.cc:304] T 00000000000000000000000000000000 P 59c475b718094d42b6d9bca928db8d52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 59c475b718094d42b6d9bca928db8d52; no voters: 
I20260709 12:27:28.365113  3170 leader_election.cc:290] T 00000000000000000000000000000000 P 59c475b718094d42b6d9bca928db8d52 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:27:28.365500  3173 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 59c475b718094d42b6d9bca928db8d52 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:28.367039  3173 raft_consensus.cc:697] T 00000000000000000000000000000000 P 59c475b718094d42b6d9bca928db8d52 [term 1 LEADER]: Becoming Leader. State: Replica: 59c475b718094d42b6d9bca928db8d52, State: Running, Role: LEADER
I20260709 12:27:28.367893  3170 sys_catalog.cc:565] T 00000000000000000000000000000000 P 59c475b718094d42b6d9bca928db8d52 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:27:28.367784  3173 consensus_queue.cc:237] T 00000000000000000000000000000000 P 59c475b718094d42b6d9bca928db8d52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59c475b718094d42b6d9bca928db8d52" member_type: VOTER }
I20260709 12:27:28.371055  3174 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59c475b718094d42b6d9bca928db8d52 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "59c475b718094d42b6d9bca928db8d52" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59c475b718094d42b6d9bca928db8d52" member_type: VOTER } }
I20260709 12:27:28.371055  3175 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59c475b718094d42b6d9bca928db8d52 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 59c475b718094d42b6d9bca928db8d52. Latest consensus state: current_term: 1 leader_uuid: "59c475b718094d42b6d9bca928db8d52" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59c475b718094d42b6d9bca928db8d52" member_type: VOTER } }
I20260709 12:27:28.371825  3174 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59c475b718094d42b6d9bca928db8d52 [sys.catalog]: This master's current role is: LEADER
I20260709 12:27:28.371858  3175 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59c475b718094d42b6d9bca928db8d52 [sys.catalog]: This master's current role is: LEADER
I20260709 12:27:28.376829  3178 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:27:28.382025  3178 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:27:28.386221 24534 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:27:28.391561  3178 catalog_manager.cc:1383] Generated new cluster ID: 28bd724f04f14cd3ba2d9d38a6eb141f
I20260709 12:27:28.391987  3178 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:27:28.407455  3178 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:27:28.408838  3178 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:27:28.450304  3178 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 59c475b718094d42b6d9bca928db8d52: Generated new TSK 0
I20260709 12:27:28.450958  3178 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:27:28.517268 24534 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:28.522873  3191 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:28.524250  3192 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:28.527125 24534 server_base.cc:1061] running on GCE node
W20260709 12:27:28.527144  3194 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:28.528541 24534 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:28.528797 24534 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:28.528971 24534 hybrid_clock.cc:648] HybridClock initialized: now 1783600048528950 us; error 0 us; skew 500 ppm
I20260709 12:27:28.529524 24534 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:28.531893 24534 webserver.cc:533] Webserver started at http://127.23.245.129:39977/ using document root <none> and password file <none>
I20260709 12:27:28.532447 24534 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:28.532657 24534 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:28.532938 24534 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:28.534018 24534 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599704270295-24534-0/minicluster-data/ts-0-root/instance:
uuid: "65bae5463b17443bb0fa568920a9ca19"
format_stamp: "Formatted at 2026-07-09 12:27:28 on dist-test-slave-mlt7"
I20260709 12:27:28.538347 24534 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 12:27:28.541879  3199 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:28.542711 24534 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:27:28.543025 24534 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599704270295-24534-0/minicluster-data/ts-0-root
uuid: "65bae5463b17443bb0fa568920a9ca19"
format_stamp: "Formatted at 2026-07-09 12:27:28 on dist-test-slave-mlt7"
I20260709 12:27:28.543323 24534 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599704270295-24534-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599704270295-24534-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599704270295-24534-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:28.559671 24534 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:28.560972 24534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:28.562569 24534 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:28.565136 24534 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:28.565423 24534 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:28.565714 24534 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:28.565912 24534 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:28.607141 24534 rpc_server.cc:307] RPC server started. Bound to: 127.23.245.129:44391
I20260709 12:27:28.607270  3261 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.245.129:44391 every 8 connection(s)
I20260709 12:27:28.612376 24534 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:28.619748  3266 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:28.622217  3267 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:28.625732  3269 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:28.626511 24534 server_base.cc:1061] running on GCE node
I20260709 12:27:28.627417  3262 heartbeater.cc:344] Connected to a master server at 127.23.245.190:43735
I20260709 12:27:28.627887  3262 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:28.628466 24534 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:28.628780 24534 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:28.628822  3262 heartbeater.cc:507] Master 127.23.245.190:43735 requested a full tablet report, sending...
I20260709 12:27:28.629079 24534 hybrid_clock.cc:648] HybridClock initialized: now 1783600048629058 us; error 0 us; skew 500 ppm
I20260709 12:27:28.629997 24534 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:28.631286  3135 ts_manager.cc:194] Registered new tserver with Master: 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391)
I20260709 12:27:28.632740 24534 webserver.cc:533] Webserver started at http://127.23.245.130:43681/ using document root <none> and password file <none>
I20260709 12:27:28.633280 24534 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:28.633487  3135 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53154
I20260709 12:27:28.633479 24534 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:28.634063 24534 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:28.635484 24534 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599704270295-24534-0/minicluster-data/ts-1-root/instance:
uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3"
format_stamp: "Formatted at 2026-07-09 12:27:28 on dist-test-slave-mlt7"
I20260709 12:27:28.639834 24534 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 12:27:28.643173  3274 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:28.644081 24534 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:27:28.644397 24534 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599704270295-24534-0/minicluster-data/ts-1-root
uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3"
format_stamp: "Formatted at 2026-07-09 12:27:28 on dist-test-slave-mlt7"
I20260709 12:27:28.644752 24534 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599704270295-24534-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599704270295-24534-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599704270295-24534-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:28.662500 24534 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:28.663640 24534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:28.665160 24534 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:28.667484 24534 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:28.667724 24534 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:28.668017 24534 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:28.668195 24534 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:28.706974 24534 rpc_server.cc:307] RPC server started. Bound to: 127.23.245.130:44915
I20260709 12:27:28.707073  3336 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.245.130:44915 every 8 connection(s)
I20260709 12:27:28.711736 24534 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:28.718250  3340 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:28.720049  3341 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:28.722795  3344 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:28.723425  3337 heartbeater.cc:344] Connected to a master server at 127.23.245.190:43735
I20260709 12:27:28.723836  3337 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:28.723865 24534 server_base.cc:1061] running on GCE node
I20260709 12:27:28.724797  3337 heartbeater.cc:507] Master 127.23.245.190:43735 requested a full tablet report, sending...
I20260709 12:27:28.725109 24534 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:28.725415 24534 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:28.725615 24534 hybrid_clock.cc:648] HybridClock initialized: now 1783600048725598 us; error 0 us; skew 500 ppm
I20260709 12:27:28.726312 24534 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:28.727063  3135 ts_manager.cc:194] Registered new tserver with Master: d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915)
I20260709 12:27:28.728878 24534 webserver.cc:533] Webserver started at http://127.23.245.131:34989/ using document root <none> and password file <none>
I20260709 12:27:28.728953  3135 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53162
I20260709 12:27:28.729487 24534 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:28.729765 24534 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:28.730167 24534 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:28.731289 24534 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599704270295-24534-0/minicluster-data/ts-2-root/instance:
uuid: "e260c115ddf045e88e73893d7f8269db"
format_stamp: "Formatted at 2026-07-09 12:27:28 on dist-test-slave-mlt7"
I20260709 12:27:28.735666 24534 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:27:28.739087  3348 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:28.740234 24534 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:27:28.740537 24534 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599704270295-24534-0/minicluster-data/ts-2-root
uuid: "e260c115ddf045e88e73893d7f8269db"
format_stamp: "Formatted at 2026-07-09 12:27:28 on dist-test-slave-mlt7"
I20260709 12:27:28.740836 24534 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599704270295-24534-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599704270295-24534-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599704270295-24534-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:28.753522 24534 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:28.754577 24534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:28.756093 24534 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:28.758261 24534 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:28.758505 24534 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:28.758773 24534 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:28.758955 24534 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:28.798689 24534 rpc_server.cc:307] RPC server started. Bound to: 127.23.245.131:37191
I20260709 12:27:28.798799  3410 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.245.131:37191 every 8 connection(s)
I20260709 12:27:28.815452  3411 heartbeater.cc:344] Connected to a master server at 127.23.245.190:43735
I20260709 12:27:28.816308  3411 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:28.817127  3411 heartbeater.cc:507] Master 127.23.245.190:43735 requested a full tablet report, sending...
I20260709 12:27:28.819306  3135 ts_manager.cc:194] Registered new tserver with Master: e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:28.819754 24534 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017543887s
I20260709 12:27:28.820788  3135 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:53172
I20260709 12:27:28.847133  3135 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53176:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:27:28.849646  3135 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:27:28.929008  3302 tablet_service.cc:1511] Processing CreateTablet for tablet 5d25e61c23044d75a5c8fbdca4c23eb2 (DEFAULT_TABLE table=test-workload [id=9dac6850fab549c49ba10d712d9f4fdc]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:27:28.931321  3300 tablet_service.cc:1511] Processing CreateTablet for tablet bfb3537bcd1e40918b030db5bc35117b (DEFAULT_TABLE table=test-workload [id=9dac6850fab549c49ba10d712d9f4fdc]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:27:28.932893  3300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfb3537bcd1e40918b030db5bc35117b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:28.932814  3301 tablet_service.cc:1511] Processing CreateTablet for tablet 2f808f4193db4e6eba0ea677944df64d (DEFAULT_TABLE table=test-workload [id=9dac6850fab549c49ba10d712d9f4fdc]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:27:28.934022  3302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d25e61c23044d75a5c8fbdca4c23eb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:28.934829  3301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f808f4193db4e6eba0ea677944df64d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:28.936728  3375 tablet_service.cc:1511] Processing CreateTablet for tablet 2f808f4193db4e6eba0ea677944df64d (DEFAULT_TABLE table=test-workload [id=9dac6850fab549c49ba10d712d9f4fdc]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:27:28.936976  3376 tablet_service.cc:1511] Processing CreateTablet for tablet 5d25e61c23044d75a5c8fbdca4c23eb2 (DEFAULT_TABLE table=test-workload [id=9dac6850fab549c49ba10d712d9f4fdc]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:27:28.937703  3227 tablet_service.cc:1511] Processing CreateTablet for tablet 5d25e61c23044d75a5c8fbdca4c23eb2 (DEFAULT_TABLE table=test-workload [id=9dac6850fab549c49ba10d712d9f4fdc]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:27:28.938113  3375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f808f4193db4e6eba0ea677944df64d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:28.939049  3227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d25e61c23044d75a5c8fbdca4c23eb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:28.939180  3225 tablet_service.cc:1511] Processing CreateTablet for tablet bfb3537bcd1e40918b030db5bc35117b (DEFAULT_TABLE table=test-workload [id=9dac6850fab549c49ba10d712d9f4fdc]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:27:28.940480  3225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfb3537bcd1e40918b030db5bc35117b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:28.936976  3226 tablet_service.cc:1511] Processing CreateTablet for tablet 2f808f4193db4e6eba0ea677944df64d (DEFAULT_TABLE table=test-workload [id=9dac6850fab549c49ba10d712d9f4fdc]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:27:28.943288  3226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f808f4193db4e6eba0ea677944df64d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:28.943395  3374 tablet_service.cc:1511] Processing CreateTablet for tablet bfb3537bcd1e40918b030db5bc35117b (DEFAULT_TABLE table=test-workload [id=9dac6850fab549c49ba10d712d9f4fdc]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:27:28.944741  3374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfb3537bcd1e40918b030db5bc35117b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:28.948338  3376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d25e61c23044d75a5c8fbdca4c23eb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:28.965534  3224 tablet_service.cc:1511] Processing CreateTablet for tablet 71b5bc230abf46069a29bb86e6039a15 (DEFAULT_TABLE table=test-workload [id=9dac6850fab549c49ba10d712d9f4fdc]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:27:28.967036  3224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71b5bc230abf46069a29bb86e6039a15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:28.987042  3299 tablet_service.cc:1511] Processing CreateTablet for tablet 71b5bc230abf46069a29bb86e6039a15 (DEFAULT_TABLE table=test-workload [id=9dac6850fab549c49ba10d712d9f4fdc]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:27:28.988869  3427 tablet_bootstrap.cc:492] T 5d25e61c23044d75a5c8fbdca4c23eb2 P 65bae5463b17443bb0fa568920a9ca19: Bootstrap starting.
I20260709 12:27:28.989049  3299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71b5bc230abf46069a29bb86e6039a15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:28.993422  3373 tablet_service.cc:1511] Processing CreateTablet for tablet 71b5bc230abf46069a29bb86e6039a15 (DEFAULT_TABLE table=test-workload [id=9dac6850fab549c49ba10d712d9f4fdc]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:27:28.995219  3373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71b5bc230abf46069a29bb86e6039a15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:29.007717  3427 tablet_bootstrap.cc:654] T 5d25e61c23044d75a5c8fbdca4c23eb2 P 65bae5463b17443bb0fa568920a9ca19: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:29.007364  3298 tablet_service.cc:1511] Processing CreateTablet for tablet 51cd230ca9d6436eafae195975c7b9ce (DEFAULT_TABLE table=test-workload [id=9dac6850fab549c49ba10d712d9f4fdc]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:27:29.014292  3298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51cd230ca9d6436eafae195975c7b9ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:29.011579  3372 tablet_service.cc:1511] Processing CreateTablet for tablet 51cd230ca9d6436eafae195975c7b9ce (DEFAULT_TABLE table=test-workload [id=9dac6850fab549c49ba10d712d9f4fdc]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:27:29.017120  3426 tablet_bootstrap.cc:492] T 2f808f4193db4e6eba0ea677944df64d P d31e1edf8df54dd5a75e9fba6cc0a1f3: Bootstrap starting.
I20260709 12:27:29.017230  3372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51cd230ca9d6436eafae195975c7b9ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:29.018824  3428 tablet_bootstrap.cc:492] T 5d25e61c23044d75a5c8fbdca4c23eb2 P e260c115ddf045e88e73893d7f8269db: Bootstrap starting.
I20260709 12:27:29.023411  3426 tablet_bootstrap.cc:654] T 2f808f4193db4e6eba0ea677944df64d P d31e1edf8df54dd5a75e9fba6cc0a1f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:29.012825  3226 tablet_service.cc:1511] Processing CreateTablet for tablet 51cd230ca9d6436eafae195975c7b9ce (DEFAULT_TABLE table=test-workload [id=9dac6850fab549c49ba10d712d9f4fdc]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:27:29.037135  3226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51cd230ca9d6436eafae195975c7b9ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:29.044150  3224 tablet_service.cc:1511] Processing CreateTablet for tablet 3f0de7c8efd147bcb0dcec69dd1bc2ab (DEFAULT_TABLE table=test-workload [id=9dac6850fab549c49ba10d712d9f4fdc]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:27:29.045677  3224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f0de7c8efd147bcb0dcec69dd1bc2ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:29.046322  3302 tablet_service.cc:1511] Processing CreateTablet for tablet 3f0de7c8efd147bcb0dcec69dd1bc2ab (DEFAULT_TABLE table=test-workload [id=9dac6850fab549c49ba10d712d9f4fdc]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:27:29.047752  3302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f0de7c8efd147bcb0dcec69dd1bc2ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:29.061507  3428 tablet_bootstrap.cc:654] T 5d25e61c23044d75a5c8fbdca4c23eb2 P e260c115ddf045e88e73893d7f8269db: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:29.071614  3375 tablet_service.cc:1511] Processing CreateTablet for tablet 3f0de7c8efd147bcb0dcec69dd1bc2ab (DEFAULT_TABLE table=test-workload [id=9dac6850fab549c49ba10d712d9f4fdc]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:27:29.073686  3375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f0de7c8efd147bcb0dcec69dd1bc2ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:29.074610  3428 tablet_bootstrap.cc:492] T 5d25e61c23044d75a5c8fbdca4c23eb2 P e260c115ddf045e88e73893d7f8269db: No bootstrap required, opened a new log
I20260709 12:27:29.075147  3428 ts_tablet_manager.cc:1403] T 5d25e61c23044d75a5c8fbdca4c23eb2 P e260c115ddf045e88e73893d7f8269db: Time spent bootstrapping tablet: real 0.057s	user 0.008s	sys 0.004s
I20260709 12:27:29.083892  3224 tablet_service.cc:1511] Processing CreateTablet for tablet 42f943816e0640d0af646f248f518df5 (DEFAULT_TABLE table=test-workload [id=9dac6850fab549c49ba10d712d9f4fdc]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:27:29.085256  3224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42f943816e0640d0af646f248f518df5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:29.084556  3300 tablet_service.cc:1511] Processing CreateTablet for tablet 42f943816e0640d0af646f248f518df5 (DEFAULT_TABLE table=test-workload [id=9dac6850fab549c49ba10d712d9f4fdc]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:27:29.086709  3300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42f943816e0640d0af646f248f518df5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:29.079212  3428 raft_consensus.cc:359] T 5d25e61c23044d75a5c8fbdca4c23eb2 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } } peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } }
I20260709 12:27:29.088577  3428 raft_consensus.cc:385] T 5d25e61c23044d75a5c8fbdca4c23eb2 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:29.089314  3428 raft_consensus.cc:740] T 5d25e61c23044d75a5c8fbdca4c23eb2 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e260c115ddf045e88e73893d7f8269db, State: Initialized, Role: FOLLOWER
I20260709 12:27:29.090950  3428 consensus_queue.cc:260] T 5d25e61c23044d75a5c8fbdca4c23eb2 P e260c115ddf045e88e73893d7f8269db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } } peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } }
I20260709 12:27:29.100019  3225 tablet_service.cc:1511] Processing CreateTablet for tablet f05d1ba2ab1744db8f477c06f30a6887 (DEFAULT_TABLE table=test-workload [id=9dac6850fab549c49ba10d712d9f4fdc]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:27:29.101750  3225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f05d1ba2ab1744db8f477c06f30a6887. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:29.103195  3427 tablet_bootstrap.cc:492] T 5d25e61c23044d75a5c8fbdca4c23eb2 P 65bae5463b17443bb0fa568920a9ca19: No bootstrap required, opened a new log
I20260709 12:27:29.103724  3427 ts_tablet_manager.cc:1403] T 5d25e61c23044d75a5c8fbdca4c23eb2 P 65bae5463b17443bb0fa568920a9ca19: Time spent bootstrapping tablet: real 0.115s	user 0.028s	sys 0.021s
I20260709 12:27:29.106176  3302 tablet_service.cc:1511] Processing CreateTablet for tablet f05d1ba2ab1744db8f477c06f30a6887 (DEFAULT_TABLE table=test-workload [id=9dac6850fab549c49ba10d712d9f4fdc]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:27:29.106694  3427 raft_consensus.cc:359] T 5d25e61c23044d75a5c8fbdca4c23eb2 P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } } peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } }
I20260709 12:27:29.109254  3427 raft_consensus.cc:385] T 5d25e61c23044d75a5c8fbdca4c23eb2 P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:29.107632  3302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f05d1ba2ab1744db8f477c06f30a6887. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:29.108562  3227 tablet_service.cc:1511] Processing CreateTablet for tablet 088188cf28674e1c94310faf6d3f7ff4 (DEFAULT_TABLE table=test-workload [id=9dac6850fab549c49ba10d712d9f4fdc]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:27:29.109665  3374 tablet_service.cc:1511] Processing CreateTablet for tablet 088188cf28674e1c94310faf6d3f7ff4 (DEFAULT_TABLE table=test-workload [id=9dac6850fab549c49ba10d712d9f4fdc]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:27:29.109752  3298 tablet_service.cc:1511] Processing CreateTablet for tablet 088188cf28674e1c94310faf6d3f7ff4 (DEFAULT_TABLE table=test-workload [id=9dac6850fab549c49ba10d712d9f4fdc]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:27:29.110597  3227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 088188cf28674e1c94310faf6d3f7ff4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:29.110930  3374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 088188cf28674e1c94310faf6d3f7ff4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:29.109663  3427 raft_consensus.cc:740] T 5d25e61c23044d75a5c8fbdca4c23eb2 P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65bae5463b17443bb0fa568920a9ca19, State: Initialized, Role: FOLLOWER
I20260709 12:27:29.109758  3426 tablet_bootstrap.cc:492] T 2f808f4193db4e6eba0ea677944df64d P d31e1edf8df54dd5a75e9fba6cc0a1f3: No bootstrap required, opened a new log
I20260709 12:27:29.098043  3373 tablet_service.cc:1511] Processing CreateTablet for tablet 42f943816e0640d0af646f248f518df5 (DEFAULT_TABLE table=test-workload [id=9dac6850fab549c49ba10d712d9f4fdc]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:27:29.117120  3298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 088188cf28674e1c94310faf6d3f7ff4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:29.117372  3426 ts_tablet_manager.cc:1403] T 2f808f4193db4e6eba0ea677944df64d P d31e1edf8df54dd5a75e9fba6cc0a1f3: Time spent bootstrapping tablet: real 0.100s	user 0.032s	sys 0.033s
I20260709 12:27:29.114569  3427 consensus_queue.cc:260] T 5d25e61c23044d75a5c8fbdca4c23eb2 P 65bae5463b17443bb0fa568920a9ca19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } } peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } }
I20260709 12:27:29.118494  3372 tablet_service.cc:1511] Processing CreateTablet for tablet f05d1ba2ab1744db8f477c06f30a6887 (DEFAULT_TABLE table=test-workload [id=9dac6850fab549c49ba10d712d9f4fdc]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:27:29.127736  3426 raft_consensus.cc:359] T 2f808f4193db4e6eba0ea677944df64d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.128564  3426 raft_consensus.cc:385] T 2f808f4193db4e6eba0ea677944df64d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:29.128849  3426 raft_consensus.cc:740] T 2f808f4193db4e6eba0ea677944df64d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d31e1edf8df54dd5a75e9fba6cc0a1f3, State: Initialized, Role: FOLLOWER
I20260709 12:27:29.129597  3426 consensus_queue.cc:260] T 2f808f4193db4e6eba0ea677944df64d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.117430  3373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42f943816e0640d0af646f248f518df5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:29.139281  3372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f05d1ba2ab1744db8f477c06f30a6887. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:29.145123  3428 ts_tablet_manager.cc:1434] T 5d25e61c23044d75a5c8fbdca4c23eb2 P e260c115ddf045e88e73893d7f8269db: Time spent starting tablet: real 0.070s	user 0.009s	sys 0.005s
I20260709 12:27:29.146054  3411 heartbeater.cc:499] Master 127.23.245.190:43735 was elected leader, sending a full tablet report...
I20260709 12:27:29.146427  3428 tablet_bootstrap.cc:492] T bfb3537bcd1e40918b030db5bc35117b P e260c115ddf045e88e73893d7f8269db: Bootstrap starting.
I20260709 12:27:29.157029  3432 raft_consensus.cc:493] T 5d25e61c23044d75a5c8fbdca4c23eb2 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:29.158444  3432 raft_consensus.cc:515] T 5d25e61c23044d75a5c8fbdca4c23eb2 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } } peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } }
I20260709 12:27:29.168963  3262 heartbeater.cc:499] Master 127.23.245.190:43735 was elected leader, sending a full tablet report...
I20260709 12:27:29.174814  3312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d25e61c23044d75a5c8fbdca4c23eb2" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" is_pre_election: true
W20260709 12:27:29.176570  3351 leader_election.cc:343] T 5d25e61c23044d75a5c8fbdca4c23eb2 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:29.176590  3427 ts_tablet_manager.cc:1434] T 5d25e61c23044d75a5c8fbdca4c23eb2 P 65bae5463b17443bb0fa568920a9ca19: Time spent starting tablet: real 0.073s	user 0.007s	sys 0.016s
I20260709 12:27:29.178375  3427 tablet_bootstrap.cc:492] T 2f808f4193db4e6eba0ea677944df64d P 65bae5463b17443bb0fa568920a9ca19: Bootstrap starting.
I20260709 12:27:29.183624  3337 heartbeater.cc:499] Master 127.23.245.190:43735 was elected leader, sending a full tablet report...
I20260709 12:27:29.185256  3432 leader_election.cc:290] T 5d25e61c23044d75a5c8fbdca4c23eb2 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915), 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391)
I20260709 12:27:29.186251  3427 tablet_bootstrap.cc:654] T 2f808f4193db4e6eba0ea677944df64d P 65bae5463b17443bb0fa568920a9ca19: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:29.188530  3426 ts_tablet_manager.cc:1434] T 2f808f4193db4e6eba0ea677944df64d P d31e1edf8df54dd5a75e9fba6cc0a1f3: Time spent starting tablet: real 0.064s	user 0.005s	sys 0.005s
I20260709 12:27:29.189800  3426 tablet_bootstrap.cc:492] T 5d25e61c23044d75a5c8fbdca4c23eb2 P d31e1edf8df54dd5a75e9fba6cc0a1f3: Bootstrap starting.
I20260709 12:27:29.159497  3428 tablet_bootstrap.cc:654] T bfb3537bcd1e40918b030db5bc35117b P e260c115ddf045e88e73893d7f8269db: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:29.199860  3427 tablet_bootstrap.cc:492] T 2f808f4193db4e6eba0ea677944df64d P 65bae5463b17443bb0fa568920a9ca19: No bootstrap required, opened a new log
I20260709 12:27:29.200444  3427 ts_tablet_manager.cc:1403] T 2f808f4193db4e6eba0ea677944df64d P 65bae5463b17443bb0fa568920a9ca19: Time spent bootstrapping tablet: real 0.022s	user 0.006s	sys 0.006s
I20260709 12:27:29.203264  3427 raft_consensus.cc:359] T 2f808f4193db4e6eba0ea677944df64d P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.204003  3427 raft_consensus.cc:385] T 2f808f4193db4e6eba0ea677944df64d P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:29.204308  3427 raft_consensus.cc:740] T 2f808f4193db4e6eba0ea677944df64d P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65bae5463b17443bb0fa568920a9ca19, State: Initialized, Role: FOLLOWER
I20260709 12:27:29.206878  3237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d25e61c23044d75a5c8fbdca4c23eb2" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19" is_pre_election: true
I20260709 12:27:29.207608  3428 tablet_bootstrap.cc:492] T bfb3537bcd1e40918b030db5bc35117b P e260c115ddf045e88e73893d7f8269db: No bootstrap required, opened a new log
I20260709 12:27:29.207676  3237 raft_consensus.cc:2468] T 5d25e61c23044d75a5c8fbdca4c23eb2 P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e260c115ddf045e88e73893d7f8269db in term 0.
I20260709 12:27:29.208221  3428 ts_tablet_manager.cc:1403] T bfb3537bcd1e40918b030db5bc35117b P e260c115ddf045e88e73893d7f8269db: Time spent bootstrapping tablet: real 0.062s	user 0.011s	sys 0.010s
I20260709 12:27:29.209292  3351 leader_election.cc:304] T 5d25e61c23044d75a5c8fbdca4c23eb2 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, e260c115ddf045e88e73893d7f8269db; no voters: d31e1edf8df54dd5a75e9fba6cc0a1f3
I20260709 12:27:29.209830  3426 tablet_bootstrap.cc:654] T 5d25e61c23044d75a5c8fbdca4c23eb2 P d31e1edf8df54dd5a75e9fba6cc0a1f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:29.210331  3435 raft_consensus.cc:2804] T 5d25e61c23044d75a5c8fbdca4c23eb2 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:29.210727  3435 raft_consensus.cc:493] T 5d25e61c23044d75a5c8fbdca4c23eb2 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:29.211086  3435 raft_consensus.cc:3060] T 5d25e61c23044d75a5c8fbdca4c23eb2 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:29.211127  3428 raft_consensus.cc:359] T bfb3537bcd1e40918b030db5bc35117b P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.212042  3428 raft_consensus.cc:385] T bfb3537bcd1e40918b030db5bc35117b P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:29.212366  3428 raft_consensus.cc:740] T bfb3537bcd1e40918b030db5bc35117b P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e260c115ddf045e88e73893d7f8269db, State: Initialized, Role: FOLLOWER
I20260709 12:27:29.213269  3428 consensus_queue.cc:260] T bfb3537bcd1e40918b030db5bc35117b P e260c115ddf045e88e73893d7f8269db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.215699  3428 ts_tablet_manager.cc:1434] T bfb3537bcd1e40918b030db5bc35117b P e260c115ddf045e88e73893d7f8269db: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:27:29.216740  3428 tablet_bootstrap.cc:492] T 2f808f4193db4e6eba0ea677944df64d P e260c115ddf045e88e73893d7f8269db: Bootstrap starting.
I20260709 12:27:29.220928  3427 consensus_queue.cc:260] T 2f808f4193db4e6eba0ea677944df64d P 65bae5463b17443bb0fa568920a9ca19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.223351  3427 ts_tablet_manager.cc:1434] T 2f808f4193db4e6eba0ea677944df64d P 65bae5463b17443bb0fa568920a9ca19: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.000s
I20260709 12:27:29.226106  3435 raft_consensus.cc:515] T 5d25e61c23044d75a5c8fbdca4c23eb2 P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } } peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } }
I20260709 12:27:29.229931  3428 tablet_bootstrap.cc:654] T 2f808f4193db4e6eba0ea677944df64d P e260c115ddf045e88e73893d7f8269db: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:29.233458  3312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d25e61c23044d75a5c8fbdca4c23eb2" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3"
W20260709 12:27:29.235468  3351 leader_election.cc:343] T 5d25e61c23044d75a5c8fbdca4c23eb2 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:29.239140  3237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d25e61c23044d75a5c8fbdca4c23eb2" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19"
I20260709 12:27:29.239940  3237 raft_consensus.cc:3060] T 5d25e61c23044d75a5c8fbdca4c23eb2 P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:29.243052  3427 tablet_bootstrap.cc:492] T 71b5bc230abf46069a29bb86e6039a15 P 65bae5463b17443bb0fa568920a9ca19: Bootstrap starting.
I20260709 12:27:29.251382  3237 raft_consensus.cc:2468] T 5d25e61c23044d75a5c8fbdca4c23eb2 P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e260c115ddf045e88e73893d7f8269db in term 1.
I20260709 12:27:29.252190  3435 leader_election.cc:290] T 5d25e61c23044d75a5c8fbdca4c23eb2 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 1 election: Requested vote from peers d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915), 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391)
I20260709 12:27:29.252502  3427 tablet_bootstrap.cc:654] T 71b5bc230abf46069a29bb86e6039a15 P 65bae5463b17443bb0fa568920a9ca19: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:29.254225  3351 leader_election.cc:304] T 5d25e61c23044d75a5c8fbdca4c23eb2 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, e260c115ddf045e88e73893d7f8269db; no voters: d31e1edf8df54dd5a75e9fba6cc0a1f3
I20260709 12:27:29.255528  3435 raft_consensus.cc:2804] T 5d25e61c23044d75a5c8fbdca4c23eb2 P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:29.256955  3426 tablet_bootstrap.cc:492] T 5d25e61c23044d75a5c8fbdca4c23eb2 P d31e1edf8df54dd5a75e9fba6cc0a1f3: No bootstrap required, opened a new log
I20260709 12:27:29.257257  3435 raft_consensus.cc:697] T 5d25e61c23044d75a5c8fbdca4c23eb2 P e260c115ddf045e88e73893d7f8269db [term 1 LEADER]: Becoming Leader. State: Replica: e260c115ddf045e88e73893d7f8269db, State: Running, Role: LEADER
I20260709 12:27:29.257665  3426 ts_tablet_manager.cc:1403] T 5d25e61c23044d75a5c8fbdca4c23eb2 P d31e1edf8df54dd5a75e9fba6cc0a1f3: Time spent bootstrapping tablet: real 0.068s	user 0.030s	sys 0.019s
I20260709 12:27:29.258733  3428 tablet_bootstrap.cc:492] T 2f808f4193db4e6eba0ea677944df64d P e260c115ddf045e88e73893d7f8269db: No bootstrap required, opened a new log
I20260709 12:27:29.258718  3435 consensus_queue.cc:237] T 5d25e61c23044d75a5c8fbdca4c23eb2 P e260c115ddf045e88e73893d7f8269db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } } peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } }
I20260709 12:27:29.259862  3428 ts_tablet_manager.cc:1403] T 2f808f4193db4e6eba0ea677944df64d P e260c115ddf045e88e73893d7f8269db: Time spent bootstrapping tablet: real 0.043s	user 0.026s	sys 0.009s
I20260709 12:27:29.260941  3426 raft_consensus.cc:359] T 5d25e61c23044d75a5c8fbdca4c23eb2 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } } peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } }
I20260709 12:27:29.261529  3427 tablet_bootstrap.cc:492] T 71b5bc230abf46069a29bb86e6039a15 P 65bae5463b17443bb0fa568920a9ca19: No bootstrap required, opened a new log
I20260709 12:27:29.261827  3426 raft_consensus.cc:385] T 5d25e61c23044d75a5c8fbdca4c23eb2 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:29.262161  3427 ts_tablet_manager.cc:1403] T 71b5bc230abf46069a29bb86e6039a15 P 65bae5463b17443bb0fa568920a9ca19: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.006s
I20260709 12:27:29.262249  3426 raft_consensus.cc:740] T 5d25e61c23044d75a5c8fbdca4c23eb2 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d31e1edf8df54dd5a75e9fba6cc0a1f3, State: Initialized, Role: FOLLOWER
I20260709 12:27:29.263226  3426 consensus_queue.cc:260] T 5d25e61c23044d75a5c8fbdca4c23eb2 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } } peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } }
I20260709 12:27:29.263080  3428 raft_consensus.cc:359] T 2f808f4193db4e6eba0ea677944df64d P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.264362  3428 raft_consensus.cc:385] T 2f808f4193db4e6eba0ea677944df64d P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:29.264770  3428 raft_consensus.cc:740] T 2f808f4193db4e6eba0ea677944df64d P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e260c115ddf045e88e73893d7f8269db, State: Initialized, Role: FOLLOWER
I20260709 12:27:29.265204  3427 raft_consensus.cc:359] T 71b5bc230abf46069a29bb86e6039a15 P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.265986  3427 raft_consensus.cc:385] T 71b5bc230abf46069a29bb86e6039a15 P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:29.266324  3427 raft_consensus.cc:740] T 71b5bc230abf46069a29bb86e6039a15 P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65bae5463b17443bb0fa568920a9ca19, State: Initialized, Role: FOLLOWER
I20260709 12:27:29.265688  3428 consensus_queue.cc:260] T 2f808f4193db4e6eba0ea677944df64d P e260c115ddf045e88e73893d7f8269db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.267153  3427 consensus_queue.cc:260] T 71b5bc230abf46069a29bb86e6039a15 P 65bae5463b17443bb0fa568920a9ca19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.269538  3427 ts_tablet_manager.cc:1434] T 71b5bc230abf46069a29bb86e6039a15 P 65bae5463b17443bb0fa568920a9ca19: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:27:29.271209  3426 ts_tablet_manager.cc:1434] T 5d25e61c23044d75a5c8fbdca4c23eb2 P d31e1edf8df54dd5a75e9fba6cc0a1f3: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:27:29.272257  3428 ts_tablet_manager.cc:1434] T 2f808f4193db4e6eba0ea677944df64d P e260c115ddf045e88e73893d7f8269db: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:27:29.273583  3428 tablet_bootstrap.cc:492] T 71b5bc230abf46069a29bb86e6039a15 P e260c115ddf045e88e73893d7f8269db: Bootstrap starting.
I20260709 12:27:29.277033  3427 tablet_bootstrap.cc:492] T bfb3537bcd1e40918b030db5bc35117b P 65bae5463b17443bb0fa568920a9ca19: Bootstrap starting.
I20260709 12:27:29.279637  3428 tablet_bootstrap.cc:654] T 71b5bc230abf46069a29bb86e6039a15 P e260c115ddf045e88e73893d7f8269db: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:29.272401  3426 tablet_bootstrap.cc:492] T bfb3537bcd1e40918b030db5bc35117b P d31e1edf8df54dd5a75e9fba6cc0a1f3: Bootstrap starting.
I20260709 12:27:29.285931  3426 tablet_bootstrap.cc:654] T bfb3537bcd1e40918b030db5bc35117b P d31e1edf8df54dd5a75e9fba6cc0a1f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:29.285930  3427 tablet_bootstrap.cc:654] T bfb3537bcd1e40918b030db5bc35117b P 65bae5463b17443bb0fa568920a9ca19: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:29.287214  3132 catalog_manager.cc:5697] T 5d25e61c23044d75a5c8fbdca4c23eb2 P e260c115ddf045e88e73893d7f8269db reported cstate change: term changed from 0 to 1, leader changed from <none> to e260c115ddf045e88e73893d7f8269db (127.23.245.131). New cstate: current_term: 1 leader_uuid: "e260c115ddf045e88e73893d7f8269db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:29.292933  3428 tablet_bootstrap.cc:492] T 71b5bc230abf46069a29bb86e6039a15 P e260c115ddf045e88e73893d7f8269db: No bootstrap required, opened a new log
I20260709 12:27:29.293284  3427 tablet_bootstrap.cc:492] T bfb3537bcd1e40918b030db5bc35117b P 65bae5463b17443bb0fa568920a9ca19: No bootstrap required, opened a new log
I20260709 12:27:29.293674  3428 ts_tablet_manager.cc:1403] T 71b5bc230abf46069a29bb86e6039a15 P e260c115ddf045e88e73893d7f8269db: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.006s
I20260709 12:27:29.294250  3426 tablet_bootstrap.cc:492] T bfb3537bcd1e40918b030db5bc35117b P d31e1edf8df54dd5a75e9fba6cc0a1f3: No bootstrap required, opened a new log
I20260709 12:27:29.294750  3426 ts_tablet_manager.cc:1403] T bfb3537bcd1e40918b030db5bc35117b P d31e1edf8df54dd5a75e9fba6cc0a1f3: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.000s
I20260709 12:27:29.293764  3427 ts_tablet_manager.cc:1403] T bfb3537bcd1e40918b030db5bc35117b P 65bae5463b17443bb0fa568920a9ca19: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.001s
I20260709 12:27:29.296857  3428 raft_consensus.cc:359] T 71b5bc230abf46069a29bb86e6039a15 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.297654  3428 raft_consensus.cc:385] T 71b5bc230abf46069a29bb86e6039a15 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:29.297418  3426 raft_consensus.cc:359] T bfb3537bcd1e40918b030db5bc35117b P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.298022  3428 raft_consensus.cc:740] T 71b5bc230abf46069a29bb86e6039a15 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e260c115ddf045e88e73893d7f8269db, State: Initialized, Role: FOLLOWER
I20260709 12:27:29.298280  3426 raft_consensus.cc:385] T bfb3537bcd1e40918b030db5bc35117b P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:29.297986  3427 raft_consensus.cc:359] T bfb3537bcd1e40918b030db5bc35117b P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.298817  3426 raft_consensus.cc:740] T bfb3537bcd1e40918b030db5bc35117b P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d31e1edf8df54dd5a75e9fba6cc0a1f3, State: Initialized, Role: FOLLOWER
I20260709 12:27:29.298938  3427 raft_consensus.cc:385] T bfb3537bcd1e40918b030db5bc35117b P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:29.299378  3427 raft_consensus.cc:740] T bfb3537bcd1e40918b030db5bc35117b P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65bae5463b17443bb0fa568920a9ca19, State: Initialized, Role: FOLLOWER
I20260709 12:27:29.299204  3428 consensus_queue.cc:260] T 71b5bc230abf46069a29bb86e6039a15 P e260c115ddf045e88e73893d7f8269db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.299799  3426 consensus_queue.cc:260] T bfb3537bcd1e40918b030db5bc35117b P d31e1edf8df54dd5a75e9fba6cc0a1f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.300305  3427 consensus_queue.cc:260] T bfb3537bcd1e40918b030db5bc35117b P 65bae5463b17443bb0fa568920a9ca19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.301915  3428 ts_tablet_manager.cc:1434] T 71b5bc230abf46069a29bb86e6039a15 P e260c115ddf045e88e73893d7f8269db: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:27:29.302933  3428 tablet_bootstrap.cc:492] T 51cd230ca9d6436eafae195975c7b9ce P e260c115ddf045e88e73893d7f8269db: Bootstrap starting.
I20260709 12:27:29.306381  3426 ts_tablet_manager.cc:1434] T bfb3537bcd1e40918b030db5bc35117b P d31e1edf8df54dd5a75e9fba6cc0a1f3: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:27:29.307436  3426 tablet_bootstrap.cc:492] T 71b5bc230abf46069a29bb86e6039a15 P d31e1edf8df54dd5a75e9fba6cc0a1f3: Bootstrap starting.
I20260709 12:27:29.309080  3428 tablet_bootstrap.cc:654] T 51cd230ca9d6436eafae195975c7b9ce P e260c115ddf045e88e73893d7f8269db: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:29.313841  3426 tablet_bootstrap.cc:654] T 71b5bc230abf46069a29bb86e6039a15 P d31e1edf8df54dd5a75e9fba6cc0a1f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:29.318548  3427 ts_tablet_manager.cc:1434] T bfb3537bcd1e40918b030db5bc35117b P 65bae5463b17443bb0fa568920a9ca19: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.000s
I20260709 12:27:29.319792  3427 tablet_bootstrap.cc:492] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19: Bootstrap starting.
I20260709 12:27:29.321187  3428 tablet_bootstrap.cc:492] T 51cd230ca9d6436eafae195975c7b9ce P e260c115ddf045e88e73893d7f8269db: No bootstrap required, opened a new log
I20260709 12:27:29.321735  3428 ts_tablet_manager.cc:1403] T 51cd230ca9d6436eafae195975c7b9ce P e260c115ddf045e88e73893d7f8269db: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 12:27:29.324783  3428 raft_consensus.cc:359] T 51cd230ca9d6436eafae195975c7b9ce P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.325511  3428 raft_consensus.cc:385] T 51cd230ca9d6436eafae195975c7b9ce P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:29.325802  3428 raft_consensus.cc:740] T 51cd230ca9d6436eafae195975c7b9ce P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e260c115ddf045e88e73893d7f8269db, State: Initialized, Role: FOLLOWER
I20260709 12:27:29.326436  3427 tablet_bootstrap.cc:654] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:29.326756  3428 consensus_queue.cc:260] T 51cd230ca9d6436eafae195975c7b9ce P e260c115ddf045e88e73893d7f8269db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.330753  3426 tablet_bootstrap.cc:492] T 71b5bc230abf46069a29bb86e6039a15 P d31e1edf8df54dd5a75e9fba6cc0a1f3: No bootstrap required, opened a new log
I20260709 12:27:29.331311  3426 ts_tablet_manager.cc:1403] T 71b5bc230abf46069a29bb86e6039a15 P d31e1edf8df54dd5a75e9fba6cc0a1f3: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.011s
I20260709 12:27:29.332433  3433 raft_consensus.cc:493] T bfb3537bcd1e40918b030db5bc35117b P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:29.332939  3433 raft_consensus.cc:515] T bfb3537bcd1e40918b030db5bc35117b P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.334448  3428 ts_tablet_manager.cc:1434] T 51cd230ca9d6436eafae195975c7b9ce P e260c115ddf045e88e73893d7f8269db: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:27:29.334364  3426 raft_consensus.cc:359] T 71b5bc230abf46069a29bb86e6039a15 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.335219  3426 raft_consensus.cc:385] T 71b5bc230abf46069a29bb86e6039a15 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:29.335539  3426 raft_consensus.cc:740] T 71b5bc230abf46069a29bb86e6039a15 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d31e1edf8df54dd5a75e9fba6cc0a1f3, State: Initialized, Role: FOLLOWER
I20260709 12:27:29.335785  3428 tablet_bootstrap.cc:492] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P e260c115ddf045e88e73893d7f8269db: Bootstrap starting.
I20260709 12:27:29.336331  3426 consensus_queue.cc:260] T 71b5bc230abf46069a29bb86e6039a15 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.338956  3426 ts_tablet_manager.cc:1434] T 71b5bc230abf46069a29bb86e6039a15 P d31e1edf8df54dd5a75e9fba6cc0a1f3: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:27:29.340212  3426 tablet_bootstrap.cc:492] T 51cd230ca9d6436eafae195975c7b9ce P d31e1edf8df54dd5a75e9fba6cc0a1f3: Bootstrap starting.
I20260709 12:27:29.343080  3428 tablet_bootstrap.cc:654] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P e260c115ddf045e88e73893d7f8269db: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:29.347203  3433 leader_election.cc:290] T bfb3537bcd1e40918b030db5bc35117b P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:29.348057  3426 tablet_bootstrap.cc:654] T 51cd230ca9d6436eafae195975c7b9ce P d31e1edf8df54dd5a75e9fba6cc0a1f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:29.368350  3427 tablet_bootstrap.cc:492] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19: No bootstrap required, opened a new log
I20260709 12:27:29.372196  3386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3537bcd1e40918b030db5bc35117b" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db" is_pre_election: true
I20260709 12:27:29.369024  3427 ts_tablet_manager.cc:1403] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19: Time spent bootstrapping tablet: real 0.050s	user 0.011s	sys 0.003s
I20260709 12:27:29.373136  3386 raft_consensus.cc:2468] T bfb3537bcd1e40918b030db5bc35117b P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65bae5463b17443bb0fa568920a9ca19 in term 0.
I20260709 12:27:29.373611  3312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3537bcd1e40918b030db5bc35117b" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" is_pre_election: true
I20260709 12:27:29.374300  3312 raft_consensus.cc:2468] T bfb3537bcd1e40918b030db5bc35117b P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65bae5463b17443bb0fa568920a9ca19 in term 0.
I20260709 12:27:29.375221  3200 leader_election.cc:304] T bfb3537bcd1e40918b030db5bc35117b P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, e260c115ddf045e88e73893d7f8269db; no voters: 
I20260709 12:27:29.376588  3433 raft_consensus.cc:2804] T bfb3537bcd1e40918b030db5bc35117b P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:29.376431  3427 raft_consensus.cc:359] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.377197  3433 raft_consensus.cc:493] T bfb3537bcd1e40918b030db5bc35117b P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:29.377429  3427 raft_consensus.cc:385] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:29.377508  3428 tablet_bootstrap.cc:492] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P e260c115ddf045e88e73893d7f8269db: No bootstrap required, opened a new log
I20260709 12:27:29.377720  3433 raft_consensus.cc:3060] T bfb3537bcd1e40918b030db5bc35117b P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:29.378298  3428 ts_tablet_manager.cc:1403] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P e260c115ddf045e88e73893d7f8269db: Time spent bootstrapping tablet: real 0.043s	user 0.024s	sys 0.012s
I20260709 12:27:29.378118  3427 raft_consensus.cc:740] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65bae5463b17443bb0fa568920a9ca19, State: Initialized, Role: FOLLOWER
I20260709 12:27:29.379359  3427 consensus_queue.cc:260] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
W20260709 12:27:29.382050  3183 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:29.383421  3426 tablet_bootstrap.cc:492] T 51cd230ca9d6436eafae195975c7b9ce P d31e1edf8df54dd5a75e9fba6cc0a1f3: No bootstrap required, opened a new log
I20260709 12:27:29.383993  3426 ts_tablet_manager.cc:1403] T 51cd230ca9d6436eafae195975c7b9ce P d31e1edf8df54dd5a75e9fba6cc0a1f3: Time spent bootstrapping tablet: real 0.044s	user 0.016s	sys 0.024s
I20260709 12:27:29.385667  3428 raft_consensus.cc:359] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.386570  3428 raft_consensus.cc:385] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:29.386945  3428 raft_consensus.cc:740] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e260c115ddf045e88e73893d7f8269db, State: Initialized, Role: FOLLOWER
I20260709 12:27:29.386806  3433 raft_consensus.cc:515] T bfb3537bcd1e40918b030db5bc35117b P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.386931  3426 raft_consensus.cc:359] T 51cd230ca9d6436eafae195975c7b9ce P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.387856  3426 raft_consensus.cc:385] T 51cd230ca9d6436eafae195975c7b9ce P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:29.388175  3426 raft_consensus.cc:740] T 51cd230ca9d6436eafae195975c7b9ce P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d31e1edf8df54dd5a75e9fba6cc0a1f3, State: Initialized, Role: FOLLOWER
I20260709 12:27:29.388700  3427 ts_tablet_manager.cc:1434] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.004s
I20260709 12:27:29.388178  3428 consensus_queue.cc:260] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P e260c115ddf045e88e73893d7f8269db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.389093  3426 consensus_queue.cc:260] T 51cd230ca9d6436eafae195975c7b9ce P d31e1edf8df54dd5a75e9fba6cc0a1f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.390203  3312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3537bcd1e40918b030db5bc35117b" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3"
I20260709 12:27:29.390656  3428 ts_tablet_manager.cc:1434] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P e260c115ddf045e88e73893d7f8269db: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:27:29.390770  3312 raft_consensus.cc:3060] T bfb3537bcd1e40918b030db5bc35117b P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:29.391646  3426 ts_tablet_manager.cc:1434] T 51cd230ca9d6436eafae195975c7b9ce P d31e1edf8df54dd5a75e9fba6cc0a1f3: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:27:29.391809  3428 tablet_bootstrap.cc:492] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db: Bootstrap starting.
I20260709 12:27:29.392590  3427 tablet_bootstrap.cc:492] T 51cd230ca9d6436eafae195975c7b9ce P 65bae5463b17443bb0fa568920a9ca19: Bootstrap starting.
I20260709 12:27:29.398523  3428 tablet_bootstrap.cc:654] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:29.392671  3426 tablet_bootstrap.cc:492] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3: Bootstrap starting.
I20260709 12:27:29.403124  3427 tablet_bootstrap.cc:654] T 51cd230ca9d6436eafae195975c7b9ce P 65bae5463b17443bb0fa568920a9ca19: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:29.406549  3426 tablet_bootstrap.cc:654] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:29.414795  3427 tablet_bootstrap.cc:492] T 51cd230ca9d6436eafae195975c7b9ce P 65bae5463b17443bb0fa568920a9ca19: No bootstrap required, opened a new log
I20260709 12:27:29.415304  3427 ts_tablet_manager.cc:1403] T 51cd230ca9d6436eafae195975c7b9ce P 65bae5463b17443bb0fa568920a9ca19: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.007s
I20260709 12:27:29.415767  3312 raft_consensus.cc:2468] T bfb3537bcd1e40918b030db5bc35117b P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65bae5463b17443bb0fa568920a9ca19 in term 1.
I20260709 12:27:29.417168  3202 leader_election.cc:304] T bfb3537bcd1e40918b030db5bc35117b P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, d31e1edf8df54dd5a75e9fba6cc0a1f3; no voters: 
I20260709 12:27:29.417634  3433 leader_election.cc:290] T bfb3537bcd1e40918b030db5bc35117b P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 1 election: Requested vote from peers d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:29.418215  3433 raft_consensus.cc:2804] T bfb3537bcd1e40918b030db5bc35117b P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:29.418699  3433 raft_consensus.cc:697] T bfb3537bcd1e40918b030db5bc35117b P 65bae5463b17443bb0fa568920a9ca19 [term 1 LEADER]: Becoming Leader. State: Replica: 65bae5463b17443bb0fa568920a9ca19, State: Running, Role: LEADER
I20260709 12:27:29.418743  3386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3537bcd1e40918b030db5bc35117b" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db"
I20260709 12:27:29.419381  3386 raft_consensus.cc:3060] T bfb3537bcd1e40918b030db5bc35117b P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:29.419622  3433 consensus_queue.cc:237] T bfb3537bcd1e40918b030db5bc35117b P 65bae5463b17443bb0fa568920a9ca19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.423373  3434 raft_consensus.cc:493] T 51cd230ca9d6436eafae195975c7b9ce P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:29.424037  3434 raft_consensus.cc:515] T 51cd230ca9d6436eafae195975c7b9ce P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.425902  3452 raft_consensus.cc:493] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:29.426522  3452 raft_consensus.cc:515] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.436233  3452 leader_election.cc:290] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:29.437340  3312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f0de7c8efd147bcb0dcec69dd1bc2ab" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" is_pre_election: true
I20260709 12:27:29.439224  3385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f0de7c8efd147bcb0dcec69dd1bc2ab" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db" is_pre_election: true
I20260709 12:27:29.439934  3385 raft_consensus.cc:2468] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65bae5463b17443bb0fa568920a9ca19 in term 0.
I20260709 12:27:29.440551  3386 raft_consensus.cc:2468] T bfb3537bcd1e40918b030db5bc35117b P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65bae5463b17443bb0fa568920a9ca19 in term 1.
I20260709 12:27:29.441505  3200 leader_election.cc:304] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, e260c115ddf045e88e73893d7f8269db; no voters: 
I20260709 12:27:29.442196  3434 leader_election.cc:290] T 51cd230ca9d6436eafae195975c7b9ce P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:29.448392  3452 raft_consensus.cc:2804] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:27:29.454684  3202 leader_election.cc:343] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:29.455857  3452 raft_consensus.cc:493] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:29.458719  3452 raft_consensus.cc:3060] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:29.459134  3426 tablet_bootstrap.cc:492] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3: No bootstrap required, opened a new log
I20260709 12:27:29.459700  3426 ts_tablet_manager.cc:1403] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3: Time spent bootstrapping tablet: real 0.067s	user 0.024s	sys 0.026s
I20260709 12:27:29.462692  3426 raft_consensus.cc:359] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.463421  3426 raft_consensus.cc:385] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:29.463717  3426 raft_consensus.cc:740] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d31e1edf8df54dd5a75e9fba6cc0a1f3, State: Initialized, Role: FOLLOWER
I20260709 12:27:29.468035  3452 raft_consensus.cc:515] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.470440  3428 tablet_bootstrap.cc:492] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db: No bootstrap required, opened a new log
I20260709 12:27:29.471289  3428 ts_tablet_manager.cc:1403] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db: Time spent bootstrapping tablet: real 0.080s	user 0.025s	sys 0.023s
I20260709 12:27:29.470422  3134 catalog_manager.cc:5697] T bfb3537bcd1e40918b030db5bc35117b P 65bae5463b17443bb0fa568920a9ca19 reported cstate change: term changed from 0 to 1, leader changed from <none> to 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129). New cstate: current_term: 1 leader_uuid: "65bae5463b17443bb0fa568920a9ca19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:29.457261  3427 raft_consensus.cc:359] T 51cd230ca9d6436eafae195975c7b9ce P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.473587  3237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51cd230ca9d6436eafae195975c7b9ce" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19" is_pre_election: true
I20260709 12:27:29.473893  3427 raft_consensus.cc:385] T 51cd230ca9d6436eafae195975c7b9ce P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:29.475704  3427 raft_consensus.cc:740] T 51cd230ca9d6436eafae195975c7b9ce P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65bae5463b17443bb0fa568920a9ca19, State: Initialized, Role: FOLLOWER
I20260709 12:27:29.475528  3426 consensus_queue.cc:260] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.477977  3386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51cd230ca9d6436eafae195975c7b9ce" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db" is_pre_election: true
I20260709 12:27:29.476624  3427 consensus_queue.cc:260] T 51cd230ca9d6436eafae195975c7b9ce P 65bae5463b17443bb0fa568920a9ca19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.478654  3426 ts_tablet_manager.cc:1434] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.002s
I20260709 12:27:29.478696  3386 raft_consensus.cc:2468] T 51cd230ca9d6436eafae195975c7b9ce P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d31e1edf8df54dd5a75e9fba6cc0a1f3 in term 0.
I20260709 12:27:29.478956  3237 raft_consensus.cc:2468] T 51cd230ca9d6436eafae195975c7b9ce P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d31e1edf8df54dd5a75e9fba6cc0a1f3 in term 0.
I20260709 12:27:29.479892  3426 tablet_bootstrap.cc:492] T 42f943816e0640d0af646f248f518df5 P d31e1edf8df54dd5a75e9fba6cc0a1f3: Bootstrap starting.
I20260709 12:27:29.480448  3275 leader_election.cc:304] T 51cd230ca9d6436eafae195975c7b9ce P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d31e1edf8df54dd5a75e9fba6cc0a1f3, e260c115ddf045e88e73893d7f8269db; no voters: 
I20260709 12:27:29.481350  3434 raft_consensus.cc:2804] T 51cd230ca9d6436eafae195975c7b9ce P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:29.481721  3434 raft_consensus.cc:493] T 51cd230ca9d6436eafae195975c7b9ce P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:29.482048  3434 raft_consensus.cc:3060] T 51cd230ca9d6436eafae195975c7b9ce P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:29.482291  3427 ts_tablet_manager.cc:1434] T 51cd230ca9d6436eafae195975c7b9ce P 65bae5463b17443bb0fa568920a9ca19: Time spent starting tablet: real 0.067s	user 0.008s	sys 0.001s
I20260709 12:27:29.482754  3428 raft_consensus.cc:359] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.483268  3427 tablet_bootstrap.cc:492] T f05d1ba2ab1744db8f477c06f30a6887 P 65bae5463b17443bb0fa568920a9ca19: Bootstrap starting.
I20260709 12:27:29.486593  3428 raft_consensus.cc:385] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:29.485848  3312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f0de7c8efd147bcb0dcec69dd1bc2ab" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3"
I20260709 12:27:29.487027  3428 raft_consensus.cc:740] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e260c115ddf045e88e73893d7f8269db, State: Initialized, Role: FOLLOWER
I20260709 12:27:29.487227  3312 raft_consensus.cc:3060] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:29.487901  3452 leader_election.cc:290] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 1 election: Requested vote from peers d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:29.488548  3428 consensus_queue.cc:260] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.489768  3434 raft_consensus.cc:515] T 51cd230ca9d6436eafae195975c7b9ce P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.492503  3237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51cd230ca9d6436eafae195975c7b9ce" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19"
I20260709 12:27:29.493075  3237 raft_consensus.cc:3060] T 51cd230ca9d6436eafae195975c7b9ce P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:29.493268  3427 tablet_bootstrap.cc:654] T f05d1ba2ab1744db8f477c06f30a6887 P 65bae5463b17443bb0fa568920a9ca19: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:29.493911  3428 ts_tablet_manager.cc:1434] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260709 12:27:29.495048  3428 tablet_bootstrap.cc:492] T 42f943816e0640d0af646f248f518df5 P e260c115ddf045e88e73893d7f8269db: Bootstrap starting.
I20260709 12:27:29.501032  3237 raft_consensus.cc:2468] T 51cd230ca9d6436eafae195975c7b9ce P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d31e1edf8df54dd5a75e9fba6cc0a1f3 in term 1.
I20260709 12:27:29.501343  3428 tablet_bootstrap.cc:654] T 42f943816e0640d0af646f248f518df5 P e260c115ddf045e88e73893d7f8269db: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:29.502465  3277 leader_election.cc:304] T 51cd230ca9d6436eafae195975c7b9ce P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, d31e1edf8df54dd5a75e9fba6cc0a1f3; no voters: 
I20260709 12:27:29.485983  3386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f0de7c8efd147bcb0dcec69dd1bc2ab" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db"
I20260709 12:27:29.504433  3386 raft_consensus.cc:3060] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:29.505569  3460 raft_consensus.cc:2804] T 51cd230ca9d6436eafae195975c7b9ce P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:29.508963  3434 leader_election.cc:290] T 51cd230ca9d6436eafae195975c7b9ce P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 1 election: Requested vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:29.510126  3385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51cd230ca9d6436eafae195975c7b9ce" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db"
I20260709 12:27:29.510771  3385 raft_consensus.cc:3060] T 51cd230ca9d6436eafae195975c7b9ce P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:29.511893  3426 tablet_bootstrap.cc:654] T 42f943816e0640d0af646f248f518df5 P d31e1edf8df54dd5a75e9fba6cc0a1f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:29.521214  3435 raft_consensus.cc:493] T 71b5bc230abf46069a29bb86e6039a15 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:29.521847  3435 raft_consensus.cc:515] T 71b5bc230abf46069a29bb86e6039a15 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.524716  3435 leader_election.cc:290] T 71b5bc230abf46069a29bb86e6039a15 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915)
I20260709 12:27:29.520512  3385 raft_consensus.cc:2468] T 51cd230ca9d6436eafae195975c7b9ce P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d31e1edf8df54dd5a75e9fba6cc0a1f3 in term 1.
I20260709 12:27:29.527519  3237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b5bc230abf46069a29bb86e6039a15" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19" is_pre_election: true
I20260709 12:27:29.527284  3311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b5bc230abf46069a29bb86e6039a15" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" is_pre_election: true
I20260709 12:27:29.528229  3237 raft_consensus.cc:2468] T 71b5bc230abf46069a29bb86e6039a15 P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e260c115ddf045e88e73893d7f8269db in term 0.
I20260709 12:27:29.528502  3311 raft_consensus.cc:2468] T 71b5bc230abf46069a29bb86e6039a15 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e260c115ddf045e88e73893d7f8269db in term 0.
I20260709 12:27:29.530679  3351 leader_election.cc:304] T 71b5bc230abf46069a29bb86e6039a15 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d31e1edf8df54dd5a75e9fba6cc0a1f3, e260c115ddf045e88e73893d7f8269db; no voters: 
I20260709 12:27:29.532505  3435 raft_consensus.cc:2804] T 71b5bc230abf46069a29bb86e6039a15 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:29.533053  3435 raft_consensus.cc:493] T 71b5bc230abf46069a29bb86e6039a15 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:29.533537  3435 raft_consensus.cc:3060] T 71b5bc230abf46069a29bb86e6039a15 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:29.537890  3386 raft_consensus.cc:2468] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65bae5463b17443bb0fa568920a9ca19 in term 1.
I20260709 12:27:29.542165  3200 leader_election.cc:304] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, e260c115ddf045e88e73893d7f8269db; no voters: 
I20260709 12:27:29.540431  3312 raft_consensus.cc:2468] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65bae5463b17443bb0fa568920a9ca19 in term 1.
I20260709 12:27:29.543278  3452 raft_consensus.cc:2804] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:29.544334  3452 raft_consensus.cc:697] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19 [term 1 LEADER]: Becoming Leader. State: Replica: 65bae5463b17443bb0fa568920a9ca19, State: Running, Role: LEADER
I20260709 12:27:29.545444  3452 consensus_queue.cc:237] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.550912  3427 tablet_bootstrap.cc:492] T f05d1ba2ab1744db8f477c06f30a6887 P 65bae5463b17443bb0fa568920a9ca19: No bootstrap required, opened a new log
I20260709 12:27:29.551563  3427 ts_tablet_manager.cc:1403] T f05d1ba2ab1744db8f477c06f30a6887 P 65bae5463b17443bb0fa568920a9ca19: Time spent bootstrapping tablet: real 0.068s	user 0.035s	sys 0.027s
I20260709 12:27:29.553170  3435 raft_consensus.cc:515] T 71b5bc230abf46069a29bb86e6039a15 P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.556026  3460 raft_consensus.cc:697] T 51cd230ca9d6436eafae195975c7b9ce P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 LEADER]: Becoming Leader. State: Replica: d31e1edf8df54dd5a75e9fba6cc0a1f3, State: Running, Role: LEADER
I20260709 12:27:29.557989  3435 leader_election.cc:290] T 71b5bc230abf46069a29bb86e6039a15 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 1 election: Requested vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915)
I20260709 12:27:29.558990  3433 raft_consensus.cc:493] T 2f808f4193db4e6eba0ea677944df64d P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:29.559325  3435 raft_consensus.cc:493] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:29.560292  3435 raft_consensus.cc:515] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.561127  3237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b5bc230abf46069a29bb86e6039a15" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19"
I20260709 12:27:29.561964  3237 raft_consensus.cc:3060] T 71b5bc230abf46069a29bb86e6039a15 P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:29.554630  3427 raft_consensus.cc:359] T f05d1ba2ab1744db8f477c06f30a6887 P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.555608  3428 tablet_bootstrap.cc:492] T 42f943816e0640d0af646f248f518df5 P e260c115ddf045e88e73893d7f8269db: No bootstrap required, opened a new log
I20260709 12:27:29.564250  3428 ts_tablet_manager.cc:1403] T 42f943816e0640d0af646f248f518df5 P e260c115ddf045e88e73893d7f8269db: Time spent bootstrapping tablet: real 0.069s	user 0.014s	sys 0.000s
I20260709 12:27:29.564261  3435 leader_election.cc:290] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915)
I20260709 12:27:29.567423  3428 raft_consensus.cc:359] T 42f943816e0640d0af646f248f518df5 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.568485  3428 raft_consensus.cc:385] T 42f943816e0640d0af646f248f518df5 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:29.568790  3428 raft_consensus.cc:740] T 42f943816e0640d0af646f248f518df5 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e260c115ddf045e88e73893d7f8269db, State: Initialized, Role: FOLLOWER
I20260709 12:27:29.568816  3433 raft_consensus.cc:515] T 2f808f4193db4e6eba0ea677944df64d P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.568933  3312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b5bc230abf46069a29bb86e6039a15" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3"
I20260709 12:27:29.569759  3428 consensus_queue.cc:260] T 42f943816e0640d0af646f248f518df5 P e260c115ddf045e88e73893d7f8269db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.570274  3312 raft_consensus.cc:3060] T 71b5bc230abf46069a29bb86e6039a15 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:29.571991  3428 ts_tablet_manager.cc:1434] T 42f943816e0640d0af646f248f518df5 P e260c115ddf045e88e73893d7f8269db: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:27:29.574074  3236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "088188cf28674e1c94310faf6d3f7ff4" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19" is_pre_election: true
I20260709 12:27:29.575331  3428 tablet_bootstrap.cc:492] T f05d1ba2ab1744db8f477c06f30a6887 P e260c115ddf045e88e73893d7f8269db: Bootstrap starting.
I20260709 12:27:29.576040  3427 raft_consensus.cc:385] T f05d1ba2ab1744db8f477c06f30a6887 P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:29.576382  3427 raft_consensus.cc:740] T f05d1ba2ab1744db8f477c06f30a6887 P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65bae5463b17443bb0fa568920a9ca19, State: Initialized, Role: FOLLOWER
I20260709 12:27:29.577522  3311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "088188cf28674e1c94310faf6d3f7ff4" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" is_pre_election: true
I20260709 12:27:29.577803  3427 consensus_queue.cc:260] T f05d1ba2ab1744db8f477c06f30a6887 P 65bae5463b17443bb0fa568920a9ca19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.580092  3460 consensus_queue.cc:237] T 51cd230ca9d6436eafae195975c7b9ce P d31e1edf8df54dd5a75e9fba6cc0a1f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.589416  3433 leader_election.cc:290] T 2f808f4193db4e6eba0ea677944df64d P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:29.590793  3386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f808f4193db4e6eba0ea677944df64d" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db" is_pre_election: true
I20260709 12:27:29.591548  3386 raft_consensus.cc:2468] T 2f808f4193db4e6eba0ea677944df64d P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65bae5463b17443bb0fa568920a9ca19 in term 0.
I20260709 12:27:29.592324  3237 raft_consensus.cc:2468] T 71b5bc230abf46069a29bb86e6039a15 P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e260c115ddf045e88e73893d7f8269db in term 1.
I20260709 12:27:29.595347  3462 raft_consensus.cc:493] T 2f808f4193db4e6eba0ea677944df64d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:29.596053  3462 raft_consensus.cc:515] T 2f808f4193db4e6eba0ea677944df64d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.599809  3237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f808f4193db4e6eba0ea677944df64d" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19" is_pre_election: true
I20260709 12:27:29.600469  3237 raft_consensus.cc:2468] T 2f808f4193db4e6eba0ea677944df64d P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d31e1edf8df54dd5a75e9fba6cc0a1f3 in term 0.
I20260709 12:27:29.600937  3200 leader_election.cc:304] T 2f808f4193db4e6eba0ea677944df64d P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, e260c115ddf045e88e73893d7f8269db; no voters: 
I20260709 12:27:29.601543  3277 leader_election.cc:304] T 2f808f4193db4e6eba0ea677944df64d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, d31e1edf8df54dd5a75e9fba6cc0a1f3; no voters: 
I20260709 12:27:29.601890  3462 leader_election.cc:290] T 2f808f4193db4e6eba0ea677944df64d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:29.602497  3434 raft_consensus.cc:2804] T 2f808f4193db4e6eba0ea677944df64d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:29.589341  3311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f808f4193db4e6eba0ea677944df64d" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" is_pre_election: true
W20260709 12:27:29.581418  3351 leader_election.cc:343] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:29.603804  3386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f808f4193db4e6eba0ea677944df64d" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db" is_pre_election: true
W20260709 12:27:29.604864  3351 leader_election.cc:343] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:29.605330  3351 leader_election.cc:304] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e260c115ddf045e88e73893d7f8269db; no voters: 65bae5463b17443bb0fa568920a9ca19, d31e1edf8df54dd5a75e9fba6cc0a1f3
I20260709 12:27:29.605432  3386 raft_consensus.cc:2468] T 2f808f4193db4e6eba0ea677944df64d P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d31e1edf8df54dd5a75e9fba6cc0a1f3 in term 0.
I20260709 12:27:29.606528  3351 leader_election.cc:304] T 71b5bc230abf46069a29bb86e6039a15 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, e260c115ddf045e88e73893d7f8269db; no voters: 
I20260709 12:27:29.603180  3433 raft_consensus.cc:2804] T 2f808f4193db4e6eba0ea677944df64d P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:29.607599  3433 raft_consensus.cc:493] T 2f808f4193db4e6eba0ea677944df64d P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:29.607999  3433 raft_consensus.cc:3060] T 2f808f4193db4e6eba0ea677944df64d P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:29.608695  3312 raft_consensus.cc:2468] T 71b5bc230abf46069a29bb86e6039a15 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e260c115ddf045e88e73893d7f8269db in term 1.
I20260709 12:27:29.612082  3435 raft_consensus.cc:2749] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:29.612859  3435 raft_consensus.cc:2804] T 71b5bc230abf46069a29bb86e6039a15 P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:29.613322  3435 raft_consensus.cc:697] T 71b5bc230abf46069a29bb86e6039a15 P e260c115ddf045e88e73893d7f8269db [term 1 LEADER]: Becoming Leader. State: Replica: e260c115ddf045e88e73893d7f8269db, State: Running, Role: LEADER
I20260709 12:27:29.614583  3428 tablet_bootstrap.cc:654] T f05d1ba2ab1744db8f477c06f30a6887 P e260c115ddf045e88e73893d7f8269db: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:29.614183  3435 consensus_queue.cc:237] T 71b5bc230abf46069a29bb86e6039a15 P e260c115ddf045e88e73893d7f8269db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.615414  3426 tablet_bootstrap.cc:492] T 42f943816e0640d0af646f248f518df5 P d31e1edf8df54dd5a75e9fba6cc0a1f3: No bootstrap required, opened a new log
I20260709 12:27:29.616040  3426 ts_tablet_manager.cc:1403] T 42f943816e0640d0af646f248f518df5 P d31e1edf8df54dd5a75e9fba6cc0a1f3: Time spent bootstrapping tablet: real 0.136s	user 0.041s	sys 0.060s
I20260709 12:27:29.602942  3434 raft_consensus.cc:493] T 2f808f4193db4e6eba0ea677944df64d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:29.617388  3434 raft_consensus.cc:3060] T 2f808f4193db4e6eba0ea677944df64d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:29.619257  3134 catalog_manager.cc:5697] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19 reported cstate change: term changed from 0 to 1, leader changed from <none> to 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129). New cstate: current_term: 1 leader_uuid: "65bae5463b17443bb0fa568920a9ca19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:29.619871  3426 raft_consensus.cc:359] T 42f943816e0640d0af646f248f518df5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.623425  3426 raft_consensus.cc:385] T 42f943816e0640d0af646f248f518df5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:29.623934  3426 raft_consensus.cc:740] T 42f943816e0640d0af646f248f518df5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d31e1edf8df54dd5a75e9fba6cc0a1f3, State: Initialized, Role: FOLLOWER
I20260709 12:27:29.625008  3426 consensus_queue.cc:260] T 42f943816e0640d0af646f248f518df5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.629683  3426 ts_tablet_manager.cc:1434] T 42f943816e0640d0af646f248f518df5 P d31e1edf8df54dd5a75e9fba6cc0a1f3: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 12:27:29.631103  3426 tablet_bootstrap.cc:492] T f05d1ba2ab1744db8f477c06f30a6887 P d31e1edf8df54dd5a75e9fba6cc0a1f3: Bootstrap starting.
I20260709 12:27:29.633373  3433 raft_consensus.cc:515] T 2f808f4193db4e6eba0ea677944df64d P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.638228  3434 raft_consensus.cc:515] T 2f808f4193db4e6eba0ea677944df64d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.640650  3312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f808f4193db4e6eba0ea677944df64d" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3"
I20260709 12:27:29.643198  3426 tablet_bootstrap.cc:654] T f05d1ba2ab1744db8f477c06f30a6887 P d31e1edf8df54dd5a75e9fba6cc0a1f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:29.643803  3427 ts_tablet_manager.cc:1434] T f05d1ba2ab1744db8f477c06f30a6887 P 65bae5463b17443bb0fa568920a9ca19: Time spent starting tablet: real 0.092s	user 0.012s	sys 0.028s
I20260709 12:27:29.645148  3427 tablet_bootstrap.cc:492] T 088188cf28674e1c94310faf6d3f7ff4 P 65bae5463b17443bb0fa568920a9ca19: Bootstrap starting.
I20260709 12:27:29.651472  3428 tablet_bootstrap.cc:492] T f05d1ba2ab1744db8f477c06f30a6887 P e260c115ddf045e88e73893d7f8269db: No bootstrap required, opened a new log
I20260709 12:27:29.653194  3427 tablet_bootstrap.cc:654] T 088188cf28674e1c94310faf6d3f7ff4 P 65bae5463b17443bb0fa568920a9ca19: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:29.654110  3311 raft_consensus.cc:2393] T 2f808f4193db4e6eba0ea677944df64d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65bae5463b17443bb0fa568920a9ca19 in current term 1: Already voted for candidate d31e1edf8df54dd5a75e9fba6cc0a1f3 in this term.
I20260709 12:27:29.655114  3426 tablet_bootstrap.cc:492] T f05d1ba2ab1744db8f477c06f30a6887 P d31e1edf8df54dd5a75e9fba6cc0a1f3: No bootstrap required, opened a new log
I20260709 12:27:29.655660  3426 ts_tablet_manager.cc:1403] T f05d1ba2ab1744db8f477c06f30a6887 P d31e1edf8df54dd5a75e9fba6cc0a1f3: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.007s
I20260709 12:27:29.654959  3134 catalog_manager.cc:5697] T 71b5bc230abf46069a29bb86e6039a15 P e260c115ddf045e88e73893d7f8269db reported cstate change: term changed from 0 to 1, leader changed from <none> to e260c115ddf045e88e73893d7f8269db (127.23.245.131). New cstate: current_term: 1 leader_uuid: "e260c115ddf045e88e73893d7f8269db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:29.659672  3386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f808f4193db4e6eba0ea677944df64d" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db"
I20260709 12:27:29.659431  3426 raft_consensus.cc:359] T f05d1ba2ab1744db8f477c06f30a6887 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.660351  3386 raft_consensus.cc:3060] T 2f808f4193db4e6eba0ea677944df64d P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:29.661921  3433 leader_election.cc:290] T 2f808f4193db4e6eba0ea677944df64d P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 1 election: Requested vote from peers d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:29.662150  3385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f808f4193db4e6eba0ea677944df64d" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db"
I20260709 12:27:29.662827  3434 leader_election.cc:290] T 2f808f4193db4e6eba0ea677944df64d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 1 election: Requested vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:29.663429  3237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f808f4193db4e6eba0ea677944df64d" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19"
I20260709 12:27:29.664222  3237 raft_consensus.cc:2393] T 2f808f4193db4e6eba0ea677944df64d P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d31e1edf8df54dd5a75e9fba6cc0a1f3 in current term 1: Already voted for candidate 65bae5463b17443bb0fa568920a9ca19 in this term.
I20260709 12:27:29.665331  3277 leader_election.cc:304] T 2f808f4193db4e6eba0ea677944df64d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d31e1edf8df54dd5a75e9fba6cc0a1f3; no voters: 65bae5463b17443bb0fa568920a9ca19, e260c115ddf045e88e73893d7f8269db
I20260709 12:27:29.666718  3427 tablet_bootstrap.cc:492] T 088188cf28674e1c94310faf6d3f7ff4 P 65bae5463b17443bb0fa568920a9ca19: No bootstrap required, opened a new log
I20260709 12:27:29.666476  3434 raft_consensus.cc:2749] T 2f808f4193db4e6eba0ea677944df64d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:27:29.667274  3427 ts_tablet_manager.cc:1403] T 088188cf28674e1c94310faf6d3f7ff4 P 65bae5463b17443bb0fa568920a9ca19: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.010s
I20260709 12:27:29.668215  3428 ts_tablet_manager.cc:1403] T f05d1ba2ab1744db8f477c06f30a6887 P e260c115ddf045e88e73893d7f8269db: Time spent bootstrapping tablet: real 0.093s	user 0.012s	sys 0.002s
I20260709 12:27:29.669020  3386 raft_consensus.cc:2468] T 2f808f4193db4e6eba0ea677944df64d P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65bae5463b17443bb0fa568920a9ca19 in term 1.
I20260709 12:27:29.669574  3426 raft_consensus.cc:385] T f05d1ba2ab1744db8f477c06f30a6887 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:29.669993  3426 raft_consensus.cc:740] T f05d1ba2ab1744db8f477c06f30a6887 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d31e1edf8df54dd5a75e9fba6cc0a1f3, State: Initialized, Role: FOLLOWER
I20260709 12:27:29.670363  3427 raft_consensus.cc:359] T 088188cf28674e1c94310faf6d3f7ff4 P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.670680  3200 leader_election.cc:304] T 2f808f4193db4e6eba0ea677944df64d P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, e260c115ddf045e88e73893d7f8269db; no voters: d31e1edf8df54dd5a75e9fba6cc0a1f3
I20260709 12:27:29.671084  3427 raft_consensus.cc:385] T 088188cf28674e1c94310faf6d3f7ff4 P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:29.670794  3426 consensus_queue.cc:260] T f05d1ba2ab1744db8f477c06f30a6887 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.671381  3427 raft_consensus.cc:740] T 088188cf28674e1c94310faf6d3f7ff4 P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65bae5463b17443bb0fa568920a9ca19, State: Initialized, Role: FOLLOWER
I20260709 12:27:29.671960  3433 raft_consensus.cc:2804] T 2f808f4193db4e6eba0ea677944df64d P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:29.672318  3427 consensus_queue.cc:260] T 088188cf28674e1c94310faf6d3f7ff4 P 65bae5463b17443bb0fa568920a9ca19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.672969  3426 ts_tablet_manager.cc:1434] T f05d1ba2ab1744db8f477c06f30a6887 P d31e1edf8df54dd5a75e9fba6cc0a1f3: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 12:27:29.673545  3433 raft_consensus.cc:697] T 2f808f4193db4e6eba0ea677944df64d P 65bae5463b17443bb0fa568920a9ca19 [term 1 LEADER]: Becoming Leader. State: Replica: 65bae5463b17443bb0fa568920a9ca19, State: Running, Role: LEADER
I20260709 12:27:29.674010  3426 tablet_bootstrap.cc:492] T 088188cf28674e1c94310faf6d3f7ff4 P d31e1edf8df54dd5a75e9fba6cc0a1f3: Bootstrap starting.
I20260709 12:27:29.674345  3427 ts_tablet_manager.cc:1434] T 088188cf28674e1c94310faf6d3f7ff4 P 65bae5463b17443bb0fa568920a9ca19: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:27:29.674867  3435 raft_consensus.cc:493] T 42f943816e0640d0af646f248f518df5 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:29.674732  3433 consensus_queue.cc:237] T 2f808f4193db4e6eba0ea677944df64d P 65bae5463b17443bb0fa568920a9ca19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.675311  3427 tablet_bootstrap.cc:492] T 42f943816e0640d0af646f248f518df5 P 65bae5463b17443bb0fa568920a9ca19: Bootstrap starting.
I20260709 12:27:29.675366  3435 raft_consensus.cc:515] T 42f943816e0640d0af646f248f518df5 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.678445  3237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f943816e0640d0af646f248f518df5" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19" is_pre_election: true
I20260709 12:27:29.679194  3311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f943816e0640d0af646f248f518df5" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" is_pre_election: true
I20260709 12:27:29.679705  3435 leader_election.cc:290] T 42f943816e0640d0af646f248f518df5 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915)
I20260709 12:27:29.680308  3311 raft_consensus.cc:2468] T 42f943816e0640d0af646f248f518df5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e260c115ddf045e88e73893d7f8269db in term 0.
I20260709 12:27:29.681600  3351 leader_election.cc:304] T 42f943816e0640d0af646f248f518df5 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d31e1edf8df54dd5a75e9fba6cc0a1f3, e260c115ddf045e88e73893d7f8269db; no voters: 
I20260709 12:27:29.681878  3427 tablet_bootstrap.cc:654] T 42f943816e0640d0af646f248f518df5 P 65bae5463b17443bb0fa568920a9ca19: Neither blocks nor log segments found. Creating new log.
W20260709 12:27:29.682585  3351 leader_election.cc:343] T 42f943816e0640d0af646f248f518df5 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:29.683463  3435 raft_consensus.cc:2804] T 42f943816e0640d0af646f248f518df5 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:29.683866  3435 raft_consensus.cc:493] T 42f943816e0640d0af646f248f518df5 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:29.684239  3435 raft_consensus.cc:3060] T 42f943816e0640d0af646f248f518df5 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:29.685140  3426 tablet_bootstrap.cc:654] T 088188cf28674e1c94310faf6d3f7ff4 P d31e1edf8df54dd5a75e9fba6cc0a1f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:29.681125  3134 catalog_manager.cc:5697] T 51cd230ca9d6436eafae195975c7b9ce P d31e1edf8df54dd5a75e9fba6cc0a1f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130). New cstate: current_term: 1 leader_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:29.691207  3132 catalog_manager.cc:5697] T 2f808f4193db4e6eba0ea677944df64d P 65bae5463b17443bb0fa568920a9ca19 reported cstate change: term changed from 0 to 1, leader changed from <none> to 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129). New cstate: current_term: 1 leader_uuid: "65bae5463b17443bb0fa568920a9ca19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:29.670871  3428 raft_consensus.cc:359] T f05d1ba2ab1744db8f477c06f30a6887 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.692624  3428 raft_consensus.cc:385] T f05d1ba2ab1744db8f477c06f30a6887 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:29.693018  3428 raft_consensus.cc:740] T f05d1ba2ab1744db8f477c06f30a6887 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e260c115ddf045e88e73893d7f8269db, State: Initialized, Role: FOLLOWER
I20260709 12:27:29.694096  3428 consensus_queue.cc:260] T f05d1ba2ab1744db8f477c06f30a6887 P e260c115ddf045e88e73893d7f8269db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.705976  3460 raft_consensus.cc:493] T f05d1ba2ab1744db8f477c06f30a6887 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:29.706617  3460 raft_consensus.cc:515] T f05d1ba2ab1744db8f477c06f30a6887 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.708814  3428 ts_tablet_manager.cc:1434] T f05d1ba2ab1744db8f477c06f30a6887 P e260c115ddf045e88e73893d7f8269db: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.002s
I20260709 12:27:29.710744  3432 consensus_queue.cc:1048] T 5d25e61c23044d75a5c8fbdca4c23eb2 P e260c115ddf045e88e73893d7f8269db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:29.713615  3435 raft_consensus.cc:515] T 42f943816e0640d0af646f248f518df5 P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.715802  3435 leader_election.cc:290] T 42f943816e0640d0af646f248f518df5 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 1 election: Requested vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915)
I20260709 12:27:29.718075  3460 leader_election.cc:290] T f05d1ba2ab1744db8f477c06f30a6887 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:29.718819  3235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05d1ba2ab1744db8f477c06f30a6887" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19" is_pre_election: true
I20260709 12:27:29.716514  3236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f943816e0640d0af646f248f518df5" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19"
I20260709 12:27:29.720384  3235 raft_consensus.cc:2468] T f05d1ba2ab1744db8f477c06f30a6887 P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d31e1edf8df54dd5a75e9fba6cc0a1f3 in term 0.
I20260709 12:27:29.721623  3277 leader_election.cc:304] T f05d1ba2ab1744db8f477c06f30a6887 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, d31e1edf8df54dd5a75e9fba6cc0a1f3; no voters: 
I20260709 12:27:29.719178  3386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05d1ba2ab1744db8f477c06f30a6887" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db" is_pre_election: true
I20260709 12:27:29.722565  3386 raft_consensus.cc:2468] T f05d1ba2ab1744db8f477c06f30a6887 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d31e1edf8df54dd5a75e9fba6cc0a1f3 in term 0.
I20260709 12:27:29.722608  3311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f943816e0640d0af646f248f518df5" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3"
W20260709 12:27:29.723125  3351 leader_election.cc:343] T 42f943816e0640d0af646f248f518df5 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:29.723491  3311 raft_consensus.cc:3060] T 42f943816e0640d0af646f248f518df5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:29.727397  3426 tablet_bootstrap.cc:492] T 088188cf28674e1c94310faf6d3f7ff4 P d31e1edf8df54dd5a75e9fba6cc0a1f3: No bootstrap required, opened a new log
I20260709 12:27:29.727947  3426 ts_tablet_manager.cc:1403] T 088188cf28674e1c94310faf6d3f7ff4 P d31e1edf8df54dd5a75e9fba6cc0a1f3: Time spent bootstrapping tablet: real 0.054s	user 0.026s	sys 0.012s
I20260709 12:27:29.728266  3427 tablet_bootstrap.cc:492] T 42f943816e0640d0af646f248f518df5 P 65bae5463b17443bb0fa568920a9ca19: No bootstrap required, opened a new log
I20260709 12:27:29.728770  3427 ts_tablet_manager.cc:1403] T 42f943816e0640d0af646f248f518df5 P 65bae5463b17443bb0fa568920a9ca19: Time spent bootstrapping tablet: real 0.054s	user 0.014s	sys 0.001s
I20260709 12:27:29.730641  3426 raft_consensus.cc:359] T 088188cf28674e1c94310faf6d3f7ff4 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.731330  3426 raft_consensus.cc:385] T 088188cf28674e1c94310faf6d3f7ff4 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:29.731779  3426 raft_consensus.cc:740] T 088188cf28674e1c94310faf6d3f7ff4 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d31e1edf8df54dd5a75e9fba6cc0a1f3, State: Initialized, Role: FOLLOWER
I20260709 12:27:29.732579  3426 consensus_queue.cc:260] T 088188cf28674e1c94310faf6d3f7ff4 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.733531  3434 raft_consensus.cc:2804] T f05d1ba2ab1744db8f477c06f30a6887 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:29.731081  3427 raft_consensus.cc:359] T 42f943816e0640d0af646f248f518df5 P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.733929  3434 raft_consensus.cc:493] T f05d1ba2ab1744db8f477c06f30a6887 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:29.733700  3435 raft_consensus.cc:493] T f05d1ba2ab1744db8f477c06f30a6887 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:29.734169  3427 raft_consensus.cc:385] T 42f943816e0640d0af646f248f518df5 P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:29.734323  3434 raft_consensus.cc:3060] T f05d1ba2ab1744db8f477c06f30a6887 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:29.734521  3427 raft_consensus.cc:740] T 42f943816e0640d0af646f248f518df5 P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65bae5463b17443bb0fa568920a9ca19, State: Initialized, Role: FOLLOWER
I20260709 12:27:29.734465  3435 raft_consensus.cc:515] T f05d1ba2ab1744db8f477c06f30a6887 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.735603  3427 consensus_queue.cc:260] T 42f943816e0640d0af646f248f518df5 P 65bae5463b17443bb0fa568920a9ca19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.737609  3427 ts_tablet_manager.cc:1434] T 42f943816e0640d0af646f248f518df5 P 65bae5463b17443bb0fa568920a9ca19: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:27:29.737782  3235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05d1ba2ab1744db8f477c06f30a6887" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19" is_pre_election: true
I20260709 12:27:29.738430  3235 raft_consensus.cc:2468] T f05d1ba2ab1744db8f477c06f30a6887 P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e260c115ddf045e88e73893d7f8269db in term 0.
I20260709 12:27:29.739682  3351 leader_election.cc:304] T f05d1ba2ab1744db8f477c06f30a6887 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, e260c115ddf045e88e73893d7f8269db; no voters: 
I20260709 12:27:29.741319  3432 raft_consensus.cc:2804] T f05d1ba2ab1744db8f477c06f30a6887 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:29.741052  3434 raft_consensus.cc:515] T f05d1ba2ab1744db8f477c06f30a6887 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.741779  3432 raft_consensus.cc:493] T f05d1ba2ab1744db8f477c06f30a6887 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:29.742156  3432 raft_consensus.cc:3060] T f05d1ba2ab1744db8f477c06f30a6887 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:29.744051  3434 leader_election.cc:290] T f05d1ba2ab1744db8f477c06f30a6887 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 1 election: Requested vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:29.744267  3235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05d1ba2ab1744db8f477c06f30a6887" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19"
I20260709 12:27:29.744791  3426 ts_tablet_manager.cc:1434] T 088188cf28674e1c94310faf6d3f7ff4 P d31e1edf8df54dd5a75e9fba6cc0a1f3: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:27:29.744930  3235 raft_consensus.cc:3060] T f05d1ba2ab1744db8f477c06f30a6887 P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:29.746982  3434 raft_consensus.cc:493] T 5d25e61c23044d75a5c8fbdca4c23eb2 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:29.747439  3386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05d1ba2ab1744db8f477c06f30a6887" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db"
I20260709 12:27:29.747579  3434 raft_consensus.cc:515] T 5d25e61c23044d75a5c8fbdca4c23eb2 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } } peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } }
I20260709 12:27:29.750392  3385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d25e61c23044d75a5c8fbdca4c23eb2" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db" is_pre_election: true
I20260709 12:27:29.750730  3236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d25e61c23044d75a5c8fbdca4c23eb2" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19" is_pre_election: true
I20260709 12:27:29.752195  3277 leader_election.cc:304] T 5d25e61c23044d75a5c8fbdca4c23eb2 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d31e1edf8df54dd5a75e9fba6cc0a1f3; no voters: 65bae5463b17443bb0fa568920a9ca19, e260c115ddf045e88e73893d7f8269db
I20260709 12:27:29.752878  3462 raft_consensus.cc:2749] T 5d25e61c23044d75a5c8fbdca4c23eb2 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:29.752938  3434 leader_election.cc:290] T 5d25e61c23044d75a5c8fbdca4c23eb2 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191), 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391)
I20260709 12:27:29.758697  3311 raft_consensus.cc:2468] T 42f943816e0640d0af646f248f518df5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e260c115ddf045e88e73893d7f8269db in term 1.
I20260709 12:27:29.759888  3351 leader_election.cc:304] T 42f943816e0640d0af646f248f518df5 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d31e1edf8df54dd5a75e9fba6cc0a1f3, e260c115ddf045e88e73893d7f8269db; no voters: 65bae5463b17443bb0fa568920a9ca19
I20260709 12:27:29.760195  3432 raft_consensus.cc:515] T f05d1ba2ab1744db8f477c06f30a6887 P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.761624  3386 raft_consensus.cc:2393] T f05d1ba2ab1744db8f477c06f30a6887 P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d31e1edf8df54dd5a75e9fba6cc0a1f3 in current term 1: Already voted for candidate e260c115ddf045e88e73893d7f8269db in this term.
I20260709 12:27:29.761582  3475 raft_consensus.cc:2804] T 42f943816e0640d0af646f248f518df5 P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:29.763156  3236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05d1ba2ab1744db8f477c06f30a6887" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19"
I20260709 12:27:29.764372  3235 raft_consensus.cc:2468] T f05d1ba2ab1744db8f477c06f30a6887 P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d31e1edf8df54dd5a75e9fba6cc0a1f3 in term 1.
I20260709 12:27:29.765236  3475 raft_consensus.cc:697] T 42f943816e0640d0af646f248f518df5 P e260c115ddf045e88e73893d7f8269db [term 1 LEADER]: Becoming Leader. State: Replica: e260c115ddf045e88e73893d7f8269db, State: Running, Role: LEADER
I20260709 12:27:29.765736  3277 leader_election.cc:304] T f05d1ba2ab1744db8f477c06f30a6887 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, d31e1edf8df54dd5a75e9fba6cc0a1f3; no voters: e260c115ddf045e88e73893d7f8269db
I20260709 12:27:29.766198  3475 consensus_queue.cc:237] T 42f943816e0640d0af646f248f518df5 P e260c115ddf045e88e73893d7f8269db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.768229  3460 raft_consensus.cc:2804] T f05d1ba2ab1744db8f477c06f30a6887 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:29.769968  3435 leader_election.cc:290] T f05d1ba2ab1744db8f477c06f30a6887 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915)
I20260709 12:27:29.768925  3460 raft_consensus.cc:697] T f05d1ba2ab1744db8f477c06f30a6887 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 LEADER]: Becoming Leader. State: Replica: d31e1edf8df54dd5a75e9fba6cc0a1f3, State: Running, Role: LEADER
I20260709 12:27:29.772680  3460 consensus_queue.cc:237] T f05d1ba2ab1744db8f477c06f30a6887 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.776177  3432 leader_election.cc:290] T f05d1ba2ab1744db8f477c06f30a6887 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 1 election: Requested vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915)
I20260709 12:27:29.779480  3311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05d1ba2ab1744db8f477c06f30a6887" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" is_pre_election: true
I20260709 12:27:29.782757  3311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05d1ba2ab1744db8f477c06f30a6887" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3"
I20260709 12:27:29.783670  3133 catalog_manager.cc:5697] T 42f943816e0640d0af646f248f518df5 P e260c115ddf045e88e73893d7f8269db reported cstate change: term changed from 0 to 1, leader changed from <none> to e260c115ddf045e88e73893d7f8269db (127.23.245.131). New cstate: current_term: 1 leader_uuid: "e260c115ddf045e88e73893d7f8269db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:29.784345  3132 catalog_manager.cc:5697] T f05d1ba2ab1744db8f477c06f30a6887 P d31e1edf8df54dd5a75e9fba6cc0a1f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130). New cstate: current_term: 1 leader_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:29.785305  3312 raft_consensus.cc:3060] T 5d25e61c23044d75a5c8fbdca4c23eb2 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:29.791867  3351 leader_election.cc:304] T f05d1ba2ab1744db8f477c06f30a6887 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e260c115ddf045e88e73893d7f8269db; no voters: 65bae5463b17443bb0fa568920a9ca19, d31e1edf8df54dd5a75e9fba6cc0a1f3
I20260709 12:27:29.794435  3435 raft_consensus.cc:2749] T f05d1ba2ab1744db8f477c06f30a6887 P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:27:29.795140  3435 consensus_queue.cc:1048] T 5d25e61c23044d75a5c8fbdca4c23eb2 P e260c115ddf045e88e73893d7f8269db [LEADER]: Connected to new peer: Peer: permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:29.836198  3433 raft_consensus.cc:493] T 42f943816e0640d0af646f248f518df5 P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:29.836773  3433 raft_consensus.cc:515] T 42f943816e0640d0af646f248f518df5 P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.838414  3433 leader_election.cc:290] T 42f943816e0640d0af646f248f518df5 P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:29.839282  3312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f943816e0640d0af646f248f518df5" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" is_pre_election: true
I20260709 12:27:29.839411  3386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f943816e0640d0af646f248f518df5" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db" is_pre_election: true
I20260709 12:27:29.840271  3312 raft_consensus.cc:2393] T 42f943816e0640d0af646f248f518df5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65bae5463b17443bb0fa568920a9ca19 in current term 1: Already voted for candidate e260c115ddf045e88e73893d7f8269db in this term.
I20260709 12:27:29.841352  3202 leader_election.cc:304] T 42f943816e0640d0af646f248f518df5 P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19; no voters: d31e1edf8df54dd5a75e9fba6cc0a1f3, e260c115ddf045e88e73893d7f8269db
I20260709 12:27:29.842155  3433 raft_consensus.cc:3060] T 42f943816e0640d0af646f248f518df5 P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:29.847738  3433 raft_consensus.cc:2749] T 42f943816e0640d0af646f248f518df5 P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:29.904033  3433 consensus_queue.cc:1048] T bfb3537bcd1e40918b030db5bc35117b P 65bae5463b17443bb0fa568920a9ca19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:29.910399  3433 raft_consensus.cc:493] T 088188cf28674e1c94310faf6d3f7ff4 P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:29.910938  3433 raft_consensus.cc:515] T 088188cf28674e1c94310faf6d3f7ff4 P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.913107  3433 leader_election.cc:290] T 088188cf28674e1c94310faf6d3f7ff4 P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:29.915633  3311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "088188cf28674e1c94310faf6d3f7ff4" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" is_pre_election: true
I20260709 12:27:29.915633  3386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "088188cf28674e1c94310faf6d3f7ff4" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db" is_pre_election: true
I20260709 12:27:29.916493  3311 raft_consensus.cc:2468] T 088188cf28674e1c94310faf6d3f7ff4 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65bae5463b17443bb0fa568920a9ca19 in term 0.
I20260709 12:27:29.916623  3386 raft_consensus.cc:2468] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65bae5463b17443bb0fa568920a9ca19 in term 0.
I20260709 12:27:29.917836  3200 leader_election.cc:304] T 088188cf28674e1c94310faf6d3f7ff4 P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, e260c115ddf045e88e73893d7f8269db; no voters: 
I20260709 12:27:29.918018  3433 consensus_queue.cc:1048] T bfb3537bcd1e40918b030db5bc35117b P 65bae5463b17443bb0fa568920a9ca19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:29.918889  3486 raft_consensus.cc:2804] T 088188cf28674e1c94310faf6d3f7ff4 P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:29.919302  3486 raft_consensus.cc:493] T 088188cf28674e1c94310faf6d3f7ff4 P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:29.919641  3486 raft_consensus.cc:3060] T 088188cf28674e1c94310faf6d3f7ff4 P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:29.928417  3486 raft_consensus.cc:515] T 088188cf28674e1c94310faf6d3f7ff4 P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.930020  3486 leader_election.cc:290] T 088188cf28674e1c94310faf6d3f7ff4 P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 1 election: Requested vote from peers d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:29.930866  3312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "088188cf28674e1c94310faf6d3f7ff4" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3"
I20260709 12:27:29.931082  3386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "088188cf28674e1c94310faf6d3f7ff4" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db"
I20260709 12:27:29.931480  3312 raft_consensus.cc:3060] T 088188cf28674e1c94310faf6d3f7ff4 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:29.931867  3386 raft_consensus.cc:3060] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:29.937623  3386 raft_consensus.cc:2468] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65bae5463b17443bb0fa568920a9ca19 in term 1.
I20260709 12:27:29.938647  3200 leader_election.cc:304] T 088188cf28674e1c94310faf6d3f7ff4 P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, e260c115ddf045e88e73893d7f8269db; no voters: 
I20260709 12:27:29.939162  3312 raft_consensus.cc:2468] T 088188cf28674e1c94310faf6d3f7ff4 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65bae5463b17443bb0fa568920a9ca19 in term 1.
I20260709 12:27:29.939354  3486 raft_consensus.cc:2804] T 088188cf28674e1c94310faf6d3f7ff4 P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:29.939939  3486 raft_consensus.cc:697] T 088188cf28674e1c94310faf6d3f7ff4 P 65bae5463b17443bb0fa568920a9ca19 [term 1 LEADER]: Becoming Leader. State: Replica: 65bae5463b17443bb0fa568920a9ca19, State: Running, Role: LEADER
I20260709 12:27:29.940784  3486 consensus_queue.cc:237] T 088188cf28674e1c94310faf6d3f7ff4 P 65bae5463b17443bb0fa568920a9ca19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:29.947877  3133 catalog_manager.cc:5697] T 088188cf28674e1c94310faf6d3f7ff4 P 65bae5463b17443bb0fa568920a9ca19 reported cstate change: term changed from 0 to 1, leader changed from <none> to 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129). New cstate: current_term: 1 leader_uuid: "65bae5463b17443bb0fa568920a9ca19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:29.987733  3486 consensus_queue.cc:1048] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:29.997876  3486 consensus_queue.cc:1048] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:30.025017  3386 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d25e61c23044d75a5c8fbdca4c23eb2"
dest_uuid: "e260c115ddf045e88e73893d7f8269db"
mode: GRACEFUL
new_leader_uuid: "65bae5463b17443bb0fa568920a9ca19"
 from {username='slave'} at 127.0.0.1:53002
I20260709 12:27:30.025604  3386 raft_consensus.cc:606] T 5d25e61c23044d75a5c8fbdca4c23eb2 P e260c115ddf045e88e73893d7f8269db [term 1 LEADER]: Received request to transfer leadership to TS 65bae5463b17443bb0fa568920a9ca19
I20260709 12:27:30.035972  3435 consensus_queue.cc:1048] T 71b5bc230abf46069a29bb86e6039a15 P e260c115ddf045e88e73893d7f8269db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:30.037437  3386 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71b5bc230abf46069a29bb86e6039a15"
dest_uuid: "e260c115ddf045e88e73893d7f8269db"
mode: GRACEFUL
new_leader_uuid: "65bae5463b17443bb0fa568920a9ca19"
 from {username='slave'} at 127.0.0.1:53002
I20260709 12:27:30.038133  3386 raft_consensus.cc:606] T 71b5bc230abf46069a29bb86e6039a15 P e260c115ddf045e88e73893d7f8269db [term 1 LEADER]: Received request to transfer leadership to TS 65bae5463b17443bb0fa568920a9ca19
I20260709 12:27:30.043877  3477 raft_consensus.cc:993] T 71b5bc230abf46069a29bb86e6039a15 P e260c115ddf045e88e73893d7f8269db: : Instructing follower 65bae5463b17443bb0fa568920a9ca19 to start an election
I20260709 12:27:30.044378  3477 raft_consensus.cc:1081] T 71b5bc230abf46069a29bb86e6039a15 P e260c115ddf045e88e73893d7f8269db [term 1 LEADER]: Signalling peer 65bae5463b17443bb0fa568920a9ca19 to start an election
I20260709 12:27:30.049192  3237 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "71b5bc230abf46069a29bb86e6039a15"
dest_uuid: "65bae5463b17443bb0fa568920a9ca19"
 from {username='slave'} at 127.0.0.1:39490
I20260709 12:27:30.051120  3237 raft_consensus.cc:493] T 71b5bc230abf46069a29bb86e6039a15 P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:30.053246  3435 consensus_queue.cc:1048] T 71b5bc230abf46069a29bb86e6039a15 P e260c115ddf045e88e73893d7f8269db [LEADER]: Connected to new peer: Peer: permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:30.054883  3237 raft_consensus.cc:3060] T 71b5bc230abf46069a29bb86e6039a15 P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:30.063019  3237 raft_consensus.cc:515] T 71b5bc230abf46069a29bb86e6039a15 P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:30.066879  3237 leader_election.cc:290] T 71b5bc230abf46069a29bb86e6039a15 P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 2 election: Requested vote from peers d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:30.067791  3235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3f0de7c8efd147bcb0dcec69dd1bc2ab"
dest_uuid: "65bae5463b17443bb0fa568920a9ca19"
mode: GRACEFUL
new_leader_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3"
 from {username='slave'} at 127.0.0.1:39504
I20260709 12:27:30.068753  3312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b5bc230abf46069a29bb86e6039a15" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3"
I20260709 12:27:30.069022  3235 raft_consensus.cc:606] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19 [term 1 LEADER]: Received request to transfer leadership to TS d31e1edf8df54dd5a75e9fba6cc0a1f3
I20260709 12:27:30.068753  3386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b5bc230abf46069a29bb86e6039a15" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e260c115ddf045e88e73893d7f8269db"
I20260709 12:27:30.069617  3312 raft_consensus.cc:3060] T 71b5bc230abf46069a29bb86e6039a15 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:30.070056  3386 raft_consensus.cc:3055] T 71b5bc230abf46069a29bb86e6039a15 P e260c115ddf045e88e73893d7f8269db [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:30.070451  3386 raft_consensus.cc:740] T 71b5bc230abf46069a29bb86e6039a15 P e260c115ddf045e88e73893d7f8269db [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e260c115ddf045e88e73893d7f8269db, State: Running, Role: LEADER
I20260709 12:27:30.071375  3386 consensus_queue.cc:260] T 71b5bc230abf46069a29bb86e6039a15 P e260c115ddf045e88e73893d7f8269db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:30.072790  3386 raft_consensus.cc:3060] T 71b5bc230abf46069a29bb86e6039a15 P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:30.075078  3385 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42f943816e0640d0af646f248f518df5"
dest_uuid: "e260c115ddf045e88e73893d7f8269db"
mode: GRACEFUL
new_leader_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3"
 from {username='slave'} at 127.0.0.1:53002
I20260709 12:27:30.075783  3385 raft_consensus.cc:606] T 42f943816e0640d0af646f248f518df5 P e260c115ddf045e88e73893d7f8269db [term 1 LEADER]: Received request to transfer leadership to TS d31e1edf8df54dd5a75e9fba6cc0a1f3
I20260709 12:27:30.077726  3312 raft_consensus.cc:2468] T 71b5bc230abf46069a29bb86e6039a15 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65bae5463b17443bb0fa568920a9ca19 in term 2.
I20260709 12:27:30.078979  3202 leader_election.cc:304] T 71b5bc230abf46069a29bb86e6039a15 P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, d31e1edf8df54dd5a75e9fba6cc0a1f3; no voters: 
I20260709 12:27:30.079957  3486 raft_consensus.cc:2804] T 71b5bc230abf46069a29bb86e6039a15 P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:30.080474  3486 raft_consensus.cc:697] T 71b5bc230abf46069a29bb86e6039a15 P 65bae5463b17443bb0fa568920a9ca19 [term 2 LEADER]: Becoming Leader. State: Replica: 65bae5463b17443bb0fa568920a9ca19, State: Running, Role: LEADER
I20260709 12:27:30.081473  3486 consensus_queue.cc:237] T 71b5bc230abf46069a29bb86e6039a15 P 65bae5463b17443bb0fa568920a9ca19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:30.083364  3386 raft_consensus.cc:2468] T 71b5bc230abf46069a29bb86e6039a15 P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65bae5463b17443bb0fa568920a9ca19 in term 2.
I20260709 12:27:30.085714  3434 consensus_queue.cc:1048] T 51cd230ca9d6436eafae195975c7b9ce P d31e1edf8df54dd5a75e9fba6cc0a1f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:30.090692  3235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "088188cf28674e1c94310faf6d3f7ff4"
dest_uuid: "65bae5463b17443bb0fa568920a9ca19"
mode: GRACEFUL
new_leader_uuid: "e260c115ddf045e88e73893d7f8269db"
 from {username='slave'} at 127.0.0.1:39504
I20260709 12:27:30.091187  3235 raft_consensus.cc:606] T 088188cf28674e1c94310faf6d3f7ff4 P 65bae5463b17443bb0fa568920a9ca19 [term 1 LEADER]: Received request to transfer leadership to TS e260c115ddf045e88e73893d7f8269db
I20260709 12:27:30.091368  3134 catalog_manager.cc:5697] T 71b5bc230abf46069a29bb86e6039a15 P 65bae5463b17443bb0fa568920a9ca19 reported cstate change: term changed from 1 to 2, leader changed from e260c115ddf045e88e73893d7f8269db (127.23.245.131) to 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129). New cstate: current_term: 2 leader_uuid: "65bae5463b17443bb0fa568920a9ca19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:30.105487  3434 consensus_queue.cc:1048] T 51cd230ca9d6436eafae195975c7b9ce P d31e1edf8df54dd5a75e9fba6cc0a1f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:30.174225  3435 consensus_queue.cc:1048] T 42f943816e0640d0af646f248f518df5 P e260c115ddf045e88e73893d7f8269db [LEADER]: Connected to new peer: Peer: permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:30.181311  3476 raft_consensus.cc:993] T 42f943816e0640d0af646f248f518df5 P e260c115ddf045e88e73893d7f8269db: : Instructing follower d31e1edf8df54dd5a75e9fba6cc0a1f3 to start an election
I20260709 12:27:30.181811  3475 raft_consensus.cc:1081] T 42f943816e0640d0af646f248f518df5 P e260c115ddf045e88e73893d7f8269db [term 1 LEADER]: Signalling peer d31e1edf8df54dd5a75e9fba6cc0a1f3 to start an election
I20260709 12:27:30.184542  3311 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "42f943816e0640d0af646f248f518df5"
dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3"
 from {username='slave'} at 127.0.0.1:52004
I20260709 12:27:30.185120  3311 raft_consensus.cc:493] T 42f943816e0640d0af646f248f518df5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:30.185498  3311 raft_consensus.cc:3060] T 42f943816e0640d0af646f248f518df5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:30.187400  3476 consensus_queue.cc:1048] T 42f943816e0640d0af646f248f518df5 P e260c115ddf045e88e73893d7f8269db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:30.192791  3311 raft_consensus.cc:515] T 42f943816e0640d0af646f248f518df5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:30.195581  3237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f943816e0640d0af646f248f518df5" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65bae5463b17443bb0fa568920a9ca19"
I20260709 12:27:30.195956  3386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f943816e0640d0af646f248f518df5" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e260c115ddf045e88e73893d7f8269db"
I20260709 12:27:30.196223  3237 raft_consensus.cc:3060] T 42f943816e0640d0af646f248f518df5 P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:30.196619  3386 raft_consensus.cc:3055] T 42f943816e0640d0af646f248f518df5 P e260c115ddf045e88e73893d7f8269db [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:30.196943  3386 raft_consensus.cc:740] T 42f943816e0640d0af646f248f518df5 P e260c115ddf045e88e73893d7f8269db [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e260c115ddf045e88e73893d7f8269db, State: Running, Role: LEADER
I20260709 12:27:30.197808  3386 consensus_queue.cc:260] T 42f943816e0640d0af646f248f518df5 P e260c115ddf045e88e73893d7f8269db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:30.198972  3386 raft_consensus.cc:3060] T 42f943816e0640d0af646f248f518df5 P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:30.203519  3311 leader_election.cc:290] T 42f943816e0640d0af646f248f518df5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 2 election: Requested vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:30.203622  3237 raft_consensus.cc:2468] T 42f943816e0640d0af646f248f518df5 P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d31e1edf8df54dd5a75e9fba6cc0a1f3 in term 2.
I20260709 12:27:30.206218  3386 raft_consensus.cc:2468] T 42f943816e0640d0af646f248f518df5 P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d31e1edf8df54dd5a75e9fba6cc0a1f3 in term 2.
I20260709 12:27:30.206259  3277 leader_election.cc:304] T 42f943816e0640d0af646f248f518df5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, d31e1edf8df54dd5a75e9fba6cc0a1f3; no voters: 
I20260709 12:27:30.207396  3434 raft_consensus.cc:2804] T 42f943816e0640d0af646f248f518df5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:30.207115  3486 consensus_queue.cc:1048] T 2f808f4193db4e6eba0ea677944df64d P 65bae5463b17443bb0fa568920a9ca19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:30.207926  3434 raft_consensus.cc:697] T 42f943816e0640d0af646f248f518df5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 LEADER]: Becoming Leader. State: Replica: d31e1edf8df54dd5a75e9fba6cc0a1f3, State: Running, Role: LEADER
I20260709 12:27:30.208803  3434 consensus_queue.cc:237] T 42f943816e0640d0af646f248f518df5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:30.216416  3134 catalog_manager.cc:5697] T 42f943816e0640d0af646f248f518df5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 reported cstate change: term changed from 1 to 2, leader changed from e260c115ddf045e88e73893d7f8269db (127.23.245.131) to d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130). New cstate: current_term: 2 leader_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:30.219134  3452 consensus_queue.cc:1048] T 2f808f4193db4e6eba0ea677944df64d P 65bae5463b17443bb0fa568920a9ca19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:30.266263  3475 raft_consensus.cc:993] T 5d25e61c23044d75a5c8fbdca4c23eb2 P e260c115ddf045e88e73893d7f8269db: : Instructing follower 65bae5463b17443bb0fa568920a9ca19 to start an election
I20260709 12:27:30.266817  3476 raft_consensus.cc:1081] T 5d25e61c23044d75a5c8fbdca4c23eb2 P e260c115ddf045e88e73893d7f8269db [term 1 LEADER]: Signalling peer 65bae5463b17443bb0fa568920a9ca19 to start an election
I20260709 12:27:30.268451  3237 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5d25e61c23044d75a5c8fbdca4c23eb2"
dest_uuid: "65bae5463b17443bb0fa568920a9ca19"
 from {username='slave'} at 127.0.0.1:39490
I20260709 12:27:30.268930  3237 raft_consensus.cc:493] T 5d25e61c23044d75a5c8fbdca4c23eb2 P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:30.269309  3237 raft_consensus.cc:3060] T 5d25e61c23044d75a5c8fbdca4c23eb2 P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:30.274300  3237 raft_consensus.cc:515] T 5d25e61c23044d75a5c8fbdca4c23eb2 P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } } peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } }
I20260709 12:27:30.275863  3237 leader_election.cc:290] T 5d25e61c23044d75a5c8fbdca4c23eb2 P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 2 election: Requested vote from peers d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:30.276935  3311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d25e61c23044d75a5c8fbdca4c23eb2" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3"
I20260709 12:27:30.277119  3386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d25e61c23044d75a5c8fbdca4c23eb2" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e260c115ddf045e88e73893d7f8269db"
I20260709 12:27:30.277648  3311 raft_consensus.cc:3060] T 5d25e61c23044d75a5c8fbdca4c23eb2 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:30.277674  3386 raft_consensus.cc:3055] T 5d25e61c23044d75a5c8fbdca4c23eb2 P e260c115ddf045e88e73893d7f8269db [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:30.278160  3386 raft_consensus.cc:740] T 5d25e61c23044d75a5c8fbdca4c23eb2 P e260c115ddf045e88e73893d7f8269db [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e260c115ddf045e88e73893d7f8269db, State: Running, Role: LEADER
I20260709 12:27:30.279047  3386 consensus_queue.cc:260] T 5d25e61c23044d75a5c8fbdca4c23eb2 P e260c115ddf045e88e73893d7f8269db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } } peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } }
I20260709 12:27:30.280401  3386 raft_consensus.cc:3060] T 5d25e61c23044d75a5c8fbdca4c23eb2 P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:30.285168  3311 raft_consensus.cc:2468] T 5d25e61c23044d75a5c8fbdca4c23eb2 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65bae5463b17443bb0fa568920a9ca19 in term 2.
I20260709 12:27:30.286715  3202 leader_election.cc:304] T 5d25e61c23044d75a5c8fbdca4c23eb2 P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, d31e1edf8df54dd5a75e9fba6cc0a1f3; no voters: 
I20260709 12:27:30.287606  3452 raft_consensus.cc:2804] T 5d25e61c23044d75a5c8fbdca4c23eb2 P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:30.287698  3386 raft_consensus.cc:2468] T 5d25e61c23044d75a5c8fbdca4c23eb2 P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65bae5463b17443bb0fa568920a9ca19 in term 2.
I20260709 12:27:30.288103  3452 raft_consensus.cc:697] T 5d25e61c23044d75a5c8fbdca4c23eb2 P 65bae5463b17443bb0fa568920a9ca19 [term 2 LEADER]: Becoming Leader. State: Replica: 65bae5463b17443bb0fa568920a9ca19, State: Running, Role: LEADER
I20260709 12:27:30.289482  3452 consensus_queue.cc:237] T 5d25e61c23044d75a5c8fbdca4c23eb2 P 65bae5463b17443bb0fa568920a9ca19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } } peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } }
I20260709 12:27:30.296082  3133 catalog_manager.cc:5697] T 5d25e61c23044d75a5c8fbdca4c23eb2 P 65bae5463b17443bb0fa568920a9ca19 reported cstate change: term changed from 1 to 2, leader changed from e260c115ddf045e88e73893d7f8269db (127.23.245.131) to 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129). New cstate: current_term: 2 leader_uuid: "65bae5463b17443bb0fa568920a9ca19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:30.309499  3434 consensus_queue.cc:1048] T f05d1ba2ab1744db8f477c06f30a6887 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:30.310293  3462 consensus_queue.cc:1048] T f05d1ba2ab1744db8f477c06f30a6887 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:30.456660  3452 consensus_queue.cc:1048] T 088188cf28674e1c94310faf6d3f7ff4 P 65bae5463b17443bb0fa568920a9ca19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:30.463464  3433 raft_consensus.cc:993] T 088188cf28674e1c94310faf6d3f7ff4 P 65bae5463b17443bb0fa568920a9ca19: : Instructing follower e260c115ddf045e88e73893d7f8269db to start an election
I20260709 12:27:30.464052  3486 raft_consensus.cc:1081] T 088188cf28674e1c94310faf6d3f7ff4 P 65bae5463b17443bb0fa568920a9ca19 [term 1 LEADER]: Signalling peer e260c115ddf045e88e73893d7f8269db to start an election
I20260709 12:27:30.465692  3385 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "088188cf28674e1c94310faf6d3f7ff4"
dest_uuid: "e260c115ddf045e88e73893d7f8269db"
 from {username='slave'} at 127.0.0.1:52976
I20260709 12:27:30.466317  3385 raft_consensus.cc:493] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:30.466706  3385 raft_consensus.cc:3060] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:30.469759  3486 consensus_queue.cc:1048] T 088188cf28674e1c94310faf6d3f7ff4 P 65bae5463b17443bb0fa568920a9ca19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:30.474335  3384 raft_consensus.cc:1275] T 71b5bc230abf46069a29bb86e6039a15 P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Refusing update from remote peer 65bae5463b17443bb0fa568920a9ca19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:30.474056  3385 raft_consensus.cc:515] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:30.475241  3386 raft_consensus.cc:1240] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Rejecting Update request from peer 65bae5463b17443bb0fa568920a9ca19 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:30.476424  3385 leader_election.cc:290] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 2 election: Requested vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915)
I20260709 12:27:30.477272  3237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "088188cf28674e1c94310faf6d3f7ff4" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65bae5463b17443bb0fa568920a9ca19"
I20260709 12:27:30.477631  3312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "088188cf28674e1c94310faf6d3f7ff4" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3"
I20260709 12:27:30.477932  3237 raft_consensus.cc:3055] T 088188cf28674e1c94310faf6d3f7ff4 P 65bae5463b17443bb0fa568920a9ca19 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:30.478379  3237 raft_consensus.cc:740] T 088188cf28674e1c94310faf6d3f7ff4 P 65bae5463b17443bb0fa568920a9ca19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65bae5463b17443bb0fa568920a9ca19, State: Running, Role: LEADER
I20260709 12:27:30.479224  3237 consensus_queue.cc:260] T 088188cf28674e1c94310faf6d3f7ff4 P 65bae5463b17443bb0fa568920a9ca19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:30.479898  3452 consensus_queue.cc:1048] T 71b5bc230abf46069a29bb86e6039a15 P 65bae5463b17443bb0fa568920a9ca19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:30.480199  3237 raft_consensus.cc:3060] T 088188cf28674e1c94310faf6d3f7ff4 P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:30.491793  3311 raft_consensus.cc:1275] T 71b5bc230abf46069a29bb86e6039a15 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Refusing update from remote peer 65bae5463b17443bb0fa568920a9ca19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:30.493678  3465 consensus_queue.cc:1048] T 71b5bc230abf46069a29bb86e6039a15 P 65bae5463b17443bb0fa568920a9ca19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:30.499995  3237 raft_consensus.cc:2468] T 088188cf28674e1c94310faf6d3f7ff4 P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e260c115ddf045e88e73893d7f8269db in term 2.
I20260709 12:27:30.502856  3351 leader_election.cc:304] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, e260c115ddf045e88e73893d7f8269db; no voters: d31e1edf8df54dd5a75e9fba6cc0a1f3
I20260709 12:27:30.503649  3476 raft_consensus.cc:2804] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:30.504163  3476 raft_consensus.cc:697] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db [term 2 LEADER]: Becoming Leader. State: Replica: e260c115ddf045e88e73893d7f8269db, State: Running, Role: LEADER
I20260709 12:27:30.504855  3476 consensus_queue.cc:237] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:30.510736  3133 catalog_manager.cc:5697] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db reported cstate change: term changed from 1 to 2, leader changed from 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129) to e260c115ddf045e88e73893d7f8269db (127.23.245.131). New cstate: current_term: 2 leader_uuid: "e260c115ddf045e88e73893d7f8269db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:30.528357  3486 raft_consensus.cc:993] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19: : Instructing follower d31e1edf8df54dd5a75e9fba6cc0a1f3 to start an election
I20260709 12:27:30.528921  3465 raft_consensus.cc:1081] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19 [term 1 LEADER]: Signalling peer d31e1edf8df54dd5a75e9fba6cc0a1f3 to start an election
I20260709 12:27:30.530412  3311 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3f0de7c8efd147bcb0dcec69dd1bc2ab"
dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3"
 from {username='slave'} at 127.0.0.1:52012
I20260709 12:27:30.530910  3311 raft_consensus.cc:493] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:30.531224  3311 raft_consensus.cc:3060] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:30.536089  3311 raft_consensus.cc:515] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:30.537902  3311 leader_election.cc:290] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 2 election: Requested vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:30.538748  3237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f0de7c8efd147bcb0dcec69dd1bc2ab" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65bae5463b17443bb0fa568920a9ca19"
I20260709 12:27:30.539060  3386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f0de7c8efd147bcb0dcec69dd1bc2ab" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e260c115ddf045e88e73893d7f8269db"
I20260709 12:27:30.539326  3237 raft_consensus.cc:3055] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:30.539651  3386 raft_consensus.cc:3060] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:30.539674  3237 raft_consensus.cc:740] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65bae5463b17443bb0fa568920a9ca19, State: Running, Role: LEADER
I20260709 12:27:30.540565  3237 consensus_queue.cc:260] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:30.541492  3237 raft_consensus.cc:3060] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:30.545280  3386 raft_consensus.cc:2468] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d31e1edf8df54dd5a75e9fba6cc0a1f3 in term 2.
I20260709 12:27:30.546625  3275 leader_election.cc:304] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d31e1edf8df54dd5a75e9fba6cc0a1f3, e260c115ddf045e88e73893d7f8269db; no voters: 
I20260709 12:27:30.547269  3237 raft_consensus.cc:2468] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d31e1edf8df54dd5a75e9fba6cc0a1f3 in term 2.
I20260709 12:27:30.547344  3460 raft_consensus.cc:2804] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:30.548063  3460 raft_consensus.cc:697] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 LEADER]: Becoming Leader. State: Replica: d31e1edf8df54dd5a75e9fba6cc0a1f3, State: Running, Role: LEADER
I20260709 12:27:30.548815  3460 consensus_queue.cc:237] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:30.554736  3133 catalog_manager.cc:5697] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 reported cstate change: term changed from 1 to 2, leader changed from 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129) to d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130). New cstate: current_term: 2 leader_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:30.811503  3237 raft_consensus.cc:1275] T 42f943816e0640d0af646f248f518df5 P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Refusing update from remote peer d31e1edf8df54dd5a75e9fba6cc0a1f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:30.811506  3386 raft_consensus.cc:1275] T 42f943816e0640d0af646f248f518df5 P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Refusing update from remote peer d31e1edf8df54dd5a75e9fba6cc0a1f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:30.813118  3434 consensus_queue.cc:1048] T 42f943816e0640d0af646f248f518df5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:30.813791  3460 consensus_queue.cc:1048] T 42f943816e0640d0af646f248f518df5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:30.854964  3311 raft_consensus.cc:1275] T 5d25e61c23044d75a5c8fbdca4c23eb2 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Refusing update from remote peer 65bae5463b17443bb0fa568920a9ca19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:30.856303  3465 consensus_queue.cc:1048] T 5d25e61c23044d75a5c8fbdca4c23eb2 P 65bae5463b17443bb0fa568920a9ca19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:30.864789  3386 raft_consensus.cc:1275] T 5d25e61c23044d75a5c8fbdca4c23eb2 P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Refusing update from remote peer 65bae5463b17443bb0fa568920a9ca19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:30.866328  3452 consensus_queue.cc:1048] T 5d25e61c23044d75a5c8fbdca4c23eb2 P 65bae5463b17443bb0fa568920a9ca19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:31.066771  3237 raft_consensus.cc:1275] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Refusing update from remote peer d31e1edf8df54dd5a75e9fba6cc0a1f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:31.068109  3434 consensus_queue.cc:1048] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:31.074957  3237 raft_consensus.cc:1275] T 088188cf28674e1c94310faf6d3f7ff4 P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Refusing update from remote peer e260c115ddf045e88e73893d7f8269db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:31.076467  3476 consensus_queue.cc:1048] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:31.077421  3386 raft_consensus.cc:1275] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Refusing update from remote peer d31e1edf8df54dd5a75e9fba6cc0a1f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:31.079303  3460 consensus_queue.cc:1048] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:31.099694  3312 raft_consensus.cc:3060] T 088188cf28674e1c94310faf6d3f7ff4 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:31.106454  3312 raft_consensus.cc:1275] T 088188cf28674e1c94310faf6d3f7ff4 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Refusing update from remote peer e260c115ddf045e88e73893d7f8269db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:31.108108  3512 consensus_queue.cc:1048] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db [LEADER]: Connected to new peer: Peer: permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:33.120908  3134 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51274:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:27:33.123306  3134 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:27:33.172431  3224 tablet_service.cc:1511] Processing CreateTablet for tablet 848e8cff9e5b4de6b49a1bd243e9f9aa (DEFAULT_TABLE table=soft_deleted_table [id=542dd44161144d8eacebc969699a5ca3]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:27:33.173300  3298 tablet_service.cc:1511] Processing CreateTablet for tablet 848e8cff9e5b4de6b49a1bd243e9f9aa (DEFAULT_TABLE table=soft_deleted_table [id=542dd44161144d8eacebc969699a5ca3]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:27:33.174656  3298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 848e8cff9e5b4de6b49a1bd243e9f9aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:33.173763  3224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 848e8cff9e5b4de6b49a1bd243e9f9aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:33.175474  3372 tablet_service.cc:1511] Processing CreateTablet for tablet 848e8cff9e5b4de6b49a1bd243e9f9aa (DEFAULT_TABLE table=soft_deleted_table [id=542dd44161144d8eacebc969699a5ca3]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:27:33.176740  3372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 848e8cff9e5b4de6b49a1bd243e9f9aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:33.176574  3227 tablet_service.cc:1511] Processing CreateTablet for tablet 3eebe28a0e1b493581b05e588dd920d5 (DEFAULT_TABLE table=soft_deleted_table [id=542dd44161144d8eacebc969699a5ca3]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:27:33.177940  3227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3eebe28a0e1b493581b05e588dd920d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:33.188442  3302 tablet_service.cc:1511] Processing CreateTablet for tablet 3eebe28a0e1b493581b05e588dd920d5 (DEFAULT_TABLE table=soft_deleted_table [id=542dd44161144d8eacebc969699a5ca3]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:27:33.189940  3302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3eebe28a0e1b493581b05e588dd920d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:33.192088  3373 tablet_service.cc:1511] Processing CreateTablet for tablet 3eebe28a0e1b493581b05e588dd920d5 (DEFAULT_TABLE table=soft_deleted_table [id=542dd44161144d8eacebc969699a5ca3]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:27:33.193449  3373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3eebe28a0e1b493581b05e588dd920d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:33.195431  3225 tablet_service.cc:1511] Processing CreateTablet for tablet c4adb0932a604e779ef3ce9fff0b7bc5 (DEFAULT_TABLE table=soft_deleted_table [id=542dd44161144d8eacebc969699a5ca3]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:27:33.196833  3225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4adb0932a604e779ef3ce9fff0b7bc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:33.219189  3528 tablet_bootstrap.cc:492] T 848e8cff9e5b4de6b49a1bd243e9f9aa P d31e1edf8df54dd5a75e9fba6cc0a1f3: Bootstrap starting.
I20260709 12:27:33.223654  3530 tablet_bootstrap.cc:492] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db: Bootstrap starting.
I20260709 12:27:33.226810  3528 tablet_bootstrap.cc:654] T 848e8cff9e5b4de6b49a1bd243e9f9aa P d31e1edf8df54dd5a75e9fba6cc0a1f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:33.232151  3302 tablet_service.cc:1511] Processing CreateTablet for tablet c4adb0932a604e779ef3ce9fff0b7bc5 (DEFAULT_TABLE table=soft_deleted_table [id=542dd44161144d8eacebc969699a5ca3]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:27:33.234000  3302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4adb0932a604e779ef3ce9fff0b7bc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:33.238159  3530 tablet_bootstrap.cc:654] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:33.239681  3528 tablet_bootstrap.cc:492] T 848e8cff9e5b4de6b49a1bd243e9f9aa P d31e1edf8df54dd5a75e9fba6cc0a1f3: No bootstrap required, opened a new log
I20260709 12:27:33.239269  3372 tablet_service.cc:1511] Processing CreateTablet for tablet c4adb0932a604e779ef3ce9fff0b7bc5 (DEFAULT_TABLE table=soft_deleted_table [id=542dd44161144d8eacebc969699a5ca3]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:27:33.240226  3528 ts_tablet_manager.cc:1403] T 848e8cff9e5b4de6b49a1bd243e9f9aa P d31e1edf8df54dd5a75e9fba6cc0a1f3: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.008s
I20260709 12:27:33.240819  3372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c4adb0932a604e779ef3ce9fff0b7bc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:33.242578  3531 tablet_bootstrap.cc:492] T 3eebe28a0e1b493581b05e588dd920d5 P 65bae5463b17443bb0fa568920a9ca19: Bootstrap starting.
I20260709 12:27:33.243348  3528 raft_consensus.cc:359] T 848e8cff9e5b4de6b49a1bd243e9f9aa P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.244853  3528 raft_consensus.cc:385] T 848e8cff9e5b4de6b49a1bd243e9f9aa P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:33.245280  3528 raft_consensus.cc:740] T 848e8cff9e5b4de6b49a1bd243e9f9aa P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d31e1edf8df54dd5a75e9fba6cc0a1f3, State: Initialized, Role: FOLLOWER
I20260709 12:27:33.246409  3528 consensus_queue.cc:260] T 848e8cff9e5b4de6b49a1bd243e9f9aa P d31e1edf8df54dd5a75e9fba6cc0a1f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.249146  3528 ts_tablet_manager.cc:1434] T 848e8cff9e5b4de6b49a1bd243e9f9aa P d31e1edf8df54dd5a75e9fba6cc0a1f3: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:27:33.250169  3531 tablet_bootstrap.cc:654] T 3eebe28a0e1b493581b05e588dd920d5 P 65bae5463b17443bb0fa568920a9ca19: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:33.250177  3528 tablet_bootstrap.cc:492] T 3eebe28a0e1b493581b05e588dd920d5 P d31e1edf8df54dd5a75e9fba6cc0a1f3: Bootstrap starting.
I20260709 12:27:33.256004  3530 tablet_bootstrap.cc:492] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db: No bootstrap required, opened a new log
I20260709 12:27:33.256592  3530 ts_tablet_manager.cc:1403] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db: Time spent bootstrapping tablet: real 0.033s	user 0.021s	sys 0.000s
I20260709 12:27:33.260138  3528 tablet_bootstrap.cc:654] T 3eebe28a0e1b493581b05e588dd920d5 P d31e1edf8df54dd5a75e9fba6cc0a1f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:33.259740  3530 raft_consensus.cc:359] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.260775  3530 raft_consensus.cc:385] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:33.261166  3530 raft_consensus.cc:740] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e260c115ddf045e88e73893d7f8269db, State: Initialized, Role: FOLLOWER
I20260709 12:27:33.262187  3530 consensus_queue.cc:260] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.276005  3530 ts_tablet_manager.cc:1434] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:27:33.275888  3227 tablet_service.cc:1511] Processing CreateTablet for tablet 01c6742a5e0e4b0eb07abd8f93c2a8fb (DEFAULT_TABLE table=soft_deleted_table [id=542dd44161144d8eacebc969699a5ca3]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:27:33.277434  3530 tablet_bootstrap.cc:492] T 3eebe28a0e1b493581b05e588dd920d5 P e260c115ddf045e88e73893d7f8269db: Bootstrap starting.
I20260709 12:27:33.277916  3227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01c6742a5e0e4b0eb07abd8f93c2a8fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:33.282032  3298 tablet_service.cc:1511] Processing CreateTablet for tablet 01c6742a5e0e4b0eb07abd8f93c2a8fb (DEFAULT_TABLE table=soft_deleted_table [id=542dd44161144d8eacebc969699a5ca3]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:27:33.283422  3298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01c6742a5e0e4b0eb07abd8f93c2a8fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:33.286036  3373 tablet_service.cc:1511] Processing CreateTablet for tablet 01c6742a5e0e4b0eb07abd8f93c2a8fb (DEFAULT_TABLE table=soft_deleted_table [id=542dd44161144d8eacebc969699a5ca3]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:27:33.287668  3373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01c6742a5e0e4b0eb07abd8f93c2a8fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:33.294322  3224 tablet_service.cc:1511] Processing CreateTablet for tablet 3ab18fc35bf84fd4876f3c9573c22c0d (DEFAULT_TABLE table=soft_deleted_table [id=542dd44161144d8eacebc969699a5ca3]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:27:33.295766  3224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ab18fc35bf84fd4876f3c9573c22c0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:33.303817  3300 tablet_service.cc:1511] Processing CreateTablet for tablet 3ab18fc35bf84fd4876f3c9573c22c0d (DEFAULT_TABLE table=soft_deleted_table [id=542dd44161144d8eacebc969699a5ca3]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:27:33.304811  3374 tablet_service.cc:1511] Processing CreateTablet for tablet 3ab18fc35bf84fd4876f3c9573c22c0d (DEFAULT_TABLE table=soft_deleted_table [id=542dd44161144d8eacebc969699a5ca3]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:27:33.306696  3374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ab18fc35bf84fd4876f3c9573c22c0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:33.304900  3225 tablet_service.cc:1511] Processing CreateTablet for tablet 18abc32bcdc8438d8f5438356c0b68bb (DEFAULT_TABLE table=soft_deleted_table [id=542dd44161144d8eacebc969699a5ca3]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:27:33.308282  3299 tablet_service.cc:1511] Processing CreateTablet for tablet 18abc32bcdc8438d8f5438356c0b68bb (DEFAULT_TABLE table=soft_deleted_table [id=542dd44161144d8eacebc969699a5ca3]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:27:33.309765  3225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18abc32bcdc8438d8f5438356c0b68bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:33.310917  3375 tablet_service.cc:1511] Processing CreateTablet for tablet 18abc32bcdc8438d8f5438356c0b68bb (DEFAULT_TABLE table=soft_deleted_table [id=542dd44161144d8eacebc969699a5ca3]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:27:33.305475  3300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ab18fc35bf84fd4876f3c9573c22c0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:33.312475  3299 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18abc32bcdc8438d8f5438356c0b68bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:33.317858  3375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18abc32bcdc8438d8f5438356c0b68bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:33.318936  3226 tablet_service.cc:1511] Processing CreateTablet for tablet 821be9b5927a481ab065336d9a5c6522 (DEFAULT_TABLE table=soft_deleted_table [id=542dd44161144d8eacebc969699a5ca3]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:27:33.321743  3226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 821be9b5927a481ab065336d9a5c6522. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:33.348440  3530 tablet_bootstrap.cc:654] T 3eebe28a0e1b493581b05e588dd920d5 P e260c115ddf045e88e73893d7f8269db: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:33.357019  3301 tablet_service.cc:1511] Processing CreateTablet for tablet 821be9b5927a481ab065336d9a5c6522 (DEFAULT_TABLE table=soft_deleted_table [id=542dd44161144d8eacebc969699a5ca3]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:27:33.358484  3301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 821be9b5927a481ab065336d9a5c6522. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:33.358150  3372 tablet_service.cc:1511] Processing CreateTablet for tablet 821be9b5927a481ab065336d9a5c6522 (DEFAULT_TABLE table=soft_deleted_table [id=542dd44161144d8eacebc969699a5ca3]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:27:33.366358  3372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 821be9b5927a481ab065336d9a5c6522. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:33.374686  3223 tablet_service.cc:1511] Processing CreateTablet for tablet 66daa0e84b334222ac9af601b6a0a2dc (DEFAULT_TABLE table=soft_deleted_table [id=542dd44161144d8eacebc969699a5ca3]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:27:33.377743  3531 tablet_bootstrap.cc:492] T 3eebe28a0e1b493581b05e588dd920d5 P 65bae5463b17443bb0fa568920a9ca19: No bootstrap required, opened a new log
I20260709 12:27:33.377386  3376 tablet_service.cc:1511] Processing CreateTablet for tablet 66daa0e84b334222ac9af601b6a0a2dc (DEFAULT_TABLE table=soft_deleted_table [id=542dd44161144d8eacebc969699a5ca3]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:27:33.378415  3531 ts_tablet_manager.cc:1403] T 3eebe28a0e1b493581b05e588dd920d5 P 65bae5463b17443bb0fa568920a9ca19: Time spent bootstrapping tablet: real 0.136s	user 0.009s	sys 0.019s
I20260709 12:27:33.378904  3376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66daa0e84b334222ac9af601b6a0a2dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:33.380419  3223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66daa0e84b334222ac9af601b6a0a2dc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:27:33.367090  3275 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:37191, user_credentials={real_user=slave}} blocked reactor thread for 67402.3us
I20260709 12:27:33.385983  3531 raft_consensus.cc:359] T 3eebe28a0e1b493581b05e588dd920d5 P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.386893  3531 raft_consensus.cc:385] T 3eebe28a0e1b493581b05e588dd920d5 P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:33.387235  3531 raft_consensus.cc:740] T 3eebe28a0e1b493581b05e588dd920d5 P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65bae5463b17443bb0fa568920a9ca19, State: Initialized, Role: FOLLOWER
I20260709 12:27:33.388051  3227 tablet_service.cc:1511] Processing CreateTablet for tablet bfdfacb5c8bc4844936c037c39983f24 (DEFAULT_TABLE table=soft_deleted_table [id=542dd44161144d8eacebc969699a5ca3]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:27:33.391458  3227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfdfacb5c8bc4844936c037c39983f24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:33.394848  3371 tablet_service.cc:1511] Processing CreateTablet for tablet bfdfacb5c8bc4844936c037c39983f24 (DEFAULT_TABLE table=soft_deleted_table [id=542dd44161144d8eacebc969699a5ca3]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:27:33.396430  3371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfdfacb5c8bc4844936c037c39983f24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:33.404538  3531 consensus_queue.cc:260] T 3eebe28a0e1b493581b05e588dd920d5 P 65bae5463b17443bb0fa568920a9ca19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.394824  3528 tablet_bootstrap.cc:492] T 3eebe28a0e1b493581b05e588dd920d5 P d31e1edf8df54dd5a75e9fba6cc0a1f3: No bootstrap required, opened a new log
I20260709 12:27:33.410104  3528 ts_tablet_manager.cc:1403] T 3eebe28a0e1b493581b05e588dd920d5 P d31e1edf8df54dd5a75e9fba6cc0a1f3: Time spent bootstrapping tablet: real 0.160s	user 0.048s	sys 0.051s
I20260709 12:27:33.411479  3298 tablet_service.cc:1511] Processing CreateTablet for tablet bfdfacb5c8bc4844936c037c39983f24 (DEFAULT_TABLE table=soft_deleted_table [id=542dd44161144d8eacebc969699a5ca3]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:27:33.413225  3298 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfdfacb5c8bc4844936c037c39983f24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:33.413714  3528 raft_consensus.cc:359] T 3eebe28a0e1b493581b05e588dd920d5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.377386  3300 tablet_service.cc:1511] Processing CreateTablet for tablet 66daa0e84b334222ac9af601b6a0a2dc (DEFAULT_TABLE table=soft_deleted_table [id=542dd44161144d8eacebc969699a5ca3]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:27:33.414604  3528 raft_consensus.cc:385] T 3eebe28a0e1b493581b05e588dd920d5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:33.415019  3528 raft_consensus.cc:740] T 3eebe28a0e1b493581b05e588dd920d5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d31e1edf8df54dd5a75e9fba6cc0a1f3, State: Initialized, Role: FOLLOWER
I20260709 12:27:33.416252  3300 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66daa0e84b334222ac9af601b6a0a2dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:33.416687  3531 ts_tablet_manager.cc:1434] T 3eebe28a0e1b493581b05e588dd920d5 P 65bae5463b17443bb0fa568920a9ca19: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.003s
W20260709 12:27:33.419517  3183 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:33.427114  3531 tablet_bootstrap.cc:492] T 848e8cff9e5b4de6b49a1bd243e9f9aa P 65bae5463b17443bb0fa568920a9ca19: Bootstrap starting.
I20260709 12:27:33.435050  3530 tablet_bootstrap.cc:492] T 3eebe28a0e1b493581b05e588dd920d5 P e260c115ddf045e88e73893d7f8269db: No bootstrap required, opened a new log
I20260709 12:27:33.435699  3530 ts_tablet_manager.cc:1403] T 3eebe28a0e1b493581b05e588dd920d5 P e260c115ddf045e88e73893d7f8269db: Time spent bootstrapping tablet: real 0.159s	user 0.013s	sys 0.007s
I20260709 12:27:33.439148  3530 raft_consensus.cc:359] T 3eebe28a0e1b493581b05e588dd920d5 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.444257  3528 consensus_queue.cc:260] T 3eebe28a0e1b493581b05e588dd920d5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.457130  3528 ts_tablet_manager.cc:1434] T 3eebe28a0e1b493581b05e588dd920d5 P d31e1edf8df54dd5a75e9fba6cc0a1f3: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.000s
I20260709 12:27:33.458318  3528 tablet_bootstrap.cc:492] T 3ab18fc35bf84fd4876f3c9573c22c0d P d31e1edf8df54dd5a75e9fba6cc0a1f3: Bootstrap starting.
I20260709 12:27:33.463994  3530 raft_consensus.cc:385] T 3eebe28a0e1b493581b05e588dd920d5 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:33.464502  3530 raft_consensus.cc:740] T 3eebe28a0e1b493581b05e588dd920d5 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e260c115ddf045e88e73893d7f8269db, State: Initialized, Role: FOLLOWER
I20260709 12:27:33.465368  3530 consensus_queue.cc:260] T 3eebe28a0e1b493581b05e588dd920d5 P e260c115ddf045e88e73893d7f8269db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.467792  3530 ts_tablet_manager.cc:1434] T 3eebe28a0e1b493581b05e588dd920d5 P e260c115ddf045e88e73893d7f8269db: Time spent starting tablet: real 0.032s	user 0.003s	sys 0.001s
I20260709 12:27:33.470750  3531 tablet_bootstrap.cc:654] T 848e8cff9e5b4de6b49a1bd243e9f9aa P 65bae5463b17443bb0fa568920a9ca19: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:33.472991  3530 tablet_bootstrap.cc:492] T c4adb0932a604e779ef3ce9fff0b7bc5 P e260c115ddf045e88e73893d7f8269db: Bootstrap starting.
I20260709 12:27:33.477260  3528 tablet_bootstrap.cc:654] T 3ab18fc35bf84fd4876f3c9573c22c0d P d31e1edf8df54dd5a75e9fba6cc0a1f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:33.481009  3530 tablet_bootstrap.cc:654] T c4adb0932a604e779ef3ce9fff0b7bc5 P e260c115ddf045e88e73893d7f8269db: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:33.482779  3531 tablet_bootstrap.cc:492] T 848e8cff9e5b4de6b49a1bd243e9f9aa P 65bae5463b17443bb0fa568920a9ca19: No bootstrap required, opened a new log
I20260709 12:27:33.483603  3531 ts_tablet_manager.cc:1403] T 848e8cff9e5b4de6b49a1bd243e9f9aa P 65bae5463b17443bb0fa568920a9ca19: Time spent bootstrapping tablet: real 0.057s	user 0.006s	sys 0.007s
I20260709 12:27:33.486559  3530 tablet_bootstrap.cc:492] T c4adb0932a604e779ef3ce9fff0b7bc5 P e260c115ddf045e88e73893d7f8269db: No bootstrap required, opened a new log
I20260709 12:27:33.487145  3530 ts_tablet_manager.cc:1403] T c4adb0932a604e779ef3ce9fff0b7bc5 P e260c115ddf045e88e73893d7f8269db: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.004s
I20260709 12:27:33.487736  3531 raft_consensus.cc:359] T 848e8cff9e5b4de6b49a1bd243e9f9aa P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.488561  3531 raft_consensus.cc:385] T 848e8cff9e5b4de6b49a1bd243e9f9aa P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:33.488862  3531 raft_consensus.cc:740] T 848e8cff9e5b4de6b49a1bd243e9f9aa P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65bae5463b17443bb0fa568920a9ca19, State: Initialized, Role: FOLLOWER
I20260709 12:27:33.489704  3528 tablet_bootstrap.cc:492] T 3ab18fc35bf84fd4876f3c9573c22c0d P d31e1edf8df54dd5a75e9fba6cc0a1f3: No bootstrap required, opened a new log
I20260709 12:27:33.489676  3531 consensus_queue.cc:260] T 848e8cff9e5b4de6b49a1bd243e9f9aa P 65bae5463b17443bb0fa568920a9ca19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.490460  3528 ts_tablet_manager.cc:1403] T 3ab18fc35bf84fd4876f3c9573c22c0d P d31e1edf8df54dd5a75e9fba6cc0a1f3: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.008s
I20260709 12:27:33.490226  3530 raft_consensus.cc:359] T c4adb0932a604e779ef3ce9fff0b7bc5 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.491129  3530 raft_consensus.cc:385] T c4adb0932a604e779ef3ce9fff0b7bc5 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:33.491472  3530 raft_consensus.cc:740] T c4adb0932a604e779ef3ce9fff0b7bc5 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e260c115ddf045e88e73893d7f8269db, State: Initialized, Role: FOLLOWER
I20260709 12:27:33.492439  3530 consensus_queue.cc:260] T c4adb0932a604e779ef3ce9fff0b7bc5 P e260c115ddf045e88e73893d7f8269db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.492929  3531 ts_tablet_manager.cc:1434] T 848e8cff9e5b4de6b49a1bd243e9f9aa P 65bae5463b17443bb0fa568920a9ca19: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:27:33.494072  3531 tablet_bootstrap.cc:492] T c4adb0932a604e779ef3ce9fff0b7bc5 P 65bae5463b17443bb0fa568920a9ca19: Bootstrap starting.
I20260709 12:27:33.494856  3528 raft_consensus.cc:359] T 3ab18fc35bf84fd4876f3c9573c22c0d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.495496  3530 ts_tablet_manager.cc:1434] T c4adb0932a604e779ef3ce9fff0b7bc5 P e260c115ddf045e88e73893d7f8269db: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:27:33.495760  3528 raft_consensus.cc:385] T 3ab18fc35bf84fd4876f3c9573c22c0d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:33.496124  3528 raft_consensus.cc:740] T 3ab18fc35bf84fd4876f3c9573c22c0d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d31e1edf8df54dd5a75e9fba6cc0a1f3, State: Initialized, Role: FOLLOWER
I20260709 12:27:33.496830  3530 tablet_bootstrap.cc:492] T 821be9b5927a481ab065336d9a5c6522 P e260c115ddf045e88e73893d7f8269db: Bootstrap starting.
I20260709 12:27:33.497011  3528 consensus_queue.cc:260] T 3ab18fc35bf84fd4876f3c9573c22c0d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.501916  3531 tablet_bootstrap.cc:654] T c4adb0932a604e779ef3ce9fff0b7bc5 P 65bae5463b17443bb0fa568920a9ca19: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:33.502475  3528 ts_tablet_manager.cc:1434] T 3ab18fc35bf84fd4876f3c9573c22c0d P d31e1edf8df54dd5a75e9fba6cc0a1f3: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:27:33.503634  3528 tablet_bootstrap.cc:492] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P d31e1edf8df54dd5a75e9fba6cc0a1f3: Bootstrap starting.
I20260709 12:27:33.504729  3530 tablet_bootstrap.cc:654] T 821be9b5927a481ab065336d9a5c6522 P e260c115ddf045e88e73893d7f8269db: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:33.510576  3512 raft_consensus.cc:493] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:33.511162  3512 raft_consensus.cc:515] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.513444  3512 leader_election.cc:290] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915)
I20260709 12:27:33.514091  3528 tablet_bootstrap.cc:654] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P d31e1edf8df54dd5a75e9fba6cc0a1f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:33.516026  3235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848e8cff9e5b4de6b49a1bd243e9f9aa" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19" is_pre_election: true
I20260709 12:27:33.516776  3235 raft_consensus.cc:2468] T 848e8cff9e5b4de6b49a1bd243e9f9aa P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e260c115ddf045e88e73893d7f8269db in term 0.
I20260709 12:27:33.517984  3311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848e8cff9e5b4de6b49a1bd243e9f9aa" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" is_pre_election: true
I20260709 12:27:33.518754  3311 raft_consensus.cc:2468] T 848e8cff9e5b4de6b49a1bd243e9f9aa P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e260c115ddf045e88e73893d7f8269db in term 0.
I20260709 12:27:33.520690  3351 leader_election.cc:304] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d31e1edf8df54dd5a75e9fba6cc0a1f3, e260c115ddf045e88e73893d7f8269db; no voters: 
I20260709 12:27:33.522241  3512 raft_consensus.cc:2804] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:33.522667  3512 raft_consensus.cc:493] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:33.523064  3512 raft_consensus.cc:3060] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:33.529309  3528 tablet_bootstrap.cc:492] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P d31e1edf8df54dd5a75e9fba6cc0a1f3: No bootstrap required, opened a new log
I20260709 12:27:33.530102  3528 ts_tablet_manager.cc:1403] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P d31e1edf8df54dd5a75e9fba6cc0a1f3: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.012s
I20260709 12:27:33.532848  3512 raft_consensus.cc:515] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.534073  3528 raft_consensus.cc:359] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.535164  3528 raft_consensus.cc:385] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:33.535550  3528 raft_consensus.cc:740] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d31e1edf8df54dd5a75e9fba6cc0a1f3, State: Initialized, Role: FOLLOWER
I20260709 12:27:33.535959  3235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848e8cff9e5b4de6b49a1bd243e9f9aa" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19"
I20260709 12:27:33.536726  3235 raft_consensus.cc:3060] T 848e8cff9e5b4de6b49a1bd243e9f9aa P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:33.536897  3528 consensus_queue.cc:260] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P d31e1edf8df54dd5a75e9fba6cc0a1f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.543494  3528 ts_tablet_manager.cc:1434] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P d31e1edf8df54dd5a75e9fba6cc0a1f3: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.004s
I20260709 12:27:33.544456  3530 tablet_bootstrap.cc:492] T 821be9b5927a481ab065336d9a5c6522 P e260c115ddf045e88e73893d7f8269db: No bootstrap required, opened a new log
I20260709 12:27:33.544793  3528 tablet_bootstrap.cc:492] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3: Bootstrap starting.
I20260709 12:27:33.545356  3530 ts_tablet_manager.cc:1403] T 821be9b5927a481ab065336d9a5c6522 P e260c115ddf045e88e73893d7f8269db: Time spent bootstrapping tablet: real 0.049s	user 0.013s	sys 0.004s
I20260709 12:27:33.546121  3235 raft_consensus.cc:2468] T 848e8cff9e5b4de6b49a1bd243e9f9aa P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e260c115ddf045e88e73893d7f8269db in term 1.
I20260709 12:27:33.547741  3351 leader_election.cc:304] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, e260c115ddf045e88e73893d7f8269db; no voters: 
I20260709 12:27:33.550453  3512 leader_election.cc:290] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 1 election: Requested vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915)
I20260709 12:27:33.551218  3512 raft_consensus.cc:2804] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:33.551545  3531 tablet_bootstrap.cc:492] T c4adb0932a604e779ef3ce9fff0b7bc5 P 65bae5463b17443bb0fa568920a9ca19: No bootstrap required, opened a new log
I20260709 12:27:33.551837  3512 raft_consensus.cc:697] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [term 1 LEADER]: Becoming Leader. State: Replica: e260c115ddf045e88e73893d7f8269db, State: Running, Role: LEADER
I20260709 12:27:33.552330  3531 ts_tablet_manager.cc:1403] T c4adb0932a604e779ef3ce9fff0b7bc5 P 65bae5463b17443bb0fa568920a9ca19: Time spent bootstrapping tablet: real 0.058s	user 0.027s	sys 0.017s
I20260709 12:27:33.553114  3512 consensus_queue.cc:237] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.556252  3515 raft_consensus.cc:493] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:33.560783  3311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848e8cff9e5b4de6b49a1bd243e9f9aa" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3"
I20260709 12:27:33.561676  3311 raft_consensus.cc:3060] T 848e8cff9e5b4de6b49a1bd243e9f9aa P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:33.561939  3528 tablet_bootstrap.cc:654] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:33.557124  3515 raft_consensus.cc:515] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.570004  3515 leader_election.cc:290] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:33.571522  3385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c6742a5e0e4b0eb07abd8f93c2a8fb" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db" is_pre_election: true
I20260709 12:27:33.571408  3530 raft_consensus.cc:359] T 821be9b5927a481ab065336d9a5c6522 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.572320  3530 raft_consensus.cc:385] T 821be9b5927a481ab065336d9a5c6522 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:33.572656  3530 raft_consensus.cc:740] T 821be9b5927a481ab065336d9a5c6522 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e260c115ddf045e88e73893d7f8269db, State: Initialized, Role: FOLLOWER
W20260709 12:27:33.573499  3275 leader_election.cc:343] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:33.573539  3530 consensus_queue.cc:260] T 821be9b5927a481ab065336d9a5c6522 P e260c115ddf045e88e73893d7f8269db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.575452  3311 raft_consensus.cc:2468] T 848e8cff9e5b4de6b49a1bd243e9f9aa P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e260c115ddf045e88e73893d7f8269db in term 1.
I20260709 12:27:33.577376  3530 ts_tablet_manager.cc:1434] T 821be9b5927a481ab065336d9a5c6522 P e260c115ddf045e88e73893d7f8269db: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 12:27:33.579015  3530 tablet_bootstrap.cc:492] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P e260c115ddf045e88e73893d7f8269db: Bootstrap starting.
I20260709 12:27:33.578708  3235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c6742a5e0e4b0eb07abd8f93c2a8fb" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19" is_pre_election: true
I20260709 12:27:33.583997  3531 raft_consensus.cc:359] T c4adb0932a604e779ef3ce9fff0b7bc5 P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.584872  3531 raft_consensus.cc:385] T c4adb0932a604e779ef3ce9fff0b7bc5 P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:33.585230  3531 raft_consensus.cc:740] T c4adb0932a604e779ef3ce9fff0b7bc5 P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65bae5463b17443bb0fa568920a9ca19, State: Initialized, Role: FOLLOWER
W20260709 12:27:33.585901  3277 leader_election.cc:343] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:33.586072  3531 consensus_queue.cc:260] T c4adb0932a604e779ef3ce9fff0b7bc5 P 65bae5463b17443bb0fa568920a9ca19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.586766  3277 leader_election.cc:304] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d31e1edf8df54dd5a75e9fba6cc0a1f3; no voters: 65bae5463b17443bb0fa568920a9ca19, e260c115ddf045e88e73893d7f8269db
I20260709 12:27:33.587355  3530 tablet_bootstrap.cc:654] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P e260c115ddf045e88e73893d7f8269db: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:33.588097  3515 raft_consensus.cc:2749] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:33.589375  3531 ts_tablet_manager.cc:1434] T c4adb0932a604e779ef3ce9fff0b7bc5 P 65bae5463b17443bb0fa568920a9ca19: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.000s
I20260709 12:27:33.590626  3531 tablet_bootstrap.cc:492] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P 65bae5463b17443bb0fa568920a9ca19: Bootstrap starting.
I20260709 12:27:33.592356  3132 catalog_manager.cc:5697] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db reported cstate change: term changed from 0 to 1, leader changed from <none> to e260c115ddf045e88e73893d7f8269db (127.23.245.131). New cstate: current_term: 1 leader_uuid: "e260c115ddf045e88e73893d7f8269db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:33.600786  3531 tablet_bootstrap.cc:654] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P 65bae5463b17443bb0fa568920a9ca19: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:33.606140  3528 tablet_bootstrap.cc:492] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3: No bootstrap required, opened a new log
I20260709 12:27:33.606736  3528 ts_tablet_manager.cc:1403] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3: Time spent bootstrapping tablet: real 0.062s	user 0.025s	sys 0.008s
I20260709 12:27:33.608238  3531 tablet_bootstrap.cc:492] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P 65bae5463b17443bb0fa568920a9ca19: No bootstrap required, opened a new log
I20260709 12:27:33.608281  3530 tablet_bootstrap.cc:492] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P e260c115ddf045e88e73893d7f8269db: No bootstrap required, opened a new log
I20260709 12:27:33.609030  3531 ts_tablet_manager.cc:1403] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P 65bae5463b17443bb0fa568920a9ca19: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.002s
I20260709 12:27:33.609095  3530 ts_tablet_manager.cc:1403] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P e260c115ddf045e88e73893d7f8269db: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.011s
I20260709 12:27:33.610291  3528 raft_consensus.cc:359] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.611156  3528 raft_consensus.cc:385] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:33.611442  3528 raft_consensus.cc:740] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d31e1edf8df54dd5a75e9fba6cc0a1f3, State: Initialized, Role: FOLLOWER
I20260709 12:27:33.612282  3528 consensus_queue.cc:260] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.612833  3530 raft_consensus.cc:359] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.612628  3531 raft_consensus.cc:359] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.614260  3531 raft_consensus.cc:385] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:33.614612  3531 raft_consensus.cc:740] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65bae5463b17443bb0fa568920a9ca19, State: Initialized, Role: FOLLOWER
I20260709 12:27:33.615329  3528 ts_tablet_manager.cc:1434] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:27:33.613780  3530 raft_consensus.cc:385] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:33.616168  3530 raft_consensus.cc:740] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e260c115ddf045e88e73893d7f8269db, State: Initialized, Role: FOLLOWER
I20260709 12:27:33.616436  3528 tablet_bootstrap.cc:492] T c4adb0932a604e779ef3ce9fff0b7bc5 P d31e1edf8df54dd5a75e9fba6cc0a1f3: Bootstrap starting.
I20260709 12:27:33.617051  3530 consensus_queue.cc:260] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P e260c115ddf045e88e73893d7f8269db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.619117  3530 ts_tablet_manager.cc:1434] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P e260c115ddf045e88e73893d7f8269db: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:27:33.620483  3530 tablet_bootstrap.cc:492] T 3ab18fc35bf84fd4876f3c9573c22c0d P e260c115ddf045e88e73893d7f8269db: Bootstrap starting.
I20260709 12:27:33.623104  3528 tablet_bootstrap.cc:654] T c4adb0932a604e779ef3ce9fff0b7bc5 P d31e1edf8df54dd5a75e9fba6cc0a1f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:33.615481  3531 consensus_queue.cc:260] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P 65bae5463b17443bb0fa568920a9ca19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.625281  3512 raft_consensus.cc:493] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:33.625806  3512 raft_consensus.cc:515] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.628623  3512 leader_election.cc:290] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915)
I20260709 12:27:33.631963  3530 tablet_bootstrap.cc:654] T 3ab18fc35bf84fd4876f3c9573c22c0d P e260c115ddf045e88e73893d7f8269db: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:33.632272  3311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c6742a5e0e4b0eb07abd8f93c2a8fb" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" is_pre_election: true
I20260709 12:27:33.633018  3311 raft_consensus.cc:2468] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e260c115ddf045e88e73893d7f8269db in term 0.
I20260709 12:27:33.634019  3235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c6742a5e0e4b0eb07abd8f93c2a8fb" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19" is_pre_election: true
I20260709 12:27:33.634720  3235 raft_consensus.cc:2468] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e260c115ddf045e88e73893d7f8269db in term 0.
I20260709 12:27:33.634719  3528 tablet_bootstrap.cc:492] T c4adb0932a604e779ef3ce9fff0b7bc5 P d31e1edf8df54dd5a75e9fba6cc0a1f3: No bootstrap required, opened a new log
I20260709 12:27:33.635864  3351 leader_election.cc:304] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, e260c115ddf045e88e73893d7f8269db; no voters: 
I20260709 12:27:33.636315  3528 ts_tablet_manager.cc:1403] T c4adb0932a604e779ef3ce9fff0b7bc5 P d31e1edf8df54dd5a75e9fba6cc0a1f3: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.007s
I20260709 12:27:33.638324  3544 raft_consensus.cc:2804] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:33.638715  3544 raft_consensus.cc:493] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:33.639039  3544 raft_consensus.cc:3060] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:33.639523  3528 raft_consensus.cc:359] T c4adb0932a604e779ef3ce9fff0b7bc5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.640306  3528 raft_consensus.cc:385] T c4adb0932a604e779ef3ce9fff0b7bc5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:33.640691  3528 raft_consensus.cc:740] T c4adb0932a604e779ef3ce9fff0b7bc5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d31e1edf8df54dd5a75e9fba6cc0a1f3, State: Initialized, Role: FOLLOWER
I20260709 12:27:33.641644  3528 consensus_queue.cc:260] T c4adb0932a604e779ef3ce9fff0b7bc5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.648873  3528 ts_tablet_manager.cc:1434] T c4adb0932a604e779ef3ce9fff0b7bc5 P d31e1edf8df54dd5a75e9fba6cc0a1f3: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:27:33.649995  3528 tablet_bootstrap.cc:492] T bfdfacb5c8bc4844936c037c39983f24 P d31e1edf8df54dd5a75e9fba6cc0a1f3: Bootstrap starting.
I20260709 12:27:33.652448  3531 ts_tablet_manager.cc:1434] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P 65bae5463b17443bb0fa568920a9ca19: Time spent starting tablet: real 0.043s	user 0.009s	sys 0.000s
I20260709 12:27:33.655907  3531 tablet_bootstrap.cc:492] T 18abc32bcdc8438d8f5438356c0b68bb P 65bae5463b17443bb0fa568920a9ca19: Bootstrap starting.
I20260709 12:27:33.658903  3530 tablet_bootstrap.cc:492] T 3ab18fc35bf84fd4876f3c9573c22c0d P e260c115ddf045e88e73893d7f8269db: No bootstrap required, opened a new log
I20260709 12:27:33.654237  3544 raft_consensus.cc:515] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.659519  3530 ts_tablet_manager.cc:1403] T 3ab18fc35bf84fd4876f3c9573c22c0d P e260c115ddf045e88e73893d7f8269db: Time spent bootstrapping tablet: real 0.039s	user 0.017s	sys 0.009s
I20260709 12:27:33.662662  3530 raft_consensus.cc:359] T 3ab18fc35bf84fd4876f3c9573c22c0d P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.663098  3235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c6742a5e0e4b0eb07abd8f93c2a8fb" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19"
I20260709 12:27:33.663456  3530 raft_consensus.cc:385] T 3ab18fc35bf84fd4876f3c9573c22c0d P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:33.663784  3235 raft_consensus.cc:3060] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:33.665019  3528 tablet_bootstrap.cc:654] T bfdfacb5c8bc4844936c037c39983f24 P d31e1edf8df54dd5a75e9fba6cc0a1f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:33.666981  3311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c6742a5e0e4b0eb07abd8f93c2a8fb" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3"
I20260709 12:27:33.667663  3311 raft_consensus.cc:3060] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:33.663823  3530 raft_consensus.cc:740] T 3ab18fc35bf84fd4876f3c9573c22c0d P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e260c115ddf045e88e73893d7f8269db, State: Initialized, Role: FOLLOWER
I20260709 12:27:33.668617  3544 leader_election.cc:290] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 1 election: Requested vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915)
I20260709 12:27:33.672971  3531 tablet_bootstrap.cc:654] T 18abc32bcdc8438d8f5438356c0b68bb P 65bae5463b17443bb0fa568920a9ca19: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:33.672916  3235 raft_consensus.cc:2468] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e260c115ddf045e88e73893d7f8269db in term 1.
I20260709 12:27:33.670342  3530 consensus_queue.cc:260] T 3ab18fc35bf84fd4876f3c9573c22c0d P e260c115ddf045e88e73893d7f8269db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.677495  3351 leader_election.cc:304] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, e260c115ddf045e88e73893d7f8269db; no voters: 
I20260709 12:27:33.678412  3544 raft_consensus.cc:2804] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:33.678874  3544 raft_consensus.cc:697] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P e260c115ddf045e88e73893d7f8269db [term 1 LEADER]: Becoming Leader. State: Replica: e260c115ddf045e88e73893d7f8269db, State: Running, Role: LEADER
I20260709 12:27:33.679574  3544 consensus_queue.cc:237] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P e260c115ddf045e88e73893d7f8269db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.680074  3530 ts_tablet_manager.cc:1434] T 3ab18fc35bf84fd4876f3c9573c22c0d P e260c115ddf045e88e73893d7f8269db: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:27:33.681538  3530 tablet_bootstrap.cc:492] T 66daa0e84b334222ac9af601b6a0a2dc P e260c115ddf045e88e73893d7f8269db: Bootstrap starting.
I20260709 12:27:33.684741  3311 raft_consensus.cc:2468] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e260c115ddf045e88e73893d7f8269db in term 1.
I20260709 12:27:33.686709  3528 tablet_bootstrap.cc:492] T bfdfacb5c8bc4844936c037c39983f24 P d31e1edf8df54dd5a75e9fba6cc0a1f3: No bootstrap required, opened a new log
I20260709 12:27:33.688552  3528 ts_tablet_manager.cc:1403] T bfdfacb5c8bc4844936c037c39983f24 P d31e1edf8df54dd5a75e9fba6cc0a1f3: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.001s
I20260709 12:27:33.690526  3530 tablet_bootstrap.cc:654] T 66daa0e84b334222ac9af601b6a0a2dc P e260c115ddf045e88e73893d7f8269db: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:33.692211  3528 raft_consensus.cc:359] T bfdfacb5c8bc4844936c037c39983f24 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.693037  3528 raft_consensus.cc:385] T bfdfacb5c8bc4844936c037c39983f24 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:33.693372  3528 raft_consensus.cc:740] T bfdfacb5c8bc4844936c037c39983f24 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d31e1edf8df54dd5a75e9fba6cc0a1f3, State: Initialized, Role: FOLLOWER
I20260709 12:27:33.694180  3528 consensus_queue.cc:260] T bfdfacb5c8bc4844936c037c39983f24 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.698549  3528 ts_tablet_manager.cc:1434] T bfdfacb5c8bc4844936c037c39983f24 P d31e1edf8df54dd5a75e9fba6cc0a1f3: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:27:33.700603  3528 tablet_bootstrap.cc:492] T 66daa0e84b334222ac9af601b6a0a2dc P d31e1edf8df54dd5a75e9fba6cc0a1f3: Bootstrap starting.
I20260709 12:27:33.706445  3528 tablet_bootstrap.cc:654] T 66daa0e84b334222ac9af601b6a0a2dc P d31e1edf8df54dd5a75e9fba6cc0a1f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:33.706961  3132 catalog_manager.cc:5697] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P e260c115ddf045e88e73893d7f8269db reported cstate change: term changed from 0 to 1, leader changed from <none> to e260c115ddf045e88e73893d7f8269db (127.23.245.131). New cstate: current_term: 1 leader_uuid: "e260c115ddf045e88e73893d7f8269db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:33.709251  3531 tablet_bootstrap.cc:492] T 18abc32bcdc8438d8f5438356c0b68bb P 65bae5463b17443bb0fa568920a9ca19: No bootstrap required, opened a new log
I20260709 12:27:33.709882  3531 ts_tablet_manager.cc:1403] T 18abc32bcdc8438d8f5438356c0b68bb P 65bae5463b17443bb0fa568920a9ca19: Time spent bootstrapping tablet: real 0.054s	user 0.022s	sys 0.010s
I20260709 12:27:33.712955  3531 raft_consensus.cc:359] T 18abc32bcdc8438d8f5438356c0b68bb P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.713692  3531 raft_consensus.cc:385] T 18abc32bcdc8438d8f5438356c0b68bb P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:33.713971  3531 raft_consensus.cc:740] T 18abc32bcdc8438d8f5438356c0b68bb P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65bae5463b17443bb0fa568920a9ca19, State: Initialized, Role: FOLLOWER
I20260709 12:27:33.714848  3530 tablet_bootstrap.cc:492] T 66daa0e84b334222ac9af601b6a0a2dc P e260c115ddf045e88e73893d7f8269db: No bootstrap required, opened a new log
I20260709 12:27:33.714723  3531 consensus_queue.cc:260] T 18abc32bcdc8438d8f5438356c0b68bb P 65bae5463b17443bb0fa568920a9ca19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.715391  3530 ts_tablet_manager.cc:1403] T 66daa0e84b334222ac9af601b6a0a2dc P e260c115ddf045e88e73893d7f8269db: Time spent bootstrapping tablet: real 0.034s	user 0.018s	sys 0.001s
I20260709 12:27:33.718343  3530 raft_consensus.cc:359] T 66daa0e84b334222ac9af601b6a0a2dc P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.719038  3530 raft_consensus.cc:385] T 66daa0e84b334222ac9af601b6a0a2dc P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:33.719326  3530 raft_consensus.cc:740] T 66daa0e84b334222ac9af601b6a0a2dc P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e260c115ddf045e88e73893d7f8269db, State: Initialized, Role: FOLLOWER
I20260709 12:27:33.720034  3530 consensus_queue.cc:260] T 66daa0e84b334222ac9af601b6a0a2dc P e260c115ddf045e88e73893d7f8269db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.720475  3531 ts_tablet_manager.cc:1434] T 18abc32bcdc8438d8f5438356c0b68bb P 65bae5463b17443bb0fa568920a9ca19: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.002s
I20260709 12:27:33.721526  3531 tablet_bootstrap.cc:492] T 3ab18fc35bf84fd4876f3c9573c22c0d P 65bae5463b17443bb0fa568920a9ca19: Bootstrap starting.
I20260709 12:27:33.723321  3528 tablet_bootstrap.cc:492] T 66daa0e84b334222ac9af601b6a0a2dc P d31e1edf8df54dd5a75e9fba6cc0a1f3: No bootstrap required, opened a new log
I20260709 12:27:33.723898  3528 ts_tablet_manager.cc:1403] T 66daa0e84b334222ac9af601b6a0a2dc P d31e1edf8df54dd5a75e9fba6cc0a1f3: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.003s
I20260709 12:27:33.726768  3530 ts_tablet_manager.cc:1434] T 66daa0e84b334222ac9af601b6a0a2dc P e260c115ddf045e88e73893d7f8269db: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:27:33.726575  3528 raft_consensus.cc:359] T 66daa0e84b334222ac9af601b6a0a2dc P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.727372  3528 raft_consensus.cc:385] T 66daa0e84b334222ac9af601b6a0a2dc P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:33.727715  3528 raft_consensus.cc:740] T 66daa0e84b334222ac9af601b6a0a2dc P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d31e1edf8df54dd5a75e9fba6cc0a1f3, State: Initialized, Role: FOLLOWER
I20260709 12:27:33.727872  3530 tablet_bootstrap.cc:492] T bfdfacb5c8bc4844936c037c39983f24 P e260c115ddf045e88e73893d7f8269db: Bootstrap starting.
I20260709 12:27:33.728094  3531 tablet_bootstrap.cc:654] T 3ab18fc35bf84fd4876f3c9573c22c0d P 65bae5463b17443bb0fa568920a9ca19: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:33.728713  3528 consensus_queue.cc:260] T 66daa0e84b334222ac9af601b6a0a2dc P d31e1edf8df54dd5a75e9fba6cc0a1f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.737288  3515 raft_consensus.cc:493] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:33.737847  3515 raft_consensus.cc:515] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.754241  3528 ts_tablet_manager.cc:1434] T 66daa0e84b334222ac9af601b6a0a2dc P d31e1edf8df54dd5a75e9fba6cc0a1f3: Time spent starting tablet: real 0.030s	user 0.012s	sys 0.005s
I20260709 12:27:33.757055  3386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821be9b5927a481ab065336d9a5c6522" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db" is_pre_election: true
I20260709 12:27:33.757503  3544 raft_consensus.cc:493] T 66daa0e84b334222ac9af601b6a0a2dc P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:33.757788  3386 raft_consensus.cc:2468] T 821be9b5927a481ab065336d9a5c6522 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d31e1edf8df54dd5a75e9fba6cc0a1f3 in term 0.
I20260709 12:27:33.758040  3544 raft_consensus.cc:515] T 66daa0e84b334222ac9af601b6a0a2dc P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.759148  3275 leader_election.cc:304] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d31e1edf8df54dd5a75e9fba6cc0a1f3, e260c115ddf045e88e73893d7f8269db; no voters: 
I20260709 12:27:33.759428  3530 tablet_bootstrap.cc:654] T bfdfacb5c8bc4844936c037c39983f24 P e260c115ddf045e88e73893d7f8269db: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:33.760354  3544 leader_election.cc:290] T 66daa0e84b334222ac9af601b6a0a2dc P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915)
I20260709 12:27:33.762723  3528 tablet_bootstrap.cc:492] T 18abc32bcdc8438d8f5438356c0b68bb P d31e1edf8df54dd5a75e9fba6cc0a1f3: Bootstrap starting.
I20260709 12:27:33.763628  3529 raft_consensus.cc:493] T 3eebe28a0e1b493581b05e588dd920d5 P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:33.764181  3529 raft_consensus.cc:515] T 3eebe28a0e1b493581b05e588dd920d5 P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.766294  3529 leader_election.cc:290] T 3eebe28a0e1b493581b05e588dd920d5 P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:33.763481  3311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66daa0e84b334222ac9af601b6a0a2dc" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" is_pre_election: true
I20260709 12:27:33.767501  3311 raft_consensus.cc:2468] T 66daa0e84b334222ac9af601b6a0a2dc P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e260c115ddf045e88e73893d7f8269db in term 0.
I20260709 12:27:33.768915  3351 leader_election.cc:304] T 66daa0e84b334222ac9af601b6a0a2dc P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d31e1edf8df54dd5a75e9fba6cc0a1f3, e260c115ddf045e88e73893d7f8269db; no voters: 
I20260709 12:27:33.770443  3544 raft_consensus.cc:2804] T 66daa0e84b334222ac9af601b6a0a2dc P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:33.770923  3544 raft_consensus.cc:493] T 66daa0e84b334222ac9af601b6a0a2dc P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:33.771343  3544 raft_consensus.cc:3060] T 66daa0e84b334222ac9af601b6a0a2dc P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:33.773536  3515 leader_election.cc:290] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:33.774163  3515 raft_consensus.cc:493] T 3ab18fc35bf84fd4876f3c9573c22c0d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:33.774626  3515 raft_consensus.cc:515] T 3ab18fc35bf84fd4876f3c9573c22c0d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.776767  3512 raft_consensus.cc:493] T 3eebe28a0e1b493581b05e588dd920d5 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:33.777529  3512 raft_consensus.cc:515] T 3eebe28a0e1b493581b05e588dd920d5 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.780579  3235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66daa0e84b334222ac9af601b6a0a2dc" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19" is_pre_election: true
W20260709 12:27:33.782647  3351 leader_election.cc:343] T 66daa0e84b334222ac9af601b6a0a2dc P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:33.783792  3386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eebe28a0e1b493581b05e588dd920d5" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db" is_pre_election: true
I20260709 12:27:33.784523  3386 raft_consensus.cc:2468] T 3eebe28a0e1b493581b05e588dd920d5 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65bae5463b17443bb0fa568920a9ca19 in term 0.
I20260709 12:27:33.785653  3200 leader_election.cc:304] T 3eebe28a0e1b493581b05e588dd920d5 P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, e260c115ddf045e88e73893d7f8269db; no voters: 
I20260709 12:27:33.786167  3512 leader_election.cc:290] T 3eebe28a0e1b493581b05e588dd920d5 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915)
I20260709 12:27:33.793496  3559 raft_consensus.cc:2804] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:33.793990  3559 raft_consensus.cc:493] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:33.794327  3559 raft_consensus.cc:3060] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:33.794485  3515 leader_election.cc:290] T 3ab18fc35bf84fd4876f3c9573c22c0d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:33.796007  3512 raft_consensus.cc:493] T c4adb0932a604e779ef3ce9fff0b7bc5 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:33.796962  3512 raft_consensus.cc:515] T c4adb0932a604e779ef3ce9fff0b7bc5 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.791615  3529 raft_consensus.cc:2804] T 3eebe28a0e1b493581b05e588dd920d5 P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:33.797775  3235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eebe28a0e1b493581b05e588dd920d5" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19" is_pre_election: true
I20260709 12:27:33.797935  3529 raft_consensus.cc:493] T 3eebe28a0e1b493581b05e588dd920d5 P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:33.798317  3312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eebe28a0e1b493581b05e588dd920d5" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" is_pre_election: true
I20260709 12:27:33.798735  3529 raft_consensus.cc:3060] T 3eebe28a0e1b493581b05e588dd920d5 P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:33.799005  3312 raft_consensus.cc:2468] T 3eebe28a0e1b493581b05e588dd920d5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65bae5463b17443bb0fa568920a9ca19 in term 0.
I20260709 12:27:33.799362  3512 leader_election.cc:290] T c4adb0932a604e779ef3ce9fff0b7bc5 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915)
I20260709 12:27:33.800096  3311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eebe28a0e1b493581b05e588dd920d5" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" is_pre_election: true
I20260709 12:27:33.801210  3528 tablet_bootstrap.cc:654] T 18abc32bcdc8438d8f5438356c0b68bb P d31e1edf8df54dd5a75e9fba6cc0a1f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:33.801608  3311 raft_consensus.cc:2468] T 3eebe28a0e1b493581b05e588dd920d5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e260c115ddf045e88e73893d7f8269db in term 0.
I20260709 12:27:33.803774  3386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ab18fc35bf84fd4876f3c9573c22c0d" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db" is_pre_election: true
I20260709 12:27:33.804345  3386 raft_consensus.cc:2468] T 3ab18fc35bf84fd4876f3c9573c22c0d P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d31e1edf8df54dd5a75e9fba6cc0a1f3 in term 0.
I20260709 12:27:33.805476  3311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4adb0932a604e779ef3ce9fff0b7bc5" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" is_pre_election: true
I20260709 12:27:33.805792  3237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4adb0932a604e779ef3ce9fff0b7bc5" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19" is_pre_election: true
I20260709 12:27:33.806147  3311 raft_consensus.cc:2468] T c4adb0932a604e779ef3ce9fff0b7bc5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e260c115ddf045e88e73893d7f8269db in term 0.
I20260709 12:27:33.806494  3531 tablet_bootstrap.cc:492] T 3ab18fc35bf84fd4876f3c9573c22c0d P 65bae5463b17443bb0fa568920a9ca19: No bootstrap required, opened a new log
I20260709 12:27:33.806496  3237 raft_consensus.cc:2468] T c4adb0932a604e779ef3ce9fff0b7bc5 P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e260c115ddf045e88e73893d7f8269db in term 0.
I20260709 12:27:33.807189  3531 ts_tablet_manager.cc:1403] T 3ab18fc35bf84fd4876f3c9573c22c0d P 65bae5463b17443bb0fa568920a9ca19: Time spent bootstrapping tablet: real 0.086s	user 0.005s	sys 0.008s
I20260709 12:27:33.804790  3351 leader_election.cc:304] T 3eebe28a0e1b493581b05e588dd920d5 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d31e1edf8df54dd5a75e9fba6cc0a1f3, e260c115ddf045e88e73893d7f8269db; no voters: 
I20260709 12:27:33.808517  3351 leader_election.cc:304] T c4adb0932a604e779ef3ce9fff0b7bc5 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, e260c115ddf045e88e73893d7f8269db; no voters: 
W20260709 12:27:33.809353  3277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:44391, user_credentials={real_user=slave}} blocked reactor thread for 54786us
I20260709 12:27:33.809966  3512 raft_consensus.cc:2804] T 3eebe28a0e1b493581b05e588dd920d5 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:33.810467  3512 raft_consensus.cc:493] T 3eebe28a0e1b493581b05e588dd920d5 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:33.810803  3512 raft_consensus.cc:3060] T 3eebe28a0e1b493581b05e588dd920d5 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:33.811175  3530 tablet_bootstrap.cc:492] T bfdfacb5c8bc4844936c037c39983f24 P e260c115ddf045e88e73893d7f8269db: No bootstrap required, opened a new log
I20260709 12:27:33.811301  3237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821be9b5927a481ab065336d9a5c6522" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19" is_pre_election: true
I20260709 12:27:33.811820  3530 ts_tablet_manager.cc:1403] T bfdfacb5c8bc4844936c037c39983f24 P e260c115ddf045e88e73893d7f8269db: Time spent bootstrapping tablet: real 0.084s	user 0.030s	sys 0.040s
I20260709 12:27:33.812288  3529 raft_consensus.cc:515] T 3eebe28a0e1b493581b05e588dd920d5 P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.813519  3235 raft_consensus.cc:2393] T 3eebe28a0e1b493581b05e588dd920d5 P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e260c115ddf045e88e73893d7f8269db in current term 1: Already voted for candidate 65bae5463b17443bb0fa568920a9ca19 in this term.
I20260709 12:27:33.813618  3531 raft_consensus.cc:359] T 3ab18fc35bf84fd4876f3c9573c22c0d P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.814431  3531 raft_consensus.cc:385] T 3ab18fc35bf84fd4876f3c9573c22c0d P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:33.814718  3531 raft_consensus.cc:740] T 3ab18fc35bf84fd4876f3c9573c22c0d P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65bae5463b17443bb0fa568920a9ca19, State: Initialized, Role: FOLLOWER
I20260709 12:27:33.815434  3531 consensus_queue.cc:260] T 3ab18fc35bf84fd4876f3c9573c22c0d P 65bae5463b17443bb0fa568920a9ca19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.815757  3311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eebe28a0e1b493581b05e588dd920d5" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3"
I20260709 12:27:33.816465  3311 raft_consensus.cc:3060] T 3eebe28a0e1b493581b05e588dd920d5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:33.818223  3235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ab18fc35bf84fd4876f3c9573c22c0d" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19" is_pre_election: true
I20260709 12:27:33.818701  3275 leader_election.cc:304] T 3ab18fc35bf84fd4876f3c9573c22c0d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d31e1edf8df54dd5a75e9fba6cc0a1f3, e260c115ddf045e88e73893d7f8269db; no voters: 
I20260709 12:27:33.818899  3235 raft_consensus.cc:2468] T 3ab18fc35bf84fd4876f3c9573c22c0d P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d31e1edf8df54dd5a75e9fba6cc0a1f3 in term 0.
I20260709 12:27:33.819761  3557 raft_consensus.cc:2804] T 3ab18fc35bf84fd4876f3c9573c22c0d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:27:33.820703  3277 leader_election.cc:343] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:33.816165  3544 raft_consensus.cc:515] T 66daa0e84b334222ac9af601b6a0a2dc P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.823006  3530 raft_consensus.cc:359] T bfdfacb5c8bc4844936c037c39983f24 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.823817  3530 raft_consensus.cc:385] T bfdfacb5c8bc4844936c037c39983f24 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:33.824222  3530 raft_consensus.cc:740] T bfdfacb5c8bc4844936c037c39983f24 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e260c115ddf045e88e73893d7f8269db, State: Initialized, Role: FOLLOWER
I20260709 12:27:33.824980  3530 consensus_queue.cc:260] T bfdfacb5c8bc4844936c037c39983f24 P e260c115ddf045e88e73893d7f8269db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.822175  3557 raft_consensus.cc:493] T 3ab18fc35bf84fd4876f3c9573c22c0d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:33.827567  3529 leader_election.cc:290] T 3eebe28a0e1b493581b05e588dd920d5 P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 1 election: Requested vote from peers d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:33.826638  3557 raft_consensus.cc:3060] T 3ab18fc35bf84fd4876f3c9573c22c0d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:33.829164  3385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eebe28a0e1b493581b05e588dd920d5" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db"
I20260709 12:27:33.831962  3531 ts_tablet_manager.cc:1434] T 3ab18fc35bf84fd4876f3c9573c22c0d P 65bae5463b17443bb0fa568920a9ca19: Time spent starting tablet: real 0.024s	user 0.009s	sys 0.000s
I20260709 12:27:33.832357  3562 raft_consensus.cc:2804] T c4adb0932a604e779ef3ce9fff0b7bc5 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:33.832875  3562 raft_consensus.cc:493] T c4adb0932a604e779ef3ce9fff0b7bc5 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:33.833068  3531 tablet_bootstrap.cc:492] T 66daa0e84b334222ac9af601b6a0a2dc P 65bae5463b17443bb0fa568920a9ca19: Bootstrap starting.
I20260709 12:27:33.833405  3562 raft_consensus.cc:3060] T c4adb0932a604e779ef3ce9fff0b7bc5 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:33.838603  3529 raft_consensus.cc:493] T 18abc32bcdc8438d8f5438356c0b68bb P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:33.839381  3529 raft_consensus.cc:515] T 18abc32bcdc8438d8f5438356c0b68bb P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.840747  3531 tablet_bootstrap.cc:654] T 66daa0e84b334222ac9af601b6a0a2dc P 65bae5463b17443bb0fa568920a9ca19: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:33.841250  3544 leader_election.cc:290] T 66daa0e84b334222ac9af601b6a0a2dc P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 1 election: Requested vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915)
I20260709 12:27:33.844074  3310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18abc32bcdc8438d8f5438356c0b68bb" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" is_pre_election: true
I20260709 12:27:33.843789  3312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66daa0e84b334222ac9af601b6a0a2dc" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3"
I20260709 12:27:33.848255  3312 raft_consensus.cc:3060] T 66daa0e84b334222ac9af601b6a0a2dc P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:33.851091  3559 raft_consensus.cc:515] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.852279  3528 tablet_bootstrap.cc:492] T 18abc32bcdc8438d8f5438356c0b68bb P d31e1edf8df54dd5a75e9fba6cc0a1f3: No bootstrap required, opened a new log
I20260709 12:27:33.852780  3528 ts_tablet_manager.cc:1403] T 18abc32bcdc8438d8f5438356c0b68bb P d31e1edf8df54dd5a75e9fba6cc0a1f3: Time spent bootstrapping tablet: real 0.091s	user 0.010s	sys 0.005s
I20260709 12:27:33.854110  3235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66daa0e84b334222ac9af601b6a0a2dc" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19"
I20260709 12:27:33.854218  3386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18abc32bcdc8438d8f5438356c0b68bb" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db" is_pre_election: true
W20260709 12:27:33.855764  3202 leader_election.cc:343] T 18abc32bcdc8438d8f5438356c0b68bb P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:33.855965  3351 leader_election.cc:343] T 66daa0e84b334222ac9af601b6a0a2dc P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:33.856861  3528 raft_consensus.cc:359] T 18abc32bcdc8438d8f5438356c0b68bb P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.857581  3528 raft_consensus.cc:385] T 18abc32bcdc8438d8f5438356c0b68bb P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:27:33.857776  3200 leader_election.cc:343] T 18abc32bcdc8438d8f5438356c0b68bb P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:33.858537  3200 leader_election.cc:304] T 18abc32bcdc8438d8f5438356c0b68bb P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19; no voters: d31e1edf8df54dd5a75e9fba6cc0a1f3, e260c115ddf045e88e73893d7f8269db
I20260709 12:27:33.859696  3561 raft_consensus.cc:2749] T 18abc32bcdc8438d8f5438356c0b68bb P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:33.859854  3512 raft_consensus.cc:515] T 3eebe28a0e1b493581b05e588dd920d5 P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.843910  3529 leader_election.cc:290] T 18abc32bcdc8438d8f5438356c0b68bb P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:33.862449  3312 raft_consensus.cc:2468] T 66daa0e84b334222ac9af601b6a0a2dc P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e260c115ddf045e88e73893d7f8269db in term 1.
I20260709 12:27:33.863838  3351 leader_election.cc:304] T 66daa0e84b334222ac9af601b6a0a2dc P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d31e1edf8df54dd5a75e9fba6cc0a1f3, e260c115ddf045e88e73893d7f8269db; no voters: 65bae5463b17443bb0fa568920a9ca19
I20260709 12:27:33.864789  3544 raft_consensus.cc:2804] T 66daa0e84b334222ac9af601b6a0a2dc P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:33.865516  3544 raft_consensus.cc:697] T 66daa0e84b334222ac9af601b6a0a2dc P e260c115ddf045e88e73893d7f8269db [term 1 LEADER]: Becoming Leader. State: Replica: e260c115ddf045e88e73893d7f8269db, State: Running, Role: LEADER
I20260709 12:27:33.866766  3544 consensus_queue.cc:237] T 66daa0e84b334222ac9af601b6a0a2dc P e260c115ddf045e88e73893d7f8269db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.868443  3385 raft_consensus.cc:2393] T 3eebe28a0e1b493581b05e588dd920d5 P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 65bae5463b17443bb0fa568920a9ca19 in current term 1: Already voted for candidate e260c115ddf045e88e73893d7f8269db in this term.
I20260709 12:27:33.869948  3530 ts_tablet_manager.cc:1434] T bfdfacb5c8bc4844936c037c39983f24 P e260c115ddf045e88e73893d7f8269db: Time spent starting tablet: real 0.058s	user 0.020s	sys 0.016s
I20260709 12:27:33.870438  3512 leader_election.cc:290] T 3eebe28a0e1b493581b05e588dd920d5 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 1 election: Requested vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915)
I20260709 12:27:33.871105  3530 tablet_bootstrap.cc:492] T 18abc32bcdc8438d8f5438356c0b68bb P e260c115ddf045e88e73893d7f8269db: Bootstrap starting.
I20260709 12:27:33.872362  3235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eebe28a0e1b493581b05e588dd920d5" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19"
I20260709 12:27:33.872673  3559 leader_election.cc:290] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 1 election: Requested vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:33.873281  3235 raft_consensus.cc:2393] T 3eebe28a0e1b493581b05e588dd920d5 P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e260c115ddf045e88e73893d7f8269db in current term 1: Already voted for candidate 65bae5463b17443bb0fa568920a9ca19 in this term.
I20260709 12:27:33.874266  3385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821be9b5927a481ab065336d9a5c6522" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db"
I20260709 12:27:33.874424  3557 raft_consensus.cc:515] T 3ab18fc35bf84fd4876f3c9573c22c0d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.874969  3385 raft_consensus.cc:3060] T 821be9b5927a481ab065336d9a5c6522 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:33.876781  3557 leader_election.cc:290] T 3ab18fc35bf84fd4876f3c9573c22c0d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 1 election: Requested vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:33.878104  3386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ab18fc35bf84fd4876f3c9573c22c0d" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db"
I20260709 12:27:33.878804  3386 raft_consensus.cc:3060] T 3ab18fc35bf84fd4876f3c9573c22c0d P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:33.880251  3530 tablet_bootstrap.cc:654] T 18abc32bcdc8438d8f5438356c0b68bb P e260c115ddf045e88e73893d7f8269db: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:33.884807  3237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ab18fc35bf84fd4876f3c9573c22c0d" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19"
I20260709 12:27:33.885738  3237 raft_consensus.cc:3060] T 3ab18fc35bf84fd4876f3c9573c22c0d P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:33.888521  3235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821be9b5927a481ab065336d9a5c6522" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19"
W20260709 12:27:33.893797  3277 leader_election.cc:343] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:33.905623  3562 raft_consensus.cc:515] T c4adb0932a604e779ef3ce9fff0b7bc5 P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.915597  3386 raft_consensus.cc:2468] T 3ab18fc35bf84fd4876f3c9573c22c0d P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d31e1edf8df54dd5a75e9fba6cc0a1f3 in term 1.
I20260709 12:27:33.916538  3312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eebe28a0e1b493581b05e588dd920d5" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3"
I20260709 12:27:33.917606  3275 leader_election.cc:304] T 3ab18fc35bf84fd4876f3c9573c22c0d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d31e1edf8df54dd5a75e9fba6cc0a1f3, e260c115ddf045e88e73893d7f8269db; no voters: 
I20260709 12:27:33.867702  3311 raft_consensus.cc:2468] T 3eebe28a0e1b493581b05e588dd920d5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65bae5463b17443bb0fa568920a9ca19 in term 1.
I20260709 12:27:33.920533  3557 raft_consensus.cc:2804] T 3ab18fc35bf84fd4876f3c9573c22c0d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:33.921422  3557 raft_consensus.cc:697] T 3ab18fc35bf84fd4876f3c9573c22c0d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 LEADER]: Becoming Leader. State: Replica: d31e1edf8df54dd5a75e9fba6cc0a1f3, State: Running, Role: LEADER
I20260709 12:27:33.921959  3202 leader_election.cc:304] T 3eebe28a0e1b493581b05e588dd920d5 P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, d31e1edf8df54dd5a75e9fba6cc0a1f3; no voters: e260c115ddf045e88e73893d7f8269db
I20260709 12:27:33.922724  3557 consensus_queue.cc:237] T 3ab18fc35bf84fd4876f3c9573c22c0d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.923687  3529 raft_consensus.cc:2804] T 3eebe28a0e1b493581b05e588dd920d5 P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:33.919364  3351 leader_election.cc:304] T 3eebe28a0e1b493581b05e588dd920d5 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e260c115ddf045e88e73893d7f8269db; no voters: 65bae5463b17443bb0fa568920a9ca19, d31e1edf8df54dd5a75e9fba6cc0a1f3
I20260709 12:27:33.925513  3529 raft_consensus.cc:697] T 3eebe28a0e1b493581b05e588dd920d5 P 65bae5463b17443bb0fa568920a9ca19 [term 1 LEADER]: Becoming Leader. State: Replica: 65bae5463b17443bb0fa568920a9ca19, State: Running, Role: LEADER
I20260709 12:27:33.926939  3529 consensus_queue.cc:237] T 3eebe28a0e1b493581b05e588dd920d5 P 65bae5463b17443bb0fa568920a9ca19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.933987  3512 raft_consensus.cc:2749] T 3eebe28a0e1b493581b05e588dd920d5 P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:27:33.935034  3237 raft_consensus.cc:2468] T 3ab18fc35bf84fd4876f3c9573c22c0d P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d31e1edf8df54dd5a75e9fba6cc0a1f3 in term 1.
I20260709 12:27:33.857856  3528 raft_consensus.cc:740] T 18abc32bcdc8438d8f5438356c0b68bb P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d31e1edf8df54dd5a75e9fba6cc0a1f3, State: Initialized, Role: FOLLOWER
I20260709 12:27:33.946338  3531 tablet_bootstrap.cc:492] T 66daa0e84b334222ac9af601b6a0a2dc P 65bae5463b17443bb0fa568920a9ca19: No bootstrap required, opened a new log
I20260709 12:27:33.946903  3531 ts_tablet_manager.cc:1403] T 66daa0e84b334222ac9af601b6a0a2dc P 65bae5463b17443bb0fa568920a9ca19: Time spent bootstrapping tablet: real 0.114s	user 0.026s	sys 0.040s
I20260709 12:27:33.949128  3385 raft_consensus.cc:2468] T 821be9b5927a481ab065336d9a5c6522 P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d31e1edf8df54dd5a75e9fba6cc0a1f3 in term 1.
I20260709 12:27:33.950356  3531 raft_consensus.cc:359] T 66daa0e84b334222ac9af601b6a0a2dc P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.950255  3134 catalog_manager.cc:5697] T 3eebe28a0e1b493581b05e588dd920d5 P 65bae5463b17443bb0fa568920a9ca19 reported cstate change: term changed from 0 to 1, leader changed from <none> to 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129). New cstate: current_term: 1 leader_uuid: "65bae5463b17443bb0fa568920a9ca19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:33.951184  3531 raft_consensus.cc:385] T 66daa0e84b334222ac9af601b6a0a2dc P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:33.951642  3531 raft_consensus.cc:740] T 66daa0e84b334222ac9af601b6a0a2dc P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65bae5463b17443bb0fa568920a9ca19, State: Initialized, Role: FOLLOWER
I20260709 12:27:33.952452  3531 consensus_queue.cc:260] T 66daa0e84b334222ac9af601b6a0a2dc P 65bae5463b17443bb0fa568920a9ca19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.954957  3531 ts_tablet_manager.cc:1434] T 66daa0e84b334222ac9af601b6a0a2dc P 65bae5463b17443bb0fa568920a9ca19: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:27:33.955981  3531 tablet_bootstrap.cc:492] T 821be9b5927a481ab065336d9a5c6522 P 65bae5463b17443bb0fa568920a9ca19: Bootstrap starting.
I20260709 12:27:33.962724  3531 tablet_bootstrap.cc:654] T 821be9b5927a481ab065336d9a5c6522 P 65bae5463b17443bb0fa568920a9ca19: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:33.962402  3237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4adb0932a604e779ef3ce9fff0b7bc5" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19"
I20260709 12:27:33.963460  3237 raft_consensus.cc:3060] T c4adb0932a604e779ef3ce9fff0b7bc5 P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:33.975093  3531 tablet_bootstrap.cc:492] T 821be9b5927a481ab065336d9a5c6522 P 65bae5463b17443bb0fa568920a9ca19: No bootstrap required, opened a new log
I20260709 12:27:33.975687  3531 ts_tablet_manager.cc:1403] T 821be9b5927a481ab065336d9a5c6522 P 65bae5463b17443bb0fa568920a9ca19: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.007s
I20260709 12:27:33.977871  3531 raft_consensus.cc:359] T 821be9b5927a481ab065336d9a5c6522 P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.978441  3531 raft_consensus.cc:385] T 821be9b5927a481ab065336d9a5c6522 P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:33.978686  3531 raft_consensus.cc:740] T 821be9b5927a481ab065336d9a5c6522 P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65bae5463b17443bb0fa568920a9ca19, State: Initialized, Role: FOLLOWER
I20260709 12:27:33.979322  3531 consensus_queue.cc:260] T 821be9b5927a481ab065336d9a5c6522 P 65bae5463b17443bb0fa568920a9ca19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.946161  3528 consensus_queue.cc:260] T 18abc32bcdc8438d8f5438356c0b68bb P d31e1edf8df54dd5a75e9fba6cc0a1f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.981338  3531 ts_tablet_manager.cc:1434] T 821be9b5927a481ab065336d9a5c6522 P 65bae5463b17443bb0fa568920a9ca19: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260709 12:27:33.982494  3531 tablet_bootstrap.cc:492] T bfdfacb5c8bc4844936c037c39983f24 P 65bae5463b17443bb0fa568920a9ca19: Bootstrap starting.
I20260709 12:27:33.983811  3528 ts_tablet_manager.cc:1434] T 18abc32bcdc8438d8f5438356c0b68bb P d31e1edf8df54dd5a75e9fba6cc0a1f3: Time spent starting tablet: real 0.131s	user 0.007s	sys 0.000s
I20260709 12:27:33.987771  3562 leader_election.cc:290] T c4adb0932a604e779ef3ce9fff0b7bc5 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 1 election: Requested vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915)
I20260709 12:27:33.987646  3311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4adb0932a604e779ef3ce9fff0b7bc5" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3"
I20260709 12:27:33.989544  3311 raft_consensus.cc:3060] T c4adb0932a604e779ef3ce9fff0b7bc5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:33.989663  3275 leader_election.cc:304] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d31e1edf8df54dd5a75e9fba6cc0a1f3, e260c115ddf045e88e73893d7f8269db; no voters: 65bae5463b17443bb0fa568920a9ca19
I20260709 12:27:33.990871  3559 raft_consensus.cc:2804] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:33.990680  3237 raft_consensus.cc:2468] T c4adb0932a604e779ef3ce9fff0b7bc5 P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e260c115ddf045e88e73893d7f8269db in term 1.
I20260709 12:27:33.991456  3559 raft_consensus.cc:697] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 LEADER]: Becoming Leader. State: Replica: d31e1edf8df54dd5a75e9fba6cc0a1f3, State: Running, Role: LEADER
I20260709 12:27:33.992331  3559 consensus_queue.cc:237] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.992552  3351 leader_election.cc:304] T c4adb0932a604e779ef3ce9fff0b7bc5 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, e260c115ddf045e88e73893d7f8269db; no voters: 
I20260709 12:27:33.994132  3562 raft_consensus.cc:2804] T c4adb0932a604e779ef3ce9fff0b7bc5 P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:33.994923  3562 raft_consensus.cc:697] T c4adb0932a604e779ef3ce9fff0b7bc5 P e260c115ddf045e88e73893d7f8269db [term 1 LEADER]: Becoming Leader. State: Replica: e260c115ddf045e88e73893d7f8269db, State: Running, Role: LEADER
I20260709 12:27:33.996140  3562 consensus_queue.cc:237] T c4adb0932a604e779ef3ce9fff0b7bc5 P e260c115ddf045e88e73893d7f8269db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:33.988921  3531 tablet_bootstrap.cc:654] T bfdfacb5c8bc4844936c037c39983f24 P 65bae5463b17443bb0fa568920a9ca19: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:34.005259  3530 tablet_bootstrap.cc:492] T 18abc32bcdc8438d8f5438356c0b68bb P e260c115ddf045e88e73893d7f8269db: No bootstrap required, opened a new log
I20260709 12:27:34.005805  3530 ts_tablet_manager.cc:1403] T 18abc32bcdc8438d8f5438356c0b68bb P e260c115ddf045e88e73893d7f8269db: Time spent bootstrapping tablet: real 0.135s	user 0.038s	sys 0.092s
I20260709 12:27:34.009945  3530 raft_consensus.cc:359] T 18abc32bcdc8438d8f5438356c0b68bb P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:34.010973  3530 raft_consensus.cc:385] T 18abc32bcdc8438d8f5438356c0b68bb P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:34.011400  3530 raft_consensus.cc:740] T 18abc32bcdc8438d8f5438356c0b68bb P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e260c115ddf045e88e73893d7f8269db, State: Initialized, Role: FOLLOWER
I20260709 12:27:34.012588  3530 consensus_queue.cc:260] T 18abc32bcdc8438d8f5438356c0b68bb P e260c115ddf045e88e73893d7f8269db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:34.013805  3133 catalog_manager.cc:5697] T 3ab18fc35bf84fd4876f3c9573c22c0d P d31e1edf8df54dd5a75e9fba6cc0a1f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130). New cstate: current_term: 1 leader_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:34.014990  3531 tablet_bootstrap.cc:492] T bfdfacb5c8bc4844936c037c39983f24 P 65bae5463b17443bb0fa568920a9ca19: No bootstrap required, opened a new log
I20260709 12:27:34.015503  3531 ts_tablet_manager.cc:1403] T bfdfacb5c8bc4844936c037c39983f24 P 65bae5463b17443bb0fa568920a9ca19: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.003s
I20260709 12:27:34.015769  3530 ts_tablet_manager.cc:1434] T 18abc32bcdc8438d8f5438356c0b68bb P e260c115ddf045e88e73893d7f8269db: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:27:34.023023  3512 consensus_queue.cc:1048] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [LEADER]: Connected to new peer: Peer: permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:34.025131  3531 raft_consensus.cc:359] T bfdfacb5c8bc4844936c037c39983f24 P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:34.026233  3531 raft_consensus.cc:385] T bfdfacb5c8bc4844936c037c39983f24 P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:34.026495  3531 raft_consensus.cc:740] T bfdfacb5c8bc4844936c037c39983f24 P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65bae5463b17443bb0fa568920a9ca19, State: Initialized, Role: FOLLOWER
I20260709 12:27:34.027215  3531 consensus_queue.cc:260] T bfdfacb5c8bc4844936c037c39983f24 P 65bae5463b17443bb0fa568920a9ca19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:34.027441  3512 consensus_queue.cc:1048] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:27:34.040549  3311 raft_consensus.cc:2468] T c4adb0932a604e779ef3ce9fff0b7bc5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e260c115ddf045e88e73893d7f8269db in term 1.
I20260709 12:27:34.054709  3562 raft_consensus.cc:493] T bfdfacb5c8bc4844936c037c39983f24 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:34.055548  3562 raft_consensus.cc:515] T bfdfacb5c8bc4844936c037c39983f24 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:34.059686  3235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdfacb5c8bc4844936c037c39983f24" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19" is_pre_election: true
I20260709 12:27:34.060513  3235 raft_consensus.cc:2468] T bfdfacb5c8bc4844936c037c39983f24 P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e260c115ddf045e88e73893d7f8269db in term 0.
I20260709 12:27:34.047235  3531 ts_tablet_manager.cc:1434] T bfdfacb5c8bc4844936c037c39983f24 P 65bae5463b17443bb0fa568920a9ca19: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 12:27:34.061944  3351 leader_election.cc:304] T bfdfacb5c8bc4844936c037c39983f24 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, e260c115ddf045e88e73893d7f8269db; no voters: 
I20260709 12:27:34.052429  3134 catalog_manager.cc:5697] T 66daa0e84b334222ac9af601b6a0a2dc P e260c115ddf045e88e73893d7f8269db reported cstate change: term changed from 0 to 1, leader changed from <none> to e260c115ddf045e88e73893d7f8269db (127.23.245.131). New cstate: current_term: 1 leader_uuid: "e260c115ddf045e88e73893d7f8269db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:34.062979  3564 raft_consensus.cc:2804] T bfdfacb5c8bc4844936c037c39983f24 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:34.063371  3564 raft_consensus.cc:493] T bfdfacb5c8bc4844936c037c39983f24 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:34.063783  3564 raft_consensus.cc:3060] T bfdfacb5c8bc4844936c037c39983f24 P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:34.065855  3562 leader_election.cc:290] T bfdfacb5c8bc4844936c037c39983f24 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915)
I20260709 12:27:34.074476  3564 raft_consensus.cc:515] T bfdfacb5c8bc4844936c037c39983f24 P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:34.076407  3312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdfacb5c8bc4844936c037c39983f24" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" is_pre_election: true
I20260709 12:27:34.077171  3312 raft_consensus.cc:2468] T bfdfacb5c8bc4844936c037c39983f24 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e260c115ddf045e88e73893d7f8269db in term 0.
I20260709 12:27:34.084213  3311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdfacb5c8bc4844936c037c39983f24" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3"
I20260709 12:27:34.084972  3311 raft_consensus.cc:3060] T bfdfacb5c8bc4844936c037c39983f24 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:34.086618  3237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdfacb5c8bc4844936c037c39983f24" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19"
I20260709 12:27:34.087321  3237 raft_consensus.cc:3060] T bfdfacb5c8bc4844936c037c39983f24 P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:34.089766  3564 leader_election.cc:290] T bfdfacb5c8bc4844936c037c39983f24 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 1 election: Requested vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915)
I20260709 12:27:34.091606  3132 catalog_manager.cc:5697] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130). New cstate: current_term: 1 leader_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:34.092626  3311 raft_consensus.cc:2468] T bfdfacb5c8bc4844936c037c39983f24 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e260c115ddf045e88e73893d7f8269db in term 1.
I20260709 12:27:34.093895  3351 leader_election.cc:304] T bfdfacb5c8bc4844936c037c39983f24 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d31e1edf8df54dd5a75e9fba6cc0a1f3, e260c115ddf045e88e73893d7f8269db; no voters: 
I20260709 12:27:34.094614  3237 raft_consensus.cc:2468] T bfdfacb5c8bc4844936c037c39983f24 P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e260c115ddf045e88e73893d7f8269db in term 1.
I20260709 12:27:34.094888  3564 raft_consensus.cc:2804] T bfdfacb5c8bc4844936c037c39983f24 P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:34.096113  3564 raft_consensus.cc:697] T bfdfacb5c8bc4844936c037c39983f24 P e260c115ddf045e88e73893d7f8269db [term 1 LEADER]: Becoming Leader. State: Replica: e260c115ddf045e88e73893d7f8269db, State: Running, Role: LEADER
I20260709 12:27:34.096947  3564 consensus_queue.cc:237] T bfdfacb5c8bc4844936c037c39983f24 P e260c115ddf045e88e73893d7f8269db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:34.112224  3134 catalog_manager.cc:5697] T bfdfacb5c8bc4844936c037c39983f24 P e260c115ddf045e88e73893d7f8269db reported cstate change: term changed from 0 to 1, leader changed from <none> to e260c115ddf045e88e73893d7f8269db (127.23.245.131). New cstate: current_term: 1 leader_uuid: "e260c115ddf045e88e73893d7f8269db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:34.113842  3134 catalog_manager.cc:5697] T c4adb0932a604e779ef3ce9fff0b7bc5 P e260c115ddf045e88e73893d7f8269db reported cstate change: term changed from 0 to 1, leader changed from <none> to e260c115ddf045e88e73893d7f8269db (127.23.245.131). New cstate: current_term: 1 leader_uuid: "e260c115ddf045e88e73893d7f8269db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:34.128317  3561 raft_consensus.cc:493] T 66daa0e84b334222ac9af601b6a0a2dc P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:34.128887  3561 raft_consensus.cc:515] T 66daa0e84b334222ac9af601b6a0a2dc P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:34.130585  3561 leader_election.cc:290] T 66daa0e84b334222ac9af601b6a0a2dc P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:34.131470  3311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66daa0e84b334222ac9af601b6a0a2dc" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" is_pre_election: true
I20260709 12:27:34.131655  3385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66daa0e84b334222ac9af601b6a0a2dc" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db" is_pre_election: true
I20260709 12:27:34.132251  3311 raft_consensus.cc:2393] T 66daa0e84b334222ac9af601b6a0a2dc P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65bae5463b17443bb0fa568920a9ca19 in current term 1: Already voted for candidate e260c115ddf045e88e73893d7f8269db in this term.
I20260709 12:27:34.133201  3202 leader_election.cc:304] T 66daa0e84b334222ac9af601b6a0a2dc P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19; no voters: d31e1edf8df54dd5a75e9fba6cc0a1f3, e260c115ddf045e88e73893d7f8269db
I20260709 12:27:34.133864  3561 raft_consensus.cc:3060] T 66daa0e84b334222ac9af601b6a0a2dc P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:34.139182  3561 raft_consensus.cc:2749] T 66daa0e84b334222ac9af601b6a0a2dc P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:34.176066  3564 consensus_queue.cc:1048] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P e260c115ddf045e88e73893d7f8269db [LEADER]: Connected to new peer: Peer: permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:34.187570  3544 consensus_queue.cc:1048] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P e260c115ddf045e88e73893d7f8269db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:34.243487  3557 raft_consensus.cc:493] T 18abc32bcdc8438d8f5438356c0b68bb P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:34.244077  3557 raft_consensus.cc:515] T 18abc32bcdc8438d8f5438356c0b68bb P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:34.245841  3557 leader_election.cc:290] T 18abc32bcdc8438d8f5438356c0b68bb P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:34.246603  3237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18abc32bcdc8438d8f5438356c0b68bb" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19" is_pre_election: true
I20260709 12:27:34.247000  3385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18abc32bcdc8438d8f5438356c0b68bb" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db" is_pre_election: true
I20260709 12:27:34.247251  3237 raft_consensus.cc:2468] T 18abc32bcdc8438d8f5438356c0b68bb P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d31e1edf8df54dd5a75e9fba6cc0a1f3 in term 0.
I20260709 12:27:34.247824  3385 raft_consensus.cc:2468] T 18abc32bcdc8438d8f5438356c0b68bb P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d31e1edf8df54dd5a75e9fba6cc0a1f3 in term 0.
I20260709 12:27:34.248392  3277 leader_election.cc:304] T 18abc32bcdc8438d8f5438356c0b68bb P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, d31e1edf8df54dd5a75e9fba6cc0a1f3; no voters: 
I20260709 12:27:34.249315  3557 raft_consensus.cc:2804] T 18abc32bcdc8438d8f5438356c0b68bb P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:34.249578  3557 raft_consensus.cc:493] T 18abc32bcdc8438d8f5438356c0b68bb P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:34.249912  3557 raft_consensus.cc:3060] T 18abc32bcdc8438d8f5438356c0b68bb P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:34.254912  3557 raft_consensus.cc:515] T 18abc32bcdc8438d8f5438356c0b68bb P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:34.256613  3557 leader_election.cc:290] T 18abc32bcdc8438d8f5438356c0b68bb P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 1 election: Requested vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:34.257521  3237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18abc32bcdc8438d8f5438356c0b68bb" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19"
I20260709 12:27:34.257669  3385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18abc32bcdc8438d8f5438356c0b68bb" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db"
I20260709 12:27:34.258071  3237 raft_consensus.cc:3060] T 18abc32bcdc8438d8f5438356c0b68bb P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:34.258333  3385 raft_consensus.cc:3060] T 18abc32bcdc8438d8f5438356c0b68bb P e260c115ddf045e88e73893d7f8269db [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:34.263199  3237 raft_consensus.cc:2468] T 18abc32bcdc8438d8f5438356c0b68bb P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d31e1edf8df54dd5a75e9fba6cc0a1f3 in term 1.
I20260709 12:27:34.263434  3385 raft_consensus.cc:2468] T 18abc32bcdc8438d8f5438356c0b68bb P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d31e1edf8df54dd5a75e9fba6cc0a1f3 in term 1.
I20260709 12:27:34.264346  3277 leader_election.cc:304] T 18abc32bcdc8438d8f5438356c0b68bb P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, d31e1edf8df54dd5a75e9fba6cc0a1f3; no voters: 
I20260709 12:27:34.265098  3557 raft_consensus.cc:2804] T 18abc32bcdc8438d8f5438356c0b68bb P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:34.265687  3557 raft_consensus.cc:697] T 18abc32bcdc8438d8f5438356c0b68bb P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 LEADER]: Becoming Leader. State: Replica: d31e1edf8df54dd5a75e9fba6cc0a1f3, State: Running, Role: LEADER
I20260709 12:27:34.266458  3557 consensus_queue.cc:237] T 18abc32bcdc8438d8f5438356c0b68bb P d31e1edf8df54dd5a75e9fba6cc0a1f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:34.273625  3132 catalog_manager.cc:5697] T 18abc32bcdc8438d8f5438356c0b68bb P d31e1edf8df54dd5a75e9fba6cc0a1f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130). New cstate: current_term: 1 leader_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:34.309310  3561 raft_consensus.cc:493] T 821be9b5927a481ab065336d9a5c6522 P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:34.309863  3561 raft_consensus.cc:515] T 821be9b5927a481ab065336d9a5c6522 P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:34.311756  3561 leader_election.cc:290] T 821be9b5927a481ab065336d9a5c6522 P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:34.312630  3311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821be9b5927a481ab065336d9a5c6522" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" is_pre_election: true
I20260709 12:27:34.312845  3385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821be9b5927a481ab065336d9a5c6522" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db" is_pre_election: true
I20260709 12:27:34.313756  3385 raft_consensus.cc:2393] T 821be9b5927a481ab065336d9a5c6522 P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65bae5463b17443bb0fa568920a9ca19 in current term 1: Already voted for candidate d31e1edf8df54dd5a75e9fba6cc0a1f3 in this term.
I20260709 12:27:34.314849  3200 leader_election.cc:304] T 821be9b5927a481ab065336d9a5c6522 P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19; no voters: d31e1edf8df54dd5a75e9fba6cc0a1f3, e260c115ddf045e88e73893d7f8269db
I20260709 12:27:34.315606  3561 raft_consensus.cc:3060] T 821be9b5927a481ab065336d9a5c6522 P 65bae5463b17443bb0fa568920a9ca19 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:34.321148  3561 raft_consensus.cc:2749] T 821be9b5927a481ab065336d9a5c6522 P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:34.386711  3512 consensus_queue.cc:1048] T 66daa0e84b334222ac9af601b6a0a2dc P e260c115ddf045e88e73893d7f8269db [LEADER]: Connected to new peer: Peer: permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:34.390430  3386 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "848e8cff9e5b4de6b49a1bd243e9f9aa"
dest_uuid: "e260c115ddf045e88e73893d7f8269db"
mode: GRACEFUL
new_leader_uuid: "65bae5463b17443bb0fa568920a9ca19"
 from {username='slave'} at 127.0.0.1:53002
I20260709 12:27:34.391137  3386 raft_consensus.cc:606] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [term 1 LEADER]: Received request to transfer leadership to TS 65bae5463b17443bb0fa568920a9ca19
I20260709 12:27:34.394212  3557 consensus_queue.cc:1048] T 3ab18fc35bf84fd4876f3c9573c22c0d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:34.404734  3386 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c4adb0932a604e779ef3ce9fff0b7bc5"
dest_uuid: "e260c115ddf045e88e73893d7f8269db"
mode: GRACEFUL
new_leader_uuid: "65bae5463b17443bb0fa568920a9ca19"
 from {username='slave'} at 127.0.0.1:53002
I20260709 12:27:34.405339  3386 raft_consensus.cc:606] T c4adb0932a604e779ef3ce9fff0b7bc5 P e260c115ddf045e88e73893d7f8269db [term 1 LEADER]: Received request to transfer leadership to TS 65bae5463b17443bb0fa568920a9ca19
I20260709 12:27:34.410961  3559 consensus_queue.cc:1048] T 3ab18fc35bf84fd4876f3c9573c22c0d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:34.413340  3544 consensus_queue.cc:1048] T 66daa0e84b334222ac9af601b6a0a2dc P e260c115ddf045e88e73893d7f8269db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:34.414812  3385 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01c6742a5e0e4b0eb07abd8f93c2a8fb"
dest_uuid: "e260c115ddf045e88e73893d7f8269db"
mode: GRACEFUL
new_leader_uuid: "65bae5463b17443bb0fa568920a9ca19"
 from {username='slave'} at 127.0.0.1:53002
I20260709 12:27:34.415452  3385 raft_consensus.cc:606] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P e260c115ddf045e88e73893d7f8269db [term 1 LEADER]: Received request to transfer leadership to TS 65bae5463b17443bb0fa568920a9ca19
I20260709 12:27:34.417438  3544 consensus_queue.cc:1048] T c4adb0932a604e779ef3ce9fff0b7bc5 P e260c115ddf045e88e73893d7f8269db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:34.436695  3559 consensus_queue.cc:1048] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:34.448863  3559 consensus_queue.cc:1048] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:34.462301  3386 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66daa0e84b334222ac9af601b6a0a2dc"
dest_uuid: "e260c115ddf045e88e73893d7f8269db"
mode: GRACEFUL
new_leader_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3"
 from {username='slave'} at 127.0.0.1:53002
I20260709 12:27:34.462924  3386 raft_consensus.cc:606] T 66daa0e84b334222ac9af601b6a0a2dc P e260c115ddf045e88e73893d7f8269db [term 1 LEADER]: Received request to transfer leadership to TS d31e1edf8df54dd5a75e9fba6cc0a1f3
I20260709 12:27:34.468796  3561 consensus_queue.cc:1048] T 3eebe28a0e1b493581b05e588dd920d5 P 65bae5463b17443bb0fa568920a9ca19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:34.472249  3544 raft_consensus.cc:993] T c4adb0932a604e779ef3ce9fff0b7bc5 P e260c115ddf045e88e73893d7f8269db: : Instructing follower 65bae5463b17443bb0fa568920a9ca19 to start an election
I20260709 12:27:34.473035  3544 raft_consensus.cc:1081] T c4adb0932a604e779ef3ce9fff0b7bc5 P e260c115ddf045e88e73893d7f8269db [term 1 LEADER]: Signalling peer 65bae5463b17443bb0fa568920a9ca19 to start an election
I20260709 12:27:34.481007  3544 raft_consensus.cc:993] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db: : Instructing follower 65bae5463b17443bb0fa568920a9ca19 to start an election
I20260709 12:27:34.481480  3562 raft_consensus.cc:1081] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [term 1 LEADER]: Signalling peer 65bae5463b17443bb0fa568920a9ca19 to start an election
I20260709 12:27:34.483549  3236 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "848e8cff9e5b4de6b49a1bd243e9f9aa"
dest_uuid: "65bae5463b17443bb0fa568920a9ca19"
 from {username='slave'} at 127.0.0.1:39490
I20260709 12:27:34.484141  3236 raft_consensus.cc:493] T 848e8cff9e5b4de6b49a1bd243e9f9aa P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:34.484563  3236 raft_consensus.cc:3060] T 848e8cff9e5b4de6b49a1bd243e9f9aa P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:34.484252  3562 consensus_queue.cc:1048] T c4adb0932a604e779ef3ce9fff0b7bc5 P e260c115ddf045e88e73893d7f8269db [LEADER]: Connected to new peer: Peer: permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:34.488025  3237 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c4adb0932a604e779ef3ce9fff0b7bc5"
dest_uuid: "65bae5463b17443bb0fa568920a9ca19"
 from {username='slave'} at 127.0.0.1:39490
I20260709 12:27:34.488617  3237 raft_consensus.cc:493] T c4adb0932a604e779ef3ce9fff0b7bc5 P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:34.488974  3237 raft_consensus.cc:3060] T c4adb0932a604e779ef3ce9fff0b7bc5 P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:34.492389  3561 consensus_queue.cc:1048] T 3eebe28a0e1b493581b05e588dd920d5 P 65bae5463b17443bb0fa568920a9ca19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:34.494192  3236 raft_consensus.cc:515] T 848e8cff9e5b4de6b49a1bd243e9f9aa P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:34.498104  3310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848e8cff9e5b4de6b49a1bd243e9f9aa" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3"
I20260709 12:27:34.498903  3310 raft_consensus.cc:3060] T 848e8cff9e5b4de6b49a1bd243e9f9aa P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:34.499545  3562 consensus_queue.cc:1048] T bfdfacb5c8bc4844936c037c39983f24 P e260c115ddf045e88e73893d7f8269db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:34.505537  3237 raft_consensus.cc:515] T c4adb0932a604e779ef3ce9fff0b7bc5 P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:34.507438  3310 raft_consensus.cc:2468] T 848e8cff9e5b4de6b49a1bd243e9f9aa P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65bae5463b17443bb0fa568920a9ca19 in term 2.
I20260709 12:27:34.510176  3309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4adb0932a604e779ef3ce9fff0b7bc5" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3"
I20260709 12:27:34.511210  3237 leader_election.cc:290] T c4adb0932a604e779ef3ce9fff0b7bc5 P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 2 election: Requested vote from peers d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:34.513068  3202 leader_election.cc:304] T 848e8cff9e5b4de6b49a1bd243e9f9aa P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, d31e1edf8df54dd5a75e9fba6cc0a1f3; no voters: 
I20260709 12:27:34.513942  3386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848e8cff9e5b4de6b49a1bd243e9f9aa" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e260c115ddf045e88e73893d7f8269db"
I20260709 12:27:34.514657  3386 raft_consensus.cc:3055] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:34.515029  3386 raft_consensus.cc:740] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e260c115ddf045e88e73893d7f8269db, State: Running, Role: LEADER
I20260709 12:27:34.515849  3386 consensus_queue.cc:260] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:34.517248  3386 raft_consensus.cc:3060] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:34.514678  3561 raft_consensus.cc:2804] T 848e8cff9e5b4de6b49a1bd243e9f9aa P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:34.520658  3561 raft_consensus.cc:697] T 848e8cff9e5b4de6b49a1bd243e9f9aa P 65bae5463b17443bb0fa568920a9ca19 [term 2 LEADER]: Becoming Leader. State: Replica: 65bae5463b17443bb0fa568920a9ca19, State: Running, Role: LEADER
I20260709 12:27:34.521721  3561 consensus_queue.cc:237] T 848e8cff9e5b4de6b49a1bd243e9f9aa P 65bae5463b17443bb0fa568920a9ca19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:34.524219  3236 leader_election.cc:290] T 848e8cff9e5b4de6b49a1bd243e9f9aa P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 2 election: Requested vote from peers d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:34.524631  3384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4adb0932a604e779ef3ce9fff0b7bc5" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e260c115ddf045e88e73893d7f8269db"
I20260709 12:27:34.525381  3384 raft_consensus.cc:3055] T c4adb0932a604e779ef3ce9fff0b7bc5 P e260c115ddf045e88e73893d7f8269db [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:34.525771  3384 raft_consensus.cc:740] T c4adb0932a604e779ef3ce9fff0b7bc5 P e260c115ddf045e88e73893d7f8269db [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e260c115ddf045e88e73893d7f8269db, State: Running, Role: LEADER
I20260709 12:27:34.526796  3384 consensus_queue.cc:260] T c4adb0932a604e779ef3ce9fff0b7bc5 P e260c115ddf045e88e73893d7f8269db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:34.528177  3384 raft_consensus.cc:3060] T c4adb0932a604e779ef3ce9fff0b7bc5 P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:34.537036  3384 raft_consensus.cc:2468] T c4adb0932a604e779ef3ce9fff0b7bc5 P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65bae5463b17443bb0fa568920a9ca19 in term 2.
I20260709 12:27:34.537357  3386 raft_consensus.cc:2468] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65bae5463b17443bb0fa568920a9ca19 in term 2.
I20260709 12:27:34.578752  3200 leader_election.cc:304] T c4adb0932a604e779ef3ce9fff0b7bc5 P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, e260c115ddf045e88e73893d7f8269db; no voters: d31e1edf8df54dd5a75e9fba6cc0a1f3
I20260709 12:27:34.610952  3133 catalog_manager.cc:5697] T 848e8cff9e5b4de6b49a1bd243e9f9aa P 65bae5463b17443bb0fa568920a9ca19 reported cstate change: term changed from 1 to 2, leader changed from e260c115ddf045e88e73893d7f8269db (127.23.245.131) to 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129). New cstate: current_term: 2 leader_uuid: "65bae5463b17443bb0fa568920a9ca19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:34.619414  3561 raft_consensus.cc:2804] T c4adb0932a604e779ef3ce9fff0b7bc5 P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:34.620412  3561 raft_consensus.cc:697] T c4adb0932a604e779ef3ce9fff0b7bc5 P 65bae5463b17443bb0fa568920a9ca19 [term 2 LEADER]: Becoming Leader. State: Replica: 65bae5463b17443bb0fa568920a9ca19, State: Running, Role: LEADER
I20260709 12:27:34.622212  3561 consensus_queue.cc:237] T c4adb0932a604e779ef3ce9fff0b7bc5 P 65bae5463b17443bb0fa568920a9ca19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:34.645787  3597 consensus_queue.cc:1048] T bfdfacb5c8bc4844936c037c39983f24 P e260c115ddf045e88e73893d7f8269db [LEADER]: Connected to new peer: Peer: permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:34.655531  3131 catalog_manager.cc:5697] T c4adb0932a604e779ef3ce9fff0b7bc5 P 65bae5463b17443bb0fa568920a9ca19 reported cstate change: term changed from 1 to 2, leader changed from e260c115ddf045e88e73893d7f8269db (127.23.245.131) to 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129). New cstate: current_term: 2 leader_uuid: "65bae5463b17443bb0fa568920a9ca19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:34.663864  3564 raft_consensus.cc:993] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P e260c115ddf045e88e73893d7f8269db: : Instructing follower 65bae5463b17443bb0fa568920a9ca19 to start an election
I20260709 12:27:34.664503  3564 raft_consensus.cc:1081] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P e260c115ddf045e88e73893d7f8269db [term 1 LEADER]: Signalling peer 65bae5463b17443bb0fa568920a9ca19 to start an election
I20260709 12:27:34.667210  3237 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01c6742a5e0e4b0eb07abd8f93c2a8fb"
dest_uuid: "65bae5463b17443bb0fa568920a9ca19"
 from {username='slave'} at 127.0.0.1:39490
I20260709 12:27:34.667956  3237 raft_consensus.cc:493] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:34.668365  3237 raft_consensus.cc:3060] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:34.670553  3557 consensus_queue.cc:1048] T 18abc32bcdc8438d8f5438356c0b68bb P d31e1edf8df54dd5a75e9fba6cc0a1f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:34.679205  3237 raft_consensus.cc:515] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:34.683081  3386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c6742a5e0e4b0eb07abd8f93c2a8fb" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e260c115ddf045e88e73893d7f8269db"
I20260709 12:27:34.683897  3386 raft_consensus.cc:3055] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P e260c115ddf045e88e73893d7f8269db [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:34.684309  3386 raft_consensus.cc:740] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P e260c115ddf045e88e73893d7f8269db [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e260c115ddf045e88e73893d7f8269db, State: Running, Role: LEADER
I20260709 12:27:34.684738  3311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c6742a5e0e4b0eb07abd8f93c2a8fb" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3"
I20260709 12:27:34.685576  3311 raft_consensus.cc:3060] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:34.685431  3386 consensus_queue.cc:260] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P e260c115ddf045e88e73893d7f8269db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:34.687223  3386 raft_consensus.cc:3060] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:34.695268  3237 leader_election.cc:290] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 2 election: Requested vote from peers d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:34.695403  3386 raft_consensus.cc:2468] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65bae5463b17443bb0fa568920a9ca19 in term 2.
I20260709 12:27:34.697098  3311 raft_consensus.cc:2468] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65bae5463b17443bb0fa568920a9ca19 in term 2.
I20260709 12:27:34.697472  3200 leader_election.cc:304] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, e260c115ddf045e88e73893d7f8269db; no voters: 
I20260709 12:27:34.698732  3592 raft_consensus.cc:2804] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:34.699323  3592 raft_consensus.cc:697] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P 65bae5463b17443bb0fa568920a9ca19 [term 2 LEADER]: Becoming Leader. State: Replica: 65bae5463b17443bb0fa568920a9ca19, State: Running, Role: LEADER
I20260709 12:27:34.701009  3592 consensus_queue.cc:237] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P 65bae5463b17443bb0fa568920a9ca19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:34.703790  3536 consensus_queue.cc:1048] T 18abc32bcdc8438d8f5438356c0b68bb P d31e1edf8df54dd5a75e9fba6cc0a1f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:34.712313  3133 catalog_manager.cc:5697] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P 65bae5463b17443bb0fa568920a9ca19 reported cstate change: term changed from 1 to 2, leader changed from e260c115ddf045e88e73893d7f8269db (127.23.245.131) to 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129). New cstate: current_term: 2 leader_uuid: "65bae5463b17443bb0fa568920a9ca19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:34.920454  3564 raft_consensus.cc:993] T 66daa0e84b334222ac9af601b6a0a2dc P e260c115ddf045e88e73893d7f8269db: : Instructing follower d31e1edf8df54dd5a75e9fba6cc0a1f3 to start an election
I20260709 12:27:34.920984  3597 raft_consensus.cc:1081] T 66daa0e84b334222ac9af601b6a0a2dc P e260c115ddf045e88e73893d7f8269db [term 1 LEADER]: Signalling peer d31e1edf8df54dd5a75e9fba6cc0a1f3 to start an election
I20260709 12:27:34.922600  3311 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "66daa0e84b334222ac9af601b6a0a2dc"
dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3"
 from {username='slave'} at 127.0.0.1:52004
I20260709 12:27:34.923197  3311 raft_consensus.cc:493] T 66daa0e84b334222ac9af601b6a0a2dc P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:34.923484  3311 raft_consensus.cc:3060] T 66daa0e84b334222ac9af601b6a0a2dc P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:34.928609  3311 raft_consensus.cc:515] T 66daa0e84b334222ac9af601b6a0a2dc P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:34.930136  3311 leader_election.cc:290] T 66daa0e84b334222ac9af601b6a0a2dc P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 2 election: Requested vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:34.931383  3384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66daa0e84b334222ac9af601b6a0a2dc" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e260c115ddf045e88e73893d7f8269db"
I20260709 12:27:34.931396  3236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66daa0e84b334222ac9af601b6a0a2dc" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65bae5463b17443bb0fa568920a9ca19"
I20260709 12:27:34.932037  3384 raft_consensus.cc:3055] T 66daa0e84b334222ac9af601b6a0a2dc P e260c115ddf045e88e73893d7f8269db [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:34.932305  3236 raft_consensus.cc:3060] T 66daa0e84b334222ac9af601b6a0a2dc P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:34.932413  3384 raft_consensus.cc:740] T 66daa0e84b334222ac9af601b6a0a2dc P e260c115ddf045e88e73893d7f8269db [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e260c115ddf045e88e73893d7f8269db, State: Running, Role: LEADER
I20260709 12:27:34.933432  3384 consensus_queue.cc:260] T 66daa0e84b334222ac9af601b6a0a2dc P e260c115ddf045e88e73893d7f8269db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:34.934569  3384 raft_consensus.cc:3060] T 66daa0e84b334222ac9af601b6a0a2dc P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:34.939092  3236 raft_consensus.cc:2468] T 66daa0e84b334222ac9af601b6a0a2dc P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d31e1edf8df54dd5a75e9fba6cc0a1f3 in term 2.
I20260709 12:27:34.940872  3277 leader_election.cc:304] T 66daa0e84b334222ac9af601b6a0a2dc P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, d31e1edf8df54dd5a75e9fba6cc0a1f3; no voters: 
I20260709 12:27:34.941684  3384 raft_consensus.cc:2468] T 66daa0e84b334222ac9af601b6a0a2dc P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d31e1edf8df54dd5a75e9fba6cc0a1f3 in term 2.
I20260709 12:27:34.941856  3536 raft_consensus.cc:2804] T 66daa0e84b334222ac9af601b6a0a2dc P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:34.941910  3311 raft_consensus.cc:1275] T 848e8cff9e5b4de6b49a1bd243e9f9aa P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Refusing update from remote peer 65bae5463b17443bb0fa568920a9ca19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:34.942730  3536 raft_consensus.cc:697] T 66daa0e84b334222ac9af601b6a0a2dc P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 LEADER]: Becoming Leader. State: Replica: d31e1edf8df54dd5a75e9fba6cc0a1f3, State: Running, Role: LEADER
I20260709 12:27:34.943833  3592 consensus_queue.cc:1048] T 848e8cff9e5b4de6b49a1bd243e9f9aa P 65bae5463b17443bb0fa568920a9ca19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:34.943838  3536 consensus_queue.cc:237] T 66daa0e84b334222ac9af601b6a0a2dc P d31e1edf8df54dd5a75e9fba6cc0a1f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:34.954561  3384 raft_consensus.cc:1275] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Refusing update from remote peer 65bae5463b17443bb0fa568920a9ca19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:34.953898  3131 catalog_manager.cc:5697] T 66daa0e84b334222ac9af601b6a0a2dc P d31e1edf8df54dd5a75e9fba6cc0a1f3 reported cstate change: term changed from 1 to 2, leader changed from e260c115ddf045e88e73893d7f8269db (127.23.245.131) to d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130). New cstate: current_term: 2 leader_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:34.956281  3561 consensus_queue.cc:1048] T 848e8cff9e5b4de6b49a1bd243e9f9aa P 65bae5463b17443bb0fa568920a9ca19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:35.104249  3311 raft_consensus.cc:3060] T c4adb0932a604e779ef3ce9fff0b7bc5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:35.109903  3311 raft_consensus.cc:1275] T c4adb0932a604e779ef3ce9fff0b7bc5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Refusing update from remote peer 65bae5463b17443bb0fa568920a9ca19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:35.111331  3529 consensus_queue.cc:1048] T c4adb0932a604e779ef3ce9fff0b7bc5 P 65bae5463b17443bb0fa568920a9ca19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:35.120903  3384 raft_consensus.cc:1275] T c4adb0932a604e779ef3ce9fff0b7bc5 P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Refusing update from remote peer 65bae5463b17443bb0fa568920a9ca19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:35.122906  3529 consensus_queue.cc:1048] T c4adb0932a604e779ef3ce9fff0b7bc5 P 65bae5463b17443bb0fa568920a9ca19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:35.219415  3384 raft_consensus.cc:1275] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Refusing update from remote peer 65bae5463b17443bb0fa568920a9ca19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:35.220955  3529 consensus_queue.cc:1048] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P 65bae5463b17443bb0fa568920a9ca19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:35.233268  3311 raft_consensus.cc:1275] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Refusing update from remote peer 65bae5463b17443bb0fa568920a9ca19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:35.235033  3561 consensus_queue.cc:1048] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P 65bae5463b17443bb0fa568920a9ca19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:35.472967  3384 raft_consensus.cc:1275] T 66daa0e84b334222ac9af601b6a0a2dc P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Refusing update from remote peer d31e1edf8df54dd5a75e9fba6cc0a1f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:35.474488  3536 consensus_queue.cc:1048] T 66daa0e84b334222ac9af601b6a0a2dc P d31e1edf8df54dd5a75e9fba6cc0a1f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:35.478145  3236 raft_consensus.cc:1275] T 66daa0e84b334222ac9af601b6a0a2dc P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Refusing update from remote peer d31e1edf8df54dd5a75e9fba6cc0a1f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:35.479908  3557 consensus_queue.cc:1048] T 66daa0e84b334222ac9af601b6a0a2dc P d31e1edf8df54dd5a75e9fba6cc0a1f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:37.623587  3133 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51274:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:27:37.647439  3133 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51274:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:27:37.762323 24534 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 12:27:37.844630  3634 log.cc:927] Time spent T bfdfacb5c8bc4844936c037c39983f24 P e260c115ddf045e88e73893d7f8269db: Append to log took a long time: real 0.060s	user 0.002s	sys 0.003s
W20260709 12:27:37.927706  3641 log.cc:927] Time spent T c4adb0932a604e779ef3ce9fff0b7bc5 P d31e1edf8df54dd5a75e9fba6cc0a1f3: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:27:38.013558  3660 tablet.cc:1724] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:27:38.021461  3200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:37191, user_credentials={real_user=slave}} blocked reactor thread for 64942us
W20260709 12:27:38.045475  3656 log.cc:927] Time spent T 3ab18fc35bf84fd4876f3c9573c22c0d P 65bae5463b17443bb0fa568920a9ca19: Append to log took a long time: real 0.097s	user 0.002s	sys 0.000s
W20260709 12:27:38.060649  3649 log.cc:927] Time spent T bfdfacb5c8bc4844936c037c39983f24 P d31e1edf8df54dd5a75e9fba6cc0a1f3: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:27:38.076122  3659 tablet.cc:1724] T 18abc32bcdc8438d8f5438356c0b68bb P d31e1edf8df54dd5a75e9fba6cc0a1f3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:38.110618  3672 tablet.cc:1724] T c4adb0932a604e779ef3ce9fff0b7bc5 P d31e1edf8df54dd5a75e9fba6cc0a1f3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:27:38.120002  3277 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.129:44391, user_credentials={real_user=slave}} blocked reactor thread for 51794.4us
I20260709 12:27:38.114770  3674 tablet.cc:1724] T 3ab18fc35bf84fd4876f3c9573c22c0d P d31e1edf8df54dd5a75e9fba6cc0a1f3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:27:38.123809  3658 log.cc:927] Time spent T 821be9b5927a481ab065336d9a5c6522 P e260c115ddf045e88e73893d7f8269db: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:27:38.123518  3675 tablet.cc:1724] T 848e8cff9e5b4de6b49a1bd243e9f9aa P 65bae5463b17443bb0fa568920a9ca19: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:27:38.136466  3200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:37191, user_credentials={real_user=slave}} blocked reactor thread for 57088.1us
I20260709 12:27:38.154995  3667 tablet.cc:1724] T c4adb0932a604e779ef3ce9fff0b7bc5 P 65bae5463b17443bb0fa568920a9ca19: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:27:38.190326  3263 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:848e8cff9e5b4de6b49a1bd243e9f9aa)
W20260709 12:27:38.191229  3263 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:848e8cff9e5b4de6b49a1bd243e9f9aa)
I20260709 12:27:38.191710  3681 tablet.cc:1724] T 3ab18fc35bf84fd4876f3c9573c22c0d P e260c115ddf045e88e73893d7f8269db: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:38.161289  3669 tablet.cc:1724] T 18abc32bcdc8438d8f5438356c0b68bb P 65bae5463b17443bb0fa568920a9ca19: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:38.197065  3683 tablet.cc:1724] T 18abc32bcdc8438d8f5438356c0b68bb P e260c115ddf045e88e73893d7f8269db: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:38.205466  3310 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "821be9b5927a481ab065336d9a5c6522"
dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3"
mode: GRACEFUL
new_leader_uuid: "e260c115ddf045e88e73893d7f8269db"
 from {username='slave'} at 127.0.0.1:39646
I20260709 12:27:38.206286  3310 raft_consensus.cc:606] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 LEADER]: Received request to transfer leadership to TS e260c115ddf045e88e73893d7f8269db
I20260709 12:27:38.211092  3676 tablet.cc:1724] T 821be9b5927a481ab065336d9a5c6522 P 65bae5463b17443bb0fa568920a9ca19: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:27:38.216828  3338 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:18abc32bcdc8438d8f5438356c0b68bb)
I20260709 12:27:38.228335  3680 tablet.cc:1724] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P e260c115ddf045e88e73893d7f8269db: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:38.236593  3639 raft_consensus.cc:993] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3: : Instructing follower e260c115ddf045e88e73893d7f8269db to start an election
I20260709 12:27:38.237139  3639 raft_consensus.cc:1081] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 LEADER]: Signalling peer e260c115ddf045e88e73893d7f8269db to start an election
I20260709 12:27:38.236606  3685 tablet.cc:1724] T c4adb0932a604e779ef3ce9fff0b7bc5 P e260c115ddf045e88e73893d7f8269db: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:38.248561  3672 tablet.cc:1724] T 848e8cff9e5b4de6b49a1bd243e9f9aa P d31e1edf8df54dd5a75e9fba6cc0a1f3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:38.251238  3386 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "821be9b5927a481ab065336d9a5c6522"
dest_uuid: "e260c115ddf045e88e73893d7f8269db"
 from {username='slave'} at 127.0.0.1:52988
I20260709 12:27:38.255896  3386 raft_consensus.cc:493] T 821be9b5927a481ab065336d9a5c6522 P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:38.256464  3386 raft_consensus.cc:3060] T 821be9b5927a481ab065336d9a5c6522 P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:38.269627  3667 tablet.cc:1724] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P 65bae5463b17443bb0fa568920a9ca19: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:38.277796  3681 tablet.cc:1724] T bfdfacb5c8bc4844936c037c39983f24 P e260c115ddf045e88e73893d7f8269db: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:38.290657  3386 raft_consensus.cc:515] T 821be9b5927a481ab065336d9a5c6522 P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:38.291486  3667 tablet.cc:1724] T 3eebe28a0e1b493581b05e588dd920d5 P 65bae5463b17443bb0fa568920a9ca19: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:38.292788  3660 tablet.cc:1724] T 66daa0e84b334222ac9af601b6a0a2dc P d31e1edf8df54dd5a75e9fba6cc0a1f3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:38.295260  3659 tablet.cc:1724] T bfdfacb5c8bc4844936c037c39983f24 P d31e1edf8df54dd5a75e9fba6cc0a1f3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:38.300433  3685 tablet.cc:1724] T 66daa0e84b334222ac9af601b6a0a2dc P e260c115ddf045e88e73893d7f8269db: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:27:38.301433  3202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.130:44915, user_credentials={real_user=slave}} blocked reactor thread for 143567us
I20260709 12:27:38.315811  3680 tablet.cc:1724] T 3eebe28a0e1b493581b05e588dd920d5 P e260c115ddf045e88e73893d7f8269db: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:38.328447  3235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821be9b5927a481ab065336d9a5c6522" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "65bae5463b17443bb0fa568920a9ca19"
I20260709 12:27:38.329039  3235 raft_consensus.cc:3060] T 821be9b5927a481ab065336d9a5c6522 P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:38.304435  3669 tablet.cc:1724] T 3ab18fc35bf84fd4876f3c9573c22c0d P 65bae5463b17443bb0fa568920a9ca19: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:38.335973  3681 tablet.cc:1724] T 821be9b5927a481ab065336d9a5c6522 P e260c115ddf045e88e73893d7f8269db: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:38.337438  3235 raft_consensus.cc:2468] T 821be9b5927a481ab065336d9a5c6522 P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e260c115ddf045e88e73893d7f8269db in term 2.
I20260709 12:27:38.311666  3675 tablet.cc:1724] T 66daa0e84b334222ac9af601b6a0a2dc P 65bae5463b17443bb0fa568920a9ca19: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:38.346025  3310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821be9b5927a481ab065336d9a5c6522" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3"
I20260709 12:27:38.346771  3310 raft_consensus.cc:3055] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:38.347100  3310 raft_consensus.cc:740] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d31e1edf8df54dd5a75e9fba6cc0a1f3, State: Running, Role: LEADER
I20260709 12:27:38.347432  3351 leader_election.cc:304] T 821be9b5927a481ab065336d9a5c6522 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, e260c115ddf045e88e73893d7f8269db; no voters: 
I20260709 12:27:38.348137  3310 consensus_queue.cc:260] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:38.348742  3608 raft_consensus.cc:2804] T 821be9b5927a481ab065336d9a5c6522 P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:38.349249  3608 raft_consensus.cc:697] T 821be9b5927a481ab065336d9a5c6522 P e260c115ddf045e88e73893d7f8269db [term 2 LEADER]: Becoming Leader. State: Replica: e260c115ddf045e88e73893d7f8269db, State: Running, Role: LEADER
I20260709 12:27:38.349431  3310 raft_consensus.cc:3060] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:38.350777  3608 consensus_queue.cc:237] T 821be9b5927a481ab065336d9a5c6522 P e260c115ddf045e88e73893d7f8269db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:38.352741  3660 tablet.cc:1724] T 3eebe28a0e1b493581b05e588dd920d5 P d31e1edf8df54dd5a75e9fba6cc0a1f3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:38.362468  3131 catalog_manager.cc:5697] T 821be9b5927a481ab065336d9a5c6522 P e260c115ddf045e88e73893d7f8269db reported cstate change: term changed from 1 to 2, leader changed from d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130) to e260c115ddf045e88e73893d7f8269db (127.23.245.131). New cstate: current_term: 2 leader_uuid: "e260c115ddf045e88e73893d7f8269db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:38.345752  3386 leader_election.cc:290] T 821be9b5927a481ab065336d9a5c6522 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 2 election: Requested vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915)
I20260709 12:27:38.370340  3310 raft_consensus.cc:2468] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e260c115ddf045e88e73893d7f8269db in term 2.
I20260709 12:27:38.308765  3667 tablet.cc:1724] T bfdfacb5c8bc4844936c037c39983f24 P 65bae5463b17443bb0fa568920a9ca19: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:38.376868  3235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "848e8cff9e5b4de6b49a1bd243e9f9aa"
dest_uuid: "65bae5463b17443bb0fa568920a9ca19"
mode: GRACEFUL
new_leader_uuid: "e260c115ddf045e88e73893d7f8269db"
 from {username='slave'} at 127.0.0.1:48190
I20260709 12:27:38.377751  3235 raft_consensus.cc:606] T 848e8cff9e5b4de6b49a1bd243e9f9aa P 65bae5463b17443bb0fa568920a9ca19 [term 2 LEADER]: Received request to transfer leadership to TS e260c115ddf045e88e73893d7f8269db
I20260709 12:27:38.367183  3674 tablet.cc:1724] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P d31e1edf8df54dd5a75e9fba6cc0a1f3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:38.324656  3683 tablet.cc:1724] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:38.381912 24534 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 12:27:38.382543 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:38.395188  3235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f808f4193db4e6eba0ea677944df64d"
dest_uuid: "65bae5463b17443bb0fa568920a9ca19"
mode: GRACEFUL
new_leader_uuid: "e260c115ddf045e88e73893d7f8269db"
 from {username='slave'} at 127.0.0.1:48190
I20260709 12:27:38.395819  3235 raft_consensus.cc:606] T 2f808f4193db4e6eba0ea677944df64d P 65bae5463b17443bb0fa568920a9ca19 [term 1 LEADER]: Received request to transfer leadership to TS e260c115ddf045e88e73893d7f8269db
I20260709 12:27:38.399214  3310 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3f0de7c8efd147bcb0dcec69dd1bc2ab"
dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3"
mode: GRACEFUL
new_leader_uuid: "e260c115ddf045e88e73893d7f8269db"
 from {username='slave'} at 127.0.0.1:39646
I20260709 12:27:38.400069  3310 raft_consensus.cc:606] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 LEADER]: Received request to transfer leadership to TS e260c115ddf045e88e73893d7f8269db
I20260709 12:27:38.402729 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:27:38.403355 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:38.414587  3132 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 59c475b718094d42b6d9bca928db8d52: soft_deleted_table [id=542dd44161144d8eacebc969699a5ca3] alter complete (version 1)
I20260709 12:27:38.419338  3638 raft_consensus.cc:993] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3: : Instructing follower e260c115ddf045e88e73893d7f8269db to start an election
I20260709 12:27:38.419859  3638 raft_consensus.cc:1081] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 LEADER]: Signalling peer e260c115ddf045e88e73893d7f8269db to start an election
I20260709 12:27:38.421602  3386 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3f0de7c8efd147bcb0dcec69dd1bc2ab"
dest_uuid: "e260c115ddf045e88e73893d7f8269db"
 from {username='slave'} at 127.0.0.1:52988
I20260709 12:27:38.422118  3386 raft_consensus.cc:493] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:38.422485  3386 raft_consensus.cc:3060] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:38.427441  3386 raft_consensus.cc:515] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P e260c115ddf045e88e73893d7f8269db [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:38.429036  3386 leader_election.cc:290] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 3 election: Requested vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915)
I20260709 12:27:38.429656  3235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f0de7c8efd147bcb0dcec69dd1bc2ab" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "65bae5463b17443bb0fa568920a9ca19"
I20260709 12:27:38.430069  3310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f0de7c8efd147bcb0dcec69dd1bc2ab" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3"
I20260709 12:27:38.430366  3235 raft_consensus.cc:3060] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:38.430702  3310 raft_consensus.cc:3055] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:38.431041  3310 raft_consensus.cc:740] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d31e1edf8df54dd5a75e9fba6cc0a1f3, State: Running, Role: LEADER
I20260709 12:27:38.431902  3310 consensus_queue.cc:260] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:38.433202  3310 raft_consensus.cc:3060] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:38.437500  3235 raft_consensus.cc:2468] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e260c115ddf045e88e73893d7f8269db in term 3.
I20260709 12:27:38.438714  3351 leader_election.cc:304] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, e260c115ddf045e88e73893d7f8269db; no voters: 
I20260709 12:27:38.439390  3608 raft_consensus.cc:2804] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P e260c115ddf045e88e73893d7f8269db [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:38.439867  3608 raft_consensus.cc:697] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P e260c115ddf045e88e73893d7f8269db [term 3 LEADER]: Becoming Leader. State: Replica: e260c115ddf045e88e73893d7f8269db, State: Running, Role: LEADER
I20260709 12:27:38.440209  3310 raft_consensus.cc:2468] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e260c115ddf045e88e73893d7f8269db in term 3.
I20260709 12:27:38.440824  3608 consensus_queue.cc:237] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P e260c115ddf045e88e73893d7f8269db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:38.448977  3132 catalog_manager.cc:5697] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P e260c115ddf045e88e73893d7f8269db reported cstate change: term changed from 2 to 3, leader changed from d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130) to e260c115ddf045e88e73893d7f8269db (127.23.245.131). New cstate: current_term: 3 leader_uuid: "e260c115ddf045e88e73893d7f8269db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:38.625213  3670 raft_consensus.cc:993] T 848e8cff9e5b4de6b49a1bd243e9f9aa P 65bae5463b17443bb0fa568920a9ca19: : Instructing follower e260c115ddf045e88e73893d7f8269db to start an election
I20260709 12:27:38.625730  3665 raft_consensus.cc:1081] T 848e8cff9e5b4de6b49a1bd243e9f9aa P 65bae5463b17443bb0fa568920a9ca19 [term 2 LEADER]: Signalling peer e260c115ddf045e88e73893d7f8269db to start an election
I20260709 12:27:38.627254  3386 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "848e8cff9e5b4de6b49a1bd243e9f9aa"
dest_uuid: "e260c115ddf045e88e73893d7f8269db"
 from {username='slave'} at 127.0.0.1:52976
I20260709 12:27:38.627827  3386 raft_consensus.cc:493] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:38.628196  3386 raft_consensus.cc:3060] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:38.633574  3386 raft_consensus.cc:515] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:38.634898  3386 leader_election.cc:290] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 3 election: Requested vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915)
I20260709 12:27:38.635692  3235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848e8cff9e5b4de6b49a1bd243e9f9aa" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "65bae5463b17443bb0fa568920a9ca19"
I20260709 12:27:38.636059  3310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848e8cff9e5b4de6b49a1bd243e9f9aa" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3"
I20260709 12:27:38.636344  3235 raft_consensus.cc:3055] T 848e8cff9e5b4de6b49a1bd243e9f9aa P 65bae5463b17443bb0fa568920a9ca19 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:38.636650  3310 raft_consensus.cc:3060] T 848e8cff9e5b4de6b49a1bd243e9f9aa P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:38.636765  3235 raft_consensus.cc:740] T 848e8cff9e5b4de6b49a1bd243e9f9aa P 65bae5463b17443bb0fa568920a9ca19 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 65bae5463b17443bb0fa568920a9ca19, State: Running, Role: LEADER
I20260709 12:27:38.637758  3235 consensus_queue.cc:260] T 848e8cff9e5b4de6b49a1bd243e9f9aa P 65bae5463b17443bb0fa568920a9ca19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:38.639007  3235 raft_consensus.cc:3060] T 848e8cff9e5b4de6b49a1bd243e9f9aa P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:38.643113  3310 raft_consensus.cc:2468] T 848e8cff9e5b4de6b49a1bd243e9f9aa P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e260c115ddf045e88e73893d7f8269db in term 3.
I20260709 12:27:38.644315  3351 leader_election.cc:304] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d31e1edf8df54dd5a75e9fba6cc0a1f3, e260c115ddf045e88e73893d7f8269db; no voters: 
I20260709 12:27:38.644798  3235 raft_consensus.cc:2468] T 848e8cff9e5b4de6b49a1bd243e9f9aa P 65bae5463b17443bb0fa568920a9ca19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e260c115ddf045e88e73893d7f8269db in term 3.
I20260709 12:27:38.645179  3608 raft_consensus.cc:2804] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:38.645835  3608 raft_consensus.cc:697] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [term 3 LEADER]: Becoming Leader. State: Replica: e260c115ddf045e88e73893d7f8269db, State: Running, Role: LEADER
I20260709 12:27:38.646634  3608 consensus_queue.cc:237] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:38.653612  3132 catalog_manager.cc:5697] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db reported cstate change: term changed from 2 to 3, leader changed from 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129) to e260c115ddf045e88e73893d7f8269db (127.23.245.131). New cstate: current_term: 3 leader_uuid: "e260c115ddf045e88e73893d7f8269db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:38.745731  3235 raft_consensus.cc:1275] T 821be9b5927a481ab065336d9a5c6522 P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Refusing update from remote peer e260c115ddf045e88e73893d7f8269db: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:27:38.746666  3310 raft_consensus.cc:1275] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Refusing update from remote peer e260c115ddf045e88e73893d7f8269db: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:27:38.747195  3608 consensus_queue.cc:1048] T 821be9b5927a481ab065336d9a5c6522 P e260c115ddf045e88e73893d7f8269db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:38.748095  3644 consensus_queue.cc:1048] T 821be9b5927a481ab065336d9a5c6522 P e260c115ddf045e88e73893d7f8269db [LEADER]: Connected to new peer: Peer: permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:38.809226  3670 raft_consensus.cc:993] T 2f808f4193db4e6eba0ea677944df64d P 65bae5463b17443bb0fa568920a9ca19: : Instructing follower e260c115ddf045e88e73893d7f8269db to start an election
I20260709 12:27:38.809764  3665 raft_consensus.cc:1081] T 2f808f4193db4e6eba0ea677944df64d P 65bae5463b17443bb0fa568920a9ca19 [term 1 LEADER]: Signalling peer e260c115ddf045e88e73893d7f8269db to start an election
I20260709 12:27:38.811112  3386 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f808f4193db4e6eba0ea677944df64d"
dest_uuid: "e260c115ddf045e88e73893d7f8269db"
 from {username='slave'} at 127.0.0.1:52976
I20260709 12:27:38.811501  3386 raft_consensus.cc:493] T 2f808f4193db4e6eba0ea677944df64d P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:38.811733  3386 raft_consensus.cc:3060] T 2f808f4193db4e6eba0ea677944df64d P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:38.816320  3386 raft_consensus.cc:515] T 2f808f4193db4e6eba0ea677944df64d P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:38.817829  3386 leader_election.cc:290] T 2f808f4193db4e6eba0ea677944df64d P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 2 election: Requested vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915)
I20260709 12:27:38.818570  3237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f808f4193db4e6eba0ea677944df64d" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "65bae5463b17443bb0fa568920a9ca19"
I20260709 12:27:38.818799  3310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f808f4193db4e6eba0ea677944df64d" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3"
I20260709 12:27:38.819196  3237 raft_consensus.cc:3055] T 2f808f4193db4e6eba0ea677944df64d P 65bae5463b17443bb0fa568920a9ca19 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:38.819325  3310 raft_consensus.cc:3060] T 2f808f4193db4e6eba0ea677944df64d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:38.819543  3237 raft_consensus.cc:740] T 2f808f4193db4e6eba0ea677944df64d P 65bae5463b17443bb0fa568920a9ca19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65bae5463b17443bb0fa568920a9ca19, State: Running, Role: LEADER
I20260709 12:27:38.820442  3237 consensus_queue.cc:260] T 2f808f4193db4e6eba0ea677944df64d P 65bae5463b17443bb0fa568920a9ca19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:38.821692  3237 raft_consensus.cc:3060] T 2f808f4193db4e6eba0ea677944df64d P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:38.826493  3310 raft_consensus.cc:2468] T 2f808f4193db4e6eba0ea677944df64d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e260c115ddf045e88e73893d7f8269db in term 2.
I20260709 12:27:38.826944  3309 raft_consensus.cc:1275] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Refusing update from remote peer e260c115ddf045e88e73893d7f8269db: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:38.827575  3351 leader_election.cc:304] T 2f808f4193db4e6eba0ea677944df64d P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d31e1edf8df54dd5a75e9fba6cc0a1f3, e260c115ddf045e88e73893d7f8269db; no voters: 
I20260709 12:27:38.828433  3693 raft_consensus.cc:2804] T 2f808f4193db4e6eba0ea677944df64d P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:38.828708  3608 consensus_queue.cc:1048] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P e260c115ddf045e88e73893d7f8269db [LEADER]: Connected to new peer: Peer: permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:38.828995  3693 raft_consensus.cc:697] T 2f808f4193db4e6eba0ea677944df64d P e260c115ddf045e88e73893d7f8269db [term 2 LEADER]: Becoming Leader. State: Replica: e260c115ddf045e88e73893d7f8269db, State: Running, Role: LEADER
I20260709 12:27:38.829216  3237 raft_consensus.cc:2468] T 2f808f4193db4e6eba0ea677944df64d P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e260c115ddf045e88e73893d7f8269db in term 2.
I20260709 12:27:38.829965  3693 consensus_queue.cc:237] T 2f808f4193db4e6eba0ea677944df64d P e260c115ddf045e88e73893d7f8269db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:38.837193  3237 raft_consensus.cc:1275] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19 [term 3 FOLLOWER]: Refusing update from remote peer e260c115ddf045e88e73893d7f8269db: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:38.841768  3132 catalog_manager.cc:5697] T 2f808f4193db4e6eba0ea677944df64d P e260c115ddf045e88e73893d7f8269db reported cstate change: term changed from 1 to 2, leader changed from 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129) to e260c115ddf045e88e73893d7f8269db (127.23.245.131). New cstate: current_term: 2 leader_uuid: "e260c115ddf045e88e73893d7f8269db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:38.842774  3644 consensus_queue.cc:1048] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P e260c115ddf045e88e73893d7f8269db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:39.060128  3309 raft_consensus.cc:1275] T 848e8cff9e5b4de6b49a1bd243e9f9aa P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Refusing update from remote peer e260c115ddf045e88e73893d7f8269db: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:27:39.061489  3693 consensus_queue.cc:1048] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [LEADER]: Connected to new peer: Peer: permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:39.070861  3237 raft_consensus.cc:1275] T 848e8cff9e5b4de6b49a1bd243e9f9aa P 65bae5463b17443bb0fa568920a9ca19 [term 3 FOLLOWER]: Refusing update from remote peer e260c115ddf045e88e73893d7f8269db: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:27:39.072190  3693 consensus_queue.cc:1048] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:39.216861  3309 raft_consensus.cc:1275] T 2f808f4193db4e6eba0ea677944df64d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Refusing update from remote peer e260c115ddf045e88e73893d7f8269db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:39.218063  3693 consensus_queue.cc:1048] T 2f808f4193db4e6eba0ea677944df64d P e260c115ddf045e88e73893d7f8269db [LEADER]: Connected to new peer: Peer: permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:39.226339  3237 raft_consensus.cc:1275] T 2f808f4193db4e6eba0ea677944df64d P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Refusing update from remote peer e260c115ddf045e88e73893d7f8269db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:39.230093  3608 consensus_queue.cc:1048] T 2f808f4193db4e6eba0ea677944df64d P e260c115ddf045e88e73893d7f8269db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:39.404698 24534 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:27:39.410879 24534 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:27:39.411347 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:39.416579 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:39.417006 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:40.418237 24534 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:27:40.425774 24534 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:27:40.426138 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:40.430878 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:40.431203 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:41.983340 24534 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:27:42.002460 24534 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:27:42.007855 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:42.036936 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:42.037624 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:42.341609  3711 raft_consensus.cc:493] T bfdfacb5c8bc4844936c037c39983f24 P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e260c115ddf045e88e73893d7f8269db)
I20260709 12:27:42.342445  3711 raft_consensus.cc:515] T bfdfacb5c8bc4844936c037c39983f24 P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:42.345235  3711 leader_election.cc:290] T bfdfacb5c8bc4844936c037c39983f24 P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:42.347332  3711 raft_consensus.cc:493] T 42f943816e0640d0af646f248f518df5 P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d31e1edf8df54dd5a75e9fba6cc0a1f3)
I20260709 12:27:42.347612  3705 raft_consensus.cc:493] T 821be9b5927a481ab065336d9a5c6522 P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e260c115ddf045e88e73893d7f8269db)
I20260709 12:27:42.347888  3711 raft_consensus.cc:515] T 42f943816e0640d0af646f248f518df5 P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:42.348281  3705 raft_consensus.cc:515] T 821be9b5927a481ab065336d9a5c6522 P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:42.350488  3711 leader_election.cc:290] T 42f943816e0640d0af646f248f518df5 P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:42.348541  3710 raft_consensus.cc:493] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e260c115ddf045e88e73893d7f8269db)
I20260709 12:27:42.351202  3705 leader_election.cc:290] T 821be9b5927a481ab065336d9a5c6522 P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:42.351163  3710 raft_consensus.cc:515] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:42.353605  3710 leader_election.cc:290] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:42.348276  3714 raft_consensus.cc:493] T 3eebe28a0e1b493581b05e588dd920d5 P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65bae5463b17443bb0fa568920a9ca19)
I20260709 12:27:42.356194  3714 raft_consensus.cc:515] T 3eebe28a0e1b493581b05e588dd920d5 P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:42.358253  3714 leader_election.cc:290] T 3eebe28a0e1b493581b05e588dd920d5 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915)
I20260709 12:27:42.359506  3710 raft_consensus.cc:493] T 5d25e61c23044d75a5c8fbdca4c23eb2 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 65bae5463b17443bb0fa568920a9ca19)
I20260709 12:27:42.360013  3714 raft_consensus.cc:493] T c4adb0932a604e779ef3ce9fff0b7bc5 P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 65bae5463b17443bb0fa568920a9ca19)
I20260709 12:27:42.361944  3714 raft_consensus.cc:515] T c4adb0932a604e779ef3ce9fff0b7bc5 P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:42.366230  3714 leader_election.cc:290] T c4adb0932a604e779ef3ce9fff0b7bc5 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915)
I20260709 12:27:42.366770  3714 raft_consensus.cc:493] T 42f943816e0640d0af646f248f518df5 P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader d31e1edf8df54dd5a75e9fba6cc0a1f3)
I20260709 12:27:42.367230  3714 raft_consensus.cc:515] T 42f943816e0640d0af646f248f518df5 P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:42.369397  3714 leader_election.cc:290] T 42f943816e0640d0af646f248f518df5 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915)
I20260709 12:27:42.361011  3710 raft_consensus.cc:515] T 5d25e61c23044d75a5c8fbdca4c23eb2 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } } peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } }
I20260709 12:27:42.372215  3710 leader_election.cc:290] T 5d25e61c23044d75a5c8fbdca4c23eb2 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191), 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391)
I20260709 12:27:43.172473  3719 raft_consensus.cc:493] T bfdfacb5c8bc4844936c037c39983f24 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e260c115ddf045e88e73893d7f8269db)
I20260709 12:27:43.173030  3719 raft_consensus.cc:515] T bfdfacb5c8bc4844936c037c39983f24 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:43.173435  3720 raft_consensus.cc:493] T 848e8cff9e5b4de6b49a1bd243e9f9aa P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e260c115ddf045e88e73893d7f8269db)
I20260709 12:27:43.174165  3720 raft_consensus.cc:515] T 848e8cff9e5b4de6b49a1bd243e9f9aa P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:43.176061  3719 leader_election.cc:290] T bfdfacb5c8bc4844936c037c39983f24 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:43.176990  3720 leader_election.cc:290] T 848e8cff9e5b4de6b49a1bd243e9f9aa P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:43.214510  3720 raft_consensus.cc:493] T c4adb0932a604e779ef3ce9fff0b7bc5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 65bae5463b17443bb0fa568920a9ca19)
I20260709 12:27:43.215224  3720 raft_consensus.cc:515] T c4adb0932a604e779ef3ce9fff0b7bc5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:43.215575  3721 raft_consensus.cc:493] T bfb3537bcd1e40918b030db5bc35117b P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65bae5463b17443bb0fa568920a9ca19)
I20260709 12:27:43.216455  3721 raft_consensus.cc:515] T bfb3537bcd1e40918b030db5bc35117b P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:43.217883  3720 leader_election.cc:290] T c4adb0932a604e779ef3ce9fff0b7bc5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:43.218580  3720 raft_consensus.cc:493] T 3eebe28a0e1b493581b05e588dd920d5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65bae5463b17443bb0fa568920a9ca19)
I20260709 12:27:43.219210  3719 raft_consensus.cc:493] T 71b5bc230abf46069a29bb86e6039a15 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 65bae5463b17443bb0fa568920a9ca19)
I20260709 12:27:43.219430  3721 leader_election.cc:290] T bfb3537bcd1e40918b030db5bc35117b P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:43.219805  3719 raft_consensus.cc:515] T 71b5bc230abf46069a29bb86e6039a15 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:43.220321  3721 raft_consensus.cc:493] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 65bae5463b17443bb0fa568920a9ca19)
I20260709 12:27:43.221053  3721 raft_consensus.cc:515] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:43.221818  3719 leader_election.cc:290] T 71b5bc230abf46069a29bb86e6039a15 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:43.223511  3721 leader_election.cc:290] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:43.224193  3720 raft_consensus.cc:515] T 3eebe28a0e1b493581b05e588dd920d5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:43.226622  3720 leader_election.cc:290] T 3eebe28a0e1b493581b05e588dd920d5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
W20260709 12:27:43.235083  3333 debug-util.cc:398] Leaking SignalData structure 0x7b080013a4c0 after lost signal to thread 24537
W20260709 12:27:43.236536  3333 debug-util.cc:398] Leaking SignalData structure 0x7b08000c7a20 after lost signal to thread 3169
W20260709 12:27:43.237643  3333 debug-util.cc:398] Leaking SignalData structure 0x7b080015c000 after lost signal to thread 3261
W20260709 12:27:43.238672  3333 debug-util.cc:398] Leaking SignalData structure 0x7b08001fc960 after lost signal to thread 3336
W20260709 12:27:43.249354  3275 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.562s	user 0.013s	sys 0.011s
W20260709 12:27:43.250151  3275 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.563s	user 0.013s	sys 0.011s
I20260709 12:27:43.253077  3719 raft_consensus.cc:493] T 2f808f4193db4e6eba0ea677944df64d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e260c115ddf045e88e73893d7f8269db)
W20260709 12:27:43.253789  3333 debug-util.cc:398] Leaking SignalData structure 0x7b080008c6e0 after lost signal to thread 3410
I20260709 12:27:43.253721  3719 raft_consensus.cc:515] T 2f808f4193db4e6eba0ea677944df64d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:43.254732  3722 raft_consensus.cc:493] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e260c115ddf045e88e73893d7f8269db)
I20260709 12:27:43.255226  3722 raft_consensus.cc:515] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:43.256135  3719 leader_election.cc:290] T 2f808f4193db4e6eba0ea677944df64d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:43.250761  3720 raft_consensus.cc:493] T 088188cf28674e1c94310faf6d3f7ff4 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e260c115ddf045e88e73893d7f8269db)
I20260709 12:27:43.257035  3720 raft_consensus.cc:515] T 088188cf28674e1c94310faf6d3f7ff4 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:43.258268  3722 leader_election.cc:290] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:43.260986  3720 leader_election.cc:290] T 088188cf28674e1c94310faf6d3f7ff4 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:43.262243  3670 raft_consensus.cc:493] T 18abc32bcdc8438d8f5438356c0b68bb P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d31e1edf8df54dd5a75e9fba6cc0a1f3)
I20260709 12:27:43.318013  3670 raft_consensus.cc:515] T 18abc32bcdc8438d8f5438356c0b68bb P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:43.319257  3693 raft_consensus.cc:493] T 3ab18fc35bf84fd4876f3c9573c22c0d P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d31e1edf8df54dd5a75e9fba6cc0a1f3)
I20260709 12:27:43.319893  3693 raft_consensus.cc:515] T 3ab18fc35bf84fd4876f3c9573c22c0d P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:43.320475  3670 leader_election.cc:290] T 18abc32bcdc8438d8f5438356c0b68bb P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:43.322029  3670 raft_consensus.cc:493] T f05d1ba2ab1744db8f477c06f30a6887 P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d31e1edf8df54dd5a75e9fba6cc0a1f3)
I20260709 12:27:43.322165  3693 leader_election.cc:290] T 3ab18fc35bf84fd4876f3c9573c22c0d P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915)
I20260709 12:27:43.263980  3237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821be9b5927a481ab065336d9a5c6522" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19" is_pre_election: true
I20260709 12:27:43.323388  3237 raft_consensus.cc:2468] T 821be9b5927a481ab065336d9a5c6522 P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d31e1edf8df54dd5a75e9fba6cc0a1f3 in term 2.
I20260709 12:27:43.324518  3237 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f0de7c8efd147bcb0dcec69dd1bc2ab" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19" is_pre_election: true
I20260709 12:27:43.328697  3725 raft_consensus.cc:493] T 5d25e61c23044d75a5c8fbdca4c23eb2 P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 65bae5463b17443bb0fa568920a9ca19)
I20260709 12:27:43.332336  3383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821be9b5927a481ab065336d9a5c6522" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db" is_pre_election: true
I20260709 12:27:43.333858  3382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d25e61c23044d75a5c8fbdca4c23eb2" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db" is_pre_election: true
I20260709 12:27:43.334848  3723 raft_consensus.cc:493] T 088188cf28674e1c94310faf6d3f7ff4 P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e260c115ddf045e88e73893d7f8269db)
I20260709 12:27:43.329249  3725 raft_consensus.cc:515] T 5d25e61c23044d75a5c8fbdca4c23eb2 P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } } peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } }
I20260709 12:27:43.336473  3235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f808f4193db4e6eba0ea677944df64d" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19" is_pre_election: true
I20260709 12:27:43.335395  3723 raft_consensus.cc:515] T 088188cf28674e1c94310faf6d3f7ff4 P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:43.337280  3382 raft_consensus.cc:2468] T 5d25e61c23044d75a5c8fbdca4c23eb2 P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d31e1edf8df54dd5a75e9fba6cc0a1f3 in term 2.
I20260709 12:27:43.338581  3725 leader_election.cc:290] T 5d25e61c23044d75a5c8fbdca4c23eb2 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915), 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391)
I20260709 12:27:43.338948  3723 leader_election.cc:290] T 088188cf28674e1c94310faf6d3f7ff4 P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:43.342470  3380 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdfacb5c8bc4844936c037c39983f24" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db" is_pre_election: true
I20260709 12:27:43.343237  3384 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848e8cff9e5b4de6b49a1bd243e9f9aa" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db" is_pre_election: true
I20260709 12:27:43.344362  3312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18abc32bcdc8438d8f5438356c0b68bb" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" is_pre_election: true
I20260709 12:27:43.344586  3379 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4adb0932a604e779ef3ce9fff0b7bc5" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db" is_pre_election: true
I20260709 12:27:43.345305  3379 raft_consensus.cc:2468] T c4adb0932a604e779ef3ce9fff0b7bc5 P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d31e1edf8df54dd5a75e9fba6cc0a1f3 in term 2.
I20260709 12:27:43.346239  3234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c6742a5e0e4b0eb07abd8f93c2a8fb" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19" is_pre_election: true
I20260709 12:27:43.346403  3312 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "088188cf28674e1c94310faf6d3f7ff4" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" is_pre_election: true
I20260709 12:27:43.346344  3378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3537bcd1e40918b030db5bc35117b" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db" is_pre_election: true
I20260709 12:27:43.268615  3708 raft_consensus.cc:493] T 2f808f4193db4e6eba0ea677944df64d P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e260c115ddf045e88e73893d7f8269db)
I20260709 12:27:43.348743  3378 raft_consensus.cc:2468] T bfb3537bcd1e40918b030db5bc35117b P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d31e1edf8df54dd5a75e9fba6cc0a1f3 in term 1.
I20260709 12:27:43.348932  3708 raft_consensus.cc:515] T 2f808f4193db4e6eba0ea677944df64d P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:43.349726  3723 raft_consensus.cc:493] T 848e8cff9e5b4de6b49a1bd243e9f9aa P 65bae5463b17443bb0fa568920a9ca19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e260c115ddf045e88e73893d7f8269db)
I20260709 12:27:43.322860  3693 raft_consensus.cc:493] T 71b5bc230abf46069a29bb86e6039a15 P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 65bae5463b17443bb0fa568920a9ca19)
I20260709 12:27:43.273942  3236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdfacb5c8bc4844936c037c39983f24" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19" is_pre_election: true
I20260709 12:27:43.351181  3236 raft_consensus.cc:2468] T bfdfacb5c8bc4844936c037c39983f24 P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d31e1edf8df54dd5a75e9fba6cc0a1f3 in term 1.
I20260709 12:27:43.351078  3693 raft_consensus.cc:515] T 71b5bc230abf46069a29bb86e6039a15 P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:43.351416  3708 leader_election.cc:290] T 2f808f4193db4e6eba0ea677944df64d P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:43.275647  3230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4adb0932a604e779ef3ce9fff0b7bc5" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19" is_pre_election: true
I20260709 12:27:43.276901  3229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3537bcd1e40918b030db5bc35117b" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19" is_pre_election: true
I20260709 12:27:43.325093  3237 raft_consensus.cc:2468] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d31e1edf8df54dd5a75e9fba6cc0a1f3 in term 3.
I20260709 12:27:43.278168  3228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b5bc230abf46069a29bb86e6039a15" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19" is_pre_election: true
I20260709 12:27:43.353302  3235 raft_consensus.cc:2468] T 2f808f4193db4e6eba0ea677944df64d P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d31e1edf8df54dd5a75e9fba6cc0a1f3 in term 2.
I20260709 12:27:43.308542  3309 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdfacb5c8bc4844936c037c39983f24" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" is_pre_election: true
I20260709 12:27:43.347700  3234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eebe28a0e1b493581b05e588dd920d5" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19" is_pre_election: true
I20260709 12:27:43.354077  3309 raft_consensus.cc:2468] T bfdfacb5c8bc4844936c037c39983f24 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65bae5463b17443bb0fa568920a9ca19 in term 1.
I20260709 12:27:43.354238  3725 raft_consensus.cc:493] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 65bae5463b17443bb0fa568920a9ca19)
I20260709 12:27:43.309132  3306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f943816e0640d0af646f248f518df5" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" is_pre_election: true
I20260709 12:27:43.354751  3725 raft_consensus.cc:515] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:43.309381  3311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4adb0932a604e779ef3ce9fff0b7bc5" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" is_pre_election: true
I20260709 12:27:43.356842  3725 leader_election.cc:290] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915)
I20260709 12:27:43.309958  3305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f943816e0640d0af646f248f518df5" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" is_pre_election: true
I20260709 12:27:43.310129  3304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821be9b5927a481ab065336d9a5c6522" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" is_pre_election: true
I20260709 12:27:43.312286  3310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eebe28a0e1b493581b05e588dd920d5" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" is_pre_election: true
I20260709 12:27:43.357664  3277 leader_election.cc:304] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, d31e1edf8df54dd5a75e9fba6cc0a1f3; no voters: 
I20260709 12:27:43.322729  3233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "088188cf28674e1c94310faf6d3f7ff4" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19" is_pre_election: true
I20260709 12:27:43.358628  3231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848e8cff9e5b4de6b49a1bd243e9f9aa" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19" is_pre_election: true
I20260709 12:27:43.358875  3233 raft_consensus.cc:2468] T 088188cf28674e1c94310faf6d3f7ff4 P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d31e1edf8df54dd5a75e9fba6cc0a1f3 in term 2.
I20260709 12:27:43.360774  3693 leader_election.cc:290] T 71b5bc230abf46069a29bb86e6039a15 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915)
I20260709 12:27:43.361200  3725 raft_consensus.cc:493] T f05d1ba2ab1744db8f477c06f30a6887 P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d31e1edf8df54dd5a75e9fba6cc0a1f3)
I20260709 12:27:43.361793  3725 raft_consensus.cc:515] T f05d1ba2ab1744db8f477c06f30a6887 P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:43.350294  3723 raft_consensus.cc:515] T 848e8cff9e5b4de6b49a1bd243e9f9aa P 65bae5463b17443bb0fa568920a9ca19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:43.272518  3232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d25e61c23044d75a5c8fbdca4c23eb2" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19" is_pre_election: true
I20260709 12:27:43.364377  3377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b5bc230abf46069a29bb86e6039a15" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db" is_pre_election: true
I20260709 12:27:43.365120  3377 raft_consensus.cc:2468] T 71b5bc230abf46069a29bb86e6039a15 P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d31e1edf8df54dd5a75e9fba6cc0a1f3 in term 2.
I20260709 12:27:43.365955  3231 raft_consensus.cc:2468] T 848e8cff9e5b4de6b49a1bd243e9f9aa P 65bae5463b17443bb0fa568920a9ca19 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d31e1edf8df54dd5a75e9fba6cc0a1f3 in term 3.
I20260709 12:27:43.322556  3670 raft_consensus.cc:515] T f05d1ba2ab1744db8f477c06f30a6887 P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:43.369095  3725 leader_election.cc:290] T f05d1ba2ab1744db8f477c06f30a6887 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915)
I20260709 12:27:43.369659  3377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c6742a5e0e4b0eb07abd8f93c2a8fb" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db" is_pre_election: true
I20260709 12:27:43.370383  3377 raft_consensus.cc:2468] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d31e1edf8df54dd5a75e9fba6cc0a1f3 in term 2.
I20260709 12:27:43.370599  3721 raft_consensus.cc:2804] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:43.371109  3721 raft_consensus.cc:493] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e260c115ddf045e88e73893d7f8269db)
I20260709 12:27:43.371506  3721 raft_consensus.cc:3060] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:43.371798  3377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eebe28a0e1b493581b05e588dd920d5" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db" is_pre_election: true
I20260709 12:27:43.372242  3202 leader_election.cc:304] T bfdfacb5c8bc4844936c037c39983f24 P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, d31e1edf8df54dd5a75e9fba6cc0a1f3; no voters: 
I20260709 12:27:43.372524  3377 raft_consensus.cc:2468] T 3eebe28a0e1b493581b05e588dd920d5 P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d31e1edf8df54dd5a75e9fba6cc0a1f3 in term 1.
I20260709 12:27:43.373724  3381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f808f4193db4e6eba0ea677944df64d" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db" is_pre_election: true
I20260709 12:27:43.373880  3723 leader_election.cc:290] T 848e8cff9e5b4de6b49a1bd243e9f9aa P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:43.372771  3310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f808f4193db4e6eba0ea677944df64d" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" is_pre_election: true
I20260709 12:27:43.374445  3382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f0de7c8efd147bcb0dcec69dd1bc2ab" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db" is_pre_election: true
I20260709 12:27:43.376107  3378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "088188cf28674e1c94310faf6d3f7ff4" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db" is_pre_election: true
I20260709 12:27:43.379455  3715 raft_consensus.cc:2804] T bfdfacb5c8bc4844936c037c39983f24 P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:43.379840  3715 raft_consensus.cc:493] T bfdfacb5c8bc4844936c037c39983f24 P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e260c115ddf045e88e73893d7f8269db)
I20260709 12:27:43.380254  3715 raft_consensus.cc:3060] T bfdfacb5c8bc4844936c037c39983f24 P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:43.382167  3721 raft_consensus.cc:515] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:43.384829  3277 leader_election.cc:304] T bfdfacb5c8bc4844936c037c39983f24 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, d31e1edf8df54dd5a75e9fba6cc0a1f3; no voters: e260c115ddf045e88e73893d7f8269db
I20260709 12:27:43.385483  3275 leader_election.cc:304] T c4adb0932a604e779ef3ce9fff0b7bc5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d31e1edf8df54dd5a75e9fba6cc0a1f3, e260c115ddf045e88e73893d7f8269db; no voters: 
I20260709 12:27:43.385608  3722 raft_consensus.cc:2804] T bfdfacb5c8bc4844936c037c39983f24 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:43.386116  3722 raft_consensus.cc:493] T bfdfacb5c8bc4844936c037c39983f24 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e260c115ddf045e88e73893d7f8269db)
I20260709 12:27:43.386457  3722 raft_consensus.cc:3060] T bfdfacb5c8bc4844936c037c39983f24 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:43.386634  3275 leader_election.cc:304] T bfb3537bcd1e40918b030db5bc35117b P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d31e1edf8df54dd5a75e9fba6cc0a1f3, e260c115ddf045e88e73893d7f8269db; no voters: 
I20260709 12:27:43.386958  3720 raft_consensus.cc:2804] T c4adb0932a604e779ef3ce9fff0b7bc5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:43.387560  3719 raft_consensus.cc:2804] T bfb3537bcd1e40918b030db5bc35117b P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:43.387995  3719 raft_consensus.cc:493] T bfb3537bcd1e40918b030db5bc35117b P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 65bae5463b17443bb0fa568920a9ca19)
I20260709 12:27:43.388489  3719 raft_consensus.cc:3060] T bfb3537bcd1e40918b030db5bc35117b P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:43.389087  3304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05d1ba2ab1744db8f477c06f30a6887" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" is_pre_election: true
I20260709 12:27:43.391417  3277 leader_election.cc:304] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, d31e1edf8df54dd5a75e9fba6cc0a1f3; no voters: 
I20260709 12:27:43.387409  3310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848e8cff9e5b4de6b49a1bd243e9f9aa" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" is_pre_election: true
I20260709 12:27:43.392292  3310 raft_consensus.cc:2468] T 848e8cff9e5b4de6b49a1bd243e9f9aa P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65bae5463b17443bb0fa568920a9ca19 in term 3.
I20260709 12:27:43.393365  3715 raft_consensus.cc:515] T bfdfacb5c8bc4844936c037c39983f24 P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:43.395637  3722 raft_consensus.cc:515] T bfdfacb5c8bc4844936c037c39983f24 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:43.399547  3275 leader_election.cc:304] T 5d25e61c23044d75a5c8fbdca4c23eb2 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d31e1edf8df54dd5a75e9fba6cc0a1f3, e260c115ddf045e88e73893d7f8269db; no voters: 
I20260709 12:27:43.401695  3722 leader_election.cc:290] T bfdfacb5c8bc4844936c037c39983f24 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 2 election: Requested vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:43.402227  3715 leader_election.cc:290] T bfdfacb5c8bc4844936c037c39983f24 P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 2 election: Requested vote from peers d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:43.402385  3722 raft_consensus.cc:2804] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:43.403119  3722 raft_consensus.cc:493] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e260c115ddf045e88e73893d7f8269db)
I20260709 12:27:43.398479  3202 leader_election.cc:304] T 848e8cff9e5b4de6b49a1bd243e9f9aa P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, d31e1edf8df54dd5a75e9fba6cc0a1f3; no voters: 
I20260709 12:27:43.387998  3670 leader_election.cc:290] T f05d1ba2ab1744db8f477c06f30a6887 P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:43.405273  3721 leader_election.cc:290] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 3 election: Requested vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:43.414611  3378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821be9b5927a481ab065336d9a5c6522" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db" is_pre_election: true
I20260709 12:27:43.407392  3727 raft_consensus.cc:2804] T 5d25e61c23044d75a5c8fbdca4c23eb2 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:43.415277  3727 raft_consensus.cc:493] T 5d25e61c23044d75a5c8fbdca4c23eb2 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 65bae5463b17443bb0fa568920a9ca19)
I20260709 12:27:43.415690  3727 raft_consensus.cc:3060] T 5d25e61c23044d75a5c8fbdca4c23eb2 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:43.410056  3236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821be9b5927a481ab065336d9a5c6522" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19"
I20260709 12:27:43.410427  3382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdfacb5c8bc4844936c037c39983f24" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db" is_pre_election: true
I20260709 12:27:43.416283  3236 raft_consensus.cc:3060] T 821be9b5927a481ab065336d9a5c6522 P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:43.411219  3231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdfacb5c8bc4844936c037c39983f24" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19"
I20260709 12:27:43.416493  3310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdfacb5c8bc4844936c037c39983f24" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3"
I20260709 12:27:43.412827  3381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f943816e0640d0af646f248f518df5" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db" is_pre_election: true
I20260709 12:27:43.416950  3275 leader_election.cc:304] T 71b5bc230abf46069a29bb86e6039a15 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d31e1edf8df54dd5a75e9fba6cc0a1f3, e260c115ddf045e88e73893d7f8269db; no voters: 65bae5463b17443bb0fa568920a9ca19
I20260709 12:27:43.417292  3310 raft_consensus.cc:2393] T bfdfacb5c8bc4844936c037c39983f24 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 65bae5463b17443bb0fa568920a9ca19 in current term 2: Already voted for candidate d31e1edf8df54dd5a75e9fba6cc0a1f3 in this term.
I20260709 12:27:43.417248  3231 raft_consensus.cc:2393] T bfdfacb5c8bc4844936c037c39983f24 P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d31e1edf8df54dd5a75e9fba6cc0a1f3 in current term 2: Already voted for candidate 65bae5463b17443bb0fa568920a9ca19 in this term.
I20260709 12:27:43.418119  3275 leader_election.cc:304] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d31e1edf8df54dd5a75e9fba6cc0a1f3, e260c115ddf045e88e73893d7f8269db; no voters: 65bae5463b17443bb0fa568920a9ca19
I20260709 12:27:43.387387  3720 raft_consensus.cc:493] T c4adb0932a604e779ef3ce9fff0b7bc5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 65bae5463b17443bb0fa568920a9ca19)
I20260709 12:27:43.418790  3720 raft_consensus.cc:3060] T c4adb0932a604e779ef3ce9fff0b7bc5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:43.418800  3721 raft_consensus.cc:2804] T 71b5bc230abf46069a29bb86e6039a15 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:43.419373  3721 raft_consensus.cc:493] T 71b5bc230abf46069a29bb86e6039a15 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 65bae5463b17443bb0fa568920a9ca19)
I20260709 12:27:43.419731  3721 raft_consensus.cc:3060] T 71b5bc230abf46069a29bb86e6039a15 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:43.420548  3381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18abc32bcdc8438d8f5438356c0b68bb" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db" is_pre_election: true
I20260709 12:27:43.421402  3722 raft_consensus.cc:3060] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:43.398032  3719 raft_consensus.cc:515] T bfb3537bcd1e40918b030db5bc35117b P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:43.424014  3382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdfacb5c8bc4844936c037c39983f24" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db"
I20260709 12:27:43.425535  3719 leader_election.cc:290] T bfb3537bcd1e40918b030db5bc35117b P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 2 election: Requested vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:43.426178  3719 raft_consensus.cc:2804] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:43.426328  3382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "088188cf28674e1c94310faf6d3f7ff4" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db" is_pre_election: true
I20260709 12:27:43.426564  3719 raft_consensus.cc:493] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 65bae5463b17443bb0fa568920a9ca19)
I20260709 12:27:43.426997  3719 raft_consensus.cc:3060] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:43.409319  3277 leader_election.cc:304] T 088188cf28674e1c94310faf6d3f7ff4 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, d31e1edf8df54dd5a75e9fba6cc0a1f3; no voters: 
I20260709 12:27:43.428243  3377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821be9b5927a481ab065336d9a5c6522" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db"
I20260709 12:27:43.428525  3277 leader_election.cc:304] T 2f808f4193db4e6eba0ea677944df64d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, d31e1edf8df54dd5a75e9fba6cc0a1f3; no voters: 
I20260709 12:27:43.428745  3382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f808f4193db4e6eba0ea677944df64d" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db" is_pre_election: true
I20260709 12:27:43.430851  3382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848e8cff9e5b4de6b49a1bd243e9f9aa" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db" is_pre_election: true
I20260709 12:27:43.433086  3382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05d1ba2ab1744db8f477c06f30a6887" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db" is_pre_election: true
I20260709 12:27:43.435300  3382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdfacb5c8bc4844936c037c39983f24" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db"
I20260709 12:27:43.431732  3236 raft_consensus.cc:2468] T 821be9b5927a481ab065336d9a5c6522 P 65bae5463b17443bb0fa568920a9ca19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d31e1edf8df54dd5a75e9fba6cc0a1f3 in term 3.
I20260709 12:27:43.431779  3721 raft_consensus.cc:515] T 71b5bc230abf46069a29bb86e6039a15 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:43.414268  3726 raft_consensus.cc:2804] T 848e8cff9e5b4de6b49a1bd243e9f9aa P 65bae5463b17443bb0fa568920a9ca19 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:43.437695  3726 raft_consensus.cc:493] T 848e8cff9e5b4de6b49a1bd243e9f9aa P 65bae5463b17443bb0fa568920a9ca19 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e260c115ddf045e88e73893d7f8269db)
I20260709 12:27:43.438040  3236 raft_consensus.cc:1240] T bfdfacb5c8bc4844936c037c39983f24 P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Rejecting Update request from peer e260c115ddf045e88e73893d7f8269db for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:43.444887  3728 raft_consensus.cc:2804] T 2f808f4193db4e6eba0ea677944df64d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:43.445281  3235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4adb0932a604e779ef3ce9fff0b7bc5" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19" is_pre_election: true
I20260709 12:27:43.440106  3721 leader_election.cc:290] T 71b5bc230abf46069a29bb86e6039a15 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 3 election: Requested vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:43.441241  3730 raft_consensus.cc:2804] T 088188cf28674e1c94310faf6d3f7ff4 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:43.450935  3305 raft_consensus.cc:1240] T bfdfacb5c8bc4844936c037c39983f24 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Rejecting Update request from peer e260c115ddf045e88e73893d7f8269db for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:43.451149  3311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c6742a5e0e4b0eb07abd8f93c2a8fb" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" is_pre_election: true
I20260709 12:27:43.442276  3310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ab18fc35bf84fd4876f3c9573c22c0d" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" is_pre_election: true
I20260709 12:27:43.438009  3719 raft_consensus.cc:515] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:43.453086  3235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ab18fc35bf84fd4876f3c9573c22c0d" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19" is_pre_election: true
I20260709 12:27:43.454113  3719 leader_election.cc:290] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 3 election: Requested vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:43.454248  3234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d25e61c23044d75a5c8fbdca4c23eb2" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19" is_pre_election: true
I20260709 12:27:43.444089  3232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eebe28a0e1b493581b05e588dd920d5" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19" is_pre_election: true
I20260709 12:27:43.438138  3726 raft_consensus.cc:3060] T 848e8cff9e5b4de6b49a1bd243e9f9aa P 65bae5463b17443bb0fa568920a9ca19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:43.455047  3228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c6742a5e0e4b0eb07abd8f93c2a8fb" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19" is_pre_election: true
I20260709 12:27:43.445386  3728 raft_consensus.cc:493] T 2f808f4193db4e6eba0ea677944df64d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e260c115ddf045e88e73893d7f8269db)
I20260709 12:27:43.456110  3728 raft_consensus.cc:3060] T 2f808f4193db4e6eba0ea677944df64d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:43.445678  3236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f943816e0640d0af646f248f518df5" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19" is_pre_election: true
I20260709 12:27:43.456673  3720 raft_consensus.cc:515] T c4adb0932a604e779ef3ce9fff0b7bc5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:43.457070  3200 leader_election.cc:304] T 821be9b5927a481ab065336d9a5c6522 P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19; no voters: d31e1edf8df54dd5a75e9fba6cc0a1f3, e260c115ddf045e88e73893d7f8269db
I20260709 12:27:43.458722  3720 leader_election.cc:290] T c4adb0932a604e779ef3ce9fff0b7bc5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 3 election: Requested vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:43.458882  3200 leader_election.cc:304] T 42f943816e0640d0af646f248f518df5 P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19; no voters: d31e1edf8df54dd5a75e9fba6cc0a1f3, e260c115ddf045e88e73893d7f8269db
I20260709 12:27:43.445950  3275 leader_election.cc:304] T 3eebe28a0e1b493581b05e588dd920d5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d31e1edf8df54dd5a75e9fba6cc0a1f3, e260c115ddf045e88e73893d7f8269db; no voters: 65bae5463b17443bb0fa568920a9ca19
I20260709 12:27:43.459976  3670 raft_consensus.cc:2749] T 42f943816e0640d0af646f248f518df5 P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:43.460618  3310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b5bc230abf46069a29bb86e6039a15" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" is_pre_election: true
I20260709 12:27:43.447952  3277 leader_election.cc:304] T 848e8cff9e5b4de6b49a1bd243e9f9aa P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, d31e1edf8df54dd5a75e9fba6cc0a1f3; no voters: e260c115ddf045e88e73893d7f8269db
I20260709 12:27:43.449101  3304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d25e61c23044d75a5c8fbdca4c23eb2" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" is_pre_election: true
I20260709 12:27:43.450466  3233 raft_consensus.cc:1240] T 821be9b5927a481ab065336d9a5c6522 P 65bae5463b17443bb0fa568920a9ca19 [term 3 FOLLOWER]: Rejecting Update request from peer e260c115ddf045e88e73893d7f8269db for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:43.464133  3723 raft_consensus.cc:2749] T 821be9b5927a481ab065336d9a5c6522 P 65bae5463b17443bb0fa568920a9ca19 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:43.465003  3377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b5bc230abf46069a29bb86e6039a15" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db"
I20260709 12:27:43.465754  3381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c6742a5e0e4b0eb07abd8f93c2a8fb" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db"
I20260709 12:27:43.466995  3378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4adb0932a604e779ef3ce9fff0b7bc5" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db"
I20260709 12:27:43.467222  3719 raft_consensus.cc:2804] T 3eebe28a0e1b493581b05e588dd920d5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:43.467636  3719 raft_consensus.cc:493] T 3eebe28a0e1b493581b05e588dd920d5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 65bae5463b17443bb0fa568920a9ca19)
I20260709 12:27:43.468021  3719 raft_consensus.cc:3060] T 3eebe28a0e1b493581b05e588dd920d5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:43.467978  3729 raft_consensus.cc:2804] T 848e8cff9e5b4de6b49a1bd243e9f9aa P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:43.468997  3729 raft_consensus.cc:493] T 848e8cff9e5b4de6b49a1bd243e9f9aa P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e260c115ddf045e88e73893d7f8269db)
I20260709 12:27:43.469410  3729 raft_consensus.cc:3060] T 848e8cff9e5b4de6b49a1bd243e9f9aa P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:43.467908  3277 leader_election.cc:304] T bfdfacb5c8bc4844936c037c39983f24 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d31e1edf8df54dd5a75e9fba6cc0a1f3; no voters: 65bae5463b17443bb0fa568920a9ca19, e260c115ddf045e88e73893d7f8269db
I20260709 12:27:43.473169  3277 leader_election.cc:304] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, d31e1edf8df54dd5a75e9fba6cc0a1f3; no voters: e260c115ddf045e88e73893d7f8269db
I20260709 12:27:43.451112  3730 raft_consensus.cc:493] T 088188cf28674e1c94310faf6d3f7ff4 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e260c115ddf045e88e73893d7f8269db)
I20260709 12:27:43.474294  3730 raft_consensus.cc:3060] T 088188cf28674e1c94310faf6d3f7ff4 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:43.474411  3722 raft_consensus.cc:515] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:43.474254  3721 raft_consensus.cc:2749] T bfdfacb5c8bc4844936c037c39983f24 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:27:43.475773  3721 raft_consensus.cc:2804] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:43.476258  3721 raft_consensus.cc:697] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 LEADER]: Becoming Leader. State: Replica: d31e1edf8df54dd5a75e9fba6cc0a1f3, State: Running, Role: LEADER
I20260709 12:27:43.477276  3304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05d1ba2ab1744db8f477c06f30a6887" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" is_pre_election: true
I20260709 12:27:43.477093  3721 consensus_queue.cc:237] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:43.474810  3382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3537bcd1e40918b030db5bc35117b" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db"
I20260709 12:27:43.482023  3730 raft_consensus.cc:515] T 088188cf28674e1c94310faf6d3f7ff4 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:43.474464  3726 raft_consensus.cc:515] T 848e8cff9e5b4de6b49a1bd243e9f9aa P 65bae5463b17443bb0fa568920a9ca19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:43.489750  3231 raft_consensus.cc:1240] T 848e8cff9e5b4de6b49a1bd243e9f9aa P 65bae5463b17443bb0fa568920a9ca19 [term 4 FOLLOWER]: Rejecting Update request from peer e260c115ddf045e88e73893d7f8269db for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:43.482764  3200 leader_election.cc:304] T 18abc32bcdc8438d8f5438356c0b68bb P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19; no voters: d31e1edf8df54dd5a75e9fba6cc0a1f3, e260c115ddf045e88e73893d7f8269db
I20260709 12:27:43.483834  3724 consensus_queue.cc:1059] T bfdfacb5c8bc4844936c037c39983f24 P e260c115ddf045e88e73893d7f8269db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:43.492528  3723 raft_consensus.cc:2749] T 18abc32bcdc8438d8f5438356c0b68bb P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:43.492666  3724 raft_consensus.cc:3055] T bfdfacb5c8bc4844936c037c39983f24 P e260c115ddf045e88e73893d7f8269db [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:43.493146  3724 raft_consensus.cc:740] T bfdfacb5c8bc4844936c037c39983f24 P e260c115ddf045e88e73893d7f8269db [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e260c115ddf045e88e73893d7f8269db, State: Running, Role: LEADER
I20260709 12:27:43.484066  3729 raft_consensus.cc:515] T 848e8cff9e5b4de6b49a1bd243e9f9aa P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:43.495731  3726 leader_election.cc:290] T 848e8cff9e5b4de6b49a1bd243e9f9aa P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 4 election: Requested vote from peers d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:43.494170  3724 consensus_queue.cc:260] T bfdfacb5c8bc4844936c037c39983f24 P e260c115ddf045e88e73893d7f8269db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:43.499523  3381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848e8cff9e5b4de6b49a1bd243e9f9aa" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db"
I20260709 12:27:43.500345  3719 raft_consensus.cc:515] T 3eebe28a0e1b493581b05e588dd920d5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:43.501610  3724 raft_consensus.cc:3060] T bfdfacb5c8bc4844936c037c39983f24 P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:43.502701  3719 leader_election.cc:290] T 3eebe28a0e1b493581b05e588dd920d5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 2 election: Requested vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:43.485512  3728 raft_consensus.cc:515] T 2f808f4193db4e6eba0ea677944df64d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:43.517894  3234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "088188cf28674e1c94310faf6d3f7ff4" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19"
I20260709 12:27:43.518850  3728 leader_election.cc:290] T 2f808f4193db4e6eba0ea677944df64d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 3 election: Requested vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:43.519367  3235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848e8cff9e5b4de6b49a1bd243e9f9aa" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19"
I20260709 12:27:43.520246  3235 raft_consensus.cc:2393] T 848e8cff9e5b4de6b49a1bd243e9f9aa P 65bae5463b17443bb0fa568920a9ca19 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate d31e1edf8df54dd5a75e9fba6cc0a1f3 in current term 4: Already voted for candidate 65bae5463b17443bb0fa568920a9ca19 in this term.
I20260709 12:27:43.520619  3377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f808f4193db4e6eba0ea677944df64d" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db"
I20260709 12:27:43.521131  3229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eebe28a0e1b493581b05e588dd920d5" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19"
I20260709 12:27:43.522974  3277 leader_election.cc:304] T 848e8cff9e5b4de6b49a1bd243e9f9aa P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d31e1edf8df54dd5a75e9fba6cc0a1f3; no voters: 65bae5463b17443bb0fa568920a9ca19, e260c115ddf045e88e73893d7f8269db
I20260709 12:27:43.523689  3229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f808f4193db4e6eba0ea677944df64d" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19"
I20260709 12:27:43.524358  3719 raft_consensus.cc:2749] T 848e8cff9e5b4de6b49a1bd243e9f9aa P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:43.515789  3132 catalog_manager.cc:5697] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3 reported cstate change: term changed from 2 to 3, leader changed from e260c115ddf045e88e73893d7f8269db (127.23.245.131) to d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130). New cstate: current_term: 3 leader_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:43.528334  3277 leader_election.cc:304] T 2f808f4193db4e6eba0ea677944df64d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d31e1edf8df54dd5a75e9fba6cc0a1f3; no voters: 65bae5463b17443bb0fa568920a9ca19, e260c115ddf045e88e73893d7f8269db
I20260709 12:27:43.488826  3382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f0de7c8efd147bcb0dcec69dd1bc2ab" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db"
I20260709 12:27:43.491699  3304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848e8cff9e5b4de6b49a1bd243e9f9aa" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3"
I20260709 12:27:43.494127  3730 leader_election.cc:290] T 088188cf28674e1c94310faf6d3f7ff4 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 3 election: Requested vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:43.493916  3200 leader_election.cc:304] T 088188cf28674e1c94310faf6d3f7ff4 P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19; no voters: d31e1edf8df54dd5a75e9fba6cc0a1f3, e260c115ddf045e88e73893d7f8269db
I20260709 12:27:43.530061  3304 raft_consensus.cc:2393] T 848e8cff9e5b4de6b49a1bd243e9f9aa P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 65bae5463b17443bb0fa568920a9ca19 in current term 4: Already voted for candidate d31e1edf8df54dd5a75e9fba6cc0a1f3 in this term.
I20260709 12:27:43.530627  3200 leader_election.cc:304] T 2f808f4193db4e6eba0ea677944df64d P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19; no voters: d31e1edf8df54dd5a75e9fba6cc0a1f3, e260c115ddf045e88e73893d7f8269db
I20260709 12:27:43.532351  3200 leader_election.cc:304] T f05d1ba2ab1744db8f477c06f30a6887 P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19; no voters: d31e1edf8df54dd5a75e9fba6cc0a1f3, e260c115ddf045e88e73893d7f8269db
I20260709 12:27:43.495211  3378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "088188cf28674e1c94310faf6d3f7ff4" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db"
I20260709 12:27:43.532852  3719 raft_consensus.cc:2749] T 2f808f4193db4e6eba0ea677944df64d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:43.484757  3351 leader_election.cc:304] T c4adb0932a604e779ef3ce9fff0b7bc5 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e260c115ddf045e88e73893d7f8269db; no voters: 65bae5463b17443bb0fa568920a9ca19, d31e1edf8df54dd5a75e9fba6cc0a1f3
I20260709 12:27:43.534142  3275 leader_election.cc:304] T 088188cf28674e1c94310faf6d3f7ff4 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d31e1edf8df54dd5a75e9fba6cc0a1f3; no voters: 65bae5463b17443bb0fa568920a9ca19, e260c115ddf045e88e73893d7f8269db
W20260709 12:27:43.534207  3351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:44391, user_credentials={real_user=slave}} blocked reactor thread for 49539.9us
I20260709 12:27:43.535034  3728 raft_consensus.cc:2749] T 088188cf28674e1c94310faf6d3f7ff4 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:43.536051  3725 raft_consensus.cc:2749] T c4adb0932a604e779ef3ce9fff0b7bc5 P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:43.536176  3351 leader_election.cc:304] T 3ab18fc35bf84fd4876f3c9573c22c0d P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e260c115ddf045e88e73893d7f8269db; no voters: 65bae5463b17443bb0fa568920a9ca19, d31e1edf8df54dd5a75e9fba6cc0a1f3
I20260709 12:27:43.503777  3381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eebe28a0e1b493581b05e588dd920d5" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db"
I20260709 12:27:43.470968  3727 raft_consensus.cc:515] T 5d25e61c23044d75a5c8fbdca4c23eb2 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } } peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } }
I20260709 12:27:43.538704  3275 leader_election.cc:304] T 3eebe28a0e1b493581b05e588dd920d5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d31e1edf8df54dd5a75e9fba6cc0a1f3; no voters: 65bae5463b17443bb0fa568920a9ca19, e260c115ddf045e88e73893d7f8269db
I20260709 12:27:43.539083  3727 leader_election.cc:290] T 5d25e61c23044d75a5c8fbdca4c23eb2 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 3 election: Requested vote from peers e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191), 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391)
I20260709 12:27:43.539693  3727 raft_consensus.cc:2749] T 3eebe28a0e1b493581b05e588dd920d5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:27:43.504323  3729 leader_election.cc:290] T 848e8cff9e5b4de6b49a1bd243e9f9aa P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 4 election: Requested vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:43.504612  3231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3537bcd1e40918b030db5bc35117b" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19"
I20260709 12:27:43.506085  3233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b5bc230abf46069a29bb86e6039a15" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19"
I20260709 12:27:43.540791  3381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d25e61c23044d75a5c8fbdca4c23eb2" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db"
I20260709 12:27:43.507536  3236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c6742a5e0e4b0eb07abd8f93c2a8fb" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19"
I20260709 12:27:43.508958  3228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4adb0932a604e779ef3ce9fff0b7bc5" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19"
I20260709 12:27:43.510399  3232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f0de7c8efd147bcb0dcec69dd1bc2ab" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19"
I20260709 12:27:43.543056  3200 leader_election.cc:304] T bfdfacb5c8bc4844936c037c39983f24 P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19; no voters: d31e1edf8df54dd5a75e9fba6cc0a1f3, e260c115ddf045e88e73893d7f8269db
I20260709 12:27:43.543277  3723 raft_consensus.cc:2749] T 088188cf28674e1c94310faf6d3f7ff4 P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:43.544083  3726 raft_consensus.cc:2749] T 2f808f4193db4e6eba0ea677944df64d P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:43.544438  3670 raft_consensus.cc:2749] T f05d1ba2ab1744db8f477c06f30a6887 P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:43.544765  3726 raft_consensus.cc:2749] T bfdfacb5c8bc4844936c037c39983f24 P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:27:43.546460  3381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848e8cff9e5b4de6b49a1bd243e9f9aa" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db"
I20260709 12:27:43.547597  3232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b5bc230abf46069a29bb86e6039a15" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19" is_pre_election: true
I20260709 12:27:43.548048  3200 leader_election.cc:304] T 848e8cff9e5b4de6b49a1bd243e9f9aa P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19; no voters: d31e1edf8df54dd5a75e9fba6cc0a1f3, e260c115ddf045e88e73893d7f8269db
I20260709 12:27:43.549079  3236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d25e61c23044d75a5c8fbdca4c23eb2" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19"
I20260709 12:27:43.549438  3723 raft_consensus.cc:2749] T 848e8cff9e5b4de6b49a1bd243e9f9aa P 65bae5463b17443bb0fa568920a9ca19 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:43.550499  3228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05d1ba2ab1744db8f477c06f30a6887" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19" is_pre_election: true
I20260709 12:27:43.550880  3351 leader_election.cc:304] T 5d25e61c23044d75a5c8fbdca4c23eb2 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e260c115ddf045e88e73893d7f8269db; no voters: 65bae5463b17443bb0fa568920a9ca19, d31e1edf8df54dd5a75e9fba6cc0a1f3
I20260709 12:27:43.551748  3724 raft_consensus.cc:2749] T 5d25e61c23044d75a5c8fbdca4c23eb2 P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:43.552142  3277 leader_election.cc:304] T bfb3537bcd1e40918b030db5bc35117b P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d31e1edf8df54dd5a75e9fba6cc0a1f3; no voters: 65bae5463b17443bb0fa568920a9ca19, e260c115ddf045e88e73893d7f8269db
I20260709 12:27:43.553191  3351 leader_election.cc:304] T 3eebe28a0e1b493581b05e588dd920d5 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e260c115ddf045e88e73893d7f8269db; no voters: 65bae5463b17443bb0fa568920a9ca19, d31e1edf8df54dd5a75e9fba6cc0a1f3
I20260709 12:27:43.553349  3277 leader_election.cc:304] T 71b5bc230abf46069a29bb86e6039a15 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d31e1edf8df54dd5a75e9fba6cc0a1f3; no voters: 65bae5463b17443bb0fa568920a9ca19, e260c115ddf045e88e73893d7f8269db
I20260709 12:27:43.554064  3724 raft_consensus.cc:2749] T 3eebe28a0e1b493581b05e588dd920d5 P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:43.537083  3693 raft_consensus.cc:2749] T 3ab18fc35bf84fd4876f3c9573c22c0d P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:43.555262  3277 leader_election.cc:304] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d31e1edf8df54dd5a75e9fba6cc0a1f3; no voters: 65bae5463b17443bb0fa568920a9ca19, e260c115ddf045e88e73893d7f8269db
I20260709 12:27:43.487474  3722 leader_election.cc:290] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 4 election: Requested vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:43.556028  3729 raft_consensus.cc:2749] T 71b5bc230abf46069a29bb86e6039a15 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:43.556267  3351 leader_election.cc:304] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e260c115ddf045e88e73893d7f8269db; no voters: 65bae5463b17443bb0fa568920a9ca19, d31e1edf8df54dd5a75e9fba6cc0a1f3
I20260709 12:27:43.554000  3719 raft_consensus.cc:2749] T bfb3537bcd1e40918b030db5bc35117b P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:27:43.556725  3729 raft_consensus.cc:2749] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:43.557492  3693 raft_consensus.cc:2749] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:43.557825  3277 leader_election.cc:304] T c4adb0932a604e779ef3ce9fff0b7bc5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d31e1edf8df54dd5a75e9fba6cc0a1f3; no voters: 65bae5463b17443bb0fa568920a9ca19, e260c115ddf045e88e73893d7f8269db
I20260709 12:27:43.560616  3730 raft_consensus.cc:2749] T c4adb0932a604e779ef3ce9fff0b7bc5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:43.561964  3277 leader_election.cc:304] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d31e1edf8df54dd5a75e9fba6cc0a1f3; no voters: 65bae5463b17443bb0fa568920a9ca19, e260c115ddf045e88e73893d7f8269db
I20260709 12:27:43.563172  3277 leader_election.cc:304] T 5d25e61c23044d75a5c8fbdca4c23eb2 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d31e1edf8df54dd5a75e9fba6cc0a1f3; no voters: 65bae5463b17443bb0fa568920a9ca19, e260c115ddf045e88e73893d7f8269db
I20260709 12:27:43.563766  3719 raft_consensus.cc:2749] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:27:43.558795  3351 leader_election.cc:304] T 42f943816e0640d0af646f248f518df5 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e260c115ddf045e88e73893d7f8269db; no voters: 65bae5463b17443bb0fa568920a9ca19, d31e1edf8df54dd5a75e9fba6cc0a1f3
I20260709 12:27:43.565219  3693 raft_consensus.cc:2749] T 42f943816e0640d0af646f248f518df5 P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:43.566563  3693 consensus_queue.cc:1059] T 821be9b5927a481ab065336d9a5c6522 P e260c115ddf045e88e73893d7f8269db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:43.567795  3724 raft_consensus.cc:3055] T 821be9b5927a481ab065336d9a5c6522 P e260c115ddf045e88e73893d7f8269db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:43.568182  3724 raft_consensus.cc:740] T 821be9b5927a481ab065336d9a5c6522 P e260c115ddf045e88e73893d7f8269db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e260c115ddf045e88e73893d7f8269db, State: Running, Role: LEADER
I20260709 12:27:43.569079  3724 consensus_queue.cc:260] T 821be9b5927a481ab065336d9a5c6522 P e260c115ddf045e88e73893d7f8269db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:43.570734  3724 raft_consensus.cc:3060] T 821be9b5927a481ab065336d9a5c6522 P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:43.572031  3693 consensus_queue.cc:1059] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:27:43.573371  3725 raft_consensus.cc:3055] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:43.573745  3725 raft_consensus.cc:740] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e260c115ddf045e88e73893d7f8269db, State: Running, Role: LEADER
I20260709 12:27:43.574602  3725 consensus_queue.cc:260] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:43.576220  3725 raft_consensus.cc:3060] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:43.586683  3351 leader_election.cc:304] T 71b5bc230abf46069a29bb86e6039a15 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e260c115ddf045e88e73893d7f8269db; no voters: 65bae5463b17443bb0fa568920a9ca19, d31e1edf8df54dd5a75e9fba6cc0a1f3
I20260709 12:27:43.587476  3730 raft_consensus.cc:2749] T 5d25e61c23044d75a5c8fbdca4c23eb2 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:27:43.589509  3351 leader_election.cc:304] T f05d1ba2ab1744db8f477c06f30a6887 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e260c115ddf045e88e73893d7f8269db; no voters: 65bae5463b17443bb0fa568920a9ca19, d31e1edf8df54dd5a75e9fba6cc0a1f3
I20260709 12:27:43.590411  3693 raft_consensus.cc:2749] T 71b5bc230abf46069a29bb86e6039a15 P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:43.591325  3693 raft_consensus.cc:2749] T f05d1ba2ab1744db8f477c06f30a6887 P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:43.667284  3304 raft_consensus.cc:1240] T bfb3537bcd1e40918b030db5bc35117b P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Rejecting Update request from peer 65bae5463b17443bb0fa568920a9ca19 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:43.669202  3723 consensus_queue.cc:1059] T bfb3537bcd1e40918b030db5bc35117b P 65bae5463b17443bb0fa568920a9ca19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:43.670320  3723 raft_consensus.cc:3055] T bfb3537bcd1e40918b030db5bc35117b P 65bae5463b17443bb0fa568920a9ca19 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:43.670675  3723 raft_consensus.cc:740] T bfb3537bcd1e40918b030db5bc35117b P 65bae5463b17443bb0fa568920a9ca19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65bae5463b17443bb0fa568920a9ca19, State: Running, Role: LEADER
I20260709 12:27:43.671600  3723 consensus_queue.cc:260] T bfb3537bcd1e40918b030db5bc35117b P 65bae5463b17443bb0fa568920a9ca19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:43.673203  3723 raft_consensus.cc:3060] T bfb3537bcd1e40918b030db5bc35117b P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:43.693603  3304 raft_consensus.cc:1240] T 3eebe28a0e1b493581b05e588dd920d5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Rejecting Update request from peer 65bae5463b17443bb0fa568920a9ca19 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:43.695067  3723 consensus_queue.cc:1059] T 3eebe28a0e1b493581b05e588dd920d5 P 65bae5463b17443bb0fa568920a9ca19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:43.696229  3708 raft_consensus.cc:3055] T 3eebe28a0e1b493581b05e588dd920d5 P 65bae5463b17443bb0fa568920a9ca19 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:43.696619  3708 raft_consensus.cc:740] T 3eebe28a0e1b493581b05e588dd920d5 P 65bae5463b17443bb0fa568920a9ca19 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 65bae5463b17443bb0fa568920a9ca19, State: Running, Role: LEADER
I20260709 12:27:43.697489  3708 consensus_queue.cc:260] T 3eebe28a0e1b493581b05e588dd920d5 P 65bae5463b17443bb0fa568920a9ca19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:43.698902  3708 raft_consensus.cc:3060] T 3eebe28a0e1b493581b05e588dd920d5 P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:43.699707  3304 raft_consensus.cc:1240] T c4adb0932a604e779ef3ce9fff0b7bc5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Rejecting Update request from peer 65bae5463b17443bb0fa568920a9ca19 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:43.701510  3723 consensus_queue.cc:1059] T c4adb0932a604e779ef3ce9fff0b7bc5 P 65bae5463b17443bb0fa568920a9ca19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:43.702515  3670 raft_consensus.cc:3055] T c4adb0932a604e779ef3ce9fff0b7bc5 P 65bae5463b17443bb0fa568920a9ca19 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:43.702898  3670 raft_consensus.cc:740] T c4adb0932a604e779ef3ce9fff0b7bc5 P 65bae5463b17443bb0fa568920a9ca19 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 65bae5463b17443bb0fa568920a9ca19, State: Running, Role: LEADER
I20260709 12:27:43.703760  3670 consensus_queue.cc:260] T c4adb0932a604e779ef3ce9fff0b7bc5 P 65bae5463b17443bb0fa568920a9ca19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:43.705279  3670 raft_consensus.cc:3060] T c4adb0932a604e779ef3ce9fff0b7bc5 P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:43.724782  3304 raft_consensus.cc:1240] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Rejecting Update request from peer 65bae5463b17443bb0fa568920a9ca19 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:43.726228  3670 consensus_queue.cc:1059] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P 65bae5463b17443bb0fa568920a9ca19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:43.727247  3708 raft_consensus.cc:3055] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P 65bae5463b17443bb0fa568920a9ca19 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:43.727478  3304 raft_consensus.cc:1240] T 71b5bc230abf46069a29bb86e6039a15 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Rejecting Update request from peer 65bae5463b17443bb0fa568920a9ca19 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:43.727643  3708 raft_consensus.cc:740] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P 65bae5463b17443bb0fa568920a9ca19 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 65bae5463b17443bb0fa568920a9ca19, State: Running, Role: LEADER
I20260709 12:27:43.728792  3708 consensus_queue.cc:260] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P 65bae5463b17443bb0fa568920a9ca19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:43.729233  3670 consensus_queue.cc:1059] T 71b5bc230abf46069a29bb86e6039a15 P 65bae5463b17443bb0fa568920a9ca19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:43.730259  3708 raft_consensus.cc:3060] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:43.730337  3723 raft_consensus.cc:3055] T 71b5bc230abf46069a29bb86e6039a15 P 65bae5463b17443bb0fa568920a9ca19 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:43.730831  3723 raft_consensus.cc:740] T 71b5bc230abf46069a29bb86e6039a15 P 65bae5463b17443bb0fa568920a9ca19 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 65bae5463b17443bb0fa568920a9ca19, State: Running, Role: LEADER
I20260709 12:27:43.731781  3723 consensus_queue.cc:260] T 71b5bc230abf46069a29bb86e6039a15 P 65bae5463b17443bb0fa568920a9ca19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:43.733269  3723 raft_consensus.cc:3060] T 71b5bc230abf46069a29bb86e6039a15 P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:43.927044  3304 raft_consensus.cc:1240] T 088188cf28674e1c94310faf6d3f7ff4 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Rejecting Update request from peer e260c115ddf045e88e73893d7f8269db for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:43.928386  3725 consensus_queue.cc:1059] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:43.929190  3693 raft_consensus.cc:3055] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:43.929586  3693 raft_consensus.cc:740] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e260c115ddf045e88e73893d7f8269db, State: Running, Role: LEADER
I20260709 12:27:43.930583  3693 consensus_queue.cc:260] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:43.931667  3304 raft_consensus.cc:1240] T 2f808f4193db4e6eba0ea677944df64d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Rejecting Update request from peer e260c115ddf045e88e73893d7f8269db for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:43.932176  3693 raft_consensus.cc:3060] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:43.933079  3725 consensus_queue.cc:1059] T 2f808f4193db4e6eba0ea677944df64d P e260c115ddf045e88e73893d7f8269db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:43.933902  3724 raft_consensus.cc:3055] T 2f808f4193db4e6eba0ea677944df64d P e260c115ddf045e88e73893d7f8269db [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:43.934168  3724 raft_consensus.cc:740] T 2f808f4193db4e6eba0ea677944df64d P e260c115ddf045e88e73893d7f8269db [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e260c115ddf045e88e73893d7f8269db, State: Running, Role: LEADER
I20260709 12:27:43.934800  3724 consensus_queue.cc:260] T 2f808f4193db4e6eba0ea677944df64d P e260c115ddf045e88e73893d7f8269db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:43.935665  3724 raft_consensus.cc:3060] T 2f808f4193db4e6eba0ea677944df64d P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:43.950350 24534 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:27:43.952404  3304 raft_consensus.cc:1240] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 4 FOLLOWER]: Rejecting Update request from peer e260c115ddf045e88e73893d7f8269db for earlier term 3. Current term is 4. Ops: []
I20260709 12:27:43.954123  3304 raft_consensus.cc:1240] T 5d25e61c23044d75a5c8fbdca4c23eb2 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Rejecting Update request from peer 65bae5463b17443bb0fa568920a9ca19 for earlier term 2. Current term is 3. Ops: []
I20260709 12:27:43.954188  3693 consensus_queue.cc:1059] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P e260c115ddf045e88e73893d7f8269db [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:27:43.955457  3693 raft_consensus.cc:3055] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P e260c115ddf045e88e73893d7f8269db [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:43.955471  3723 consensus_queue.cc:1059] T 5d25e61c23044d75a5c8fbdca4c23eb2 P 65bae5463b17443bb0fa568920a9ca19 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:43.955978  3693 raft_consensus.cc:740] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P e260c115ddf045e88e73893d7f8269db [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e260c115ddf045e88e73893d7f8269db, State: Running, Role: LEADER
I20260709 12:27:43.956974  3708 raft_consensus.cc:3055] T 5d25e61c23044d75a5c8fbdca4c23eb2 P 65bae5463b17443bb0fa568920a9ca19 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:43.957547  3708 raft_consensus.cc:740] T 5d25e61c23044d75a5c8fbdca4c23eb2 P 65bae5463b17443bb0fa568920a9ca19 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 65bae5463b17443bb0fa568920a9ca19, State: Running, Role: LEADER
I20260709 12:27:43.957001  3693 consensus_queue.cc:260] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P e260c115ddf045e88e73893d7f8269db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:43.958679  3693 raft_consensus.cc:3060] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P e260c115ddf045e88e73893d7f8269db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:43.958462  3708 consensus_queue.cc:260] T 5d25e61c23044d75a5c8fbdca4c23eb2 P 65bae5463b17443bb0fa568920a9ca19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } } peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } }
I20260709 12:27:43.959836  3708 raft_consensus.cc:3060] T 5d25e61c23044d75a5c8fbdca4c23eb2 P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:43.961213  3304 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "821be9b5927a481ab065336d9a5c6522"
dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3"
mode: GRACEFUL
new_leader_uuid: "e260c115ddf045e88e73893d7f8269db"
 from {username='slave'} at 127.0.0.1:39646
I20260709 12:27:43.961875  3304 raft_consensus.cc:606] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 LEADER]: Received request to transfer leadership to TS e260c115ddf045e88e73893d7f8269db
I20260709 12:27:43.963505 24534 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 1
I20260709 12:27:43.964186 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:43.970752 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:43.971278 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:44.028836  3228 raft_consensus.cc:1275] T 821be9b5927a481ab065336d9a5c6522 P 65bae5463b17443bb0fa568920a9ca19 [term 3 FOLLOWER]: Refusing update from remote peer d31e1edf8df54dd5a75e9fba6cc0a1f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:27:44.030227  3730 consensus_queue.cc:1048] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:44.046345  3381 raft_consensus.cc:1275] T 821be9b5927a481ab065336d9a5c6522 P e260c115ddf045e88e73893d7f8269db [term 3 FOLLOWER]: Refusing update from remote peer d31e1edf8df54dd5a75e9fba6cc0a1f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:27:44.050490  3730 consensus_queue.cc:1048] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:44.062781  3729 raft_consensus.cc:993] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3: : Instructing follower e260c115ddf045e88e73893d7f8269db to start an election
I20260709 12:27:44.063350  3730 raft_consensus.cc:1081] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 LEADER]: Signalling peer e260c115ddf045e88e73893d7f8269db to start an election
I20260709 12:27:44.064883  3381 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "821be9b5927a481ab065336d9a5c6522"
dest_uuid: "e260c115ddf045e88e73893d7f8269db"
 from {username='slave'} at 127.0.0.1:52988
I20260709 12:27:44.065372  3381 raft_consensus.cc:493] T 821be9b5927a481ab065336d9a5c6522 P e260c115ddf045e88e73893d7f8269db [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:44.065703  3381 raft_consensus.cc:3060] T 821be9b5927a481ab065336d9a5c6522 P e260c115ddf045e88e73893d7f8269db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:44.072605  3381 raft_consensus.cc:515] T 821be9b5927a481ab065336d9a5c6522 P e260c115ddf045e88e73893d7f8269db [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:44.075191  3228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821be9b5927a481ab065336d9a5c6522" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "65bae5463b17443bb0fa568920a9ca19"
I20260709 12:27:44.075796  3228 raft_consensus.cc:3060] T 821be9b5927a481ab065336d9a5c6522 P 65bae5463b17443bb0fa568920a9ca19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:44.076749  3381 leader_election.cc:290] T 821be9b5927a481ab065336d9a5c6522 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 4 election: Requested vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915)
I20260709 12:27:44.077859  3304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "821be9b5927a481ab065336d9a5c6522" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3"
I20260709 12:27:44.078557  3304 raft_consensus.cc:3055] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:44.078898  3304 raft_consensus.cc:740] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d31e1edf8df54dd5a75e9fba6cc0a1f3, State: Running, Role: LEADER
I20260709 12:27:44.079713  3304 consensus_queue.cc:260] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:44.081182  3304 raft_consensus.cc:3060] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:44.083599  3228 raft_consensus.cc:2468] T 821be9b5927a481ab065336d9a5c6522 P 65bae5463b17443bb0fa568920a9ca19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e260c115ddf045e88e73893d7f8269db in term 4.
I20260709 12:27:44.084928  3351 leader_election.cc:304] T 821be9b5927a481ab065336d9a5c6522 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, e260c115ddf045e88e73893d7f8269db; no voters: 
I20260709 12:27:44.085767  3693 raft_consensus.cc:2804] T 821be9b5927a481ab065336d9a5c6522 P e260c115ddf045e88e73893d7f8269db [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:44.086243  3693 raft_consensus.cc:697] T 821be9b5927a481ab065336d9a5c6522 P e260c115ddf045e88e73893d7f8269db [term 4 LEADER]: Becoming Leader. State: Replica: e260c115ddf045e88e73893d7f8269db, State: Running, Role: LEADER
I20260709 12:27:44.087025  3693 consensus_queue.cc:237] T 821be9b5927a481ab065336d9a5c6522 P e260c115ddf045e88e73893d7f8269db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:44.089215  3304 raft_consensus.cc:2468] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e260c115ddf045e88e73893d7f8269db in term 4.
I20260709 12:27:44.095253  3132 catalog_manager.cc:5697] T 821be9b5927a481ab065336d9a5c6522 P e260c115ddf045e88e73893d7f8269db reported cstate change: term changed from 3 to 4, leader changed from d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130) to e260c115ddf045e88e73893d7f8269db (127.23.245.131). New cstate: current_term: 4 leader_uuid: "e260c115ddf045e88e73893d7f8269db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } health_report { overall_health: HEALTHY } } }
W20260709 12:27:44.330065  3407 debug-util.cc:398] Leaking SignalData structure 0x7b08000ee5a0 after lost signal to thread 24537
W20260709 12:27:44.331321  3407 debug-util.cc:398] Leaking SignalData structure 0x7b08000d2ec0 after lost signal to thread 3169
W20260709 12:27:44.332765  3407 debug-util.cc:398] Leaking SignalData structure 0x7b080012e820 after lost signal to thread 3261
W20260709 12:27:44.334036  3407 debug-util.cc:398] Leaking SignalData structure 0x7b0800250420 after lost signal to thread 3336
W20260709 12:27:44.334384  3407 debug-util.cc:398] Leaking SignalData structure 0x7b0800299e40 after lost signal to thread 3337
W20260709 12:27:44.335564  3407 debug-util.cc:398] Leaking SignalData structure 0x7b080031cb60 after lost signal to thread 3410
I20260709 12:27:44.510257  3228 raft_consensus.cc:1275] T 821be9b5927a481ab065336d9a5c6522 P 65bae5463b17443bb0fa568920a9ca19 [term 4 FOLLOWER]: Refusing update from remote peer e260c115ddf045e88e73893d7f8269db: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:27:44.512020  3693 consensus_queue.cc:1048] T 821be9b5927a481ab065336d9a5c6522 P e260c115ddf045e88e73893d7f8269db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:44.522893  3304 raft_consensus.cc:1275] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 4 FOLLOWER]: Refusing update from remote peer e260c115ddf045e88e73893d7f8269db: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:27:44.524816  3693 consensus_queue.cc:1048] T 821be9b5927a481ab065336d9a5c6522 P e260c115ddf045e88e73893d7f8269db [LEADER]: Connected to new peer: Peer: permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:44.909763  3693 raft_consensus.cc:493] T bfb3537bcd1e40918b030db5bc35117b P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 65bae5463b17443bb0fa568920a9ca19)
I20260709 12:27:44.911602  3693 raft_consensus.cc:515] T bfb3537bcd1e40918b030db5bc35117b P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:44.920185  3228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3537bcd1e40918b030db5bc35117b" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19" is_pre_election: true
I20260709 12:27:44.920583  3693 leader_election.cc:290] T bfb3537bcd1e40918b030db5bc35117b P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915)
I20260709 12:27:44.921519  3228 raft_consensus.cc:2468] T bfb3537bcd1e40918b030db5bc35117b P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e260c115ddf045e88e73893d7f8269db in term 2.
I20260709 12:27:44.923454  3304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3537bcd1e40918b030db5bc35117b" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" is_pre_election: true
I20260709 12:27:44.923902  3351 leader_election.cc:304] T bfb3537bcd1e40918b030db5bc35117b P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, e260c115ddf045e88e73893d7f8269db; no voters: 
I20260709 12:27:44.924654  3304 raft_consensus.cc:2393] T bfb3537bcd1e40918b030db5bc35117b P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e260c115ddf045e88e73893d7f8269db in current term 2: Already voted for candidate d31e1edf8df54dd5a75e9fba6cc0a1f3 in this term.
I20260709 12:27:44.925266  3693 raft_consensus.cc:2804] T bfb3537bcd1e40918b030db5bc35117b P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:44.925901  3693 raft_consensus.cc:493] T bfb3537bcd1e40918b030db5bc35117b P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Starting leader election (detected failure of leader 65bae5463b17443bb0fa568920a9ca19)
I20260709 12:27:44.926527  3693 raft_consensus.cc:3060] T bfb3537bcd1e40918b030db5bc35117b P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:44.939005  3724 raft_consensus.cc:493] T bfdfacb5c8bc4844936c037c39983f24 P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:44.939543  3693 raft_consensus.cc:515] T bfb3537bcd1e40918b030db5bc35117b P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:44.940147  3724 raft_consensus.cc:515] T bfdfacb5c8bc4844936c037c39983f24 P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:44.942008  3693 leader_election.cc:290] T bfb3537bcd1e40918b030db5bc35117b P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 2 election: Requested vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915)
I20260709 12:27:44.942672  3724 leader_election.cc:290] T bfdfacb5c8bc4844936c037c39983f24 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915)
I20260709 12:27:44.943930  3228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3537bcd1e40918b030db5bc35117b" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19"
I20260709 12:27:44.945171  3236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdfacb5c8bc4844936c037c39983f24" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19" is_pre_election: true
I20260709 12:27:44.946079  3236 raft_consensus.cc:2468] T bfdfacb5c8bc4844936c037c39983f24 P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e260c115ddf045e88e73893d7f8269db in term 2.
I20260709 12:27:44.948282  3351 leader_election.cc:304] T bfdfacb5c8bc4844936c037c39983f24 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, e260c115ddf045e88e73893d7f8269db; no voters: 
I20260709 12:27:44.949157  3304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3537bcd1e40918b030db5bc35117b" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3"
I20260709 12:27:44.950316  3724 raft_consensus.cc:2804] T bfdfacb5c8bc4844936c037c39983f24 P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:44.950134  3310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdfacb5c8bc4844936c037c39983f24" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" is_pre_election: true
I20260709 12:27:44.950770  3724 raft_consensus.cc:493] T bfdfacb5c8bc4844936c037c39983f24 P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:44.951198  3310 raft_consensus.cc:2468] T bfdfacb5c8bc4844936c037c39983f24 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e260c115ddf045e88e73893d7f8269db in term 2.
I20260709 12:27:44.950127  3304 raft_consensus.cc:2393] T bfb3537bcd1e40918b030db5bc35117b P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e260c115ddf045e88e73893d7f8269db in current term 2: Already voted for candidate d31e1edf8df54dd5a75e9fba6cc0a1f3 in this term.
I20260709 12:27:44.951220  3724 raft_consensus.cc:3060] T bfdfacb5c8bc4844936c037c39983f24 P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:44.957106  3228 raft_consensus.cc:2468] T bfb3537bcd1e40918b030db5bc35117b P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e260c115ddf045e88e73893d7f8269db in term 2.
I20260709 12:27:44.959103  3351 leader_election.cc:304] T bfb3537bcd1e40918b030db5bc35117b P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, e260c115ddf045e88e73893d7f8269db; no voters: d31e1edf8df54dd5a75e9fba6cc0a1f3
I20260709 12:27:44.960526  3693 raft_consensus.cc:2804] T bfb3537bcd1e40918b030db5bc35117b P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:44.965242  3724 raft_consensus.cc:515] T bfdfacb5c8bc4844936c037c39983f24 P e260c115ddf045e88e73893d7f8269db [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:44.968904  3724 leader_election.cc:290] T bfdfacb5c8bc4844936c037c39983f24 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 3 election: Requested vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915)
I20260709 12:27:44.969476  3304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdfacb5c8bc4844936c037c39983f24" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3"
I20260709 12:27:44.970304  3304 raft_consensus.cc:3060] T bfdfacb5c8bc4844936c037c39983f24 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:44.973206 24534 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:27:44.978971  3228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfdfacb5c8bc4844936c037c39983f24" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19"
I20260709 12:27:44.979781  3228 raft_consensus.cc:3060] T bfdfacb5c8bc4844936c037c39983f24 P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:44.986898  3693 raft_consensus.cc:697] T bfb3537bcd1e40918b030db5bc35117b P e260c115ddf045e88e73893d7f8269db [term 2 LEADER]: Becoming Leader. State: Replica: e260c115ddf045e88e73893d7f8269db, State: Running, Role: LEADER
I20260709 12:27:44.993021  3693 consensus_queue.cc:237] T bfb3537bcd1e40918b030db5bc35117b P e260c115ddf045e88e73893d7f8269db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:44.994189  3304 raft_consensus.cc:2468] T bfdfacb5c8bc4844936c037c39983f24 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e260c115ddf045e88e73893d7f8269db in term 3.
I20260709 12:27:44.997601  3351 leader_election.cc:304] T bfdfacb5c8bc4844936c037c39983f24 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d31e1edf8df54dd5a75e9fba6cc0a1f3, e260c115ddf045e88e73893d7f8269db; no voters: 
I20260709 12:27:44.998617  3746 raft_consensus.cc:2804] T bfdfacb5c8bc4844936c037c39983f24 P e260c115ddf045e88e73893d7f8269db [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:44.999343  3746 raft_consensus.cc:697] T bfdfacb5c8bc4844936c037c39983f24 P e260c115ddf045e88e73893d7f8269db [term 3 LEADER]: Becoming Leader. State: Replica: e260c115ddf045e88e73893d7f8269db, State: Running, Role: LEADER
I20260709 12:27:44.991675 24534 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:27:45.001371 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:45.004631  3228 raft_consensus.cc:2468] T bfdfacb5c8bc4844936c037c39983f24 P 65bae5463b17443bb0fa568920a9ca19 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e260c115ddf045e88e73893d7f8269db in term 3.
I20260709 12:27:45.001026  3746 consensus_queue.cc:237] T bfdfacb5c8bc4844936c037c39983f24 P e260c115ddf045e88e73893d7f8269db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:45.010068  3708 raft_consensus.cc:493] T c4adb0932a604e779ef3ce9fff0b7bc5 P 65bae5463b17443bb0fa568920a9ca19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:45.010890  3708 raft_consensus.cc:515] T c4adb0932a604e779ef3ce9fff0b7bc5 P 65bae5463b17443bb0fa568920a9ca19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:45.019444  3304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4adb0932a604e779ef3ce9fff0b7bc5" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" is_pre_election: true
I20260709 12:27:45.020330  3304 raft_consensus.cc:2468] T c4adb0932a604e779ef3ce9fff0b7bc5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65bae5463b17443bb0fa568920a9ca19 in term 3.
I20260709 12:27:45.021705  3708 leader_election.cc:290] T c4adb0932a604e779ef3ce9fff0b7bc5 P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:45.028306  3381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4adb0932a604e779ef3ce9fff0b7bc5" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db" is_pre_election: true
I20260709 12:27:45.029287  3381 raft_consensus.cc:2468] T c4adb0932a604e779ef3ce9fff0b7bc5 P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65bae5463b17443bb0fa568920a9ca19 in term 2.
I20260709 12:27:45.032655  3200 leader_election.cc:304] T c4adb0932a604e779ef3ce9fff0b7bc5 P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, e260c115ddf045e88e73893d7f8269db; no voters: 
I20260709 12:27:45.034511  3708 raft_consensus.cc:2804] T c4adb0932a604e779ef3ce9fff0b7bc5 P 65bae5463b17443bb0fa568920a9ca19 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:45.033840  3133 catalog_manager.cc:5697] T bfb3537bcd1e40918b030db5bc35117b P e260c115ddf045e88e73893d7f8269db reported cstate change: term changed from 1 to 2, leader changed from 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129) to e260c115ddf045e88e73893d7f8269db (127.23.245.131). New cstate: current_term: 2 leader_uuid: "e260c115ddf045e88e73893d7f8269db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:45.034999  3708 raft_consensus.cc:493] T c4adb0932a604e779ef3ce9fff0b7bc5 P 65bae5463b17443bb0fa568920a9ca19 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:45.035418  3708 raft_consensus.cc:3060] T c4adb0932a604e779ef3ce9fff0b7bc5 P 65bae5463b17443bb0fa568920a9ca19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:45.019474 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:45.044493 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:45.050050  3708 raft_consensus.cc:515] T c4adb0932a604e779ef3ce9fff0b7bc5 P 65bae5463b17443bb0fa568920a9ca19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:45.054051  3304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4adb0932a604e779ef3ce9fff0b7bc5" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3"
I20260709 12:27:45.054821  3304 raft_consensus.cc:3060] T c4adb0932a604e779ef3ce9fff0b7bc5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:45.060952  3730 raft_consensus.cc:493] T 2f808f4193db4e6eba0ea677944df64d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:45.061774  3730 raft_consensus.cc:515] T 2f808f4193db4e6eba0ea677944df64d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:45.062634  3708 leader_election.cc:290] T c4adb0932a604e779ef3ce9fff0b7bc5 P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 4 election: Requested vote from peers d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:45.065558  3381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c4adb0932a604e779ef3ce9fff0b7bc5" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db"
I20260709 12:27:45.066241  3381 raft_consensus.cc:3060] T c4adb0932a604e779ef3ce9fff0b7bc5 P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:27:45.080176  3304 raft_consensus.cc:2468] T c4adb0932a604e779ef3ce9fff0b7bc5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65bae5463b17443bb0fa568920a9ca19 in term 4.
I20260709 12:27:45.081622  3202 leader_election.cc:304] T c4adb0932a604e779ef3ce9fff0b7bc5 P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, d31e1edf8df54dd5a75e9fba6cc0a1f3; no voters: 
I20260709 12:27:45.082410  3730 leader_election.cc:290] T 2f808f4193db4e6eba0ea677944df64d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:45.079648  3381 raft_consensus.cc:2468] T c4adb0932a604e779ef3ce9fff0b7bc5 P e260c115ddf045e88e73893d7f8269db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65bae5463b17443bb0fa568920a9ca19 in term 4.
I20260709 12:27:45.082698  3228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f808f4193db4e6eba0ea677944df64d" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19" is_pre_election: true
I20260709 12:27:45.084059  3708 raft_consensus.cc:2804] T c4adb0932a604e779ef3ce9fff0b7bc5 P 65bae5463b17443bb0fa568920a9ca19 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:45.095152  3708 raft_consensus.cc:697] T c4adb0932a604e779ef3ce9fff0b7bc5 P 65bae5463b17443bb0fa568920a9ca19 [term 4 LEADER]: Becoming Leader. State: Replica: 65bae5463b17443bb0fa568920a9ca19, State: Running, Role: LEADER
I20260709 12:27:45.096467  3708 consensus_queue.cc:237] T c4adb0932a604e779ef3ce9fff0b7bc5 P 65bae5463b17443bb0fa568920a9ca19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:45.097540  3133 catalog_manager.cc:5697] T bfdfacb5c8bc4844936c037c39983f24 P e260c115ddf045e88e73893d7f8269db reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e260c115ddf045e88e73893d7f8269db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:45.099525  3381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f808f4193db4e6eba0ea677944df64d" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db" is_pre_election: true
I20260709 12:27:45.100359  3381 raft_consensus.cc:2468] T 2f808f4193db4e6eba0ea677944df64d P e260c115ddf045e88e73893d7f8269db [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d31e1edf8df54dd5a75e9fba6cc0a1f3 in term 3.
I20260709 12:27:45.103807  3275 leader_election.cc:304] T 2f808f4193db4e6eba0ea677944df64d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d31e1edf8df54dd5a75e9fba6cc0a1f3, e260c115ddf045e88e73893d7f8269db; no voters: 65bae5463b17443bb0fa568920a9ca19
I20260709 12:27:45.104049  3752 raft_consensus.cc:493] T 71b5bc230abf46069a29bb86e6039a15 P 65bae5463b17443bb0fa568920a9ca19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:45.104714  3752 raft_consensus.cc:515] T 71b5bc230abf46069a29bb86e6039a15 P 65bae5463b17443bb0fa568920a9ca19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:45.106494  3730 raft_consensus.cc:2804] T 2f808f4193db4e6eba0ea677944df64d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:45.106943  3730 raft_consensus.cc:493] T 2f808f4193db4e6eba0ea677944df64d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:45.107265  3730 raft_consensus.cc:3060] T 2f808f4193db4e6eba0ea677944df64d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:45.107645  3304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b5bc230abf46069a29bb86e6039a15" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" is_pre_election: true
I20260709 12:27:45.108453  3304 raft_consensus.cc:2468] T 71b5bc230abf46069a29bb86e6039a15 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65bae5463b17443bb0fa568920a9ca19 in term 3.
I20260709 12:27:45.109699  3202 leader_election.cc:304] T 71b5bc230abf46069a29bb86e6039a15 P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, d31e1edf8df54dd5a75e9fba6cc0a1f3; no voters: 
I20260709 12:27:45.122179  3752 leader_election.cc:290] T 71b5bc230abf46069a29bb86e6039a15 P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:45.123386  3730 raft_consensus.cc:515] T 2f808f4193db4e6eba0ea677944df64d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:45.123565  3752 raft_consensus.cc:2804] T 71b5bc230abf46069a29bb86e6039a15 P 65bae5463b17443bb0fa568920a9ca19 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:45.129959  3746 raft_consensus.cc:493] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:45.130982  3746 raft_consensus.cc:515] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:45.131318  3228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f808f4193db4e6eba0ea677944df64d" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19"
I20260709 12:27:45.133188  3746 leader_election.cc:290] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915)
I20260709 12:27:45.135164  3378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f808f4193db4e6eba0ea677944df64d" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db"
I20260709 12:27:45.135445  3228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848e8cff9e5b4de6b49a1bd243e9f9aa" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19" is_pre_election: true
I20260709 12:27:45.135860  3378 raft_consensus.cc:3060] T 2f808f4193db4e6eba0ea677944df64d P e260c115ddf045e88e73893d7f8269db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:45.136224  3228 raft_consensus.cc:2468] T 848e8cff9e5b4de6b49a1bd243e9f9aa P 65bae5463b17443bb0fa568920a9ca19 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e260c115ddf045e88e73893d7f8269db in term 4.
I20260709 12:27:45.140266  3351 leader_election.cc:304] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, e260c115ddf045e88e73893d7f8269db; no voters: 
I20260709 12:27:45.143695  3746 raft_consensus.cc:2804] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:45.144013  3730 leader_election.cc:290] T 2f808f4193db4e6eba0ea677944df64d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 4 election: Requested vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:45.144163  3746 raft_consensus.cc:493] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:45.144917  3693 raft_consensus.cc:493] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:45.145709  3304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848e8cff9e5b4de6b49a1bd243e9f9aa" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" is_pre_election: true
I20260709 12:27:45.146126  3693 raft_consensus.cc:515] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:45.146548  3304 raft_consensus.cc:2468] T 848e8cff9e5b4de6b49a1bd243e9f9aa P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e260c115ddf045e88e73893d7f8269db in term 4.
I20260709 12:27:45.148371  3693 leader_election.cc:290] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915)
I20260709 12:27:45.149009  3746 raft_consensus.cc:3060] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:45.149744  3310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "088188cf28674e1c94310faf6d3f7ff4" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" is_pre_election: true
I20260709 12:27:45.150540  3310 raft_consensus.cc:2468] T 088188cf28674e1c94310faf6d3f7ff4 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e260c115ddf045e88e73893d7f8269db in term 3.
I20260709 12:27:45.151844  3351 leader_election.cc:304] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d31e1edf8df54dd5a75e9fba6cc0a1f3, e260c115ddf045e88e73893d7f8269db; no voters: 
I20260709 12:27:45.152978  3228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "088188cf28674e1c94310faf6d3f7ff4" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19" is_pre_election: true
I20260709 12:27:45.154522  3693 raft_consensus.cc:2804] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:45.154989  3693 raft_consensus.cc:493] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:45.155390  3693 raft_consensus.cc:3060] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:45.145237  3378 raft_consensus.cc:2468] T 2f808f4193db4e6eba0ea677944df64d P e260c115ddf045e88e73893d7f8269db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d31e1edf8df54dd5a75e9fba6cc0a1f3 in term 4.
I20260709 12:27:45.158623  3275 leader_election.cc:304] T 2f808f4193db4e6eba0ea677944df64d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d31e1edf8df54dd5a75e9fba6cc0a1f3, e260c115ddf045e88e73893d7f8269db; no voters: 65bae5463b17443bb0fa568920a9ca19
I20260709 12:27:45.159680  3730 raft_consensus.cc:2804] T 2f808f4193db4e6eba0ea677944df64d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:45.161353  3730 raft_consensus.cc:697] T 2f808f4193db4e6eba0ea677944df64d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 4 LEADER]: Becoming Leader. State: Replica: d31e1edf8df54dd5a75e9fba6cc0a1f3, State: Running, Role: LEADER
I20260709 12:27:45.162958  3730 consensus_queue.cc:237] T 2f808f4193db4e6eba0ea677944df64d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:45.165343  3746 raft_consensus.cc:515] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:45.171058  3746 leader_election.cc:290] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 5 election: Requested vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915)
I20260709 12:27:45.175423  3754 raft_consensus.cc:493] T 088188cf28674e1c94310faf6d3f7ff4 P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e260c115ddf045e88e73893d7f8269db)
I20260709 12:27:45.176412  3754 raft_consensus.cc:515] T 088188cf28674e1c94310faf6d3f7ff4 P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:45.183456  3754 leader_election.cc:290] T 088188cf28674e1c94310faf6d3f7ff4 P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:45.183714  3378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "088188cf28674e1c94310faf6d3f7ff4" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db" is_pre_election: true
I20260709 12:27:45.188664  3228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848e8cff9e5b4de6b49a1bd243e9f9aa" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19"
I20260709 12:27:45.202165  3228 raft_consensus.cc:3060] T 848e8cff9e5b4de6b49a1bd243e9f9aa P 65bae5463b17443bb0fa568920a9ca19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:45.216617  3304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "848e8cff9e5b4de6b49a1bd243e9f9aa" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3"
I20260709 12:27:45.218658  3304 raft_consensus.cc:3060] T 848e8cff9e5b4de6b49a1bd243e9f9aa P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:45.128221  3381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b5bc230abf46069a29bb86e6039a15" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db" is_pre_election: true
W20260709 12:27:45.220096  3202 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.130:44915, user_credentials={real_user=slave}} blocked reactor thread for 110196us
I20260709 12:27:45.225858  3310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "088188cf28674e1c94310faf6d3f7ff4" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" is_pre_election: true
I20260709 12:27:45.227020  3310 raft_consensus.cc:2393] T 088188cf28674e1c94310faf6d3f7ff4 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65bae5463b17443bb0fa568920a9ca19 in current term 3: Already voted for candidate d31e1edf8df54dd5a75e9fba6cc0a1f3 in this term.
I20260709 12:27:45.222841  3381 raft_consensus.cc:2468] T 71b5bc230abf46069a29bb86e6039a15 P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65bae5463b17443bb0fa568920a9ca19 in term 2.
I20260709 12:27:45.236157  3752 raft_consensus.cc:493] T 71b5bc230abf46069a29bb86e6039a15 P 65bae5463b17443bb0fa568920a9ca19 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:45.238966  3754 raft_consensus.cc:493] T 5d25e61c23044d75a5c8fbdca4c23eb2 P 65bae5463b17443bb0fa568920a9ca19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:45.240610  3754 raft_consensus.cc:515] T 5d25e61c23044d75a5c8fbdca4c23eb2 P 65bae5463b17443bb0fa568920a9ca19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } } peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } }
I20260709 12:27:45.245395  3382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d25e61c23044d75a5c8fbdca4c23eb2" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db" is_pre_election: true
I20260709 12:27:45.248242  3754 leader_election.cc:290] T 5d25e61c23044d75a5c8fbdca4c23eb2 P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:45.249132  3752 raft_consensus.cc:3060] T 71b5bc230abf46069a29bb86e6039a15 P 65bae5463b17443bb0fa568920a9ca19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:45.256466  3310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d25e61c23044d75a5c8fbdca4c23eb2" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" is_pre_election: true
I20260709 12:27:45.258095  3310 raft_consensus.cc:2468] T 5d25e61c23044d75a5c8fbdca4c23eb2 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65bae5463b17443bb0fa568920a9ca19 in term 3.
I20260709 12:27:45.268505  3202 leader_election.cc:304] T 5d25e61c23044d75a5c8fbdca4c23eb2 P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, d31e1edf8df54dd5a75e9fba6cc0a1f3; no voters: e260c115ddf045e88e73893d7f8269db
I20260709 12:27:45.269769  3754 raft_consensus.cc:2804] T 5d25e61c23044d75a5c8fbdca4c23eb2 P 65bae5463b17443bb0fa568920a9ca19 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:45.270351  3754 raft_consensus.cc:493] T 5d25e61c23044d75a5c8fbdca4c23eb2 P 65bae5463b17443bb0fa568920a9ca19 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:45.270859  3754 raft_consensus.cc:3060] T 5d25e61c23044d75a5c8fbdca4c23eb2 P 65bae5463b17443bb0fa568920a9ca19 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:27:45.288410  3753 log.cc:927] Time spent T c4adb0932a604e779ef3ce9fff0b7bc5 P 65bae5463b17443bb0fa568920a9ca19: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 12:27:45.291321  3693 raft_consensus.cc:515] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:45.293198  3378 raft_consensus.cc:2368] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65bae5463b17443bb0fa568920a9ca19 for earlier term 3. Current term is 4.
I20260709 12:27:45.298755  3200 leader_election.cc:400] T 088188cf28674e1c94310faf6d3f7ff4 P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 3 pre-election: Vote denied by peer e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191) with higher term. Message: Invalid argument: T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65bae5463b17443bb0fa568920a9ca19 for earlier term 3. Current term is 4.
I20260709 12:27:45.299206  3200 leader_election.cc:403] T 088188cf28674e1c94310faf6d3f7ff4 P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:27:45.300709  3755 raft_consensus.cc:493] T 5d25e61c23044d75a5c8fbdca4c23eb2 P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 65bae5463b17443bb0fa568920a9ca19)
I20260709 12:27:45.300987  3708 raft_consensus.cc:3060] T 088188cf28674e1c94310faf6d3f7ff4 P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:27:45.301415  3755 raft_consensus.cc:515] T 5d25e61c23044d75a5c8fbdca4c23eb2 P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } } peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } }
I20260709 12:27:45.303700  3755 leader_election.cc:290] T 5d25e61c23044d75a5c8fbdca4c23eb2 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915), 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391)
I20260709 12:27:45.307907  3133 catalog_manager.cc:5697] T c4adb0932a604e779ef3ce9fff0b7bc5 P 65bae5463b17443bb0fa568920a9ca19 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "65bae5463b17443bb0fa568920a9ca19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:45.308511  3236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d25e61c23044d75a5c8fbdca4c23eb2" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19" is_pre_election: true
I20260709 12:27:45.322899  3729 raft_consensus.cc:493] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:45.323817  3729 raft_consensus.cc:515] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:45.329900  3232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f0de7c8efd147bcb0dcec69dd1bc2ab" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19" is_pre_election: true
I20260709 12:27:45.332561  3729 leader_election.cc:290] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:45.333811  3310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d25e61c23044d75a5c8fbdca4c23eb2" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" is_pre_election: true
I20260709 12:27:45.335049  3310 raft_consensus.cc:2393] T 5d25e61c23044d75a5c8fbdca4c23eb2 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e260c115ddf045e88e73893d7f8269db in current term 3: Already voted for candidate d31e1edf8df54dd5a75e9fba6cc0a1f3 in this term.
I20260709 12:27:45.337436  3378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f0de7c8efd147bcb0dcec69dd1bc2ab" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db" is_pre_election: true
I20260709 12:27:45.338570  3378 raft_consensus.cc:2468] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P e260c115ddf045e88e73893d7f8269db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d31e1edf8df54dd5a75e9fba6cc0a1f3 in term 4.
I20260709 12:27:45.340147  3275 leader_election.cc:304] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d31e1edf8df54dd5a75e9fba6cc0a1f3, e260c115ddf045e88e73893d7f8269db; no voters: 65bae5463b17443bb0fa568920a9ca19
I20260709 12:27:45.342360  3729 raft_consensus.cc:2804] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:27:45.342901  3729 raft_consensus.cc:493] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:45.343391  3729 raft_consensus.cc:3060] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:45.377815  3133 catalog_manager.cc:5697] T 2f808f4193db4e6eba0ea677944df64d P d31e1edf8df54dd5a75e9fba6cc0a1f3 reported cstate change: term changed from 2 to 4, leader changed from e260c115ddf045e88e73893d7f8269db (127.23.245.131) to d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130). New cstate: current_term: 4 leader_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:45.404986  3759 raft_consensus.cc:493] T 3eebe28a0e1b493581b05e588dd920d5 P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:45.405819  3759 raft_consensus.cc:515] T 3eebe28a0e1b493581b05e588dd920d5 P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:45.407361  3757 raft_consensus.cc:493] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e260c115ddf045e88e73893d7f8269db)
I20260709 12:27:45.408471  3759 leader_election.cc:290] T 3eebe28a0e1b493581b05e588dd920d5 P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:45.408346  3757 raft_consensus.cc:515] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:45.409183  3759 raft_consensus.cc:493] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P 65bae5463b17443bb0fa568920a9ca19 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:45.409873  3759 raft_consensus.cc:515] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P 65bae5463b17443bb0fa568920a9ca19 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:45.411336  3757 leader_election.cc:290] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:45.412205  3759 leader_election.cc:290] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:45.412993  3758 raft_consensus.cc:493] T 2f808f4193db4e6eba0ea677944df64d P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e260c115ddf045e88e73893d7f8269db)
I20260709 12:27:45.413940  3758 raft_consensus.cc:515] T 2f808f4193db4e6eba0ea677944df64d P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:45.418627  3310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eebe28a0e1b493581b05e588dd920d5" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" is_pre_election: true
I20260709 12:27:45.419842  3310 raft_consensus.cc:2468] T 3eebe28a0e1b493581b05e588dd920d5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65bae5463b17443bb0fa568920a9ca19 in term 2.
I20260709 12:27:45.423416  3310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "088188cf28674e1c94310faf6d3f7ff4" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3"
I20260709 12:27:45.424321  3310 raft_consensus.cc:3060] T 088188cf28674e1c94310faf6d3f7ff4 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:45.437799  3311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f0de7c8efd147bcb0dcec69dd1bc2ab" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" is_pre_election: true
I20260709 12:27:45.452939  3693 leader_election.cc:290] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 4 election: Requested vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915)
I20260709 12:27:45.455588  3305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c6742a5e0e4b0eb07abd8f93c2a8fb" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" is_pre_election: true
I20260709 12:27:45.456830  3305 raft_consensus.cc:2468] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65bae5463b17443bb0fa568920a9ca19 in term 3.
I20260709 12:27:45.458295  3202 leader_election.cc:304] T 3eebe28a0e1b493581b05e588dd920d5 P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, d31e1edf8df54dd5a75e9fba6cc0a1f3; no voters: 
I20260709 12:27:45.459157  3759 raft_consensus.cc:2804] T 3eebe28a0e1b493581b05e588dd920d5 P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:45.459228  3202 leader_election.cc:304] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, d31e1edf8df54dd5a75e9fba6cc0a1f3; no voters: 
I20260709 12:27:45.459625  3759 raft_consensus.cc:493] T 3eebe28a0e1b493581b05e588dd920d5 P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:45.460045  3759 raft_consensus.cc:3060] T 3eebe28a0e1b493581b05e588dd920d5 P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:45.460453  3228 raft_consensus.cc:2468] T 848e8cff9e5b4de6b49a1bd243e9f9aa P 65bae5463b17443bb0fa568920a9ca19 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e260c115ddf045e88e73893d7f8269db in term 5.
I20260709 12:27:45.469178  3759 raft_consensus.cc:515] T 3eebe28a0e1b493581b05e588dd920d5 P 65bae5463b17443bb0fa568920a9ca19 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:45.472818  3381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f0de7c8efd147bcb0dcec69dd1bc2ab" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db" is_pre_election: true
I20260709 12:27:45.473631  3381 raft_consensus.cc:2468] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P e260c115ddf045e88e73893d7f8269db [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65bae5463b17443bb0fa568920a9ca19 in term 4.
I20260709 12:27:45.471402  3378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eebe28a0e1b493581b05e588dd920d5" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db" is_pre_election: true
I20260709 12:27:45.474689  3378 raft_consensus.cc:2468] T 3eebe28a0e1b493581b05e588dd920d5 P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65bae5463b17443bb0fa568920a9ca19 in term 1.
I20260709 12:27:45.475284  3754 raft_consensus.cc:515] T 5d25e61c23044d75a5c8fbdca4c23eb2 P 65bae5463b17443bb0fa568920a9ca19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } } peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } }
I20260709 12:27:45.472908  3305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f808f4193db4e6eba0ea677944df64d" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" is_pre_election: true
I20260709 12:27:45.470683  3760 raft_consensus.cc:2804] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P 65bae5463b17443bb0fa568920a9ca19 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:45.517521  3760 raft_consensus.cc:493] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P 65bae5463b17443bb0fa568920a9ca19 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:45.517751  3236 raft_consensus.cc:2368] T 5d25e61c23044d75a5c8fbdca4c23eb2 P 65bae5463b17443bb0fa568920a9ca19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e260c115ddf045e88e73893d7f8269db for earlier term 3. Current term is 4.
I20260709 12:27:45.517978  3760 raft_consensus.cc:3060] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P 65bae5463b17443bb0fa568920a9ca19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:45.495074  3755 raft_consensus.cc:493] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 65bae5463b17443bb0fa568920a9ca19)
I20260709 12:27:45.519626  3755 raft_consensus.cc:515] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:45.520941  3305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d25e61c23044d75a5c8fbdca4c23eb2" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3"
I20260709 12:27:45.508458  3382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f808f4193db4e6eba0ea677944df64d" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db" is_pre_election: true
I20260709 12:27:45.521646  3305 raft_consensus.cc:3060] T 5d25e61c23044d75a5c8fbdca4c23eb2 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:45.483202  3381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eebe28a0e1b493581b05e588dd920d5" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db"
I20260709 12:27:45.476887  3378 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c6742a5e0e4b0eb07abd8f93c2a8fb" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db" is_pre_election: true
I20260709 12:27:45.498576  3228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "088188cf28674e1c94310faf6d3f7ff4" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19"
I20260709 12:27:45.451530  3304 raft_consensus.cc:2468] T 848e8cff9e5b4de6b49a1bd243e9f9aa P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e260c115ddf045e88e73893d7f8269db in term 5.
I20260709 12:27:45.483018  3232 raft_consensus.cc:1275] T bfdfacb5c8bc4844936c037c39983f24 P 65bae5463b17443bb0fa568920a9ca19 [term 3 FOLLOWER]: Refusing update from remote peer e260c115ddf045e88e73893d7f8269db: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:45.480266  3758 leader_election.cc:290] T 2f808f4193db4e6eba0ea677944df64d P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:45.522383  3381 raft_consensus.cc:3060] T 3eebe28a0e1b493581b05e588dd920d5 P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:27:45.481684  3351 leader_election.cc:304] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, e260c115ddf045e88e73893d7f8269db; no voters: 
I20260709 12:27:45.514212  3200 leader_election.cc:304] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, e260c115ddf045e88e73893d7f8269db; no voters: 
I20260709 12:27:45.514407  3752 raft_consensus.cc:515] T 71b5bc230abf46069a29bb86e6039a15 P 65bae5463b17443bb0fa568920a9ca19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:45.479313  3729 raft_consensus.cc:515] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:45.532649  3311 raft_consensus.cc:2368] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65bae5463b17443bb0fa568920a9ca19 for earlier term 4. Current term is 5.
I20260709 12:27:45.532975  3754 leader_election.cc:290] T 5d25e61c23044d75a5c8fbdca4c23eb2 P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 4 election: Requested vote from peers d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:45.534025  3381 raft_consensus.cc:2468] T 3eebe28a0e1b493581b05e588dd920d5 P e260c115ddf045e88e73893d7f8269db [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65bae5463b17443bb0fa568920a9ca19 in term 3.
I20260709 12:27:45.481290  3306 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3eebe28a0e1b493581b05e588dd920d5" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3"
I20260709 12:27:45.474704  3759 leader_election.cc:290] T 3eebe28a0e1b493581b05e588dd920d5 P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 3 election: Requested vote from peers d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:45.523170  3382 raft_consensus.cc:2368] T 2f808f4193db4e6eba0ea677944df64d P e260c115ddf045e88e73893d7f8269db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65bae5463b17443bb0fa568920a9ca19 for earlier term 3. Current term is 4.
I20260709 12:27:45.541688  3306 raft_consensus.cc:3060] T 3eebe28a0e1b493581b05e588dd920d5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:45.522637  3378 raft_consensus.cc:2468] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65bae5463b17443bb0fa568920a9ca19 in term 2.
I20260709 12:27:45.525486  3755 leader_election.cc:290] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915)
I20260709 12:27:45.505168  3708 raft_consensus.cc:2749] T 088188cf28674e1c94310faf6d3f7ff4 P 65bae5463b17443bb0fa568920a9ca19 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191) with higher term. Message: Invalid argument: T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65bae5463b17443bb0fa568920a9ca19 for earlier term 3. Current term is 4.
W20260709 12:27:45.526904  3351 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:44391, user_credentials={real_user=slave}} blocked reactor thread for 45304us
I20260709 12:27:45.546723  3351 leader_election.cc:400] T 5d25e61c23044d75a5c8fbdca4c23eb2 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 3 pre-election: Vote denied by peer 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391) with higher term. Message: Invalid argument: T 5d25e61c23044d75a5c8fbdca4c23eb2 P 65bae5463b17443bb0fa568920a9ca19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e260c115ddf045e88e73893d7f8269db for earlier term 3. Current term is 4.
I20260709 12:27:45.547006  3351 leader_election.cc:403] T 5d25e61c23044d75a5c8fbdca4c23eb2 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:27:45.527626  3693 raft_consensus.cc:2804] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:45.549337  3311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c6742a5e0e4b0eb07abd8f93c2a8fb" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" is_pre_election: true
I20260709 12:27:45.550128  3311 raft_consensus.cc:2393] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e260c115ddf045e88e73893d7f8269db in current term 3: Already voted for candidate d31e1edf8df54dd5a75e9fba6cc0a1f3 in this term.
I20260709 12:27:45.551187  3724 raft_consensus.cc:3060] T 5d25e61c23044d75a5c8fbdca4c23eb2 P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:27:45.530442  3758 raft_consensus.cc:2804] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:45.552342  3758 raft_consensus.cc:493] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e260c115ddf045e88e73893d7f8269db)
I20260709 12:27:45.552803  3758 raft_consensus.cc:3060] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:45.531836  3305 raft_consensus.cc:2468] T 5d25e61c23044d75a5c8fbdca4c23eb2 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65bae5463b17443bb0fa568920a9ca19 in term 4.
I20260709 12:27:45.535537  3377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d25e61c23044d75a5c8fbdca4c23eb2" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db"
I20260709 12:27:45.556034  3693 raft_consensus.cc:697] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [term 5 LEADER]: Becoming Leader. State: Replica: e260c115ddf045e88e73893d7f8269db, State: Running, Role: LEADER
I20260709 12:27:45.536394  3202 leader_election.cc:400] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 4 pre-election: Vote denied by peer d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915) with higher term. Message: Invalid argument: T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65bae5463b17443bb0fa568920a9ca19 for earlier term 4. Current term is 5.
I20260709 12:27:45.556370  3306 raft_consensus.cc:2468] T 3eebe28a0e1b493581b05e588dd920d5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65bae5463b17443bb0fa568920a9ca19 in term 3.
I20260709 12:27:45.565160  3304 raft_consensus.cc:1275] T bfb3537bcd1e40918b030db5bc35117b P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Refusing update from remote peer e260c115ddf045e88e73893d7f8269db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:45.539021  3232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f0de7c8efd147bcb0dcec69dd1bc2ab" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19"
I20260709 12:27:45.539217  3383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f0de7c8efd147bcb0dcec69dd1bc2ab" candidate_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db"
I20260709 12:27:45.566339  3383 raft_consensus.cc:3060] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P e260c115ddf045e88e73893d7f8269db [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:45.575163  3383 raft_consensus.cc:2468] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P e260c115ddf045e88e73893d7f8269db [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d31e1edf8df54dd5a75e9fba6cc0a1f3 in term 5.
I20260709 12:27:45.540303  3760 raft_consensus.cc:515] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P 65bae5463b17443bb0fa568920a9ca19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:45.578287  3275 leader_election.cc:304] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d31e1edf8df54dd5a75e9fba6cc0a1f3, e260c115ddf045e88e73893d7f8269db; no voters: 
I20260709 12:27:45.579105  3730 raft_consensus.cc:2804] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:45.579252  3760 leader_election.cc:290] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 4 election: Requested vote from peers d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:45.538985  3752 leader_election.cc:290] T 71b5bc230abf46069a29bb86e6039a15 P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 4 election: Requested vote from peers d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:45.540946  3385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b5bc230abf46069a29bb86e6039a15" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db"
I20260709 12:27:45.580350  3385 raft_consensus.cc:3060] T 71b5bc230abf46069a29bb86e6039a15 P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:27:45.579666  3730 raft_consensus.cc:697] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 5 LEADER]: Becoming Leader. State: Replica: d31e1edf8df54dd5a75e9fba6cc0a1f3, State: Running, Role: LEADER
I20260709 12:27:45.581542  3228 raft_consensus.cc:2468] T 088188cf28674e1c94310faf6d3f7ff4 P 65bae5463b17443bb0fa568920a9ca19 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e260c115ddf045e88e73893d7f8269db in term 4.
I20260709 12:27:45.581583  3730 consensus_queue.cc:237] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:45.576726  3758 raft_consensus.cc:515] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:45.516896  3310 raft_consensus.cc:2468] T 088188cf28674e1c94310faf6d3f7ff4 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e260c115ddf045e88e73893d7f8269db in term 4.
I20260709 12:27:45.583902  3232 raft_consensus.cc:3060] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:45.557116  3693 consensus_queue.cc:237] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:45.558018  3746 consensus_queue.cc:1048] T bfdfacb5c8bc4844936c037c39983f24 P e260c115ddf045e88e73893d7f8269db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:45.558521  3202 leader_election.cc:304] T 5d25e61c23044d75a5c8fbdca4c23eb2 P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, d31e1edf8df54dd5a75e9fba6cc0a1f3; no voters: 
I20260709 12:27:45.588481  3752 raft_consensus.cc:2804] T 5d25e61c23044d75a5c8fbdca4c23eb2 P 65bae5463b17443bb0fa568920a9ca19 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:45.588960  3752 raft_consensus.cc:697] T 5d25e61c23044d75a5c8fbdca4c23eb2 P 65bae5463b17443bb0fa568920a9ca19 [term 4 LEADER]: Becoming Leader. State: Replica: 65bae5463b17443bb0fa568920a9ca19, State: Running, Role: LEADER
I20260709 12:27:45.588992  3202 leader_election.cc:304] T 3eebe28a0e1b493581b05e588dd920d5 P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, d31e1edf8df54dd5a75e9fba6cc0a1f3; no voters: 
I20260709 12:27:45.590090  3752 consensus_queue.cc:237] T 5d25e61c23044d75a5c8fbdca4c23eb2 P 65bae5463b17443bb0fa568920a9ca19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } } peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } }
I20260709 12:27:45.590519  3708 raft_consensus.cc:2804] T 3eebe28a0e1b493581b05e588dd920d5 P 65bae5463b17443bb0fa568920a9ca19 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:45.591074  3708 raft_consensus.cc:697] T 3eebe28a0e1b493581b05e588dd920d5 P 65bae5463b17443bb0fa568920a9ca19 [term 3 LEADER]: Becoming Leader. State: Replica: 65bae5463b17443bb0fa568920a9ca19, State: Running, Role: LEADER
I20260709 12:27:45.592100  3758 leader_election.cc:290] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 4 election: Requested vote from peers d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:45.592020  3708 consensus_queue.cc:237] T 3eebe28a0e1b493581b05e588dd920d5 P 65bae5463b17443bb0fa568920a9ca19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:45.592370  3310 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c6742a5e0e4b0eb07abd8f93c2a8fb" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3"
I20260709 12:27:45.592718  3232 raft_consensus.cc:2468] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d31e1edf8df54dd5a75e9fba6cc0a1f3 in term 5.
I20260709 12:27:45.593004  3310 raft_consensus.cc:3060] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:45.559399  3311 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71b5bc230abf46069a29bb86e6039a15" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3"
I20260709 12:27:45.560137  3236 raft_consensus.cc:1275] T bfb3537bcd1e40918b030db5bc35117b P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Refusing update from remote peer e260c115ddf045e88e73893d7f8269db: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:45.560439  3233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c6742a5e0e4b0eb07abd8f93c2a8fb" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "65bae5463b17443bb0fa568920a9ca19" is_pre_election: true
I20260709 12:27:45.596796  3233 raft_consensus.cc:2368] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P 65bae5463b17443bb0fa568920a9ca19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e260c115ddf045e88e73893d7f8269db for earlier term 3. Current term is 4.
I20260709 12:27:45.597121  3311 raft_consensus.cc:3060] T 71b5bc230abf46069a29bb86e6039a15 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:45.563306  3724 raft_consensus.cc:2749] T 5d25e61c23044d75a5c8fbdca4c23eb2 P e260c115ddf045e88e73893d7f8269db [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391) with higher term. Message: Invalid argument: T 5d25e61c23044d75a5c8fbdca4c23eb2 P 65bae5463b17443bb0fa568920a9ca19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e260c115ddf045e88e73893d7f8269db for earlier term 3. Current term is 4.
I20260709 12:27:45.601436  3351 leader_election.cc:304] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d31e1edf8df54dd5a75e9fba6cc0a1f3, e260c115ddf045e88e73893d7f8269db; no voters: 
I20260709 12:27:45.602355  3746 raft_consensus.cc:2804] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:45.602813  3746 raft_consensus.cc:697] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db [term 4 LEADER]: Becoming Leader. State: Replica: e260c115ddf045e88e73893d7f8269db, State: Running, Role: LEADER
I20260709 12:27:45.603818  3746 consensus_queue.cc:237] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:45.610034  3377 raft_consensus.cc:2468] T 5d25e61c23044d75a5c8fbdca4c23eb2 P e260c115ddf045e88e73893d7f8269db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65bae5463b17443bb0fa568920a9ca19 in term 4.
I20260709 12:27:45.613898  3385 raft_consensus.cc:2468] T 71b5bc230abf46069a29bb86e6039a15 P e260c115ddf045e88e73893d7f8269db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65bae5463b17443bb0fa568920a9ca19 in term 4.
I20260709 12:27:45.616222  3310 raft_consensus.cc:2468] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65bae5463b17443bb0fa568920a9ca19 in term 4.
I20260709 12:27:45.617583  3202 leader_election.cc:304] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, d31e1edf8df54dd5a75e9fba6cc0a1f3; no voters: 
I20260709 12:27:45.618854  3133 catalog_manager.cc:5697] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 reported cstate change: term changed from 3 to 5, leader changed from e260c115ddf045e88e73893d7f8269db (127.23.245.131) to d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130). New cstate: current_term: 5 leader_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:45.539734  3729 leader_election.cc:290] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [CANDIDATE]: Term 5 election: Requested vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:45.576797  3755 consensus_queue.cc:1048] T bfb3537bcd1e40918b030db5bc35117b P e260c115ddf045e88e73893d7f8269db [LEADER]: Connected to new peer: Peer: permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:45.561303  3200 leader_election.cc:400] T 2f808f4193db4e6eba0ea677944df64d P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 3 pre-election: Vote denied by peer e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191) with higher term. Message: Invalid argument: T 2f808f4193db4e6eba0ea677944df64d P e260c115ddf045e88e73893d7f8269db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65bae5463b17443bb0fa568920a9ca19 for earlier term 3. Current term is 4.
I20260709 12:27:45.633327  3200 leader_election.cc:403] T 2f808f4193db4e6eba0ea677944df64d P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:27:45.634083  3200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.131:37191, user_credentials={real_user=slave}} blocked reactor thread for 72927.2us
I20260709 12:27:45.634949  3708 raft_consensus.cc:2804] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P 65bae5463b17443bb0fa568920a9ca19 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:45.636315  3200 leader_election.cc:304] T 71b5bc230abf46069a29bb86e6039a15 P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, e260c115ddf045e88e73893d7f8269db; no voters: 
I20260709 12:27:45.638125  3759 raft_consensus.cc:3060] T 2f808f4193db4e6eba0ea677944df64d P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:27:45.638446  3760 raft_consensus.cc:2804] T 71b5bc230abf46069a29bb86e6039a15 P 65bae5463b17443bb0fa568920a9ca19 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:45.639271  3760 raft_consensus.cc:697] T 71b5bc230abf46069a29bb86e6039a15 P 65bae5463b17443bb0fa568920a9ca19 [term 4 LEADER]: Becoming Leader. State: Replica: 65bae5463b17443bb0fa568920a9ca19, State: Running, Role: LEADER
I20260709 12:27:45.640324  3760 consensus_queue.cc:237] T 71b5bc230abf46069a29bb86e6039a15 P 65bae5463b17443bb0fa568920a9ca19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:45.638566  3306 raft_consensus.cc:1275] T bfdfacb5c8bc4844936c037c39983f24 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Refusing update from remote peer e260c115ddf045e88e73893d7f8269db: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:45.647215  3383 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01c6742a5e0e4b0eb07abd8f93c2a8fb" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db"
I20260709 12:27:45.647279  3385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f0de7c8efd147bcb0dcec69dd1bc2ab" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e260c115ddf045e88e73893d7f8269db"
I20260709 12:27:45.648847  3759 raft_consensus.cc:2749] T 2f808f4193db4e6eba0ea677944df64d P 65bae5463b17443bb0fa568920a9ca19 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191) with higher term. Message: Invalid argument: T 2f808f4193db4e6eba0ea677944df64d P e260c115ddf045e88e73893d7f8269db [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 65bae5463b17443bb0fa568920a9ca19 for earlier term 3. Current term is 4.
I20260709 12:27:45.660832  3311 raft_consensus.cc:2468] T 71b5bc230abf46069a29bb86e6039a15 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65bae5463b17443bb0fa568920a9ca19 in term 4.
I20260709 12:27:45.649032  3383 raft_consensus.cc:3060] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:27:45.649348  3385 raft_consensus.cc:2368] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P e260c115ddf045e88e73893d7f8269db [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 65bae5463b17443bb0fa568920a9ca19 for earlier term 4. Current term is 5.
I20260709 12:27:45.668175  3200 leader_election.cc:400] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 4 election: Vote denied by peer e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191) with higher term. Message: Invalid argument: T 3f0de7c8efd147bcb0dcec69dd1bc2ab P e260c115ddf045e88e73893d7f8269db [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 65bae5463b17443bb0fa568920a9ca19 for earlier term 4. Current term is 5.
I20260709 12:27:45.668514  3200 leader_election.cc:403] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:27:45.669389  3760 raft_consensus.cc:2749] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191) with higher term. Message: Invalid argument: T 3f0de7c8efd147bcb0dcec69dd1bc2ab P e260c115ddf045e88e73893d7f8269db [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 65bae5463b17443bb0fa568920a9ca19 for earlier term 4. Current term is 5.
I20260709 12:27:45.656030  3708 raft_consensus.cc:697] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P 65bae5463b17443bb0fa568920a9ca19 [term 4 LEADER]: Becoming Leader. State: Replica: 65bae5463b17443bb0fa568920a9ca19, State: Running, Role: LEADER
I20260709 12:27:45.672982  3132 catalog_manager.cc:5697] T 5d25e61c23044d75a5c8fbdca4c23eb2 P 65bae5463b17443bb0fa568920a9ca19 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "65bae5463b17443bb0fa568920a9ca19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:45.657670  3693 consensus_queue.cc:1048] T bfb3537bcd1e40918b030db5bc35117b P e260c115ddf045e88e73893d7f8269db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:45.650605  3351 leader_election.cc:400] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 3 pre-election: Vote denied by peer 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391) with higher term. Message: Invalid argument: T 01c6742a5e0e4b0eb07abd8f93c2a8fb P 65bae5463b17443bb0fa568920a9ca19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e260c115ddf045e88e73893d7f8269db for earlier term 3. Current term is 4.
I20260709 12:27:45.681061  3351 leader_election.cc:403] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:27:45.683625  3724 consensus_queue.cc:1048] T bfdfacb5c8bc4844936c037c39983f24 P e260c115ddf045e88e73893d7f8269db [LEADER]: Connected to new peer: Peer: permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:45.690680  3385 raft_consensus.cc:1275] T 2f808f4193db4e6eba0ea677944df64d P e260c115ddf045e88e73893d7f8269db [term 4 FOLLOWER]: Refusing update from remote peer d31e1edf8df54dd5a75e9fba6cc0a1f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:45.692631  3729 consensus_queue.cc:1048] T 2f808f4193db4e6eba0ea677944df64d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:45.673233  3708 consensus_queue.cc:237] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P 65bae5463b17443bb0fa568920a9ca19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:45.701241  3377 raft_consensus.cc:1275] T c4adb0932a604e779ef3ce9fff0b7bc5 P e260c115ddf045e88e73893d7f8269db [term 4 FOLLOWER]: Refusing update from remote peer 65bae5463b17443bb0fa568920a9ca19: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:27:45.656817  3304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f0de7c8efd147bcb0dcec69dd1bc2ab" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3"
I20260709 12:27:45.702852  3752 consensus_queue.cc:1048] T c4adb0932a604e779ef3ce9fff0b7bc5 P 65bae5463b17443bb0fa568920a9ca19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:27:45.655215  3133 catalog_manager.cc:5697] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "e260c115ddf045e88e73893d7f8269db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:45.717093  3383 raft_consensus.cc:2468] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P e260c115ddf045e88e73893d7f8269db [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65bae5463b17443bb0fa568920a9ca19 in term 4.
I20260709 12:27:45.731679  3761 raft_consensus.cc:2749] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P e260c115ddf045e88e73893d7f8269db [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391) with higher term. Message: Invalid argument: T 01c6742a5e0e4b0eb07abd8f93c2a8fb P 65bae5463b17443bb0fa568920a9ca19 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e260c115ddf045e88e73893d7f8269db for earlier term 3. Current term is 4.
I20260709 12:27:45.735252  3304 raft_consensus.cc:1275] T c4adb0932a604e779ef3ce9fff0b7bc5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 4 FOLLOWER]: Refusing update from remote peer 65bae5463b17443bb0fa568920a9ca19: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:27:45.751582  3752 consensus_queue.cc:1048] T c4adb0932a604e779ef3ce9fff0b7bc5 P 65bae5463b17443bb0fa568920a9ca19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:27:45.778262  3133 catalog_manager.cc:5697] T 3eebe28a0e1b493581b05e588dd920d5 P 65bae5463b17443bb0fa568920a9ca19 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "65bae5463b17443bb0fa568920a9ca19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:45.781373  3133 catalog_manager.cc:5697] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P 65bae5463b17443bb0fa568920a9ca19 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "65bae5463b17443bb0fa568920a9ca19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:45.787111  3133 catalog_manager.cc:5697] T 71b5bc230abf46069a29bb86e6039a15 P 65bae5463b17443bb0fa568920a9ca19 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "65bae5463b17443bb0fa568920a9ca19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:45.791743  3233 raft_consensus.cc:1275] T 2f808f4193db4e6eba0ea677944df64d P 65bae5463b17443bb0fa568920a9ca19 [term 4 FOLLOWER]: Refusing update from remote peer d31e1edf8df54dd5a75e9fba6cc0a1f3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:45.800724  3132 catalog_manager.cc:5697] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e260c115ddf045e88e73893d7f8269db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:45.802937  3719 consensus_queue.cc:1048] T 2f808f4193db4e6eba0ea677944df64d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:46.005316  3383 raft_consensus.cc:1275] T 5d25e61c23044d75a5c8fbdca4c23eb2 P e260c115ddf045e88e73893d7f8269db [term 4 FOLLOWER]: Refusing update from remote peer 65bae5463b17443bb0fa568920a9ca19: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:46.006783  3708 consensus_queue.cc:1048] T 5d25e61c23044d75a5c8fbdca4c23eb2 P 65bae5463b17443bb0fa568920a9ca19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:46.010228  3233 raft_consensus.cc:1275] T 848e8cff9e5b4de6b49a1bd243e9f9aa P 65bae5463b17443bb0fa568920a9ca19 [term 5 FOLLOWER]: Refusing update from remote peer e260c115ddf045e88e73893d7f8269db: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:27:46.013302  3755 consensus_queue.cc:1048] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:46.022444  3311 raft_consensus.cc:1275] T 3eebe28a0e1b493581b05e588dd920d5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Refusing update from remote peer 65bae5463b17443bb0fa568920a9ca19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:46.024490  3708 consensus_queue.cc:1048] T 3eebe28a0e1b493581b05e588dd920d5 P 65bae5463b17443bb0fa568920a9ca19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:46.051345  3385 raft_consensus.cc:1275] T 3eebe28a0e1b493581b05e588dd920d5 P e260c115ddf045e88e73893d7f8269db [term 3 FOLLOWER]: Refusing update from remote peer 65bae5463b17443bb0fa568920a9ca19: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:46.054194  3708 consensus_queue.cc:1048] T 3eebe28a0e1b493581b05e588dd920d5 P 65bae5463b17443bb0fa568920a9ca19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:46.046213 24534 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:27:46.075501  3304 raft_consensus.cc:1275] T 71b5bc230abf46069a29bb86e6039a15 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 4 FOLLOWER]: Refusing update from remote peer 65bae5463b17443bb0fa568920a9ca19: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:46.081341  3754 consensus_queue.cc:1048] T 71b5bc230abf46069a29bb86e6039a15 P 65bae5463b17443bb0fa568920a9ca19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:46.089386  3236 raft_consensus.cc:1275] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19 [term 5 FOLLOWER]: Refusing update from remote peer d31e1edf8df54dd5a75e9fba6cc0a1f3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:27:46.091637  3730 consensus_queue.cc:1048] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:27:46.103987  3232 raft_consensus.cc:1275] T 088188cf28674e1c94310faf6d3f7ff4 P 65bae5463b17443bb0fa568920a9ca19 [term 4 FOLLOWER]: Refusing update from remote peer e260c115ddf045e88e73893d7f8269db: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:46.106209  3761 consensus_queue.cc:1048] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:46.186407  3304 raft_consensus.cc:1275] T 5d25e61c23044d75a5c8fbdca4c23eb2 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 4 FOLLOWER]: Refusing update from remote peer 65bae5463b17443bb0fa568920a9ca19: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:46.188499  3752 consensus_queue.cc:1048] T 5d25e61c23044d75a5c8fbdca4c23eb2 P 65bae5463b17443bb0fa568920a9ca19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:46.193346  3304 raft_consensus.cc:1275] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 4 FOLLOWER]: Refusing update from remote peer 65bae5463b17443bb0fa568920a9ca19: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:27:46.195386  3760 consensus_queue.cc:1048] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P 65bae5463b17443bb0fa568920a9ca19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:27:46.261649  3784 log.cc:927] Time spent T 3eebe28a0e1b493581b05e588dd920d5 P d31e1edf8df54dd5a75e9fba6cc0a1f3: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
I20260709 12:27:46.266086  3304 raft_consensus.cc:1275] T 848e8cff9e5b4de6b49a1bd243e9f9aa P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 5 FOLLOWER]: Refusing update from remote peer e260c115ddf045e88e73893d7f8269db: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:27:46.268182  3385 raft_consensus.cc:1275] T 71b5bc230abf46069a29bb86e6039a15 P e260c115ddf045e88e73893d7f8269db [term 4 FOLLOWER]: Refusing update from remote peer 65bae5463b17443bb0fa568920a9ca19: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:46.269250  3746 consensus_queue.cc:1048] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [LEADER]: Connected to new peer: Peer: permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:46.269785  3757 consensus_queue.cc:1048] T 71b5bc230abf46069a29bb86e6039a15 P 65bae5463b17443bb0fa568920a9ca19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:46.147497 24534 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:27:46.275534 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:27:46.284987  3782 log.cc:927] Time spent T 5d25e61c23044d75a5c8fbdca4c23eb2 P e260c115ddf045e88e73893d7f8269db: Append to log took a long time: real 0.243s	user 0.026s	sys 0.053s
I20260709 12:27:46.286801  3310 raft_consensus.cc:1275] T 088188cf28674e1c94310faf6d3f7ff4 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 4 FOLLOWER]: Refusing update from remote peer e260c115ddf045e88e73893d7f8269db: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:27:46.287317  3783 log.cc:927] Time spent T 848e8cff9e5b4de6b49a1bd243e9f9aa P 65bae5463b17443bb0fa568920a9ca19: Append to log took a long time: real 0.248s	user 0.000s	sys 0.001s
I20260709 12:27:46.288607  3746 consensus_queue.cc:1048] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db [LEADER]: Connected to new peer: Peer: permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:46.358661  3378 raft_consensus.cc:1275] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P e260c115ddf045e88e73893d7f8269db [term 4 FOLLOWER]: Refusing update from remote peer 65bae5463b17443bb0fa568920a9ca19: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:27:46.360841  3797 consensus_queue.cc:1048] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P 65bae5463b17443bb0fa568920a9ca19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:46.339951  3311 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3f0de7c8efd147bcb0dcec69dd1bc2ab"
dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3"
mode: GRACEFUL
new_leader_uuid: "e260c115ddf045e88e73893d7f8269db"
 from {username='slave'} at 127.0.0.1:39646
I20260709 12:27:46.363057  3311 raft_consensus.cc:606] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 5 LEADER]: Received request to transfer leadership to TS e260c115ddf045e88e73893d7f8269db
I20260709 12:27:46.352126  3383 raft_consensus.cc:1275] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P e260c115ddf045e88e73893d7f8269db [term 5 FOLLOWER]: Refusing update from remote peer d31e1edf8df54dd5a75e9fba6cc0a1f3: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:27:46.366462  3311 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f05d1ba2ab1744db8f477c06f30a6887"
dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3"
mode: GRACEFUL
new_leader_uuid: "65bae5463b17443bb0fa568920a9ca19"
 from {username='slave'} at 127.0.0.1:39646
I20260709 12:27:46.366519  3730 consensus_queue.cc:1048] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:27:46.367023  3311 raft_consensus.cc:606] T f05d1ba2ab1744db8f477c06f30a6887 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 LEADER]: Received request to transfer leadership to TS 65bae5463b17443bb0fa568920a9ca19
I20260709 12:27:46.368692 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:27:46.369330 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:27:46.437085  3200 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.23.245.131:37191, user_credentials={real_user=slave}} blocked reactor thread for 47807us
I20260709 12:27:46.474354  3729 raft_consensus.cc:993] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3: : Instructing follower e260c115ddf045e88e73893d7f8269db to start an election
I20260709 12:27:46.474891  3729 raft_consensus.cc:1081] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 5 LEADER]: Signalling peer e260c115ddf045e88e73893d7f8269db to start an election
I20260709 12:27:46.477102  3386 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3f0de7c8efd147bcb0dcec69dd1bc2ab"
dest_uuid: "e260c115ddf045e88e73893d7f8269db"
 from {username='slave'} at 127.0.0.1:52988
I20260709 12:27:46.477739  3386 raft_consensus.cc:493] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P e260c115ddf045e88e73893d7f8269db [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:46.478101  3386 raft_consensus.cc:3060] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P e260c115ddf045e88e73893d7f8269db [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:46.499485  3386 raft_consensus.cc:515] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P e260c115ddf045e88e73893d7f8269db [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:46.522807  3386 leader_election.cc:290] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 6 election: Requested vote from peers 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391), d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915)
I20260709 12:27:46.525235  3236 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f0de7c8efd147bcb0dcec69dd1bc2ab" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "65bae5463b17443bb0fa568920a9ca19"
I20260709 12:27:46.525868  3236 raft_consensus.cc:3060] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:46.536034  3791 raft_consensus.cc:993] T f05d1ba2ab1744db8f477c06f30a6887 P d31e1edf8df54dd5a75e9fba6cc0a1f3: : Instructing follower 65bae5463b17443bb0fa568920a9ca19 to start an election
I20260709 12:27:46.536614  3791 raft_consensus.cc:1081] T f05d1ba2ab1744db8f477c06f30a6887 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 LEADER]: Signalling peer 65bae5463b17443bb0fa568920a9ca19 to start an election
I20260709 12:27:46.538518  3233 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f05d1ba2ab1744db8f477c06f30a6887"
dest_uuid: "65bae5463b17443bb0fa568920a9ca19"
 from {username='slave'} at 127.0.0.1:39500
I20260709 12:27:46.539105  3233 raft_consensus.cc:493] T f05d1ba2ab1744db8f477c06f30a6887 P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:46.539475  3233 raft_consensus.cc:3060] T f05d1ba2ab1744db8f477c06f30a6887 P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:46.547596  3233 raft_consensus.cc:515] T f05d1ba2ab1744db8f477c06f30a6887 P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:46.552408  3305 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f0de7c8efd147bcb0dcec69dd1bc2ab" candidate_uuid: "e260c115ddf045e88e73893d7f8269db" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3"
I20260709 12:27:46.553097  3305 raft_consensus.cc:3055] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:46.553416  3305 raft_consensus.cc:740] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: d31e1edf8df54dd5a75e9fba6cc0a1f3, State: Running, Role: LEADER
I20260709 12:27:46.557826  3236 raft_consensus.cc:2468] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e260c115ddf045e88e73893d7f8269db in term 6.
I20260709 12:27:46.559351  3351 leader_election.cc:304] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P e260c115ddf045e88e73893d7f8269db [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, e260c115ddf045e88e73893d7f8269db; no voters: 
I20260709 12:27:46.560001  3304 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05d1ba2ab1744db8f477c06f30a6887" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3"
I20260709 12:27:46.560601  3304 raft_consensus.cc:3055] T f05d1ba2ab1744db8f477c06f30a6887 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:46.559531  3305 consensus_queue.cc:260] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:46.560921  3304 raft_consensus.cc:740] T f05d1ba2ab1744db8f477c06f30a6887 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d31e1edf8df54dd5a75e9fba6cc0a1f3, State: Running, Role: LEADER
I20260709 12:27:46.561816  3304 consensus_queue.cc:260] T f05d1ba2ab1744db8f477c06f30a6887 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:46.563098  3304 raft_consensus.cc:3060] T f05d1ba2ab1744db8f477c06f30a6887 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:46.564857  3305 raft_consensus.cc:3060] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:46.566104  3746 raft_consensus.cc:2804] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P e260c115ddf045e88e73893d7f8269db [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:46.566664  3746 raft_consensus.cc:697] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P e260c115ddf045e88e73893d7f8269db [term 6 LEADER]: Becoming Leader. State: Replica: e260c115ddf045e88e73893d7f8269db, State: Running, Role: LEADER
I20260709 12:27:46.568120  3386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f05d1ba2ab1744db8f477c06f30a6887" candidate_uuid: "65bae5463b17443bb0fa568920a9ca19" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e260c115ddf045e88e73893d7f8269db"
I20260709 12:27:46.568675  3386 raft_consensus.cc:3060] T f05d1ba2ab1744db8f477c06f30a6887 P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:46.569937  3746 consensus_queue.cc:237] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P e260c115ddf045e88e73893d7f8269db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:46.572048  3305 raft_consensus.cc:2468] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e260c115ddf045e88e73893d7f8269db in term 6.
I20260709 12:27:46.575292  3386 raft_consensus.cc:2468] T f05d1ba2ab1744db8f477c06f30a6887 P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65bae5463b17443bb0fa568920a9ca19 in term 2.
I20260709 12:27:46.576455  3200 leader_election.cc:304] T f05d1ba2ab1744db8f477c06f30a6887 P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 65bae5463b17443bb0fa568920a9ca19, e260c115ddf045e88e73893d7f8269db; no voters: 
I20260709 12:27:46.577239  3808 raft_consensus.cc:2804] T f05d1ba2ab1744db8f477c06f30a6887 P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:46.577739  3808 raft_consensus.cc:697] T f05d1ba2ab1744db8f477c06f30a6887 P 65bae5463b17443bb0fa568920a9ca19 [term 2 LEADER]: Becoming Leader. State: Replica: 65bae5463b17443bb0fa568920a9ca19, State: Running, Role: LEADER
I20260709 12:27:46.578677  3808 consensus_queue.cc:237] T f05d1ba2ab1744db8f477c06f30a6887 P 65bae5463b17443bb0fa568920a9ca19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } }
I20260709 12:27:46.581194  3233 leader_election.cc:290] T f05d1ba2ab1744db8f477c06f30a6887 P 65bae5463b17443bb0fa568920a9ca19 [CANDIDATE]: Term 2 election: Requested vote from peers d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915), e260c115ddf045e88e73893d7f8269db (127.23.245.131:37191)
I20260709 12:27:46.583534  3304 raft_consensus.cc:2468] T f05d1ba2ab1744db8f477c06f30a6887 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65bae5463b17443bb0fa568920a9ca19 in term 2.
I20260709 12:27:46.592617  3131 catalog_manager.cc:5697] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P e260c115ddf045e88e73893d7f8269db reported cstate change: term changed from 5 to 6, leader changed from d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130) to e260c115ddf045e88e73893d7f8269db (127.23.245.131). New cstate: current_term: 6 leader_uuid: "e260c115ddf045e88e73893d7f8269db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:46.594149  3132 catalog_manager.cc:5697] T f05d1ba2ab1744db8f477c06f30a6887 P 65bae5463b17443bb0fa568920a9ca19 reported cstate change: term changed from 1 to 2, leader changed from d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130) to 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129). New cstate: current_term: 2 leader_uuid: "65bae5463b17443bb0fa568920a9ca19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:47.035570  3304 raft_consensus.cc:1275] T f05d1ba2ab1744db8f477c06f30a6887 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Refusing update from remote peer 65bae5463b17443bb0fa568920a9ca19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:47.037235  3808 consensus_queue.cc:1048] T f05d1ba2ab1744db8f477c06f30a6887 P 65bae5463b17443bb0fa568920a9ca19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:47.038070  3236 raft_consensus.cc:1275] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19 [term 6 FOLLOWER]: Refusing update from remote peer e260c115ddf045e88e73893d7f8269db: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:27:47.041003  3746 consensus_queue.cc:1048] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P e260c115ddf045e88e73893d7f8269db [LEADER]: Connected to new peer: Peer: permanent_uuid: "65bae5463b17443bb0fa568920a9ca19" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 44391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:47.061254  3304 raft_consensus.cc:1275] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 6 FOLLOWER]: Refusing update from remote peer e260c115ddf045e88e73893d7f8269db: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:27:47.072171  3761 consensus_queue.cc:1048] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P e260c115ddf045e88e73893d7f8269db [LEADER]: Connected to new peer: Peer: permanent_uuid: "d31e1edf8df54dd5a75e9fba6cc0a1f3" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 44915 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:47.102916  3386 raft_consensus.cc:1275] T f05d1ba2ab1744db8f477c06f30a6887 P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Refusing update from remote peer 65bae5463b17443bb0fa568920a9ca19: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:47.104336  3805 consensus_queue.cc:1048] T f05d1ba2ab1744db8f477c06f30a6887 P 65bae5463b17443bb0fa568920a9ca19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e260c115ddf045e88e73893d7f8269db" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 37191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:47.370537 24534 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:27:47.378762 24534 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:27:47.379365 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:47.387326 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:47.387892 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:48.389039 24534 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:27:48.395795 24534 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:27:48.396390 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:48.401950 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:48.402376 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:49.403307 24534 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:27:49.409336 24534 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:27:49.409759 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:49.414348 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:49.414727 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:50.481602 24534 tablet_server.cc:179] TabletServer@127.23.245.129:0 shutting down...
W20260709 12:27:50.492882  3351 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 3 similar messages]
W20260709 12:27:50.502677  3351 consensus_peers.cc:597] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P e260c115ddf045e88e73893d7f8269db -> Peer 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391): Couldn't send request to peer 65bae5463b17443bb0fa568920a9ca19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:50.505956  3277 consensus_peers.cc:597] T 18abc32bcdc8438d8f5438356c0b68bb P d31e1edf8df54dd5a75e9fba6cc0a1f3 -> Peer 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391): Couldn't send request to peer 65bae5463b17443bb0fa568920a9ca19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:50.522284 24534 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:50.523168 24534 tablet_replica.cc:333] T 66daa0e84b334222ac9af601b6a0a2dc P 65bae5463b17443bb0fa568920a9ca19: stopping tablet replica
I20260709 12:27:50.524231 24534 raft_consensus.cc:2243] T 66daa0e84b334222ac9af601b6a0a2dc P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:50.524991 24534 raft_consensus.cc:2272] T 66daa0e84b334222ac9af601b6a0a2dc P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.528442 24534 tablet_replica.cc:333] T 3ab18fc35bf84fd4876f3c9573c22c0d P 65bae5463b17443bb0fa568920a9ca19: stopping tablet replica
I20260709 12:27:50.529237 24534 raft_consensus.cc:2243] T 3ab18fc35bf84fd4876f3c9573c22c0d P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:50.529709 24534 raft_consensus.cc:2272] T 3ab18fc35bf84fd4876f3c9573c22c0d P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.531788 24534 tablet_replica.cc:333] T 18abc32bcdc8438d8f5438356c0b68bb P 65bae5463b17443bb0fa568920a9ca19: stopping tablet replica
I20260709 12:27:50.532368 24534 raft_consensus.cc:2243] T 18abc32bcdc8438d8f5438356c0b68bb P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:50.532856 24534 raft_consensus.cc:2272] T 18abc32bcdc8438d8f5438356c0b68bb P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.534909 24534 tablet_replica.cc:333] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P 65bae5463b17443bb0fa568920a9ca19: stopping tablet replica
I20260709 12:27:50.535460 24534 raft_consensus.cc:2243] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P 65bae5463b17443bb0fa568920a9ca19 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:27:50.536195 24534 raft_consensus.cc:2272] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P 65bae5463b17443bb0fa568920a9ca19 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.538161 24534 tablet_replica.cc:333] T 848e8cff9e5b4de6b49a1bd243e9f9aa P 65bae5463b17443bb0fa568920a9ca19: stopping tablet replica
I20260709 12:27:50.538672 24534 raft_consensus.cc:2243] T 848e8cff9e5b4de6b49a1bd243e9f9aa P 65bae5463b17443bb0fa568920a9ca19 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:50.539052 24534 raft_consensus.cc:2272] T 848e8cff9e5b4de6b49a1bd243e9f9aa P 65bae5463b17443bb0fa568920a9ca19 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.540974 24534 tablet_replica.cc:333] T 3eebe28a0e1b493581b05e588dd920d5 P 65bae5463b17443bb0fa568920a9ca19: stopping tablet replica
I20260709 12:27:50.541508 24534 raft_consensus.cc:2243] T 3eebe28a0e1b493581b05e588dd920d5 P 65bae5463b17443bb0fa568920a9ca19 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:50.542155 24534 raft_consensus.cc:2272] T 3eebe28a0e1b493581b05e588dd920d5 P 65bae5463b17443bb0fa568920a9ca19 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.544011 24534 tablet_replica.cc:333] T c4adb0932a604e779ef3ce9fff0b7bc5 P 65bae5463b17443bb0fa568920a9ca19: stopping tablet replica
I20260709 12:27:50.544657 24534 raft_consensus.cc:2243] T c4adb0932a604e779ef3ce9fff0b7bc5 P 65bae5463b17443bb0fa568920a9ca19 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:27:50.545409 24534 raft_consensus.cc:2272] T c4adb0932a604e779ef3ce9fff0b7bc5 P 65bae5463b17443bb0fa568920a9ca19 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.547573 24534 tablet_replica.cc:333] T 71b5bc230abf46069a29bb86e6039a15 P 65bae5463b17443bb0fa568920a9ca19: stopping tablet replica
I20260709 12:27:50.548141 24534 raft_consensus.cc:2243] T 71b5bc230abf46069a29bb86e6039a15 P 65bae5463b17443bb0fa568920a9ca19 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:27:50.548866 24534 raft_consensus.cc:2272] T 71b5bc230abf46069a29bb86e6039a15 P 65bae5463b17443bb0fa568920a9ca19 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.550783 24534 tablet_replica.cc:333] T 42f943816e0640d0af646f248f518df5 P 65bae5463b17443bb0fa568920a9ca19: stopping tablet replica
I20260709 12:27:50.551323 24534 raft_consensus.cc:2243] T 42f943816e0640d0af646f248f518df5 P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:50.551854 24534 raft_consensus.cc:2272] T 42f943816e0640d0af646f248f518df5 P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.554400 24534 tablet_replica.cc:333] T 088188cf28674e1c94310faf6d3f7ff4 P 65bae5463b17443bb0fa568920a9ca19: stopping tablet replica
I20260709 12:27:50.555086 24534 raft_consensus.cc:2243] T 088188cf28674e1c94310faf6d3f7ff4 P 65bae5463b17443bb0fa568920a9ca19 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:50.555648 24534 raft_consensus.cc:2272] T 088188cf28674e1c94310faf6d3f7ff4 P 65bae5463b17443bb0fa568920a9ca19 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:50.555552  3277 consensus_peers.cc:597] T 51cd230ca9d6436eafae195975c7b9ce P d31e1edf8df54dd5a75e9fba6cc0a1f3 -> Peer 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391): Couldn't send request to peer 65bae5463b17443bb0fa568920a9ca19. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:50.558035 24534 tablet_replica.cc:333] T 2f808f4193db4e6eba0ea677944df64d P 65bae5463b17443bb0fa568920a9ca19: stopping tablet replica
I20260709 12:27:50.558559 24534 raft_consensus.cc:2243] T 2f808f4193db4e6eba0ea677944df64d P 65bae5463b17443bb0fa568920a9ca19 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:50.558936 24534 raft_consensus.cc:2272] T 2f808f4193db4e6eba0ea677944df64d P 65bae5463b17443bb0fa568920a9ca19 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.561380 24534 tablet_replica.cc:333] T 51cd230ca9d6436eafae195975c7b9ce P 65bae5463b17443bb0fa568920a9ca19: stopping tablet replica
I20260709 12:27:50.561892 24534 raft_consensus.cc:2243] T 51cd230ca9d6436eafae195975c7b9ce P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:50.562390 24534 raft_consensus.cc:2272] T 51cd230ca9d6436eafae195975c7b9ce P 65bae5463b17443bb0fa568920a9ca19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.564591 24534 tablet_replica.cc:333] T bfdfacb5c8bc4844936c037c39983f24 P 65bae5463b17443bb0fa568920a9ca19: stopping tablet replica
I20260709 12:27:50.565155 24534 raft_consensus.cc:2243] T bfdfacb5c8bc4844936c037c39983f24 P 65bae5463b17443bb0fa568920a9ca19 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:50.565567 24534 raft_consensus.cc:2272] T bfdfacb5c8bc4844936c037c39983f24 P 65bae5463b17443bb0fa568920a9ca19 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.567492 24534 tablet_replica.cc:333] T 821be9b5927a481ab065336d9a5c6522 P 65bae5463b17443bb0fa568920a9ca19: stopping tablet replica
I20260709 12:27:50.568014 24534 raft_consensus.cc:2243] T 821be9b5927a481ab065336d9a5c6522 P 65bae5463b17443bb0fa568920a9ca19 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:50.568499 24534 raft_consensus.cc:2272] T 821be9b5927a481ab065336d9a5c6522 P 65bae5463b17443bb0fa568920a9ca19 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.571149 24534 tablet_replica.cc:333] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19: stopping tablet replica
I20260709 12:27:50.571743 24534 raft_consensus.cc:2243] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:50.572293 24534 raft_consensus.cc:2272] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P 65bae5463b17443bb0fa568920a9ca19 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.574291 24534 tablet_replica.cc:333] T bfb3537bcd1e40918b030db5bc35117b P 65bae5463b17443bb0fa568920a9ca19: stopping tablet replica
I20260709 12:27:50.574788 24534 raft_consensus.cc:2243] T bfb3537bcd1e40918b030db5bc35117b P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:50.575194 24534 raft_consensus.cc:2272] T bfb3537bcd1e40918b030db5bc35117b P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.577276 24534 tablet_replica.cc:333] T f05d1ba2ab1744db8f477c06f30a6887 P 65bae5463b17443bb0fa568920a9ca19: stopping tablet replica
I20260709 12:27:50.577745 24534 raft_consensus.cc:2243] T f05d1ba2ab1744db8f477c06f30a6887 P 65bae5463b17443bb0fa568920a9ca19 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:50.578473 24534 raft_consensus.cc:2272] T f05d1ba2ab1744db8f477c06f30a6887 P 65bae5463b17443bb0fa568920a9ca19 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.580502 24534 tablet_replica.cc:333] T 5d25e61c23044d75a5c8fbdca4c23eb2 P 65bae5463b17443bb0fa568920a9ca19: stopping tablet replica
I20260709 12:27:50.580988 24534 raft_consensus.cc:2243] T 5d25e61c23044d75a5c8fbdca4c23eb2 P 65bae5463b17443bb0fa568920a9ca19 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:27:50.581733 24534 raft_consensus.cc:2272] T 5d25e61c23044d75a5c8fbdca4c23eb2 P 65bae5463b17443bb0fa568920a9ca19 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.625238 24534 tablet_server.cc:196] TabletServer@127.23.245.129:0 shutdown complete.
I20260709 12:27:50.661384 24534 tablet_server.cc:179] TabletServer@127.23.245.130:0 shutting down...
I20260709 12:27:50.695122 24534 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:50.695855 24534 tablet_replica.cc:333] T 18abc32bcdc8438d8f5438356c0b68bb P d31e1edf8df54dd5a75e9fba6cc0a1f3: stopping tablet replica
I20260709 12:27:50.696661 24534 raft_consensus.cc:2243] T 18abc32bcdc8438d8f5438356c0b68bb P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:50.697570 24534 raft_consensus.cc:2272] T 18abc32bcdc8438d8f5438356c0b68bb P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.699671 24534 tablet_replica.cc:333] T 66daa0e84b334222ac9af601b6a0a2dc P d31e1edf8df54dd5a75e9fba6cc0a1f3: stopping tablet replica
I20260709 12:27:50.700415 24534 raft_consensus.cc:2243] T 66daa0e84b334222ac9af601b6a0a2dc P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:50.701478 24534 raft_consensus.cc:2272] T 66daa0e84b334222ac9af601b6a0a2dc P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.703970 24534 tablet_replica.cc:333] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P d31e1edf8df54dd5a75e9fba6cc0a1f3: stopping tablet replica
W20260709 12:27:50.704293  3351 consensus_peers.cc:597] T bfdfacb5c8bc4844936c037c39983f24 P e260c115ddf045e88e73893d7f8269db -> Peer d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915): Couldn't send request to peer d31e1edf8df54dd5a75e9fba6cc0a1f3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:50.704546 24534 raft_consensus.cc:2243] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:50.705060 24534 raft_consensus.cc:2272] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.707135 24534 tablet_replica.cc:333] T 3ab18fc35bf84fd4876f3c9573c22c0d P d31e1edf8df54dd5a75e9fba6cc0a1f3: stopping tablet replica
I20260709 12:27:50.707741 24534 raft_consensus.cc:2243] T 3ab18fc35bf84fd4876f3c9573c22c0d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:50.708496 24534 raft_consensus.cc:2272] T 3ab18fc35bf84fd4876f3c9573c22c0d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.710537 24534 tablet_replica.cc:333] T 3eebe28a0e1b493581b05e588dd920d5 P d31e1edf8df54dd5a75e9fba6cc0a1f3: stopping tablet replica
I20260709 12:27:50.711090 24534 raft_consensus.cc:2243] T 3eebe28a0e1b493581b05e588dd920d5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:50.711546 24534 raft_consensus.cc:2272] T 3eebe28a0e1b493581b05e588dd920d5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.713984 24534 tablet_replica.cc:333] T 848e8cff9e5b4de6b49a1bd243e9f9aa P d31e1edf8df54dd5a75e9fba6cc0a1f3: stopping tablet replica
I20260709 12:27:50.714646 24534 raft_consensus.cc:2243] T 848e8cff9e5b4de6b49a1bd243e9f9aa P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:50.715116 24534 raft_consensus.cc:2272] T 848e8cff9e5b4de6b49a1bd243e9f9aa P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:50.717505  3351 consensus_peers.cc:597] T bfb3537bcd1e40918b030db5bc35117b P e260c115ddf045e88e73893d7f8269db -> Peer 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391): Couldn't send request to peer 65bae5463b17443bb0fa568920a9ca19. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:44391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:50.717674 24534 tablet_replica.cc:333] T 088188cf28674e1c94310faf6d3f7ff4 P d31e1edf8df54dd5a75e9fba6cc0a1f3: stopping tablet replica
I20260709 12:27:50.718371 24534 raft_consensus.cc:2243] T 088188cf28674e1c94310faf6d3f7ff4 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:50.718902 24534 raft_consensus.cc:2272] T 088188cf28674e1c94310faf6d3f7ff4 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.720878 24534 tablet_replica.cc:333] T c4adb0932a604e779ef3ce9fff0b7bc5 P d31e1edf8df54dd5a75e9fba6cc0a1f3: stopping tablet replica
I20260709 12:27:50.721443 24534 raft_consensus.cc:2243] T c4adb0932a604e779ef3ce9fff0b7bc5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:50.721884 24534 raft_consensus.cc:2272] T c4adb0932a604e779ef3ce9fff0b7bc5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.723795 24534 tablet_replica.cc:333] T 71b5bc230abf46069a29bb86e6039a15 P d31e1edf8df54dd5a75e9fba6cc0a1f3: stopping tablet replica
I20260709 12:27:50.724462 24534 raft_consensus.cc:2243] T 71b5bc230abf46069a29bb86e6039a15 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:50.724866 24534 raft_consensus.cc:2272] T 71b5bc230abf46069a29bb86e6039a15 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.726789 24534 tablet_replica.cc:333] T 42f943816e0640d0af646f248f518df5 P d31e1edf8df54dd5a75e9fba6cc0a1f3: stopping tablet replica
I20260709 12:27:50.727365 24534 raft_consensus.cc:2243] T 42f943816e0640d0af646f248f518df5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:50.728266 24534 raft_consensus.cc:2272] T 42f943816e0640d0af646f248f518df5 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.730361 24534 tablet_replica.cc:333] T bfdfacb5c8bc4844936c037c39983f24 P d31e1edf8df54dd5a75e9fba6cc0a1f3: stopping tablet replica
I20260709 12:27:50.730907 24534 raft_consensus.cc:2243] T bfdfacb5c8bc4844936c037c39983f24 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:50.731343 24534 raft_consensus.cc:2272] T bfdfacb5c8bc4844936c037c39983f24 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.733342 24534 tablet_replica.cc:333] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3: stopping tablet replica
I20260709 12:27:50.733873 24534 raft_consensus.cc:2243] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:50.734318 24534 raft_consensus.cc:2272] T 821be9b5927a481ab065336d9a5c6522 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.736290 24534 tablet_replica.cc:333] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3: stopping tablet replica
I20260709 12:27:50.736797 24534 raft_consensus.cc:2243] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:50.737197 24534 raft_consensus.cc:2272] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.739128 24534 tablet_replica.cc:333] T 2f808f4193db4e6eba0ea677944df64d P d31e1edf8df54dd5a75e9fba6cc0a1f3: stopping tablet replica
I20260709 12:27:50.739672 24534 raft_consensus.cc:2243] T 2f808f4193db4e6eba0ea677944df64d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:27:50.740502 24534 raft_consensus.cc:2272] T 2f808f4193db4e6eba0ea677944df64d P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.742799 24534 tablet_replica.cc:333] T 51cd230ca9d6436eafae195975c7b9ce P d31e1edf8df54dd5a75e9fba6cc0a1f3: stopping tablet replica
I20260709 12:27:50.743257 24534 raft_consensus.cc:2243] T 51cd230ca9d6436eafae195975c7b9ce P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:50.744007 24534 raft_consensus.cc:2272] T 51cd230ca9d6436eafae195975c7b9ce P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.745998 24534 tablet_replica.cc:333] T bfb3537bcd1e40918b030db5bc35117b P d31e1edf8df54dd5a75e9fba6cc0a1f3: stopping tablet replica
I20260709 12:27:50.746404 24534 raft_consensus.cc:2243] T bfb3537bcd1e40918b030db5bc35117b P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:50.746779 24534 raft_consensus.cc:2272] T bfb3537bcd1e40918b030db5bc35117b P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.748696 24534 tablet_replica.cc:333] T 5d25e61c23044d75a5c8fbdca4c23eb2 P d31e1edf8df54dd5a75e9fba6cc0a1f3: stopping tablet replica
I20260709 12:27:50.749110 24534 raft_consensus.cc:2243] T 5d25e61c23044d75a5c8fbdca4c23eb2 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:50.749475 24534 raft_consensus.cc:2272] T 5d25e61c23044d75a5c8fbdca4c23eb2 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.751288 24534 tablet_replica.cc:333] T f05d1ba2ab1744db8f477c06f30a6887 P d31e1edf8df54dd5a75e9fba6cc0a1f3: stopping tablet replica
I20260709 12:27:50.751695 24534 raft_consensus.cc:2243] T f05d1ba2ab1744db8f477c06f30a6887 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:50.752053 24534 raft_consensus.cc:2272] T f05d1ba2ab1744db8f477c06f30a6887 P d31e1edf8df54dd5a75e9fba6cc0a1f3 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:50.767849  3351 consensus_peers.cc:597] T 821be9b5927a481ab065336d9a5c6522 P e260c115ddf045e88e73893d7f8269db -> Peer 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391): Couldn't send request to peer 65bae5463b17443bb0fa568920a9ca19. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:44391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:50.811187 24534 tablet_server.cc:196] TabletServer@127.23.245.130:0 shutdown complete.
W20260709 12:27:50.822851  3351 consensus_peers.cc:597] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db -> Peer d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915): Couldn't send request to peer d31e1edf8df54dd5a75e9fba6cc0a1f3. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:44915: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:50.838029  3351 consensus_peers.cc:597] T bfdfacb5c8bc4844936c037c39983f24 P e260c115ddf045e88e73893d7f8269db -> Peer 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391): Couldn't send request to peer 65bae5463b17443bb0fa568920a9ca19. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:44391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:50.848146 24534 tablet_server.cc:179] TabletServer@127.23.245.131:0 shutting down...
W20260709 12:27:50.871874  3351 consensus_peers.cc:597] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db -> Peer d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915): Couldn't send request to peer d31e1edf8df54dd5a75e9fba6cc0a1f3. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:44915: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:50.882084 24534 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:50.882951 24534 tablet_replica.cc:333] T 18abc32bcdc8438d8f5438356c0b68bb P e260c115ddf045e88e73893d7f8269db: stopping tablet replica
I20260709 12:27:50.884061 24534 raft_consensus.cc:2243] T 18abc32bcdc8438d8f5438356c0b68bb P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:50.884519 24534 raft_consensus.cc:2272] T 18abc32bcdc8438d8f5438356c0b68bb P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.886540 24534 tablet_replica.cc:333] T 66daa0e84b334222ac9af601b6a0a2dc P e260c115ddf045e88e73893d7f8269db: stopping tablet replica
I20260709 12:27:50.887030 24534 raft_consensus.cc:2243] T 66daa0e84b334222ac9af601b6a0a2dc P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:50.887506 24534 raft_consensus.cc:2272] T 66daa0e84b334222ac9af601b6a0a2dc P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.889518 24534 tablet_replica.cc:333] T 3ab18fc35bf84fd4876f3c9573c22c0d P e260c115ddf045e88e73893d7f8269db: stopping tablet replica
I20260709 12:27:50.890190 24534 raft_consensus.cc:2243] T 3ab18fc35bf84fd4876f3c9573c22c0d P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:50.890632 24534 raft_consensus.cc:2272] T 3ab18fc35bf84fd4876f3c9573c22c0d P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.892978 24534 tablet_replica.cc:333] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P e260c115ddf045e88e73893d7f8269db: stopping tablet replica
I20260709 12:27:50.893535 24534 raft_consensus.cc:2243] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P e260c115ddf045e88e73893d7f8269db [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:50.894008 24534 raft_consensus.cc:2272] T 01c6742a5e0e4b0eb07abd8f93c2a8fb P e260c115ddf045e88e73893d7f8269db [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:50.894130  3351 consensus_peers.cc:597] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db -> Peer 65bae5463b17443bb0fa568920a9ca19 (127.23.245.129:44391): Couldn't send request to peer 65bae5463b17443bb0fa568920a9ca19. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:44391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:50.895851 24534 tablet_replica.cc:333] T 3eebe28a0e1b493581b05e588dd920d5 P e260c115ddf045e88e73893d7f8269db: stopping tablet replica
I20260709 12:27:50.896552 24534 raft_consensus.cc:2243] T 3eebe28a0e1b493581b05e588dd920d5 P e260c115ddf045e88e73893d7f8269db [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:50.896996 24534 raft_consensus.cc:2272] T 3eebe28a0e1b493581b05e588dd920d5 P e260c115ddf045e88e73893d7f8269db [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.898969 24534 tablet_replica.cc:333] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db: stopping tablet replica
I20260709 12:27:50.899771 24534 raft_consensus.cc:2243] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:27:50.900578 24534 raft_consensus.cc:2272] T 848e8cff9e5b4de6b49a1bd243e9f9aa P e260c115ddf045e88e73893d7f8269db [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.902475 24534 tablet_replica.cc:333] T c4adb0932a604e779ef3ce9fff0b7bc5 P e260c115ddf045e88e73893d7f8269db: stopping tablet replica
I20260709 12:27:50.903055 24534 raft_consensus.cc:2243] T c4adb0932a604e779ef3ce9fff0b7bc5 P e260c115ddf045e88e73893d7f8269db [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:50.903512 24534 raft_consensus.cc:2272] T c4adb0932a604e779ef3ce9fff0b7bc5 P e260c115ddf045e88e73893d7f8269db [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.905571 24534 tablet_replica.cc:333] T 71b5bc230abf46069a29bb86e6039a15 P e260c115ddf045e88e73893d7f8269db: stopping tablet replica
I20260709 12:27:50.906124 24534 raft_consensus.cc:2243] T 71b5bc230abf46069a29bb86e6039a15 P e260c115ddf045e88e73893d7f8269db [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:50.906618 24534 raft_consensus.cc:2272] T 71b5bc230abf46069a29bb86e6039a15 P e260c115ddf045e88e73893d7f8269db [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.908896 24534 tablet_replica.cc:333] T 42f943816e0640d0af646f248f518df5 P e260c115ddf045e88e73893d7f8269db: stopping tablet replica
I20260709 12:27:50.909466 24534 raft_consensus.cc:2243] T 42f943816e0640d0af646f248f518df5 P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:50.909955 24534 raft_consensus.cc:2272] T 42f943816e0640d0af646f248f518df5 P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:50.910355  3351 consensus_peers.cc:597] T bfb3537bcd1e40918b030db5bc35117b P e260c115ddf045e88e73893d7f8269db -> Peer d31e1edf8df54dd5a75e9fba6cc0a1f3 (127.23.245.130:44915): Couldn't send request to peer d31e1edf8df54dd5a75e9fba6cc0a1f3. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:44915: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:50.912482 24534 tablet_replica.cc:333] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db: stopping tablet replica
I20260709 12:27:50.913566 24534 raft_consensus.cc:2243] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:27:50.914382 24534 raft_consensus.cc:2272] T 088188cf28674e1c94310faf6d3f7ff4 P e260c115ddf045e88e73893d7f8269db [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.916345 24534 tablet_replica.cc:333] T bfdfacb5c8bc4844936c037c39983f24 P e260c115ddf045e88e73893d7f8269db: stopping tablet replica
I20260709 12:27:50.916903 24534 raft_consensus.cc:2243] T bfdfacb5c8bc4844936c037c39983f24 P e260c115ddf045e88e73893d7f8269db [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:50.917635 24534 raft_consensus.cc:2272] T bfdfacb5c8bc4844936c037c39983f24 P e260c115ddf045e88e73893d7f8269db [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.919420 24534 tablet_replica.cc:333] T 821be9b5927a481ab065336d9a5c6522 P e260c115ddf045e88e73893d7f8269db: stopping tablet replica
I20260709 12:27:50.919871 24534 raft_consensus.cc:2243] T 821be9b5927a481ab065336d9a5c6522 P e260c115ddf045e88e73893d7f8269db [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:27:50.920645 24534 raft_consensus.cc:2272] T 821be9b5927a481ab065336d9a5c6522 P e260c115ddf045e88e73893d7f8269db [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.922392 24534 tablet_replica.cc:333] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P e260c115ddf045e88e73893d7f8269db: stopping tablet replica
I20260709 12:27:50.922849 24534 raft_consensus.cc:2243] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P e260c115ddf045e88e73893d7f8269db [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:27:50.923513 24534 raft_consensus.cc:2272] T 3f0de7c8efd147bcb0dcec69dd1bc2ab P e260c115ddf045e88e73893d7f8269db [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.925413 24534 tablet_replica.cc:333] T 2f808f4193db4e6eba0ea677944df64d P e260c115ddf045e88e73893d7f8269db: stopping tablet replica
I20260709 12:27:50.925866 24534 raft_consensus.cc:2243] T 2f808f4193db4e6eba0ea677944df64d P e260c115ddf045e88e73893d7f8269db [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:50.926240 24534 raft_consensus.cc:2272] T 2f808f4193db4e6eba0ea677944df64d P e260c115ddf045e88e73893d7f8269db [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.928026 24534 tablet_replica.cc:333] T 51cd230ca9d6436eafae195975c7b9ce P e260c115ddf045e88e73893d7f8269db: stopping tablet replica
I20260709 12:27:50.928555 24534 raft_consensus.cc:2243] T 51cd230ca9d6436eafae195975c7b9ce P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:50.928897 24534 raft_consensus.cc:2272] T 51cd230ca9d6436eafae195975c7b9ce P e260c115ddf045e88e73893d7f8269db [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.930730 24534 tablet_replica.cc:333] T bfb3537bcd1e40918b030db5bc35117b P e260c115ddf045e88e73893d7f8269db: stopping tablet replica
I20260709 12:27:50.931146 24534 raft_consensus.cc:2243] T bfb3537bcd1e40918b030db5bc35117b P e260c115ddf045e88e73893d7f8269db [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:50.931799 24534 raft_consensus.cc:2272] T bfb3537bcd1e40918b030db5bc35117b P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.933714 24534 tablet_replica.cc:333] T f05d1ba2ab1744db8f477c06f30a6887 P e260c115ddf045e88e73893d7f8269db: stopping tablet replica
I20260709 12:27:50.934147 24534 raft_consensus.cc:2243] T f05d1ba2ab1744db8f477c06f30a6887 P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:50.934551 24534 raft_consensus.cc:2272] T f05d1ba2ab1744db8f477c06f30a6887 P e260c115ddf045e88e73893d7f8269db [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.936301 24534 tablet_replica.cc:333] T 5d25e61c23044d75a5c8fbdca4c23eb2 P e260c115ddf045e88e73893d7f8269db: stopping tablet replica
I20260709 12:27:50.936724 24534 raft_consensus.cc:2243] T 5d25e61c23044d75a5c8fbdca4c23eb2 P e260c115ddf045e88e73893d7f8269db [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:50.937100 24534 raft_consensus.cc:2272] T 5d25e61c23044d75a5c8fbdca4c23eb2 P e260c115ddf045e88e73893d7f8269db [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.998441 24534 tablet_server.cc:196] TabletServer@127.23.245.131:0 shutdown complete.
I20260709 12:27:51.032371 24534 master.cc:562] Master@127.23.245.190:43735 shutting down...
I20260709 12:27:51.056501 24534 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 59c475b718094d42b6d9bca928db8d52 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:51.057096 24534 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 59c475b718094d42b6d9bca928db8d52 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:51.057430 24534 tablet_replica.cc:333] T 00000000000000000000000000000000 P 59c475b718094d42b6d9bca928db8d52: stopping tablet replica
I20260709 12:27:51.078260 24534 master.cc:584] Master@127.23.245.190:43735 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (22879 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 12:27:51.129379 24534 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.23.245.190:34641
I20260709 12:27:51.130465 24534 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:51.136557  3839 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:51.136854  3842 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:51.136930  3840 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:51.137532 24534 server_base.cc:1061] running on GCE node
I20260709 12:27:51.138686 24534 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:51.138859 24534 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:51.139056 24534 hybrid_clock.cc:648] HybridClock initialized: now 1783600071139026 us; error 0 us; skew 500 ppm
I20260709 12:27:51.139575 24534 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:51.141938 24534 webserver.cc:533] Webserver started at http://127.23.245.190:35265/ using document root <none> and password file <none>
I20260709 12:27:51.142445 24534 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:51.142637 24534 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:51.142936 24534 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:51.144070 24534 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599704270295-24534-0/minicluster-data/master-0-root/instance:
uuid: "f4f33ba8e7c646919d5a390966cdd894"
format_stamp: "Formatted at 2026-07-09 12:27:51 on dist-test-slave-mlt7"
I20260709 12:27:51.148491 24534 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:27:51.151777  3847 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:51.152547 24534 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:27:51.152827 24534 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599704270295-24534-0/minicluster-data/master-0-root
uuid: "f4f33ba8e7c646919d5a390966cdd894"
format_stamp: "Formatted at 2026-07-09 12:27:51 on dist-test-slave-mlt7"
I20260709 12:27:51.153092 24534 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599704270295-24534-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599704270295-24534-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599704270295-24534-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:51.162947 24534 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:51.164209 24534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:51.201225 24534 rpc_server.cc:307] RPC server started. Bound to: 127.23.245.190:34641
I20260709 12:27:51.201344  3898 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.245.190:34641 every 8 connection(s)
I20260709 12:27:51.205152  3899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:51.215585  3899 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4f33ba8e7c646919d5a390966cdd894: Bootstrap starting.
I20260709 12:27:51.220256  3899 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f4f33ba8e7c646919d5a390966cdd894: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:51.224397  3899 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4f33ba8e7c646919d5a390966cdd894: No bootstrap required, opened a new log
I20260709 12:27:51.226450  3899 raft_consensus.cc:359] T 00000000000000000000000000000000 P f4f33ba8e7c646919d5a390966cdd894 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4f33ba8e7c646919d5a390966cdd894" member_type: VOTER }
I20260709 12:27:51.226809  3899 raft_consensus.cc:385] T 00000000000000000000000000000000 P f4f33ba8e7c646919d5a390966cdd894 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:51.226977  3899 raft_consensus.cc:740] T 00000000000000000000000000000000 P f4f33ba8e7c646919d5a390966cdd894 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4f33ba8e7c646919d5a390966cdd894, State: Initialized, Role: FOLLOWER
I20260709 12:27:51.227460  3899 consensus_queue.cc:260] T 00000000000000000000000000000000 P f4f33ba8e7c646919d5a390966cdd894 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4f33ba8e7c646919d5a390966cdd894" member_type: VOTER }
I20260709 12:27:51.227867  3899 raft_consensus.cc:399] T 00000000000000000000000000000000 P f4f33ba8e7c646919d5a390966cdd894 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:27:51.228081  3899 raft_consensus.cc:493] T 00000000000000000000000000000000 P f4f33ba8e7c646919d5a390966cdd894 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:27:51.228288  3899 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f4f33ba8e7c646919d5a390966cdd894 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:51.232713  3899 raft_consensus.cc:515] T 00000000000000000000000000000000 P f4f33ba8e7c646919d5a390966cdd894 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4f33ba8e7c646919d5a390966cdd894" member_type: VOTER }
I20260709 12:27:51.233155  3899 leader_election.cc:304] T 00000000000000000000000000000000 P f4f33ba8e7c646919d5a390966cdd894 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f4f33ba8e7c646919d5a390966cdd894; no voters: 
I20260709 12:27:51.234198  3899 leader_election.cc:290] T 00000000000000000000000000000000 P f4f33ba8e7c646919d5a390966cdd894 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:27:51.234517  3902 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f4f33ba8e7c646919d5a390966cdd894 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:51.235816  3902 raft_consensus.cc:697] T 00000000000000000000000000000000 P f4f33ba8e7c646919d5a390966cdd894 [term 1 LEADER]: Becoming Leader. State: Replica: f4f33ba8e7c646919d5a390966cdd894, State: Running, Role: LEADER
I20260709 12:27:51.236497  3902 consensus_queue.cc:237] T 00000000000000000000000000000000 P f4f33ba8e7c646919d5a390966cdd894 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4f33ba8e7c646919d5a390966cdd894" member_type: VOTER }
I20260709 12:27:51.237216  3899 sys_catalog.cc:565] T 00000000000000000000000000000000 P f4f33ba8e7c646919d5a390966cdd894 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:27:51.241550  3904 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4f33ba8e7c646919d5a390966cdd894 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f4f33ba8e7c646919d5a390966cdd894. Latest consensus state: current_term: 1 leader_uuid: "f4f33ba8e7c646919d5a390966cdd894" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4f33ba8e7c646919d5a390966cdd894" member_type: VOTER } }
I20260709 12:27:51.242172  3903 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4f33ba8e7c646919d5a390966cdd894 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f4f33ba8e7c646919d5a390966cdd894" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f4f33ba8e7c646919d5a390966cdd894" member_type: VOTER } }
I20260709 12:27:51.242369  3904 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4f33ba8e7c646919d5a390966cdd894 [sys.catalog]: This master's current role is: LEADER
I20260709 12:27:51.242730  3903 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4f33ba8e7c646919d5a390966cdd894 [sys.catalog]: This master's current role is: LEADER
I20260709 12:27:51.244288  3908 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:27:51.249477  3908 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:27:51.254210 24534 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:27:51.258033  3908 catalog_manager.cc:1383] Generated new cluster ID: 019b21ff2c934693962e22c31181e4ef
I20260709 12:27:51.258329  3908 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:27:51.296566  3908 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:27:51.297848  3908 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:27:51.309857  3908 catalog_manager.cc:6070] T 00000000000000000000000000000000 P f4f33ba8e7c646919d5a390966cdd894: Generated new TSK 0
I20260709 12:27:51.310506  3908 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:27:51.321352 24534 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:51.327443  3920 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:51.328692  3921 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:51.331637 24534 server_base.cc:1061] running on GCE node
W20260709 12:27:51.331735  3923 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:51.332861 24534 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:51.333091 24534 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:51.333256 24534 hybrid_clock.cc:648] HybridClock initialized: now 1783600071333234 us; error 0 us; skew 500 ppm
I20260709 12:27:51.333741 24534 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:51.335963 24534 webserver.cc:533] Webserver started at http://127.23.245.129:37411/ using document root <none> and password file <none>
I20260709 12:27:51.336428 24534 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:51.336621 24534 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:51.336881 24534 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:51.338013 24534 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599704270295-24534-0/minicluster-data/ts-0-root/instance:
uuid: "e083b2fa907d42b3b33dfba2d9f45240"
format_stamp: "Formatted at 2026-07-09 12:27:51 on dist-test-slave-mlt7"
I20260709 12:27:51.342344 24534 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:27:51.345598  3928 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:51.346427 24534 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:27:51.346707 24534 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599704270295-24534-0/minicluster-data/ts-0-root
uuid: "e083b2fa907d42b3b33dfba2d9f45240"
format_stamp: "Formatted at 2026-07-09 12:27:51 on dist-test-slave-mlt7"
I20260709 12:27:51.346987 24534 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599704270295-24534-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599704270295-24534-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599704270295-24534-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:51.365067 24534 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:51.366271 24534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:51.368007 24534 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:51.370182 24534 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:51.370393 24534 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:51.370632 24534 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:51.370811 24534 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:51.410480 24534 rpc_server.cc:307] RPC server started. Bound to: 127.23.245.129:34229
I20260709 12:27:51.410605  3990 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.245.129:34229 every 8 connection(s)
I20260709 12:27:51.415522 24534 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:51.422857  3995 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:51.425091  3996 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:51.426364  3998 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:51.427244 24534 server_base.cc:1061] running on GCE node
I20260709 12:27:51.428232  3991 heartbeater.cc:344] Connected to a master server at 127.23.245.190:34641
I20260709 12:27:51.428654  3991 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:51.428927 24534 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:51.429199 24534 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:51.429369 24534 hybrid_clock.cc:648] HybridClock initialized: now 1783600071429352 us; error 0 us; skew 500 ppm
I20260709 12:27:51.429445  3991 heartbeater.cc:507] Master 127.23.245.190:34641 requested a full tablet report, sending...
I20260709 12:27:51.429965 24534 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:51.431787  3864 ts_manager.cc:194] Registered new tserver with Master: e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229)
I20260709 12:27:51.432821 24534 webserver.cc:533] Webserver started at http://127.23.245.130:33369/ using document root <none> and password file <none>
I20260709 12:27:51.433530 24534 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:51.433784 24534 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:51.434068 24534 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:51.434322  3864 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51706
I20260709 12:27:51.435663 24534 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599704270295-24534-0/minicluster-data/ts-1-root/instance:
uuid: "ffc6860a7daf42ea871d9389b9fce64a"
format_stamp: "Formatted at 2026-07-09 12:27:51 on dist-test-slave-mlt7"
I20260709 12:27:51.440356 24534 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:27:51.443758  4003 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:51.444528 24534 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:27:51.444823 24534 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599704270295-24534-0/minicluster-data/ts-1-root
uuid: "ffc6860a7daf42ea871d9389b9fce64a"
format_stamp: "Formatted at 2026-07-09 12:27:51 on dist-test-slave-mlt7"
I20260709 12:27:51.445104 24534 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599704270295-24534-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599704270295-24534-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599704270295-24534-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:51.455958 24534 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:51.457109 24534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:51.458529 24534 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:51.460685 24534 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:51.460901 24534 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:51.461128 24534 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:51.461294 24534 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:51.500236 24534 rpc_server.cc:307] RPC server started. Bound to: 127.23.245.130:46493
I20260709 12:27:51.500339  4065 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.245.130:46493 every 8 connection(s)
I20260709 12:27:51.505148 24534 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:51.513455  4070 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:51.514982  4069 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:51.517726  4066 heartbeater.cc:344] Connected to a master server at 127.23.245.190:34641
I20260709 12:27:51.517795 24534 server_base.cc:1061] running on GCE node
I20260709 12:27:51.518261  4066 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:51.519061  4066 heartbeater.cc:507] Master 127.23.245.190:34641 requested a full tablet report, sending...
W20260709 12:27:51.520673  4072 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:51.521206  3864 ts_manager.cc:194] Registered new tserver with Master: ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130:46493)
I20260709 12:27:51.521713 24534 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:51.522018 24534 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:51.522238 24534 hybrid_clock.cc:648] HybridClock initialized: now 1783600071522218 us; error 0 us; skew 500 ppm
I20260709 12:27:51.522974 24534 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:51.523011  3864 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51722
I20260709 12:27:51.525743 24534 webserver.cc:533] Webserver started at http://127.23.245.131:43101/ using document root <none> and password file <none>
I20260709 12:27:51.526212 24534 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:51.526374 24534 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:51.526574 24534 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:51.527648 24534 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599704270295-24534-0/minicluster-data/ts-2-root/instance:
uuid: "e134dafee8df424690057d14e75c2e82"
format_stamp: "Formatted at 2026-07-09 12:27:51 on dist-test-slave-mlt7"
I20260709 12:27:51.532572 24534 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 12:27:51.535667  4077 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:51.536451 24534 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:27:51.536741 24534 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599704270295-24534-0/minicluster-data/ts-2-root
uuid: "e134dafee8df424690057d14e75c2e82"
format_stamp: "Formatted at 2026-07-09 12:27:51 on dist-test-slave-mlt7"
I20260709 12:27:51.537000 24534 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599704270295-24534-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599704270295-24534-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-task0w5XuE/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599704270295-24534-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:51.553723 24534 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:51.554896 24534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:51.556342 24534 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:51.559427 24534 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:51.559716 24534 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:51.560050 24534 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:51.560295 24534 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:51.600838 24534 rpc_server.cc:307] RPC server started. Bound to: 127.23.245.131:36883
I20260709 12:27:51.600939  4139 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.245.131:36883 every 8 connection(s)
I20260709 12:27:51.614106  4140 heartbeater.cc:344] Connected to a master server at 127.23.245.190:34641
I20260709 12:27:51.614516  4140 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:51.615185  4140 heartbeater.cc:507] Master 127.23.245.190:34641 requested a full tablet report, sending...
I20260709 12:27:51.616974  3864 ts_manager.cc:194] Registered new tserver with Master: e134dafee8df424690057d14e75c2e82 (127.23.245.131:36883)
I20260709 12:27:51.617213 24534 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013230374s
I20260709 12:27:51.618832  3864 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51736
I20260709 12:27:51.642124  3864 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51748:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:27:51.644773  3864 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:27:51.725482  4105 tablet_service.cc:1511] Processing CreateTablet for tablet 2256c4cd63e6474aa804844ed7cd18fa (DEFAULT_TABLE table=test-workload [id=6ff03394b61141c193c46a73fc977c88]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:27:51.725983  4104 tablet_service.cc:1511] Processing CreateTablet for tablet 26574dc41db14da1a6bb7492fdbcf01b (DEFAULT_TABLE table=test-workload [id=6ff03394b61141c193c46a73fc977c88]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:27:51.727077  4105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2256c4cd63e6474aa804844ed7cd18fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:51.727253  4103 tablet_service.cc:1511] Processing CreateTablet for tablet 7e083776605c4a658bcca9cb211a4cf6 (DEFAULT_TABLE table=test-workload [id=6ff03394b61141c193c46a73fc977c88]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:27:51.727723  4104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26574dc41db14da1a6bb7492fdbcf01b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:51.728615  4103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e083776605c4a658bcca9cb211a4cf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:51.740352  4031 tablet_service.cc:1511] Processing CreateTablet for tablet 2256c4cd63e6474aa804844ed7cd18fa (DEFAULT_TABLE table=test-workload [id=6ff03394b61141c193c46a73fc977c88]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:27:51.740687  4102 tablet_service.cc:1511] Processing CreateTablet for tablet ccef56abf48c4dd5bbb5bd65364ae3a9 (DEFAULT_TABLE table=test-workload [id=6ff03394b61141c193c46a73fc977c88]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:27:51.741837  4031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2256c4cd63e6474aa804844ed7cd18fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:51.742100  4102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccef56abf48c4dd5bbb5bd65364ae3a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:51.749487  4101 tablet_service.cc:1511] Processing CreateTablet for tablet a7b82f2b2be84e8aad65ee4199ce5224 (DEFAULT_TABLE table=test-workload [id=6ff03394b61141c193c46a73fc977c88]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:27:51.750747  4030 tablet_service.cc:1511] Processing CreateTablet for tablet 26574dc41db14da1a6bb7492fdbcf01b (DEFAULT_TABLE table=test-workload [id=6ff03394b61141c193c46a73fc977c88]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:27:51.751291  4101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7b82f2b2be84e8aad65ee4199ce5224. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:51.751525  4155 tablet_bootstrap.cc:492] T 26574dc41db14da1a6bb7492fdbcf01b P e134dafee8df424690057d14e75c2e82: Bootstrap starting.
I20260709 12:27:51.752188  4030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26574dc41db14da1a6bb7492fdbcf01b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:51.756100  4027 tablet_service.cc:1511] Processing CreateTablet for tablet a7b82f2b2be84e8aad65ee4199ce5224 (DEFAULT_TABLE table=test-workload [id=6ff03394b61141c193c46a73fc977c88]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:27:51.757118  4024 tablet_service.cc:1511] Processing CreateTablet for tablet 018fbc94678e41318e867a918691041b (DEFAULT_TABLE table=test-workload [id=6ff03394b61141c193c46a73fc977c88]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:27:51.756147  4025 tablet_service.cc:1511] Processing CreateTablet for tablet ca9249d3904b4b4580d1c289f923daee (DEFAULT_TABLE table=test-workload [id=6ff03394b61141c193c46a73fc977c88]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:27:51.757601  4027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7b82f2b2be84e8aad65ee4199ce5224. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:51.759364  4028 tablet_service.cc:1511] Processing CreateTablet for tablet ccef56abf48c4dd5bbb5bd65364ae3a9 (DEFAULT_TABLE table=test-workload [id=6ff03394b61141c193c46a73fc977c88]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:27:51.760155  4155 tablet_bootstrap.cc:654] T 26574dc41db14da1a6bb7492fdbcf01b P e134dafee8df424690057d14e75c2e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:51.760334  4025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca9249d3904b4b4580d1c289f923daee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:51.761564  4099 tablet_service.cc:1511] Processing CreateTablet for tablet ca9249d3904b4b4580d1c289f923daee (DEFAULT_TABLE table=test-workload [id=6ff03394b61141c193c46a73fc977c88]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:27:51.761771  3956 tablet_service.cc:1511] Processing CreateTablet for tablet 2256c4cd63e6474aa804844ed7cd18fa (DEFAULT_TABLE table=test-workload [id=6ff03394b61141c193c46a73fc977c88]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:27:51.762910  4099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca9249d3904b4b4580d1c289f923daee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:51.764084  3955 tablet_service.cc:1511] Processing CreateTablet for tablet 26574dc41db14da1a6bb7492fdbcf01b (DEFAULT_TABLE table=test-workload [id=6ff03394b61141c193c46a73fc977c88]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:27:51.765023  4097 tablet_service.cc:1511] Processing CreateTablet for tablet b03341ea7bb64c2085bdecf904d11548 (DEFAULT_TABLE table=test-workload [id=6ff03394b61141c193c46a73fc977c88]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:27:51.766376  3954 tablet_service.cc:1511] Processing CreateTablet for tablet 7e083776605c4a658bcca9cb211a4cf6 (DEFAULT_TABLE table=test-workload [id=6ff03394b61141c193c46a73fc977c88]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:27:51.767349  4100 tablet_service.cc:1511] Processing CreateTablet for tablet 9dccf99aa7894eb5b71293becf61aff1 (DEFAULT_TABLE table=test-workload [id=6ff03394b61141c193c46a73fc977c88]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:27:51.768622  3953 tablet_service.cc:1511] Processing CreateTablet for tablet ccef56abf48c4dd5bbb5bd65364ae3a9 (DEFAULT_TABLE table=test-workload [id=6ff03394b61141c193c46a73fc977c88]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:27:51.769750  4026 tablet_service.cc:1511] Processing CreateTablet for tablet 9dccf99aa7894eb5b71293becf61aff1 (DEFAULT_TABLE table=test-workload [id=6ff03394b61141c193c46a73fc977c88]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:27:51.771175  4026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dccf99aa7894eb5b71293becf61aff1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:51.770903  3952 tablet_service.cc:1511] Processing CreateTablet for tablet a7b82f2b2be84e8aad65ee4199ce5224 (DEFAULT_TABLE table=test-workload [id=6ff03394b61141c193c46a73fc977c88]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:27:51.772406  4098 tablet_service.cc:1511] Processing CreateTablet for tablet 018fbc94678e41318e867a918691041b (DEFAULT_TABLE table=test-workload [id=6ff03394b61141c193c46a73fc977c88]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:27:51.773219  3951 tablet_service.cc:1511] Processing CreateTablet for tablet 9dccf99aa7894eb5b71293becf61aff1 (DEFAULT_TABLE table=test-workload [id=6ff03394b61141c193c46a73fc977c88]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:27:51.774191  4024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 018fbc94678e41318e867a918691041b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:51.775373  3950 tablet_service.cc:1511] Processing CreateTablet for tablet ca9249d3904b4b4580d1c289f923daee (DEFAULT_TABLE table=test-workload [id=6ff03394b61141c193c46a73fc977c88]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:27:51.778870  3949 tablet_service.cc:1511] Processing CreateTablet for tablet 018fbc94678e41318e867a918691041b (DEFAULT_TABLE table=test-workload [id=6ff03394b61141c193c46a73fc977c88]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:27:51.780942  4028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccef56abf48c4dd5bbb5bd65364ae3a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:51.781603  3948 tablet_service.cc:1511] Processing CreateTablet for tablet b03341ea7bb64c2085bdecf904d11548 (DEFAULT_TABLE table=test-workload [id=6ff03394b61141c193c46a73fc977c88]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:27:51.754125  4029 tablet_service.cc:1511] Processing CreateTablet for tablet 7e083776605c4a658bcca9cb211a4cf6 (DEFAULT_TABLE table=test-workload [id=6ff03394b61141c193c46a73fc977c88]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:27:51.783649  4029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e083776605c4a658bcca9cb211a4cf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:51.762910  3956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2256c4cd63e6474aa804844ed7cd18fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:51.788321  3950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca9249d3904b4b4580d1c289f923daee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:51.790761  3948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b03341ea7bb64c2085bdecf904d11548. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:51.792721  3953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccef56abf48c4dd5bbb5bd65364ae3a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:51.797778  3954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e083776605c4a658bcca9cb211a4cf6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:51.766391  4097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b03341ea7bb64c2085bdecf904d11548. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:51.804261  3951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dccf99aa7894eb5b71293becf61aff1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:51.804718  4023 tablet_service.cc:1511] Processing CreateTablet for tablet b03341ea7bb64c2085bdecf904d11548 (DEFAULT_TABLE table=test-workload [id=6ff03394b61141c193c46a73fc977c88]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:27:51.806149  4023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b03341ea7bb64c2085bdecf904d11548. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:51.810915  3949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 018fbc94678e41318e867a918691041b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:51.812387  3952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7b82f2b2be84e8aad65ee4199ce5224. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:51.815557  3955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26574dc41db14da1a6bb7492fdbcf01b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:51.816250  4098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 018fbc94678e41318e867a918691041b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:51.828293  4100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dccf99aa7894eb5b71293becf61aff1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:51.869272  4155 tablet_bootstrap.cc:492] T 26574dc41db14da1a6bb7492fdbcf01b P e134dafee8df424690057d14e75c2e82: No bootstrap required, opened a new log
I20260709 12:27:51.869930  4155 ts_tablet_manager.cc:1403] T 26574dc41db14da1a6bb7492fdbcf01b P e134dafee8df424690057d14e75c2e82: Time spent bootstrapping tablet: real 0.119s	user 0.012s	sys 0.029s
I20260709 12:27:51.876669  4157 tablet_bootstrap.cc:492] T ca9249d3904b4b4580d1c289f923daee P ffc6860a7daf42ea871d9389b9fce64a: Bootstrap starting.
I20260709 12:27:51.890599  4155 raft_consensus.cc:359] T 26574dc41db14da1a6bb7492fdbcf01b P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:51.891450  4155 raft_consensus.cc:385] T 26574dc41db14da1a6bb7492fdbcf01b P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:51.891798  4155 raft_consensus.cc:740] T 26574dc41db14da1a6bb7492fdbcf01b P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e134dafee8df424690057d14e75c2e82, State: Initialized, Role: FOLLOWER
I20260709 12:27:51.899572  4157 tablet_bootstrap.cc:654] T ca9249d3904b4b4580d1c289f923daee P ffc6860a7daf42ea871d9389b9fce64a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:51.904258  4155 consensus_queue.cc:260] T 26574dc41db14da1a6bb7492fdbcf01b P e134dafee8df424690057d14e75c2e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:51.913072  4158 tablet_bootstrap.cc:492] T 26574dc41db14da1a6bb7492fdbcf01b P e083b2fa907d42b3b33dfba2d9f45240: Bootstrap starting.
I20260709 12:27:51.919469  4140 heartbeater.cc:499] Master 127.23.245.190:34641 was elected leader, sending a full tablet report...
I20260709 12:27:51.922371  4158 tablet_bootstrap.cc:654] T 26574dc41db14da1a6bb7492fdbcf01b P e083b2fa907d42b3b33dfba2d9f45240: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:51.933444  4155 ts_tablet_manager.cc:1434] T 26574dc41db14da1a6bb7492fdbcf01b P e134dafee8df424690057d14e75c2e82: Time spent starting tablet: real 0.063s	user 0.009s	sys 0.000s
I20260709 12:27:51.934614  4155 tablet_bootstrap.cc:492] T 7e083776605c4a658bcca9cb211a4cf6 P e134dafee8df424690057d14e75c2e82: Bootstrap starting.
I20260709 12:27:51.941798  4155 tablet_bootstrap.cc:654] T 7e083776605c4a658bcca9cb211a4cf6 P e134dafee8df424690057d14e75c2e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:51.941790  4158 tablet_bootstrap.cc:492] T 26574dc41db14da1a6bb7492fdbcf01b P e083b2fa907d42b3b33dfba2d9f45240: No bootstrap required, opened a new log
I20260709 12:27:51.942555  4158 ts_tablet_manager.cc:1403] T 26574dc41db14da1a6bb7492fdbcf01b P e083b2fa907d42b3b33dfba2d9f45240: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.015s
I20260709 12:27:51.944747  4157 tablet_bootstrap.cc:492] T ca9249d3904b4b4580d1c289f923daee P ffc6860a7daf42ea871d9389b9fce64a: No bootstrap required, opened a new log
I20260709 12:27:51.945622  4157 ts_tablet_manager.cc:1403] T ca9249d3904b4b4580d1c289f923daee P ffc6860a7daf42ea871d9389b9fce64a: Time spent bootstrapping tablet: real 0.069s	user 0.016s	sys 0.000s
I20260709 12:27:51.945977  4158 raft_consensus.cc:359] T 26574dc41db14da1a6bb7492fdbcf01b P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:51.946910  4158 raft_consensus.cc:385] T 26574dc41db14da1a6bb7492fdbcf01b P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:51.947245  4158 raft_consensus.cc:740] T 26574dc41db14da1a6bb7492fdbcf01b P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e083b2fa907d42b3b33dfba2d9f45240, State: Initialized, Role: FOLLOWER
I20260709 12:27:51.950141  4157 raft_consensus.cc:359] T ca9249d3904b4b4580d1c289f923daee P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:51.950867  4157 raft_consensus.cc:385] T ca9249d3904b4b4580d1c289f923daee P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:51.951131  4157 raft_consensus.cc:740] T ca9249d3904b4b4580d1c289f923daee P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffc6860a7daf42ea871d9389b9fce64a, State: Initialized, Role: FOLLOWER
I20260709 12:27:51.951889  4157 consensus_queue.cc:260] T ca9249d3904b4b4580d1c289f923daee P ffc6860a7daf42ea871d9389b9fce64a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:51.952921  4155 tablet_bootstrap.cc:492] T 7e083776605c4a658bcca9cb211a4cf6 P e134dafee8df424690057d14e75c2e82: No bootstrap required, opened a new log
I20260709 12:27:51.952745  4158 consensus_queue.cc:260] T 26574dc41db14da1a6bb7492fdbcf01b P e083b2fa907d42b3b33dfba2d9f45240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:51.953598  4155 ts_tablet_manager.cc:1403] T 7e083776605c4a658bcca9cb211a4cf6 P e134dafee8df424690057d14e75c2e82: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.003s
I20260709 12:27:51.953811  4163 raft_consensus.cc:493] T 26574dc41db14da1a6bb7492fdbcf01b P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:51.954836  4163 raft_consensus.cc:515] T 26574dc41db14da1a6bb7492fdbcf01b P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:51.958611  4163 leader_election.cc:290] T 26574dc41db14da1a6bb7492fdbcf01b P e083b2fa907d42b3b33dfba2d9f45240 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130:46493), e134dafee8df424690057d14e75c2e82 (127.23.245.131:36883)
I20260709 12:27:51.959980  3991 heartbeater.cc:499] Master 127.23.245.190:34641 was elected leader, sending a full tablet report...
I20260709 12:27:51.962366  4158 ts_tablet_manager.cc:1434] T 26574dc41db14da1a6bb7492fdbcf01b P e083b2fa907d42b3b33dfba2d9f45240: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.015s
I20260709 12:27:51.963662  4158 tablet_bootstrap.cc:492] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e083b2fa907d42b3b33dfba2d9f45240: Bootstrap starting.
I20260709 12:27:51.957540  4155 raft_consensus.cc:359] T 7e083776605c4a658bcca9cb211a4cf6 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:51.966562  4155 raft_consensus.cc:385] T 7e083776605c4a658bcca9cb211a4cf6 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:51.967002  4155 raft_consensus.cc:740] T 7e083776605c4a658bcca9cb211a4cf6 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e134dafee8df424690057d14e75c2e82, State: Initialized, Role: FOLLOWER
I20260709 12:27:51.968024  4155 consensus_queue.cc:260] T 7e083776605c4a658bcca9cb211a4cf6 P e134dafee8df424690057d14e75c2e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:51.970983  4155 ts_tablet_manager.cc:1434] T 7e083776605c4a658bcca9cb211a4cf6 P e134dafee8df424690057d14e75c2e82: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:27:51.972353  4155 tablet_bootstrap.cc:492] T b03341ea7bb64c2085bdecf904d11548 P e134dafee8df424690057d14e75c2e82: Bootstrap starting.
I20260709 12:27:51.973366  4159 raft_consensus.cc:493] T 26574dc41db14da1a6bb7492fdbcf01b P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:51.973965  4159 raft_consensus.cc:515] T 26574dc41db14da1a6bb7492fdbcf01b P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:51.979700  4066 heartbeater.cc:499] Master 127.23.245.190:34641 was elected leader, sending a full tablet report...
I20260709 12:27:51.980221  4157 ts_tablet_manager.cc:1434] T ca9249d3904b4b4580d1c289f923daee P ffc6860a7daf42ea871d9389b9fce64a: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.024s
I20260709 12:27:51.981992  4157 tablet_bootstrap.cc:492] T a7b82f2b2be84e8aad65ee4199ce5224 P ffc6860a7daf42ea871d9389b9fce64a: Bootstrap starting.
I20260709 12:27:51.984946  4155 tablet_bootstrap.cc:654] T b03341ea7bb64c2085bdecf904d11548 P e134dafee8df424690057d14e75c2e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:51.988723  4157 tablet_bootstrap.cc:654] T a7b82f2b2be84e8aad65ee4199ce5224 P ffc6860a7daf42ea871d9389b9fce64a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:51.998211  4159 leader_election.cc:290] T 26574dc41db14da1a6bb7492fdbcf01b P e134dafee8df424690057d14e75c2e82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229), ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130:46493)
I20260709 12:27:51.999471  4155 tablet_bootstrap.cc:492] T b03341ea7bb64c2085bdecf904d11548 P e134dafee8df424690057d14e75c2e82: No bootstrap required, opened a new log
I20260709 12:27:52.000109  4155 ts_tablet_manager.cc:1403] T b03341ea7bb64c2085bdecf904d11548 P e134dafee8df424690057d14e75c2e82: Time spent bootstrapping tablet: real 0.028s	user 0.016s	sys 0.004s
I20260709 12:27:52.003276  4155 raft_consensus.cc:359] T b03341ea7bb64c2085bdecf904d11548 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.004148  4155 raft_consensus.cc:385] T b03341ea7bb64c2085bdecf904d11548 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:52.004451  4155 raft_consensus.cc:740] T b03341ea7bb64c2085bdecf904d11548 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e134dafee8df424690057d14e75c2e82, State: Initialized, Role: FOLLOWER
I20260709 12:27:52.005311  4157 tablet_bootstrap.cc:492] T a7b82f2b2be84e8aad65ee4199ce5224 P ffc6860a7daf42ea871d9389b9fce64a: No bootstrap required, opened a new log
I20260709 12:27:52.005159  4155 consensus_queue.cc:260] T b03341ea7bb64c2085bdecf904d11548 P e134dafee8df424690057d14e75c2e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.005889  4157 ts_tablet_manager.cc:1403] T a7b82f2b2be84e8aad65ee4199ce5224 P ffc6860a7daf42ea871d9389b9fce64a: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.006s
I20260709 12:27:52.008327  4158 tablet_bootstrap.cc:654] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e083b2fa907d42b3b33dfba2d9f45240: Neither blocks nor log segments found. Creating new log.
W20260709 12:27:52.008643  4067 tablet.cc:2406] T ca9249d3904b4b4580d1c289f923daee P ffc6860a7daf42ea871d9389b9fce64a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:27:52.009052  4157 raft_consensus.cc:359] T a7b82f2b2be84e8aad65ee4199ce5224 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.009846  4157 raft_consensus.cc:385] T a7b82f2b2be84e8aad65ee4199ce5224 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:52.010164  4157 raft_consensus.cc:740] T a7b82f2b2be84e8aad65ee4199ce5224 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffc6860a7daf42ea871d9389b9fce64a, State: Initialized, Role: FOLLOWER
I20260709 12:27:52.010388  4155 ts_tablet_manager.cc:1434] T b03341ea7bb64c2085bdecf904d11548 P e134dafee8df424690057d14e75c2e82: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:27:52.011528  4155 tablet_bootstrap.cc:492] T a7b82f2b2be84e8aad65ee4199ce5224 P e134dafee8df424690057d14e75c2e82: Bootstrap starting.
I20260709 12:27:52.013418  4164 raft_consensus.cc:493] T ca9249d3904b4b4580d1c289f923daee P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.014074  4164 raft_consensus.cc:515] T ca9249d3904b4b4580d1c289f923daee P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.017433  4157 consensus_queue.cc:260] T a7b82f2b2be84e8aad65ee4199ce5224 P ffc6860a7daf42ea871d9389b9fce64a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.018182  4155 tablet_bootstrap.cc:654] T a7b82f2b2be84e8aad65ee4199ce5224 P e134dafee8df424690057d14e75c2e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:52.021464  4159 raft_consensus.cc:493] T 7e083776605c4a658bcca9cb211a4cf6 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.022066  4159 raft_consensus.cc:515] T 7e083776605c4a658bcca9cb211a4cf6 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.023226  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26574dc41db14da1a6bb7492fdbcf01b" candidate_uuid: "e134dafee8df424690057d14e75c2e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffc6860a7daf42ea871d9389b9fce64a" is_pre_election: true
I20260709 12:27:52.025089  4159 leader_election.cc:290] T 7e083776605c4a658bcca9cb211a4cf6 P e134dafee8df424690057d14e75c2e82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229), ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130:46493)
I20260709 12:27:52.026091  4157 ts_tablet_manager.cc:1434] T a7b82f2b2be84e8aad65ee4199ce5224 P ffc6860a7daf42ea871d9389b9fce64a: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.005s
I20260709 12:27:52.027563  4157 tablet_bootstrap.cc:492] T 2256c4cd63e6474aa804844ed7cd18fa P ffc6860a7daf42ea871d9389b9fce64a: Bootstrap starting.
I20260709 12:27:52.028802  4164 leader_election.cc:290] T ca9249d3904b4b4580d1c289f923daee P ffc6860a7daf42ea871d9389b9fce64a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229), e134dafee8df424690057d14e75c2e82 (127.23.245.131:36883)
I20260709 12:27:52.032590  4155 tablet_bootstrap.cc:492] T a7b82f2b2be84e8aad65ee4199ce5224 P e134dafee8df424690057d14e75c2e82: No bootstrap required, opened a new log
I20260709 12:27:52.033172  4155 ts_tablet_manager.cc:1403] T a7b82f2b2be84e8aad65ee4199ce5224 P e134dafee8df424690057d14e75c2e82: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.003s
I20260709 12:27:52.034631  4157 tablet_bootstrap.cc:654] T 2256c4cd63e6474aa804844ed7cd18fa P ffc6860a7daf42ea871d9389b9fce64a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:52.036746  4155 raft_consensus.cc:359] T a7b82f2b2be84e8aad65ee4199ce5224 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.037571  4155 raft_consensus.cc:385] T a7b82f2b2be84e8aad65ee4199ce5224 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:52.038066  4155 raft_consensus.cc:740] T a7b82f2b2be84e8aad65ee4199ce5224 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e134dafee8df424690057d14e75c2e82, State: Initialized, Role: FOLLOWER
I20260709 12:27:52.039523  4155 consensus_queue.cc:260] T a7b82f2b2be84e8aad65ee4199ce5224 P e134dafee8df424690057d14e75c2e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.043071  4155 ts_tablet_manager.cc:1434] T a7b82f2b2be84e8aad65ee4199ce5224 P e134dafee8df424690057d14e75c2e82: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
W20260709 12:27:52.046149  4079 leader_election.cc:343] T 26574dc41db14da1a6bb7492fdbcf01b P e134dafee8df424690057d14e75c2e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130:46493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:52.046250  4155 tablet_bootstrap.cc:492] T ca9249d3904b4b4580d1c289f923daee P e134dafee8df424690057d14e75c2e82: Bootstrap starting.
I20260709 12:27:52.046248  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e083776605c4a658bcca9cb211a4cf6" candidate_uuid: "e134dafee8df424690057d14e75c2e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffc6860a7daf42ea871d9389b9fce64a" is_pre_election: true
W20260709 12:27:52.048673  4079 leader_election.cc:343] T 7e083776605c4a658bcca9cb211a4cf6 P e134dafee8df424690057d14e75c2e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130:46493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:52.050925  4157 tablet_bootstrap.cc:492] T 2256c4cd63e6474aa804844ed7cd18fa P ffc6860a7daf42ea871d9389b9fce64a: No bootstrap required, opened a new log
I20260709 12:27:52.051719  4157 ts_tablet_manager.cc:1403] T 2256c4cd63e6474aa804844ed7cd18fa P ffc6860a7daf42ea871d9389b9fce64a: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.003s
I20260709 12:27:52.055698  4157 raft_consensus.cc:359] T 2256c4cd63e6474aa804844ed7cd18fa P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } } peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } }
I20260709 12:27:52.064832  4157 raft_consensus.cc:385] T 2256c4cd63e6474aa804844ed7cd18fa P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:52.065261  4157 raft_consensus.cc:740] T 2256c4cd63e6474aa804844ed7cd18fa P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffc6860a7daf42ea871d9389b9fce64a, State: Initialized, Role: FOLLOWER
I20260709 12:27:52.064999  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26574dc41db14da1a6bb7492fdbcf01b" candidate_uuid: "e083b2fa907d42b3b33dfba2d9f45240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffc6860a7daf42ea871d9389b9fce64a" is_pre_election: true
I20260709 12:27:52.066547  4157 consensus_queue.cc:260] T 2256c4cd63e6474aa804844ed7cd18fa P ffc6860a7daf42ea871d9389b9fce64a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } } peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } }
W20260709 12:27:52.068037  3930 leader_election.cc:343] T 26574dc41db14da1a6bb7492fdbcf01b P e083b2fa907d42b3b33dfba2d9f45240 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130:46493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:52.068598  4157 ts_tablet_manager.cc:1434] T 2256c4cd63e6474aa804844ed7cd18fa P ffc6860a7daf42ea871d9389b9fce64a: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:27:52.069600  4157 tablet_bootstrap.cc:492] T 26574dc41db14da1a6bb7492fdbcf01b P ffc6860a7daf42ea871d9389b9fce64a: Bootstrap starting.
I20260709 12:27:52.073426  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26574dc41db14da1a6bb7492fdbcf01b" candidate_uuid: "e083b2fa907d42b3b33dfba2d9f45240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e134dafee8df424690057d14e75c2e82" is_pre_election: true
I20260709 12:27:52.074198  4115 raft_consensus.cc:2468] T 26574dc41db14da1a6bb7492fdbcf01b P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e083b2fa907d42b3b33dfba2d9f45240 in term 0.
I20260709 12:27:52.054195  4155 tablet_bootstrap.cc:654] T ca9249d3904b4b4580d1c289f923daee P e134dafee8df424690057d14e75c2e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:52.077335  3930 leader_election.cc:304] T 26574dc41db14da1a6bb7492fdbcf01b P e083b2fa907d42b3b33dfba2d9f45240 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e083b2fa907d42b3b33dfba2d9f45240, e134dafee8df424690057d14e75c2e82; no voters: ffc6860a7daf42ea871d9389b9fce64a
I20260709 12:27:52.079181  4163 raft_consensus.cc:2804] T 26574dc41db14da1a6bb7492fdbcf01b P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:52.079603  4163 raft_consensus.cc:493] T 26574dc41db14da1a6bb7492fdbcf01b P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:52.080000  4163 raft_consensus.cc:3060] T 26574dc41db14da1a6bb7492fdbcf01b P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:52.077826  4157 tablet_bootstrap.cc:654] T 26574dc41db14da1a6bb7492fdbcf01b P ffc6860a7daf42ea871d9389b9fce64a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:52.078439  4158 tablet_bootstrap.cc:492] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e083b2fa907d42b3b33dfba2d9f45240: No bootstrap required, opened a new log
I20260709 12:27:52.084122  4158 ts_tablet_manager.cc:1403] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e083b2fa907d42b3b33dfba2d9f45240: Time spent bootstrapping tablet: real 0.121s	user 0.022s	sys 0.012s
I20260709 12:27:52.084439  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26574dc41db14da1a6bb7492fdbcf01b" candidate_uuid: "e134dafee8df424690057d14e75c2e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e083b2fa907d42b3b33dfba2d9f45240" is_pre_election: true
I20260709 12:27:52.085748  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e083776605c4a658bcca9cb211a4cf6" candidate_uuid: "e134dafee8df424690057d14e75c2e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e083b2fa907d42b3b33dfba2d9f45240" is_pre_election: true
I20260709 12:27:52.087299  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9249d3904b4b4580d1c289f923daee" candidate_uuid: "ffc6860a7daf42ea871d9389b9fce64a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e083b2fa907d42b3b33dfba2d9f45240" is_pre_election: true
I20260709 12:27:52.088277  4158 raft_consensus.cc:359] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
W20260709 12:27:52.088765  4081 leader_election.cc:343] T 7e083776605c4a658bcca9cb211a4cf6 P e134dafee8df424690057d14e75c2e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:52.089109  4158 raft_consensus.cc:385] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:52.089499  4158 raft_consensus.cc:740] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e083b2fa907d42b3b33dfba2d9f45240, State: Initialized, Role: FOLLOWER
I20260709 12:27:52.089380  4081 leader_election.cc:304] T 7e083776605c4a658bcca9cb211a4cf6 P e134dafee8df424690057d14e75c2e82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e134dafee8df424690057d14e75c2e82; no voters: e083b2fa907d42b3b33dfba2d9f45240, ffc6860a7daf42ea871d9389b9fce64a
I20260709 12:27:52.090737  4157 tablet_bootstrap.cc:492] T 26574dc41db14da1a6bb7492fdbcf01b P ffc6860a7daf42ea871d9389b9fce64a: No bootstrap required, opened a new log
I20260709 12:27:52.090447  4158 consensus_queue.cc:260] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e083b2fa907d42b3b33dfba2d9f45240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.090831  4155 tablet_bootstrap.cc:492] T ca9249d3904b4b4580d1c289f923daee P e134dafee8df424690057d14e75c2e82: No bootstrap required, opened a new log
I20260709 12:27:52.090756  4159 raft_consensus.cc:2749] T 7e083776605c4a658bcca9cb211a4cf6 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:52.091365  4157 ts_tablet_manager.cc:1403] T 26574dc41db14da1a6bb7492fdbcf01b P ffc6860a7daf42ea871d9389b9fce64a: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.001s
I20260709 12:27:52.091622  4155 ts_tablet_manager.cc:1403] T ca9249d3904b4b4580d1c289f923daee P e134dafee8df424690057d14e75c2e82: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.011s
W20260709 12:27:52.092697  4007 leader_election.cc:343] T ca9249d3904b4b4580d1c289f923daee P ffc6860a7daf42ea871d9389b9fce64a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:52.092906  4158 ts_tablet_manager.cc:1434] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e083b2fa907d42b3b33dfba2d9f45240: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:27:52.094275  4158 tablet_bootstrap.cc:492] T a7b82f2b2be84e8aad65ee4199ce5224 P e083b2fa907d42b3b33dfba2d9f45240: Bootstrap starting.
I20260709 12:27:52.094496  4157 raft_consensus.cc:359] T 26574dc41db14da1a6bb7492fdbcf01b P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.095247  4157 raft_consensus.cc:385] T 26574dc41db14da1a6bb7492fdbcf01b P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:52.094972  4155 raft_consensus.cc:359] T ca9249d3904b4b4580d1c289f923daee P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.095603  4157 raft_consensus.cc:740] T 26574dc41db14da1a6bb7492fdbcf01b P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffc6860a7daf42ea871d9389b9fce64a, State: Initialized, Role: FOLLOWER
I20260709 12:27:52.095929  4155 raft_consensus.cc:385] T ca9249d3904b4b4580d1c289f923daee P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:52.096297  4155 raft_consensus.cc:740] T ca9249d3904b4b4580d1c289f923daee P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e134dafee8df424690057d14e75c2e82, State: Initialized, Role: FOLLOWER
I20260709 12:27:52.096417  4157 consensus_queue.cc:260] T 26574dc41db14da1a6bb7492fdbcf01b P ffc6860a7daf42ea871d9389b9fce64a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.097199  4155 consensus_queue.cc:260] T ca9249d3904b4b4580d1c289f923daee P e134dafee8df424690057d14e75c2e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.098795  4157 ts_tablet_manager.cc:1434] T 26574dc41db14da1a6bb7492fdbcf01b P ffc6860a7daf42ea871d9389b9fce64a: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:27:52.099706  4155 ts_tablet_manager.cc:1434] T ca9249d3904b4b4580d1c289f923daee P e134dafee8df424690057d14e75c2e82: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 12:27:52.099882  4157 tablet_bootstrap.cc:492] T 9dccf99aa7894eb5b71293becf61aff1 P ffc6860a7daf42ea871d9389b9fce64a: Bootstrap starting.
I20260709 12:27:52.100888  4155 tablet_bootstrap.cc:492] T 2256c4cd63e6474aa804844ed7cd18fa P e134dafee8df424690057d14e75c2e82: Bootstrap starting.
I20260709 12:27:52.103423  4159 raft_consensus.cc:493] T ca9249d3904b4b4580d1c289f923daee P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.104053  4159 raft_consensus.cc:515] T ca9249d3904b4b4580d1c289f923daee P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.104481  4163 raft_consensus.cc:515] T 26574dc41db14da1a6bb7492fdbcf01b P e083b2fa907d42b3b33dfba2d9f45240 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.106900  4157 tablet_bootstrap.cc:654] T 9dccf99aa7894eb5b71293becf61aff1 P ffc6860a7daf42ea871d9389b9fce64a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:52.107263  3966 raft_consensus.cc:2393] T 26574dc41db14da1a6bb7492fdbcf01b P e083b2fa907d42b3b33dfba2d9f45240 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e134dafee8df424690057d14e75c2e82 in current term 1: Already voted for candidate e083b2fa907d42b3b33dfba2d9f45240 in this term.
I20260709 12:27:52.107744  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26574dc41db14da1a6bb7492fdbcf01b" candidate_uuid: "e083b2fa907d42b3b33dfba2d9f45240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffc6860a7daf42ea871d9389b9fce64a"
I20260709 12:27:52.108421  4041 raft_consensus.cc:3060] T 26574dc41db14da1a6bb7492fdbcf01b P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:52.111059  4155 tablet_bootstrap.cc:654] T 2256c4cd63e6474aa804844ed7cd18fa P e134dafee8df424690057d14e75c2e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:52.111617  4159 leader_election.cc:290] T ca9249d3904b4b4580d1c289f923daee P e134dafee8df424690057d14e75c2e82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229), ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130:46493)
I20260709 12:27:52.111631  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9249d3904b4b4580d1c289f923daee" candidate_uuid: "e134dafee8df424690057d14e75c2e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffc6860a7daf42ea871d9389b9fce64a" is_pre_election: true
I20260709 12:27:52.112802  4040 raft_consensus.cc:2468] T ca9249d3904b4b4580d1c289f923daee P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e134dafee8df424690057d14e75c2e82 in term 0.
I20260709 12:27:52.114553  4079 leader_election.cc:304] T ca9249d3904b4b4580d1c289f923daee P e134dafee8df424690057d14e75c2e82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e134dafee8df424690057d14e75c2e82, ffc6860a7daf42ea871d9389b9fce64a; no voters: 
I20260709 12:27:52.116600  4158 tablet_bootstrap.cc:654] T a7b82f2b2be84e8aad65ee4199ce5224 P e083b2fa907d42b3b33dfba2d9f45240: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:52.118923  4081 leader_election.cc:304] T 26574dc41db14da1a6bb7492fdbcf01b P e134dafee8df424690057d14e75c2e82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e134dafee8df424690057d14e75c2e82; no voters: e083b2fa907d42b3b33dfba2d9f45240, ffc6860a7daf42ea871d9389b9fce64a
I20260709 12:27:52.119877  4159 raft_consensus.cc:2804] T ca9249d3904b4b4580d1c289f923daee P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:52.120559  4159 raft_consensus.cc:493] T ca9249d3904b4b4580d1c289f923daee P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:52.121075  4159 raft_consensus.cc:3060] T ca9249d3904b4b4580d1c289f923daee P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:52.120926  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9249d3904b4b4580d1c289f923daee" candidate_uuid: "e134dafee8df424690057d14e75c2e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e083b2fa907d42b3b33dfba2d9f45240" is_pre_election: true
I20260709 12:27:52.134378  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26574dc41db14da1a6bb7492fdbcf01b" candidate_uuid: "e083b2fa907d42b3b33dfba2d9f45240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e134dafee8df424690057d14e75c2e82"
I20260709 12:27:52.135326  4115 raft_consensus.cc:3060] T 26574dc41db14da1a6bb7492fdbcf01b P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:52.141471  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9249d3904b4b4580d1c289f923daee" candidate_uuid: "ffc6860a7daf42ea871d9389b9fce64a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e134dafee8df424690057d14e75c2e82" is_pre_election: true
I20260709 12:27:52.146210  4163 leader_election.cc:290] T 26574dc41db14da1a6bb7492fdbcf01b P e083b2fa907d42b3b33dfba2d9f45240 [CANDIDATE]: Term 1 election: Requested vote from peers ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130:46493), e134dafee8df424690057d14e75c2e82 (127.23.245.131:36883)
I20260709 12:27:52.154515  4041 raft_consensus.cc:2468] T 26574dc41db14da1a6bb7492fdbcf01b P ffc6860a7daf42ea871d9389b9fce64a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e083b2fa907d42b3b33dfba2d9f45240 in term 1.
I20260709 12:27:52.159696  4115 raft_consensus.cc:2468] T 26574dc41db14da1a6bb7492fdbcf01b P e134dafee8df424690057d14e75c2e82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e083b2fa907d42b3b33dfba2d9f45240 in term 1.
I20260709 12:27:52.162779  4182 raft_consensus.cc:2749] T 26574dc41db14da1a6bb7492fdbcf01b P e134dafee8df424690057d14e75c2e82 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:52.163940  4155 tablet_bootstrap.cc:492] T 2256c4cd63e6474aa804844ed7cd18fa P e134dafee8df424690057d14e75c2e82: No bootstrap required, opened a new log
I20260709 12:27:52.164527  4155 ts_tablet_manager.cc:1403] T 2256c4cd63e6474aa804844ed7cd18fa P e134dafee8df424690057d14e75c2e82: Time spent bootstrapping tablet: real 0.064s	user 0.024s	sys 0.030s
I20260709 12:27:52.166960  4158 tablet_bootstrap.cc:492] T a7b82f2b2be84e8aad65ee4199ce5224 P e083b2fa907d42b3b33dfba2d9f45240: No bootstrap required, opened a new log
I20260709 12:27:52.167492  4158 ts_tablet_manager.cc:1403] T a7b82f2b2be84e8aad65ee4199ce5224 P e083b2fa907d42b3b33dfba2d9f45240: Time spent bootstrapping tablet: real 0.073s	user 0.015s	sys 0.005s
I20260709 12:27:52.167850  4155 raft_consensus.cc:359] T 2256c4cd63e6474aa804844ed7cd18fa P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } } peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } }
I20260709 12:27:52.168686  4155 raft_consensus.cc:385] T 2256c4cd63e6474aa804844ed7cd18fa P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:52.168964  4155 raft_consensus.cc:740] T 2256c4cd63e6474aa804844ed7cd18fa P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e134dafee8df424690057d14e75c2e82, State: Initialized, Role: FOLLOWER
I20260709 12:27:52.169685  4155 consensus_queue.cc:260] T 2256c4cd63e6474aa804844ed7cd18fa P e134dafee8df424690057d14e75c2e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } } peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } }
W20260709 12:27:52.170944  4081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.23.245.129:34229, user_credentials={real_user=slave}} blocked reactor thread for 52151.8us
W20260709 12:27:52.171893  4081 leader_election.cc:343] T ca9249d3904b4b4580d1c289f923daee P e134dafee8df424690057d14e75c2e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:52.172060  4155 ts_tablet_manager.cc:1434] T 2256c4cd63e6474aa804844ed7cd18fa P e134dafee8df424690057d14e75c2e82: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 12:27:52.173136  4155 tablet_bootstrap.cc:492] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e134dafee8df424690057d14e75c2e82: Bootstrap starting.
I20260709 12:27:52.173501  3930 leader_election.cc:304] T 26574dc41db14da1a6bb7492fdbcf01b P e083b2fa907d42b3b33dfba2d9f45240 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e083b2fa907d42b3b33dfba2d9f45240, ffc6860a7daf42ea871d9389b9fce64a; no voters: 
I20260709 12:27:52.173802  4158 raft_consensus.cc:359] T a7b82f2b2be84e8aad65ee4199ce5224 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.174610  4158 raft_consensus.cc:385] T a7b82f2b2be84e8aad65ee4199ce5224 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:52.174904  4158 raft_consensus.cc:740] T a7b82f2b2be84e8aad65ee4199ce5224 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e083b2fa907d42b3b33dfba2d9f45240, State: Initialized, Role: FOLLOWER
I20260709 12:27:52.175628  4163 raft_consensus.cc:2804] T 26574dc41db14da1a6bb7492fdbcf01b P e083b2fa907d42b3b33dfba2d9f45240 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:52.175810  4158 consensus_queue.cc:260] T a7b82f2b2be84e8aad65ee4199ce5224 P e083b2fa907d42b3b33dfba2d9f45240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.176786  4163 raft_consensus.cc:697] T 26574dc41db14da1a6bb7492fdbcf01b P e083b2fa907d42b3b33dfba2d9f45240 [term 1 LEADER]: Becoming Leader. State: Replica: e083b2fa907d42b3b33dfba2d9f45240, State: Running, Role: LEADER
I20260709 12:27:52.178561  4158 ts_tablet_manager.cc:1434] T a7b82f2b2be84e8aad65ee4199ce5224 P e083b2fa907d42b3b33dfba2d9f45240: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 12:27:52.178694  4164 raft_consensus.cc:493] T 2256c4cd63e6474aa804844ed7cd18fa P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.179648  4158 tablet_bootstrap.cc:492] T 2256c4cd63e6474aa804844ed7cd18fa P e083b2fa907d42b3b33dfba2d9f45240: Bootstrap starting.
I20260709 12:27:52.179401  4164 raft_consensus.cc:515] T 2256c4cd63e6474aa804844ed7cd18fa P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } } peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } }
I20260709 12:27:52.181221  4155 tablet_bootstrap.cc:654] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e134dafee8df424690057d14e75c2e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:52.183656  4164 leader_election.cc:290] T 2256c4cd63e6474aa804844ed7cd18fa P ffc6860a7daf42ea871d9389b9fce64a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e134dafee8df424690057d14e75c2e82 (127.23.245.131:36883), e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229)
I20260709 12:27:52.184443  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2256c4cd63e6474aa804844ed7cd18fa" candidate_uuid: "ffc6860a7daf42ea871d9389b9fce64a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e134dafee8df424690057d14e75c2e82" is_pre_election: true
I20260709 12:27:52.185388  4115 raft_consensus.cc:2468] T 2256c4cd63e6474aa804844ed7cd18fa P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ffc6860a7daf42ea871d9389b9fce64a in term 0.
I20260709 12:27:52.178061  4163 consensus_queue.cc:237] T 26574dc41db14da1a6bb7492fdbcf01b P e083b2fa907d42b3b33dfba2d9f45240 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.186851  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2256c4cd63e6474aa804844ed7cd18fa" candidate_uuid: "ffc6860a7daf42ea871d9389b9fce64a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e083b2fa907d42b3b33dfba2d9f45240" is_pre_election: true
I20260709 12:27:52.189543  4005 leader_election.cc:304] T 2256c4cd63e6474aa804844ed7cd18fa P ffc6860a7daf42ea871d9389b9fce64a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e134dafee8df424690057d14e75c2e82, ffc6860a7daf42ea871d9389b9fce64a; no voters: 
I20260709 12:27:52.191193  4164 raft_consensus.cc:2804] T 2256c4cd63e6474aa804844ed7cd18fa P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:27:52.191154  4007 leader_election.cc:343] T 2256c4cd63e6474aa804844ed7cd18fa P ffc6860a7daf42ea871d9389b9fce64a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:52.191854  4164 raft_consensus.cc:493] T 2256c4cd63e6474aa804844ed7cd18fa P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:52.192260  4164 raft_consensus.cc:3060] T 2256c4cd63e6474aa804844ed7cd18fa P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:52.193043  4155 tablet_bootstrap.cc:492] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e134dafee8df424690057d14e75c2e82: No bootstrap required, opened a new log
I20260709 12:27:52.193562  4155 ts_tablet_manager.cc:1403] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e134dafee8df424690057d14e75c2e82: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.006s
I20260709 12:27:52.196630  4155 raft_consensus.cc:359] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.197360  4155 raft_consensus.cc:385] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:52.197661  4155 raft_consensus.cc:740] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e134dafee8df424690057d14e75c2e82, State: Initialized, Role: FOLLOWER
I20260709 12:27:52.198451  4155 consensus_queue.cc:260] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e134dafee8df424690057d14e75c2e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.200911  4155 ts_tablet_manager.cc:1434] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e134dafee8df424690057d14e75c2e82: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 12:27:52.200611  4164 raft_consensus.cc:515] T 2256c4cd63e6474aa804844ed7cd18fa P ffc6860a7daf42ea871d9389b9fce64a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } } peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } }
I20260709 12:27:52.202764  4164 leader_election.cc:290] T 2256c4cd63e6474aa804844ed7cd18fa P ffc6860a7daf42ea871d9389b9fce64a [CANDIDATE]: Term 1 election: Requested vote from peers e134dafee8df424690057d14e75c2e82 (127.23.245.131:36883), e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229)
I20260709 12:27:52.203287  4158 tablet_bootstrap.cc:654] T 2256c4cd63e6474aa804844ed7cd18fa P e083b2fa907d42b3b33dfba2d9f45240: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:52.203771  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2256c4cd63e6474aa804844ed7cd18fa" candidate_uuid: "ffc6860a7daf42ea871d9389b9fce64a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e134dafee8df424690057d14e75c2e82"
I20260709 12:27:52.204419  4115 raft_consensus.cc:3060] T 2256c4cd63e6474aa804844ed7cd18fa P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:52.204792  4159 raft_consensus.cc:515] T ca9249d3904b4b4580d1c289f923daee P e134dafee8df424690057d14e75c2e82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.205464  4155 tablet_bootstrap.cc:492] T 9dccf99aa7894eb5b71293becf61aff1 P e134dafee8df424690057d14e75c2e82: Bootstrap starting.
I20260709 12:27:52.206579  4114 raft_consensus.cc:2393] T ca9249d3904b4b4580d1c289f923daee P e134dafee8df424690057d14e75c2e82 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ffc6860a7daf42ea871d9389b9fce64a in current term 1: Already voted for candidate e134dafee8df424690057d14e75c2e82 in this term.
I20260709 12:27:52.212347  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2256c4cd63e6474aa804844ed7cd18fa" candidate_uuid: "ffc6860a7daf42ea871d9389b9fce64a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e083b2fa907d42b3b33dfba2d9f45240"
I20260709 12:27:52.213076  4155 tablet_bootstrap.cc:654] T 9dccf99aa7894eb5b71293becf61aff1 P e134dafee8df424690057d14e75c2e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:52.213315  4005 leader_election.cc:304] T ca9249d3904b4b4580d1c289f923daee P ffc6860a7daf42ea871d9389b9fce64a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ffc6860a7daf42ea871d9389b9fce64a; no voters: e083b2fa907d42b3b33dfba2d9f45240, e134dafee8df424690057d14e75c2e82
W20260709 12:27:52.214038  4007 leader_election.cc:343] T 2256c4cd63e6474aa804844ed7cd18fa P ffc6860a7daf42ea871d9389b9fce64a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:52.215054  4164 raft_consensus.cc:3060] T ca9249d3904b4b4580d1c289f923daee P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:52.218415  4158 tablet_bootstrap.cc:492] T 2256c4cd63e6474aa804844ed7cd18fa P e083b2fa907d42b3b33dfba2d9f45240: No bootstrap required, opened a new log
I20260709 12:27:52.215451  4115 raft_consensus.cc:2468] T 2256c4cd63e6474aa804844ed7cd18fa P e134dafee8df424690057d14e75c2e82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffc6860a7daf42ea871d9389b9fce64a in term 1.
I20260709 12:27:52.218851  4155 tablet_bootstrap.cc:492] T 9dccf99aa7894eb5b71293becf61aff1 P e134dafee8df424690057d14e75c2e82: No bootstrap required, opened a new log
I20260709 12:27:52.220729  4155 ts_tablet_manager.cc:1403] T 9dccf99aa7894eb5b71293becf61aff1 P e134dafee8df424690057d14e75c2e82: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.004s
I20260709 12:27:52.221455  4158 ts_tablet_manager.cc:1403] T 2256c4cd63e6474aa804844ed7cd18fa P e083b2fa907d42b3b33dfba2d9f45240: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.003s
I20260709 12:27:52.221220  4005 leader_election.cc:304] T 2256c4cd63e6474aa804844ed7cd18fa P ffc6860a7daf42ea871d9389b9fce64a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e134dafee8df424690057d14e75c2e82, ffc6860a7daf42ea871d9389b9fce64a; no voters: e083b2fa907d42b3b33dfba2d9f45240
I20260709 12:27:52.222496  4171 raft_consensus.cc:2804] T 2256c4cd63e6474aa804844ed7cd18fa P ffc6860a7daf42ea871d9389b9fce64a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:52.223418  4155 raft_consensus.cc:359] T 9dccf99aa7894eb5b71293becf61aff1 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.224197  4155 raft_consensus.cc:385] T 9dccf99aa7894eb5b71293becf61aff1 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:52.224509  4155 raft_consensus.cc:740] T 9dccf99aa7894eb5b71293becf61aff1 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e134dafee8df424690057d14e75c2e82, State: Initialized, Role: FOLLOWER
I20260709 12:27:52.225338  4155 consensus_queue.cc:260] T 9dccf99aa7894eb5b71293becf61aff1 P e134dafee8df424690057d14e75c2e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.225483  4158 raft_consensus.cc:359] T 2256c4cd63e6474aa804844ed7cd18fa P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } } peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } }
I20260709 12:27:52.226547  4158 raft_consensus.cc:385] T 2256c4cd63e6474aa804844ed7cd18fa P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:52.226943  4158 raft_consensus.cc:740] T 2256c4cd63e6474aa804844ed7cd18fa P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e083b2fa907d42b3b33dfba2d9f45240, State: Initialized, Role: FOLLOWER
I20260709 12:27:52.227689  4155 ts_tablet_manager.cc:1434] T 9dccf99aa7894eb5b71293becf61aff1 P e134dafee8df424690057d14e75c2e82: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:27:52.228785  4155 tablet_bootstrap.cc:492] T 018fbc94678e41318e867a918691041b P e134dafee8df424690057d14e75c2e82: Bootstrap starting.
I20260709 12:27:52.232044  4158 consensus_queue.cc:260] T 2256c4cd63e6474aa804844ed7cd18fa P e083b2fa907d42b3b33dfba2d9f45240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } } peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } }
I20260709 12:27:52.234483  4155 tablet_bootstrap.cc:654] T 018fbc94678e41318e867a918691041b P e134dafee8df424690057d14e75c2e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:52.234802  4158 ts_tablet_manager.cc:1434] T 2256c4cd63e6474aa804844ed7cd18fa P e083b2fa907d42b3b33dfba2d9f45240: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:27:52.236614  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9249d3904b4b4580d1c289f923daee" candidate_uuid: "e134dafee8df424690057d14e75c2e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e083b2fa907d42b3b33dfba2d9f45240"
W20260709 12:27:52.238260  4081 leader_election.cc:343] T ca9249d3904b4b4580d1c289f923daee P e134dafee8df424690057d14e75c2e82 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:52.238337  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9249d3904b4b4580d1c289f923daee" candidate_uuid: "e134dafee8df424690057d14e75c2e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffc6860a7daf42ea871d9389b9fce64a"
I20260709 12:27:52.239070  4158 tablet_bootstrap.cc:492] T 9dccf99aa7894eb5b71293becf61aff1 P e083b2fa907d42b3b33dfba2d9f45240: Bootstrap starting.
I20260709 12:27:52.240285  4171 raft_consensus.cc:697] T 2256c4cd63e6474aa804844ed7cd18fa P ffc6860a7daf42ea871d9389b9fce64a [term 1 LEADER]: Becoming Leader. State: Replica: ffc6860a7daf42ea871d9389b9fce64a, State: Running, Role: LEADER
I20260709 12:27:52.241291  4171 consensus_queue.cc:237] T 2256c4cd63e6474aa804844ed7cd18fa P ffc6860a7daf42ea871d9389b9fce64a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } } peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } }
I20260709 12:27:52.236877  4159 leader_election.cc:290] T ca9249d3904b4b4580d1c289f923daee P e134dafee8df424690057d14e75c2e82 [CANDIDATE]: Term 1 election: Requested vote from peers e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229), ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130:46493)
I20260709 12:27:52.247511  4157 tablet_bootstrap.cc:492] T 9dccf99aa7894eb5b71293becf61aff1 P ffc6860a7daf42ea871d9389b9fce64a: No bootstrap required, opened a new log
I20260709 12:27:52.248311  4157 ts_tablet_manager.cc:1403] T 9dccf99aa7894eb5b71293becf61aff1 P ffc6860a7daf42ea871d9389b9fce64a: Time spent bootstrapping tablet: real 0.149s	user 0.055s	sys 0.059s
W20260709 12:27:52.249248  3912 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:52.250443  4155 tablet_bootstrap.cc:492] T 018fbc94678e41318e867a918691041b P e134dafee8df424690057d14e75c2e82: No bootstrap required, opened a new log
I20260709 12:27:52.251093  4155 ts_tablet_manager.cc:1403] T 018fbc94678e41318e867a918691041b P e134dafee8df424690057d14e75c2e82: Time spent bootstrapping tablet: real 0.023s	user 0.019s	sys 0.000s
I20260709 12:27:52.251303  4158 tablet_bootstrap.cc:654] T 9dccf99aa7894eb5b71293becf61aff1 P e083b2fa907d42b3b33dfba2d9f45240: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:52.251379  4157 raft_consensus.cc:359] T 9dccf99aa7894eb5b71293becf61aff1 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.252288  4157 raft_consensus.cc:385] T 9dccf99aa7894eb5b71293becf61aff1 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:52.252606  4157 raft_consensus.cc:740] T 9dccf99aa7894eb5b71293becf61aff1 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffc6860a7daf42ea871d9389b9fce64a, State: Initialized, Role: FOLLOWER
I20260709 12:27:52.253386  4157 consensus_queue.cc:260] T 9dccf99aa7894eb5b71293becf61aff1 P ffc6860a7daf42ea871d9389b9fce64a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.254115  4155 raft_consensus.cc:359] T 018fbc94678e41318e867a918691041b P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.254824  4155 raft_consensus.cc:385] T 018fbc94678e41318e867a918691041b P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:52.255106  4155 raft_consensus.cc:740] T 018fbc94678e41318e867a918691041b P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e134dafee8df424690057d14e75c2e82, State: Initialized, Role: FOLLOWER
I20260709 12:27:52.255815  4155 consensus_queue.cc:260] T 018fbc94678e41318e867a918691041b P e134dafee8df424690057d14e75c2e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.256547  4157 ts_tablet_manager.cc:1434] T 9dccf99aa7894eb5b71293becf61aff1 P ffc6860a7daf42ea871d9389b9fce64a: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:27:52.257862  4155 ts_tablet_manager.cc:1434] T 018fbc94678e41318e867a918691041b P e134dafee8df424690057d14e75c2e82: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:27:52.259439  4157 tablet_bootstrap.cc:492] T ccef56abf48c4dd5bbb5bd65364ae3a9 P ffc6860a7daf42ea871d9389b9fce64a: Bootstrap starting.
I20260709 12:27:52.264360  4164 raft_consensus.cc:2749] T ca9249d3904b4b4580d1c289f923daee P ffc6860a7daf42ea871d9389b9fce64a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:52.265837  3864 catalog_manager.cc:5697] T 26574dc41db14da1a6bb7492fdbcf01b P e083b2fa907d42b3b33dfba2d9f45240 reported cstate change: term changed from 0 to 1, leader changed from <none> to e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129). New cstate: current_term: 1 leader_uuid: "e083b2fa907d42b3b33dfba2d9f45240" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:52.267784  4159 raft_consensus.cc:493] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.268359  4159 raft_consensus.cc:515] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.270135  3861 catalog_manager.cc:5697] T 2256c4cd63e6474aa804844ed7cd18fa P ffc6860a7daf42ea871d9389b9fce64a reported cstate change: term changed from 0 to 1, leader changed from <none> to ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130). New cstate: current_term: 1 leader_uuid: "ffc6860a7daf42ea871d9389b9fce64a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:52.272601  4157 tablet_bootstrap.cc:654] T ccef56abf48c4dd5bbb5bd65364ae3a9 P ffc6860a7daf42ea871d9389b9fce64a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:52.273936  4041 raft_consensus.cc:2468] T ca9249d3904b4b4580d1c289f923daee P ffc6860a7daf42ea871d9389b9fce64a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e134dafee8df424690057d14e75c2e82 in term 1.
I20260709 12:27:52.276105  4079 leader_election.cc:304] T ca9249d3904b4b4580d1c289f923daee P e134dafee8df424690057d14e75c2e82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e134dafee8df424690057d14e75c2e82, ffc6860a7daf42ea871d9389b9fce64a; no voters: e083b2fa907d42b3b33dfba2d9f45240
I20260709 12:27:52.277499  4182 raft_consensus.cc:2804] T ca9249d3904b4b4580d1c289f923daee P e134dafee8df424690057d14e75c2e82 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:52.278293  4157 tablet_bootstrap.cc:492] T ccef56abf48c4dd5bbb5bd65364ae3a9 P ffc6860a7daf42ea871d9389b9fce64a: No bootstrap required, opened a new log
I20260709 12:27:52.279032  4157 ts_tablet_manager.cc:1403] T ccef56abf48c4dd5bbb5bd65364ae3a9 P ffc6860a7daf42ea871d9389b9fce64a: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.002s
I20260709 12:27:52.279074  4164 raft_consensus.cc:493] T a7b82f2b2be84e8aad65ee4199ce5224 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.279791  4164 raft_consensus.cc:515] T a7b82f2b2be84e8aad65ee4199ce5224 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.282886  4157 raft_consensus.cc:359] T ccef56abf48c4dd5bbb5bd65364ae3a9 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.283406  4164 leader_election.cc:290] T a7b82f2b2be84e8aad65ee4199ce5224 P ffc6860a7daf42ea871d9389b9fce64a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229), e134dafee8df424690057d14e75c2e82 (127.23.245.131:36883)
I20260709 12:27:52.283903  4157 raft_consensus.cc:385] T ccef56abf48c4dd5bbb5bd65364ae3a9 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:52.283716  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7b82f2b2be84e8aad65ee4199ce5224" candidate_uuid: "ffc6860a7daf42ea871d9389b9fce64a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e083b2fa907d42b3b33dfba2d9f45240" is_pre_election: true
I20260709 12:27:52.284303  4182 raft_consensus.cc:697] T ca9249d3904b4b4580d1c289f923daee P e134dafee8df424690057d14e75c2e82 [term 1 LEADER]: Becoming Leader. State: Replica: e134dafee8df424690057d14e75c2e82, State: Running, Role: LEADER
I20260709 12:27:52.284672  3966 raft_consensus.cc:2468] T a7b82f2b2be84e8aad65ee4199ce5224 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ffc6860a7daf42ea871d9389b9fce64a in term 0.
I20260709 12:27:52.284721  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7b82f2b2be84e8aad65ee4199ce5224" candidate_uuid: "ffc6860a7daf42ea871d9389b9fce64a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e134dafee8df424690057d14e75c2e82" is_pre_election: true
I20260709 12:27:52.285530  4115 raft_consensus.cc:2468] T a7b82f2b2be84e8aad65ee4199ce5224 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ffc6860a7daf42ea871d9389b9fce64a in term 0.
I20260709 12:27:52.285585  4182 consensus_queue.cc:237] T ca9249d3904b4b4580d1c289f923daee P e134dafee8df424690057d14e75c2e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.286330  4007 leader_election.cc:304] T a7b82f2b2be84e8aad65ee4199ce5224 P ffc6860a7daf42ea871d9389b9fce64a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e083b2fa907d42b3b33dfba2d9f45240, ffc6860a7daf42ea871d9389b9fce64a; no voters: 
I20260709 12:27:52.287392  4164 raft_consensus.cc:2804] T a7b82f2b2be84e8aad65ee4199ce5224 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:52.287746  4164 raft_consensus.cc:493] T a7b82f2b2be84e8aad65ee4199ce5224 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:52.288094  4164 raft_consensus.cc:3060] T a7b82f2b2be84e8aad65ee4199ce5224 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:52.288120  4157 raft_consensus.cc:740] T ccef56abf48c4dd5bbb5bd65364ae3a9 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffc6860a7daf42ea871d9389b9fce64a, State: Initialized, Role: FOLLOWER
I20260709 12:27:52.289175  4194 raft_consensus.cc:493] T b03341ea7bb64c2085bdecf904d11548 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.289587  4157 consensus_queue.cc:260] T ccef56abf48c4dd5bbb5bd65364ae3a9 P ffc6860a7daf42ea871d9389b9fce64a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.289801  4194 raft_consensus.cc:515] T b03341ea7bb64c2085bdecf904d11548 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.292809  4157 ts_tablet_manager.cc:1434] T ccef56abf48c4dd5bbb5bd65364ae3a9 P ffc6860a7daf42ea871d9389b9fce64a: Time spent starting tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 12:27:52.294092  4157 tablet_bootstrap.cc:492] T 7e083776605c4a658bcca9cb211a4cf6 P ffc6860a7daf42ea871d9389b9fce64a: Bootstrap starting.
I20260709 12:27:52.294598  4194 leader_election.cc:290] T b03341ea7bb64c2085bdecf904d11548 P e134dafee8df424690057d14e75c2e82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229), ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130:46493)
I20260709 12:27:52.295145  4194 raft_consensus.cc:493] T 9dccf99aa7894eb5b71293becf61aff1 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.295581  4194 raft_consensus.cc:515] T 9dccf99aa7894eb5b71293becf61aff1 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.296881  4164 raft_consensus.cc:515] T a7b82f2b2be84e8aad65ee4199ce5224 P ffc6860a7daf42ea871d9389b9fce64a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.297986  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03341ea7bb64c2085bdecf904d11548" candidate_uuid: "e134dafee8df424690057d14e75c2e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e083b2fa907d42b3b33dfba2d9f45240" is_pre_election: true
I20260709 12:27:52.299342  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dccf99aa7894eb5b71293becf61aff1" candidate_uuid: "e134dafee8df424690057d14e75c2e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e083b2fa907d42b3b33dfba2d9f45240" is_pre_election: true
I20260709 12:27:52.300238  4164 leader_election.cc:290] T a7b82f2b2be84e8aad65ee4199ce5224 P ffc6860a7daf42ea871d9389b9fce64a [CANDIDATE]: Term 1 election: Requested vote from peers e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229), e134dafee8df424690057d14e75c2e82 (127.23.245.131:36883)
I20260709 12:27:52.301354  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7b82f2b2be84e8aad65ee4199ce5224" candidate_uuid: "ffc6860a7daf42ea871d9389b9fce64a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e083b2fa907d42b3b33dfba2d9f45240"
I20260709 12:27:52.302105  4157 tablet_bootstrap.cc:654] T 7e083776605c4a658bcca9cb211a4cf6 P ffc6860a7daf42ea871d9389b9fce64a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:52.302052  3965 raft_consensus.cc:3060] T a7b82f2b2be84e8aad65ee4199ce5224 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:27:52.302255  4081 leader_election.cc:343] T b03341ea7bb64c2085bdecf904d11548 P e134dafee8df424690057d14e75c2e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:52.303086  4081 leader_election.cc:343] T 9dccf99aa7894eb5b71293becf61aff1 P e134dafee8df424690057d14e75c2e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:52.305655  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7b82f2b2be84e8aad65ee4199ce5224" candidate_uuid: "ffc6860a7daf42ea871d9389b9fce64a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e134dafee8df424690057d14e75c2e82"
I20260709 12:27:52.305884  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03341ea7bb64c2085bdecf904d11548" candidate_uuid: "e134dafee8df424690057d14e75c2e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffc6860a7daf42ea871d9389b9fce64a" is_pre_election: true
I20260709 12:27:52.306293  4115 raft_consensus.cc:3060] T a7b82f2b2be84e8aad65ee4199ce5224 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:52.312062  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccef56abf48c4dd5bbb5bd65364ae3a9" candidate_uuid: "e134dafee8df424690057d14e75c2e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e083b2fa907d42b3b33dfba2d9f45240" is_pre_election: true
I20260709 12:27:52.312750  3966 raft_consensus.cc:2468] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e134dafee8df424690057d14e75c2e82 in term 0.
I20260709 12:27:52.315050  4081 leader_election.cc:304] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e134dafee8df424690057d14e75c2e82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e083b2fa907d42b3b33dfba2d9f45240, e134dafee8df424690057d14e75c2e82; no voters: 
I20260709 12:27:52.315635  4157 tablet_bootstrap.cc:492] T 7e083776605c4a658bcca9cb211a4cf6 P ffc6860a7daf42ea871d9389b9fce64a: No bootstrap required, opened a new log
I20260709 12:27:52.316324  4157 ts_tablet_manager.cc:1403] T 7e083776605c4a658bcca9cb211a4cf6 P ffc6860a7daf42ea871d9389b9fce64a: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.009s
I20260709 12:27:52.316469  4159 leader_election.cc:290] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e134dafee8df424690057d14e75c2e82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229), ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130:46493)
I20260709 12:27:52.317629  4159 raft_consensus.cc:2804] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:52.317899  4159 raft_consensus.cc:493] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:52.318189  4159 raft_consensus.cc:3060] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:52.319905  4157 raft_consensus.cc:359] T 7e083776605c4a658bcca9cb211a4cf6 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.320869  4157 raft_consensus.cc:385] T 7e083776605c4a658bcca9cb211a4cf6 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:52.321036  4194 leader_election.cc:290] T 9dccf99aa7894eb5b71293becf61aff1 P e134dafee8df424690057d14e75c2e82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229), ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130:46493)
I20260709 12:27:52.321296  4157 raft_consensus.cc:740] T 7e083776605c4a658bcca9cb211a4cf6 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffc6860a7daf42ea871d9389b9fce64a, State: Initialized, Role: FOLLOWER
I20260709 12:27:52.321671  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccef56abf48c4dd5bbb5bd65364ae3a9" candidate_uuid: "e134dafee8df424690057d14e75c2e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffc6860a7daf42ea871d9389b9fce64a" is_pre_election: true
I20260709 12:27:52.322428  4040 raft_consensus.cc:2468] T ccef56abf48c4dd5bbb5bd65364ae3a9 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e134dafee8df424690057d14e75c2e82 in term 0.
I20260709 12:27:52.322465  4157 consensus_queue.cc:260] T 7e083776605c4a658bcca9cb211a4cf6 P ffc6860a7daf42ea871d9389b9fce64a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
W20260709 12:27:52.320451  4079 leader_election.cc:343] T b03341ea7bb64c2085bdecf904d11548 P e134dafee8df424690057d14e75c2e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130:46493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:52.323660  4079 leader_election.cc:304] T b03341ea7bb64c2085bdecf904d11548 P e134dafee8df424690057d14e75c2e82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e134dafee8df424690057d14e75c2e82; no voters: e083b2fa907d42b3b33dfba2d9f45240, ffc6860a7daf42ea871d9389b9fce64a
I20260709 12:27:52.325464  4157 ts_tablet_manager.cc:1434] T 7e083776605c4a658bcca9cb211a4cf6 P ffc6860a7daf42ea871d9389b9fce64a: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.002s
I20260709 12:27:52.325989  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dccf99aa7894eb5b71293becf61aff1" candidate_uuid: "e134dafee8df424690057d14e75c2e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffc6860a7daf42ea871d9389b9fce64a" is_pre_election: true
I20260709 12:27:52.326769  4157 tablet_bootstrap.cc:492] T b03341ea7bb64c2085bdecf904d11548 P ffc6860a7daf42ea871d9389b9fce64a: Bootstrap starting.
I20260709 12:27:52.326890  4158 tablet_bootstrap.cc:492] T 9dccf99aa7894eb5b71293becf61aff1 P e083b2fa907d42b3b33dfba2d9f45240: No bootstrap required, opened a new log
I20260709 12:27:52.328436  4158 ts_tablet_manager.cc:1403] T 9dccf99aa7894eb5b71293becf61aff1 P e083b2fa907d42b3b33dfba2d9f45240: Time spent bootstrapping tablet: real 0.093s	user 0.009s	sys 0.012s
I20260709 12:27:52.332195  4197 raft_consensus.cc:2749] T b03341ea7bb64c2085bdecf904d11548 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:52.334923  4157 tablet_bootstrap.cc:654] T b03341ea7bb64c2085bdecf904d11548 P ffc6860a7daf42ea871d9389b9fce64a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:52.335638  4158 raft_consensus.cc:359] T 9dccf99aa7894eb5b71293becf61aff1 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.336498  4158 raft_consensus.cc:385] T 9dccf99aa7894eb5b71293becf61aff1 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:52.336869  4158 raft_consensus.cc:740] T 9dccf99aa7894eb5b71293becf61aff1 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e083b2fa907d42b3b33dfba2d9f45240, State: Initialized, Role: FOLLOWER
I20260709 12:27:52.336555  4159 raft_consensus.cc:515] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e134dafee8df424690057d14e75c2e82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.337699  4158 consensus_queue.cc:260] T 9dccf99aa7894eb5b71293becf61aff1 P e083b2fa907d42b3b33dfba2d9f45240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.339866  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccef56abf48c4dd5bbb5bd65364ae3a9" candidate_uuid: "e134dafee8df424690057d14e75c2e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e083b2fa907d42b3b33dfba2d9f45240"
I20260709 12:27:52.340560  3966 raft_consensus.cc:3060] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:52.340873  4159 leader_election.cc:290] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e134dafee8df424690057d14e75c2e82 [CANDIDATE]: Term 1 election: Requested vote from peers e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229), ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130:46493)
I20260709 12:27:52.340108  4158 ts_tablet_manager.cc:1434] T 9dccf99aa7894eb5b71293becf61aff1 P e083b2fa907d42b3b33dfba2d9f45240: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 12:27:52.342244  4158 tablet_bootstrap.cc:492] T ca9249d3904b4b4580d1c289f923daee P e083b2fa907d42b3b33dfba2d9f45240: Bootstrap starting.
I20260709 12:27:52.347260  4157 tablet_bootstrap.cc:492] T b03341ea7bb64c2085bdecf904d11548 P ffc6860a7daf42ea871d9389b9fce64a: No bootstrap required, opened a new log
I20260709 12:27:52.348747  4158 tablet_bootstrap.cc:654] T ca9249d3904b4b4580d1c289f923daee P e083b2fa907d42b3b33dfba2d9f45240: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:52.353967  4157 ts_tablet_manager.cc:1403] T b03341ea7bb64c2085bdecf904d11548 P ffc6860a7daf42ea871d9389b9fce64a: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.010s
I20260709 12:27:52.349113  4159 raft_consensus.cc:493] T 018fbc94678e41318e867a918691041b P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.354728  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccef56abf48c4dd5bbb5bd65364ae3a9" candidate_uuid: "e134dafee8df424690057d14e75c2e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffc6860a7daf42ea871d9389b9fce64a"
I20260709 12:27:52.354843  4159 raft_consensus.cc:515] T 018fbc94678e41318e867a918691041b P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.355479  4041 raft_consensus.cc:3060] T ccef56abf48c4dd5bbb5bd65364ae3a9 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:52.357117  4157 raft_consensus.cc:359] T b03341ea7bb64c2085bdecf904d11548 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.357898  4157 raft_consensus.cc:385] T b03341ea7bb64c2085bdecf904d11548 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:52.358011  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018fbc94678e41318e867a918691041b" candidate_uuid: "e134dafee8df424690057d14e75c2e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e083b2fa907d42b3b33dfba2d9f45240" is_pre_election: true
W20260709 12:27:52.359609  4081 leader_election.cc:343] T 018fbc94678e41318e867a918691041b P e134dafee8df424690057d14e75c2e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:52.351553  3862 catalog_manager.cc:5697] T ca9249d3904b4b4580d1c289f923daee P e134dafee8df424690057d14e75c2e82 reported cstate change: term changed from 0 to 1, leader changed from <none> to e134dafee8df424690057d14e75c2e82 (127.23.245.131). New cstate: current_term: 1 leader_uuid: "e134dafee8df424690057d14e75c2e82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:52.326655  4040 raft_consensus.cc:2468] T 9dccf99aa7894eb5b71293becf61aff1 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e134dafee8df424690057d14e75c2e82 in term 0.
I20260709 12:27:52.358232  4157 raft_consensus.cc:740] T b03341ea7bb64c2085bdecf904d11548 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffc6860a7daf42ea871d9389b9fce64a, State: Initialized, Role: FOLLOWER
I20260709 12:27:52.360659  4159 leader_election.cc:290] T 018fbc94678e41318e867a918691041b P e134dafee8df424690057d14e75c2e82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229), ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130:46493)
I20260709 12:27:52.353030  3966 raft_consensus.cc:2468] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e083b2fa907d42b3b33dfba2d9f45240 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e134dafee8df424690057d14e75c2e82 in term 1.
I20260709 12:27:52.361171  4157 consensus_queue.cc:260] T b03341ea7bb64c2085bdecf904d11548 P ffc6860a7daf42ea871d9389b9fce64a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.361744  3965 raft_consensus.cc:2468] T a7b82f2b2be84e8aad65ee4199ce5224 P e083b2fa907d42b3b33dfba2d9f45240 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffc6860a7daf42ea871d9389b9fce64a in term 1.
I20260709 12:27:52.362501  4081 leader_election.cc:304] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e134dafee8df424690057d14e75c2e82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e083b2fa907d42b3b33dfba2d9f45240, e134dafee8df424690057d14e75c2e82; no voters: 
I20260709 12:27:52.363382  4194 raft_consensus.cc:2804] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e134dafee8df424690057d14e75c2e82 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:52.363850  4157 ts_tablet_manager.cc:1434] T b03341ea7bb64c2085bdecf904d11548 P ffc6860a7daf42ea871d9389b9fce64a: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:27:52.363847  4194 raft_consensus.cc:697] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e134dafee8df424690057d14e75c2e82 [term 1 LEADER]: Becoming Leader. State: Replica: e134dafee8df424690057d14e75c2e82, State: Running, Role: LEADER
I20260709 12:27:52.363941  4007 leader_election.cc:304] T a7b82f2b2be84e8aad65ee4199ce5224 P ffc6860a7daf42ea871d9389b9fce64a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e083b2fa907d42b3b33dfba2d9f45240, ffc6860a7daf42ea871d9389b9fce64a; no voters: 
I20260709 12:27:52.365049  4164 raft_consensus.cc:2804] T a7b82f2b2be84e8aad65ee4199ce5224 P ffc6860a7daf42ea871d9389b9fce64a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:52.365206  4157 tablet_bootstrap.cc:492] T 018fbc94678e41318e867a918691041b P ffc6860a7daf42ea871d9389b9fce64a: Bootstrap starting.
I20260709 12:27:52.365568  4164 raft_consensus.cc:697] T a7b82f2b2be84e8aad65ee4199ce5224 P ffc6860a7daf42ea871d9389b9fce64a [term 1 LEADER]: Becoming Leader. State: Replica: ffc6860a7daf42ea871d9389b9fce64a, State: Running, Role: LEADER
I20260709 12:27:52.365178  4194 consensus_queue.cc:237] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e134dafee8df424690057d14e75c2e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.366528  4164 consensus_queue.cc:237] T a7b82f2b2be84e8aad65ee4199ce5224 P ffc6860a7daf42ea871d9389b9fce64a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.370198  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018fbc94678e41318e867a918691041b" candidate_uuid: "e134dafee8df424690057d14e75c2e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffc6860a7daf42ea871d9389b9fce64a" is_pre_election: true
I20260709 12:27:52.374766  4041 raft_consensus.cc:2468] T ccef56abf48c4dd5bbb5bd65364ae3a9 P ffc6860a7daf42ea871d9389b9fce64a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e134dafee8df424690057d14e75c2e82 in term 1.
I20260709 12:27:52.380086  4157 tablet_bootstrap.cc:654] T 018fbc94678e41318e867a918691041b P ffc6860a7daf42ea871d9389b9fce64a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:52.380442  4158 tablet_bootstrap.cc:492] T ca9249d3904b4b4580d1c289f923daee P e083b2fa907d42b3b33dfba2d9f45240: No bootstrap required, opened a new log
I20260709 12:27:52.380961  4158 ts_tablet_manager.cc:1403] T ca9249d3904b4b4580d1c289f923daee P e083b2fa907d42b3b33dfba2d9f45240: Time spent bootstrapping tablet: real 0.039s	user 0.007s	sys 0.013s
I20260709 12:27:52.384090  4158 raft_consensus.cc:359] T ca9249d3904b4b4580d1c289f923daee P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.385078  4158 raft_consensus.cc:385] T ca9249d3904b4b4580d1c289f923daee P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:52.385471  4158 raft_consensus.cc:740] T ca9249d3904b4b4580d1c289f923daee P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e083b2fa907d42b3b33dfba2d9f45240, State: Initialized, Role: FOLLOWER
I20260709 12:27:52.386622  4158 consensus_queue.cc:260] T ca9249d3904b4b4580d1c289f923daee P e083b2fa907d42b3b33dfba2d9f45240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.393615  4158 ts_tablet_manager.cc:1434] T ca9249d3904b4b4580d1c289f923daee P e083b2fa907d42b3b33dfba2d9f45240: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:27:52.395057  4158 tablet_bootstrap.cc:492] T 018fbc94678e41318e867a918691041b P e083b2fa907d42b3b33dfba2d9f45240: Bootstrap starting.
I20260709 12:27:52.395757  4079 leader_election.cc:304] T 9dccf99aa7894eb5b71293becf61aff1 P e134dafee8df424690057d14e75c2e82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e134dafee8df424690057d14e75c2e82, ffc6860a7daf42ea871d9389b9fce64a; no voters: e083b2fa907d42b3b33dfba2d9f45240
I20260709 12:27:52.397141  4194 raft_consensus.cc:2804] T 9dccf99aa7894eb5b71293becf61aff1 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:52.397853  4194 raft_consensus.cc:493] T 9dccf99aa7894eb5b71293becf61aff1 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:52.398337  4194 raft_consensus.cc:3060] T 9dccf99aa7894eb5b71293becf61aff1 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:27:52.408950  4079 leader_election.cc:343] T 018fbc94678e41318e867a918691041b P e134dafee8df424690057d14e75c2e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130:46493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:52.409709  4079 leader_election.cc:304] T 018fbc94678e41318e867a918691041b P e134dafee8df424690057d14e75c2e82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e134dafee8df424690057d14e75c2e82; no voters: e083b2fa907d42b3b33dfba2d9f45240, ffc6860a7daf42ea871d9389b9fce64a
I20260709 12:27:52.412256  4159 raft_consensus.cc:2749] T 018fbc94678e41318e867a918691041b P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:52.413699  4115 raft_consensus.cc:2468] T a7b82f2b2be84e8aad65ee4199ce5224 P e134dafee8df424690057d14e75c2e82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffc6860a7daf42ea871d9389b9fce64a in term 1.
I20260709 12:27:52.417563  4194 raft_consensus.cc:515] T 9dccf99aa7894eb5b71293becf61aff1 P e134dafee8df424690057d14e75c2e82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.420538  4158 tablet_bootstrap.cc:654] T 018fbc94678e41318e867a918691041b P e083b2fa907d42b3b33dfba2d9f45240: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:52.427824  3861 catalog_manager.cc:5697] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e134dafee8df424690057d14e75c2e82 reported cstate change: term changed from 0 to 1, leader changed from <none> to e134dafee8df424690057d14e75c2e82 (127.23.245.131). New cstate: current_term: 1 leader_uuid: "e134dafee8df424690057d14e75c2e82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:52.434674  4158 tablet_bootstrap.cc:492] T 018fbc94678e41318e867a918691041b P e083b2fa907d42b3b33dfba2d9f45240: No bootstrap required, opened a new log
I20260709 12:27:52.435499  4158 ts_tablet_manager.cc:1403] T 018fbc94678e41318e867a918691041b P e083b2fa907d42b3b33dfba2d9f45240: Time spent bootstrapping tablet: real 0.041s	user 0.013s	sys 0.007s
I20260709 12:27:52.440009  4158 raft_consensus.cc:359] T 018fbc94678e41318e867a918691041b P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.441016  4158 raft_consensus.cc:385] T 018fbc94678e41318e867a918691041b P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:52.441375  4158 raft_consensus.cc:740] T 018fbc94678e41318e867a918691041b P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e083b2fa907d42b3b33dfba2d9f45240, State: Initialized, Role: FOLLOWER
I20260709 12:27:52.442600  4163 raft_consensus.cc:493] T 2256c4cd63e6474aa804844ed7cd18fa P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.445741  4158 consensus_queue.cc:260] T 018fbc94678e41318e867a918691041b P e083b2fa907d42b3b33dfba2d9f45240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.446023  4163 raft_consensus.cc:515] T 2256c4cd63e6474aa804844ed7cd18fa P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } } peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } }
I20260709 12:27:52.449267  4158 ts_tablet_manager.cc:1434] T 018fbc94678e41318e867a918691041b P e083b2fa907d42b3b33dfba2d9f45240: Time spent starting tablet: real 0.013s	user 0.012s	sys 0.000s
I20260709 12:27:52.450764  4158 tablet_bootstrap.cc:492] T b03341ea7bb64c2085bdecf904d11548 P e083b2fa907d42b3b33dfba2d9f45240: Bootstrap starting.
I20260709 12:27:52.448928  4163 leader_election.cc:290] T 2256c4cd63e6474aa804844ed7cd18fa P e083b2fa907d42b3b33dfba2d9f45240 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130:46493), e134dafee8df424690057d14e75c2e82 (127.23.245.131:36883)
I20260709 12:27:52.452498  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2256c4cd63e6474aa804844ed7cd18fa" candidate_uuid: "e083b2fa907d42b3b33dfba2d9f45240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffc6860a7daf42ea871d9389b9fce64a" is_pre_election: true
I20260709 12:27:52.457873  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2256c4cd63e6474aa804844ed7cd18fa" candidate_uuid: "e083b2fa907d42b3b33dfba2d9f45240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e134dafee8df424690057d14e75c2e82" is_pre_election: true
I20260709 12:27:52.459385  4115 raft_consensus.cc:2393] T 2256c4cd63e6474aa804844ed7cd18fa P e134dafee8df424690057d14e75c2e82 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e083b2fa907d42b3b33dfba2d9f45240 in current term 1: Already voted for candidate ffc6860a7daf42ea871d9389b9fce64a in this term.
I20260709 12:27:52.461402  3930 leader_election.cc:304] T 2256c4cd63e6474aa804844ed7cd18fa P e083b2fa907d42b3b33dfba2d9f45240 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e083b2fa907d42b3b33dfba2d9f45240; no voters: e134dafee8df424690057d14e75c2e82, ffc6860a7daf42ea871d9389b9fce64a
I20260709 12:27:52.463007  4163 raft_consensus.cc:3060] T 2256c4cd63e6474aa804844ed7cd18fa P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:52.465449  4194 leader_election.cc:290] T 9dccf99aa7894eb5b71293becf61aff1 P e134dafee8df424690057d14e75c2e82 [CANDIDATE]: Term 1 election: Requested vote from peers e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229), ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130:46493)
I20260709 12:27:52.467442  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dccf99aa7894eb5b71293becf61aff1" candidate_uuid: "e134dafee8df424690057d14e75c2e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e083b2fa907d42b3b33dfba2d9f45240"
I20260709 12:27:52.468209  3966 raft_consensus.cc:3060] T 9dccf99aa7894eb5b71293becf61aff1 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:52.470976  4163 raft_consensus.cc:2749] T 2256c4cd63e6474aa804844ed7cd18fa P e083b2fa907d42b3b33dfba2d9f45240 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:52.471704  4158 tablet_bootstrap.cc:654] T b03341ea7bb64c2085bdecf904d11548 P e083b2fa907d42b3b33dfba2d9f45240: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:52.472168  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dccf99aa7894eb5b71293becf61aff1" candidate_uuid: "e134dafee8df424690057d14e75c2e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffc6860a7daf42ea871d9389b9fce64a"
I20260709 12:27:52.471756  4157 tablet_bootstrap.cc:492] T 018fbc94678e41318e867a918691041b P ffc6860a7daf42ea871d9389b9fce64a: No bootstrap required, opened a new log
I20260709 12:27:52.472851  4041 raft_consensus.cc:3060] T 9dccf99aa7894eb5b71293becf61aff1 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:52.473085  4157 ts_tablet_manager.cc:1403] T 018fbc94678e41318e867a918691041b P ffc6860a7daf42ea871d9389b9fce64a: Time spent bootstrapping tablet: real 0.108s	user 0.046s	sys 0.039s
I20260709 12:27:52.475376  3862 catalog_manager.cc:5697] T a7b82f2b2be84e8aad65ee4199ce5224 P ffc6860a7daf42ea871d9389b9fce64a reported cstate change: term changed from 0 to 1, leader changed from <none> to ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130). New cstate: current_term: 1 leader_uuid: "ffc6860a7daf42ea871d9389b9fce64a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:52.476787  3966 raft_consensus.cc:2468] T 9dccf99aa7894eb5b71293becf61aff1 P e083b2fa907d42b3b33dfba2d9f45240 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e134dafee8df424690057d14e75c2e82 in term 1.
I20260709 12:27:52.478041  4081 leader_election.cc:304] T 9dccf99aa7894eb5b71293becf61aff1 P e134dafee8df424690057d14e75c2e82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e083b2fa907d42b3b33dfba2d9f45240, e134dafee8df424690057d14e75c2e82; no voters: 
I20260709 12:27:52.476049  4157 raft_consensus.cc:359] T 018fbc94678e41318e867a918691041b P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.478885  4157 raft_consensus.cc:385] T 018fbc94678e41318e867a918691041b P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:52.479108  4194 raft_consensus.cc:2804] T 9dccf99aa7894eb5b71293becf61aff1 P e134dafee8df424690057d14e75c2e82 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:52.479256  4157 raft_consensus.cc:740] T 018fbc94678e41318e867a918691041b P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffc6860a7daf42ea871d9389b9fce64a, State: Initialized, Role: FOLLOWER
I20260709 12:27:52.480378  4041 raft_consensus.cc:2468] T 9dccf99aa7894eb5b71293becf61aff1 P ffc6860a7daf42ea871d9389b9fce64a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e134dafee8df424690057d14e75c2e82 in term 1.
I20260709 12:27:52.480506  4194 raft_consensus.cc:697] T 9dccf99aa7894eb5b71293becf61aff1 P e134dafee8df424690057d14e75c2e82 [term 1 LEADER]: Becoming Leader. State: Replica: e134dafee8df424690057d14e75c2e82, State: Running, Role: LEADER
I20260709 12:27:52.481432  4194 consensus_queue.cc:237] T 9dccf99aa7894eb5b71293becf61aff1 P e134dafee8df424690057d14e75c2e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.480407  4157 consensus_queue.cc:260] T 018fbc94678e41318e867a918691041b P ffc6860a7daf42ea871d9389b9fce64a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.484304  4157 ts_tablet_manager.cc:1434] T 018fbc94678e41318e867a918691041b P ffc6860a7daf42ea871d9389b9fce64a: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:27:52.487233  4158 tablet_bootstrap.cc:492] T b03341ea7bb64c2085bdecf904d11548 P e083b2fa907d42b3b33dfba2d9f45240: No bootstrap required, opened a new log
I20260709 12:27:52.487864  4158 ts_tablet_manager.cc:1403] T b03341ea7bb64c2085bdecf904d11548 P e083b2fa907d42b3b33dfba2d9f45240: Time spent bootstrapping tablet: real 0.037s	user 0.016s	sys 0.000s
I20260709 12:27:52.490823  4164 raft_consensus.cc:493] T 7e083776605c4a658bcca9cb211a4cf6 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.491163  4158 raft_consensus.cc:359] T b03341ea7bb64c2085bdecf904d11548 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.491456  4164 raft_consensus.cc:515] T 7e083776605c4a658bcca9cb211a4cf6 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.492018  4158 raft_consensus.cc:385] T b03341ea7bb64c2085bdecf904d11548 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:52.492637  4158 raft_consensus.cc:740] T b03341ea7bb64c2085bdecf904d11548 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e083b2fa907d42b3b33dfba2d9f45240, State: Initialized, Role: FOLLOWER
I20260709 12:27:52.492002  3862 catalog_manager.cc:5697] T 9dccf99aa7894eb5b71293becf61aff1 P e134dafee8df424690057d14e75c2e82 reported cstate change: term changed from 0 to 1, leader changed from <none> to e134dafee8df424690057d14e75c2e82 (127.23.245.131). New cstate: current_term: 1 leader_uuid: "e134dafee8df424690057d14e75c2e82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:52.493563  4158 consensus_queue.cc:260] T b03341ea7bb64c2085bdecf904d11548 P e083b2fa907d42b3b33dfba2d9f45240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.494510  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e083776605c4a658bcca9cb211a4cf6" candidate_uuid: "ffc6860a7daf42ea871d9389b9fce64a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e083b2fa907d42b3b33dfba2d9f45240" is_pre_election: true
I20260709 12:27:52.496877  4158 ts_tablet_manager.cc:1434] T b03341ea7bb64c2085bdecf904d11548 P e083b2fa907d42b3b33dfba2d9f45240: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:27:52.497862  4158 tablet_bootstrap.cc:492] T 7e083776605c4a658bcca9cb211a4cf6 P e083b2fa907d42b3b33dfba2d9f45240: Bootstrap starting.
W20260709 12:27:52.498484  4007 leader_election.cc:343] T 7e083776605c4a658bcca9cb211a4cf6 P ffc6860a7daf42ea871d9389b9fce64a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:52.501230  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e083776605c4a658bcca9cb211a4cf6" candidate_uuid: "ffc6860a7daf42ea871d9389b9fce64a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e134dafee8df424690057d14e75c2e82" is_pre_election: true
I20260709 12:27:52.501893  4115 raft_consensus.cc:2468] T 7e083776605c4a658bcca9cb211a4cf6 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ffc6860a7daf42ea871d9389b9fce64a in term 0.
I20260709 12:27:52.503199  4005 leader_election.cc:304] T 7e083776605c4a658bcca9cb211a4cf6 P ffc6860a7daf42ea871d9389b9fce64a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e134dafee8df424690057d14e75c2e82, ffc6860a7daf42ea871d9389b9fce64a; no voters: e083b2fa907d42b3b33dfba2d9f45240
I20260709 12:27:52.503723  4158 tablet_bootstrap.cc:654] T 7e083776605c4a658bcca9cb211a4cf6 P e083b2fa907d42b3b33dfba2d9f45240: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:52.504179  4188 raft_consensus.cc:2804] T 7e083776605c4a658bcca9cb211a4cf6 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:52.504654  4188 raft_consensus.cc:493] T 7e083776605c4a658bcca9cb211a4cf6 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:52.504963  4188 raft_consensus.cc:3060] T 7e083776605c4a658bcca9cb211a4cf6 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:52.505125  4164 leader_election.cc:290] T 7e083776605c4a658bcca9cb211a4cf6 P ffc6860a7daf42ea871d9389b9fce64a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229), e134dafee8df424690057d14e75c2e82 (127.23.245.131:36883)
I20260709 12:27:52.508543  4158 tablet_bootstrap.cc:492] T 7e083776605c4a658bcca9cb211a4cf6 P e083b2fa907d42b3b33dfba2d9f45240: No bootstrap required, opened a new log
I20260709 12:27:52.509114  4158 ts_tablet_manager.cc:1403] T 7e083776605c4a658bcca9cb211a4cf6 P e083b2fa907d42b3b33dfba2d9f45240: Time spent bootstrapping tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 12:27:52.511729  4158 raft_consensus.cc:359] T 7e083776605c4a658bcca9cb211a4cf6 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.512421  4158 raft_consensus.cc:385] T 7e083776605c4a658bcca9cb211a4cf6 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:52.512713  4158 raft_consensus.cc:740] T 7e083776605c4a658bcca9cb211a4cf6 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e083b2fa907d42b3b33dfba2d9f45240, State: Initialized, Role: FOLLOWER
I20260709 12:27:52.512755  4188 raft_consensus.cc:515] T 7e083776605c4a658bcca9cb211a4cf6 P ffc6860a7daf42ea871d9389b9fce64a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.513443  4158 consensus_queue.cc:260] T 7e083776605c4a658bcca9cb211a4cf6 P e083b2fa907d42b3b33dfba2d9f45240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.515511  4158 ts_tablet_manager.cc:1434] T 7e083776605c4a658bcca9cb211a4cf6 P e083b2fa907d42b3b33dfba2d9f45240: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:27:52.516000  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e083776605c4a658bcca9cb211a4cf6" candidate_uuid: "ffc6860a7daf42ea871d9389b9fce64a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e083b2fa907d42b3b33dfba2d9f45240"
I20260709 12:27:52.516618  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e083776605c4a658bcca9cb211a4cf6" candidate_uuid: "ffc6860a7daf42ea871d9389b9fce64a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e134dafee8df424690057d14e75c2e82"
I20260709 12:27:52.516614  3966 raft_consensus.cc:3060] T 7e083776605c4a658bcca9cb211a4cf6 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:52.517168  4115 raft_consensus.cc:3060] T 7e083776605c4a658bcca9cb211a4cf6 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:52.518380  4188 leader_election.cc:290] T 7e083776605c4a658bcca9cb211a4cf6 P ffc6860a7daf42ea871d9389b9fce64a [CANDIDATE]: Term 1 election: Requested vote from peers e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229), e134dafee8df424690057d14e75c2e82 (127.23.245.131:36883)
I20260709 12:27:52.523784  4115 raft_consensus.cc:2468] T 7e083776605c4a658bcca9cb211a4cf6 P e134dafee8df424690057d14e75c2e82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffc6860a7daf42ea871d9389b9fce64a in term 1.
I20260709 12:27:52.524912  4005 leader_election.cc:304] T 7e083776605c4a658bcca9cb211a4cf6 P ffc6860a7daf42ea871d9389b9fce64a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e134dafee8df424690057d14e75c2e82, ffc6860a7daf42ea871d9389b9fce64a; no voters: 
I20260709 12:27:52.525143  3966 raft_consensus.cc:2468] T 7e083776605c4a658bcca9cb211a4cf6 P e083b2fa907d42b3b33dfba2d9f45240 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffc6860a7daf42ea871d9389b9fce64a in term 1.
I20260709 12:27:52.525612  4188 raft_consensus.cc:2804] T 7e083776605c4a658bcca9cb211a4cf6 P ffc6860a7daf42ea871d9389b9fce64a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:52.526144  4188 raft_consensus.cc:697] T 7e083776605c4a658bcca9cb211a4cf6 P ffc6860a7daf42ea871d9389b9fce64a [term 1 LEADER]: Becoming Leader. State: Replica: ffc6860a7daf42ea871d9389b9fce64a, State: Running, Role: LEADER
I20260709 12:27:52.526983  4188 consensus_queue.cc:237] T 7e083776605c4a658bcca9cb211a4cf6 P ffc6860a7daf42ea871d9389b9fce64a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.534965  3862 catalog_manager.cc:5697] T 7e083776605c4a658bcca9cb211a4cf6 P ffc6860a7daf42ea871d9389b9fce64a reported cstate change: term changed from 0 to 1, leader changed from <none> to ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130). New cstate: current_term: 1 leader_uuid: "ffc6860a7daf42ea871d9389b9fce64a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:52.630262  4163 raft_consensus.cc:493] T 018fbc94678e41318e867a918691041b P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.630832  4163 raft_consensus.cc:515] T 018fbc94678e41318e867a918691041b P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.632360  4188 consensus_queue.cc:1048] T 2256c4cd63e6474aa804844ed7cd18fa P ffc6860a7daf42ea871d9389b9fce64a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:52.632818  4163 leader_election.cc:290] T 018fbc94678e41318e867a918691041b P e083b2fa907d42b3b33dfba2d9f45240 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130:46493), e134dafee8df424690057d14e75c2e82 (127.23.245.131:36883)
I20260709 12:27:52.633488  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018fbc94678e41318e867a918691041b" candidate_uuid: "e083b2fa907d42b3b33dfba2d9f45240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffc6860a7daf42ea871d9389b9fce64a" is_pre_election: true
I20260709 12:27:52.633734  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018fbc94678e41318e867a918691041b" candidate_uuid: "e083b2fa907d42b3b33dfba2d9f45240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e134dafee8df424690057d14e75c2e82" is_pre_election: true
I20260709 12:27:52.634248  4041 raft_consensus.cc:2468] T 018fbc94678e41318e867a918691041b P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e083b2fa907d42b3b33dfba2d9f45240 in term 0.
I20260709 12:27:52.634387  4115 raft_consensus.cc:2468] T 018fbc94678e41318e867a918691041b P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e083b2fa907d42b3b33dfba2d9f45240 in term 0.
I20260709 12:27:52.635521  3930 leader_election.cc:304] T 018fbc94678e41318e867a918691041b P e083b2fa907d42b3b33dfba2d9f45240 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e083b2fa907d42b3b33dfba2d9f45240, ffc6860a7daf42ea871d9389b9fce64a; no voters: 
I20260709 12:27:52.636343  4163 raft_consensus.cc:2804] T 018fbc94678e41318e867a918691041b P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:52.638414  4163 raft_consensus.cc:493] T 018fbc94678e41318e867a918691041b P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:52.638865  4163 raft_consensus.cc:3060] T 018fbc94678e41318e867a918691041b P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:52.649421  4188 consensus_queue.cc:1048] T 2256c4cd63e6474aa804844ed7cd18fa P ffc6860a7daf42ea871d9389b9fce64a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:52.649266  4163 raft_consensus.cc:515] T 018fbc94678e41318e867a918691041b P e083b2fa907d42b3b33dfba2d9f45240 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.650807  4165 raft_consensus.cc:493] T ca9249d3904b4b4580d1c289f923daee P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.651576  4165 raft_consensus.cc:515] T ca9249d3904b4b4580d1c289f923daee P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.653354  4163 leader_election.cc:290] T 018fbc94678e41318e867a918691041b P e083b2fa907d42b3b33dfba2d9f45240 [CANDIDATE]: Term 1 election: Requested vote from peers ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130:46493), e134dafee8df424690057d14e75c2e82 (127.23.245.131:36883)
I20260709 12:27:52.654342  4165 leader_election.cc:290] T ca9249d3904b4b4580d1c289f923daee P e083b2fa907d42b3b33dfba2d9f45240 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130:46493), e134dafee8df424690057d14e75c2e82 (127.23.245.131:36883)
I20260709 12:27:52.656128  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018fbc94678e41318e867a918691041b" candidate_uuid: "e083b2fa907d42b3b33dfba2d9f45240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffc6860a7daf42ea871d9389b9fce64a"
I20260709 12:27:52.656545  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018fbc94678e41318e867a918691041b" candidate_uuid: "e083b2fa907d42b3b33dfba2d9f45240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e134dafee8df424690057d14e75c2e82"
I20260709 12:27:52.660044  4041 raft_consensus.cc:3060] T 018fbc94678e41318e867a918691041b P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:52.660358  4114 raft_consensus.cc:3060] T 018fbc94678e41318e867a918691041b P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:52.658663  4113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9249d3904b4b4580d1c289f923daee" candidate_uuid: "e083b2fa907d42b3b33dfba2d9f45240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e134dafee8df424690057d14e75c2e82" is_pre_election: true
I20260709 12:27:52.658787  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9249d3904b4b4580d1c289f923daee" candidate_uuid: "e083b2fa907d42b3b33dfba2d9f45240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffc6860a7daf42ea871d9389b9fce64a" is_pre_election: true
I20260709 12:27:52.664856  4040 raft_consensus.cc:2393] T ca9249d3904b4b4580d1c289f923daee P ffc6860a7daf42ea871d9389b9fce64a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e083b2fa907d42b3b33dfba2d9f45240 in current term 1: Already voted for candidate e134dafee8df424690057d14e75c2e82 in this term.
I20260709 12:27:52.667615  3930 leader_election.cc:304] T ca9249d3904b4b4580d1c289f923daee P e083b2fa907d42b3b33dfba2d9f45240 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e083b2fa907d42b3b33dfba2d9f45240; no voters: e134dafee8df424690057d14e75c2e82, ffc6860a7daf42ea871d9389b9fce64a
I20260709 12:27:52.669492  4163 raft_consensus.cc:3060] T ca9249d3904b4b4580d1c289f923daee P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:52.674980  4114 raft_consensus.cc:2468] T 018fbc94678e41318e867a918691041b P e134dafee8df424690057d14e75c2e82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e083b2fa907d42b3b33dfba2d9f45240 in term 1.
I20260709 12:27:52.681584  3930 leader_election.cc:304] T 018fbc94678e41318e867a918691041b P e083b2fa907d42b3b33dfba2d9f45240 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e083b2fa907d42b3b33dfba2d9f45240, e134dafee8df424690057d14e75c2e82; no voters: 
I20260709 12:27:52.683305  4165 raft_consensus.cc:2804] T 018fbc94678e41318e867a918691041b P e083b2fa907d42b3b33dfba2d9f45240 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:52.684296  4216 consensus_queue.cc:1048] T 26574dc41db14da1a6bb7492fdbcf01b P e083b2fa907d42b3b33dfba2d9f45240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:52.688165  4041 raft_consensus.cc:2468] T 018fbc94678e41318e867a918691041b P ffc6860a7daf42ea871d9389b9fce64a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e083b2fa907d42b3b33dfba2d9f45240 in term 1.
I20260709 12:27:52.692929  4165 raft_consensus.cc:697] T 018fbc94678e41318e867a918691041b P e083b2fa907d42b3b33dfba2d9f45240 [term 1 LEADER]: Becoming Leader. State: Replica: e083b2fa907d42b3b33dfba2d9f45240, State: Running, Role: LEADER
I20260709 12:27:52.694175  4163 raft_consensus.cc:2749] T ca9249d3904b4b4580d1c289f923daee P e083b2fa907d42b3b33dfba2d9f45240 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:52.693933  4165 consensus_queue.cc:237] T 018fbc94678e41318e867a918691041b P e083b2fa907d42b3b33dfba2d9f45240 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.705118  4217 consensus_queue.cc:1048] T 26574dc41db14da1a6bb7492fdbcf01b P e083b2fa907d42b3b33dfba2d9f45240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:52.709070  3862 catalog_manager.cc:5697] T 018fbc94678e41318e867a918691041b P e083b2fa907d42b3b33dfba2d9f45240 reported cstate change: term changed from 0 to 1, leader changed from <none> to e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129). New cstate: current_term: 1 leader_uuid: "e083b2fa907d42b3b33dfba2d9f45240" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:52.770869  4194 consensus_queue.cc:1048] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e134dafee8df424690057d14e75c2e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:52.779116  4164 raft_consensus.cc:493] T b03341ea7bb64c2085bdecf904d11548 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.779686  4164 raft_consensus.cc:515] T b03341ea7bb64c2085bdecf904d11548 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.782038  4194 consensus_queue.cc:1048] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e134dafee8df424690057d14e75c2e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:52.784199  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03341ea7bb64c2085bdecf904d11548" candidate_uuid: "ffc6860a7daf42ea871d9389b9fce64a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e083b2fa907d42b3b33dfba2d9f45240" is_pre_election: true
I20260709 12:27:52.784940  3966 raft_consensus.cc:2468] T b03341ea7bb64c2085bdecf904d11548 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ffc6860a7daf42ea871d9389b9fce64a in term 0.
I20260709 12:27:52.785714  4164 leader_election.cc:290] T b03341ea7bb64c2085bdecf904d11548 P ffc6860a7daf42ea871d9389b9fce64a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229), e134dafee8df424690057d14e75c2e82 (127.23.245.131:36883)
I20260709 12:27:52.786669  4007 leader_election.cc:304] T b03341ea7bb64c2085bdecf904d11548 P ffc6860a7daf42ea871d9389b9fce64a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e083b2fa907d42b3b33dfba2d9f45240, ffc6860a7daf42ea871d9389b9fce64a; no voters: 
I20260709 12:27:52.787791  4164 raft_consensus.cc:2804] T b03341ea7bb64c2085bdecf904d11548 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:52.788378  4164 raft_consensus.cc:493] T b03341ea7bb64c2085bdecf904d11548 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:52.788851  4164 raft_consensus.cc:3060] T b03341ea7bb64c2085bdecf904d11548 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:52.788403  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03341ea7bb64c2085bdecf904d11548" candidate_uuid: "ffc6860a7daf42ea871d9389b9fce64a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e134dafee8df424690057d14e75c2e82" is_pre_election: true
I20260709 12:27:52.793007  4115 raft_consensus.cc:2468] T b03341ea7bb64c2085bdecf904d11548 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ffc6860a7daf42ea871d9389b9fce64a in term 0.
I20260709 12:27:52.797911  4164 raft_consensus.cc:515] T b03341ea7bb64c2085bdecf904d11548 P ffc6860a7daf42ea871d9389b9fce64a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.800583  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03341ea7bb64c2085bdecf904d11548" candidate_uuid: "ffc6860a7daf42ea871d9389b9fce64a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e083b2fa907d42b3b33dfba2d9f45240"
I20260709 12:27:52.801208  3965 raft_consensus.cc:3060] T b03341ea7bb64c2085bdecf904d11548 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:52.801352  4164 leader_election.cc:290] T b03341ea7bb64c2085bdecf904d11548 P ffc6860a7daf42ea871d9389b9fce64a [CANDIDATE]: Term 1 election: Requested vote from peers e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229), e134dafee8df424690057d14e75c2e82 (127.23.245.131:36883)
I20260709 12:27:52.802601  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03341ea7bb64c2085bdecf904d11548" candidate_uuid: "ffc6860a7daf42ea871d9389b9fce64a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e134dafee8df424690057d14e75c2e82"
I20260709 12:27:52.803217  4115 raft_consensus.cc:3060] T b03341ea7bb64c2085bdecf904d11548 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:52.804513  4164 consensus_queue.cc:1048] T a7b82f2b2be84e8aad65ee4199ce5224 P ffc6860a7daf42ea871d9389b9fce64a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:52.809428  4194 consensus_queue.cc:1048] T ca9249d3904b4b4580d1c289f923daee P e134dafee8df424690057d14e75c2e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:52.810465  3965 raft_consensus.cc:2468] T b03341ea7bb64c2085bdecf904d11548 P e083b2fa907d42b3b33dfba2d9f45240 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffc6860a7daf42ea871d9389b9fce64a in term 1.
I20260709 12:27:52.811586  4115 raft_consensus.cc:2468] T b03341ea7bb64c2085bdecf904d11548 P e134dafee8df424690057d14e75c2e82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffc6860a7daf42ea871d9389b9fce64a in term 1.
I20260709 12:27:52.811744  4007 leader_election.cc:304] T b03341ea7bb64c2085bdecf904d11548 P ffc6860a7daf42ea871d9389b9fce64a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e083b2fa907d42b3b33dfba2d9f45240, ffc6860a7daf42ea871d9389b9fce64a; no voters: 
I20260709 12:27:52.812726  4164 raft_consensus.cc:2804] T b03341ea7bb64c2085bdecf904d11548 P ffc6860a7daf42ea871d9389b9fce64a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:52.813257  4164 raft_consensus.cc:697] T b03341ea7bb64c2085bdecf904d11548 P ffc6860a7daf42ea871d9389b9fce64a [term 1 LEADER]: Becoming Leader. State: Replica: ffc6860a7daf42ea871d9389b9fce64a, State: Running, Role: LEADER
I20260709 12:27:52.814258  4164 consensus_queue.cc:237] T b03341ea7bb64c2085bdecf904d11548 P ffc6860a7daf42ea871d9389b9fce64a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:52.826017  4188 consensus_queue.cc:1048] T a7b82f2b2be84e8aad65ee4199ce5224 P ffc6860a7daf42ea871d9389b9fce64a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:52.829871  4194 consensus_queue.cc:1048] T ca9249d3904b4b4580d1c289f923daee P e134dafee8df424690057d14e75c2e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:52.845918  3864 catalog_manager.cc:5697] T b03341ea7bb64c2085bdecf904d11548 P ffc6860a7daf42ea871d9389b9fce64a reported cstate change: term changed from 0 to 1, leader changed from <none> to ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130). New cstate: current_term: 1 leader_uuid: "ffc6860a7daf42ea871d9389b9fce64a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:52.981946  4226 consensus_queue.cc:1048] T 7e083776605c4a658bcca9cb211a4cf6 P ffc6860a7daf42ea871d9389b9fce64a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:52.994022  4226 consensus_queue.cc:1048] T 7e083776605c4a658bcca9cb211a4cf6 P ffc6860a7daf42ea871d9389b9fce64a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:53.013441  4194 consensus_queue.cc:1048] T 9dccf99aa7894eb5b71293becf61aff1 P e134dafee8df424690057d14e75c2e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:53.024435  4182 consensus_queue.cc:1048] T 9dccf99aa7894eb5b71293becf61aff1 P e134dafee8df424690057d14e75c2e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:53.080196  4217 consensus_queue.cc:1048] T 018fbc94678e41318e867a918691041b P e083b2fa907d42b3b33dfba2d9f45240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:53.092533  4217 consensus_queue.cc:1048] T 018fbc94678e41318e867a918691041b P e083b2fa907d42b3b33dfba2d9f45240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:53.131126  4040 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2256c4cd63e6474aa804844ed7cd18fa"
dest_uuid: "ffc6860a7daf42ea871d9389b9fce64a"
mode: GRACEFUL
new_leader_uuid: "e083b2fa907d42b3b33dfba2d9f45240"
 from {username='slave'} at 127.0.0.1:39866
I20260709 12:27:53.131747  4040 raft_consensus.cc:606] T 2256c4cd63e6474aa804844ed7cd18fa P ffc6860a7daf42ea871d9389b9fce64a [term 1 LEADER]: Received request to transfer leadership to TS e083b2fa907d42b3b33dfba2d9f45240
I20260709 12:27:53.141413  4040 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e083776605c4a658bcca9cb211a4cf6"
dest_uuid: "ffc6860a7daf42ea871d9389b9fce64a"
mode: GRACEFUL
new_leader_uuid: "e083b2fa907d42b3b33dfba2d9f45240"
 from {username='slave'} at 127.0.0.1:39866
I20260709 12:27:53.142050  4040 raft_consensus.cc:606] T 7e083776605c4a658bcca9cb211a4cf6 P ffc6860a7daf42ea871d9389b9fce64a [term 1 LEADER]: Received request to transfer leadership to TS e083b2fa907d42b3b33dfba2d9f45240
I20260709 12:27:53.156647  4115 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ccef56abf48c4dd5bbb5bd65364ae3a9"
dest_uuid: "e134dafee8df424690057d14e75c2e82"
mode: GRACEFUL
new_leader_uuid: "e083b2fa907d42b3b33dfba2d9f45240"
 from {username='slave'} at 127.0.0.1:40274
I20260709 12:27:53.157155  4115 raft_consensus.cc:606] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e134dafee8df424690057d14e75c2e82 [term 1 LEADER]: Received request to transfer leadership to TS e083b2fa907d42b3b33dfba2d9f45240
I20260709 12:27:53.165344  4115 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9dccf99aa7894eb5b71293becf61aff1"
dest_uuid: "e134dafee8df424690057d14e75c2e82"
mode: GRACEFUL
new_leader_uuid: "ffc6860a7daf42ea871d9389b9fce64a"
 from {username='slave'} at 127.0.0.1:40274
I20260709 12:27:53.165881  4115 raft_consensus.cc:606] T 9dccf99aa7894eb5b71293becf61aff1 P e134dafee8df424690057d14e75c2e82 [term 1 LEADER]: Received request to transfer leadership to TS ffc6860a7daf42ea871d9389b9fce64a
I20260709 12:27:53.171288  4115 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca9249d3904b4b4580d1c289f923daee"
dest_uuid: "e134dafee8df424690057d14e75c2e82"
mode: GRACEFUL
new_leader_uuid: "ffc6860a7daf42ea871d9389b9fce64a"
 from {username='slave'} at 127.0.0.1:40274
I20260709 12:27:53.171769  4115 raft_consensus.cc:606] T ca9249d3904b4b4580d1c289f923daee P e134dafee8df424690057d14e75c2e82 [term 1 LEADER]: Received request to transfer leadership to TS ffc6860a7daf42ea871d9389b9fce64a
I20260709 12:27:53.186486  3964 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "018fbc94678e41318e867a918691041b"
dest_uuid: "e083b2fa907d42b3b33dfba2d9f45240"
mode: GRACEFUL
new_leader_uuid: "ffc6860a7daf42ea871d9389b9fce64a"
 from {username='slave'} at 127.0.0.1:50414
I20260709 12:27:53.187089  3964 raft_consensus.cc:606] T 018fbc94678e41318e867a918691041b P e083b2fa907d42b3b33dfba2d9f45240 [term 1 LEADER]: Received request to transfer leadership to TS ffc6860a7daf42ea871d9389b9fce64a
I20260709 12:27:53.192306  4040 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b03341ea7bb64c2085bdecf904d11548"
dest_uuid: "ffc6860a7daf42ea871d9389b9fce64a"
mode: GRACEFUL
new_leader_uuid: "e134dafee8df424690057d14e75c2e82"
 from {username='slave'} at 127.0.0.1:39866
I20260709 12:27:53.192827  4040 raft_consensus.cc:606] T b03341ea7bb64c2085bdecf904d11548 P ffc6860a7daf42ea871d9389b9fce64a [term 1 LEADER]: Received request to transfer leadership to TS e134dafee8df424690057d14e75c2e82
I20260709 12:27:53.227193  4226 consensus_queue.cc:1048] T b03341ea7bb64c2085bdecf904d11548 P ffc6860a7daf42ea871d9389b9fce64a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:53.234530  4164 raft_consensus.cc:993] T b03341ea7bb64c2085bdecf904d11548 P ffc6860a7daf42ea871d9389b9fce64a: : Instructing follower e134dafee8df424690057d14e75c2e82 to start an election
I20260709 12:27:53.235152  4164 raft_consensus.cc:1081] T b03341ea7bb64c2085bdecf904d11548 P ffc6860a7daf42ea871d9389b9fce64a [term 1 LEADER]: Signalling peer e134dafee8df424690057d14e75c2e82 to start an election
I20260709 12:27:53.239504  4171 raft_consensus.cc:993] T 2256c4cd63e6474aa804844ed7cd18fa P ffc6860a7daf42ea871d9389b9fce64a: : Instructing follower e083b2fa907d42b3b33dfba2d9f45240 to start an election
I20260709 12:27:53.239998  4171 raft_consensus.cc:1081] T 2256c4cd63e6474aa804844ed7cd18fa P ffc6860a7daf42ea871d9389b9fce64a [term 1 LEADER]: Signalling peer e083b2fa907d42b3b33dfba2d9f45240 to start an election
I20260709 12:27:53.240974  4115 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b03341ea7bb64c2085bdecf904d11548"
dest_uuid: "e134dafee8df424690057d14e75c2e82"
 from {username='slave'} at 127.0.0.1:40266
I20260709 12:27:53.241613  4115 raft_consensus.cc:493] T b03341ea7bb64c2085bdecf904d11548 P e134dafee8df424690057d14e75c2e82 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:53.241994  4115 raft_consensus.cc:3060] T b03341ea7bb64c2085bdecf904d11548 P e134dafee8df424690057d14e75c2e82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:53.242065  4171 consensus_queue.cc:1048] T b03341ea7bb64c2085bdecf904d11548 P ffc6860a7daf42ea871d9389b9fce64a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:53.245944  3964 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2256c4cd63e6474aa804844ed7cd18fa"
dest_uuid: "e083b2fa907d42b3b33dfba2d9f45240"
 from {username='slave'} at 127.0.0.1:50404
I20260709 12:27:53.247084  3964 raft_consensus.cc:493] T 2256c4cd63e6474aa804844ed7cd18fa P e083b2fa907d42b3b33dfba2d9f45240 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:53.249364  3964 raft_consensus.cc:3060] T 2256c4cd63e6474aa804844ed7cd18fa P e083b2fa907d42b3b33dfba2d9f45240 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:53.251832  4115 raft_consensus.cc:515] T b03341ea7bb64c2085bdecf904d11548 P e134dafee8df424690057d14e75c2e82 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:53.254351  4115 leader_election.cc:290] T b03341ea7bb64c2085bdecf904d11548 P e134dafee8df424690057d14e75c2e82 [CANDIDATE]: Term 2 election: Requested vote from peers e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229), ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130:46493)
I20260709 12:27:53.256728  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03341ea7bb64c2085bdecf904d11548" candidate_uuid: "e134dafee8df424690057d14e75c2e82" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ffc6860a7daf42ea871d9389b9fce64a"
I20260709 12:27:53.257397  4040 raft_consensus.cc:3055] T b03341ea7bb64c2085bdecf904d11548 P ffc6860a7daf42ea871d9389b9fce64a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:53.257727  4040 raft_consensus.cc:740] T b03341ea7bb64c2085bdecf904d11548 P ffc6860a7daf42ea871d9389b9fce64a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ffc6860a7daf42ea871d9389b9fce64a, State: Running, Role: LEADER
I20260709 12:27:53.257815  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b03341ea7bb64c2085bdecf904d11548" candidate_uuid: "e134dafee8df424690057d14e75c2e82" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e083b2fa907d42b3b33dfba2d9f45240"
I20260709 12:27:53.258560  3965 raft_consensus.cc:3060] T b03341ea7bb64c2085bdecf904d11548 P e083b2fa907d42b3b33dfba2d9f45240 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:53.258630  4040 consensus_queue.cc:260] T b03341ea7bb64c2085bdecf904d11548 P ffc6860a7daf42ea871d9389b9fce64a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:53.260099  4040 raft_consensus.cc:3060] T b03341ea7bb64c2085bdecf904d11548 P ffc6860a7daf42ea871d9389b9fce64a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:53.262298  3964 raft_consensus.cc:515] T 2256c4cd63e6474aa804844ed7cd18fa P e083b2fa907d42b3b33dfba2d9f45240 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } } peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } }
I20260709 12:27:53.265812  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2256c4cd63e6474aa804844ed7cd18fa" candidate_uuid: "e083b2fa907d42b3b33dfba2d9f45240" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ffc6860a7daf42ea871d9389b9fce64a"
I20260709 12:27:53.266144  3965 raft_consensus.cc:2468] T b03341ea7bb64c2085bdecf904d11548 P e083b2fa907d42b3b33dfba2d9f45240 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e134dafee8df424690057d14e75c2e82 in term 2.
I20260709 12:27:53.266533  4041 raft_consensus.cc:3055] T 2256c4cd63e6474aa804844ed7cd18fa P ffc6860a7daf42ea871d9389b9fce64a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:53.266989  4041 raft_consensus.cc:740] T 2256c4cd63e6474aa804844ed7cd18fa P ffc6860a7daf42ea871d9389b9fce64a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ffc6860a7daf42ea871d9389b9fce64a, State: Running, Role: LEADER
I20260709 12:27:53.267786  4040 raft_consensus.cc:2468] T b03341ea7bb64c2085bdecf904d11548 P ffc6860a7daf42ea871d9389b9fce64a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e134dafee8df424690057d14e75c2e82 in term 2.
I20260709 12:27:53.267956  4041 consensus_queue.cc:260] T 2256c4cd63e6474aa804844ed7cd18fa P ffc6860a7daf42ea871d9389b9fce64a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } } peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } }
I20260709 12:27:53.268759  3964 leader_election.cc:290] T 2256c4cd63e6474aa804844ed7cd18fa P e083b2fa907d42b3b33dfba2d9f45240 [CANDIDATE]: Term 2 election: Requested vote from peers ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130:46493), e134dafee8df424690057d14e75c2e82 (127.23.245.131:36883)
I20260709 12:27:53.269398  4041 raft_consensus.cc:3060] T 2256c4cd63e6474aa804844ed7cd18fa P ffc6860a7daf42ea871d9389b9fce64a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:53.270272  4081 leader_election.cc:304] T b03341ea7bb64c2085bdecf904d11548 P e134dafee8df424690057d14e75c2e82 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e083b2fa907d42b3b33dfba2d9f45240, e134dafee8df424690057d14e75c2e82; no voters: 
I20260709 12:27:53.269326  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2256c4cd63e6474aa804844ed7cd18fa" candidate_uuid: "e083b2fa907d42b3b33dfba2d9f45240" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e134dafee8df424690057d14e75c2e82"
I20260709 12:27:53.271173  4182 raft_consensus.cc:2804] T b03341ea7bb64c2085bdecf904d11548 P e134dafee8df424690057d14e75c2e82 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:53.271754  4115 raft_consensus.cc:3060] T 2256c4cd63e6474aa804844ed7cd18fa P e134dafee8df424690057d14e75c2e82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:53.271804  4182 raft_consensus.cc:697] T b03341ea7bb64c2085bdecf904d11548 P e134dafee8df424690057d14e75c2e82 [term 2 LEADER]: Becoming Leader. State: Replica: e134dafee8df424690057d14e75c2e82, State: Running, Role: LEADER
I20260709 12:27:53.273605  4182 consensus_queue.cc:237] T b03341ea7bb64c2085bdecf904d11548 P e134dafee8df424690057d14e75c2e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:53.278873  4041 raft_consensus.cc:2468] T 2256c4cd63e6474aa804844ed7cd18fa P ffc6860a7daf42ea871d9389b9fce64a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e083b2fa907d42b3b33dfba2d9f45240 in term 2.
I20260709 12:27:53.280505  3930 leader_election.cc:304] T 2256c4cd63e6474aa804844ed7cd18fa P e083b2fa907d42b3b33dfba2d9f45240 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e083b2fa907d42b3b33dfba2d9f45240, ffc6860a7daf42ea871d9389b9fce64a; no voters: 
I20260709 12:27:53.280732  4115 raft_consensus.cc:2468] T 2256c4cd63e6474aa804844ed7cd18fa P e134dafee8df424690057d14e75c2e82 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e083b2fa907d42b3b33dfba2d9f45240 in term 2.
I20260709 12:27:53.281375  4217 raft_consensus.cc:2804] T 2256c4cd63e6474aa804844ed7cd18fa P e083b2fa907d42b3b33dfba2d9f45240 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:53.281876  4217 raft_consensus.cc:697] T 2256c4cd63e6474aa804844ed7cd18fa P e083b2fa907d42b3b33dfba2d9f45240 [term 2 LEADER]: Becoming Leader. State: Replica: e083b2fa907d42b3b33dfba2d9f45240, State: Running, Role: LEADER
I20260709 12:27:53.282052  3862 catalog_manager.cc:5697] T b03341ea7bb64c2085bdecf904d11548 P e134dafee8df424690057d14e75c2e82 reported cstate change: term changed from 1 to 2, leader changed from ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130) to e134dafee8df424690057d14e75c2e82 (127.23.245.131). New cstate: current_term: 2 leader_uuid: "e134dafee8df424690057d14e75c2e82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:53.282719  4217 consensus_queue.cc:237] T 2256c4cd63e6474aa804844ed7cd18fa P e083b2fa907d42b3b33dfba2d9f45240 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } } peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } }
I20260709 12:27:53.290624  3864 catalog_manager.cc:5697] T 2256c4cd63e6474aa804844ed7cd18fa P e083b2fa907d42b3b33dfba2d9f45240 reported cstate change: term changed from 1 to 2, leader changed from ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130) to e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129). New cstate: current_term: 2 leader_uuid: "e083b2fa907d42b3b33dfba2d9f45240" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:53.334434  4159 raft_consensus.cc:993] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e134dafee8df424690057d14e75c2e82: : Instructing follower e083b2fa907d42b3b33dfba2d9f45240 to start an election
I20260709 12:27:53.334923  4182 raft_consensus.cc:1081] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e134dafee8df424690057d14e75c2e82 [term 1 LEADER]: Signalling peer e083b2fa907d42b3b33dfba2d9f45240 to start an election
I20260709 12:27:53.336508  3964 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ccef56abf48c4dd5bbb5bd65364ae3a9"
dest_uuid: "e083b2fa907d42b3b33dfba2d9f45240"
 from {username='slave'} at 127.0.0.1:50398
I20260709 12:27:53.337198  3964 raft_consensus.cc:493] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e083b2fa907d42b3b33dfba2d9f45240 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:53.337574  3964 raft_consensus.cc:3060] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e083b2fa907d42b3b33dfba2d9f45240 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:53.344310  3964 raft_consensus.cc:515] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e083b2fa907d42b3b33dfba2d9f45240 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:53.346302  3964 leader_election.cc:290] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e083b2fa907d42b3b33dfba2d9f45240 [CANDIDATE]: Term 2 election: Requested vote from peers ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130:46493), e134dafee8df424690057d14e75c2e82 (127.23.245.131:36883)
I20260709 12:27:53.346975  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccef56abf48c4dd5bbb5bd65364ae3a9" candidate_uuid: "e083b2fa907d42b3b33dfba2d9f45240" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ffc6860a7daf42ea871d9389b9fce64a"
I20260709 12:27:53.347283  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccef56abf48c4dd5bbb5bd65364ae3a9" candidate_uuid: "e083b2fa907d42b3b33dfba2d9f45240" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e134dafee8df424690057d14e75c2e82"
I20260709 12:27:53.347597  4041 raft_consensus.cc:3060] T ccef56abf48c4dd5bbb5bd65364ae3a9 P ffc6860a7daf42ea871d9389b9fce64a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:53.347860  4115 raft_consensus.cc:3055] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e134dafee8df424690057d14e75c2e82 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:53.348222  4115 raft_consensus.cc:740] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e134dafee8df424690057d14e75c2e82 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e134dafee8df424690057d14e75c2e82, State: Running, Role: LEADER
I20260709 12:27:53.348966  4115 consensus_queue.cc:260] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e134dafee8df424690057d14e75c2e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:53.349892  4115 raft_consensus.cc:3060] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e134dafee8df424690057d14e75c2e82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:53.352860  4041 raft_consensus.cc:2468] T ccef56abf48c4dd5bbb5bd65364ae3a9 P ffc6860a7daf42ea871d9389b9fce64a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e083b2fa907d42b3b33dfba2d9f45240 in term 2.
I20260709 12:27:53.354010  3930 leader_election.cc:304] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e083b2fa907d42b3b33dfba2d9f45240 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e083b2fa907d42b3b33dfba2d9f45240, ffc6860a7daf42ea871d9389b9fce64a; no voters: 
I20260709 12:27:53.354846  4217 raft_consensus.cc:2804] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e083b2fa907d42b3b33dfba2d9f45240 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:53.355324  4217 raft_consensus.cc:697] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e083b2fa907d42b3b33dfba2d9f45240 [term 2 LEADER]: Becoming Leader. State: Replica: e083b2fa907d42b3b33dfba2d9f45240, State: Running, Role: LEADER
I20260709 12:27:53.355386  4115 raft_consensus.cc:2468] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e134dafee8df424690057d14e75c2e82 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e083b2fa907d42b3b33dfba2d9f45240 in term 2.
I20260709 12:27:53.356158  4217 consensus_queue.cc:237] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e083b2fa907d42b3b33dfba2d9f45240 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:53.362174  3864 catalog_manager.cc:5697] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e083b2fa907d42b3b33dfba2d9f45240 reported cstate change: term changed from 1 to 2, leader changed from e134dafee8df424690057d14e75c2e82 (127.23.245.131) to e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129). New cstate: current_term: 2 leader_uuid: "e083b2fa907d42b3b33dfba2d9f45240" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:53.386778  4226 raft_consensus.cc:993] T 7e083776605c4a658bcca9cb211a4cf6 P ffc6860a7daf42ea871d9389b9fce64a: : Instructing follower e083b2fa907d42b3b33dfba2d9f45240 to start an election
I20260709 12:27:53.387259  4171 raft_consensus.cc:1081] T 7e083776605c4a658bcca9cb211a4cf6 P ffc6860a7daf42ea871d9389b9fce64a [term 1 LEADER]: Signalling peer e083b2fa907d42b3b33dfba2d9f45240 to start an election
I20260709 12:27:53.388736  3964 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7e083776605c4a658bcca9cb211a4cf6"
dest_uuid: "e083b2fa907d42b3b33dfba2d9f45240"
 from {username='slave'} at 127.0.0.1:50404
I20260709 12:27:53.389214  3964 raft_consensus.cc:493] T 7e083776605c4a658bcca9cb211a4cf6 P e083b2fa907d42b3b33dfba2d9f45240 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:53.389568  3964 raft_consensus.cc:3060] T 7e083776605c4a658bcca9cb211a4cf6 P e083b2fa907d42b3b33dfba2d9f45240 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:53.394704  3964 raft_consensus.cc:515] T 7e083776605c4a658bcca9cb211a4cf6 P e083b2fa907d42b3b33dfba2d9f45240 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:53.396368  3964 leader_election.cc:290] T 7e083776605c4a658bcca9cb211a4cf6 P e083b2fa907d42b3b33dfba2d9f45240 [CANDIDATE]: Term 2 election: Requested vote from peers ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130:46493), e134dafee8df424690057d14e75c2e82 (127.23.245.131:36883)
I20260709 12:27:53.397253  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e083776605c4a658bcca9cb211a4cf6" candidate_uuid: "e083b2fa907d42b3b33dfba2d9f45240" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ffc6860a7daf42ea871d9389b9fce64a"
I20260709 12:27:53.397574  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e083776605c4a658bcca9cb211a4cf6" candidate_uuid: "e083b2fa907d42b3b33dfba2d9f45240" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e134dafee8df424690057d14e75c2e82"
I20260709 12:27:53.398093  4041 raft_consensus.cc:3055] T 7e083776605c4a658bcca9cb211a4cf6 P ffc6860a7daf42ea871d9389b9fce64a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:53.398146  4115 raft_consensus.cc:3060] T 7e083776605c4a658bcca9cb211a4cf6 P e134dafee8df424690057d14e75c2e82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:53.398571  4041 raft_consensus.cc:740] T 7e083776605c4a658bcca9cb211a4cf6 P ffc6860a7daf42ea871d9389b9fce64a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ffc6860a7daf42ea871d9389b9fce64a, State: Running, Role: LEADER
I20260709 12:27:53.399366  4041 consensus_queue.cc:260] T 7e083776605c4a658bcca9cb211a4cf6 P ffc6860a7daf42ea871d9389b9fce64a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:53.400462  4041 raft_consensus.cc:3060] T 7e083776605c4a658bcca9cb211a4cf6 P ffc6860a7daf42ea871d9389b9fce64a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:53.406812  4115 raft_consensus.cc:2468] T 7e083776605c4a658bcca9cb211a4cf6 P e134dafee8df424690057d14e75c2e82 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e083b2fa907d42b3b33dfba2d9f45240 in term 2.
I20260709 12:27:53.407548  4041 raft_consensus.cc:2468] T 7e083776605c4a658bcca9cb211a4cf6 P ffc6860a7daf42ea871d9389b9fce64a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e083b2fa907d42b3b33dfba2d9f45240 in term 2.
I20260709 12:27:53.408192  3930 leader_election.cc:304] T 7e083776605c4a658bcca9cb211a4cf6 P e083b2fa907d42b3b33dfba2d9f45240 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e083b2fa907d42b3b33dfba2d9f45240, e134dafee8df424690057d14e75c2e82; no voters: 
I20260709 12:27:53.409078  4217 raft_consensus.cc:2804] T 7e083776605c4a658bcca9cb211a4cf6 P e083b2fa907d42b3b33dfba2d9f45240 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:53.409552  4217 raft_consensus.cc:697] T 7e083776605c4a658bcca9cb211a4cf6 P e083b2fa907d42b3b33dfba2d9f45240 [term 2 LEADER]: Becoming Leader. State: Replica: e083b2fa907d42b3b33dfba2d9f45240, State: Running, Role: LEADER
I20260709 12:27:53.410195  4217 consensus_queue.cc:237] T 7e083776605c4a658bcca9cb211a4cf6 P e083b2fa907d42b3b33dfba2d9f45240 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:53.416817  3864 catalog_manager.cc:5697] T 7e083776605c4a658bcca9cb211a4cf6 P e083b2fa907d42b3b33dfba2d9f45240 reported cstate change: term changed from 1 to 2, leader changed from ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130) to e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129). New cstate: current_term: 2 leader_uuid: "e083b2fa907d42b3b33dfba2d9f45240" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:53.417692  4159 raft_consensus.cc:993] T ca9249d3904b4b4580d1c289f923daee P e134dafee8df424690057d14e75c2e82: : Instructing follower ffc6860a7daf42ea871d9389b9fce64a to start an election
I20260709 12:27:53.418287  4182 raft_consensus.cc:1081] T ca9249d3904b4b4580d1c289f923daee P e134dafee8df424690057d14e75c2e82 [term 1 LEADER]: Signalling peer ffc6860a7daf42ea871d9389b9fce64a to start an election
I20260709 12:27:53.419792  4041 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca9249d3904b4b4580d1c289f923daee"
dest_uuid: "ffc6860a7daf42ea871d9389b9fce64a"
 from {username='slave'} at 127.0.0.1:39860
I20260709 12:27:53.420377  4041 raft_consensus.cc:493] T ca9249d3904b4b4580d1c289f923daee P ffc6860a7daf42ea871d9389b9fce64a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:53.420795  4041 raft_consensus.cc:3060] T ca9249d3904b4b4580d1c289f923daee P ffc6860a7daf42ea871d9389b9fce64a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:53.427132  4041 raft_consensus.cc:515] T ca9249d3904b4b4580d1c289f923daee P ffc6860a7daf42ea871d9389b9fce64a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:53.428714  4041 leader_election.cc:290] T ca9249d3904b4b4580d1c289f923daee P ffc6860a7daf42ea871d9389b9fce64a [CANDIDATE]: Term 2 election: Requested vote from peers e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229), e134dafee8df424690057d14e75c2e82 (127.23.245.131:36883)
I20260709 12:27:53.429522  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9249d3904b4b4580d1c289f923daee" candidate_uuid: "ffc6860a7daf42ea871d9389b9fce64a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e083b2fa907d42b3b33dfba2d9f45240"
I20260709 12:27:53.429751  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca9249d3904b4b4580d1c289f923daee" candidate_uuid: "ffc6860a7daf42ea871d9389b9fce64a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e134dafee8df424690057d14e75c2e82"
I20260709 12:27:53.430087  3964 raft_consensus.cc:3060] T ca9249d3904b4b4580d1c289f923daee P e083b2fa907d42b3b33dfba2d9f45240 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:53.430455  4115 raft_consensus.cc:3055] T ca9249d3904b4b4580d1c289f923daee P e134dafee8df424690057d14e75c2e82 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:53.430740  4115 raft_consensus.cc:740] T ca9249d3904b4b4580d1c289f923daee P e134dafee8df424690057d14e75c2e82 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e134dafee8df424690057d14e75c2e82, State: Running, Role: LEADER
I20260709 12:27:53.431493  4115 consensus_queue.cc:260] T ca9249d3904b4b4580d1c289f923daee P e134dafee8df424690057d14e75c2e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:53.432475  4115 raft_consensus.cc:3060] T ca9249d3904b4b4580d1c289f923daee P e134dafee8df424690057d14e75c2e82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:53.435343  3964 raft_consensus.cc:2468] T ca9249d3904b4b4580d1c289f923daee P e083b2fa907d42b3b33dfba2d9f45240 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffc6860a7daf42ea871d9389b9fce64a in term 2.
I20260709 12:27:53.436470  4007 leader_election.cc:304] T ca9249d3904b4b4580d1c289f923daee P ffc6860a7daf42ea871d9389b9fce64a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e083b2fa907d42b3b33dfba2d9f45240, ffc6860a7daf42ea871d9389b9fce64a; no voters: 
I20260709 12:27:53.437199  4171 raft_consensus.cc:2804] T ca9249d3904b4b4580d1c289f923daee P ffc6860a7daf42ea871d9389b9fce64a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:53.437652  4171 raft_consensus.cc:697] T ca9249d3904b4b4580d1c289f923daee P ffc6860a7daf42ea871d9389b9fce64a [term 2 LEADER]: Becoming Leader. State: Replica: ffc6860a7daf42ea871d9389b9fce64a, State: Running, Role: LEADER
I20260709 12:27:53.438462  4171 consensus_queue.cc:237] T ca9249d3904b4b4580d1c289f923daee P ffc6860a7daf42ea871d9389b9fce64a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:53.438903  4115 raft_consensus.cc:2468] T ca9249d3904b4b4580d1c289f923daee P e134dafee8df424690057d14e75c2e82 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffc6860a7daf42ea871d9389b9fce64a in term 2.
I20260709 12:27:53.445143  3864 catalog_manager.cc:5697] T ca9249d3904b4b4580d1c289f923daee P ffc6860a7daf42ea871d9389b9fce64a reported cstate change: term changed from 1 to 2, leader changed from e134dafee8df424690057d14e75c2e82 (127.23.245.131) to ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130). New cstate: current_term: 2 leader_uuid: "ffc6860a7daf42ea871d9389b9fce64a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:53.486661  4197 raft_consensus.cc:993] T 9dccf99aa7894eb5b71293becf61aff1 P e134dafee8df424690057d14e75c2e82: : Instructing follower ffc6860a7daf42ea871d9389b9fce64a to start an election
I20260709 12:27:53.487074  4182 raft_consensus.cc:1081] T 9dccf99aa7894eb5b71293becf61aff1 P e134dafee8df424690057d14e75c2e82 [term 1 LEADER]: Signalling peer ffc6860a7daf42ea871d9389b9fce64a to start an election
I20260709 12:27:53.488444  4041 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9dccf99aa7894eb5b71293becf61aff1"
dest_uuid: "ffc6860a7daf42ea871d9389b9fce64a"
 from {username='slave'} at 127.0.0.1:39860
I20260709 12:27:53.488862  4041 raft_consensus.cc:493] T 9dccf99aa7894eb5b71293becf61aff1 P ffc6860a7daf42ea871d9389b9fce64a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:53.489101  4041 raft_consensus.cc:3060] T 9dccf99aa7894eb5b71293becf61aff1 P ffc6860a7daf42ea871d9389b9fce64a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:53.494014  4041 raft_consensus.cc:515] T 9dccf99aa7894eb5b71293becf61aff1 P ffc6860a7daf42ea871d9389b9fce64a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:53.495646  4041 leader_election.cc:290] T 9dccf99aa7894eb5b71293becf61aff1 P ffc6860a7daf42ea871d9389b9fce64a [CANDIDATE]: Term 2 election: Requested vote from peers e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229), e134dafee8df424690057d14e75c2e82 (127.23.245.131:36883)
I20260709 12:27:53.496398  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dccf99aa7894eb5b71293becf61aff1" candidate_uuid: "ffc6860a7daf42ea871d9389b9fce64a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e083b2fa907d42b3b33dfba2d9f45240"
I20260709 12:27:53.496698  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dccf99aa7894eb5b71293becf61aff1" candidate_uuid: "ffc6860a7daf42ea871d9389b9fce64a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e134dafee8df424690057d14e75c2e82"
I20260709 12:27:53.497105  3964 raft_consensus.cc:3060] T 9dccf99aa7894eb5b71293becf61aff1 P e083b2fa907d42b3b33dfba2d9f45240 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:53.497352  4115 raft_consensus.cc:3055] T 9dccf99aa7894eb5b71293becf61aff1 P e134dafee8df424690057d14e75c2e82 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:53.497697  4115 raft_consensus.cc:740] T 9dccf99aa7894eb5b71293becf61aff1 P e134dafee8df424690057d14e75c2e82 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e134dafee8df424690057d14e75c2e82, State: Running, Role: LEADER
I20260709 12:27:53.498550  4115 consensus_queue.cc:260] T 9dccf99aa7894eb5b71293becf61aff1 P e134dafee8df424690057d14e75c2e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:53.499843  4115 raft_consensus.cc:3060] T 9dccf99aa7894eb5b71293becf61aff1 P e134dafee8df424690057d14e75c2e82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:53.504552  3964 raft_consensus.cc:2468] T 9dccf99aa7894eb5b71293becf61aff1 P e083b2fa907d42b3b33dfba2d9f45240 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffc6860a7daf42ea871d9389b9fce64a in term 2.
I20260709 12:27:53.505968  4007 leader_election.cc:304] T 9dccf99aa7894eb5b71293becf61aff1 P ffc6860a7daf42ea871d9389b9fce64a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e083b2fa907d42b3b33dfba2d9f45240, ffc6860a7daf42ea871d9389b9fce64a; no voters: 
I20260709 12:27:53.506762  4171 raft_consensus.cc:2804] T 9dccf99aa7894eb5b71293becf61aff1 P ffc6860a7daf42ea871d9389b9fce64a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:53.506942  4115 raft_consensus.cc:2468] T 9dccf99aa7894eb5b71293becf61aff1 P e134dafee8df424690057d14e75c2e82 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffc6860a7daf42ea871d9389b9fce64a in term 2.
I20260709 12:27:53.507217  4171 raft_consensus.cc:697] T 9dccf99aa7894eb5b71293becf61aff1 P ffc6860a7daf42ea871d9389b9fce64a [term 2 LEADER]: Becoming Leader. State: Replica: ffc6860a7daf42ea871d9389b9fce64a, State: Running, Role: LEADER
I20260709 12:27:53.508239  4171 consensus_queue.cc:237] T 9dccf99aa7894eb5b71293becf61aff1 P ffc6860a7daf42ea871d9389b9fce64a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:53.514238  3864 catalog_manager.cc:5697] T 9dccf99aa7894eb5b71293becf61aff1 P ffc6860a7daf42ea871d9389b9fce64a reported cstate change: term changed from 1 to 2, leader changed from e134dafee8df424690057d14e75c2e82 (127.23.245.131) to ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130). New cstate: current_term: 2 leader_uuid: "ffc6860a7daf42ea871d9389b9fce64a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:53.549899  4216 raft_consensus.cc:993] T 018fbc94678e41318e867a918691041b P e083b2fa907d42b3b33dfba2d9f45240: : Instructing follower ffc6860a7daf42ea871d9389b9fce64a to start an election
I20260709 12:27:53.550400  4216 raft_consensus.cc:1081] T 018fbc94678e41318e867a918691041b P e083b2fa907d42b3b33dfba2d9f45240 [term 1 LEADER]: Signalling peer ffc6860a7daf42ea871d9389b9fce64a to start an election
I20260709 12:27:53.551971  4041 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "018fbc94678e41318e867a918691041b"
dest_uuid: "ffc6860a7daf42ea871d9389b9fce64a"
 from {username='slave'} at 127.0.0.1:39850
I20260709 12:27:53.552471  4041 raft_consensus.cc:493] T 018fbc94678e41318e867a918691041b P ffc6860a7daf42ea871d9389b9fce64a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:53.552767  4041 raft_consensus.cc:3060] T 018fbc94678e41318e867a918691041b P ffc6860a7daf42ea871d9389b9fce64a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:53.559109  4041 raft_consensus.cc:515] T 018fbc94678e41318e867a918691041b P ffc6860a7daf42ea871d9389b9fce64a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:53.562224  4041 leader_election.cc:290] T 018fbc94678e41318e867a918691041b P ffc6860a7daf42ea871d9389b9fce64a [CANDIDATE]: Term 2 election: Requested vote from peers e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229), e134dafee8df424690057d14e75c2e82 (127.23.245.131:36883)
I20260709 12:27:53.562636  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018fbc94678e41318e867a918691041b" candidate_uuid: "ffc6860a7daf42ea871d9389b9fce64a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e083b2fa907d42b3b33dfba2d9f45240"
I20260709 12:27:53.563710  3964 raft_consensus.cc:3055] T 018fbc94678e41318e867a918691041b P e083b2fa907d42b3b33dfba2d9f45240 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:53.563402  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018fbc94678e41318e867a918691041b" candidate_uuid: "ffc6860a7daf42ea871d9389b9fce64a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e134dafee8df424690057d14e75c2e82"
I20260709 12:27:53.564296  3964 raft_consensus.cc:740] T 018fbc94678e41318e867a918691041b P e083b2fa907d42b3b33dfba2d9f45240 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e083b2fa907d42b3b33dfba2d9f45240, State: Running, Role: LEADER
I20260709 12:27:53.564431  4115 raft_consensus.cc:3060] T 018fbc94678e41318e867a918691041b P e134dafee8df424690057d14e75c2e82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:53.565274  3964 consensus_queue.cc:260] T 018fbc94678e41318e867a918691041b P e083b2fa907d42b3b33dfba2d9f45240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:53.566661  3964 raft_consensus.cc:3060] T 018fbc94678e41318e867a918691041b P e083b2fa907d42b3b33dfba2d9f45240 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:53.572203  4115 raft_consensus.cc:2468] T 018fbc94678e41318e867a918691041b P e134dafee8df424690057d14e75c2e82 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffc6860a7daf42ea871d9389b9fce64a in term 2.
I20260709 12:27:53.573472  4005 leader_election.cc:304] T 018fbc94678e41318e867a918691041b P ffc6860a7daf42ea871d9389b9fce64a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e134dafee8df424690057d14e75c2e82, ffc6860a7daf42ea871d9389b9fce64a; no voters: 
I20260709 12:27:53.573997  3964 raft_consensus.cc:2468] T 018fbc94678e41318e867a918691041b P e083b2fa907d42b3b33dfba2d9f45240 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffc6860a7daf42ea871d9389b9fce64a in term 2.
I20260709 12:27:53.574347  4171 raft_consensus.cc:2804] T 018fbc94678e41318e867a918691041b P ffc6860a7daf42ea871d9389b9fce64a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:53.575069  4171 raft_consensus.cc:697] T 018fbc94678e41318e867a918691041b P ffc6860a7daf42ea871d9389b9fce64a [term 2 LEADER]: Becoming Leader. State: Replica: ffc6860a7daf42ea871d9389b9fce64a, State: Running, Role: LEADER
I20260709 12:27:53.575851  4171 consensus_queue.cc:237] T 018fbc94678e41318e867a918691041b P ffc6860a7daf42ea871d9389b9fce64a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:53.582499  3864 catalog_manager.cc:5697] T 018fbc94678e41318e867a918691041b P ffc6860a7daf42ea871d9389b9fce64a reported cstate change: term changed from 1 to 2, leader changed from e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129) to ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130). New cstate: current_term: 2 leader_uuid: "ffc6860a7daf42ea871d9389b9fce64a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:53.662242  4041 raft_consensus.cc:1275] T b03341ea7bb64c2085bdecf904d11548 P ffc6860a7daf42ea871d9389b9fce64a [term 2 FOLLOWER]: Refusing update from remote peer e134dafee8df424690057d14e75c2e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:53.663537  4182 consensus_queue.cc:1048] T b03341ea7bb64c2085bdecf904d11548 P e134dafee8df424690057d14e75c2e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:53.671638  3964 raft_consensus.cc:1275] T b03341ea7bb64c2085bdecf904d11548 P e083b2fa907d42b3b33dfba2d9f45240 [term 2 FOLLOWER]: Refusing update from remote peer e134dafee8df424690057d14e75c2e82: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:53.673152  4159 consensus_queue.cc:1048] T b03341ea7bb64c2085bdecf904d11548 P e134dafee8df424690057d14e75c2e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:53.752426  4114 raft_consensus.cc:1275] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e134dafee8df424690057d14e75c2e82 [term 2 FOLLOWER]: Refusing update from remote peer e083b2fa907d42b3b33dfba2d9f45240: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:53.753852  4216 consensus_queue.cc:1048] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e083b2fa907d42b3b33dfba2d9f45240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:53.758378  4041 raft_consensus.cc:1275] T ccef56abf48c4dd5bbb5bd65364ae3a9 P ffc6860a7daf42ea871d9389b9fce64a [term 2 FOLLOWER]: Refusing update from remote peer e083b2fa907d42b3b33dfba2d9f45240: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:53.760983  4217 consensus_queue.cc:1048] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e083b2fa907d42b3b33dfba2d9f45240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:53.809861  4114 raft_consensus.cc:1275] T 2256c4cd63e6474aa804844ed7cd18fa P e134dafee8df424690057d14e75c2e82 [term 2 FOLLOWER]: Refusing update from remote peer e083b2fa907d42b3b33dfba2d9f45240: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:53.811221  4241 consensus_queue.cc:1048] T 2256c4cd63e6474aa804844ed7cd18fa P e083b2fa907d42b3b33dfba2d9f45240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:53.813196  4041 raft_consensus.cc:1275] T 7e083776605c4a658bcca9cb211a4cf6 P ffc6860a7daf42ea871d9389b9fce64a [term 2 FOLLOWER]: Refusing update from remote peer e083b2fa907d42b3b33dfba2d9f45240: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:53.814579  4241 consensus_queue.cc:1048] T 7e083776605c4a658bcca9cb211a4cf6 P e083b2fa907d42b3b33dfba2d9f45240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:53.825186  4114 raft_consensus.cc:1275] T 7e083776605c4a658bcca9cb211a4cf6 P e134dafee8df424690057d14e75c2e82 [term 2 FOLLOWER]: Refusing update from remote peer e083b2fa907d42b3b33dfba2d9f45240: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:53.830358  4241 consensus_queue.cc:1048] T 7e083776605c4a658bcca9cb211a4cf6 P e083b2fa907d42b3b33dfba2d9f45240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:53.831131  4041 raft_consensus.cc:1275] T 2256c4cd63e6474aa804844ed7cd18fa P ffc6860a7daf42ea871d9389b9fce64a [term 2 FOLLOWER]: Refusing update from remote peer e083b2fa907d42b3b33dfba2d9f45240: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:53.832774  4241 consensus_queue.cc:1048] T 2256c4cd63e6474aa804844ed7cd18fa P e083b2fa907d42b3b33dfba2d9f45240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:53.845335  3964 raft_consensus.cc:1275] T ca9249d3904b4b4580d1c289f923daee P e083b2fa907d42b3b33dfba2d9f45240 [term 2 FOLLOWER]: Refusing update from remote peer ffc6860a7daf42ea871d9389b9fce64a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:53.846586  4171 consensus_queue.cc:1048] T ca9249d3904b4b4580d1c289f923daee P ffc6860a7daf42ea871d9389b9fce64a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:53.856600  4114 raft_consensus.cc:1275] T ca9249d3904b4b4580d1c289f923daee P e134dafee8df424690057d14e75c2e82 [term 2 FOLLOWER]: Refusing update from remote peer ffc6860a7daf42ea871d9389b9fce64a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:53.858603  4226 consensus_queue.cc:1048] T ca9249d3904b4b4580d1c289f923daee P ffc6860a7daf42ea871d9389b9fce64a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:53.937390  4114 raft_consensus.cc:1275] T 9dccf99aa7894eb5b71293becf61aff1 P e134dafee8df424690057d14e75c2e82 [term 2 FOLLOWER]: Refusing update from remote peer ffc6860a7daf42ea871d9389b9fce64a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:53.938800  4188 consensus_queue.cc:1048] T 9dccf99aa7894eb5b71293becf61aff1 P ffc6860a7daf42ea871d9389b9fce64a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:53.947755  3964 raft_consensus.cc:1275] T 9dccf99aa7894eb5b71293becf61aff1 P e083b2fa907d42b3b33dfba2d9f45240 [term 2 FOLLOWER]: Refusing update from remote peer ffc6860a7daf42ea871d9389b9fce64a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:53.949371  4226 consensus_queue.cc:1048] T 9dccf99aa7894eb5b71293becf61aff1 P ffc6860a7daf42ea871d9389b9fce64a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:54.132068  3964 raft_consensus.cc:1275] T 018fbc94678e41318e867a918691041b P e083b2fa907d42b3b33dfba2d9f45240 [term 2 FOLLOWER]: Refusing update from remote peer ffc6860a7daf42ea871d9389b9fce64a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:54.133548  4226 consensus_queue.cc:1048] T 018fbc94678e41318e867a918691041b P ffc6860a7daf42ea871d9389b9fce64a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:54.142761  4114 raft_consensus.cc:1275] T 018fbc94678e41318e867a918691041b P e134dafee8df424690057d14e75c2e82 [term 2 FOLLOWER]: Refusing update from remote peer ffc6860a7daf42ea871d9389b9fce64a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:54.147148  4188 consensus_queue.cc:1048] T 018fbc94678e41318e867a918691041b P ffc6860a7daf42ea871d9389b9fce64a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:56.227275  3864 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51758:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:27:56.231109  3864 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:27:56.282135  3954 tablet_service.cc:1511] Processing CreateTablet for tablet cf7d17c9f4f54d63ac12f4015065ab60 (DEFAULT_TABLE table=soft_deleted_table [id=638529512a5f41229d38fa09b7e5d486]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:27:56.284138  3954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf7d17c9f4f54d63ac12f4015065ab60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.283908  4023 tablet_service.cc:1511] Processing CreateTablet for tablet cf7d17c9f4f54d63ac12f4015065ab60 (DEFAULT_TABLE table=soft_deleted_table [id=638529512a5f41229d38fa09b7e5d486]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:27:56.285179  4098 tablet_service.cc:1511] Processing CreateTablet for tablet cf7d17c9f4f54d63ac12f4015065ab60 (DEFAULT_TABLE table=soft_deleted_table [id=638529512a5f41229d38fa09b7e5d486]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:27:56.285996  4023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf7d17c9f4f54d63ac12f4015065ab60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.287245  4098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf7d17c9f4f54d63ac12f4015065ab60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.290755  3948 tablet_service.cc:1511] Processing CreateTablet for tablet acbdf543b174470e9a0d4e181804ae01 (DEFAULT_TABLE table=soft_deleted_table [id=638529512a5f41229d38fa09b7e5d486]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:27:56.292428  4024 tablet_service.cc:1511] Processing CreateTablet for tablet acbdf543b174470e9a0d4e181804ae01 (DEFAULT_TABLE table=soft_deleted_table [id=638529512a5f41229d38fa09b7e5d486]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:27:56.294083  4024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acbdf543b174470e9a0d4e181804ae01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.298358  4100 tablet_service.cc:1511] Processing CreateTablet for tablet acbdf543b174470e9a0d4e181804ae01 (DEFAULT_TABLE table=soft_deleted_table [id=638529512a5f41229d38fa09b7e5d486]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:27:56.299597  3949 tablet_service.cc:1511] Processing CreateTablet for tablet 2ee866cdb98640d78e7b5d108a652846 (DEFAULT_TABLE table=soft_deleted_table [id=638529512a5f41229d38fa09b7e5d486]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:27:56.300180  4100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acbdf543b174470e9a0d4e181804ae01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.302775  4028 tablet_service.cc:1511] Processing CreateTablet for tablet 2ee866cdb98640d78e7b5d108a652846 (DEFAULT_TABLE table=soft_deleted_table [id=638529512a5f41229d38fa09b7e5d486]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:27:56.304366  4028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ee866cdb98640d78e7b5d108a652846. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:27:56.306972  3912 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:56.292431  3948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acbdf543b174470e9a0d4e181804ae01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.308436  4102 tablet_service.cc:1511] Processing CreateTablet for tablet 2ee866cdb98640d78e7b5d108a652846 (DEFAULT_TABLE table=soft_deleted_table [id=638529512a5f41229d38fa09b7e5d486]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:27:56.310410  4102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ee866cdb98640d78e7b5d108a652846. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.312201  3949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ee866cdb98640d78e7b5d108a652846. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.311936  3950 tablet_service.cc:1511] Processing CreateTablet for tablet 4e1151150f9a467ebd21f401fb352c29 (DEFAULT_TABLE table=soft_deleted_table [id=638529512a5f41229d38fa09b7e5d486]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:27:56.313455  3950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e1151150f9a467ebd21f401fb352c29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.321962  4029 tablet_service.cc:1511] Processing CreateTablet for tablet 4e1151150f9a467ebd21f401fb352c29 (DEFAULT_TABLE table=soft_deleted_table [id=638529512a5f41229d38fa09b7e5d486]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:27:56.323498  4029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e1151150f9a467ebd21f401fb352c29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.338723  4105 tablet_service.cc:1511] Processing CreateTablet for tablet 4e1151150f9a467ebd21f401fb352c29 (DEFAULT_TABLE table=soft_deleted_table [id=638529512a5f41229d38fa09b7e5d486]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:27:56.343163  4262 tablet_bootstrap.cc:492] T cf7d17c9f4f54d63ac12f4015065ab60 P e083b2fa907d42b3b33dfba2d9f45240: Bootstrap starting.
I20260709 12:27:56.346105  3954 tablet_service.cc:1511] Processing CreateTablet for tablet d97a598a1a4d49d6af38a80b7d94085a (DEFAULT_TABLE table=soft_deleted_table [id=638529512a5f41229d38fa09b7e5d486]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:27:56.350654  3954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d97a598a1a4d49d6af38a80b7d94085a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.353502  4026 tablet_service.cc:1511] Processing CreateTablet for tablet d97a598a1a4d49d6af38a80b7d94085a (DEFAULT_TABLE table=soft_deleted_table [id=638529512a5f41229d38fa09b7e5d486]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:27:56.354997  4026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d97a598a1a4d49d6af38a80b7d94085a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.356438  3951 tablet_service.cc:1511] Processing CreateTablet for tablet b76c818ee9f34bddaec899987166e3c7 (DEFAULT_TABLE table=soft_deleted_table [id=638529512a5f41229d38fa09b7e5d486]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:27:56.357887  3951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b76c818ee9f34bddaec899987166e3c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.362051  4099 tablet_service.cc:1511] Processing CreateTablet for tablet d97a598a1a4d49d6af38a80b7d94085a (DEFAULT_TABLE table=soft_deleted_table [id=638529512a5f41229d38fa09b7e5d486]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:27:56.364321  4105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e1151150f9a467ebd21f401fb352c29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.366043  4099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d97a598a1a4d49d6af38a80b7d94085a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.386971  4262 tablet_bootstrap.cc:654] T cf7d17c9f4f54d63ac12f4015065ab60 P e083b2fa907d42b3b33dfba2d9f45240: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.405635  4100 tablet_service.cc:1511] Processing CreateTablet for tablet b76c818ee9f34bddaec899987166e3c7 (DEFAULT_TABLE table=soft_deleted_table [id=638529512a5f41229d38fa09b7e5d486]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:27:56.407047  4100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b76c818ee9f34bddaec899987166e3c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.412468  4024 tablet_service.cc:1511] Processing CreateTablet for tablet 70d90926ee274610a5addbacc456d3e6 (DEFAULT_TABLE table=soft_deleted_table [id=638529512a5f41229d38fa09b7e5d486]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:27:56.414427  4024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70d90926ee274610a5addbacc456d3e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.415297  3949 tablet_service.cc:1511] Processing CreateTablet for tablet 70d90926ee274610a5addbacc456d3e6 (DEFAULT_TABLE table=soft_deleted_table [id=638529512a5f41229d38fa09b7e5d486]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:27:56.422778  3949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70d90926ee274610a5addbacc456d3e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.412472  4026 tablet_service.cc:1511] Processing CreateTablet for tablet b76c818ee9f34bddaec899987166e3c7 (DEFAULT_TABLE table=soft_deleted_table [id=638529512a5f41229d38fa09b7e5d486]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:27:56.424111  4026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b76c818ee9f34bddaec899987166e3c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.430678  4264 tablet_bootstrap.cc:492] T 2ee866cdb98640d78e7b5d108a652846 P e134dafee8df424690057d14e75c2e82: Bootstrap starting.
I20260709 12:27:56.436443  3954 tablet_service.cc:1511] Processing CreateTablet for tablet d7bf8a5e5f8648a08295d2e0e9da0b41 (DEFAULT_TABLE table=soft_deleted_table [id=638529512a5f41229d38fa09b7e5d486]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:27:56.437791  3954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7bf8a5e5f8648a08295d2e0e9da0b41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.442354  4023 tablet_service.cc:1511] Processing CreateTablet for tablet d7bf8a5e5f8648a08295d2e0e9da0b41 (DEFAULT_TABLE table=soft_deleted_table [id=638529512a5f41229d38fa09b7e5d486]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:27:56.443382  4023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7bf8a5e5f8648a08295d2e0e9da0b41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.444962  4102 tablet_service.cc:1511] Processing CreateTablet for tablet d7bf8a5e5f8648a08295d2e0e9da0b41 (DEFAULT_TABLE table=soft_deleted_table [id=638529512a5f41229d38fa09b7e5d486]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:27:56.447543  4102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7bf8a5e5f8648a08295d2e0e9da0b41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.431270  4105 tablet_service.cc:1511] Processing CreateTablet for tablet 70d90926ee274610a5addbacc456d3e6 (DEFAULT_TABLE table=soft_deleted_table [id=638529512a5f41229d38fa09b7e5d486]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:27:56.432050  4262 tablet_bootstrap.cc:492] T cf7d17c9f4f54d63ac12f4015065ab60 P e083b2fa907d42b3b33dfba2d9f45240: No bootstrap required, opened a new log
I20260709 12:27:56.448491  4262 ts_tablet_manager.cc:1403] T cf7d17c9f4f54d63ac12f4015065ab60 P e083b2fa907d42b3b33dfba2d9f45240: Time spent bootstrapping tablet: real 0.106s	user 0.007s	sys 0.009s
I20260709 12:27:56.451737  4262 raft_consensus.cc:359] T cf7d17c9f4f54d63ac12f4015065ab60 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.453022  4262 raft_consensus.cc:385] T cf7d17c9f4f54d63ac12f4015065ab60 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.453385  4262 raft_consensus.cc:740] T cf7d17c9f4f54d63ac12f4015065ab60 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e083b2fa907d42b3b33dfba2d9f45240, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.432986  3951 tablet_service.cc:1511] Processing CreateTablet for tablet 6a3d62d2c10d46e1ae7198117fa43d67 (DEFAULT_TABLE table=soft_deleted_table [id=638529512a5f41229d38fa09b7e5d486]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:27:56.454520  3951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a3d62d2c10d46e1ae7198117fa43d67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.457442  4262 consensus_queue.cc:260] T cf7d17c9f4f54d63ac12f4015065ab60 P e083b2fa907d42b3b33dfba2d9f45240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.434554  4099 tablet_service.cc:1511] Processing CreateTablet for tablet 6a3d62d2c10d46e1ae7198117fa43d67 (DEFAULT_TABLE table=soft_deleted_table [id=638529512a5f41229d38fa09b7e5d486]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:27:56.432627  4263 tablet_bootstrap.cc:492] T 2ee866cdb98640d78e7b5d108a652846 P ffc6860a7daf42ea871d9389b9fce64a: Bootstrap starting.
I20260709 12:27:56.463557  4099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a3d62d2c10d46e1ae7198117fa43d67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.433763  4028 tablet_service.cc:1511] Processing CreateTablet for tablet 6a3d62d2c10d46e1ae7198117fa43d67 (DEFAULT_TABLE table=soft_deleted_table [id=638529512a5f41229d38fa09b7e5d486]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:27:56.459664  4264 tablet_bootstrap.cc:654] T 2ee866cdb98640d78e7b5d108a652846 P e134dafee8df424690057d14e75c2e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.473532  4262 ts_tablet_manager.cc:1434] T cf7d17c9f4f54d63ac12f4015065ab60 P e083b2fa907d42b3b33dfba2d9f45240: Time spent starting tablet: real 0.025s	user 0.001s	sys 0.006s
I20260709 12:27:56.474617  4262 tablet_bootstrap.cc:492] T 4e1151150f9a467ebd21f401fb352c29 P e083b2fa907d42b3b33dfba2d9f45240: Bootstrap starting.
I20260709 12:27:56.479329  4028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a3d62d2c10d46e1ae7198117fa43d67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.480650  4105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70d90926ee274610a5addbacc456d3e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.497470  4262 tablet_bootstrap.cc:654] T 4e1151150f9a467ebd21f401fb352c29 P e083b2fa907d42b3b33dfba2d9f45240: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.502521  4263 tablet_bootstrap.cc:654] T 2ee866cdb98640d78e7b5d108a652846 P ffc6860a7daf42ea871d9389b9fce64a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.509964  4262 tablet_bootstrap.cc:492] T 4e1151150f9a467ebd21f401fb352c29 P e083b2fa907d42b3b33dfba2d9f45240: No bootstrap required, opened a new log
I20260709 12:27:56.510637  4262 ts_tablet_manager.cc:1403] T 4e1151150f9a467ebd21f401fb352c29 P e083b2fa907d42b3b33dfba2d9f45240: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.007s
I20260709 12:27:56.512799  4264 tablet_bootstrap.cc:492] T 2ee866cdb98640d78e7b5d108a652846 P e134dafee8df424690057d14e75c2e82: No bootstrap required, opened a new log
I20260709 12:27:56.513366  4264 ts_tablet_manager.cc:1403] T 2ee866cdb98640d78e7b5d108a652846 P e134dafee8df424690057d14e75c2e82: Time spent bootstrapping tablet: real 0.083s	user 0.016s	sys 0.006s
I20260709 12:27:56.515436  4262 raft_consensus.cc:359] T 4e1151150f9a467ebd21f401fb352c29 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.516681  4262 raft_consensus.cc:385] T 4e1151150f9a467ebd21f401fb352c29 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.517099  4262 raft_consensus.cc:740] T 4e1151150f9a467ebd21f401fb352c29 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e083b2fa907d42b3b33dfba2d9f45240, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.516702  4264 raft_consensus.cc:359] T 2ee866cdb98640d78e7b5d108a652846 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.517673  4264 raft_consensus.cc:385] T 2ee866cdb98640d78e7b5d108a652846 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.517995  4264 raft_consensus.cc:740] T 2ee866cdb98640d78e7b5d108a652846 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e134dafee8df424690057d14e75c2e82, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.518102  4262 consensus_queue.cc:260] T 4e1151150f9a467ebd21f401fb352c29 P e083b2fa907d42b3b33dfba2d9f45240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.518846  4263 tablet_bootstrap.cc:492] T 2ee866cdb98640d78e7b5d108a652846 P ffc6860a7daf42ea871d9389b9fce64a: No bootstrap required, opened a new log
I20260709 12:27:56.519352  4264 consensus_queue.cc:260] T 2ee866cdb98640d78e7b5d108a652846 P e134dafee8df424690057d14e75c2e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.519443  4263 ts_tablet_manager.cc:1403] T 2ee866cdb98640d78e7b5d108a652846 P ffc6860a7daf42ea871d9389b9fce64a: Time spent bootstrapping tablet: real 0.087s	user 0.009s	sys 0.008s
I20260709 12:27:56.520920  4262 ts_tablet_manager.cc:1434] T 4e1151150f9a467ebd21f401fb352c29 P e083b2fa907d42b3b33dfba2d9f45240: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:27:56.522440  4262 tablet_bootstrap.cc:492] T acbdf543b174470e9a0d4e181804ae01 P e083b2fa907d42b3b33dfba2d9f45240: Bootstrap starting.
I20260709 12:27:56.523432  4263 raft_consensus.cc:359] T 2ee866cdb98640d78e7b5d108a652846 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.524304  4263 raft_consensus.cc:385] T 2ee866cdb98640d78e7b5d108a652846 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.524672  4263 raft_consensus.cc:740] T 2ee866cdb98640d78e7b5d108a652846 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffc6860a7daf42ea871d9389b9fce64a, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.525490  4263 consensus_queue.cc:260] T 2ee866cdb98640d78e7b5d108a652846 P ffc6860a7daf42ea871d9389b9fce64a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.528309  4263 ts_tablet_manager.cc:1434] T 2ee866cdb98640d78e7b5d108a652846 P ffc6860a7daf42ea871d9389b9fce64a: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:27:56.529402  4263 tablet_bootstrap.cc:492] T acbdf543b174470e9a0d4e181804ae01 P ffc6860a7daf42ea871d9389b9fce64a: Bootstrap starting.
I20260709 12:27:56.526015  4264 ts_tablet_manager.cc:1434] T 2ee866cdb98640d78e7b5d108a652846 P e134dafee8df424690057d14e75c2e82: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:27:56.530992  4262 tablet_bootstrap.cc:654] T acbdf543b174470e9a0d4e181804ae01 P e083b2fa907d42b3b33dfba2d9f45240: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.531255  4264 tablet_bootstrap.cc:492] T acbdf543b174470e9a0d4e181804ae01 P e134dafee8df424690057d14e75c2e82: Bootstrap starting.
I20260709 12:27:56.537731  4263 tablet_bootstrap.cc:654] T acbdf543b174470e9a0d4e181804ae01 P ffc6860a7daf42ea871d9389b9fce64a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.538996  4264 tablet_bootstrap.cc:654] T acbdf543b174470e9a0d4e181804ae01 P e134dafee8df424690057d14e75c2e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.578008  4264 tablet_bootstrap.cc:492] T acbdf543b174470e9a0d4e181804ae01 P e134dafee8df424690057d14e75c2e82: No bootstrap required, opened a new log
I20260709 12:27:56.578008  4263 tablet_bootstrap.cc:492] T acbdf543b174470e9a0d4e181804ae01 P ffc6860a7daf42ea871d9389b9fce64a: No bootstrap required, opened a new log
I20260709 12:27:56.578164  4262 tablet_bootstrap.cc:492] T acbdf543b174470e9a0d4e181804ae01 P e083b2fa907d42b3b33dfba2d9f45240: No bootstrap required, opened a new log
I20260709 12:27:56.578651  4264 ts_tablet_manager.cc:1403] T acbdf543b174470e9a0d4e181804ae01 P e134dafee8df424690057d14e75c2e82: Time spent bootstrapping tablet: real 0.048s	user 0.030s	sys 0.008s
I20260709 12:27:56.578811  4263 ts_tablet_manager.cc:1403] T acbdf543b174470e9a0d4e181804ae01 P ffc6860a7daf42ea871d9389b9fce64a: Time spent bootstrapping tablet: real 0.050s	user 0.031s	sys 0.017s
I20260709 12:27:56.578912  4262 ts_tablet_manager.cc:1403] T acbdf543b174470e9a0d4e181804ae01 P e083b2fa907d42b3b33dfba2d9f45240: Time spent bootstrapping tablet: real 0.057s	user 0.031s	sys 0.020s
I20260709 12:27:56.582008  4264 raft_consensus.cc:359] T acbdf543b174470e9a0d4e181804ae01 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.582198  4263 raft_consensus.cc:359] T acbdf543b174470e9a0d4e181804ae01 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.582439  4262 raft_consensus.cc:359] T acbdf543b174470e9a0d4e181804ae01 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.582774  4264 raft_consensus.cc:385] T acbdf543b174470e9a0d4e181804ae01 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.582898  4263 raft_consensus.cc:385] T acbdf543b174470e9a0d4e181804ae01 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.583199  4262 raft_consensus.cc:385] T acbdf543b174470e9a0d4e181804ae01 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.583269  4264 raft_consensus.cc:740] T acbdf543b174470e9a0d4e181804ae01 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e134dafee8df424690057d14e75c2e82, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.583307  4263 raft_consensus.cc:740] T acbdf543b174470e9a0d4e181804ae01 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffc6860a7daf42ea871d9389b9fce64a, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.583635  4262 raft_consensus.cc:740] T acbdf543b174470e9a0d4e181804ae01 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e083b2fa907d42b3b33dfba2d9f45240, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.584523  4263 consensus_queue.cc:260] T acbdf543b174470e9a0d4e181804ae01 P ffc6860a7daf42ea871d9389b9fce64a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.584597  4264 consensus_queue.cc:260] T acbdf543b174470e9a0d4e181804ae01 P e134dafee8df424690057d14e75c2e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.586871  4263 ts_tablet_manager.cc:1434] T acbdf543b174470e9a0d4e181804ae01 P ffc6860a7daf42ea871d9389b9fce64a: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:27:56.587193  4264 ts_tablet_manager.cc:1434] T acbdf543b174470e9a0d4e181804ae01 P e134dafee8df424690057d14e75c2e82: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 12:27:56.587771  4263 tablet_bootstrap.cc:492] T d97a598a1a4d49d6af38a80b7d94085a P ffc6860a7daf42ea871d9389b9fce64a: Bootstrap starting.
I20260709 12:27:56.588172  4264 tablet_bootstrap.cc:492] T d97a598a1a4d49d6af38a80b7d94085a P e134dafee8df424690057d14e75c2e82: Bootstrap starting.
I20260709 12:27:56.584597  4262 consensus_queue.cc:260] T acbdf543b174470e9a0d4e181804ae01 P e083b2fa907d42b3b33dfba2d9f45240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.592293  4262 ts_tablet_manager.cc:1434] T acbdf543b174470e9a0d4e181804ae01 P e083b2fa907d42b3b33dfba2d9f45240: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.002s
I20260709 12:27:56.595038  4263 tablet_bootstrap.cc:654] T d97a598a1a4d49d6af38a80b7d94085a P ffc6860a7daf42ea871d9389b9fce64a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.597702  4264 tablet_bootstrap.cc:654] T d97a598a1a4d49d6af38a80b7d94085a P e134dafee8df424690057d14e75c2e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.604223  4188 raft_consensus.cc:493] T 2ee866cdb98640d78e7b5d108a652846 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:56.605012  4188 raft_consensus.cc:515] T 2ee866cdb98640d78e7b5d108a652846 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.609294  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee866cdb98640d78e7b5d108a652846" candidate_uuid: "ffc6860a7daf42ea871d9389b9fce64a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e134dafee8df424690057d14e75c2e82" is_pre_election: true
I20260709 12:27:56.610029  4264 tablet_bootstrap.cc:492] T d97a598a1a4d49d6af38a80b7d94085a P e134dafee8df424690057d14e75c2e82: No bootstrap required, opened a new log
I20260709 12:27:56.610169  4188 leader_election.cc:290] T 2ee866cdb98640d78e7b5d108a652846 P ffc6860a7daf42ea871d9389b9fce64a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229), e134dafee8df424690057d14e75c2e82 (127.23.245.131:36883)
I20260709 12:27:56.610316  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee866cdb98640d78e7b5d108a652846" candidate_uuid: "ffc6860a7daf42ea871d9389b9fce64a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e083b2fa907d42b3b33dfba2d9f45240" is_pre_election: true
I20260709 12:27:56.610090  4114 raft_consensus.cc:2468] T 2ee866cdb98640d78e7b5d108a652846 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ffc6860a7daf42ea871d9389b9fce64a in term 0.
I20260709 12:27:56.598227  4262 tablet_bootstrap.cc:492] T d97a598a1a4d49d6af38a80b7d94085a P e083b2fa907d42b3b33dfba2d9f45240: Bootstrap starting.
W20260709 12:27:56.612288  4007 leader_election.cc:343] T 2ee866cdb98640d78e7b5d108a652846 P ffc6860a7daf42ea871d9389b9fce64a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:56.612591  4263 tablet_bootstrap.cc:492] T d97a598a1a4d49d6af38a80b7d94085a P ffc6860a7daf42ea871d9389b9fce64a: No bootstrap required, opened a new log
I20260709 12:27:56.613114  4263 ts_tablet_manager.cc:1403] T d97a598a1a4d49d6af38a80b7d94085a P ffc6860a7daf42ea871d9389b9fce64a: Time spent bootstrapping tablet: real 0.026s	user 0.005s	sys 0.015s
I20260709 12:27:56.613467  4005 leader_election.cc:304] T 2ee866cdb98640d78e7b5d108a652846 P ffc6860a7daf42ea871d9389b9fce64a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e134dafee8df424690057d14e75c2e82, ffc6860a7daf42ea871d9389b9fce64a; no voters: e083b2fa907d42b3b33dfba2d9f45240
I20260709 12:27:56.610706  4264 ts_tablet_manager.cc:1403] T d97a598a1a4d49d6af38a80b7d94085a P e134dafee8df424690057d14e75c2e82: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.004s
I20260709 12:27:56.614703  4188 raft_consensus.cc:2804] T 2ee866cdb98640d78e7b5d108a652846 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:56.615132  4188 raft_consensus.cc:493] T 2ee866cdb98640d78e7b5d108a652846 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:56.615489  4188 raft_consensus.cc:3060] T 2ee866cdb98640d78e7b5d108a652846 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:56.617559  4264 raft_consensus.cc:359] T d97a598a1a4d49d6af38a80b7d94085a P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.618191  4264 raft_consensus.cc:385] T d97a598a1a4d49d6af38a80b7d94085a P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.618479  4264 raft_consensus.cc:740] T d97a598a1a4d49d6af38a80b7d94085a P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e134dafee8df424690057d14e75c2e82, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.619201  4264 consensus_queue.cc:260] T d97a598a1a4d49d6af38a80b7d94085a P e134dafee8df424690057d14e75c2e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.620136  4262 tablet_bootstrap.cc:654] T d97a598a1a4d49d6af38a80b7d94085a P e083b2fa907d42b3b33dfba2d9f45240: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.621536  4263 raft_consensus.cc:359] T d97a598a1a4d49d6af38a80b7d94085a P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.622134  4263 raft_consensus.cc:385] T d97a598a1a4d49d6af38a80b7d94085a P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.622371  4263 raft_consensus.cc:740] T d97a598a1a4d49d6af38a80b7d94085a P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffc6860a7daf42ea871d9389b9fce64a, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.623041  4263 consensus_queue.cc:260] T d97a598a1a4d49d6af38a80b7d94085a P ffc6860a7daf42ea871d9389b9fce64a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.625164  4188 raft_consensus.cc:515] T 2ee866cdb98640d78e7b5d108a652846 P ffc6860a7daf42ea871d9389b9fce64a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.628917  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee866cdb98640d78e7b5d108a652846" candidate_uuid: "ffc6860a7daf42ea871d9389b9fce64a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e083b2fa907d42b3b33dfba2d9f45240"
I20260709 12:27:56.629797  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee866cdb98640d78e7b5d108a652846" candidate_uuid: "ffc6860a7daf42ea871d9389b9fce64a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e134dafee8df424690057d14e75c2e82"
I20260709 12:27:56.630467  4114 raft_consensus.cc:3060] T 2ee866cdb98640d78e7b5d108a652846 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:56.634310  4264 ts_tablet_manager.cc:1434] T d97a598a1a4d49d6af38a80b7d94085a P e134dafee8df424690057d14e75c2e82: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:27:56.636058  4264 tablet_bootstrap.cc:492] T cf7d17c9f4f54d63ac12f4015065ab60 P e134dafee8df424690057d14e75c2e82: Bootstrap starting.
W20260709 12:27:56.630467  4007 leader_election.cc:343] T 2ee866cdb98640d78e7b5d108a652846 P ffc6860a7daf42ea871d9389b9fce64a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:56.646373  4264 tablet_bootstrap.cc:654] T cf7d17c9f4f54d63ac12f4015065ab60 P e134dafee8df424690057d14e75c2e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.648597  4188 leader_election.cc:290] T 2ee866cdb98640d78e7b5d108a652846 P ffc6860a7daf42ea871d9389b9fce64a [CANDIDATE]: Term 1 election: Requested vote from peers e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229), e134dafee8df424690057d14e75c2e82 (127.23.245.131:36883)
I20260709 12:27:56.651615  4114 raft_consensus.cc:2468] T 2ee866cdb98640d78e7b5d108a652846 P e134dafee8df424690057d14e75c2e82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffc6860a7daf42ea871d9389b9fce64a in term 1.
I20260709 12:27:56.655218  4263 ts_tablet_manager.cc:1434] T d97a598a1a4d49d6af38a80b7d94085a P ffc6860a7daf42ea871d9389b9fce64a: Time spent starting tablet: real 0.042s	user 0.016s	sys 0.021s
I20260709 12:27:56.656330  4263 tablet_bootstrap.cc:492] T cf7d17c9f4f54d63ac12f4015065ab60 P ffc6860a7daf42ea871d9389b9fce64a: Bootstrap starting.
I20260709 12:27:56.656418  4264 tablet_bootstrap.cc:492] T cf7d17c9f4f54d63ac12f4015065ab60 P e134dafee8df424690057d14e75c2e82: No bootstrap required, opened a new log
I20260709 12:27:56.657011  4264 ts_tablet_manager.cc:1403] T cf7d17c9f4f54d63ac12f4015065ab60 P e134dafee8df424690057d14e75c2e82: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.003s
I20260709 12:27:56.658478  4262 tablet_bootstrap.cc:492] T d97a598a1a4d49d6af38a80b7d94085a P e083b2fa907d42b3b33dfba2d9f45240: No bootstrap required, opened a new log
I20260709 12:27:56.659000  4262 ts_tablet_manager.cc:1403] T d97a598a1a4d49d6af38a80b7d94085a P e083b2fa907d42b3b33dfba2d9f45240: Time spent bootstrapping tablet: real 0.066s	user 0.015s	sys 0.016s
I20260709 12:27:56.660023  4264 raft_consensus.cc:359] T cf7d17c9f4f54d63ac12f4015065ab60 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.660820  4264 raft_consensus.cc:385] T cf7d17c9f4f54d63ac12f4015065ab60 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.661106  4264 raft_consensus.cc:740] T cf7d17c9f4f54d63ac12f4015065ab60 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e134dafee8df424690057d14e75c2e82, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.661844  4264 consensus_queue.cc:260] T cf7d17c9f4f54d63ac12f4015065ab60 P e134dafee8df424690057d14e75c2e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.662659  4005 leader_election.cc:304] T 2ee866cdb98640d78e7b5d108a652846 P ffc6860a7daf42ea871d9389b9fce64a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e134dafee8df424690057d14e75c2e82, ffc6860a7daf42ea871d9389b9fce64a; no voters: e083b2fa907d42b3b33dfba2d9f45240
I20260709 12:27:56.663434  4263 tablet_bootstrap.cc:654] T cf7d17c9f4f54d63ac12f4015065ab60 P ffc6860a7daf42ea871d9389b9fce64a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.664248  4264 ts_tablet_manager.cc:1434] T cf7d17c9f4f54d63ac12f4015065ab60 P e134dafee8df424690057d14e75c2e82: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 12:27:56.664482  4275 raft_consensus.cc:2804] T 2ee866cdb98640d78e7b5d108a652846 P ffc6860a7daf42ea871d9389b9fce64a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:56.665074  4275 raft_consensus.cc:697] T 2ee866cdb98640d78e7b5d108a652846 P ffc6860a7daf42ea871d9389b9fce64a [term 1 LEADER]: Becoming Leader. State: Replica: ffc6860a7daf42ea871d9389b9fce64a, State: Running, Role: LEADER
I20260709 12:27:56.665197  4264 tablet_bootstrap.cc:492] T 4e1151150f9a467ebd21f401fb352c29 P e134dafee8df424690057d14e75c2e82: Bootstrap starting.
I20260709 12:27:56.666028  4275 consensus_queue.cc:237] T 2ee866cdb98640d78e7b5d108a652846 P ffc6860a7daf42ea871d9389b9fce64a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.671713  4216 raft_consensus.cc:493] T cf7d17c9f4f54d63ac12f4015065ab60 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:56.672459  4264 tablet_bootstrap.cc:654] T 4e1151150f9a467ebd21f401fb352c29 P e134dafee8df424690057d14e75c2e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.672261  4216 raft_consensus.cc:515] T cf7d17c9f4f54d63ac12f4015065ab60 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.677740  4188 raft_consensus.cc:493] T acbdf543b174470e9a0d4e181804ae01 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:56.677847  4216 leader_election.cc:290] T cf7d17c9f4f54d63ac12f4015065ab60 P e083b2fa907d42b3b33dfba2d9f45240 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130:46493), e134dafee8df424690057d14e75c2e82 (127.23.245.131:36883)
I20260709 12:27:56.678339  4188 raft_consensus.cc:515] T acbdf543b174470e9a0d4e181804ae01 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.679806  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7d17c9f4f54d63ac12f4015065ab60" candidate_uuid: "e083b2fa907d42b3b33dfba2d9f45240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e134dafee8df424690057d14e75c2e82" is_pre_election: true
I20260709 12:27:56.680459  4115 raft_consensus.cc:2468] T cf7d17c9f4f54d63ac12f4015065ab60 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e083b2fa907d42b3b33dfba2d9f45240 in term 0.
I20260709 12:27:56.661969  4262 raft_consensus.cc:359] T d97a598a1a4d49d6af38a80b7d94085a P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.680495  4188 leader_election.cc:290] T acbdf543b174470e9a0d4e181804ae01 P ffc6860a7daf42ea871d9389b9fce64a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229), e134dafee8df424690057d14e75c2e82 (127.23.245.131:36883)
I20260709 12:27:56.681938  4262 raft_consensus.cc:385] T d97a598a1a4d49d6af38a80b7d94085a P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.681882  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acbdf543b174470e9a0d4e181804ae01" candidate_uuid: "ffc6860a7daf42ea871d9389b9fce64a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e083b2fa907d42b3b33dfba2d9f45240" is_pre_election: true
I20260709 12:27:56.682447  4262 raft_consensus.cc:740] T d97a598a1a4d49d6af38a80b7d94085a P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e083b2fa907d42b3b33dfba2d9f45240, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.683090  3964 raft_consensus.cc:2468] T acbdf543b174470e9a0d4e181804ae01 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ffc6860a7daf42ea871d9389b9fce64a in term 0.
I20260709 12:27:56.683382  4262 consensus_queue.cc:260] T d97a598a1a4d49d6af38a80b7d94085a P e083b2fa907d42b3b33dfba2d9f45240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.681861  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7d17c9f4f54d63ac12f4015065ab60" candidate_uuid: "e083b2fa907d42b3b33dfba2d9f45240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffc6860a7daf42ea871d9389b9fce64a" is_pre_election: true
I20260709 12:27:56.681972  3930 leader_election.cc:304] T cf7d17c9f4f54d63ac12f4015065ab60 P e083b2fa907d42b3b33dfba2d9f45240 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e083b2fa907d42b3b33dfba2d9f45240, e134dafee8df424690057d14e75c2e82; no voters: 
I20260709 12:27:56.688609  4007 leader_election.cc:304] T acbdf543b174470e9a0d4e181804ae01 P ffc6860a7daf42ea871d9389b9fce64a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e083b2fa907d42b3b33dfba2d9f45240, ffc6860a7daf42ea871d9389b9fce64a; no voters: 
I20260709 12:27:56.688942  4262 ts_tablet_manager.cc:1434] T d97a598a1a4d49d6af38a80b7d94085a P e083b2fa907d42b3b33dfba2d9f45240: Time spent starting tablet: real 0.030s	user 0.009s	sys 0.000s
I20260709 12:27:56.689759  4188 raft_consensus.cc:2804] T acbdf543b174470e9a0d4e181804ae01 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:56.690133  4188 raft_consensus.cc:493] T acbdf543b174470e9a0d4e181804ae01 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:56.690446  4262 tablet_bootstrap.cc:492] T 2ee866cdb98640d78e7b5d108a652846 P e083b2fa907d42b3b33dfba2d9f45240: Bootstrap starting.
I20260709 12:27:56.690462  4188 raft_consensus.cc:3060] T acbdf543b174470e9a0d4e181804ae01 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:56.692480  4216 raft_consensus.cc:2804] T cf7d17c9f4f54d63ac12f4015065ab60 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:56.693066  4216 raft_consensus.cc:493] T cf7d17c9f4f54d63ac12f4015065ab60 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:56.693481  4216 raft_consensus.cc:3060] T cf7d17c9f4f54d63ac12f4015065ab60 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:56.698256  4262 tablet_bootstrap.cc:654] T 2ee866cdb98640d78e7b5d108a652846 P e083b2fa907d42b3b33dfba2d9f45240: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.699132  4188 raft_consensus.cc:515] T acbdf543b174470e9a0d4e181804ae01 P ffc6860a7daf42ea871d9389b9fce64a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.699074  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acbdf543b174470e9a0d4e181804ae01" candidate_uuid: "ffc6860a7daf42ea871d9389b9fce64a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e134dafee8df424690057d14e75c2e82" is_pre_election: true
I20260709 12:27:56.700799  4115 raft_consensus.cc:2468] T acbdf543b174470e9a0d4e181804ae01 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ffc6860a7daf42ea871d9389b9fce64a in term 0.
W20260709 12:27:56.702646  3930 leader_election.cc:343] T cf7d17c9f4f54d63ac12f4015065ab60 P e083b2fa907d42b3b33dfba2d9f45240 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130:46493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:56.704792  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acbdf543b174470e9a0d4e181804ae01" candidate_uuid: "ffc6860a7daf42ea871d9389b9fce64a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e083b2fa907d42b3b33dfba2d9f45240"
I20260709 12:27:56.705579  3964 raft_consensus.cc:3060] T acbdf543b174470e9a0d4e181804ae01 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:56.706102  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acbdf543b174470e9a0d4e181804ae01" candidate_uuid: "ffc6860a7daf42ea871d9389b9fce64a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e134dafee8df424690057d14e75c2e82"
I20260709 12:27:56.706944  4114 raft_consensus.cc:3060] T acbdf543b174470e9a0d4e181804ae01 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:56.702587  4188 leader_election.cc:290] T acbdf543b174470e9a0d4e181804ae01 P ffc6860a7daf42ea871d9389b9fce64a [CANDIDATE]: Term 1 election: Requested vote from peers e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229), e134dafee8df424690057d14e75c2e82 (127.23.245.131:36883)
I20260709 12:27:56.711257  4262 tablet_bootstrap.cc:492] T 2ee866cdb98640d78e7b5d108a652846 P e083b2fa907d42b3b33dfba2d9f45240: No bootstrap required, opened a new log
I20260709 12:27:56.711525  4264 tablet_bootstrap.cc:492] T 4e1151150f9a467ebd21f401fb352c29 P e134dafee8df424690057d14e75c2e82: No bootstrap required, opened a new log
I20260709 12:27:56.711796  4262 ts_tablet_manager.cc:1403] T 2ee866cdb98640d78e7b5d108a652846 P e083b2fa907d42b3b33dfba2d9f45240: Time spent bootstrapping tablet: real 0.022s	user 0.002s	sys 0.016s
I20260709 12:27:56.712102  4264 ts_tablet_manager.cc:1403] T 4e1151150f9a467ebd21f401fb352c29 P e134dafee8df424690057d14e75c2e82: Time spent bootstrapping tablet: real 0.047s	user 0.014s	sys 0.004s
I20260709 12:27:56.714318  4188 raft_consensus.cc:493] T d97a598a1a4d49d6af38a80b7d94085a P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:56.714417  3964 raft_consensus.cc:2468] T acbdf543b174470e9a0d4e181804ae01 P e083b2fa907d42b3b33dfba2d9f45240 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffc6860a7daf42ea871d9389b9fce64a in term 1.
I20260709 12:27:56.714900  4188 raft_consensus.cc:515] T d97a598a1a4d49d6af38a80b7d94085a P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.714967  4262 raft_consensus.cc:359] T 2ee866cdb98640d78e7b5d108a652846 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.715782  4007 leader_election.cc:304] T acbdf543b174470e9a0d4e181804ae01 P ffc6860a7daf42ea871d9389b9fce64a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e083b2fa907d42b3b33dfba2d9f45240, ffc6860a7daf42ea871d9389b9fce64a; no voters: 
I20260709 12:27:56.716897  4264 raft_consensus.cc:359] T 4e1151150f9a467ebd21f401fb352c29 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.718927  4264 raft_consensus.cc:385] T 4e1151150f9a467ebd21f401fb352c29 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.719031  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97a598a1a4d49d6af38a80b7d94085a" candidate_uuid: "ffc6860a7daf42ea871d9389b9fce64a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e083b2fa907d42b3b33dfba2d9f45240" is_pre_election: true
I20260709 12:27:56.719471  4264 raft_consensus.cc:740] T 4e1151150f9a467ebd21f401fb352c29 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e134dafee8df424690057d14e75c2e82, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.719971  3964 raft_consensus.cc:2468] T d97a598a1a4d49d6af38a80b7d94085a P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ffc6860a7daf42ea871d9389b9fce64a in term 0.
I20260709 12:27:56.720594  4264 consensus_queue.cc:260] T 4e1151150f9a467ebd21f401fb352c29 P e134dafee8df424690057d14e75c2e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.721432  4007 leader_election.cc:304] T d97a598a1a4d49d6af38a80b7d94085a P ffc6860a7daf42ea871d9389b9fce64a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e083b2fa907d42b3b33dfba2d9f45240, ffc6860a7daf42ea871d9389b9fce64a; no voters: 
I20260709 12:27:56.723189  4264 ts_tablet_manager.cc:1434] T 4e1151150f9a467ebd21f401fb352c29 P e134dafee8df424690057d14e75c2e82: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:27:56.717955  4188 leader_election.cc:290] T d97a598a1a4d49d6af38a80b7d94085a P ffc6860a7daf42ea871d9389b9fce64a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229), e134dafee8df424690057d14e75c2e82 (127.23.245.131:36883)
I20260709 12:27:56.724035  4264 tablet_bootstrap.cc:492] T b76c818ee9f34bddaec899987166e3c7 P e134dafee8df424690057d14e75c2e82: Bootstrap starting.
I20260709 12:27:56.741551  4188 raft_consensus.cc:2804] T acbdf543b174470e9a0d4e181804ae01 P ffc6860a7daf42ea871d9389b9fce64a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:56.748170  4188 raft_consensus.cc:697] T acbdf543b174470e9a0d4e181804ae01 P ffc6860a7daf42ea871d9389b9fce64a [term 1 LEADER]: Becoming Leader. State: Replica: ffc6860a7daf42ea871d9389b9fce64a, State: Running, Role: LEADER
I20260709 12:27:56.749706  4114 raft_consensus.cc:2468] T acbdf543b174470e9a0d4e181804ae01 P e134dafee8df424690057d14e75c2e82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffc6860a7daf42ea871d9389b9fce64a in term 1.
I20260709 12:27:56.749409  4188 consensus_queue.cc:237] T acbdf543b174470e9a0d4e181804ae01 P ffc6860a7daf42ea871d9389b9fce64a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.715885  4262 raft_consensus.cc:385] T 2ee866cdb98640d78e7b5d108a652846 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.743791  4275 raft_consensus.cc:2804] T d97a598a1a4d49d6af38a80b7d94085a P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:56.758270  4264 tablet_bootstrap.cc:654] T b76c818ee9f34bddaec899987166e3c7 P e134dafee8df424690057d14e75c2e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.758102  4216 raft_consensus.cc:515] T cf7d17c9f4f54d63ac12f4015065ab60 P e083b2fa907d42b3b33dfba2d9f45240 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.754361  4275 raft_consensus.cc:493] T d97a598a1a4d49d6af38a80b7d94085a P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:56.760361  4275 raft_consensus.cc:3060] T d97a598a1a4d49d6af38a80b7d94085a P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:56.761039  4216 leader_election.cc:290] T cf7d17c9f4f54d63ac12f4015065ab60 P e083b2fa907d42b3b33dfba2d9f45240 [CANDIDATE]: Term 1 election: Requested vote from peers ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130:46493), e134dafee8df424690057d14e75c2e82 (127.23.245.131:36883)
I20260709 12:27:56.753913  4262 raft_consensus.cc:740] T 2ee866cdb98640d78e7b5d108a652846 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e083b2fa907d42b3b33dfba2d9f45240, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.762331  4262 consensus_queue.cc:260] T 2ee866cdb98640d78e7b5d108a652846 P e083b2fa907d42b3b33dfba2d9f45240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.762984  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7d17c9f4f54d63ac12f4015065ab60" candidate_uuid: "e083b2fa907d42b3b33dfba2d9f45240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffc6860a7daf42ea871d9389b9fce64a"
W20260709 12:27:56.764510  3930 leader_election.cc:343] T cf7d17c9f4f54d63ac12f4015065ab60 P e083b2fa907d42b3b33dfba2d9f45240 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130:46493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:56.765952  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7d17c9f4f54d63ac12f4015065ab60" candidate_uuid: "e083b2fa907d42b3b33dfba2d9f45240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e134dafee8df424690057d14e75c2e82"
I20260709 12:27:56.766616  4114 raft_consensus.cc:3060] T cf7d17c9f4f54d63ac12f4015065ab60 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:56.768437  4263 tablet_bootstrap.cc:492] T cf7d17c9f4f54d63ac12f4015065ab60 P ffc6860a7daf42ea871d9389b9fce64a: No bootstrap required, opened a new log
I20260709 12:27:56.768989  4263 ts_tablet_manager.cc:1403] T cf7d17c9f4f54d63ac12f4015065ab60 P ffc6860a7daf42ea871d9389b9fce64a: Time spent bootstrapping tablet: real 0.113s	user 0.046s	sys 0.037s
I20260709 12:27:56.769397  4262 ts_tablet_manager.cc:1434] T 2ee866cdb98640d78e7b5d108a652846 P e083b2fa907d42b3b33dfba2d9f45240: Time spent starting tablet: real 0.057s	user 0.006s	sys 0.002s
I20260709 12:27:56.770839  4262 tablet_bootstrap.cc:492] T b76c818ee9f34bddaec899987166e3c7 P e083b2fa907d42b3b33dfba2d9f45240: Bootstrap starting.
I20260709 12:27:56.771981  4263 raft_consensus.cc:359] T cf7d17c9f4f54d63ac12f4015065ab60 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.772759  4263 raft_consensus.cc:385] T cf7d17c9f4f54d63ac12f4015065ab60 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.773061  4263 raft_consensus.cc:740] T cf7d17c9f4f54d63ac12f4015065ab60 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffc6860a7daf42ea871d9389b9fce64a, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.780191  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97a598a1a4d49d6af38a80b7d94085a" candidate_uuid: "ffc6860a7daf42ea871d9389b9fce64a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e134dafee8df424690057d14e75c2e82" is_pre_election: true
I20260709 12:27:56.780794  4115 raft_consensus.cc:2468] T d97a598a1a4d49d6af38a80b7d94085a P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ffc6860a7daf42ea871d9389b9fce64a in term 0.
I20260709 12:27:56.777634  4263 consensus_queue.cc:260] T cf7d17c9f4f54d63ac12f4015065ab60 P ffc6860a7daf42ea871d9389b9fce64a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.784870  4264 tablet_bootstrap.cc:492] T b76c818ee9f34bddaec899987166e3c7 P e134dafee8df424690057d14e75c2e82: No bootstrap required, opened a new log
I20260709 12:27:56.785586  4264 ts_tablet_manager.cc:1403] T b76c818ee9f34bddaec899987166e3c7 P e134dafee8df424690057d14e75c2e82: Time spent bootstrapping tablet: real 0.062s	user 0.012s	sys 0.013s
I20260709 12:27:56.785993  4114 raft_consensus.cc:2468] T cf7d17c9f4f54d63ac12f4015065ab60 P e134dafee8df424690057d14e75c2e82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e083b2fa907d42b3b33dfba2d9f45240 in term 1.
I20260709 12:27:56.787696  3930 leader_election.cc:304] T cf7d17c9f4f54d63ac12f4015065ab60 P e083b2fa907d42b3b33dfba2d9f45240 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e083b2fa907d42b3b33dfba2d9f45240, e134dafee8df424690057d14e75c2e82; no voters: ffc6860a7daf42ea871d9389b9fce64a
I20260709 12:27:56.788970  4264 raft_consensus.cc:359] T b76c818ee9f34bddaec899987166e3c7 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.789798  4264 raft_consensus.cc:385] T b76c818ee9f34bddaec899987166e3c7 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.790169  4264 raft_consensus.cc:740] T b76c818ee9f34bddaec899987166e3c7 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e134dafee8df424690057d14e75c2e82, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.790560  4216 raft_consensus.cc:2804] T cf7d17c9f4f54d63ac12f4015065ab60 P e083b2fa907d42b3b33dfba2d9f45240 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:56.791014  4264 consensus_queue.cc:260] T b76c818ee9f34bddaec899987166e3c7 P e134dafee8df424690057d14e75c2e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.792270  4263 ts_tablet_manager.cc:1434] T cf7d17c9f4f54d63ac12f4015065ab60 P ffc6860a7daf42ea871d9389b9fce64a: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.002s
I20260709 12:27:56.793931  4264 ts_tablet_manager.cc:1434] T b76c818ee9f34bddaec899987166e3c7 P e134dafee8df424690057d14e75c2e82: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.005s
I20260709 12:27:56.795017  4264 tablet_bootstrap.cc:492] T d7bf8a5e5f8648a08295d2e0e9da0b41 P e134dafee8df424690057d14e75c2e82: Bootstrap starting.
I20260709 12:27:56.797155  4262 tablet_bootstrap.cc:654] T b76c818ee9f34bddaec899987166e3c7 P e083b2fa907d42b3b33dfba2d9f45240: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.797580  4216 raft_consensus.cc:697] T cf7d17c9f4f54d63ac12f4015065ab60 P e083b2fa907d42b3b33dfba2d9f45240 [term 1 LEADER]: Becoming Leader. State: Replica: e083b2fa907d42b3b33dfba2d9f45240, State: Running, Role: LEADER
I20260709 12:27:56.798588  4216 consensus_queue.cc:237] T cf7d17c9f4f54d63ac12f4015065ab60 P e083b2fa907d42b3b33dfba2d9f45240 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.800168  4275 raft_consensus.cc:515] T d97a598a1a4d49d6af38a80b7d94085a P ffc6860a7daf42ea871d9389b9fce64a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.802232  4275 leader_election.cc:290] T d97a598a1a4d49d6af38a80b7d94085a P ffc6860a7daf42ea871d9389b9fce64a [CANDIDATE]: Term 1 election: Requested vote from peers e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229), e134dafee8df424690057d14e75c2e82 (127.23.245.131:36883)
I20260709 12:27:56.793430  4263 tablet_bootstrap.cc:492] T 4e1151150f9a467ebd21f401fb352c29 P ffc6860a7daf42ea871d9389b9fce64a: Bootstrap starting.
I20260709 12:27:56.803283  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97a598a1a4d49d6af38a80b7d94085a" candidate_uuid: "ffc6860a7daf42ea871d9389b9fce64a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e083b2fa907d42b3b33dfba2d9f45240"
I20260709 12:27:56.803624  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97a598a1a4d49d6af38a80b7d94085a" candidate_uuid: "ffc6860a7daf42ea871d9389b9fce64a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e134dafee8df424690057d14e75c2e82"
I20260709 12:27:56.803980  3964 raft_consensus.cc:3060] T d97a598a1a4d49d6af38a80b7d94085a P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:56.804944  4264 tablet_bootstrap.cc:654] T d7bf8a5e5f8648a08295d2e0e9da0b41 P e134dafee8df424690057d14e75c2e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.809937  4263 tablet_bootstrap.cc:654] T 4e1151150f9a467ebd21f401fb352c29 P ffc6860a7daf42ea871d9389b9fce64a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.811079  3964 raft_consensus.cc:2468] T d97a598a1a4d49d6af38a80b7d94085a P e083b2fa907d42b3b33dfba2d9f45240 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffc6860a7daf42ea871d9389b9fce64a in term 1.
I20260709 12:27:56.811965  4114 raft_consensus.cc:3060] T d97a598a1a4d49d6af38a80b7d94085a P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:56.812410  4007 leader_election.cc:304] T d97a598a1a4d49d6af38a80b7d94085a P ffc6860a7daf42ea871d9389b9fce64a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e083b2fa907d42b3b33dfba2d9f45240, ffc6860a7daf42ea871d9389b9fce64a; no voters: 
I20260709 12:27:56.813293  4275 raft_consensus.cc:2804] T d97a598a1a4d49d6af38a80b7d94085a P ffc6860a7daf42ea871d9389b9fce64a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:56.813920  4275 raft_consensus.cc:697] T d97a598a1a4d49d6af38a80b7d94085a P ffc6860a7daf42ea871d9389b9fce64a [term 1 LEADER]: Becoming Leader. State: Replica: ffc6860a7daf42ea871d9389b9fce64a, State: Running, Role: LEADER
I20260709 12:27:56.815002  4275 consensus_queue.cc:237] T d97a598a1a4d49d6af38a80b7d94085a P ffc6860a7daf42ea871d9389b9fce64a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.817699  4114 raft_consensus.cc:2468] T d97a598a1a4d49d6af38a80b7d94085a P e134dafee8df424690057d14e75c2e82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffc6860a7daf42ea871d9389b9fce64a in term 1.
I20260709 12:27:56.822374  4262 tablet_bootstrap.cc:492] T b76c818ee9f34bddaec899987166e3c7 P e083b2fa907d42b3b33dfba2d9f45240: No bootstrap required, opened a new log
I20260709 12:27:56.823698  4262 ts_tablet_manager.cc:1403] T b76c818ee9f34bddaec899987166e3c7 P e083b2fa907d42b3b33dfba2d9f45240: Time spent bootstrapping tablet: real 0.053s	user 0.016s	sys 0.000s
I20260709 12:27:56.826977  4262 raft_consensus.cc:359] T b76c818ee9f34bddaec899987166e3c7 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.827742  4262 raft_consensus.cc:385] T b76c818ee9f34bddaec899987166e3c7 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.828086  4262 raft_consensus.cc:740] T b76c818ee9f34bddaec899987166e3c7 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e083b2fa907d42b3b33dfba2d9f45240, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.827469  3863 catalog_manager.cc:5697] T 2ee866cdb98640d78e7b5d108a652846 P ffc6860a7daf42ea871d9389b9fce64a reported cstate change: term changed from 0 to 1, leader changed from <none> to ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130). New cstate: current_term: 1 leader_uuid: "ffc6860a7daf42ea871d9389b9fce64a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:56.828697  4264 tablet_bootstrap.cc:492] T d7bf8a5e5f8648a08295d2e0e9da0b41 P e134dafee8df424690057d14e75c2e82: No bootstrap required, opened a new log
I20260709 12:27:56.829209  4264 ts_tablet_manager.cc:1403] T d7bf8a5e5f8648a08295d2e0e9da0b41 P e134dafee8df424690057d14e75c2e82: Time spent bootstrapping tablet: real 0.034s	user 0.007s	sys 0.004s
I20260709 12:27:56.829197  4262 consensus_queue.cc:260] T b76c818ee9f34bddaec899987166e3c7 P e083b2fa907d42b3b33dfba2d9f45240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.829775  3863 catalog_manager.cc:5697] T acbdf543b174470e9a0d4e181804ae01 P ffc6860a7daf42ea871d9389b9fce64a reported cstate change: term changed from 0 to 1, leader changed from <none> to ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130). New cstate: current_term: 1 leader_uuid: "ffc6860a7daf42ea871d9389b9fce64a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:56.831790  4262 ts_tablet_manager.cc:1434] T b76c818ee9f34bddaec899987166e3c7 P e083b2fa907d42b3b33dfba2d9f45240: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 12:27:56.832799  4262 tablet_bootstrap.cc:492] T d7bf8a5e5f8648a08295d2e0e9da0b41 P e083b2fa907d42b3b33dfba2d9f45240: Bootstrap starting.
I20260709 12:27:56.832556  4264 raft_consensus.cc:359] T d7bf8a5e5f8648a08295d2e0e9da0b41 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.832427  3860 catalog_manager.cc:5697] T cf7d17c9f4f54d63ac12f4015065ab60 P e083b2fa907d42b3b33dfba2d9f45240 reported cstate change: term changed from 0 to 1, leader changed from <none> to e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129). New cstate: current_term: 1 leader_uuid: "e083b2fa907d42b3b33dfba2d9f45240" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:56.833329  4264 raft_consensus.cc:385] T d7bf8a5e5f8648a08295d2e0e9da0b41 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.833748  4264 raft_consensus.cc:740] T d7bf8a5e5f8648a08295d2e0e9da0b41 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e134dafee8df424690057d14e75c2e82, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.834550  4264 consensus_queue.cc:260] T d7bf8a5e5f8648a08295d2e0e9da0b41 P e134dafee8df424690057d14e75c2e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.837060  4264 ts_tablet_manager.cc:1434] T d7bf8a5e5f8648a08295d2e0e9da0b41 P e134dafee8df424690057d14e75c2e82: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:27:56.838092  4264 tablet_bootstrap.cc:492] T 6a3d62d2c10d46e1ae7198117fa43d67 P e134dafee8df424690057d14e75c2e82: Bootstrap starting.
I20260709 12:27:56.841928  4263 tablet_bootstrap.cc:492] T 4e1151150f9a467ebd21f401fb352c29 P ffc6860a7daf42ea871d9389b9fce64a: No bootstrap required, opened a new log
I20260709 12:27:56.842497  4263 ts_tablet_manager.cc:1403] T 4e1151150f9a467ebd21f401fb352c29 P ffc6860a7daf42ea871d9389b9fce64a: Time spent bootstrapping tablet: real 0.049s	user 0.006s	sys 0.006s
I20260709 12:27:56.844684  4264 tablet_bootstrap.cc:654] T 6a3d62d2c10d46e1ae7198117fa43d67 P e134dafee8df424690057d14e75c2e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.850337  4263 raft_consensus.cc:359] T 4e1151150f9a467ebd21f401fb352c29 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.851162  4263 raft_consensus.cc:385] T 4e1151150f9a467ebd21f401fb352c29 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.851437  4263 raft_consensus.cc:740] T 4e1151150f9a467ebd21f401fb352c29 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffc6860a7daf42ea871d9389b9fce64a, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.852452  4251 raft_consensus.cc:493] T b76c818ee9f34bddaec899987166e3c7 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:56.852335  4263 consensus_queue.cc:260] T 4e1151150f9a467ebd21f401fb352c29 P ffc6860a7daf42ea871d9389b9fce64a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.852986  4251 raft_consensus.cc:515] T b76c818ee9f34bddaec899987166e3c7 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.853981  4263 ts_tablet_manager.cc:1434] T 4e1151150f9a467ebd21f401fb352c29 P ffc6860a7daf42ea871d9389b9fce64a: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:27:56.854843  4263 tablet_bootstrap.cc:492] T 70d90926ee274610a5addbacc456d3e6 P ffc6860a7daf42ea871d9389b9fce64a: Bootstrap starting.
I20260709 12:27:56.855443  4251 leader_election.cc:290] T b76c818ee9f34bddaec899987166e3c7 P e134dafee8df424690057d14e75c2e82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229), ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130:46493)
I20260709 12:27:56.857270  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76c818ee9f34bddaec899987166e3c7" candidate_uuid: "e134dafee8df424690057d14e75c2e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e083b2fa907d42b3b33dfba2d9f45240" is_pre_election: true
I20260709 12:27:56.858059  3964 raft_consensus.cc:2468] T b76c818ee9f34bddaec899987166e3c7 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e134dafee8df424690057d14e75c2e82 in term 0.
I20260709 12:27:56.859140  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76c818ee9f34bddaec899987166e3c7" candidate_uuid: "e134dafee8df424690057d14e75c2e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffc6860a7daf42ea871d9389b9fce64a" is_pre_election: true
I20260709 12:27:56.859761  4262 tablet_bootstrap.cc:654] T d7bf8a5e5f8648a08295d2e0e9da0b41 P e083b2fa907d42b3b33dfba2d9f45240: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.860209  4216 raft_consensus.cc:493] T 4e1151150f9a467ebd21f401fb352c29 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:56.860747  4216 raft_consensus.cc:515] T 4e1151150f9a467ebd21f401fb352c29 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.863116  4081 leader_election.cc:304] T b76c818ee9f34bddaec899987166e3c7 P e134dafee8df424690057d14e75c2e82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e083b2fa907d42b3b33dfba2d9f45240, e134dafee8df424690057d14e75c2e82; no voters: 
W20260709 12:27:56.863991  4079 leader_election.cc:343] T b76c818ee9f34bddaec899987166e3c7 P e134dafee8df424690057d14e75c2e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130:46493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:56.864130  4251 raft_consensus.cc:2804] T b76c818ee9f34bddaec899987166e3c7 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:56.865854  4251 raft_consensus.cc:493] T b76c818ee9f34bddaec899987166e3c7 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:56.866454  4251 raft_consensus.cc:3060] T b76c818ee9f34bddaec899987166e3c7 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:56.866567  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e1151150f9a467ebd21f401fb352c29" candidate_uuid: "e083b2fa907d42b3b33dfba2d9f45240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffc6860a7daf42ea871d9389b9fce64a" is_pre_election: true
I20260709 12:27:56.867323  4041 raft_consensus.cc:2468] T 4e1151150f9a467ebd21f401fb352c29 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e083b2fa907d42b3b33dfba2d9f45240 in term 0.
I20260709 12:27:56.866734  4216 leader_election.cc:290] T 4e1151150f9a467ebd21f401fb352c29 P e083b2fa907d42b3b33dfba2d9f45240 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130:46493), e134dafee8df424690057d14e75c2e82 (127.23.245.131:36883)
I20260709 12:27:56.868786  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e1151150f9a467ebd21f401fb352c29" candidate_uuid: "e083b2fa907d42b3b33dfba2d9f45240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e134dafee8df424690057d14e75c2e82" is_pre_election: true
I20260709 12:27:56.869557  4114 raft_consensus.cc:2468] T 4e1151150f9a467ebd21f401fb352c29 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e083b2fa907d42b3b33dfba2d9f45240 in term 0.
I20260709 12:27:56.872411  4263 tablet_bootstrap.cc:654] T 70d90926ee274610a5addbacc456d3e6 P ffc6860a7daf42ea871d9389b9fce64a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.876247  3930 leader_election.cc:304] T 4e1151150f9a467ebd21f401fb352c29 P e083b2fa907d42b3b33dfba2d9f45240 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e083b2fa907d42b3b33dfba2d9f45240, e134dafee8df424690057d14e75c2e82; no voters: 
I20260709 12:27:56.879746  4287 raft_consensus.cc:2804] T 4e1151150f9a467ebd21f401fb352c29 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:56.880254  4287 raft_consensus.cc:493] T 4e1151150f9a467ebd21f401fb352c29 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:56.873453  4264 tablet_bootstrap.cc:492] T 6a3d62d2c10d46e1ae7198117fa43d67 P e134dafee8df424690057d14e75c2e82: No bootstrap required, opened a new log
I20260709 12:27:56.880698  4287 raft_consensus.cc:3060] T 4e1151150f9a467ebd21f401fb352c29 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:56.881279  4264 ts_tablet_manager.cc:1403] T 6a3d62d2c10d46e1ae7198117fa43d67 P e134dafee8df424690057d14e75c2e82: Time spent bootstrapping tablet: real 0.043s	user 0.013s	sys 0.001s
I20260709 12:27:56.885330  4264 raft_consensus.cc:359] T 6a3d62d2c10d46e1ae7198117fa43d67 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.886266  4264 raft_consensus.cc:385] T 6a3d62d2c10d46e1ae7198117fa43d67 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.886632  4264 raft_consensus.cc:740] T 6a3d62d2c10d46e1ae7198117fa43d67 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e134dafee8df424690057d14e75c2e82, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.887589  4264 consensus_queue.cc:260] T 6a3d62d2c10d46e1ae7198117fa43d67 P e134dafee8df424690057d14e75c2e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.887758  4251 raft_consensus.cc:515] T b76c818ee9f34bddaec899987166e3c7 P e134dafee8df424690057d14e75c2e82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.897693  4264 ts_tablet_manager.cc:1434] T 6a3d62d2c10d46e1ae7198117fa43d67 P e134dafee8df424690057d14e75c2e82: Time spent starting tablet: real 0.016s	user 0.010s	sys 0.000s
I20260709 12:27:56.898872  4298 raft_consensus.cc:493] T d7bf8a5e5f8648a08295d2e0e9da0b41 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:56.904820  4298 raft_consensus.cc:515] T d7bf8a5e5f8648a08295d2e0e9da0b41 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.909673  4298 leader_election.cc:290] T d7bf8a5e5f8648a08295d2e0e9da0b41 P e134dafee8df424690057d14e75c2e82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229), ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130:46493)
I20260709 12:27:56.913347  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8a5e5f8648a08295d2e0e9da0b41" candidate_uuid: "e134dafee8df424690057d14e75c2e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffc6860a7daf42ea871d9389b9fce64a" is_pre_election: true
W20260709 12:27:56.921190  4079 leader_election.cc:343] T d7bf8a5e5f8648a08295d2e0e9da0b41 P e134dafee8df424690057d14e75c2e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130:46493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:56.901479  4251 leader_election.cc:290] T b76c818ee9f34bddaec899987166e3c7 P e134dafee8df424690057d14e75c2e82 [CANDIDATE]: Term 1 election: Requested vote from peers e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229), ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130:46493)
I20260709 12:27:56.904137  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76c818ee9f34bddaec899987166e3c7" candidate_uuid: "e134dafee8df424690057d14e75c2e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffc6860a7daf42ea871d9389b9fce64a"
I20260709 12:27:56.901139  4264 tablet_bootstrap.cc:492] T 70d90926ee274610a5addbacc456d3e6 P e134dafee8df424690057d14e75c2e82: Bootstrap starting.
W20260709 12:27:56.925025  4079 leader_election.cc:343] T b76c818ee9f34bddaec899987166e3c7 P e134dafee8df424690057d14e75c2e82 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130:46493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:56.930465  4264 tablet_bootstrap.cc:654] T 70d90926ee274610a5addbacc456d3e6 P e134dafee8df424690057d14e75c2e82: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.935307  4287 raft_consensus.cc:515] T 4e1151150f9a467ebd21f401fb352c29 P e083b2fa907d42b3b33dfba2d9f45240 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.936192  4262 tablet_bootstrap.cc:492] T d7bf8a5e5f8648a08295d2e0e9da0b41 P e083b2fa907d42b3b33dfba2d9f45240: No bootstrap required, opened a new log
I20260709 12:27:56.936486  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76c818ee9f34bddaec899987166e3c7" candidate_uuid: "e134dafee8df424690057d14e75c2e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e083b2fa907d42b3b33dfba2d9f45240"
I20260709 12:27:56.936764  4262 ts_tablet_manager.cc:1403] T d7bf8a5e5f8648a08295d2e0e9da0b41 P e083b2fa907d42b3b33dfba2d9f45240: Time spent bootstrapping tablet: real 0.104s	user 0.028s	sys 0.049s
I20260709 12:27:56.936908  4263 tablet_bootstrap.cc:492] T 70d90926ee274610a5addbacc456d3e6 P ffc6860a7daf42ea871d9389b9fce64a: No bootstrap required, opened a new log
I20260709 12:27:56.937129  3964 raft_consensus.cc:3060] T b76c818ee9f34bddaec899987166e3c7 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:56.937394  4263 ts_tablet_manager.cc:1403] T 70d90926ee274610a5addbacc456d3e6 P ffc6860a7daf42ea871d9389b9fce64a: Time spent bootstrapping tablet: real 0.083s	user 0.018s	sys 0.019s
I20260709 12:27:56.937675  4287 leader_election.cc:290] T 4e1151150f9a467ebd21f401fb352c29 P e083b2fa907d42b3b33dfba2d9f45240 [CANDIDATE]: Term 1 election: Requested vote from peers ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130:46493), e134dafee8df424690057d14e75c2e82 (127.23.245.131:36883)
I20260709 12:27:56.940616  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8a5e5f8648a08295d2e0e9da0b41" candidate_uuid: "e134dafee8df424690057d14e75c2e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e083b2fa907d42b3b33dfba2d9f45240" is_pre_election: true
I20260709 12:27:56.940778  4263 raft_consensus.cc:359] T 70d90926ee274610a5addbacc456d3e6 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.940996  4262 raft_consensus.cc:359] T d7bf8a5e5f8648a08295d2e0e9da0b41 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.941622  4263 raft_consensus.cc:385] T 70d90926ee274610a5addbacc456d3e6 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.942492  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e1151150f9a467ebd21f401fb352c29" candidate_uuid: "e083b2fa907d42b3b33dfba2d9f45240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffc6860a7daf42ea871d9389b9fce64a"
I20260709 12:27:56.942996  4262 raft_consensus.cc:385] T d7bf8a5e5f8648a08295d2e0e9da0b41 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.949318  4263 raft_consensus.cc:740] T 70d90926ee274610a5addbacc456d3e6 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffc6860a7daf42ea871d9389b9fce64a, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.942942  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e1151150f9a467ebd21f401fb352c29" candidate_uuid: "e083b2fa907d42b3b33dfba2d9f45240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e134dafee8df424690057d14e75c2e82"
I20260709 12:27:56.949581  4262 raft_consensus.cc:740] T d7bf8a5e5f8648a08295d2e0e9da0b41 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e083b2fa907d42b3b33dfba2d9f45240, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.950371  4114 raft_consensus.cc:3060] T 4e1151150f9a467ebd21f401fb352c29 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:56.950294  4263 consensus_queue.cc:260] T 70d90926ee274610a5addbacc456d3e6 P ffc6860a7daf42ea871d9389b9fce64a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.950911  4262 consensus_queue.cc:260] T d7bf8a5e5f8648a08295d2e0e9da0b41 P e083b2fa907d42b3b33dfba2d9f45240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.952087  3965 raft_consensus.cc:2468] T d7bf8a5e5f8648a08295d2e0e9da0b41 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e134dafee8df424690057d14e75c2e82 in term 0.
I20260709 12:27:56.953090  4263 ts_tablet_manager.cc:1434] T 70d90926ee274610a5addbacc456d3e6 P ffc6860a7daf42ea871d9389b9fce64a: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.008s
I20260709 12:27:56.953298  4262 ts_tablet_manager.cc:1434] T d7bf8a5e5f8648a08295d2e0e9da0b41 P e083b2fa907d42b3b33dfba2d9f45240: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 12:27:56.954298  4262 tablet_bootstrap.cc:492] T 70d90926ee274610a5addbacc456d3e6 P e083b2fa907d42b3b33dfba2d9f45240: Bootstrap starting.
I20260709 12:27:56.954514  4081 leader_election.cc:304] T d7bf8a5e5f8648a08295d2e0e9da0b41 P e134dafee8df424690057d14e75c2e82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e083b2fa907d42b3b33dfba2d9f45240, e134dafee8df424690057d14e75c2e82; no voters: ffc6860a7daf42ea871d9389b9fce64a
I20260709 12:27:56.949862  4041 raft_consensus.cc:3060] T 4e1151150f9a467ebd21f401fb352c29 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:56.956081  4299 raft_consensus.cc:2804] T d7bf8a5e5f8648a08295d2e0e9da0b41 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:56.956456  4299 raft_consensus.cc:493] T d7bf8a5e5f8648a08295d2e0e9da0b41 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:56.956820  4299 raft_consensus.cc:3060] T d7bf8a5e5f8648a08295d2e0e9da0b41 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:56.960101  3964 raft_consensus.cc:2468] T b76c818ee9f34bddaec899987166e3c7 P e083b2fa907d42b3b33dfba2d9f45240 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e134dafee8df424690057d14e75c2e82 in term 1.
I20260709 12:27:56.961234  4081 leader_election.cc:304] T b76c818ee9f34bddaec899987166e3c7 P e134dafee8df424690057d14e75c2e82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e083b2fa907d42b3b33dfba2d9f45240, e134dafee8df424690057d14e75c2e82; no voters: ffc6860a7daf42ea871d9389b9fce64a
I20260709 12:27:56.954253  4263 tablet_bootstrap.cc:492] T b76c818ee9f34bddaec899987166e3c7 P ffc6860a7daf42ea871d9389b9fce64a: Bootstrap starting.
I20260709 12:27:56.962317  4251 raft_consensus.cc:2804] T b76c818ee9f34bddaec899987166e3c7 P e134dafee8df424690057d14e75c2e82 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:56.962898  4251 raft_consensus.cc:697] T b76c818ee9f34bddaec899987166e3c7 P e134dafee8df424690057d14e75c2e82 [term 1 LEADER]: Becoming Leader. State: Replica: e134dafee8df424690057d14e75c2e82, State: Running, Role: LEADER
I20260709 12:27:56.963860  4262 tablet_bootstrap.cc:654] T 70d90926ee274610a5addbacc456d3e6 P e083b2fa907d42b3b33dfba2d9f45240: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.963685  4251 consensus_queue.cc:237] T b76c818ee9f34bddaec899987166e3c7 P e134dafee8df424690057d14e75c2e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.969805  4041 raft_consensus.cc:2468] T 4e1151150f9a467ebd21f401fb352c29 P ffc6860a7daf42ea871d9389b9fce64a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e083b2fa907d42b3b33dfba2d9f45240 in term 1.
I20260709 12:27:56.972886  4264 tablet_bootstrap.cc:492] T 70d90926ee274610a5addbacc456d3e6 P e134dafee8df424690057d14e75c2e82: No bootstrap required, opened a new log
I20260709 12:27:56.982153  4264 ts_tablet_manager.cc:1403] T 70d90926ee274610a5addbacc456d3e6 P e134dafee8df424690057d14e75c2e82: Time spent bootstrapping tablet: real 0.081s	user 0.012s	sys 0.009s
I20260709 12:27:56.975368  4298 raft_consensus.cc:493] T 6a3d62d2c10d46e1ae7198117fa43d67 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:56.982667  4298 raft_consensus.cc:515] T 6a3d62d2c10d46e1ae7198117fa43d67 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.974993  4299 raft_consensus.cc:515] T d7bf8a5e5f8648a08295d2e0e9da0b41 P e134dafee8df424690057d14e75c2e82 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.977154  4262 tablet_bootstrap.cc:492] T 70d90926ee274610a5addbacc456d3e6 P e083b2fa907d42b3b33dfba2d9f45240: No bootstrap required, opened a new log
I20260709 12:27:56.985039  4298 leader_election.cc:290] T 6a3d62d2c10d46e1ae7198117fa43d67 P e134dafee8df424690057d14e75c2e82 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229), ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130:46493)
I20260709 12:27:56.985486  4262 ts_tablet_manager.cc:1403] T 70d90926ee274610a5addbacc456d3e6 P e083b2fa907d42b3b33dfba2d9f45240: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.007s
I20260709 12:27:56.986012  4264 raft_consensus.cc:359] T 70d90926ee274610a5addbacc456d3e6 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.986759  4264 raft_consensus.cc:385] T 70d90926ee274610a5addbacc456d3e6 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.987031  4264 raft_consensus.cc:740] T 70d90926ee274610a5addbacc456d3e6 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e134dafee8df424690057d14e75c2e82, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.987107  4299 leader_election.cc:290] T d7bf8a5e5f8648a08295d2e0e9da0b41 P e134dafee8df424690057d14e75c2e82 [CANDIDATE]: Term 1 election: Requested vote from peers e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229), ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130:46493)
I20260709 12:27:56.981345  4114 raft_consensus.cc:2468] T 4e1151150f9a467ebd21f401fb352c29 P e134dafee8df424690057d14e75c2e82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e083b2fa907d42b3b33dfba2d9f45240 in term 1.
I20260709 12:27:56.973664  4263 tablet_bootstrap.cc:654] T b76c818ee9f34bddaec899987166e3c7 P ffc6860a7daf42ea871d9389b9fce64a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.988338  4262 raft_consensus.cc:359] T 70d90926ee274610a5addbacc456d3e6 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.988876  4262 raft_consensus.cc:385] T 70d90926ee274610a5addbacc456d3e6 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.989205  4262 raft_consensus.cc:740] T 70d90926ee274610a5addbacc456d3e6 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e083b2fa907d42b3b33dfba2d9f45240, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.987767  4264 consensus_queue.cc:260] T 70d90926ee274610a5addbacc456d3e6 P e134dafee8df424690057d14e75c2e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.990343  4275 raft_consensus.cc:493] T cf7d17c9f4f54d63ac12f4015065ab60 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:56.990850  4275 raft_consensus.cc:515] T cf7d17c9f4f54d63ac12f4015065ab60 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.989879  4262 consensus_queue.cc:260] T 70d90926ee274610a5addbacc456d3e6 P e083b2fa907d42b3b33dfba2d9f45240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:56.991647  4040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8a5e5f8648a08295d2e0e9da0b41" candidate_uuid: "e134dafee8df424690057d14e75c2e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffc6860a7daf42ea871d9389b9fce64a"
I20260709 12:27:56.991834  4264 ts_tablet_manager.cc:1434] T 70d90926ee274610a5addbacc456d3e6 P e134dafee8df424690057d14e75c2e82: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:27:56.993197  4275 leader_election.cc:290] T cf7d17c9f4f54d63ac12f4015065ab60 P ffc6860a7daf42ea871d9389b9fce64a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229), e134dafee8df424690057d14e75c2e82 (127.23.245.131:36883)
I20260709 12:27:56.993989  3930 leader_election.cc:304] T 4e1151150f9a467ebd21f401fb352c29 P e083b2fa907d42b3b33dfba2d9f45240 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e083b2fa907d42b3b33dfba2d9f45240, e134dafee8df424690057d14e75c2e82; no voters: 
I20260709 12:27:56.994616  4262 ts_tablet_manager.cc:1434] T 70d90926ee274610a5addbacc456d3e6 P e083b2fa907d42b3b33dfba2d9f45240: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:27:56.995455  4287 raft_consensus.cc:2804] T 4e1151150f9a467ebd21f401fb352c29 P e083b2fa907d42b3b33dfba2d9f45240 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:56.995963  4287 raft_consensus.cc:697] T 4e1151150f9a467ebd21f401fb352c29 P e083b2fa907d42b3b33dfba2d9f45240 [term 1 LEADER]: Becoming Leader. State: Replica: e083b2fa907d42b3b33dfba2d9f45240, State: Running, Role: LEADER
I20260709 12:27:56.995738  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7bf8a5e5f8648a08295d2e0e9da0b41" candidate_uuid: "e134dafee8df424690057d14e75c2e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e083b2fa907d42b3b33dfba2d9f45240"
I20260709 12:27:56.996580  3966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7d17c9f4f54d63ac12f4015065ab60" candidate_uuid: "ffc6860a7daf42ea871d9389b9fce64a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e083b2fa907d42b3b33dfba2d9f45240" is_pre_election: true
I20260709 12:27:56.997026  3965 raft_consensus.cc:3060] T d7bf8a5e5f8648a08295d2e0e9da0b41 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:27:56.998559  4079 leader_election.cc:343] T d7bf8a5e5f8648a08295d2e0e9da0b41 P e134dafee8df424690057d14e75c2e82 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130:46493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:57.000154  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf7d17c9f4f54d63ac12f4015065ab60" candidate_uuid: "ffc6860a7daf42ea871d9389b9fce64a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e134dafee8df424690057d14e75c2e82" is_pre_election: true
I20260709 12:27:57.000962  4115 raft_consensus.cc:2393] T cf7d17c9f4f54d63ac12f4015065ab60 P e134dafee8df424690057d14e75c2e82 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ffc6860a7daf42ea871d9389b9fce64a in current term 1: Already voted for candidate e083b2fa907d42b3b33dfba2d9f45240 in this term.
I20260709 12:27:57.001479  3863 catalog_manager.cc:5697] T d97a598a1a4d49d6af38a80b7d94085a P ffc6860a7daf42ea871d9389b9fce64a reported cstate change: term changed from 0 to 1, leader changed from <none> to ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130). New cstate: current_term: 1 leader_uuid: "ffc6860a7daf42ea871d9389b9fce64a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:57.005445  4262 tablet_bootstrap.cc:492] T 6a3d62d2c10d46e1ae7198117fa43d67 P e083b2fa907d42b3b33dfba2d9f45240: Bootstrap starting.
I20260709 12:27:57.005733  4005 leader_election.cc:304] T cf7d17c9f4f54d63ac12f4015065ab60 P ffc6860a7daf42ea871d9389b9fce64a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ffc6860a7daf42ea871d9389b9fce64a; no voters: e083b2fa907d42b3b33dfba2d9f45240, e134dafee8df424690057d14e75c2e82
I20260709 12:27:57.006587  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3d62d2c10d46e1ae7198117fa43d67" candidate_uuid: "e134dafee8df424690057d14e75c2e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e083b2fa907d42b3b33dfba2d9f45240" is_pre_election: true
I20260709 12:27:57.007841  4188 raft_consensus.cc:3060] T cf7d17c9f4f54d63ac12f4015065ab60 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:57.012090  4262 tablet_bootstrap.cc:654] T 6a3d62d2c10d46e1ae7198117fa43d67 P e083b2fa907d42b3b33dfba2d9f45240: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.996855  4287 consensus_queue.cc:237] T 4e1151150f9a467ebd21f401fb352c29 P e083b2fa907d42b3b33dfba2d9f45240 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:57.017373  4263 tablet_bootstrap.cc:492] T b76c818ee9f34bddaec899987166e3c7 P ffc6860a7daf42ea871d9389b9fce64a: No bootstrap required, opened a new log
I20260709 12:27:57.017907  4263 ts_tablet_manager.cc:1403] T b76c818ee9f34bddaec899987166e3c7 P ffc6860a7daf42ea871d9389b9fce64a: Time spent bootstrapping tablet: real 0.064s	user 0.010s	sys 0.025s
I20260709 12:27:57.019338  4262 tablet_bootstrap.cc:492] T 6a3d62d2c10d46e1ae7198117fa43d67 P e083b2fa907d42b3b33dfba2d9f45240: No bootstrap required, opened a new log
I20260709 12:27:57.019879  4262 ts_tablet_manager.cc:1403] T 6a3d62d2c10d46e1ae7198117fa43d67 P e083b2fa907d42b3b33dfba2d9f45240: Time spent bootstrapping tablet: real 0.015s	user 0.006s	sys 0.003s
I20260709 12:27:57.021533  4263 raft_consensus.cc:359] T b76c818ee9f34bddaec899987166e3c7 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:57.022631  4263 raft_consensus.cc:385] T b76c818ee9f34bddaec899987166e3c7 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:57.022541  4262 raft_consensus.cc:359] T 6a3d62d2c10d46e1ae7198117fa43d67 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:57.023379  4262 raft_consensus.cc:385] T 6a3d62d2c10d46e1ae7198117fa43d67 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:57.023192  4263 raft_consensus.cc:740] T b76c818ee9f34bddaec899987166e3c7 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffc6860a7daf42ea871d9389b9fce64a, State: Initialized, Role: FOLLOWER
I20260709 12:27:57.023710  4262 raft_consensus.cc:740] T 6a3d62d2c10d46e1ae7198117fa43d67 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e083b2fa907d42b3b33dfba2d9f45240, State: Initialized, Role: FOLLOWER
I20260709 12:27:57.024483  4263 consensus_queue.cc:260] T b76c818ee9f34bddaec899987166e3c7 P ffc6860a7daf42ea871d9389b9fce64a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
W20260709 12:27:57.025456  4081 leader_election.cc:343] T 6a3d62d2c10d46e1ae7198117fa43d67 P e134dafee8df424690057d14e75c2e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:57.024555  4262 consensus_queue.cc:260] T 6a3d62d2c10d46e1ae7198117fa43d67 P e083b2fa907d42b3b33dfba2d9f45240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:57.027138  4263 ts_tablet_manager.cc:1434] T b76c818ee9f34bddaec899987166e3c7 P ffc6860a7daf42ea871d9389b9fce64a: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:27:57.027180  4262 ts_tablet_manager.cc:1434] T 6a3d62d2c10d46e1ae7198117fa43d67 P e083b2fa907d42b3b33dfba2d9f45240: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:27:57.028748  4263 tablet_bootstrap.cc:492] T d7bf8a5e5f8648a08295d2e0e9da0b41 P ffc6860a7daf42ea871d9389b9fce64a: Bootstrap starting.
I20260709 12:27:57.035950  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3d62d2c10d46e1ae7198117fa43d67" candidate_uuid: "e134dafee8df424690057d14e75c2e82" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffc6860a7daf42ea871d9389b9fce64a" is_pre_election: true
I20260709 12:27:57.037211  3860 catalog_manager.cc:5697] T b76c818ee9f34bddaec899987166e3c7 P e134dafee8df424690057d14e75c2e82 reported cstate change: term changed from 0 to 1, leader changed from <none> to e134dafee8df424690057d14e75c2e82 (127.23.245.131). New cstate: current_term: 1 leader_uuid: "e134dafee8df424690057d14e75c2e82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } health_report { overall_health: HEALTHY } } }
W20260709 12:27:57.040628  4079 leader_election.cc:343] T 6a3d62d2c10d46e1ae7198117fa43d67 P e134dafee8df424690057d14e75c2e82 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130:46493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:57.040725  4263 tablet_bootstrap.cc:654] T d7bf8a5e5f8648a08295d2e0e9da0b41 P ffc6860a7daf42ea871d9389b9fce64a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:57.041214  4079 leader_election.cc:304] T 6a3d62d2c10d46e1ae7198117fa43d67 P e134dafee8df424690057d14e75c2e82 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e134dafee8df424690057d14e75c2e82; no voters: e083b2fa907d42b3b33dfba2d9f45240, ffc6860a7daf42ea871d9389b9fce64a
I20260709 12:27:57.042953  4299 raft_consensus.cc:2749] T 6a3d62d2c10d46e1ae7198117fa43d67 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:57.044459  4188 raft_consensus.cc:2749] T cf7d17c9f4f54d63ac12f4015065ab60 P ffc6860a7daf42ea871d9389b9fce64a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:57.047653  4275 raft_consensus.cc:493] T 70d90926ee274610a5addbacc456d3e6 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:57.048805  3965 raft_consensus.cc:2468] T d7bf8a5e5f8648a08295d2e0e9da0b41 P e083b2fa907d42b3b33dfba2d9f45240 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e134dafee8df424690057d14e75c2e82 in term 1.
I20260709 12:27:57.048313  4275 raft_consensus.cc:515] T 70d90926ee274610a5addbacc456d3e6 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:57.051419  4081 leader_election.cc:304] T d7bf8a5e5f8648a08295d2e0e9da0b41 P e134dafee8df424690057d14e75c2e82 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e083b2fa907d42b3b33dfba2d9f45240, e134dafee8df424690057d14e75c2e82; no voters: ffc6860a7daf42ea871d9389b9fce64a
I20260709 12:27:57.052589  4299 raft_consensus.cc:2804] T d7bf8a5e5f8648a08295d2e0e9da0b41 P e134dafee8df424690057d14e75c2e82 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:57.053074  4299 raft_consensus.cc:697] T d7bf8a5e5f8648a08295d2e0e9da0b41 P e134dafee8df424690057d14e75c2e82 [term 1 LEADER]: Becoming Leader. State: Replica: e134dafee8df424690057d14e75c2e82, State: Running, Role: LEADER
I20260709 12:27:57.053879  4299 consensus_queue.cc:237] T d7bf8a5e5f8648a08295d2e0e9da0b41 P e134dafee8df424690057d14e75c2e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:57.055480  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70d90926ee274610a5addbacc456d3e6" candidate_uuid: "ffc6860a7daf42ea871d9389b9fce64a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e083b2fa907d42b3b33dfba2d9f45240" is_pre_election: true
I20260709 12:27:57.056644  3965 raft_consensus.cc:2468] T 70d90926ee274610a5addbacc456d3e6 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ffc6860a7daf42ea871d9389b9fce64a in term 0.
I20260709 12:27:57.058226  4007 leader_election.cc:304] T 70d90926ee274610a5addbacc456d3e6 P ffc6860a7daf42ea871d9389b9fce64a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e083b2fa907d42b3b33dfba2d9f45240, ffc6860a7daf42ea871d9389b9fce64a; no voters: 
I20260709 12:27:57.059376  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70d90926ee274610a5addbacc456d3e6" candidate_uuid: "ffc6860a7daf42ea871d9389b9fce64a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e134dafee8df424690057d14e75c2e82" is_pre_election: true
I20260709 12:27:57.059546  4283 raft_consensus.cc:2804] T 70d90926ee274610a5addbacc456d3e6 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:57.060211  4114 raft_consensus.cc:2468] T 70d90926ee274610a5addbacc456d3e6 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ffc6860a7daf42ea871d9389b9fce64a in term 0.
I20260709 12:27:57.060379  4283 raft_consensus.cc:493] T 70d90926ee274610a5addbacc456d3e6 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:57.060920  4283 raft_consensus.cc:3060] T 70d90926ee274610a5addbacc456d3e6 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:57.061811  4275 leader_election.cc:290] T 70d90926ee274610a5addbacc456d3e6 P ffc6860a7daf42ea871d9389b9fce64a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229), e134dafee8df424690057d14e75c2e82 (127.23.245.131:36883)
I20260709 12:27:57.068130  4216 raft_consensus.cc:493] T 6a3d62d2c10d46e1ae7198117fa43d67 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:57.068981  4216 raft_consensus.cc:515] T 6a3d62d2c10d46e1ae7198117fa43d67 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:57.072803  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3d62d2c10d46e1ae7198117fa43d67" candidate_uuid: "e083b2fa907d42b3b33dfba2d9f45240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffc6860a7daf42ea871d9389b9fce64a" is_pre_election: true
I20260709 12:27:57.074383  4283 raft_consensus.cc:515] T 70d90926ee274610a5addbacc456d3e6 P ffc6860a7daf42ea871d9389b9fce64a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
W20260709 12:27:57.074887  3930 leader_election.cc:343] T 6a3d62d2c10d46e1ae7198117fa43d67 P e083b2fa907d42b3b33dfba2d9f45240 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130:46493): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:57.079990  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70d90926ee274610a5addbacc456d3e6" candidate_uuid: "ffc6860a7daf42ea871d9389b9fce64a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e134dafee8df424690057d14e75c2e82"
I20260709 12:27:57.080930  4115 raft_consensus.cc:3060] T 70d90926ee274610a5addbacc456d3e6 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:57.080096  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3d62d2c10d46e1ae7198117fa43d67" candidate_uuid: "e083b2fa907d42b3b33dfba2d9f45240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e134dafee8df424690057d14e75c2e82" is_pre_election: true
I20260709 12:27:57.084720  4114 raft_consensus.cc:2468] T 6a3d62d2c10d46e1ae7198117fa43d67 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e083b2fa907d42b3b33dfba2d9f45240 in term 0.
I20260709 12:27:57.085765  4283 leader_election.cc:290] T 70d90926ee274610a5addbacc456d3e6 P ffc6860a7daf42ea871d9389b9fce64a [CANDIDATE]: Term 1 election: Requested vote from peers e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229), e134dafee8df424690057d14e75c2e82 (127.23.245.131:36883)
I20260709 12:27:57.088193  3860 catalog_manager.cc:5697] T d7bf8a5e5f8648a08295d2e0e9da0b41 P e134dafee8df424690057d14e75c2e82 reported cstate change: term changed from 0 to 1, leader changed from <none> to e134dafee8df424690057d14e75c2e82 (127.23.245.131). New cstate: current_term: 1 leader_uuid: "e134dafee8df424690057d14e75c2e82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:57.089221  4263 tablet_bootstrap.cc:492] T d7bf8a5e5f8648a08295d2e0e9da0b41 P ffc6860a7daf42ea871d9389b9fce64a: No bootstrap required, opened a new log
I20260709 12:27:57.089740  4263 ts_tablet_manager.cc:1403] T d7bf8a5e5f8648a08295d2e0e9da0b41 P ffc6860a7daf42ea871d9389b9fce64a: Time spent bootstrapping tablet: real 0.061s	user 0.034s	sys 0.022s
I20260709 12:27:57.090957  4115 raft_consensus.cc:2468] T 70d90926ee274610a5addbacc456d3e6 P e134dafee8df424690057d14e75c2e82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffc6860a7daf42ea871d9389b9fce64a in term 1.
I20260709 12:27:57.092063  3930 leader_election.cc:304] T 6a3d62d2c10d46e1ae7198117fa43d67 P e083b2fa907d42b3b33dfba2d9f45240 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e083b2fa907d42b3b33dfba2d9f45240, e134dafee8df424690057d14e75c2e82; no voters: ffc6860a7daf42ea871d9389b9fce64a
I20260709 12:27:57.079901  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70d90926ee274610a5addbacc456d3e6" candidate_uuid: "ffc6860a7daf42ea871d9389b9fce64a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e083b2fa907d42b3b33dfba2d9f45240"
I20260709 12:27:57.092567  4263 raft_consensus.cc:359] T d7bf8a5e5f8648a08295d2e0e9da0b41 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:57.076542  4216 leader_election.cc:290] T 6a3d62d2c10d46e1ae7198117fa43d67 P e083b2fa907d42b3b33dfba2d9f45240 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130:46493), e134dafee8df424690057d14e75c2e82 (127.23.245.131:36883)
I20260709 12:27:57.093262  4263 raft_consensus.cc:385] T d7bf8a5e5f8648a08295d2e0e9da0b41 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:57.093554  4263 raft_consensus.cc:740] T d7bf8a5e5f8648a08295d2e0e9da0b41 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffc6860a7daf42ea871d9389b9fce64a, State: Initialized, Role: FOLLOWER
I20260709 12:27:57.093894  4216 raft_consensus.cc:2804] T 6a3d62d2c10d46e1ae7198117fa43d67 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:57.094233  4263 consensus_queue.cc:260] T d7bf8a5e5f8648a08295d2e0e9da0b41 P ffc6860a7daf42ea871d9389b9fce64a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:57.096709  4263 ts_tablet_manager.cc:1434] T d7bf8a5e5f8648a08295d2e0e9da0b41 P ffc6860a7daf42ea871d9389b9fce64a: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:27:57.097631  4263 tablet_bootstrap.cc:492] T 6a3d62d2c10d46e1ae7198117fa43d67 P ffc6860a7daf42ea871d9389b9fce64a: Bootstrap starting.
I20260709 12:27:57.098636  4005 leader_election.cc:304] T 70d90926ee274610a5addbacc456d3e6 P ffc6860a7daf42ea871d9389b9fce64a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e134dafee8df424690057d14e75c2e82, ffc6860a7daf42ea871d9389b9fce64a; no voters: 
I20260709 12:27:57.094266  4216 raft_consensus.cc:493] T 6a3d62d2c10d46e1ae7198117fa43d67 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:57.101163  4283 raft_consensus.cc:2804] T 70d90926ee274610a5addbacc456d3e6 P ffc6860a7daf42ea871d9389b9fce64a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:57.101310  4216 raft_consensus.cc:3060] T 6a3d62d2c10d46e1ae7198117fa43d67 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:57.101780  4283 raft_consensus.cc:697] T 70d90926ee274610a5addbacc456d3e6 P ffc6860a7daf42ea871d9389b9fce64a [term 1 LEADER]: Becoming Leader. State: Replica: ffc6860a7daf42ea871d9389b9fce64a, State: Running, Role: LEADER
I20260709 12:27:57.102633  4283 consensus_queue.cc:237] T 70d90926ee274610a5addbacc456d3e6 P ffc6860a7daf42ea871d9389b9fce64a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:57.102872  3863 catalog_manager.cc:5697] T 4e1151150f9a467ebd21f401fb352c29 P e083b2fa907d42b3b33dfba2d9f45240 reported cstate change: term changed from 0 to 1, leader changed from <none> to e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129). New cstate: current_term: 1 leader_uuid: "e083b2fa907d42b3b33dfba2d9f45240" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:57.107153  4263 tablet_bootstrap.cc:654] T 6a3d62d2c10d46e1ae7198117fa43d67 P ffc6860a7daf42ea871d9389b9fce64a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:57.093288  3965 raft_consensus.cc:3060] T 70d90926ee274610a5addbacc456d3e6 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:57.111759  4275 consensus_queue.cc:1048] T 2ee866cdb98640d78e7b5d108a652846 P ffc6860a7daf42ea871d9389b9fce64a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:57.127784  3965 raft_consensus.cc:2468] T 70d90926ee274610a5addbacc456d3e6 P e083b2fa907d42b3b33dfba2d9f45240 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffc6860a7daf42ea871d9389b9fce64a in term 1.
I20260709 12:27:57.133957  3860 catalog_manager.cc:5697] T 70d90926ee274610a5addbacc456d3e6 P ffc6860a7daf42ea871d9389b9fce64a reported cstate change: term changed from 0 to 1, leader changed from <none> to ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130). New cstate: current_term: 1 leader_uuid: "ffc6860a7daf42ea871d9389b9fce64a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:57.134971  4216 raft_consensus.cc:515] T 6a3d62d2c10d46e1ae7198117fa43d67 P e083b2fa907d42b3b33dfba2d9f45240 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:57.139824  4263 tablet_bootstrap.cc:492] T 6a3d62d2c10d46e1ae7198117fa43d67 P ffc6860a7daf42ea871d9389b9fce64a: No bootstrap required, opened a new log
I20260709 12:27:57.140578  4263 ts_tablet_manager.cc:1403] T 6a3d62d2c10d46e1ae7198117fa43d67 P ffc6860a7daf42ea871d9389b9fce64a: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.026s
I20260709 12:27:57.143468  4263 raft_consensus.cc:359] T 6a3d62d2c10d46e1ae7198117fa43d67 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:57.144167  4263 raft_consensus.cc:385] T 6a3d62d2c10d46e1ae7198117fa43d67 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:57.144412  4263 raft_consensus.cc:740] T 6a3d62d2c10d46e1ae7198117fa43d67 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffc6860a7daf42ea871d9389b9fce64a, State: Initialized, Role: FOLLOWER
I20260709 12:27:57.145206  4263 consensus_queue.cc:260] T 6a3d62d2c10d46e1ae7198117fa43d67 P ffc6860a7daf42ea871d9389b9fce64a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:57.146234  3965 raft_consensus.cc:3060] T 2ee866cdb98640d78e7b5d108a652846 P e083b2fa907d42b3b33dfba2d9f45240 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:57.147406  4263 ts_tablet_manager.cc:1434] T 6a3d62d2c10d46e1ae7198117fa43d67 P ffc6860a7daf42ea871d9389b9fce64a: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:27:57.149595  4216 leader_election.cc:290] T 6a3d62d2c10d46e1ae7198117fa43d67 P e083b2fa907d42b3b33dfba2d9f45240 [CANDIDATE]: Term 1 election: Requested vote from peers ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130:46493), e134dafee8df424690057d14e75c2e82 (127.23.245.131:36883)
I20260709 12:27:57.150172  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3d62d2c10d46e1ae7198117fa43d67" candidate_uuid: "e083b2fa907d42b3b33dfba2d9f45240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffc6860a7daf42ea871d9389b9fce64a"
I20260709 12:27:57.150671  4041 raft_consensus.cc:3060] T 6a3d62d2c10d46e1ae7198117fa43d67 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:57.152052  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3d62d2c10d46e1ae7198117fa43d67" candidate_uuid: "e083b2fa907d42b3b33dfba2d9f45240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e134dafee8df424690057d14e75c2e82"
I20260709 12:27:57.152638  4115 raft_consensus.cc:3060] T 6a3d62d2c10d46e1ae7198117fa43d67 P e134dafee8df424690057d14e75c2e82 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:57.156263  4041 raft_consensus.cc:2468] T 6a3d62d2c10d46e1ae7198117fa43d67 P ffc6860a7daf42ea871d9389b9fce64a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e083b2fa907d42b3b33dfba2d9f45240 in term 1.
I20260709 12:27:57.157477  3930 leader_election.cc:304] T 6a3d62d2c10d46e1ae7198117fa43d67 P e083b2fa907d42b3b33dfba2d9f45240 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e083b2fa907d42b3b33dfba2d9f45240, ffc6860a7daf42ea871d9389b9fce64a; no voters: 
I20260709 12:27:57.158027  4287 raft_consensus.cc:493] T 2ee866cdb98640d78e7b5d108a652846 P e083b2fa907d42b3b33dfba2d9f45240 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:57.158581  4287 raft_consensus.cc:515] T 2ee866cdb98640d78e7b5d108a652846 P e083b2fa907d42b3b33dfba2d9f45240 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:57.158897  4275 consensus_queue.cc:1048] T 2ee866cdb98640d78e7b5d108a652846 P ffc6860a7daf42ea871d9389b9fce64a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:57.161065  4115 raft_consensus.cc:2468] T 6a3d62d2c10d46e1ae7198117fa43d67 P e134dafee8df424690057d14e75c2e82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e083b2fa907d42b3b33dfba2d9f45240 in term 1.
I20260709 12:27:57.161154  4216 raft_consensus.cc:2804] T 6a3d62d2c10d46e1ae7198117fa43d67 P e083b2fa907d42b3b33dfba2d9f45240 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:57.162294  4287 leader_election.cc:290] T 2ee866cdb98640d78e7b5d108a652846 P e083b2fa907d42b3b33dfba2d9f45240 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130:46493), e134dafee8df424690057d14e75c2e82 (127.23.245.131:36883)
I20260709 12:27:57.163666  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee866cdb98640d78e7b5d108a652846" candidate_uuid: "e083b2fa907d42b3b33dfba2d9f45240" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffc6860a7daf42ea871d9389b9fce64a" is_pre_election: true
I20260709 12:27:57.163868  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee866cdb98640d78e7b5d108a652846" candidate_uuid: "e083b2fa907d42b3b33dfba2d9f45240" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e134dafee8df424690057d14e75c2e82" is_pre_election: true
I20260709 12:27:57.165522  3930 leader_election.cc:304] T 2ee866cdb98640d78e7b5d108a652846 P e083b2fa907d42b3b33dfba2d9f45240 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e083b2fa907d42b3b33dfba2d9f45240; no voters: e134dafee8df424690057d14e75c2e82, ffc6860a7daf42ea871d9389b9fce64a
I20260709 12:27:57.168030  4216 raft_consensus.cc:697] T 6a3d62d2c10d46e1ae7198117fa43d67 P e083b2fa907d42b3b33dfba2d9f45240 [term 1 LEADER]: Becoming Leader. State: Replica: e083b2fa907d42b3b33dfba2d9f45240, State: Running, Role: LEADER
I20260709 12:27:57.169163  4216 consensus_queue.cc:237] T 6a3d62d2c10d46e1ae7198117fa43d67 P e083b2fa907d42b3b33dfba2d9f45240 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:57.169739  4287 raft_consensus.cc:2749] T 2ee866cdb98640d78e7b5d108a652846 P e083b2fa907d42b3b33dfba2d9f45240 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:57.177213  3863 catalog_manager.cc:5697] T 6a3d62d2c10d46e1ae7198117fa43d67 P e083b2fa907d42b3b33dfba2d9f45240 reported cstate change: term changed from 0 to 1, leader changed from <none> to e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129). New cstate: current_term: 1 leader_uuid: "e083b2fa907d42b3b33dfba2d9f45240" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:57.184413  4216 consensus_queue.cc:1048] T cf7d17c9f4f54d63ac12f4015065ab60 P e083b2fa907d42b3b33dfba2d9f45240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:57.196593  4216 consensus_queue.cc:1048] T cf7d17c9f4f54d63ac12f4015065ab60 P e083b2fa907d42b3b33dfba2d9f45240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:57.214938  4041 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "acbdf543b174470e9a0d4e181804ae01"
dest_uuid: "ffc6860a7daf42ea871d9389b9fce64a"
mode: GRACEFUL
new_leader_uuid: "e083b2fa907d42b3b33dfba2d9f45240"
 from {username='slave'} at 127.0.0.1:39866
I20260709 12:27:57.215651  4041 raft_consensus.cc:606] T acbdf543b174470e9a0d4e181804ae01 P ffc6860a7daf42ea871d9389b9fce64a [term 1 LEADER]: Received request to transfer leadership to TS e083b2fa907d42b3b33dfba2d9f45240
I20260709 12:27:57.221067  4041 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ee866cdb98640d78e7b5d108a652846"
dest_uuid: "ffc6860a7daf42ea871d9389b9fce64a"
mode: GRACEFUL
new_leader_uuid: "e083b2fa907d42b3b33dfba2d9f45240"
 from {username='slave'} at 127.0.0.1:39866
I20260709 12:27:57.221619  4041 raft_consensus.cc:606] T 2ee866cdb98640d78e7b5d108a652846 P ffc6860a7daf42ea871d9389b9fce64a [term 1 LEADER]: Received request to transfer leadership to TS e083b2fa907d42b3b33dfba2d9f45240
I20260709 12:27:57.228924  4275 raft_consensus.cc:493] T b76c818ee9f34bddaec899987166e3c7 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:57.229526  4275 raft_consensus.cc:515] T b76c818ee9f34bddaec899987166e3c7 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:57.231398  4275 leader_election.cc:290] T b76c818ee9f34bddaec899987166e3c7 P ffc6860a7daf42ea871d9389b9fce64a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229), e134dafee8df424690057d14e75c2e82 (127.23.245.131:36883)
I20260709 12:27:57.232204  3965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76c818ee9f34bddaec899987166e3c7" candidate_uuid: "ffc6860a7daf42ea871d9389b9fce64a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e083b2fa907d42b3b33dfba2d9f45240" is_pre_election: true
I20260709 12:27:57.232687  4115 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b76c818ee9f34bddaec899987166e3c7"
dest_uuid: "e134dafee8df424690057d14e75c2e82"
mode: GRACEFUL
new_leader_uuid: "ffc6860a7daf42ea871d9389b9fce64a"
 from {username='slave'} at 127.0.0.1:40274
I20260709 12:27:57.232945  3965 raft_consensus.cc:2393] T b76c818ee9f34bddaec899987166e3c7 P e083b2fa907d42b3b33dfba2d9f45240 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ffc6860a7daf42ea871d9389b9fce64a in current term 1: Already voted for candidate e134dafee8df424690057d14e75c2e82 in this term.
I20260709 12:27:57.233333  4115 raft_consensus.cc:606] T b76c818ee9f34bddaec899987166e3c7 P e134dafee8df424690057d14e75c2e82 [term 1 LEADER]: Received request to transfer leadership to TS ffc6860a7daf42ea871d9389b9fce64a
I20260709 12:27:57.234073  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76c818ee9f34bddaec899987166e3c7" candidate_uuid: "ffc6860a7daf42ea871d9389b9fce64a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e134dafee8df424690057d14e75c2e82" is_pre_election: true
I20260709 12:27:57.235376  4005 leader_election.cc:304] T b76c818ee9f34bddaec899987166e3c7 P ffc6860a7daf42ea871d9389b9fce64a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ffc6860a7daf42ea871d9389b9fce64a; no voters: e083b2fa907d42b3b33dfba2d9f45240, e134dafee8df424690057d14e75c2e82
I20260709 12:27:57.236148  4275 raft_consensus.cc:3060] T b76c818ee9f34bddaec899987166e3c7 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:57.242735  3965 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a3d62d2c10d46e1ae7198117fa43d67"
dest_uuid: "e083b2fa907d42b3b33dfba2d9f45240"
mode: GRACEFUL
new_leader_uuid: "ffc6860a7daf42ea871d9389b9fce64a"
 from {username='slave'} at 127.0.0.1:50414
I20260709 12:27:57.243319  4275 raft_consensus.cc:2749] T b76c818ee9f34bddaec899987166e3c7 P ffc6860a7daf42ea871d9389b9fce64a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:57.243430  3965 raft_consensus.cc:606] T 6a3d62d2c10d46e1ae7198117fa43d67 P e083b2fa907d42b3b33dfba2d9f45240 [term 1 LEADER]: Received request to transfer leadership to TS ffc6860a7daf42ea871d9389b9fce64a
I20260709 12:27:57.263423  4275 consensus_queue.cc:1048] T acbdf543b174470e9a0d4e181804ae01 P ffc6860a7daf42ea871d9389b9fce64a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:57.270171  4283 raft_consensus.cc:993] T acbdf543b174470e9a0d4e181804ae01 P ffc6860a7daf42ea871d9389b9fce64a: : Instructing follower e083b2fa907d42b3b33dfba2d9f45240 to start an election
I20260709 12:27:57.270681  4188 raft_consensus.cc:1081] T acbdf543b174470e9a0d4e181804ae01 P ffc6860a7daf42ea871d9389b9fce64a [term 1 LEADER]: Signalling peer e083b2fa907d42b3b33dfba2d9f45240 to start an election
I20260709 12:27:57.272750  3964 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "acbdf543b174470e9a0d4e181804ae01"
dest_uuid: "e083b2fa907d42b3b33dfba2d9f45240"
 from {username='slave'} at 127.0.0.1:50404
I20260709 12:27:57.273357  3964 raft_consensus.cc:493] T acbdf543b174470e9a0d4e181804ae01 P e083b2fa907d42b3b33dfba2d9f45240 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:57.273746  3964 raft_consensus.cc:3060] T acbdf543b174470e9a0d4e181804ae01 P e083b2fa907d42b3b33dfba2d9f45240 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:57.278020  4284 consensus_queue.cc:1048] T acbdf543b174470e9a0d4e181804ae01 P ffc6860a7daf42ea871d9389b9fce64a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:57.281389  3964 raft_consensus.cc:515] T acbdf543b174470e9a0d4e181804ae01 P e083b2fa907d42b3b33dfba2d9f45240 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:57.285023  3964 leader_election.cc:290] T acbdf543b174470e9a0d4e181804ae01 P e083b2fa907d42b3b33dfba2d9f45240 [CANDIDATE]: Term 2 election: Requested vote from peers ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130:46493), e134dafee8df424690057d14e75c2e82 (127.23.245.131:36883)
I20260709 12:27:57.287276  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acbdf543b174470e9a0d4e181804ae01" candidate_uuid: "e083b2fa907d42b3b33dfba2d9f45240" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ffc6860a7daf42ea871d9389b9fce64a"
I20260709 12:27:57.287849  4041 raft_consensus.cc:3055] T acbdf543b174470e9a0d4e181804ae01 P ffc6860a7daf42ea871d9389b9fce64a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:57.288173  4041 raft_consensus.cc:740] T acbdf543b174470e9a0d4e181804ae01 P ffc6860a7daf42ea871d9389b9fce64a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ffc6860a7daf42ea871d9389b9fce64a, State: Running, Role: LEADER
I20260709 12:27:57.288424  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acbdf543b174470e9a0d4e181804ae01" candidate_uuid: "e083b2fa907d42b3b33dfba2d9f45240" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e134dafee8df424690057d14e75c2e82"
I20260709 12:27:57.289041  4114 raft_consensus.cc:3060] T acbdf543b174470e9a0d4e181804ae01 P e134dafee8df424690057d14e75c2e82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:57.288906  4041 consensus_queue.cc:260] T acbdf543b174470e9a0d4e181804ae01 P ffc6860a7daf42ea871d9389b9fce64a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:57.290266  4041 raft_consensus.cc:3060] T acbdf543b174470e9a0d4e181804ae01 P ffc6860a7daf42ea871d9389b9fce64a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:57.296483  4114 raft_consensus.cc:2468] T acbdf543b174470e9a0d4e181804ae01 P e134dafee8df424690057d14e75c2e82 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e083b2fa907d42b3b33dfba2d9f45240 in term 2.
I20260709 12:27:57.297611  3930 leader_election.cc:304] T acbdf543b174470e9a0d4e181804ae01 P e083b2fa907d42b3b33dfba2d9f45240 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e083b2fa907d42b3b33dfba2d9f45240, e134dafee8df424690057d14e75c2e82; no voters: 
I20260709 12:27:57.297902  4041 raft_consensus.cc:2468] T acbdf543b174470e9a0d4e181804ae01 P ffc6860a7daf42ea871d9389b9fce64a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e083b2fa907d42b3b33dfba2d9f45240 in term 2.
I20260709 12:27:57.298539  4287 raft_consensus.cc:2804] T acbdf543b174470e9a0d4e181804ae01 P e083b2fa907d42b3b33dfba2d9f45240 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:57.299062  4287 raft_consensus.cc:697] T acbdf543b174470e9a0d4e181804ae01 P e083b2fa907d42b3b33dfba2d9f45240 [term 2 LEADER]: Becoming Leader. State: Replica: e083b2fa907d42b3b33dfba2d9f45240, State: Running, Role: LEADER
I20260709 12:27:57.299871  4287 consensus_queue.cc:237] T acbdf543b174470e9a0d4e181804ae01 P e083b2fa907d42b3b33dfba2d9f45240 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:57.306761  3862 catalog_manager.cc:5697] T acbdf543b174470e9a0d4e181804ae01 P e083b2fa907d42b3b33dfba2d9f45240 reported cstate change: term changed from 1 to 2, leader changed from ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130) to e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129). New cstate: current_term: 2 leader_uuid: "e083b2fa907d42b3b33dfba2d9f45240" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:57.322865  4284 consensus_queue.cc:1048] T d97a598a1a4d49d6af38a80b7d94085a P ffc6860a7daf42ea871d9389b9fce64a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:57.326247  4284 consensus_queue.cc:1048] T d97a598a1a4d49d6af38a80b7d94085a P ffc6860a7daf42ea871d9389b9fce64a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:57.394397  4299 consensus_queue.cc:1048] T b76c818ee9f34bddaec899987166e3c7 P e134dafee8df424690057d14e75c2e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:57.406699  4326 consensus_queue.cc:1048] T b76c818ee9f34bddaec899987166e3c7 P e134dafee8df424690057d14e75c2e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:57.415498  4251 raft_consensus.cc:993] T b76c818ee9f34bddaec899987166e3c7 P e134dafee8df424690057d14e75c2e82: : Instructing follower ffc6860a7daf42ea871d9389b9fce64a to start an election
I20260709 12:27:57.415967  4326 raft_consensus.cc:1081] T b76c818ee9f34bddaec899987166e3c7 P e134dafee8df424690057d14e75c2e82 [term 1 LEADER]: Signalling peer ffc6860a7daf42ea871d9389b9fce64a to start an election
I20260709 12:27:57.417613  4041 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b76c818ee9f34bddaec899987166e3c7"
dest_uuid: "ffc6860a7daf42ea871d9389b9fce64a"
 from {username='slave'} at 127.0.0.1:39860
I20260709 12:27:57.418107  4041 raft_consensus.cc:493] T b76c818ee9f34bddaec899987166e3c7 P ffc6860a7daf42ea871d9389b9fce64a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:57.418412  4041 raft_consensus.cc:3060] T b76c818ee9f34bddaec899987166e3c7 P ffc6860a7daf42ea871d9389b9fce64a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:57.422979  4041 raft_consensus.cc:515] T b76c818ee9f34bddaec899987166e3c7 P ffc6860a7daf42ea871d9389b9fce64a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:57.424538  4041 leader_election.cc:290] T b76c818ee9f34bddaec899987166e3c7 P ffc6860a7daf42ea871d9389b9fce64a [CANDIDATE]: Term 2 election: Requested vote from peers e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229), e134dafee8df424690057d14e75c2e82 (127.23.245.131:36883)
I20260709 12:27:57.425426  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76c818ee9f34bddaec899987166e3c7" candidate_uuid: "ffc6860a7daf42ea871d9389b9fce64a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e083b2fa907d42b3b33dfba2d9f45240"
I20260709 12:27:57.425807  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b76c818ee9f34bddaec899987166e3c7" candidate_uuid: "ffc6860a7daf42ea871d9389b9fce64a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e134dafee8df424690057d14e75c2e82"
I20260709 12:27:57.426383  4115 raft_consensus.cc:3055] T b76c818ee9f34bddaec899987166e3c7 P e134dafee8df424690057d14e75c2e82 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:57.426442  3964 raft_consensus.cc:3060] T b76c818ee9f34bddaec899987166e3c7 P e083b2fa907d42b3b33dfba2d9f45240 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:57.426788  4115 raft_consensus.cc:740] T b76c818ee9f34bddaec899987166e3c7 P e134dafee8df424690057d14e75c2e82 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e134dafee8df424690057d14e75c2e82, State: Running, Role: LEADER
I20260709 12:27:57.427544  4115 consensus_queue.cc:260] T b76c818ee9f34bddaec899987166e3c7 P e134dafee8df424690057d14e75c2e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:57.428499  4115 raft_consensus.cc:3060] T b76c818ee9f34bddaec899987166e3c7 P e134dafee8df424690057d14e75c2e82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:57.433218  3964 raft_consensus.cc:2468] T b76c818ee9f34bddaec899987166e3c7 P e083b2fa907d42b3b33dfba2d9f45240 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffc6860a7daf42ea871d9389b9fce64a in term 2.
I20260709 12:27:57.434041  4115 raft_consensus.cc:2468] T b76c818ee9f34bddaec899987166e3c7 P e134dafee8df424690057d14e75c2e82 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffc6860a7daf42ea871d9389b9fce64a in term 2.
I20260709 12:27:57.434165  4007 leader_election.cc:304] T b76c818ee9f34bddaec899987166e3c7 P ffc6860a7daf42ea871d9389b9fce64a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e083b2fa907d42b3b33dfba2d9f45240, ffc6860a7daf42ea871d9389b9fce64a; no voters: 
I20260709 12:27:57.435072  4188 raft_consensus.cc:2804] T b76c818ee9f34bddaec899987166e3c7 P ffc6860a7daf42ea871d9389b9fce64a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:57.435508  4188 raft_consensus.cc:697] T b76c818ee9f34bddaec899987166e3c7 P ffc6860a7daf42ea871d9389b9fce64a [term 2 LEADER]: Becoming Leader. State: Replica: ffc6860a7daf42ea871d9389b9fce64a, State: Running, Role: LEADER
I20260709 12:27:57.436262  4188 consensus_queue.cc:237] T b76c818ee9f34bddaec899987166e3c7 P ffc6860a7daf42ea871d9389b9fce64a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:57.442715  3863 catalog_manager.cc:5697] T b76c818ee9f34bddaec899987166e3c7 P ffc6860a7daf42ea871d9389b9fce64a reported cstate change: term changed from 1 to 2, leader changed from e134dafee8df424690057d14e75c2e82 (127.23.245.131) to ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130). New cstate: current_term: 2 leader_uuid: "ffc6860a7daf42ea871d9389b9fce64a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:57.458436  4287 consensus_queue.cc:1048] T 4e1151150f9a467ebd21f401fb352c29 P e083b2fa907d42b3b33dfba2d9f45240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:57.469729  4315 consensus_queue.cc:1048] T 4e1151150f9a467ebd21f401fb352c29 P e083b2fa907d42b3b33dfba2d9f45240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:57.483812  4041 raft_consensus.cc:3060] T d7bf8a5e5f8648a08295d2e0e9da0b41 P ffc6860a7daf42ea871d9389b9fce64a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:57.489385  4326 consensus_queue.cc:1048] T d7bf8a5e5f8648a08295d2e0e9da0b41 P e134dafee8df424690057d14e75c2e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:57.495705  4188 consensus_queue.cc:1048] T 70d90926ee274610a5addbacc456d3e6 P ffc6860a7daf42ea871d9389b9fce64a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:57.501085  4251 consensus_queue.cc:1048] T d7bf8a5e5f8648a08295d2e0e9da0b41 P e134dafee8df424690057d14e75c2e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:57.510301  4283 consensus_queue.cc:1048] T 70d90926ee274610a5addbacc456d3e6 P ffc6860a7daf42ea871d9389b9fce64a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:57.579520  4275 raft_consensus.cc:993] T 2ee866cdb98640d78e7b5d108a652846 P ffc6860a7daf42ea871d9389b9fce64a: : Instructing follower e083b2fa907d42b3b33dfba2d9f45240 to start an election
I20260709 12:27:57.580065  4283 raft_consensus.cc:1081] T 2ee866cdb98640d78e7b5d108a652846 P ffc6860a7daf42ea871d9389b9fce64a [term 1 LEADER]: Signalling peer e083b2fa907d42b3b33dfba2d9f45240 to start an election
I20260709 12:27:57.581686  3964 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ee866cdb98640d78e7b5d108a652846"
dest_uuid: "e083b2fa907d42b3b33dfba2d9f45240"
 from {username='slave'} at 127.0.0.1:50404
I20260709 12:27:57.582154  3964 raft_consensus.cc:493] T 2ee866cdb98640d78e7b5d108a652846 P e083b2fa907d42b3b33dfba2d9f45240 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:57.582440  3964 raft_consensus.cc:3060] T 2ee866cdb98640d78e7b5d108a652846 P e083b2fa907d42b3b33dfba2d9f45240 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:57.588011  3964 raft_consensus.cc:515] T 2ee866cdb98640d78e7b5d108a652846 P e083b2fa907d42b3b33dfba2d9f45240 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:57.589546  3964 leader_election.cc:290] T 2ee866cdb98640d78e7b5d108a652846 P e083b2fa907d42b3b33dfba2d9f45240 [CANDIDATE]: Term 2 election: Requested vote from peers ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130:46493), e134dafee8df424690057d14e75c2e82 (127.23.245.131:36883)
I20260709 12:27:57.590492  4041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee866cdb98640d78e7b5d108a652846" candidate_uuid: "e083b2fa907d42b3b33dfba2d9f45240" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ffc6860a7daf42ea871d9389b9fce64a"
I20260709 12:27:57.590636  4115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ee866cdb98640d78e7b5d108a652846" candidate_uuid: "e083b2fa907d42b3b33dfba2d9f45240" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e134dafee8df424690057d14e75c2e82"
I20260709 12:27:57.591179  4041 raft_consensus.cc:3055] T 2ee866cdb98640d78e7b5d108a652846 P ffc6860a7daf42ea871d9389b9fce64a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:57.591234  4115 raft_consensus.cc:3060] T 2ee866cdb98640d78e7b5d108a652846 P e134dafee8df424690057d14e75c2e82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:57.591511  4041 raft_consensus.cc:740] T 2ee866cdb98640d78e7b5d108a652846 P ffc6860a7daf42ea871d9389b9fce64a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ffc6860a7daf42ea871d9389b9fce64a, State: Running, Role: LEADER
I20260709 12:27:57.592348  4041 consensus_queue.cc:260] T 2ee866cdb98640d78e7b5d108a652846 P ffc6860a7daf42ea871d9389b9fce64a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:57.593318  4041 raft_consensus.cc:3060] T 2ee866cdb98640d78e7b5d108a652846 P ffc6860a7daf42ea871d9389b9fce64a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:57.596335  4115 raft_consensus.cc:2468] T 2ee866cdb98640d78e7b5d108a652846 P e134dafee8df424690057d14e75c2e82 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e083b2fa907d42b3b33dfba2d9f45240 in term 2.
I20260709 12:27:57.597337  3930 leader_election.cc:304] T 2ee866cdb98640d78e7b5d108a652846 P e083b2fa907d42b3b33dfba2d9f45240 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e083b2fa907d42b3b33dfba2d9f45240, e134dafee8df424690057d14e75c2e82; no voters: 
I20260709 12:27:57.598168  4216 raft_consensus.cc:2804] T 2ee866cdb98640d78e7b5d108a652846 P e083b2fa907d42b3b33dfba2d9f45240 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:57.598307  4041 raft_consensus.cc:2468] T 2ee866cdb98640d78e7b5d108a652846 P ffc6860a7daf42ea871d9389b9fce64a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e083b2fa907d42b3b33dfba2d9f45240 in term 2.
I20260709 12:27:57.598695  4216 raft_consensus.cc:697] T 2ee866cdb98640d78e7b5d108a652846 P e083b2fa907d42b3b33dfba2d9f45240 [term 2 LEADER]: Becoming Leader. State: Replica: e083b2fa907d42b3b33dfba2d9f45240, State: Running, Role: LEADER
I20260709 12:27:57.599543  4216 consensus_queue.cc:237] T 2ee866cdb98640d78e7b5d108a652846 P e083b2fa907d42b3b33dfba2d9f45240 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:57.606216  3863 catalog_manager.cc:5697] T 2ee866cdb98640d78e7b5d108a652846 P e083b2fa907d42b3b33dfba2d9f45240 reported cstate change: term changed from 1 to 2, leader changed from ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130) to e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129). New cstate: current_term: 2 leader_uuid: "e083b2fa907d42b3b33dfba2d9f45240" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:57.643528  4216 consensus_queue.cc:1048] T 6a3d62d2c10d46e1ae7198117fa43d67 P e083b2fa907d42b3b33dfba2d9f45240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:57.650913  4315 raft_consensus.cc:993] T 6a3d62d2c10d46e1ae7198117fa43d67 P e083b2fa907d42b3b33dfba2d9f45240: : Instructing follower ffc6860a7daf42ea871d9389b9fce64a to start an election
I20260709 12:27:57.651439  4287 raft_consensus.cc:1081] T 6a3d62d2c10d46e1ae7198117fa43d67 P e083b2fa907d42b3b33dfba2d9f45240 [term 1 LEADER]: Signalling peer ffc6860a7daf42ea871d9389b9fce64a to start an election
I20260709 12:27:57.653219  4040 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a3d62d2c10d46e1ae7198117fa43d67"
dest_uuid: "ffc6860a7daf42ea871d9389b9fce64a"
 from {username='slave'} at 127.0.0.1:39850
I20260709 12:27:57.653805  4040 raft_consensus.cc:493] T 6a3d62d2c10d46e1ae7198117fa43d67 P ffc6860a7daf42ea871d9389b9fce64a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:57.654198  4040 raft_consensus.cc:3060] T 6a3d62d2c10d46e1ae7198117fa43d67 P ffc6860a7daf42ea871d9389b9fce64a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:57.657130  4216 consensus_queue.cc:1048] T 6a3d62d2c10d46e1ae7198117fa43d67 P e083b2fa907d42b3b33dfba2d9f45240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:57.661346  4040 raft_consensus.cc:515] T 6a3d62d2c10d46e1ae7198117fa43d67 P ffc6860a7daf42ea871d9389b9fce64a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:57.665061  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3d62d2c10d46e1ae7198117fa43d67" candidate_uuid: "ffc6860a7daf42ea871d9389b9fce64a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e083b2fa907d42b3b33dfba2d9f45240"
I20260709 12:27:57.665503  4114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a3d62d2c10d46e1ae7198117fa43d67" candidate_uuid: "ffc6860a7daf42ea871d9389b9fce64a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e134dafee8df424690057d14e75c2e82"
I20260709 12:27:57.665639  3964 raft_consensus.cc:3055] T 6a3d62d2c10d46e1ae7198117fa43d67 P e083b2fa907d42b3b33dfba2d9f45240 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:57.666235  3964 raft_consensus.cc:740] T 6a3d62d2c10d46e1ae7198117fa43d67 P e083b2fa907d42b3b33dfba2d9f45240 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e083b2fa907d42b3b33dfba2d9f45240, State: Running, Role: LEADER
I20260709 12:27:57.665730  4040 leader_election.cc:290] T 6a3d62d2c10d46e1ae7198117fa43d67 P ffc6860a7daf42ea871d9389b9fce64a [CANDIDATE]: Term 2 election: Requested vote from peers e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229), e134dafee8df424690057d14e75c2e82 (127.23.245.131:36883)
I20260709 12:27:57.667014  3964 consensus_queue.cc:260] T 6a3d62d2c10d46e1ae7198117fa43d67 P e083b2fa907d42b3b33dfba2d9f45240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:57.667949  3964 raft_consensus.cc:3060] T 6a3d62d2c10d46e1ae7198117fa43d67 P e083b2fa907d42b3b33dfba2d9f45240 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:57.674151  3964 raft_consensus.cc:2468] T 6a3d62d2c10d46e1ae7198117fa43d67 P e083b2fa907d42b3b33dfba2d9f45240 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ffc6860a7daf42ea871d9389b9fce64a in term 2.
I20260709 12:27:57.675052  4007 leader_election.cc:304] T 6a3d62d2c10d46e1ae7198117fa43d67 P ffc6860a7daf42ea871d9389b9fce64a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e083b2fa907d42b3b33dfba2d9f45240, ffc6860a7daf42ea871d9389b9fce64a; no voters: e134dafee8df424690057d14e75c2e82
I20260709 12:27:57.675891  4283 raft_consensus.cc:2804] T 6a3d62d2c10d46e1ae7198117fa43d67 P ffc6860a7daf42ea871d9389b9fce64a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:57.676465  4283 raft_consensus.cc:697] T 6a3d62d2c10d46e1ae7198117fa43d67 P ffc6860a7daf42ea871d9389b9fce64a [term 2 LEADER]: Becoming Leader. State: Replica: ffc6860a7daf42ea871d9389b9fce64a, State: Running, Role: LEADER
I20260709 12:27:57.677268  4283 consensus_queue.cc:237] T 6a3d62d2c10d46e1ae7198117fa43d67 P ffc6860a7daf42ea871d9389b9fce64a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:27:57.683822  3860 catalog_manager.cc:5697] T 6a3d62d2c10d46e1ae7198117fa43d67 P ffc6860a7daf42ea871d9389b9fce64a reported cstate change: term changed from 1 to 2, leader changed from e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129) to ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130). New cstate: current_term: 2 leader_uuid: "ffc6860a7daf42ea871d9389b9fce64a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:57.846114  4114 raft_consensus.cc:1275] T acbdf543b174470e9a0d4e181804ae01 P e134dafee8df424690057d14e75c2e82 [term 2 FOLLOWER]: Refusing update from remote peer e083b2fa907d42b3b33dfba2d9f45240: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:57.847412  4216 consensus_queue.cc:1048] T acbdf543b174470e9a0d4e181804ae01 P e083b2fa907d42b3b33dfba2d9f45240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:57.855528  4040 raft_consensus.cc:1275] T acbdf543b174470e9a0d4e181804ae01 P ffc6860a7daf42ea871d9389b9fce64a [term 2 FOLLOWER]: Refusing update from remote peer e083b2fa907d42b3b33dfba2d9f45240: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:57.857394  4315 consensus_queue.cc:1048] T acbdf543b174470e9a0d4e181804ae01 P e083b2fa907d42b3b33dfba2d9f45240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:57.891695  3964 raft_consensus.cc:1275] T b76c818ee9f34bddaec899987166e3c7 P e083b2fa907d42b3b33dfba2d9f45240 [term 2 FOLLOWER]: Refusing update from remote peer ffc6860a7daf42ea871d9389b9fce64a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:57.893301  4283 consensus_queue.cc:1048] T b76c818ee9f34bddaec899987166e3c7 P ffc6860a7daf42ea871d9389b9fce64a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:57.901275  4114 raft_consensus.cc:1275] T b76c818ee9f34bddaec899987166e3c7 P e134dafee8df424690057d14e75c2e82 [term 2 FOLLOWER]: Refusing update from remote peer ffc6860a7daf42ea871d9389b9fce64a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:57.903373  4275 consensus_queue.cc:1048] T b76c818ee9f34bddaec899987166e3c7 P ffc6860a7daf42ea871d9389b9fce64a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:58.036892  4041 raft_consensus.cc:1275] T 2ee866cdb98640d78e7b5d108a652846 P ffc6860a7daf42ea871d9389b9fce64a [term 2 FOLLOWER]: Refusing update from remote peer e083b2fa907d42b3b33dfba2d9f45240: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:58.038100  4216 consensus_queue.cc:1048] T 2ee866cdb98640d78e7b5d108a652846 P e083b2fa907d42b3b33dfba2d9f45240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:58.046779  4114 raft_consensus.cc:1275] T 2ee866cdb98640d78e7b5d108a652846 P e134dafee8df424690057d14e75c2e82 [term 2 FOLLOWER]: Refusing update from remote peer e083b2fa907d42b3b33dfba2d9f45240: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:58.048859  4287 consensus_queue.cc:1048] T 2ee866cdb98640d78e7b5d108a652846 P e083b2fa907d42b3b33dfba2d9f45240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:58.152129  3964 raft_consensus.cc:1275] T 6a3d62d2c10d46e1ae7198117fa43d67 P e083b2fa907d42b3b33dfba2d9f45240 [term 2 FOLLOWER]: Refusing update from remote peer ffc6860a7daf42ea871d9389b9fce64a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:58.154099  4275 consensus_queue.cc:1048] T 6a3d62d2c10d46e1ae7198117fa43d67 P ffc6860a7daf42ea871d9389b9fce64a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:58.161299  4114 raft_consensus.cc:3060] T 6a3d62d2c10d46e1ae7198117fa43d67 P e134dafee8df424690057d14e75c2e82 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:58.167726  4114 raft_consensus.cc:1275] T 6a3d62d2c10d46e1ae7198117fa43d67 P e134dafee8df424690057d14e75c2e82 [term 2 FOLLOWER]: Refusing update from remote peer ffc6860a7daf42ea871d9389b9fce64a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:58.169051  4275 consensus_queue.cc:1048] T 6a3d62d2c10d46e1ae7198117fa43d67 P ffc6860a7daf42ea871d9389b9fce64a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:00.250973  3860 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51758:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:28:00.276335  3860 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51758:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:28:00.373953 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:28:00.522754  4365 log.cc:927] Time spent T d97a598a1a4d49d6af38a80b7d94085a P ffc6860a7daf42ea871d9389b9fce64a: Append to log took a long time: real 0.062s	user 0.002s	sys 0.000s
I20260709 12:28:00.605103  4390 tablet.cc:1724] T cf7d17c9f4f54d63ac12f4015065ab60 P e083b2fa907d42b3b33dfba2d9f45240: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:28:00.600641  4378 log.cc:927] Time spent T acbdf543b174470e9a0d4e181804ae01 P ffc6860a7daf42ea871d9389b9fce64a: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 12:28:00.608932  4381 tablet.cc:1724] T b76c818ee9f34bddaec899987166e3c7 P ffc6860a7daf42ea871d9389b9fce64a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:00.677346  4392 tablet.cc:1724] T d7bf8a5e5f8648a08295d2e0e9da0b41 P e134dafee8df424690057d14e75c2e82: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:28:00.713449  4374 log.cc:927] Time spent T 6a3d62d2c10d46e1ae7198117fa43d67 P e134dafee8df424690057d14e75c2e82: Append to log took a long time: real 0.138s	user 0.002s	sys 0.000s
I20260709 12:28:00.729250  4401 tablet.cc:1724] T d7bf8a5e5f8648a08295d2e0e9da0b41 P ffc6860a7daf42ea871d9389b9fce64a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:00.737387  4399 tablet.cc:1724] T acbdf543b174470e9a0d4e181804ae01 P e083b2fa907d42b3b33dfba2d9f45240: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:00.749643  4398 tablet.cc:1724] T 70d90926ee274610a5addbacc456d3e6 P ffc6860a7daf42ea871d9389b9fce64a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:00.735948  4396 tablet.cc:1724] T acbdf543b174470e9a0d4e181804ae01 P e134dafee8df424690057d14e75c2e82: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:00.749176  4394 tablet.cc:1724] T 4e1151150f9a467ebd21f401fb352c29 P e083b2fa907d42b3b33dfba2d9f45240: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:00.759584  4402 tablet.cc:1724] T cf7d17c9f4f54d63ac12f4015065ab60 P ffc6860a7daf42ea871d9389b9fce64a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:00.781728  4403 tablet.cc:1724] T 70d90926ee274610a5addbacc456d3e6 P e134dafee8df424690057d14e75c2e82: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:00.715077  4386 tablet.cc:1724] T b76c818ee9f34bddaec899987166e3c7 P e134dafee8df424690057d14e75c2e82: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:00.803131  4405 tablet.cc:1724] T d7bf8a5e5f8648a08295d2e0e9da0b41 P e083b2fa907d42b3b33dfba2d9f45240: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:00.822436  4390 tablet.cc:1724] T d97a598a1a4d49d6af38a80b7d94085a P e083b2fa907d42b3b33dfba2d9f45240: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:00.836989  4381 tablet.cc:1724] T d97a598a1a4d49d6af38a80b7d94085a P ffc6860a7daf42ea871d9389b9fce64a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:00.857475  4396 tablet.cc:1724] T cf7d17c9f4f54d63ac12f4015065ab60 P e134dafee8df424690057d14e75c2e82: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:00.859103  4394 tablet.cc:1724] T b76c818ee9f34bddaec899987166e3c7 P e083b2fa907d42b3b33dfba2d9f45240: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:00.838871  4401 tablet.cc:1724] T 4e1151150f9a467ebd21f401fb352c29 P ffc6860a7daf42ea871d9389b9fce64a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:00.849431  4398 tablet.cc:1724] T acbdf543b174470e9a0d4e181804ae01 P ffc6860a7daf42ea871d9389b9fce64a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:00.850152  4399 tablet.cc:1724] T 2ee866cdb98640d78e7b5d108a652846 P e083b2fa907d42b3b33dfba2d9f45240: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:00.850390  4392 tablet.cc:1724] T 4e1151150f9a467ebd21f401fb352c29 P e134dafee8df424690057d14e75c2e82: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:00.851379  4405 tablet.cc:1724] T 70d90926ee274610a5addbacc456d3e6 P e083b2fa907d42b3b33dfba2d9f45240: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:00.849437  4038 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "018fbc94678e41318e867a918691041b"
dest_uuid: "ffc6860a7daf42ea871d9389b9fce64a"
mode: GRACEFUL
new_leader_uuid: "e134dafee8df424690057d14e75c2e82"
 from {username='slave'} at 127.0.0.1:39872
I20260709 12:28:00.875146  4038 raft_consensus.cc:606] T 018fbc94678e41318e867a918691041b P ffc6860a7daf42ea871d9389b9fce64a [term 2 LEADER]: Received request to transfer leadership to TS e134dafee8df424690057d14e75c2e82
I20260709 12:28:00.886005  4381 tablet.cc:1724] T 6a3d62d2c10d46e1ae7198117fa43d67 P ffc6860a7daf42ea871d9389b9fce64a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:00.902371  4390 tablet.cc:1724] T 6a3d62d2c10d46e1ae7198117fa43d67 P e083b2fa907d42b3b33dfba2d9f45240: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:00.904011  4392 tablet.cc:1724] T 2ee866cdb98640d78e7b5d108a652846 P e134dafee8df424690057d14e75c2e82: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:00.910501  4396 tablet.cc:1724] T 6a3d62d2c10d46e1ae7198117fa43d67 P e134dafee8df424690057d14e75c2e82: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:00.929431  4398 tablet.cc:1724] T 2ee866cdb98640d78e7b5d108a652846 P ffc6860a7daf42ea871d9389b9fce64a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:00.923017  4386 tablet.cc:1724] T d97a598a1a4d49d6af38a80b7d94085a P e134dafee8df424690057d14e75c2e82: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:00.958628  3963 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7e083776605c4a658bcca9cb211a4cf6"
dest_uuid: "e083b2fa907d42b3b33dfba2d9f45240"
mode: GRACEFUL
new_leader_uuid: "e134dafee8df424690057d14e75c2e82"
 from {username='slave'} at 127.0.0.1:50428
I20260709 12:28:00.959444  3963 raft_consensus.cc:606] T 7e083776605c4a658bcca9cb211a4cf6 P e083b2fa907d42b3b33dfba2d9f45240 [term 2 LEADER]: Received request to transfer leadership to TS e134dafee8df424690057d14e75c2e82
I20260709 12:28:00.960840 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:28:00.961530 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:00.973361  3860 catalog_manager.cc:6242] T 00000000000000000000000000000000 P f4f33ba8e7c646919d5a390966cdd894: soft_deleted_table [id=638529512a5f41229d38fa09b7e5d486] alter complete (version 1)
I20260709 12:28:00.992066  4373 raft_consensus.cc:993] T 018fbc94678e41318e867a918691041b P ffc6860a7daf42ea871d9389b9fce64a: : Instructing follower e134dafee8df424690057d14e75c2e82 to start an election
I20260709 12:28:00.992668  4376 raft_consensus.cc:1081] T 018fbc94678e41318e867a918691041b P ffc6860a7daf42ea871d9389b9fce64a [term 2 LEADER]: Signalling peer e134dafee8df424690057d14e75c2e82 to start an election
I20260709 12:28:00.994184  4114 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "018fbc94678e41318e867a918691041b"
dest_uuid: "e134dafee8df424690057d14e75c2e82"
 from {username='slave'} at 127.0.0.1:40266
I20260709 12:28:00.994647  4114 raft_consensus.cc:493] T 018fbc94678e41318e867a918691041b P e134dafee8df424690057d14e75c2e82 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:00.995070  4114 raft_consensus.cc:3060] T 018fbc94678e41318e867a918691041b P e134dafee8df424690057d14e75c2e82 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:01.000275  4114 raft_consensus.cc:515] T 018fbc94678e41318e867a918691041b P e134dafee8df424690057d14e75c2e82 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:28:01.001924  4114 leader_election.cc:290] T 018fbc94678e41318e867a918691041b P e134dafee8df424690057d14e75c2e82 [CANDIDATE]: Term 3 election: Requested vote from peers e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229), ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130:46493)
I20260709 12:28:01.003026  3963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018fbc94678e41318e867a918691041b" candidate_uuid: "e134dafee8df424690057d14e75c2e82" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e083b2fa907d42b3b33dfba2d9f45240"
I20260709 12:28:01.003021  4038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018fbc94678e41318e867a918691041b" candidate_uuid: "e134dafee8df424690057d14e75c2e82" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ffc6860a7daf42ea871d9389b9fce64a"
I20260709 12:28:01.004068  3963 raft_consensus.cc:3060] T 018fbc94678e41318e867a918691041b P e083b2fa907d42b3b33dfba2d9f45240 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:01.004328  4038 raft_consensus.cc:3055] T 018fbc94678e41318e867a918691041b P ffc6860a7daf42ea871d9389b9fce64a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:01.004719  4038 raft_consensus.cc:740] T 018fbc94678e41318e867a918691041b P ffc6860a7daf42ea871d9389b9fce64a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ffc6860a7daf42ea871d9389b9fce64a, State: Running, Role: LEADER
I20260709 12:28:01.005625  4038 consensus_queue.cc:260] T 018fbc94678e41318e867a918691041b P ffc6860a7daf42ea871d9389b9fce64a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:28:01.006798  4038 raft_consensus.cc:3060] T 018fbc94678e41318e867a918691041b P ffc6860a7daf42ea871d9389b9fce64a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:01.012498  3963 raft_consensus.cc:2468] T 018fbc94678e41318e867a918691041b P e083b2fa907d42b3b33dfba2d9f45240 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e134dafee8df424690057d14e75c2e82 in term 3.
I20260709 12:28:01.013512  3964 raft_consensus.cc:1240] T 018fbc94678e41318e867a918691041b P e083b2fa907d42b3b33dfba2d9f45240 [term 3 FOLLOWER]: Rejecting Update request from peer ffc6860a7daf42ea871d9389b9fce64a for earlier term 2. Current term is 3. Ops: []
I20260709 12:28:01.014112  4081 leader_election.cc:304] T 018fbc94678e41318e867a918691041b P e134dafee8df424690057d14e75c2e82 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e083b2fa907d42b3b33dfba2d9f45240, e134dafee8df424690057d14e75c2e82; no voters: 
I20260709 12:28:01.015316  4384 raft_consensus.cc:2804] T 018fbc94678e41318e867a918691041b P e134dafee8df424690057d14e75c2e82 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:01.015332  4038 raft_consensus.cc:2468] T 018fbc94678e41318e867a918691041b P ffc6860a7daf42ea871d9389b9fce64a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e134dafee8df424690057d14e75c2e82 in term 3.
I20260709 12:28:01.015908  4384 raft_consensus.cc:697] T 018fbc94678e41318e867a918691041b P e134dafee8df424690057d14e75c2e82 [term 3 LEADER]: Becoming Leader. State: Replica: e134dafee8df424690057d14e75c2e82, State: Running, Role: LEADER
I20260709 12:28:01.016925  4384 consensus_queue.cc:237] T 018fbc94678e41318e867a918691041b P e134dafee8df424690057d14e75c2e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:28:01.025883  3863 catalog_manager.cc:5697] T 018fbc94678e41318e867a918691041b P e134dafee8df424690057d14e75c2e82 reported cstate change: term changed from 2 to 3, leader changed from ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130) to e134dafee8df424690057d14e75c2e82 (127.23.245.131). New cstate: current_term: 3 leader_uuid: "e134dafee8df424690057d14e75c2e82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:01.211470  4380 raft_consensus.cc:993] T 7e083776605c4a658bcca9cb211a4cf6 P e083b2fa907d42b3b33dfba2d9f45240: : Instructing follower e134dafee8df424690057d14e75c2e82 to start an election
I20260709 12:28:01.211952  4287 raft_consensus.cc:1081] T 7e083776605c4a658bcca9cb211a4cf6 P e083b2fa907d42b3b33dfba2d9f45240 [term 2 LEADER]: Signalling peer e134dafee8df424690057d14e75c2e82 to start an election
I20260709 12:28:01.213415  4111 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7e083776605c4a658bcca9cb211a4cf6"
dest_uuid: "e134dafee8df424690057d14e75c2e82"
 from {username='slave'} at 127.0.0.1:40264
I20260709 12:28:01.213869  4111 raft_consensus.cc:493] T 7e083776605c4a658bcca9cb211a4cf6 P e134dafee8df424690057d14e75c2e82 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:01.214130  4111 raft_consensus.cc:3060] T 7e083776605c4a658bcca9cb211a4cf6 P e134dafee8df424690057d14e75c2e82 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:01.219528  4111 raft_consensus.cc:515] T 7e083776605c4a658bcca9cb211a4cf6 P e134dafee8df424690057d14e75c2e82 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:28:01.221601  4111 leader_election.cc:290] T 7e083776605c4a658bcca9cb211a4cf6 P e134dafee8df424690057d14e75c2e82 [CANDIDATE]: Term 3 election: Requested vote from peers e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229), ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130:46493)
I20260709 12:28:01.222687  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e083776605c4a658bcca9cb211a4cf6" candidate_uuid: "e134dafee8df424690057d14e75c2e82" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ffc6860a7daf42ea871d9389b9fce64a"
I20260709 12:28:01.223361  4039 raft_consensus.cc:3060] T 7e083776605c4a658bcca9cb211a4cf6 P ffc6860a7daf42ea871d9389b9fce64a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:01.223433  3964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e083776605c4a658bcca9cb211a4cf6" candidate_uuid: "e134dafee8df424690057d14e75c2e82" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e083b2fa907d42b3b33dfba2d9f45240"
I20260709 12:28:01.224152  3964 raft_consensus.cc:3055] T 7e083776605c4a658bcca9cb211a4cf6 P e083b2fa907d42b3b33dfba2d9f45240 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:01.224473  3964 raft_consensus.cc:740] T 7e083776605c4a658bcca9cb211a4cf6 P e083b2fa907d42b3b33dfba2d9f45240 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e083b2fa907d42b3b33dfba2d9f45240, State: Running, Role: LEADER
I20260709 12:28:01.225253  3964 consensus_queue.cc:260] T 7e083776605c4a658bcca9cb211a4cf6 P e083b2fa907d42b3b33dfba2d9f45240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:28:01.226508  3964 raft_consensus.cc:3060] T 7e083776605c4a658bcca9cb211a4cf6 P e083b2fa907d42b3b33dfba2d9f45240 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:01.229696  4039 raft_consensus.cc:2468] T 7e083776605c4a658bcca9cb211a4cf6 P ffc6860a7daf42ea871d9389b9fce64a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e134dafee8df424690057d14e75c2e82 in term 3.
I20260709 12:28:01.230930  4079 leader_election.cc:304] T 7e083776605c4a658bcca9cb211a4cf6 P e134dafee8df424690057d14e75c2e82 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e134dafee8df424690057d14e75c2e82, ffc6860a7daf42ea871d9389b9fce64a; no voters: 
I20260709 12:28:01.231617  3964 raft_consensus.cc:2468] T 7e083776605c4a658bcca9cb211a4cf6 P e083b2fa907d42b3b33dfba2d9f45240 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e134dafee8df424690057d14e75c2e82 in term 3.
I20260709 12:28:01.231709  4384 raft_consensus.cc:2804] T 7e083776605c4a658bcca9cb211a4cf6 P e134dafee8df424690057d14e75c2e82 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:01.232426  4384 raft_consensus.cc:697] T 7e083776605c4a658bcca9cb211a4cf6 P e134dafee8df424690057d14e75c2e82 [term 3 LEADER]: Becoming Leader. State: Replica: e134dafee8df424690057d14e75c2e82, State: Running, Role: LEADER
I20260709 12:28:01.233385  4384 consensus_queue.cc:237] T 7e083776605c4a658bcca9cb211a4cf6 P e134dafee8df424690057d14e75c2e82 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:28:01.241775  3863 catalog_manager.cc:5697] T 7e083776605c4a658bcca9cb211a4cf6 P e134dafee8df424690057d14e75c2e82 reported cstate change: term changed from 2 to 3, leader changed from e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129) to e134dafee8df424690057d14e75c2e82 (127.23.245.131). New cstate: current_term: 3 leader_uuid: "e134dafee8df424690057d14e75c2e82" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:01.414335  3963 raft_consensus.cc:1275] T 018fbc94678e41318e867a918691041b P e083b2fa907d42b3b33dfba2d9f45240 [term 3 FOLLOWER]: Refusing update from remote peer e134dafee8df424690057d14e75c2e82: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:01.415684  4384 consensus_queue.cc:1048] T 018fbc94678e41318e867a918691041b P e134dafee8df424690057d14e75c2e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:01.428040  4039 raft_consensus.cc:1275] T 018fbc94678e41318e867a918691041b P ffc6860a7daf42ea871d9389b9fce64a [term 3 FOLLOWER]: Refusing update from remote peer e134dafee8df424690057d14e75c2e82: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:01.429708  4336 consensus_queue.cc:1048] T 018fbc94678e41318e867a918691041b P e134dafee8df424690057d14e75c2e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:01.776912  4039 raft_consensus.cc:1275] T 7e083776605c4a658bcca9cb211a4cf6 P ffc6860a7daf42ea871d9389b9fce64a [term 3 FOLLOWER]: Refusing update from remote peer e134dafee8df424690057d14e75c2e82: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:01.778103  4384 consensus_queue.cc:1048] T 7e083776605c4a658bcca9cb211a4cf6 P e134dafee8df424690057d14e75c2e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:01.787777  3963 raft_consensus.cc:1275] T 7e083776605c4a658bcca9cb211a4cf6 P e083b2fa907d42b3b33dfba2d9f45240 [term 3 FOLLOWER]: Refusing update from remote peer e134dafee8df424690057d14e75c2e82: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:01.789538  4421 consensus_queue.cc:1048] T 7e083776605c4a658bcca9cb211a4cf6 P e134dafee8df424690057d14e75c2e82 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:01.962639 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:01.968436 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:01.968937 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:02.970096 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:02.977102 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:02.977553 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:03.978607 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:03.984043 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:03.984485 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:04.985757 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:05.000545 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:05.001354 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:06.002774 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:06.009032 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:06.009429 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:07.671398  4437 raft_consensus.cc:493] T 7e083776605c4a658bcca9cb211a4cf6 P e083b2fa907d42b3b33dfba2d9f45240 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e134dafee8df424690057d14e75c2e82)
I20260709 12:28:07.672695  4437 raft_consensus.cc:515] T 7e083776605c4a658bcca9cb211a4cf6 P e083b2fa907d42b3b33dfba2d9f45240 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e083b2fa907d42b3b33dfba2d9f45240" member_type: VOTER last_known_addr { host: "127.23.245.129" port: 34229 } } peers { permanent_uuid: "ffc6860a7daf42ea871d9389b9fce64a" member_type: VOTER last_known_addr { host: "127.23.245.130" port: 46493 } } peers { permanent_uuid: "e134dafee8df424690057d14e75c2e82" member_type: VOTER last_known_addr { host: "127.23.245.131" port: 36883 } }
I20260709 12:28:07.679437  4437 leader_election.cc:290] T 7e083776605c4a658bcca9cb211a4cf6 P e083b2fa907d42b3b33dfba2d9f45240 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130:46493), e134dafee8df424690057d14e75c2e82 (127.23.245.131:36883)
I20260709 12:28:07.687868  4039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e083776605c4a658bcca9cb211a4cf6" candidate_uuid: "e083b2fa907d42b3b33dfba2d9f45240" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "ffc6860a7daf42ea871d9389b9fce64a" is_pre_election: true
I20260709 12:28:07.709051  4111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e083776605c4a658bcca9cb211a4cf6" candidate_uuid: "e083b2fa907d42b3b33dfba2d9f45240" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e134dafee8df424690057d14e75c2e82" is_pre_election: true
I20260709 12:28:07.725126  3930 leader_election.cc:304] T 7e083776605c4a658bcca9cb211a4cf6 P e083b2fa907d42b3b33dfba2d9f45240 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e083b2fa907d42b3b33dfba2d9f45240; no voters: e134dafee8df424690057d14e75c2e82, ffc6860a7daf42ea871d9389b9fce64a
I20260709 12:28:07.726110  4437 raft_consensus.cc:2749] T 7e083776605c4a658bcca9cb211a4cf6 P e083b2fa907d42b3b33dfba2d9f45240 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:28:07.864810 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:07.869957 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:07.870338 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:28:08.563683  4062 debug-util.cc:398] Leaking SignalData structure 0x7b080009e960 after lost signal to thread 24537
W20260709 12:28:08.564911  4062 debug-util.cc:398] Leaking SignalData structure 0x7b08002089e0 after lost signal to thread 3898
W20260709 12:28:08.566016  4062 debug-util.cc:398] Leaking SignalData structure 0x7b0800140660 after lost signal to thread 3990
W20260709 12:28:08.566994  4062 debug-util.cc:398] Leaking SignalData structure 0x7b080016c840 after lost signal to thread 4065
W20260709 12:28:08.567970  4062 debug-util.cc:398] Leaking SignalData structure 0x7b080033bde0 after lost signal to thread 4139
I20260709 12:28:08.871260 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:08.877046 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:08.877512 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:09.878636 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:09.884052 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:09.884521 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:10.885576 24534 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:10.890516 24534 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:10.890955 24534 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:11.949872 24534 tablet_server.cc:179] TabletServer@127.23.245.129:0 shutting down...
I20260709 12:28:11.987249 24534 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:11.988125 24534 tablet_replica.cc:333] T d7bf8a5e5f8648a08295d2e0e9da0b41 P e083b2fa907d42b3b33dfba2d9f45240: stopping tablet replica
I20260709 12:28:11.989334 24534 raft_consensus.cc:2243] T d7bf8a5e5f8648a08295d2e0e9da0b41 P e083b2fa907d42b3b33dfba2d9f45240 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:11.990199 24534 raft_consensus.cc:2272] T d7bf8a5e5f8648a08295d2e0e9da0b41 P e083b2fa907d42b3b33dfba2d9f45240 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:11.993534 24534 tablet_replica.cc:333] T 2ee866cdb98640d78e7b5d108a652846 P e083b2fa907d42b3b33dfba2d9f45240: stopping tablet replica
I20260709 12:28:11.994248 24534 raft_consensus.cc:2243] T 2ee866cdb98640d78e7b5d108a652846 P e083b2fa907d42b3b33dfba2d9f45240 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:11.995133 24534 raft_consensus.cc:2272] T 2ee866cdb98640d78e7b5d108a652846 P e083b2fa907d42b3b33dfba2d9f45240 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:11.997764 24534 tablet_replica.cc:333] T d97a598a1a4d49d6af38a80b7d94085a P e083b2fa907d42b3b33dfba2d9f45240: stopping tablet replica
I20260709 12:28:11.998299 24534 raft_consensus.cc:2243] T d97a598a1a4d49d6af38a80b7d94085a P e083b2fa907d42b3b33dfba2d9f45240 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:11.998806 24534 raft_consensus.cc:2272] T d97a598a1a4d49d6af38a80b7d94085a P e083b2fa907d42b3b33dfba2d9f45240 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.001240 24534 tablet_replica.cc:333] T acbdf543b174470e9a0d4e181804ae01 P e083b2fa907d42b3b33dfba2d9f45240: stopping tablet replica
I20260709 12:28:12.001909 24534 raft_consensus.cc:2243] T acbdf543b174470e9a0d4e181804ae01 P e083b2fa907d42b3b33dfba2d9f45240 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:12.002854 24534 raft_consensus.cc:2272] T acbdf543b174470e9a0d4e181804ae01 P e083b2fa907d42b3b33dfba2d9f45240 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.005455 24534 tablet_replica.cc:333] T b76c818ee9f34bddaec899987166e3c7 P e083b2fa907d42b3b33dfba2d9f45240: stopping tablet replica
I20260709 12:28:12.006083 24534 raft_consensus.cc:2243] T b76c818ee9f34bddaec899987166e3c7 P e083b2fa907d42b3b33dfba2d9f45240 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:12.006914 24534 raft_consensus.cc:2272] T b76c818ee9f34bddaec899987166e3c7 P e083b2fa907d42b3b33dfba2d9f45240 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:12.009141  4007 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 10 similar messages]
I20260709 12:28:12.011118 24534 tablet_replica.cc:333] T b03341ea7bb64c2085bdecf904d11548 P e083b2fa907d42b3b33dfba2d9f45240: stopping tablet replica
I20260709 12:28:12.012244 24534 raft_consensus.cc:2243] T b03341ea7bb64c2085bdecf904d11548 P e083b2fa907d42b3b33dfba2d9f45240 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:12.013049 24534 raft_consensus.cc:2272] T b03341ea7bb64c2085bdecf904d11548 P e083b2fa907d42b3b33dfba2d9f45240 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.016765 24534 tablet_replica.cc:333] T 7e083776605c4a658bcca9cb211a4cf6 P e083b2fa907d42b3b33dfba2d9f45240: stopping tablet replica
I20260709 12:28:12.017841 24534 raft_consensus.cc:2243] T 7e083776605c4a658bcca9cb211a4cf6 P e083b2fa907d42b3b33dfba2d9f45240 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:12.018597 24534 raft_consensus.cc:2272] T 7e083776605c4a658bcca9cb211a4cf6 P e083b2fa907d42b3b33dfba2d9f45240 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:12.019490  4007 consensus_peers.cc:597] T 6a3d62d2c10d46e1ae7198117fa43d67 P ffc6860a7daf42ea871d9389b9fce64a -> Peer e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229): Couldn't send request to peer e083b2fa907d42b3b33dfba2d9f45240. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:12.020277  4081 consensus_peers.cc:597] T d7bf8a5e5f8648a08295d2e0e9da0b41 P e134dafee8df424690057d14e75c2e82 -> Peer e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229): Couldn't send request to peer e083b2fa907d42b3b33dfba2d9f45240. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:12.021890 24534 tablet_replica.cc:333] T 9dccf99aa7894eb5b71293becf61aff1 P e083b2fa907d42b3b33dfba2d9f45240: stopping tablet replica
I20260709 12:28:12.022558 24534 raft_consensus.cc:2243] T 9dccf99aa7894eb5b71293becf61aff1 P e083b2fa907d42b3b33dfba2d9f45240 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:12.023087 24534 raft_consensus.cc:2272] T 9dccf99aa7894eb5b71293becf61aff1 P e083b2fa907d42b3b33dfba2d9f45240 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.025568 24534 tablet_replica.cc:333] T 4e1151150f9a467ebd21f401fb352c29 P e083b2fa907d42b3b33dfba2d9f45240: stopping tablet replica
I20260709 12:28:12.026177 24534 raft_consensus.cc:2243] T 4e1151150f9a467ebd21f401fb352c29 P e083b2fa907d42b3b33dfba2d9f45240 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:12.027094 24534 raft_consensus.cc:2272] T 4e1151150f9a467ebd21f401fb352c29 P e083b2fa907d42b3b33dfba2d9f45240 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.029626 24534 tablet_replica.cc:333] T 018fbc94678e41318e867a918691041b P e083b2fa907d42b3b33dfba2d9f45240: stopping tablet replica
I20260709 12:28:12.030227 24534 raft_consensus.cc:2243] T 018fbc94678e41318e867a918691041b P e083b2fa907d42b3b33dfba2d9f45240 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:12.030864 24534 raft_consensus.cc:2272] T 018fbc94678e41318e867a918691041b P e083b2fa907d42b3b33dfba2d9f45240 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.033239 24534 tablet_replica.cc:333] T 6a3d62d2c10d46e1ae7198117fa43d67 P e083b2fa907d42b3b33dfba2d9f45240: stopping tablet replica
I20260709 12:28:12.033826 24534 raft_consensus.cc:2243] T 6a3d62d2c10d46e1ae7198117fa43d67 P e083b2fa907d42b3b33dfba2d9f45240 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:12.034380 24534 raft_consensus.cc:2272] T 6a3d62d2c10d46e1ae7198117fa43d67 P e083b2fa907d42b3b33dfba2d9f45240 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.036828 24534 tablet_replica.cc:333] T ca9249d3904b4b4580d1c289f923daee P e083b2fa907d42b3b33dfba2d9f45240: stopping tablet replica
I20260709 12:28:12.037376 24534 raft_consensus.cc:2243] T ca9249d3904b4b4580d1c289f923daee P e083b2fa907d42b3b33dfba2d9f45240 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:12.037902 24534 raft_consensus.cc:2272] T ca9249d3904b4b4580d1c289f923daee P e083b2fa907d42b3b33dfba2d9f45240 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.040467 24534 tablet_replica.cc:333] T cf7d17c9f4f54d63ac12f4015065ab60 P e083b2fa907d42b3b33dfba2d9f45240: stopping tablet replica
I20260709 12:28:12.041075 24534 raft_consensus.cc:2243] T cf7d17c9f4f54d63ac12f4015065ab60 P e083b2fa907d42b3b33dfba2d9f45240 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:12.041965 24534 raft_consensus.cc:2272] T cf7d17c9f4f54d63ac12f4015065ab60 P e083b2fa907d42b3b33dfba2d9f45240 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.045020 24534 tablet_replica.cc:333] T 2256c4cd63e6474aa804844ed7cd18fa P e083b2fa907d42b3b33dfba2d9f45240: stopping tablet replica
I20260709 12:28:12.045707 24534 raft_consensus.cc:2243] T 2256c4cd63e6474aa804844ed7cd18fa P e083b2fa907d42b3b33dfba2d9f45240 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:12.046944 24534 raft_consensus.cc:2272] T 2256c4cd63e6474aa804844ed7cd18fa P e083b2fa907d42b3b33dfba2d9f45240 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.049436 24534 tablet_replica.cc:333] T a7b82f2b2be84e8aad65ee4199ce5224 P e083b2fa907d42b3b33dfba2d9f45240: stopping tablet replica
I20260709 12:28:12.050006 24534 raft_consensus.cc:2243] T a7b82f2b2be84e8aad65ee4199ce5224 P e083b2fa907d42b3b33dfba2d9f45240 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:12.050525 24534 raft_consensus.cc:2272] T a7b82f2b2be84e8aad65ee4199ce5224 P e083b2fa907d42b3b33dfba2d9f45240 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.052838 24534 tablet_replica.cc:333] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e083b2fa907d42b3b33dfba2d9f45240: stopping tablet replica
I20260709 12:28:12.053339 24534 raft_consensus.cc:2243] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e083b2fa907d42b3b33dfba2d9f45240 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:12.054416 24534 raft_consensus.cc:2272] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e083b2fa907d42b3b33dfba2d9f45240 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.057225 24534 tablet_replica.cc:333] T 70d90926ee274610a5addbacc456d3e6 P e083b2fa907d42b3b33dfba2d9f45240: stopping tablet replica
I20260709 12:28:12.057817 24534 raft_consensus.cc:2243] T 70d90926ee274610a5addbacc456d3e6 P e083b2fa907d42b3b33dfba2d9f45240 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:12.058425 24534 raft_consensus.cc:2272] T 70d90926ee274610a5addbacc456d3e6 P e083b2fa907d42b3b33dfba2d9f45240 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.060853 24534 tablet_replica.cc:333] T 26574dc41db14da1a6bb7492fdbcf01b P e083b2fa907d42b3b33dfba2d9f45240: stopping tablet replica
I20260709 12:28:12.061360 24534 raft_consensus.cc:2243] T 26574dc41db14da1a6bb7492fdbcf01b P e083b2fa907d42b3b33dfba2d9f45240 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:12.062244 24534 raft_consensus.cc:2272] T 26574dc41db14da1a6bb7492fdbcf01b P e083b2fa907d42b3b33dfba2d9f45240 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.109223 24534 tablet_server.cc:196] TabletServer@127.23.245.129:0 shutdown complete.
I20260709 12:28:12.156750 24534 tablet_server.cc:179] TabletServer@127.23.245.130:0 shutting down...
W20260709 12:28:12.159046  4007 consensus_peers.cc:597] T b76c818ee9f34bddaec899987166e3c7 P ffc6860a7daf42ea871d9389b9fce64a -> Peer e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229): Couldn't send request to peer e083b2fa907d42b3b33dfba2d9f45240. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:34229: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:12.157444  4081 consensus_peers.cc:597] T 018fbc94678e41318e867a918691041b P e134dafee8df424690057d14e75c2e82 -> Peer e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229): Couldn't send request to peer e083b2fa907d42b3b33dfba2d9f45240. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:34229: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:12.189210 24534 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:12.190272 24534 tablet_replica.cc:333] T d7bf8a5e5f8648a08295d2e0e9da0b41 P ffc6860a7daf42ea871d9389b9fce64a: stopping tablet replica
W20260709 12:28:12.190774  4007 consensus_peers.cc:597] T a7b82f2b2be84e8aad65ee4199ce5224 P ffc6860a7daf42ea871d9389b9fce64a -> Peer e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229): Couldn't send request to peer e083b2fa907d42b3b33dfba2d9f45240. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:34229: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:12.191463 24534 raft_consensus.cc:2243] T d7bf8a5e5f8648a08295d2e0e9da0b41 P ffc6860a7daf42ea871d9389b9fce64a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:12.192315 24534 raft_consensus.cc:2272] T d7bf8a5e5f8648a08295d2e0e9da0b41 P ffc6860a7daf42ea871d9389b9fce64a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.196048 24534 tablet_replica.cc:333] T d97a598a1a4d49d6af38a80b7d94085a P ffc6860a7daf42ea871d9389b9fce64a: stopping tablet replica
I20260709 12:28:12.196679 24534 raft_consensus.cc:2243] T d97a598a1a4d49d6af38a80b7d94085a P ffc6860a7daf42ea871d9389b9fce64a [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:28:12.197568  4079 consensus_peers.cc:597] T 018fbc94678e41318e867a918691041b P e134dafee8df424690057d14e75c2e82 -> Peer ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130:46493): Couldn't send request to peer ffc6860a7daf42ea871d9389b9fce64a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:12.197939 24534 raft_consensus.cc:2272] T d97a598a1a4d49d6af38a80b7d94085a P ffc6860a7daf42ea871d9389b9fce64a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:12.198944  4007 consensus_peers.cc:597] T ca9249d3904b4b4580d1c289f923daee P ffc6860a7daf42ea871d9389b9fce64a -> Peer e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229): Couldn't send request to peer e083b2fa907d42b3b33dfba2d9f45240. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:34229: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:12.201148 24534 tablet_replica.cc:333] T 2ee866cdb98640d78e7b5d108a652846 P ffc6860a7daf42ea871d9389b9fce64a: stopping tablet replica
I20260709 12:28:12.201982 24534 raft_consensus.cc:2243] T 2ee866cdb98640d78e7b5d108a652846 P ffc6860a7daf42ea871d9389b9fce64a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:12.202574 24534 raft_consensus.cc:2272] T 2ee866cdb98640d78e7b5d108a652846 P ffc6860a7daf42ea871d9389b9fce64a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.206437 24534 tablet_replica.cc:333] T 018fbc94678e41318e867a918691041b P ffc6860a7daf42ea871d9389b9fce64a: stopping tablet replica
I20260709 12:28:12.207089 24534 raft_consensus.cc:2243] T 018fbc94678e41318e867a918691041b P ffc6860a7daf42ea871d9389b9fce64a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:12.207563 24534 raft_consensus.cc:2272] T 018fbc94678e41318e867a918691041b P ffc6860a7daf42ea871d9389b9fce64a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.210170 24534 tablet_replica.cc:333] T b76c818ee9f34bddaec899987166e3c7 P ffc6860a7daf42ea871d9389b9fce64a: stopping tablet replica
I20260709 12:28:12.210811 24534 raft_consensus.cc:2243] T b76c818ee9f34bddaec899987166e3c7 P ffc6860a7daf42ea871d9389b9fce64a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:12.212066 24534 raft_consensus.cc:2272] T b76c818ee9f34bddaec899987166e3c7 P ffc6860a7daf42ea871d9389b9fce64a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.214251 24534 tablet_replica.cc:333] T b03341ea7bb64c2085bdecf904d11548 P ffc6860a7daf42ea871d9389b9fce64a: stopping tablet replica
I20260709 12:28:12.215080 24534 raft_consensus.cc:2243] T b03341ea7bb64c2085bdecf904d11548 P ffc6860a7daf42ea871d9389b9fce64a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:12.215721 24534 raft_consensus.cc:2272] T b03341ea7bb64c2085bdecf904d11548 P ffc6860a7daf42ea871d9389b9fce64a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.218588 24534 tablet_replica.cc:333] T 7e083776605c4a658bcca9cb211a4cf6 P ffc6860a7daf42ea871d9389b9fce64a: stopping tablet replica
I20260709 12:28:12.219110 24534 raft_consensus.cc:2243] T 7e083776605c4a658bcca9cb211a4cf6 P ffc6860a7daf42ea871d9389b9fce64a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:12.219585 24534 raft_consensus.cc:2272] T 7e083776605c4a658bcca9cb211a4cf6 P ffc6860a7daf42ea871d9389b9fce64a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.221772 24534 tablet_replica.cc:333] T ccef56abf48c4dd5bbb5bd65364ae3a9 P ffc6860a7daf42ea871d9389b9fce64a: stopping tablet replica
I20260709 12:28:12.222400 24534 raft_consensus.cc:2243] T ccef56abf48c4dd5bbb5bd65364ae3a9 P ffc6860a7daf42ea871d9389b9fce64a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:12.222801 24534 raft_consensus.cc:2272] T ccef56abf48c4dd5bbb5bd65364ae3a9 P ffc6860a7daf42ea871d9389b9fce64a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.224843 24534 tablet_replica.cc:333] T 4e1151150f9a467ebd21f401fb352c29 P ffc6860a7daf42ea871d9389b9fce64a: stopping tablet replica
I20260709 12:28:12.225322 24534 raft_consensus.cc:2243] T 4e1151150f9a467ebd21f401fb352c29 P ffc6860a7daf42ea871d9389b9fce64a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:12.225786 24534 raft_consensus.cc:2272] T 4e1151150f9a467ebd21f401fb352c29 P ffc6860a7daf42ea871d9389b9fce64a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.227908 24534 tablet_replica.cc:333] T 9dccf99aa7894eb5b71293becf61aff1 P ffc6860a7daf42ea871d9389b9fce64a: stopping tablet replica
I20260709 12:28:12.228403 24534 raft_consensus.cc:2243] T 9dccf99aa7894eb5b71293becf61aff1 P ffc6860a7daf42ea871d9389b9fce64a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:12.229154 24534 raft_consensus.cc:2272] T 9dccf99aa7894eb5b71293becf61aff1 P ffc6860a7daf42ea871d9389b9fce64a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.231210 24534 tablet_replica.cc:333] T 70d90926ee274610a5addbacc456d3e6 P ffc6860a7daf42ea871d9389b9fce64a: stopping tablet replica
I20260709 12:28:12.231709 24534 raft_consensus.cc:2243] T 70d90926ee274610a5addbacc456d3e6 P ffc6860a7daf42ea871d9389b9fce64a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:12.232523 24534 raft_consensus.cc:2272] T 70d90926ee274610a5addbacc456d3e6 P ffc6860a7daf42ea871d9389b9fce64a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.234616 24534 tablet_replica.cc:333] T 26574dc41db14da1a6bb7492fdbcf01b P ffc6860a7daf42ea871d9389b9fce64a: stopping tablet replica
I20260709 12:28:12.235100 24534 raft_consensus.cc:2243] T 26574dc41db14da1a6bb7492fdbcf01b P ffc6860a7daf42ea871d9389b9fce64a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:12.235522 24534 raft_consensus.cc:2272] T 26574dc41db14da1a6bb7492fdbcf01b P ffc6860a7daf42ea871d9389b9fce64a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.237704 24534 tablet_replica.cc:333] T cf7d17c9f4f54d63ac12f4015065ab60 P ffc6860a7daf42ea871d9389b9fce64a: stopping tablet replica
I20260709 12:28:12.238284 24534 raft_consensus.cc:2243] T cf7d17c9f4f54d63ac12f4015065ab60 P ffc6860a7daf42ea871d9389b9fce64a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:12.238817 24534 raft_consensus.cc:2272] T cf7d17c9f4f54d63ac12f4015065ab60 P ffc6860a7daf42ea871d9389b9fce64a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.241111 24534 tablet_replica.cc:333] T 2256c4cd63e6474aa804844ed7cd18fa P ffc6860a7daf42ea871d9389b9fce64a: stopping tablet replica
I20260709 12:28:12.241564 24534 raft_consensus.cc:2243] T 2256c4cd63e6474aa804844ed7cd18fa P ffc6860a7daf42ea871d9389b9fce64a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:12.241994 24534 raft_consensus.cc:2272] T 2256c4cd63e6474aa804844ed7cd18fa P ffc6860a7daf42ea871d9389b9fce64a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.244053 24534 tablet_replica.cc:333] T acbdf543b174470e9a0d4e181804ae01 P ffc6860a7daf42ea871d9389b9fce64a: stopping tablet replica
I20260709 12:28:12.244515 24534 raft_consensus.cc:2243] T acbdf543b174470e9a0d4e181804ae01 P ffc6860a7daf42ea871d9389b9fce64a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:12.244935 24534 raft_consensus.cc:2272] T acbdf543b174470e9a0d4e181804ae01 P ffc6860a7daf42ea871d9389b9fce64a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.246961 24534 tablet_replica.cc:333] T a7b82f2b2be84e8aad65ee4199ce5224 P ffc6860a7daf42ea871d9389b9fce64a: stopping tablet replica
I20260709 12:28:12.247411 24534 raft_consensus.cc:2243] T a7b82f2b2be84e8aad65ee4199ce5224 P ffc6860a7daf42ea871d9389b9fce64a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:12.248344 24534 raft_consensus.cc:2272] T a7b82f2b2be84e8aad65ee4199ce5224 P ffc6860a7daf42ea871d9389b9fce64a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.250434 24534 tablet_replica.cc:333] T 6a3d62d2c10d46e1ae7198117fa43d67 P ffc6860a7daf42ea871d9389b9fce64a: stopping tablet replica
I20260709 12:28:12.250934 24534 raft_consensus.cc:2243] T 6a3d62d2c10d46e1ae7198117fa43d67 P ffc6860a7daf42ea871d9389b9fce64a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:12.251770 24534 raft_consensus.cc:2272] T 6a3d62d2c10d46e1ae7198117fa43d67 P ffc6860a7daf42ea871d9389b9fce64a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.253935 24534 tablet_replica.cc:333] T ca9249d3904b4b4580d1c289f923daee P ffc6860a7daf42ea871d9389b9fce64a: stopping tablet replica
I20260709 12:28:12.254467 24534 raft_consensus.cc:2243] T ca9249d3904b4b4580d1c289f923daee P ffc6860a7daf42ea871d9389b9fce64a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:12.255278 24534 raft_consensus.cc:2272] T ca9249d3904b4b4580d1c289f923daee P ffc6860a7daf42ea871d9389b9fce64a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:12.264355  4079 consensus_peers.cc:597] T 7e083776605c4a658bcca9cb211a4cf6 P e134dafee8df424690057d14e75c2e82 -> Peer ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130:46493): Couldn't send request to peer ffc6860a7daf42ea871d9389b9fce64a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:12.319734 24534 tablet_server.cc:196] TabletServer@127.23.245.130:0 shutdown complete.
W20260709 12:28:12.349385  4081 consensus_peers.cc:597] T 7e083776605c4a658bcca9cb211a4cf6 P e134dafee8df424690057d14e75c2e82 -> Peer e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229): Couldn't send request to peer e083b2fa907d42b3b33dfba2d9f45240. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:34229: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:12.362149 24534 tablet_server.cc:179] TabletServer@127.23.245.131:0 shutting down...
I20260709 12:28:12.390635 24534 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:12.391451 24534 tablet_replica.cc:333] T d7bf8a5e5f8648a08295d2e0e9da0b41 P e134dafee8df424690057d14e75c2e82: stopping tablet replica
I20260709 12:28:12.392302 24534 raft_consensus.cc:2243] T d7bf8a5e5f8648a08295d2e0e9da0b41 P e134dafee8df424690057d14e75c2e82 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:12.393225 24534 raft_consensus.cc:2272] T d7bf8a5e5f8648a08295d2e0e9da0b41 P e134dafee8df424690057d14e75c2e82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.395519 24534 tablet_replica.cc:333] T d97a598a1a4d49d6af38a80b7d94085a P e134dafee8df424690057d14e75c2e82: stopping tablet replica
I20260709 12:28:12.396152 24534 raft_consensus.cc:2243] T d97a598a1a4d49d6af38a80b7d94085a P e134dafee8df424690057d14e75c2e82 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:12.396652 24534 raft_consensus.cc:2272] T d97a598a1a4d49d6af38a80b7d94085a P e134dafee8df424690057d14e75c2e82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.399014 24534 tablet_replica.cc:333] T 2ee866cdb98640d78e7b5d108a652846 P e134dafee8df424690057d14e75c2e82: stopping tablet replica
I20260709 12:28:12.399624 24534 raft_consensus.cc:2243] T 2ee866cdb98640d78e7b5d108a652846 P e134dafee8df424690057d14e75c2e82 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:12.400182 24534 raft_consensus.cc:2272] T 2ee866cdb98640d78e7b5d108a652846 P e134dafee8df424690057d14e75c2e82 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.402324 24534 tablet_replica.cc:333] T 018fbc94678e41318e867a918691041b P e134dafee8df424690057d14e75c2e82: stopping tablet replica
I20260709 12:28:12.402873 24534 raft_consensus.cc:2243] T 018fbc94678e41318e867a918691041b P e134dafee8df424690057d14e75c2e82 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:28:12.403818 24534 raft_consensus.cc:2272] T 018fbc94678e41318e867a918691041b P e134dafee8df424690057d14e75c2e82 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.406025 24534 tablet_replica.cc:333] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e134dafee8df424690057d14e75c2e82: stopping tablet replica
I20260709 12:28:12.406582 24534 raft_consensus.cc:2243] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e134dafee8df424690057d14e75c2e82 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:12.407056 24534 raft_consensus.cc:2272] T ccef56abf48c4dd5bbb5bd65364ae3a9 P e134dafee8df424690057d14e75c2e82 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.409348 24534 tablet_replica.cc:333] T cf7d17c9f4f54d63ac12f4015065ab60 P e134dafee8df424690057d14e75c2e82: stopping tablet replica
I20260709 12:28:12.409907 24534 raft_consensus.cc:2243] T cf7d17c9f4f54d63ac12f4015065ab60 P e134dafee8df424690057d14e75c2e82 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:12.410390 24534 raft_consensus.cc:2272] T cf7d17c9f4f54d63ac12f4015065ab60 P e134dafee8df424690057d14e75c2e82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.412541 24534 tablet_replica.cc:333] T 2256c4cd63e6474aa804844ed7cd18fa P e134dafee8df424690057d14e75c2e82: stopping tablet replica
I20260709 12:28:12.413081 24534 raft_consensus.cc:2243] T 2256c4cd63e6474aa804844ed7cd18fa P e134dafee8df424690057d14e75c2e82 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:12.413601 24534 raft_consensus.cc:2272] T 2256c4cd63e6474aa804844ed7cd18fa P e134dafee8df424690057d14e75c2e82 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.415618 24534 tablet_replica.cc:333] T acbdf543b174470e9a0d4e181804ae01 P e134dafee8df424690057d14e75c2e82: stopping tablet replica
I20260709 12:28:12.416308 24534 raft_consensus.cc:2243] T acbdf543b174470e9a0d4e181804ae01 P e134dafee8df424690057d14e75c2e82 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:12.416926 24534 raft_consensus.cc:2272] T acbdf543b174470e9a0d4e181804ae01 P e134dafee8df424690057d14e75c2e82 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.420027 24534 tablet_replica.cc:333] T a7b82f2b2be84e8aad65ee4199ce5224 P e134dafee8df424690057d14e75c2e82: stopping tablet replica
I20260709 12:28:12.420631 24534 raft_consensus.cc:2243] T a7b82f2b2be84e8aad65ee4199ce5224 P e134dafee8df424690057d14e75c2e82 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:28:12.420771  4079 consensus_peers.cc:597] T b03341ea7bb64c2085bdecf904d11548 P e134dafee8df424690057d14e75c2e82 -> Peer ffc6860a7daf42ea871d9389b9fce64a (127.23.245.130:46493): Couldn't send request to peer ffc6860a7daf42ea871d9389b9fce64a. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.130:46493: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:12.421388 24534 raft_consensus.cc:2272] T a7b82f2b2be84e8aad65ee4199ce5224 P e134dafee8df424690057d14e75c2e82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.424129 24534 tablet_replica.cc:333] T 6a3d62d2c10d46e1ae7198117fa43d67 P e134dafee8df424690057d14e75c2e82: stopping tablet replica
I20260709 12:28:12.424741 24534 raft_consensus.cc:2243] T 6a3d62d2c10d46e1ae7198117fa43d67 P e134dafee8df424690057d14e75c2e82 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:12.425326 24534 raft_consensus.cc:2272] T 6a3d62d2c10d46e1ae7198117fa43d67 P e134dafee8df424690057d14e75c2e82 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:12.425738  4081 consensus_peers.cc:597] T b03341ea7bb64c2085bdecf904d11548 P e134dafee8df424690057d14e75c2e82 -> Peer e083b2fa907d42b3b33dfba2d9f45240 (127.23.245.129:34229): Couldn't send request to peer e083b2fa907d42b3b33dfba2d9f45240. Status: Network error: Client connection negotiation failed: client connection to 127.23.245.129:34229: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:12.427664 24534 tablet_replica.cc:333] T ca9249d3904b4b4580d1c289f923daee P e134dafee8df424690057d14e75c2e82: stopping tablet replica
I20260709 12:28:12.428342 24534 raft_consensus.cc:2243] T ca9249d3904b4b4580d1c289f923daee P e134dafee8df424690057d14e75c2e82 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:12.428750 24534 raft_consensus.cc:2272] T ca9249d3904b4b4580d1c289f923daee P e134dafee8df424690057d14e75c2e82 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.430760 24534 tablet_replica.cc:333] T 4e1151150f9a467ebd21f401fb352c29 P e134dafee8df424690057d14e75c2e82: stopping tablet replica
I20260709 12:28:12.431265 24534 raft_consensus.cc:2243] T 4e1151150f9a467ebd21f401fb352c29 P e134dafee8df424690057d14e75c2e82 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:12.431802 24534 raft_consensus.cc:2272] T 4e1151150f9a467ebd21f401fb352c29 P e134dafee8df424690057d14e75c2e82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.433847 24534 tablet_replica.cc:333] T 9dccf99aa7894eb5b71293becf61aff1 P e134dafee8df424690057d14e75c2e82: stopping tablet replica
I20260709 12:28:12.434324 24534 raft_consensus.cc:2243] T 9dccf99aa7894eb5b71293becf61aff1 P e134dafee8df424690057d14e75c2e82 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:12.434702 24534 raft_consensus.cc:2272] T 9dccf99aa7894eb5b71293becf61aff1 P e134dafee8df424690057d14e75c2e82 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.436757 24534 tablet_replica.cc:333] T b76c818ee9f34bddaec899987166e3c7 P e134dafee8df424690057d14e75c2e82: stopping tablet replica
I20260709 12:28:12.437230 24534 raft_consensus.cc:2243] T b76c818ee9f34bddaec899987166e3c7 P e134dafee8df424690057d14e75c2e82 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:12.437670 24534 raft_consensus.cc:2272] T b76c818ee9f34bddaec899987166e3c7 P e134dafee8df424690057d14e75c2e82 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.439847 24534 tablet_replica.cc:333] T b03341ea7bb64c2085bdecf904d11548 P e134dafee8df424690057d14e75c2e82: stopping tablet replica
I20260709 12:28:12.440450 24534 raft_consensus.cc:2243] T b03341ea7bb64c2085bdecf904d11548 P e134dafee8df424690057d14e75c2e82 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:12.441237 24534 raft_consensus.cc:2272] T b03341ea7bb64c2085bdecf904d11548 P e134dafee8df424690057d14e75c2e82 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.443250 24534 tablet_replica.cc:333] T 7e083776605c4a658bcca9cb211a4cf6 P e134dafee8df424690057d14e75c2e82: stopping tablet replica
I20260709 12:28:12.443692 24534 raft_consensus.cc:2243] T 7e083776605c4a658bcca9cb211a4cf6 P e134dafee8df424690057d14e75c2e82 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:28:12.444511 24534 raft_consensus.cc:2272] T 7e083776605c4a658bcca9cb211a4cf6 P e134dafee8df424690057d14e75c2e82 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.446400 24534 tablet_replica.cc:333] T 70d90926ee274610a5addbacc456d3e6 P e134dafee8df424690057d14e75c2e82: stopping tablet replica
I20260709 12:28:12.446841 24534 raft_consensus.cc:2243] T 70d90926ee274610a5addbacc456d3e6 P e134dafee8df424690057d14e75c2e82 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:12.447237 24534 raft_consensus.cc:2272] T 70d90926ee274610a5addbacc456d3e6 P e134dafee8df424690057d14e75c2e82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.449216 24534 tablet_replica.cc:333] T 26574dc41db14da1a6bb7492fdbcf01b P e134dafee8df424690057d14e75c2e82: stopping tablet replica
I20260709 12:28:12.449645 24534 raft_consensus.cc:2243] T 26574dc41db14da1a6bb7492fdbcf01b P e134dafee8df424690057d14e75c2e82 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:12.450031 24534 raft_consensus.cc:2272] T 26574dc41db14da1a6bb7492fdbcf01b P e134dafee8df424690057d14e75c2e82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.492041 24534 tablet_server.cc:196] TabletServer@127.23.245.131:0 shutdown complete.
I20260709 12:28:12.527791 24534 master.cc:562] Master@127.23.245.190:34641 shutting down...
I20260709 12:28:12.551764 24534 raft_consensus.cc:2243] T 00000000000000000000000000000000 P f4f33ba8e7c646919d5a390966cdd894 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:12.552479 24534 raft_consensus.cc:2272] T 00000000000000000000000000000000 P f4f33ba8e7c646919d5a390966cdd894 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:12.552827 24534 tablet_replica.cc:333] T 00000000000000000000000000000000 P f4f33ba8e7c646919d5a390966cdd894: stopping tablet replica
I20260709 12:28:12.573676 24534 master.cc:584] Master@127.23.245.190:34641 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (21503 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (44382 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (388183 ms total)
[  PASSED  ] 8 tests.
I20260709 12:28:12.635771 24534 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 2279 messages since previous log ~34 seconds ago
I20260709 12:28:12.636199 24534 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 2284 messages since previous log ~34 seconds ago
I20260709 12:28:12.636399 24534 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 2284 messages since previous log ~34 seconds ago
I20260709 12:28:12.636627 24534 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~52 seconds ago
I20260709 12:28:12.636824 24534 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~52 seconds ago
I20260709 12:28:12.637048 24534 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/master/catalog_manager.cc:4755: suppressed but not reported on 1 messages since previous log ~114 seconds ago
I20260709 12:28:12.637257 24534 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 9 messages since previous log ~176 seconds ago
I20260709 12:28:12.637518 24534 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 10 messages since previous log ~0 seconds ago
I20260709 12:28:12.637820 24534 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~20 seconds ago
